Also tweak Hive a bit and refer to artifacts in a new (but not totally
ideal) location.
Co-Authored-By: Jeremy Freudberg <jeremyfreudberg@gmail.com>
Change-Id: I3a25ee8c282849911089adf6c3593b1bb50fd067
we don't have vanilla 2.6.0 in supported list
in all current branches of sahara. we can
just drop that. if needed, stable/mitaka
branch should be used for building that image.
Change-Id: I81ed8209f2154f112fe7f6718029b84548793380
Drop support for generating vanilla/hadoop v1 images. This version is
deprecated in Sahara, and the support for going to be removed soon.
Partially-implements bp: drop-hadoop-1
Change-Id: I7b0d36d255a783057c7c5876017653e0f28f83de
New vanilla would contain following elements:
* 2.7.1 version of hadoop
* 4.2.0 version of oozie
Implements blueprint: support-vanilla-2-7-1
Depends-On: Iae884d9f044ba1fe64b6d4ff23fa6ebabdbb41d9
Change-Id: I4191d6bb7e323709cd14744df3d5c8695c1eddee
Make use of the package-installs element to declare in yaml format the
packages to be installed at the beginning of a phase.
Other than reducing the amont of explicit 'install-packages pkg1 ...'
invocations, they can also be installed just once per-phase.
Change-Id: I1f1acfb2bd74fed5cf4c0b48bc739f7f75c35d83
Following the latest dib-lint reporting, make sure almost all the
scripts are enabling -e, -u, and pipefail. This eases the discovery of
failing commands, and the usage of unset variables.
There are few exceptions with flags not set:
* elements/hadoop-hdp/install.d/40-install-hdp, set -e
when installing HDP 2.0, it tries to install tez, which does not seem
to exist in Hortonworks' repositories
* elements/ssh/install.d/33-ssh, set -e
the version of augtool (part of augeas 0.10) in older Ubuntu versions
(like Precise, needed by the cloudera plugin) exits with wrong return
values in autosave mode
* elements/storm/install.d/60-storm, set -e
It tries to change the permission of /etc/supervisord.conf, which does
not seem to exist
Change-Id: Ic1314639dfc6a66c48ca87b6820707a2b0cb1dbd
Partial-Bug: #1435306
Use the cache-url script (in the element cache-url) to download and
cache resources which might be expensive (mostly because of their size)
to fetch every time.
As the shared cache ($DIB_IMAGE_CACHE) is available only when running
the root.d elements, move the download phases to root.d scripts.
Change-Id: Iec3e0f92e62c4c9542487a3c228ba8f9e884e5dd
Make sure that, even when set -u, scripts can run handling unset
variables correctly.
All the changes involve variables optionally set by the user.
Change-Id: If74051fb5882eacdaa49ca7e35d2808f3989bd17
Mimic commit 36b59c001c1643217449646b371df46d2cb11b91 in
diskimage-builder, by adopting the usage of $DIB_DEBUG_TRACE to check
whether enable tracing in scripts.
Unlike with the diskimage-builder commit, the default is to not enable
tracing even in the few scripts that used to unconditionally "set -x".
Enabling tracing can be done by either:
- passing -x to disk-image-create
- exporting DIB_DEBUG_TRACE=N, with N=0/1
Change-Id: I56ccd6753df31f7ddda641640cdb1985b2d9e856
Partial-Bug: #1435306
Vanilla 2.3 deprecated in Juno
Vanilla 2.4 deprecated in Kilo
Need to remove code for building these images.
Implements blueprint drop-hadoop-2-3-support
Change-Id: Ie981346bfd5dd98d9c48740f74ccff0bf424136b
If you build all images for vanilla plugin then for vanilla 2
image install oozie with hadoop 1. This patch fixed it.
Closes-bug: #1305123
Change-Id: Ic9911b05774b063dc7640d8fdaa684fa7688ae71
* New element name is 'oozie'
* Parameters for Oozie libs are OOZIE_DOWNLOAD_URL and OOZIE_FILE
Implements: blueprint edp-dib-element-oozie-vanilla
Change-Id: I7e107b51d5aef5d225690c0f7633dbccc072fe27
Zhuang Changkun