On the process of upgrading Storm to version 1.0.1 we need to provide
images for the cluster. This patch allows the creation of Storm images
using 1.0.1 version as well as 0.9.2. The default value is set to 1.0.1
Change-Id: I5fbe0c194d83aba1fc09f26bc259c59c4f8a27ce
Partially-implements: blueprint upgrade-storm-1-0-1
Make use of the package-installs element to declare in yaml format the
packages to be installed at the beginning of a phase.
Other than reducing the amont of explicit 'install-packages pkg1 ...'
invocations, they can also be installed just once per-phase.
Change-Id: I1f1acfb2bd74fed5cf4c0b48bc739f7f75c35d83
Supervisor conf file path is used as /etc/supervisord.conf and it should
be /etc/supervisor/supervisord.conf
Change-Id: I756124ee9c6ffac9c477e645b92fba08a7099940
Closes-bug: 1441293
Following the latest dib-lint reporting, make sure almost all the
scripts are enabling -e, -u, and pipefail. This eases the discovery of
failing commands, and the usage of unset variables.
There are few exceptions with flags not set:
* elements/hadoop-hdp/install.d/40-install-hdp, set -e
when installing HDP 2.0, it tries to install tez, which does not seem
to exist in Hortonworks' repositories
* elements/ssh/install.d/33-ssh, set -e
the version of augtool (part of augeas 0.10) in older Ubuntu versions
(like Precise, needed by the cloudera plugin) exits with wrong return
values in autosave mode
* elements/storm/install.d/60-storm, set -e
It tries to change the permission of /etc/supervisord.conf, which does
not seem to exist
Change-Id: Ic1314639dfc6a66c48ca87b6820707a2b0cb1dbd
Partial-Bug: #1435306
Use the cache-url script (in the element cache-url) to download and
cache resources which might be expensive (mostly because of their size)
to fetch every time.
As the shared cache ($DIB_IMAGE_CACHE) is available only when running
the root.d elements, move the download phases to root.d scripts.
Change-Id: Iec3e0f92e62c4c9542487a3c228ba8f9e884e5dd
Make sure that, even when set -u, scripts can run handling unset
variables correctly.
All the changes involve variables optionally set by the user.
Change-Id: If74051fb5882eacdaa49ca7e35d2808f3989bd17
Mimic commit 36b59c001c1643217449646b371df46d2cb11b91 in
diskimage-builder, by adopting the usage of $DIB_DEBUG_TRACE to check
whether enable tracing in scripts.
Unlike with the diskimage-builder commit, the default is to not enable
tracing even in the few scripts that used to unconditionally "set -x".
Enabling tracing can be done by either:
- passing -x to disk-image-create
- exporting DIB_DEBUG_TRACE=N, with N=0/1
Change-Id: I56ccd6753df31f7ddda641640cdb1985b2d9e856
Partial-Bug: #1435306
ZeroMQ is not necessary anymore for Storm. Without ZeroMQ the default
Netty is used for messaging.
Closes-bug: #1390446
Change-Id: Iff91dfc96d9644087f0b32c1ce694c20d9e14d3a
This patch implements storm element and zookeeper.
They are both needed by storm plugin.
Change-Id: If279457b8f2b0fc18dca031afa979d0485bbbd81
Partial-implements: blueprint storm-integration
Telles Nobrega