Useful to generate a single image on-the-fly
and use it for scenario tests
(or simply useful for a refactor of the rest of the
build-images script).
Change-Id: Ica615e9e7d93b38fd12189a9f97d26ca62d84a3e
Also tweak Hive a bit and refer to artifacts in a new (but not totally
ideal) location.
Co-Authored-By: Jeremy Freudberg <jeremyfreudberg@gmail.com>
Change-Id: I3a25ee8c282849911089adf6c3593b1bb50fd067
Following the approved spec:
- do not automatically build centos (CentOS 6) images when no
operating system is specified for a specific plugin;
- if 'centos' is explicitly specified, print out a warning message.
- whenever 'centos' is explicitly specified by the gate script,
do not build it anymore.
Blueprint: deprecate-centos6-images
Change-Id: I4e11b97061d6e1f9804bae0157a345ed484d7dbe
Added support of CDH 5.7 for ubuntu, centos and centos7.
Also added support of CDH minor versions (5.7.0 and 5.7.1) that we
can set with DIB_CDH_MINOR_VERSION variable
By default it builds 5.7.0 version.
note: for Spark plugin we use HDFS part of CDH so we don't need to
create symbolic links for oozie (so for this we check variable
DIB_CDH_HDFS_ONLY)
depends-on: I1167d0d98ae6fb6fabaf7f1f9a344691d459b50b
Change-Id: I1d71ffbdf78373d27f7e1304164b32da786ac10b
bp: cdh-5-7-support
This commit adds support for diskimage-create.sh to create
Centos 7 images with CDH 5.5.
There are also minor changes to the repo definitions for
Centos/RHEL to use the $releasever variable
Also modifies the gate script to create the Centos 7 image
Change-Id: I9d563bdb5f5a1eb0243db376bf28113e8c416511
Closes-Bug: #1581233
This job has been failing because we use ubuntu as base image OS
which is not supported in ambari version <= 2.1.1
Change-Id: I5feb11d94435bd48b8116be3986e588fca16f47c
Closes-bug: 1540318
Generating cloudera images requires lots of space, in terms of cached
resources (distribution base images, packages, etc) and generated
images. This causes the generation of all the cloudera images to
(almost?) always fail on the gate slaves, as running out of space.
As a workaround to this, manually invoke the generation of cloudera
images per-distro, cleaning the cache (which contains mostly stuff
specific to the last built distribution) and the generated images after
each run.
Change-Id: I4468f9e2926e101864e73f8aedf7b0612a3f7a96
This change removes the global system updates in favor of only updating
the required packages for diskimage creation. Additionally the script
will not automatically install the updates but will warn the user if the
packages are not installed. A switch is provided to allow the script to
install the updates.
Changes
* adding function to detect an installed package
* adding function to check for a list of installed packages
* adding command line switch for updating (-u)
* removing global update commands
* refactoring update logic to fail gracefully or accept switch
* adding -u switch to build-images gate tool
* adding note in documentation about update command line switch
Closes-Bug: 1375843
Change-Id: Iba5e676fa8ef7a852b71acd9e4c19d32f848285a
It will simplify configuring and tuning for our upcoming images
gating. In gate job we'll just exec this script and it will do
all the things we need. Let's start just with the building all
images for the specified plugin.
Change-Id: Iecef82bec8eb8d10218c5ad2b763ccabb41053ad