Commit Graph

23 Commits

Author SHA1 Message Date
Luigi Toscano 2d0c3a8b98 Fix the buildimages jobs: call the ensure-tox role
... and use its output.

tox is not available by default on the images anymore.

Change-Id: If5ea0ffdfc51860842c19f0a6f238127d42eb292
2020-08-10 18:00:06 +02:00
Zhuang Changkun 83224a6c5e Add support to build 3.0.1 image
Change-Id: I1d90099b22ed9a0ede08df45059e6d7848c237b8
2018-06-08 14:11:37 +08:00
Zuul aa3ff84f2b Merge "Add support to build 2.7.5 image" 2018-05-10 14:41:00 +00:00
Zhuang Changkun 5707f5cc5a Add support to build 2.7.5 image
Change-Id: Ia16692632cbe6380d4021dd031eed09362873905
2018-04-17 19:26:08 +08:00
Luigi Toscano ba498abc7d Zuul roles: allow to build only a specific image
Useful to generate a single image on-the-fly
and use it for scenario tests
(or simply useful for a refactor of the rest of the
build-images script).

Change-Id: Ica615e9e7d93b38fd12189a9f97d26ca62d84a3e
2018-03-30 15:33:35 +02:00
Shu Yingya 12efcf84e2 Add support to build 2.8.2 image
Also tweak Hive a bit and refer to artifacts in a new (but not totally
ideal) location.

Co-Authored-By: Jeremy Freudberg <jeremyfreudberg@gmail.com>
Change-Id: I3a25ee8c282849911089adf6c3593b1bb50fd067
2018-03-01 09:51:01 +08:00
Evgeny Sikachov 8f2caee358 Add support to create CDH 5.11 images
Change-Id: Ibd61ca89bb24e369cca5d06e338edef2f0c6f6d6
2017-07-25 17:26:40 +00:00
Luigi Toscano 802379aba6 Deprecate and don't build CentOS 6 images by default
Following the approved spec:
- do not automatically build centos (CentOS 6) images when no
  operating system is specified for a specific plugin;
- if 'centos' is explicitly specified, print out a warning message.
- whenever 'centos' is explicitly specified by the gate script,
  do not build it anymore.
Blueprint: deprecate-centos6-images
Change-Id: I4e11b97061d6e1f9804bae0157a345ed484d7dbe
2017-07-13 10:05:19 +02:00
yingya.shu 4cc289bc0c [CDH] Support CDH 5.9
Added support of CDH 5.9 for ubuntu, centos and centos7.

Change-Id: I14aad25829d011e14f37bf0ff50e50b157681163
bp: cdh-5-9-support
2016-12-09 11:05:54 +00:00
Vitaly Gridnev 347b0a0fef improve building images in gate for vanilla
Change-Id: I9d6895b6d472f2bd3874665a1f3a52505e095c1f
2016-08-16 15:45:31 +03:00
Michael Ionkin 038ea3a6f1 [CDH] Support CDH 5.7
Added support of CDH 5.7 for ubuntu, centos and centos7.
Also added support of CDH minor versions (5.7.0 and 5.7.1) that we
can set with DIB_CDH_MINOR_VERSION variable
By default it builds 5.7.0 version.

note: for Spark plugin we use HDFS part of CDH so we don't need to
create symbolic links for oozie (so for this we check variable
DIB_CDH_HDFS_ONLY)

depends-on: I1167d0d98ae6fb6fabaf7f1f9a344691d459b50b
Change-Id: I1d71ffbdf78373d27f7e1304164b32da786ac10b
bp: cdh-5-7-support
2016-07-07 12:26:09 +03:00
Jenkins 9da8e92c7b Merge "build all images for ambari in gate" 2016-06-27 14:47:21 +00:00
Vitaly Gridnev 9223cb9330 build all images for ambari in gate
Change-Id: I36b505b98f19b9eb870850c52d110b5ae74b4eaa
2016-06-27 10:13:42 +00:00
Peter Nordquist e03243532e Add support for building Centos 7 images for CDH 5.5
This commit adds support for diskimage-create.sh to create
Centos 7 images with CDH 5.5.
There are also minor changes to the repo definitions for
Centos/RHEL to use the $releasever variable
Also modifies the gate script to create the Centos 7 image

Change-Id: I9d563bdb5f5a1eb0243db376bf28113e8c416511
Closes-Bug: #1581233
2016-06-16 12:19:43 +03:00
Vitaly Gridnev ff424114ef fix gate jobs for building centos images
Change-Id: I31c489737a0f5403b204dc065390822534b5dd6d
2016-06-14 13:16:20 +00:00
Michael Ionkin e8e1d771d2 gate-sahara-buildimages-ambari job fix
This job has been failing because we use ubuntu as base image OS
which is not supported in ambari version <= 2.1.1

Change-Id: I5feb11d94435bd48b8116be3986e588fca16f47c
Closes-bug: 1540318
2016-02-01 15:01:49 +03:00
Pino Toscano eaf37bdace gate: custom handling of cloudera images
Generating cloudera images requires lots of space, in terms of cached
resources (distribution base images, packages, etc) and generated
images. This causes the generation of all the cloudera images to
(almost?) always fail on the gate slaves, as running out of space.

As a workaround to this, manually invoke the generation of cloudera
images per-distro, cleaning the cache (which contains mostly stuff
specific to the last built distribution) and the generated images after
each run.

Change-Id: I4468f9e2926e101864e73f8aedf7b0612a3f7a96
2015-09-14 13:10:05 +02:00
Sergey Lukjanov 77cf556122 Always enable TRACE in gate for building images
It'll provides us a bunch of additional information to debug
potential issues.

Change-Id: Iaa69c0fc35f922d35535ee63a9adb6be2d021237
2015-05-07 14:43:54 +03:00
Sergey Reshetnyak deddc28ce3 Add main script for building sahara images
Change-Id: Ia0a8604421dcfa553e8a21cf836856fb3c063504
2015-03-30 16:43:06 +03:00
Sergey Reshetnyak 81d2ab1fd1 Don't use sudo for diskimage-create.sh script
Root privileges needed for only installs packages

Change-Id: I7d7395f3a3cb95f595895c169ae530bb3aa10718
2015-03-26 18:16:43 +03:00
Michael McCune 4bf342a48c Adding new update option to diskimage-create.sh
This change removes the global system updates in favor of only updating
the required packages for diskimage creation. Additionally the script
will not automatically install the updates but will warn the user if the
packages are not installed. A switch is provided to allow the script to
install the updates.

Changes
* adding function to detect an installed package
* adding function to check for a list of installed packages
* adding command line switch for updating (-u)
* removing global update commands
* refactoring update logic to fail gracefully or accept switch
* adding -u switch to build-images gate tool
* adding note in documentation about update command line switch

Closes-Bug: 1375843
Change-Id: Iba5e676fa8ef7a852b71acd9e4c19d32f848285a
2015-02-12 10:11:33 -05:00
Sergey Reshetnyak b59c56cdfa Set SIM_REPO_PATH variable for gating tests
It's needed for correct working gating jobs

Change-Id: I23a60b16973395e12c092c265ee9ae2c22257518
2015-01-13 10:51:09 +03:00
Sergey Lukjanov 8f38712e1f Add tools/gate/build-images script
It will simplify configuring and tuning for our upcoming images
gating. In gate job we'll just exec this script and it will do
all the things we need. Let's start just with the building all
images for the specified plugin.

Change-Id: Iecef82bec8eb8d10218c5ad2b763ccabb41053ad
2014-10-06 14:26:03 -07:00