From 7838d596ad5cc878ddb336f05c1f345a6cdd6662 Mon Sep 17 00:00:00 2001 From: Luigi Toscano Date: Mon, 4 Feb 2019 22:07:02 +0100 Subject: [PATCH] Update git submodules * Update sahara-image-elements from branch 'master' - archive-primary.cloudera.com -> archive.cloudera.com The former is no more active. Story: 2004936 Task: 29329 Change-Id: I260bf4cd3840ba2c44b85df87b89b717831b3b5c - Use template for lower-constraints Small cleanups: * Use openstack-lower-constraints-jobs template, remove individual jobs. * Sort list of templates Change-Id: If67b57ec2517eba2691c3cfcc6540813633ec25d Needed-By: https://review.openstack.org/623229 - Merge "Update the min version of tox to 2.0" - Plain Ubuntu image are still based on Xenial Even if we are not really testing plain images much, let's make clear that we didn't test any hadoop stuff on bionic yet. Change-Id: I684a98338945d4449e37d9f652bddddf827838bf - firstboot: make rc-local start after cloud-init The change is required because the cloud-init user (centos, ubuntu, cloud-user, ...) is used in the firstboot code. All distributions where vanilla can be deployed are based on systemd. Story: 2004479 Task: 28194 Change-Id: I9d8a626b84d5d3c2a91348895cded5fd32ded52a - Update devel info: mailing list The new openstack-discuss mailing list is going to replace few mailing lists, including openstack-dev. Change-Id: I4e6abbd29667f84a2ea07089010d1da1266ca7b7 - Update the min version of tox to 2.0 The verification comands used by tox need at least 2.0 version. This patch aims to update tox version from 1.6 to 2.0 which should help with local running of constraints targets. Change-Id: I84a53543b50184b4e838cd6e597dfc80ec025588 - Increment versioning with pbr instruction With moving away from required milestone releases, the version numbers calculated by PBR on the master branch will not work for those testing upgrades from the last stable release. More details can be found in the mailing list post here: http://lists.openstack.org/pipermail/openstack-dev/2018-October/135706.html This is an empty commit that will cause PBR to increment its calculated version to get around this. PBR will see the following which will cause it to increment the version: Sem-Ver: feature Please merge this patch as soon as possible to support those testing upgrades. Change-Id: I0ec6d6877f3518f267a977effb4e9d32a7300b89 Signed-off-by: Sean McGinnis - import zuul job settings from project-config This is a mechanically generated patch to complete step 1 of moving the zuul job settings out of project-config and into each project repository. Because there will be a separate patch on each branch, the branch specifiers for branch-specific jobs have been removed. Because this patch is generated by a script, there may be some cosmetic changes to the layout of the YAML file(s) as the contents are normalized. See the python3-first goal document for details: https://governance.openstack.org/tc/goals/stein/python3-first.html Change-Id: Ia20404b70cb5589b8ffacff1d7de39b14566987c Story: #2002586 Task: #24332 - Use the correct "or" operator to check the spark version It clearly slipped through the review... Story: 2003281 Task: 24222 Change-Id: I094045a665a4441029fa4930e278e94d0cff50f8 - Updating Storm version list We are adding Storm 1.2.0 and 1.2.1 and removing 0.9.2 Change-Id: I7e82464dda5d7d9f03e634eef814c63b661bb0c4 - Merge "Adding Spark 2.3" - fix tox python3 overrides We want to default to running all tox environments under python 3, so set the basepython value in each environment. We do not want to specify a minor version number, because we do not want to have to update the file every time we upgrade python. We do not want to set the override once in testenv, because that breaks the more specific versions used in default environments like py35 and py36. Change-Id: I204e381701c91e59558eee57efac7ae7566acf76 - Totally rewrite s3_hadoop Remedying of patchings, version conflicts, classpath issues, etc. ALSO: Switch the Hadoop libraries used on the Spark standalone plugin to Hadoop 2.7.3. The version was previously 2.6.5, to match Cloudera's so-called "Hadoop 2.6.0", but in fact this concordance is not at all necessary... Change-Id: Iafafb64fd60a1ae585375a68173c84fbb82c7e1f - Adding Spark 2.3 Adding ability to create Spark 2.3 Change-Id: I5fcfd050121b563960a48a3c8dbad9dda19b2a3e - Add support to build 3.0.1 image Change-Id: I1d90099b22ed9a0ede08df45059e6d7848c237b8 - Remove CentOS6/RHEL6 support Deprecated in Pike, and removed from diskimage-builder for a while. Story: 2001996 Task: 19626 Change-Id: I9b4eab56fcbfcb2e97805fba805eafeeafa5d540 - Merge "Add support to build 2.7.5 image" - Fix (again) the detection of scala version (now https) The www.scala-lang.org switched to https and the curl call did not account for this scenario, so it failed. Switch the address to https and as extra measure add also the -L argument, which forces curl to follow the redirects. Switch also the download URL to https. Story: 2001964 Task: 15089 Change-Id: I82d3dd0bd000284fb5404483bf3ee34a6fbb147b - Add support to build 2.7.5 image Change-Id: Ia16692632cbe6380d4021dd031eed09362873905 - Zuul roles: allow to build only a specific image Useful to generate a single image on-the-fly and use it for scenario tests (or simply useful for a refactor of the rest of the build-images script). Change-Id: Ica615e9e7d93b38fd12189a9f97d26ca62d84a3e - add lower-constraints job Create a tox environment for running the unit tests against the lower bounds of the dependencies. Create a lower-constraints.txt to be used to enforce the lower bounds in those tests. Add openstack-tox-lower-constraints job to the zuul configuration. See http://lists.openstack.org/pipermail/openstack-dev/2018-March/128352.html for more details. Change-Id: I00b41e7e3bcd86677084243917a205c703097674 Depends-On: https://review.openstack.org/555034 Signed-off-by: Doug Hellmann - Migration to Storyboard Sahara projects migrated to storyboard.openstack.org. Replace the references to Launchpad, including the bugs now available as stories. Fix a reference to github. Change-Id: Iadba69efc1e310b6a19463d3398bf5c6549acd73 - Merge "Add support to build 2.8.2 image" - Preload soci-mysql and soci on RHEL7 images Change-Id: I00d78b45dffd785e956058ca7d76fb9e32bfac60 Closes-bug: #1754313 - Add support to build 2.8.2 image Also tweak Hive a bit and refer to artifacts in a new (but not totally ideal) location. Co-Authored-By: Jeremy Freudberg Change-Id: I3a25ee8c282849911089adf6c3593b1bb50fd067 - Update the links to artifacts (removing sahara-files too) The canonical location for the artifacts going on is tarballs.openstack.org/sahara-extra/, so fix the link to use that and also use https. Moreover, since the last tarball required for building images is available on tarballs.openstack.org, remove the last references to sahara-files for artifacts and documentation (the new location was used already for a while in few places). there are still few references to sahara-files, but they are all about CentOS6 which is no more supported by diskimage-builder, and should be removed separately. Change-Id: Iab5a4d50a0abc6ab278837b6a9efd5e30f31c44a - Disables CA checking for Ambari on Centos/RHEL The default SSL certificate, which is generated when the Ambari server is installed, is invalid. We are disabling check for now. Change-Id: Ifcbc931e2ca23cb1fe221d509f57750e7e060aea Partial-bug: #1748507 - Merge "Revise s3_hadoop" - Revise s3_hadoop * Handle Hadoop classpath better * Include proper support for Spark classpath * Formally limit element's use to Vanilla and Spark Change-Id: I65abd7e375dba11599a4ab943d24f878235cd71d Closes-Bug: #1727757 Closes-Bug: #1728061 - Merge "Adding fuse package to Ambari" - Merge "Zuul: Remove project name" - Zuul: Remove project name Zuul no longer requires the project-name for in-repo configuration. Omitting it makes forking or renaming projects easier. Change-Id: I2604716833cb0b1ac64facf3ae09236ad7d56fb9 - Adding fuse package to Ambari In order for Ambari to work properly on Rhel we need to install fuse package on the image. Change-Id: I27b661b2da83776e382da962c89b9098599524d0 Closes-bug: #1746712 - Merge "Remove empty files" - Remove empty files classdist_noinst.stamp is empty file. We probably should delete it. Change-Id: I7c5df947ce16facef6d808008d3a4b0ffd5b76aa - Fix starting hive failure in Ubuntu xenial The mysql configuration file name and directory change in Ubuntu 16.04. my.cnf becomes an entry for mysql configuration. The new file locates here: "/etc/mysql/mysql.conf.d/mysqld.cnf" Change-Id: I8f70589cfc904a7d30081172b313ad8e30914935 Closes-Bug: #1738124 --- sahara-image-elements | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sahara-image-elements b/sahara-image-elements index 2a0fa0d58b..48491edb72 160000 --- a/sahara-image-elements +++ b/sahara-image-elements @@ -1 +1 @@ -Subproject commit 2a0fa0d58b0dbfe56f09355e0eb1f8caae43aa15 +Subproject commit 48491edb728266ffe260fba4347134526094531e