The change is required because the cloud-init user (centos, ubuntu,
cloud-user, ...) is used in the firstboot code.
All distributions where vanilla can be deployed are based
on systemd.
Story: 2004479
Task: 28194
Change-Id: I9d8a626b84d5d3c2a91348895cded5fd32ded52a
Remedying of patchings, version conflicts, classpath issues, etc.
ALSO: Switch the Hadoop libraries used on the Spark standalone plugin to
Hadoop 2.7.3. The version was previously 2.6.5, to match Cloudera's
so-called "Hadoop 2.6.0", but in fact this concordance is not at all
necessary...
Change-Id: Iafafb64fd60a1ae585375a68173c84fbb82c7e1f
The www.scala-lang.org switched to https and the curl call did not
account for this scenario, so it failed.
Switch the address to https and as extra measure add also the -L
argument, which forces curl to follow the redirects.
Switch also the download URL to https.
Story: 2001964
Task: 15089
Change-Id: I82d3dd0bd000284fb5404483bf3ee34a6fbb147b
Also tweak Hive a bit and refer to artifacts in a new (but not totally
ideal) location.
Co-Authored-By: Jeremy Freudberg <jeremyfreudberg@gmail.com>
Change-Id: I3a25ee8c282849911089adf6c3593b1bb50fd067
The canonical location for the artifacts going on is
tarballs.openstack.org/sahara-extra/, so fix the link to use that
and also use https.
Moreover, since the last tarball required for building images
is available on tarballs.openstack.org, remove the last references
to sahara-files for artifacts and documentation
(the new location was used already for a while in few places).
there are still few references to sahara-files,
but they are all about CentOS6 which is no more supported
by diskimage-builder, and should be removed separately.
Change-Id: Iab5a4d50a0abc6ab278837b6a9efd5e30f31c44a
The default SSL certificate, which is generated when the Ambari server is
installed, is invalid.
We are disabling check for now.
Change-Id: Ifcbc931e2ca23cb1fe221d509f57750e7e060aea
Partial-bug: #1748507
* Handle Hadoop classpath better
* Include proper support for Spark classpath
* Formally limit element's use to Vanilla and Spark
Change-Id: I65abd7e375dba11599a4ab943d24f878235cd71d
Closes-Bug: #1727757
Closes-Bug: #1728061
In order for Ambari to work properly on Rhel we need to install fuse package
on the image.
Change-Id: I27b661b2da83776e382da962c89b9098599524d0
Closes-bug: #1746712
The mysql configuration file name and directory change in
Ubuntu 16.04. my.cnf becomes an entry for mysql configuration.
The new file locates here:
"/etc/mysql/mysql.conf.d/mysqld.cnf"
Change-Id: I8f70589cfc904a7d30081172b313ad8e30914935
Closes-Bug: #1738124
As prereq of support for S3 datasource, the hadoop-aws jar needs to be
in the Hadoop classpath. The jar is copied into the proper folder when
possible on the appropriate plugins, and otherwise can be provided from
a download URL by the user.
Additionally, set the correct value of DIB_HDFS_LIB_DIR on the Vanilla
plugin to avoid any unnecessary simlinking.
Partially-Implements: bp sahara-support-s3
Change-Id: I94c5b0055b87f6a4e1382118d0718e588fccfe87
The structure of the page changed slightly between July 8th
and now (thanks Internet Archive).
Adapt the extraction code. including a more robust regex.
Also update the download location (lightbend.com instead of
typesafe.com, even if the latter is still a redirect).
Finally, expose a new variable which allows users to
force a specific version of Scala, disabling the autodetection.
This is useful to workaround possible future similar breakages
without changing the code.
Closes-Bug: #1704337
Change-Id: Ib105d08816d6833f05301e59f64163de5f070109
Few artifacts are already available on tarballs.openstack.org; use
them instead of sahara-files (the others should be migrated as well).
Change-Id: I5151b43fab56a071793097dba72aca6e9fb19196
diskimage-builder deprecated the usage of which (dib-lint marks its
occurrences as error by default):
https://review.openstack.org/#/c/466063/
Replace all the occurences of 'which' with 'type -p'.
Also, remove the (now useless) installation of which from
the disable-firewalld element.
Change-Id: I00bda062767070e46133cc800e82c9470923f572
Actually there is no much difference between using CDH 5.4 and 5.5
for spark, because both are using Hadoop 2.6 as a base.
Also removing redundant case in installing packages for CDH.
Change-Id: Ie24bb72365352edb22d94a461df0a0af6cd71806
Closes-bug: 1686400
In [1], we changed the default link
to ExtJS to be on sahara-files.
Now, update the README to reflect it.
[1] https://review.openstack.org/#/c/336024/
Depends-On: I6b8e12f0d33752e7790c5f40ebe6a3940ff1b0c1
Change-Id: I473257476b53e50ad0659f058cddf9bb2f78d917
The Host entry in /etc/ssh/ssh_config file on Fedora 25+ is commented
because there is an Include directive and the custom settings have
been moved to a file there.
This leads to a failure when the augeas lens tries to write to that
files. If I read the schema correctly, the lens assumes that the Host
entry is available/uncommented (this it was the case before in Fedora,
and in CentOS and RHEL, and in Debian/Ubuntu, where a customization
is a applied to the upstream default file, which is used as it is now
in Fedora).
This maybe could be an issue of the lens which may not assume that
key, but I'm not sure whether is possible.
In the meantime, use the existing customization file on Fedora,
instead of /etc/ssh/ssh_config.
Change-Id: Iee5c109b1265b54a75f675d26c9fec49c777d298
The "all" entry is a fallback if an entry/override for a specific
version has not been specified.
Change-Id: I5e57a00023cddaed691a2c701dc2e7fbd4726fe4
Closes-Bug: #1686343
Build an image with DIB_CDH_MINOR_VERSION may fail
because `navigator-keytrustee` doesn't release
minor version sometimes, and then the repo will not
be found.
This patch determines whether the repo exists before
writing repo url.
Change-Id: I6bcd66264019847a08c2ba4c15da401567e57574
Closes-Bug: 1682754
Building CDH image under version 5.5.0 is no longer support.
Remove these useless code.
Also, adding the ambari usage info in sahara-image-create
command.
Change-Id: I6fffe25ee9daf651355611be675137babb67e2a8
RHEL7 configuration is the same as CentOS7 (or the other way around).
uses mariadb like CentOS7
Closes-Bug: #1675119
Change-Id: I7ea7a6f327f69a7271b605733ba95ef296bebef7
The version 3.7.0 of Hue (or better, its packages) are not available
and the build fails on CentOS 7 and RHEL7.
Closes-Bug: #1675047
Change-Id: Ifd5d8c96dd62cc6def8b785c932221c4987aac62
The documented default version is much older than the real
default value which was bumped a while back but the README.rst
was not updated. This patch fixes this issue.
Change-Id: I7a8aa7a0ed2234fdf48a2dec5c300fbaf1783dd3
Set DIB_CDH_MINOR_VERSION in diskimage-create so that it could not
be an empty value. The order of the lines where DIB_CDH_VERSION is
assigned for other CDH versions where DIB_CDH_MINOR_VERSION is not
used was changed as well for consistency.
Also, in order to try to prevent future errors, set the value of
DIB_CDH_MINOR_VERSION based on DIB_CDH_VERSION in all elements where
it is used (thanks to the ${VAR:-value} syntax which does not fail
with set -u even if DIB_CDH_MINOR_VERSION is not assigned).
Closes-Bug: #1657482
Change-Id: I31b25fd4ba886d051b9b57902cd72349a4a2dbfa
Calling systemctl disable on a non-existing unit leads to a failure due
to `set -e`. This checks prevents it.
Also applies the same codepath to centos7 (as it is for rhel7, also
because centos7 has currently test coverage).
Closes-Bug: #1653535
Change-Id: I21f9cfd1959dcde80ed6abbf410bd0c4e93cc803
implement required changes to adopt firstboot script for
CentOS 7.x. Since lsb_release command is not available on
CentOS 7.x, we will include redhat-lsb-core package to image.
Change-Id: I2e5f2d598fbb9b3af0fcfd6e69a09e1ebce8e52d