Commit Graph

32 Commits

Author SHA1 Message Date
Sagi Shnaidman 0977f8502d Big clean of tripleo-ci
Change-Id: Iff0350a1fff1057d1de924f05693258445da9c37
2020-01-22 18:37:04 +02:00
Wes Hayutin 407ffce875 update openstack.org -> opendev.org
Change-Id: I3c943d837fc2deeadbdefddeca6532f702d22e32
2019-04-22 13:31:45 -06:00
Sorin Sbarnea ed27a979d5 Adopt use of pre-commit linting
Follows the same configuration that was used on
tripleo-quickstart-extras and documented use on tripleo-docs.

Change-Id: Iba8a2db92137f9f6ad28f498627eb1b87039d99f
Story: https://tree.taiga.io/project/tripleo-ci-board/task/381
2018-12-14 15:50:06 +00:00
Natal Ngétal dbc129238e [Core] Remove mitaka.
The mitaka release is no longer supported by the community.

Change-Id: Iba4ed16f5d91973e43d3be040ce7e0eaf7396c73
Closes-Bug: #1722602
2018-11-14 11:14:06 +01:00
Sagi Shnaidman 1f7de38e47 Remove debug config of unbound since it's enabled
Infra already sets unbound to debug, so we can remove it from our
code.

Related-Bug: #1736157
Change-Id: Id5a50218d6b47354f12cc50f88d84c0c86196e3b
2017-12-04 15:00:59 +00:00
Sagi Shnaidman de4a74ea6c Set debug in unbound only if config file exists
In CI reproducers unbound config files could not exist, so
check before changing them.

Change-Id: Iae7d1e23e819de3dfc37b5588eb73d5cb8ba8f33
2017-11-21 10:44:42 +02:00
Sagi Shnaidman 962205603d Set ubound to debug level and dump cache
Debug unbound DNS queries in job for investigation of
DNS failures.
Dump unbound DNS cache server cache..

Depends-On: Ia76ac9b20d6b8402060b71e11e00e515bc74077d
Related-Bug: #1730931

Change-Id: Ic8b9e33067141366655fad1b99dee1adb40dfba3
2017-11-20 14:11:16 +02:00
Emilien Macchi 437a1059ee /etc/machine-id detection improvements
- Collecting /etc/machine-id is useful to make sure we have it in our CI jobs.
- Verify file size is not zero otherwise create the machine-id again

Change-Id: I5403337e735b6a4967bfff2173ab681517404a24
2017-10-07 22:07:34 -07:00
Sofer Athlan-Guyot 0c9e912cf4 Make sure we always have /etc/machine-id available.
We rightfully import the remove-machine-id element during the instack
bootstrap, but with multinode job it can create a vm without
/etc/machine-id as it's not restarted.  This can cause issue with nova
not finding any valid host due to this missing file.

Change-Id: Ieb5ad6ad429c8388a1cbbd650339b6eecd9b7997
Closes-Bug: #1718387
Co-Authored-By: Michele Baldessari <michele@redhat.com>
2017-09-28 18:38:16 +02:00
Dan Prince 915b923dd6 Drop duplicate openstack-tripleo-common install
This is also installed above so remove the duplicate.

Change-Id: I8efd679ca76fc1a5cfa70c36b22c01d1bd80938c
2017-06-12 10:40:50 -04:00
Jenkins e1b35eeb80 Merge "Remove all centos-release-* repos" 2017-06-04 18:24:57 +00:00
Emilien Macchi 5ee54ae448 Uninstall certifi/requests/urllib3 pip installation
requests-2.16.5 has added urllib3 package as dependency. Requests is
being installed using pip as dependency for git-review in DIB.

This parch removes urllib in node preparation for puppet jobs as it
will be installed as requirement for requests rpm package.

This patch should be a workaround until git-review is removed from
nodepool images.
See comments on https://review.openstack.org/#/c/468823.

Change-Id: Ia839cac125e2a749fc9ce40894e5900237ec3ae1
2017-05-29 17:28:30 +02:00
Sagi Shnaidman 7548af6a7c Fix CI python-urllib3 install failure
Fix CI failure of python urllib3 installation

Change-Id: Ibee99c44d950c8cf5b15e0e02e7a23727433bb46
2017-05-29 02:54:03 +03:00
Ben Nemec ca5f796c8c Remove all centos-release-* repos
We shouldn't be using packages from any of these, and they can cause
package conflicts with the delorean repos we do want to use.

For some reason centos-release-* also matches the base centos-release
package, so we need to explicitly match only packages where the
following characters are a-z.

Change-Id: I928a0efc9d75e584889967e262155e576452632d
Closes-Bug: 1685814
2017-05-23 11:31:56 +00:00
James Slagle bb430f3011 Support running toci_gate_test-oooq.sh locally
These are various improvements to tripleo-ci (squashed into a single
commit to save CI resources) that enable running the tripleo-ci entry
point script which is now toci_gate_test-oooq.sh locally in a standalone
environment of vm's not spawned by nodepool.

This is useful to developers trying to reproduce CI locally for
development and testing.

The changes are:
- Default $REMAINING_TIME in common_vars.bash
- Don't hardcode the jenkins user everywhere
- Improved initial package handling:
    Before blindly yum installing the packages needed by these scripts in a
    few spots, check if the packages are already installed with just the rpm
    command. This can end up saving a decent amount of time when iterating
    on running these scripts locally. Also installs wget.
- Reinstall python-requests
    When locally running toci_gate_test.sh, python-requests needs to be
    reinstalled since toci_gate_test.sh removes the python module as it
    was pip installed on the infra provided image. Also updates the
    logic to handle the python-requests -> python2-requests transition.

Change-Id: I48cd1e5f53b86455992b83248d57f5338c29a7ca
2017-05-10 21:38:45 +00:00
Emilien Macchi 431c0ab754 Remove centos-release-ceph-* package provided by nodepool
We don't want centos-release-ceph-* package because we already manage
Ceph repos ourselves.

Depends-On: I683e84f60c7d9c3a7f26d34606b2fa221386bac9
Change-Id: I571f4cd5a322d034ec1b5aa0e3953c950a0619ae
2017-04-26 18:51:32 -04:00
Alfredo Moralejo 16b35e0950 Remove centos-release-openstack-* in nodes preparation
Currently, tripleo-ci scrips clean up repos removing rdo-release
rpm, but https://review.openstack.org/#/c/453325 moved base image to
use centos openstack release rpm instead of rdo-release.

This patch removes all centos-release-openstack packages in addition
to rdo-release. Note that yum returns 0 even if no matching packages
are found so this should be ok.

Change-Id: I825038eeb134590fe9bb68697a193e5c6626f991
Closes-Bug: #1685418
2017-04-24 20:36:36 +02:00
Emilien Macchi cf5e1d2f6c ovb/multinode: cleanup rdo-release/puppet packages
OpenStack Infra provides images with rdo-release and puppet packages,
which is something we don't want in TripleO CI because we already have
our own packages from local mirror, depending of the version of
OpenStack that we want to test.

This patch makes consistent the cleanup on both OVB & multinode jobs to
remove puppet & rdo-release packages.

Closes-Bug: #1670015
Change-Id: I5f6b6be6f07dfd7d27189547db9daf1594db8c85
2017-03-04 13:12:00 -05:00
Ben Nemec 46a7ed16bf Remove openstack-heat-templates from bootstrap elements path
We no longer use anything from openstack-heat-templates so having
this included is just preventing us from dropping the dependency.

Change-Id: I94bd0c203e3d6dbfab5c24fffde56b9cf34af7e1
2017-02-16 21:30:44 +00:00
Julie Pichon 08af9ed794 Remove references to Liberty (now EOL'd)
Change-Id: I57d977e48bac4cf703d9c428a0f527baa1968d99
2017-01-26 08:55:59 +00:00
Jenkins 9dd5c90411 Merge "Remove temporary hotfix" 2016-12-01 22:09:41 +00:00
Jenkins 77aa5acfb4 Merge "Enable consuming packages for a feature branch" 2016-11-29 16:25:14 +00:00
Harry Rybacki 460210b5f8 Remove temporary hotfix
Bug referenced[1] had a fix released in August.

[1] - https://bugs.launchpad.net/tripleo/+bug/1606685

Change-Id: Id086a2919fd72673f8604c609cd1aaffb9c7c604
2016-11-28 15:16:38 -05:00
Yolanda Robla Mota 3deb01f109 Enable consuming packages for a feature branch
An use case for TripleO CI can be to test changes on an
specific feature branch. In that case, the packages need to be
consumed for that specific branch, instead of master.
This change enables the detection of a feature branch in the
current change, and enables the related repositories (they will
default to master if the feature branch for a repo does not exist)

Also update ELEMENTS_PATH properly to consune latest
features from diskimage-builder

Change-Id: I701c01dd18023c0c05aede9d06b6b1380b6f2386
Needed-By: I0ca6a4ae3a2684d473b44e5f332ee4225ee30f8c
2016-11-24 23:34:40 +01:00
James Slagle 62a61fda3c Default $STABLE_RELEASE in bootstrap-overcloud-full.sh
This script is meant to be able to be used standalone as well as from
tripleo-ci. The $STABLE_RELEASE variable needs to be defaulted to an
empty string otherwise the script will fail since it is set -u.

Change-Id: I6aa8bd3b01b1147de9b45f40ded8318fb46dcaf8
2016-11-16 09:14:08 -05:00
Brad P. Crochet f35267b42e Only ask for the overcloud-full image
Use the new --image-name argument to tripleo-build-images to get just
the overcloud-full image, simplifying the jq expression.

Change-Id: Ia60fe3643efe6a0b4010172717e43bc69cc513be
Depends-On: I5644656bbdc534f54c254edc7e939ae36f1f98ca
2016-09-26 09:40:56 -04:00
Jenkins 4c485a0896 Merge "Reinstall python-requests in bootstrap script" 2016-08-12 17:57:32 +00:00
James Slagle 7fd8345219 Use updated overcloud-full image name
Commit Ia1a3fa071c07d8a60c69f32375ac6b0aa92cff7b changed the name of the
images in the yaml definition files from overcloud to overcloud-full.
This updates the bootstrap script accordingly.

Change-Id: I35954ff424b945f1ba4f4ef2bbd29f404e292f9a
2016-08-10 16:36:26 -04:00
James Slagle 5529912854 Reinstall python-requests in bootstrap script
python-requests needs to be reinstalled in bootstrap-overcloud-full.sh
if it was already installed in order to make this script idempotent.
Otherwise, yum sees the package as already installed and does not
reinstall it again after we have rm'd the files (which we do to clean up
the previous pip install).

Change-Id: I6dd6676ae9a53a31afeaec43d242a33e072b4a94
2016-08-09 15:51:38 -04:00
Steven Hardy 242cfb9d97 Use delorean-current for puppet modules
Currently we always build from source, but the latest master is now
available via delorean-current since o-p-m was broken into per-module
packages.

This should reduce the time taken to install everything from source,
and also provide a better path wnen upgrading as a simple
openstack undercloud install or yum update will update to the latest
puppet modules (currently failures happen if you forget to run via
tripleo.sh because the puppet modules aren't upgraded but things
that depend on the puppet modules are).

Also disable usage of the overcloud image cache as I have no idea what
will happen if we mix an image with puppet modules deployed from source
with ci scripts trying to install packaged modules.

Change-Id: Ie4cae6b884b2e539545371b9f716903b8fe5cf1f
Closes-Bug: #1597438
2016-08-01 16:31:27 +03:00
James Slagle 618a6316ad Temporary fix for nodejs/libuv conflict
Temporarily remove epel-release, and don't enable epel via tripleo.sh.
Also remove nodejs and nodejs-devel. This is a quick fix for:
https://bugs.launchpad.net/tripleo/+bug/1606685

We have a CI dependency on EPEL too with moreutils, so that needs
to be installed before we remove epel.  Since everything is running
on the Jenkins slave that should be okay for now.

The proper fix will be to remove epel more completely going forward:
https://review.openstack.org/347499
https://review.openstack.org/347513

Co-Authored-By: Ben Nemec <bnemec@redhat.com>
Change-Id: I91eff35586547dd278e8a32668f06efb840fc8c6
Partial-Bug: #1606685
2016-07-26 19:37:29 -04:00
James Slagle 4eba02b2de Add mulitnode CI job support to tripleo-ci
This would allow using multinode jobs spawned by nodepool, but that is
not the only use case. Any cloud provider could be used by this setup,
including a 3rd party CI setup.

The scripts here are modified to support installing the undercloud
directly on the node running the toci_gate_test.sh script, which is
often the jenkins slave. When deploying an all in one Overcloud this
results in needing 2 nodes total to do the basic TripleO deployment.

There is a new script named toci_instack_multinode.sh to run the
multinode setup.

Change-Id: Icc67a289df207348536c0a2419b3fc81f03fe758
2016-07-19 17:20:44 -04:00