Commit Graph

68 Commits

Author SHA1 Message Date
Sagi Shnaidman 8c6db50589 Remove unnecessary code from toci_* scripts
Detect and remove unnecessary code from toci_* scripts
Simplify tripleo-upgrades roles installation with ZUUL_BRANCH

Change-Id: Ie230aa0640e41a33e10e6656b69e1db4a6819127
2018-06-25 14:56:07 +03:00
Sagi Shnaidman 9c4c9d1b57 Fix yum command for TLS job
Fix yum command options for TLS experimental job

Change-Id: I8370d8a051809fe11fa6a15a27c2a611b69b0fca
2017-12-04 10:57:14 +02:00
Sagi Shnaidman b56e22a835 Mirror images from RDO server
Mirror promoted images from RDO server to RH1 cloud
Rename all ipa_images.tar to ironic-python-agent.tar
Remove old promotion code from mirror-server

Change-Id: I44a170cfa23e568d31726f55cea8906ad2c8e146
2017-10-18 13:21:13 +00:00
Attila Darazs 3b766679e9 Remove promotion logic from the toci scripts
The image upload is now going to be handled by the periodic jobs on
rdocloud and the promotion by the dlrnapi_promoter script.

Depends-On: Id9e08bc5938a8d8daad0203293ac1e266aa65326
Change-Id: I8a83c1a47e0a8a5ba0a11fee6f9fed3edd97af76
2017-09-27 16:23:50 +02:00
Ben Nemec ca5f796c8c Remove all centos-release-* repos
We shouldn't be using packages from any of these, and they can cause
package conflicts with the delorean repos we do want to use.

For some reason centos-release-* also matches the base centos-release
package, so we need to explicitly match only packages where the
following characters are a-z.

Change-Id: I928a0efc9d75e584889967e262155e576452632d
Closes-Bug: 1685814
2017-05-23 11:31:56 +00:00
James Slagle fa75d56177 Stop dstat at the end of a job
We should stop the dstat process that was previously started in
toci_gate_test.sh, so that processes aren't left running from tripleo-ci
jobs.

Change-Id: I200fe5f99d371fdde3b20518ffd10197680d46dd
2017-05-15 09:46:12 -04:00
Emilien Macchi 431c0ab754 Remove centos-release-ceph-* package provided by nodepool
We don't want centos-release-ceph-* package because we already manage
Ceph repos ourselves.

Depends-On: I683e84f60c7d9c3a7f26d34606b2fa221386bac9
Change-Id: I571f4cd5a322d034ec1b5aa0e3953c950a0619ae
2017-04-26 18:51:32 -04:00
Alfredo Moralejo 16b35e0950 Remove centos-release-openstack-* in nodes preparation
Currently, tripleo-ci scrips clean up repos removing rdo-release
rpm, but https://review.openstack.org/#/c/453325 moved base image to
use centos openstack release rpm instead of rdo-release.

This patch removes all centos-release-openstack packages in addition
to rdo-release. Note that yum returns 0 even if no matching packages
are found so this should be ok.

Change-Id: I825038eeb134590fe9bb68697a193e5c6626f991
Closes-Bug: #1685418
2017-04-24 20:36:36 +02:00
Juan Antonio Osorio Robles 2af4c1271c Remove installation of moreutils and replace ts
epel is no longer available.

Change-Id: If6affd68edafec683db0be2f5695455e907ad311
Closes-Bug: 1682488
2017-04-13 22:01:52 +00:00
Sagi Shnaidman f61c5e51d8 Set REMAINING_TIME for local run
When running CI scripts locally it fails because REMAINING_TIME is
propagated by infra before the job starts. This patch sets it to
some default value if it wasn't set before.

Change-Id: I0050046db17e50ddd17a7115e46c4684afa87b2f
2017-04-02 17:23:33 +03:00
Sagi Shnaidman 5a58c9a231 Stop deployment before jobs end
Stop deployment if it exceeds maximum timeout so that logs
could be collected.

Change-Id: Ia4e1ef2a10987b06406b343353066ea9d76f8e28
Related-Bug: #1649742
2017-03-27 20:58:48 +03:00
Ben Nemec 8b14612070 Only force http for repos that allow it
It seems that trying to use http for CBS repos causes a lot of
spurious failures due to the forced redirect to https.  Since we
only care about using http for the delorean repos that allow it,
limit the repo sed to just those urls.

Change-Id: I55ebe1d3963055d27c37cd5e9a299dcf929c84ec
Partial-Bug: 1674681
2017-03-21 16:29:14 +00:00
Emilien Macchi cf5e1d2f6c ovb/multinode: cleanup rdo-release/puppet packages
OpenStack Infra provides images with rdo-release and puppet packages,
which is something we don't want in TripleO CI because we already have
our own packages from local mirror, depending of the version of
OpenStack that we want to test.

This patch makes consistent the cleanup on both OVB & multinode jobs to
remove puppet & rdo-release packages.

Closes-Bug: #1670015
Change-Id: I5f6b6be6f07dfd7d27189547db9daf1594db8c85
2017-03-04 13:12:00 -05:00
Jenkins 383e9281f1 Merge "Add option for scenarios jobs promotion" 2017-03-02 14:00:23 +00:00
Sagi Shnaidman 7a4477409d Download promoted images in case of stable branch
After we started collecting images for stable branches we can
download them and save time on building.

Change-Id: I3a70b38392476a03ac66a984e088c372e879487f
2017-03-01 01:11:13 +02:00
Sagi Shnaidman 4efcd5923b Add option for scenarios jobs promotion
Add support for promote repositories with scenario jobs
but don't enable it.

Change-Id: I9efb59f9d5d1aa81765c4b31630bb93b57944113
2017-02-28 10:59:40 +02:00
Jenkins 2b090f660e Merge "Drop ceph workaround for mitaka" 2017-02-28 02:56:33 +00:00
Jenkins d0e8953cb5 Merge "Remove rdo-qemu-ev workaround" 2017-02-28 02:55:32 +00:00
Juan Antonio Osorio Robles b0f72f0026 Deploy novajoin in the TLS-everywhere job
This deploys novajoin in the fakeha-ca-server job which deploys
TLS-everywhere.

bp novajoin

Depends-On: I4c055e4b4086b02fa706380f01911f499966dfc1
Change-Id: If2d392caa54a0090da5f2654d37742d5aecaa4b0
2017-02-16 15:14:21 +02:00
Ben Nemec 1a768e499c Drop ceph workaround for mitaka
Once Ceph works out the version conflict on their side we shouldn't
need this anymore.

Change-Id: I267e9d7a301ffd87fd2d231fc9214ae8a4fab3c2
2017-02-15 00:20:45 +00:00
Ben Nemec 96358ac05e Remove rdo-qemu-ev workaround
I noticed that we had a warning message about this repo being
present twice in a recent job.  I'm guessing this workaround is now
being applied in dlrn, so we don't need to do it.

Change-Id: I2c08b798f9ce64a3015ddaf74ac59fb7a13b6bfc
2017-02-15 00:20:23 +00:00
Jenkins d8f75408c4 Merge "Save images according to their branch" 2017-02-13 21:33:44 +00:00
Ben Nemec 905eac0eee Make graphite metrics more granular
Right now, most metrics are recorded the same regardless of branch,
and some ignore the job type as well.  Since many of the metrics
can vary significantly depending on those details (mitaka jobs take
far less time than master, for example), let's separate out the
metrics more.

This change adds a .release.jobtype specifier to most of the
metrics.  The notable exception is the testenv wait time because
that is not release-specific.  Also, the image metrics do not
actually need to be split based on job type since they don't vary,
but for consistency with the other overcloud metrics I did anyway.

With this change we do not lose the ability to look at broader
aggregate numbers either.  We can still combine these newly
separated metrics back together in the Graphite UI.

Change-Id: I1df58f3a0c44708728e6ea1d705a6e8bf49ef330
2017-02-06 19:02:02 +00:00
Sagi Shnaidman 482ccc8ffa Save images according to their branch
Save images which are uploaded from promotion jobs in different
folders, according to their branch.

Change-Id: Ia76db45546c469a8245b388dc4a81fdc6ab27217
2017-02-06 18:51:33 +02:00
Ben Nemec 8861c0459c Use http delorean urls instead of https
We can't cache https urls in squid which hurts our job runtimes and
is probably driving excessive amounts of external traffic from the
cloud.  For ci purposes, let's use http instead.

Unfortunately, this doesn't entirely solve the problem.  The
delorean-deps http repo redirects to https.  That's something we'll
need to discuss with the people in charge of the repo, but in the
meantime we can start pointing at the http url and if/when we get
that working on the repo side we'll start to benefit from caching
of that repo too.

Change-Id: Icb88b7111f09ed302ace0800f4f6e2a898e0b450
2017-02-01 00:08:21 +00:00
Gabriele Cerami e7148c0c31 Promotion: fix promotion check
the script to check if the change is allowed to promote was not
considering the set -u, so when ZUUL_CHANGES was empty CHANGES[@] was
unbound.
Adding fallback to empty for the variable in the loop

Change-Id: I16fc10358147b2bd54502d15f7e96cc94cccac63
2017-01-18 18:22:21 +01:00
Jenkins c8d7cb3c8c Merge "Promotion: restrict promotion acceptance rule" 2017-01-17 23:09:35 +00:00
Jenkins 325597cb7b Merge "Work around ceph problems on mitaka" 2017-01-17 16:39:04 +00:00
Gabriele Cerami c797c90b34 Promotion: restrict promotion acceptance rule
Start image promotion process only if
- we are launching a periodic job (no changes)
- we are testing a maximum of 1 change
- all the changes come from tripleo-ci

Change-Id: If567cdf6fc0c36aed56e2927d66953e8e5ab6f7c
2017-01-16 18:29:35 +01:00
Jenkins 6c1d745f24 Merge "Use rdo-qemu-ev repo in mitaka jobs" 2017-01-13 23:19:14 +00:00
Ben Nemec 27337145c7 Work around ceph problems on mitaka
There is a conflict between the base and ceph repos that we use on
the mitaka branch.  One solution is to use a repo priority to make
the ceph repo take precedence.  Until this problem is fixed by the
ceph people, let's do the priority workaround ourselves to get the
mitaka jobs passing again.

Change-Id: I6bd245852ac621272ffdaa879214b3f88590a489
Partial-Bug: 1654611
2017-01-13 20:01:07 +00:00
Jenkins 96bee6a2e2 Merge "Revert "temprevert neutron "Don't create HA resources until needed" patch"" 2017-01-11 20:21:05 +00:00
Jenkins f43713b908 Merge "add default for ZUUL_PROJECT in toci_instack_ovb" 2017-01-11 19:02:44 +00:00
Ben Nemec 3e5304ef7f Use rdo-qemu-ev repo in mitaka jobs
This seems to avoid the problem with the nested pingtest vm not
starting in our mitaka jobs.  I'm not sure whether we _should_ be
using the ev repo in mitaka so I'm adding this as a fixme for now.

Change-Id: I8401eeced32c957d7a192091a19b39a734804c31
Partial-Bug: 1654615
2017-01-11 14:38:27 +00:00
Emilien Macchi 70a3042d9f Revert "temprevert neutron "Don't create HA resources until needed" patch"
This reverts commit 86c8c7626f.

The bug was fixed by https://review.openstack.org/#/c/417089/.

Change-Id: Idb664d8bd1705f1f54c719c757af85ebd02af521
2017-01-11 04:01:01 +00:00
Juan Antonio Osorio Robles 9a26e7566b Instal jq before deploy.sh in OVB jobs
This will be used by the TLS everywhere job on the CA setup part (which
runs before the undercloud install), and is also used by the undercloud
anyway, so we install this from the start.

Change-Id: I471dc7d872fda11dc4e48ec23d412ab0256c666d
2017-01-10 20:03:13 +02:00
Juan Antonio Osorio Robles dc84f37c17 add default for ZUUL_PROJECT in toci_instack_ovb
Zuul will usually set this value, however, if we're running these
scripts outside of CI, we might not need this and it will fail if the
variable is not set up. So we set a default for this case.

Change-Id: Ice808680f79a810c3b5a646d45bd81ea56dfbebf
2017-01-10 19:39:50 +02:00
Emilien Macchi 86c8c7626f temprevert neutron "Don't create HA resources until needed" patch
https://bugs.launchpad.net/tripleo/+bug/1654032/

Reverting a Neutron patch until it's fixed upstream.
Note: do not revert when the job run in Neutron's gate.

Change-Id: Ic3ea505e877608bc9d9c529b698a5068a67461a4
2017-01-05 15:37:57 +00:00
Gabriele Cerami d9c8dcd7c5 updates: enable ssl
Change-Id: I3dd83c39f101c2bee9a15f9897ef32840961a1cc
2016-12-22 18:20:11 +01:00
Sagi Shnaidman fed7c2ec0b Stop using documentation network range
Stop using 192.0.2.0 network range and move it to 192.168.24.0

Change-Id: I73e657d9612ca843dd9e9980b0996658195c2dd7
2016-11-16 13:51:11 +02:00
Gabriele Cerami 369902388f Move qemu-img installation after repo setup
Move qemu-img after setting up the repos. Nova depends on a version
that conflics with the one installed for setting up images before
deploying.
Moving install after repo ensure we install the version nova would
install as dependency anyway

Change-Id: Iee9a8553abdaeb67816e3242a856108f95fcab4d
Closes-Bug: #1631929
2016-10-10 22:03:34 +00:00
Jenkins 0c52118233 Merge "Re-enable temprevert/cherry-pick/pin functionality" 2016-09-22 02:08:05 +00:00
Jenkins f746f5f823 Merge "Remove support for legacy rh1" 2016-09-20 23:03:11 +00:00
Jenkins 3cfb5c442b Merge "Don't send metrics to graphite in failed jobs" 2016-09-20 17:57:33 +00:00
Derek Higgins 4c3c83029c Remove support for legacy rh1
We no longer need to support the legacy rh1 system, rh1 is now
ovb.

Change-Id: I8c8de7c829d5c94f4d18a56618c7ab737855655b
2016-09-19 14:25:29 +01:00
Ben Nemec cdc73c8585 Re-enable temprevert/cherry-pick/pin functionality
When we do tempreverts now, we need to ensure we signal to delorean
that it needs to rebuild the affected package.

Change-Id: I3e36398091357fadc6ff0f4e1eef5d673d3041f1
2016-09-15 18:55:05 +00:00
Juan Antonio Osorio Robles 72285f5503 Also set Haproxy addresses in no_proxy
When we deploy with SSL we do so via haproxy. So just as we do for
the undercloud services IP, we need to add that one to the no_proxy
list.

Change-Id: If158033663878e621c8683c7754b87c227550c75
2016-09-15 11:57:23 +03:00
Ben Nemec a81af90c93 Don't send metrics to graphite in failed jobs
The metrics from a failed job are likely bogus anyway and just
create noise in the Graphite data.  Let's only store the runtimes
from successful jobs.

Because we do some funny business in the trap, we need to first
store the previous exit value and pass it along to postci.
Otherwise by the time we get to postci the exit value we care
about is long gone.

Change-Id: I55db493ce5a1cdc38185d1f805adf4e89e5cbb9c
2016-09-06 20:44:56 +00:00
Sagi Shnaidman 1a8060cb3e Use proxy on OVB environemnt
Bring our proxy back!

Change-Id: Ida88d5ffac66e4b0b056362454dc63e3414a85fe
2016-09-01 17:09:20 +03:00
Steven Hardy 242cfb9d97 Use delorean-current for puppet modules
Currently we always build from source, but the latest master is now
available via delorean-current since o-p-m was broken into per-module
packages.

This should reduce the time taken to install everything from source,
and also provide a better path wnen upgrading as a simple
openstack undercloud install or yum update will update to the latest
puppet modules (currently failures happen if you forget to run via
tripleo.sh because the puppet modules aren't upgraded but things
that depend on the puppet modules are).

Also disable usage of the overcloud image cache as I have no idea what
will happen if we mix an image with puppet modules deployed from source
with ci scripts trying to install packaged modules.

Change-Id: Ie4cae6b884b2e539545371b9f716903b8fe5cf1f
Closes-Bug: #1597438
2016-08-01 16:31:27 +03:00