Commit Graph

129 Commits

Author SHA1 Message Date
Sagi Shnaidman 0977f8502d Big clean of tripleo-ci
Change-Id: Iff0350a1fff1057d1de924f05693258445da9c37
2020-01-22 18:37:04 +02:00
Sorin Sbarnea ed27a979d5 Adopt use of pre-commit linting
Follows the same configuration that was used on
tripleo-quickstart-extras and documented use on tripleo-docs.

Change-Id: Iba8a2db92137f9f6ad28f498627eb1b87039d99f
Story: https://tree.taiga.io/project/tripleo-ci-board/task/381
2018-12-14 15:50:06 +00:00
Harald Jensås 0d318c08d4 Use a shorter default domain name
Some of the CI jobs use very long <hostname>'s,
resulting in the FQDN to be more than 63 characters
long which is the max for linux, see GETHOSTNAME(2).

Change the default to use: <hostname>.ooo.test instead.

Change-Id: Idfbd604e35f85307c666ab940adfe9ea94b29004
Related-Bug: #1803703
2018-11-19 16:57:26 +01:00
Natal Ngétal dbc129238e [Core] Remove mitaka.
The mitaka release is no longer supported by the community.

Change-Id: Iba4ed16f5d91973e43d3be040ce7e0eaf7396c73
Closes-Bug: #1722602
2018-11-14 11:14:06 +01:00
yatin 5bf07a20c2 Add bits to support stable/queens
Add missing bits to support stable/queens branch in TripleO;
Some adjustments might be done later but this is a first iteration.

Change-Id: I4a369389fbecf6890a75ffaaf695f391cd6b7e2d
Closes-Bug: #1750311
2018-02-20 19:55:12 +05:30
Sagi Shnaidman 0ec3a9c25d Use CENTOS_MIRROR from provided mirror_info.sh file
Don't construct CENTOS_MIRROR env var because we have it in the
file mirror_info.sh which is provided from nodepool.
Remove EPEL_MIRROR because it's not used anywhere.

Change-Id: I40fe8f6b2be1864b27bbe369e7da988fa7f1a0bb
2018-02-12 16:48:22 +02:00
Sagi Shnaidman d33474785a Fix all TLS job by using overcloudrc
Use overcloudrc which is default v3, instead of overcloudrc.v3

Change-Id: I33c9caba79331a7df38c2cfae4d53bd4a94a92af
2017-12-30 18:34:38 +02:00
Sagi Shnaidman 49a6109cbd Fix TripleO CI jobs
Fix TripleO CI jobs to be compatible with Zuul v3

Change-Id: Ibf6e7290528d072443bf7fa0ad22938e861538c6
2017-10-09 11:45:53 +03:00
Emilien Macchi 97f53309c6 Preparing TripleO CI to test upgrades to Queens
Update the code to test upgrades between stable/ocata and stable/pike,
and stable/pike to master (queens).

Change-Id: I61afed141d611b4b6b5ad40b3d48e9ea2346d1e2
2017-08-31 21:26:50 +00:00
Juan Antonio Osorio Robles ad076d7ec4 TLS-everywhere: Explicitly set overcloud_domain_name
This used to rely in the undercloud being clever and assuming the domain
from the undercloud. However, this caused issues for some folks. So
instead we do it explicitly.

Change-Id: I3c1a36fa70e46721bbe21826254171cb0166c87c
2017-07-27 18:05:13 +03:00
Emilien Macchi 21e72f9da8 Fix undercloud-upgrade job for Newton to Ocata
Several love fixes needed here:

- We forgot to override STABLE_RELEASE so
  the upgrade was failing because it was
  deploying repos from Pike instead of Ocata.

- Allow only to check that Ironic API is running
  on Newton or Ocata.
  In master we can check that ipmi driver is
  available.

- On old relases like Newton or Ocata we will
  use the old heat calls on get host info.

Change-Id: I558e86f5cec139cef165b0908bb3861434c7c8bc
Depends-On: Ie79dfff667437305ff4109da5a9c42ae358b1a3e
2017-06-30 21:10:55 +02:00
Steven Hardy 23bf89eb9d Don't maintain stable scenario env in upgrade CI
In https://review.openstack.org/#/c/464667 I assumed we wanted to
keep the stable scenario on upgrade, to avoid adding services during
the upgrade process.

It seems we're expecting to run the pingtest for master (or whatever
post-upgrade branch) so were actually depending on the services getting
added during the upgrade.

Change-Id: I83a421a23333a01d56781fb329116ae0036ae48a
2017-05-25 11:07:20 +01:00
Steven Hardy 87722b14c7 Ensure consistent path for multinode upgrade job
Some changes in t-h-t recently mean we've got to support multinode
scenario environments that reference j2 rendered files, but this
only works when the environment is contained within the --templates
tree.  So we copy the environment under test to the "new" tree
during an upgrade test, and ensure all paths reference the new
location.

Change-Id: I0288c2b470606d990281f6c37071b632a2d0d423
Closes-Bug: #1687908
2017-05-17 11:46:58 +00:00
Juan Antonio Osorio Robles 4c50a9f2da Deploy FreeIPA-backed LDAP domain for keystone in fakeha-caserver job
This deploys an extra domain whose LDAP server is the FreeIPA node.

Co-Authored-By: Rob Crittenden <rcritten@redhat.com>
Change-Id: I9d64bda89c5551335ea85c3170d1e74c9b7fed6c
2017-05-08 17:59:51 +03:00
Juan Antonio Osorio Robles 2af4c1271c Remove installation of moreutils and replace ts
epel is no longer available.

Change-Id: If6affd68edafec683db0be2f5695455e907ad311
Closes-Bug: 1682488
2017-04-13 22:01:52 +00:00
James Slagle fe6c49ef65 Use stable release templates for all environments
In the upgrades job, we should be using the path to the stable release
templates that we are upgrading from for all the environments.
Otherwise, we're mixing environments from master (or the release you're
upgrading *to*) with templates that you're upgrading *from*.

Change-Id: I3e7d21850c4cc5c42fa309e846701ac7e59c6e02
Partial-Bug: #1677186
2017-03-29 08:00:35 -04:00
Jenkins 94cb5026cf Merge "Disable delorean-ci earlier for multinode upgrades" 2017-03-07 18:56:26 +00:00
Juan Antonio Osorio Robles f386afbd9b fakeha-caserver: Rely on FreeIPA as the DNS for the undercloud
This removes the explicit setting of the domain and the ipa server in
the undercloud hieradata overrides. These values should be determined
from DNS.

Change-Id: Ie10f9e9d2ffe878ca13aa68ccd2ea66688e86c4b
2017-03-07 11:24:11 +02:00
Steven Hardy b686e2221f Disable delorean-ci earlier for multinode upgrades
We do this too late so the subnode is still bootstrapped
with delorean-ci enabled

Change-Id: I06adc5438ee67df88e0f4e5bcc16723ec6e052e1
2017-03-07 08:18:12 +00:00
Jenkins bc6de94054 Merge "upgrades: Only use release depenent environment for newton" 2017-03-06 20:51:17 +00:00
Juan Antonio Osorio Robles 3874fb1977 upgrades: Only use release depenent environment for newton
update-from-deployed-server-$UPGRADE_RELEASE.yaml only exists for newton
and is not needed for ocata. So it's only added in that case.

Change-Id: I9057d47eea15c8ba92ca34717b6b5965d4425ab1
2017-03-06 15:52:01 +02:00
Steven Hardy f86cfc2a0d Don't use delorean-ci repo for upgrade deployment
The initial deploy uses UPGRADE_RELEASE branch, which is the previous
release, not the branch under test.  This means, because Depends-On
and ZUUL_REFS aren't branch-aware, that we can only test packages for
the current branch, and we have to disable delorean-ci to avoid pulling
in e.g master puppet-tripleo on a newton deployment due to
Depends-On.

Change-Id: I8222da355fa7a7134b695a45d815caa640b8029b
2017-03-03 14:58:01 +00:00
Juan Antonio Osorio Robles d02eb1e631 Use a more appropriate domain name for FreeIPA
the domain I set initially was causing issues with some operations when
used outside of CI, this uses a more appropriate one.

Change-Id: I3142b3593d93bcdc1f92d12c1192262b0cc1e557
2017-02-28 17:35:44 +02:00
Emilien Macchi 5a16fac513 upgrades: run pingtest at the very end of the CI job
When upgrade has been completed, run a pingtest to check if we can
actually consume the OpenStack Cloud.

That is a first iteration. The next will be:
1. Run pingtest just before the upgrade
2. Verify that resources survived to the upgrade
3. Run pingtest again when we know resources survived

Change-Id: I83f45efd0b4608ec29489b8f8e717945b22469d4
2017-02-24 14:29:29 -05:00
Emilien Macchi 885882a3d2 upgrades: switch 'newton' to $UPGRADE_RELEASE
In order to support upgrade testing from stable to stable +1 releases,
we need to stop hardcoding newton keyword and use $UPGRADE_RELEASE
everywhere we can.

Change-Id: I0257945500400c0ec69a0da99ec0f31178d0f70e
2017-02-18 03:06:54 +00:00
Emilien Macchi a52bbde43f remove test-environments/multinode_major_upgrade.yaml
This is now in t-h-t so we should only use that version.

Note this means we use the master version of the env for
defining the service list for the deployed (newton) overcloud.

Change-Id: Ia7cc49daf8e9e26e3dee9db6f1bdb53b543b658e
2017-02-17 23:29:50 +00:00
Jenkins df5d300adb Merge "Add converge update to major upgrade test" 2017-02-17 17:44:59 +00:00
Juan Antonio Osorio Robles b0f72f0026 Deploy novajoin in the TLS-everywhere job
This deploys novajoin in the fakeha-ca-server job which deploys
TLS-everywhere.

bp novajoin

Depends-On: I4c055e4b4086b02fa706380f01911f499966dfc1
Change-Id: If2d392caa54a0090da5f2654d37742d5aecaa4b0
2017-02-16 15:14:21 +02:00
Steven Hardy e36bfbd0a4 Add converge update to major upgrade test
Discussion on IRC has made clear that for real deployments we can't
avoid the converge step, because we do still need a way to pin/unpin
the RPC (even when using "auto" as the version), and also potentially
some other nova specific steps will be required during the converge.

So align the CI test with how real deployments will be upgraded, even
though this will make the job take a little longer, otherwise the test
isn't representative of the expected upgrade workflow.

Depends-On: If5016b910931364a621b280465420d0bf2617895
Change-Id: Ifcdb048a1081b16a8a33816be98ddbbe07c27856
2017-02-15 19:09:39 +00:00
Jenkins 97f1afe942 Merge "Add wait_for from tripleo-incubator" 2017-02-09 20:10:54 +00:00
James Slagle 9340cd685f Add wait_for from tripleo-incubator
wait_for is the last script still used by tripleo-ci from
tripleo-incubator.  This commit brings the script over into tripleo-ci
(like we did in the past for other scripts) so that we can continue with
removing tripleo-incubator.

Change-Id: Icd62f75df3e27ead780a392b34a9720b127c9b6d
2017-02-08 23:04:19 +00:00
Ben Nemec 905eac0eee Make graphite metrics more granular
Right now, most metrics are recorded the same regardless of branch,
and some ignore the job type as well.  Since many of the metrics
can vary significantly depending on those details (mitaka jobs take
far less time than master, for example), let's separate out the
metrics more.

This change adds a .release.jobtype specifier to most of the
metrics.  The notable exception is the testenv wait time because
that is not release-specific.  Also, the image metrics do not
actually need to be split based on job type since they don't vary,
but for consistency with the other overcloud metrics I did anyway.

With this change we do not lose the ability to look at broader
aggregate numbers either.  We can still combine these newly
separated metrics back together in the Graphite UI.

Change-Id: I1df58f3a0c44708728e6ea1d705a6e8bf49ef330
2017-02-06 19:02:02 +00:00
Jenkins 234b51a39d Merge "Fix image size metric retrieval" 2017-02-02 11:03:55 +00:00
Jenkins aa9658897d Merge "Test with scheduler hints" 2017-02-01 23:32:26 +00:00
Ben Nemec f6192f8681 Fix image size metric retrieval
I'm not sure what the purpose of this sed was, but all it's doing
right now is cutting off the last digit of the image size.  So an
image of 1152 MB is being reported as 115.

My best guess is that this was designed to remove a newline from
the output, but in my local testing there is no newline.  Maybe
something changed in the output from du/cut.

Change-Id: I225daf1e3abfe627713b1f54fae902236b5c321f
2017-02-01 00:15:15 +00:00
Jenkins 663e20abb1 Merge "Add metric for overcloud update time" 2017-01-30 21:47:20 +00:00
Ben Nemec 52ab46042a Test with scheduler hints
Enables predictable placement to specific nodes using the nova
scheduler hints.

Change-Id: Ib64be565494658c8e0b8301240aaf116824692e9
2017-01-27 22:24:29 +00:00
Brad P. Crochet f1c9600b25 Set INTROSPECT_NODES before calling register-nodes
The register-nodes in tripleo.sh is expecting INTROSPECT_NODES to be
set in order to actually introspect the nodes. This sets it, then unsets
after the --register-nodes call so that it doesn't leak anywhere.

Change-Id: I6f39a19f51ad94c9ad541856083991d98ee63a52
Closes-Bug: #1659931
2017-01-27 14:42:44 -05:00
Jenkins 88906199a1 Merge "Test hostname map" 2017-01-27 18:18:51 +00:00
Jenkins 12ea52ae91 Merge "Add support for testing predictable placement" 2017-01-27 18:18:45 +00:00
Jenkins 4ac9476831 Merge "Fix check for overcloud-full in deploy.sh" 2017-01-27 17:52:37 +00:00
Ben Nemec c36eafb900 Test hostname map
Deploy with a hostname map and verify that the instance names end
up as specified.

Change-Id: I3a120e784c8862b112869288ccf87ee1634b3564
2017-01-26 18:10:27 +00:00
Ben Nemec 2cb41b9d1f Add support for testing predictable placement
Initially just the predefined ips piece of that functionality
because it is the easiest to implement.  Testing the other bits
will come in followup patches.

Change-Id: Ic12b85be917aad1ae8313cb4748b4f11b6b24192
2017-01-26 18:10:27 +00:00
Emilien Macchi 64ad4bed4b Prepare TripleO CI for stable/ocata
* Prepare undercloud upgrade job to support stable/ocata, though don't
  switch yet since it's not released.
* Put some comments in upgrade blocks to mention Newton is hardcoded and
  some work needs to be done to be release agnostic.
* Update the distgit branch logic for Mitaka, Newton and Ocata.

Change-Id: Ia2fa8e251439634d162512ccdad6c68529fda03e
2017-01-24 07:34:43 -05:00
Jenkins 8f6ce5ae8f Merge "Only install tempest if it's going to be used" 2017-01-20 20:03:07 +00:00
Jenkins d7ef55e8f6 Merge "Disable optional undercloud features in longer jobs" 2017-01-20 20:02:32 +00:00
Jenkins 4909fa968e Merge "Add sahara support to major upgrade CI" 2017-01-20 17:25:12 +00:00
Ben Nemec 0d3179135f Only install tempest if it's going to be used
There's no point spending time installing tempest if we're not
running the tests in the job.

Change-Id: Icd80ad7e13f1b5bc342dfae4ff6fa24e609162ff
2017-01-20 17:41:01 +02:00
Ben Nemec b4a0d7885b Disable optional undercloud features in longer jobs
We don't have test coverage for these features in the ha and
updates jobs anyway, so there's no point spending time deploying
them in those jobs.  Leaving them in the nonha job and the
undercloud job should provide sufficient coverage.

This saves approximately 4.5 minutes per undercloud deploy in my
local environment, which adds up when you're running 750 jobs per
day.

Change-Id: I3eb3324c3291c70544a7b71cee1ff31cec687769
2017-01-20 17:41:01 +02:00
Steven Hardy 3a53aa0294 Add sahara support to major upgrade CI
Depends-On: Icf8e215935bdf299cb792abb29bb5d58c5c312c5
Change-Id: Ie211946601c7a313d95705de11746d773dd269e1
2017-01-19 17:25:46 +00:00