Commit Graph

33 Commits

Author SHA1 Message Date
Marios Andreou 963ac72a0a Remove stale bash scripts from tripleo-ci repo
As discussed in the parent patch [1] we should remove these stale file as
they are no longer used. The oooq_common_functions, toci_gate_test,
toci_quickstart have all been replaced by the templated versions in [2].

The heat-deploy-times.py is replaced by the script at [3] in the
ansible-role-collect-logs repo. The generate-kill-heat.sh has not been
touched in over 2 years and as far as I can see isn't being used
somewhere (code search).

Some of these especially the common_functions/toci_ files are updated
out of confusion and causing unnecessary maintenance burden.

[1] https://review.opendev.org/c/openstack/tripleo-ci/+/782549/5#message-f29d32c0c652d0929f680030e1a4c970fb111c2d
[2] https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates
[3] https://opendev.org/openstack/ansible-role-collect-logs/src/branch/master/roles/collect_logs/files/heat-deploy-times.py

Change-Id: If248d145cdcaa448de601b24a80a11d567fb235f
2021-04-08 12:36:53 +03:00
Zuul 8055430854 Merge "Add wallaby support for emit_releases_file.py" 2021-04-07 11:26:29 +00:00
frenzyfriday f14bb680fb Add wallaby support for emit_releases_file.py
Adds wallaby into the emit releases script. Similar to https://review.opendev.org/c/openstack/tripleo-ci/+/757861 which was for victoria.

Change-Id: Ib7d4bde73d3206b96b43a8f3ef2a78882cddf855
2021-03-30 14:58:34 +02:00
Marios Andreou b813597a5a Remove all rocky related jobs/conditionals tests after rocky End of Life
Rocky is now EOL since [1][2] so this removes all the rocky related jobs
or conditionals.
Moves tripleo-ci-centos-7-undercloud-containers to deprecated jobs as it
is still in use in other repos so we can't remove yet.
Related reviews in topic branch tripleo-ci-reduce-rocky [3].

[1] https://review.opendev.org/c/openstack/releases/+/774244
[2] http://lists.openstack.org/pipermail/openstack-discuss/2021-March/020912.html
[3] https://review.opendev.org/q/topic:tripleo-ci-reduce-rocky

Change-Id: Ibe2fd5c7792d55236c09dbf9cf88e23e1c5a5673
2021-03-26 13:47:18 +02:00
Bhagyashri Shewale d69df19d22 Add victoria support for emit_releases_file.py
Adds victoria into the emit releases script [1].

[1]: https://projects.engineering.redhat.com/browse/TRIPLEOCI-230
Change-Id: I1758ff860cb36692af638be0cae3c3076dbd5b9e
2020-10-18 15:09:04 +00:00
Marios Andreou 22d77e7f88 Add ussuri support for emit_releases_file.py
Adds ussuri into the emit releases script as tracked at [1] by
tripleo-ci squad

[1] https://tree.taiga.io/project/tripleo-ci-board/task/1666

Change-Id: I38a5c2abcdbd3dc5927ed6ccfdd31d357fc25f8a
2020-05-14 13:23:59 +00:00
Chandan Kumar (raukadah) 8c31506575 Added support for train for emit release file
It is needed train related upgrade jobs and fixes
the tests for the same.

It also rename the old-current-tripleo to previous-current-tripleo
in test name.

https://tree.taiga.io/project/tripleo-ci-board/task/1299

Change-Id: I9c4b6743547327457bbe1762605a48d59f4fa902
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-10-04 12:03:49 +05:30
Sorin Sbarnea 7612e52810 Avoid ignoring failure to collect missing folders
Makes output easier to read by avoiding errors related to missing
folders.

Keep in mind that log collection happens even for failed builds so
missing files are to be expected and not a reason to create warnings.

Collection should create warnings only if it encounters something
unexpected.

Partial-Bug: #1787912
Change-Id: I5c40e531c06389e9707c0db33d6aaa5baea0ddea
2019-01-14 17:20:15 +00:00
Sorin Sbarnea ed27a979d5 Adopt use of pre-commit linting
Follows the same configuration that was used on
tripleo-quickstart-extras and documented use on tripleo-docs.

Change-Id: Iba8a2db92137f9f6ad28f498627eb1b87039d99f
Story: https://tree.taiga.io/project/tripleo-ci-board/task/381
2018-12-14 15:50:06 +00:00
Natal Ngétal dbc129238e [Core] Remove mitaka.
The mitaka release is no longer supported by the community.

Change-Id: Iba4ed16f5d91973e43d3be040ce7e0eaf7396c73
Closes-Bug: #1722602
2018-11-14 11:14:06 +01:00
Sofer Athlan-Guyot f3702f4335 Add standalone upgrade to emit release.
This also add dlrn_hash_newest variable to be able to make proper repo
switching.

The $title is just adding the necessary bits into emit_release to take
standalone_upgrade into account.

The dlrn_hash_newest is a forgotten variable from the initial emit
release.  It has been included for standalone upgrade where the
problem first appeared, but will likely be needed for other upgrade
jobs as well when they switch to non specific release file.

Currently we only set dlrn_hash which becomes TRIPLEO_DLRN_REPO which
becomes delorean url. We don't do anything about dlrn_hash_tag_newest
which becomes RDO_DLRN_REPO which becomes delorean-current.

This means that when we are upgrading we get the dlrn_hash_tag_newest
that was defined in the previous run, ie during deployment.

Change-Id: I0e298fc37eb7b3fd0afaa13ab021330b789b2f5e
Closes-Bug: #1795367
2018-10-24 00:18:40 +02:00
Sorin Sbarnea c25a428409 Corrected release config location for log collection
Fixes problem where log collection was using config files from
old location after we already switched deployment to use new location.

This was not observed because the file content was the same but
once we attempted to remove the old files we discovered the issue.

Prepares for removal of config files from their old location.

Change-Id: I70aeb3724d6d162aa6d8b00024f3ce1a74dbf79f
Story: https://tree.taiga.io/project/tripleo-ci-board/task/7
2018-10-19 15:19:13 +00:00
Jiri Stransky 8ac067890d Switch previous release of master from 'queens' to 'rocky'
It also calculates the releases with the emit releses script for fs047

Depends-On: Ic578de2237f9a43ff4fcd24141802a49a06be59c
Depends-On: https://review.openstack.org/#/c/605989/

Closes-Bug: 1792892
Change-Id: Ic1aea1052a9518999f0f02539459eeef516f9654
2018-10-02 12:02:07 +02:00
yatin 6bc9d7ef97 Fix HASH for periodic jobs(use tripleo-ci-testing)
Periodic jobs should use 'tripleo-ci-testing' hash as
a target hash, currently 'current-tripleo' was used,
this patch fixes it.
Also added unit tests for the same.

Also allow using promotion-testing-hash-$release in
upgrade job in promotion pipeline.

Closes-Bug: #1787817
Change-Id: I8893c7406fcf1bb3936f5ba2d9dca7d4a3e9e82a
2018-08-22 03:01:43 +00:00
Jiri Stransky 471f3d3612 Add previous release entries for stein and rocky
This is a safe additive change, shouldn't affect any existing jobs.

Change-Id: I729906994a4a99c74ceca22f58dd93dad56eeeb9
2018-08-10 15:47:14 +02:00
Gabriele Cerami 5f6db1d668 Periodic fs050: add promotion hash in "previous" function
For the first time we are adding an upgrade job to the promotion
pipeline. Since the release in these jobs is
promotion-testing-hash-{release}, we need to add a case to the function
that calculates the previous release of the upgrade.
We'll need to update also the emit_releases_script for this to work with
this featureset.

Change-Id: I89e349b3ff563e5db59173f4751a52783d63f1ac
2018-08-09 15:05:51 +01:00
Gabriele Cerami f42363f623 Collect logs: split and move the script creation
Since we create the collect logs script only at the end of the playbooks
run, when a job times out, there is no collect_logs.sh script created,
and the post-run playbook doesn't actually run anything.
This change split the function in two parts, the first part creates the
script, and its call is moved to before the playbooks run. The second
part is moved to toci_quickstart directly and runs after the playbooks.
The second part should not be needed anymore with zuulv3 in rdo
provider.

Closes-Bug: #1784417
Change-Id: Iee897f780c93bdf847e188fc033e8be112e12a4f
2018-07-31 11:06:22 +01:00
Sagi Shnaidman 67826ec816 Move get_extra_vars_from_release to functions
Move get_extra_vars_from_release bash functions to file where
all functions are located.

Change-Id: Ie2befd0903d2550ff4035ee9ecc745138592c9a6
2018-06-25 15:14:59 +03:00
Ronelle Landy 3dab6f0df0 Add dry run option to toci_quickstart - playbook order in tact
With dry run, playbooks are not executed.
The env variables, releases script output and playbooks
commands are written out to files for debug.

The review also moves the collect logs lines to a
function for easier organization

Documentation for the dry run option and variable
files is added.

Change-Id: I0bad5ee3150d94115bed018de9488590305a2b80
2018-06-15 14:27:38 +00:00
Ronelle Landy 0876f88029 Revert "Add dry run option to toci_quickstart"
This reverts commit 418f5a639f.

Closes-Bug: 1773381
Change-Id: If3086bfc96d792edcd5ea8139fd21702ad65d279
2018-05-25 14:56:25 +00:00
Ronelle Landy 418f5a639f Add dry run option to toci_quickstart
With dry run, playbooks are not executed.
The env variables, releases script output
and playbooks commands are written out to
files for debug.

The review also moves the collect logs lines
to a function for easier organization.

Documentation for the dry run option and
variable files is added.

Depends-On: I4c8f389978717848e755f12856dd454d605c9137
Change-Id: Ib6ae184a07ba291d719cabb48b51d890b0485a49
2018-05-24 23:16:34 +00:00
Emilien Macchi 7b843c32bb undercloud-upgrade: deploy n-1 first then upgrade
The current undercloud upgrade job deploys an undercloud from master so
upgrade was never actually tested. This patch finds out which release we
want to test and provide the right featureset file.

Co-authored-by: Jose Luis Franco <jfrancoa@redhat.com>
Change-Id: I3c9d2396988bd3125740f0054c66e8243e85f437
2018-04-30 11:43:32 +02:00
Jose Luis Franco Arza 995271ccc8 Use tripleo-upgrade role in undercloud upgrades job.
Featureset047 includes all needed parameters
to run an undercloud upgrade using the
tripleo-upgrade role.

Change toci_gate_test.sh logic to include the
mixed_upgrade environment file *-undercloud-*-overcloud.yml
only when overcloud-deploy is being performed. Otherwise,
it will try to load it for undercloud upgrade too.

Closes-Bug: #1735792
Depends-On: Ib204c89ad88ae4581e556710976325c2b2723039
Change-Id: Iaed38c620f39b66b0b560ae561580dce21ea199b
2018-04-16 16:20:22 +02:00
Sagi Shnaidman 327e09e0f1 Increase time for log collection in OVB
Increase log collection timeout for OVB to 20 minutes, because
10 minutes is not enough.

Change-Id: I2ce519aebe8ade6b7902b57af3bd241e4e4a9dd6
2018-03-27 18:10:45 +03:00
Sofer Athlan-Guyot 33afffa972 Find the right release file for ffu mixed version upgrade.
By setting ffu_overcloud_upgrade in the featureset this change find
the right previous version for ffu and thus the correct release file.

This also refactor all the upgrade/update related function.

This whole section of the ci code is related to this tech-debt.
Related-Bug: #1749978

Change-Id: I962c2e4ad4eb522839deb904e0c67fb6a5d0ead9
2018-02-21 15:48:30 +01:00
yatin 5bf07a20c2 Add bits to support stable/queens
Add missing bits to support stable/queens branch in TripleO;
Some adjustments might be done later but this is a first iteration.

Change-Id: I4a369389fbecf6890a75ffaaf695f391cd6b7e2d
Closes-Bug: #1750311
2018-02-20 19:55:12 +05:30
Jiri Stransky d5ba8c5a34 Add check to enable additional ansible tag for updates
This will make sure we only go through the update tasks in jobs which
need it.

Change-Id: Ia6b4daeeb1924af5de7598c4a42b5ccf1d13d1de
2018-02-15 11:45:06 +01:00
Sagi Shnaidman 8879e24c90 Reduce race condition with timeout for ansible run
When we run command with "timeout" we need to have spare minutes
to prevent race condition when zuul stops the job before we do it.

Change-Id: I9f5eb7133e205e4f667c7b56f20def4f44d89ced
2018-01-17 19:31:26 +02:00
Sagi Shnaidman 89a7c9b0c8 Remove 10 minutes reserved for logs for multinode
After https://review.openstack.org/#/c/527844/ is merged
we don't need to save 10 minutes for logs anymore.
Remove this time from timeout command for quickstart running.

Change-Id: If60280ca19a2ed8d4730f605f5ce9114c907f9ec
2018-01-09 05:57:28 +00:00
Arx Cruz 606304b3b5 Creating a function that calls /usr/bin/timeout
Due the fact that in the future, we will have several ansible-playbooks
calls, we need to create a function that will calculate the remaining time
for each call. This function gets the START_JOB_TIME and
calculate how much time still has, and execute the command with
/usr/bin/timeout

Change-Id: Ib4766ea144baaaf1b47899c4923adf40a3be4582
2017-12-06 18:26:11 +01:00
Emilien Macchi 97f53309c6 Preparing TripleO CI to test upgrades to Queens
Update the code to test upgrades between stable/ocata and stable/pike,
and stable/pike to master (queens).

Change-Id: I61afed141d611b4b6b5ad40b3d48e9ea2346d1e2
2017-08-31 21:26:50 +00:00
Gabriele Cerami 4a8b331ce4 Add settings for OVB in RDO Cloud
Adding settings to make tripleo-ci OVB jobs work in RDO Cloud.
- add and conditionally load infrastructure servers IP settings
- disable network sharing since we are not admins in RDO Cloud
- modify flavor settings to match RDO Cloud requirements
- add additional ovb environment file for RDO Cloud settings

Change-Id: I032d6e3558a44d4f90a0de092dec980e95d1f33e
2017-08-14 16:30:38 -04:00
Jiri Stransky 46b52bb89d Generic UPGRADE_RELEASE logic for featureset jobs
Instead of looking at the featureset name directly, we inspect the
featureset yaml file for the value of `mixed_upgrade` option, and if
it's set to true, we set UPGRADE_RELEASE to one release older than
STABLE_RELEASE.

Change-Id: Ib4e74351745a8a9b4917e100e2363cb294dd9f20
2017-05-16 14:26:03 +02:00