Commit Graph

303 Commits

Author SHA1 Message Date
Marios Andreou 963ac72a0a Remove stale bash scripts from tripleo-ci repo
As discussed in the parent patch [1] we should remove these stale file as
they are no longer used. The oooq_common_functions, toci_gate_test,
toci_quickstart have all been replaced by the templated versions in [2].

The heat-deploy-times.py is replaced by the script at [3] in the
ansible-role-collect-logs repo. The generate-kill-heat.sh has not been
touched in over 2 years and as far as I can see isn't being used
somewhere (code search).

Some of these especially the common_functions/toci_ files are updated
out of confusion and causing unnecessary maintenance burden.

[1] https://review.opendev.org/c/openstack/tripleo-ci/+/782549/5#message-f29d32c0c652d0929f680030e1a4c970fb111c2d
[2] https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates
[3] https://opendev.org/openstack/ansible-role-collect-logs/src/branch/master/roles/collect_logs/files/heat-deploy-times.py

Change-Id: If248d145cdcaa448de601b24a80a11d567fb235f
2021-04-08 12:36:53 +03:00
Sorin Sbarnea 4c73731482 Avoid execution failure when mirror_info.sh is missing
Avoids execution failure like:
/home/zuul/src/opendev.org/openstack/tripleo-ci/toci_gate_test.sh: line 20: /etc/ci/mirror_info.sh: No such file or directory

Change-Id: I3ef13bd9f7a029154334c0f7d98df9697dd7f6ad
Example: http://logs.rdoproject.org/23/23423/1/check/tripleo-ci-centos-7-scenario000-standalone/dd8ff8c/job-output.txt
2019-10-28 13:20:36 +00:00
Rafael Folco 1ea2735739 Ignore error when /opt/git does not exist
Try to delete /opt/git with find -delete, but do not die if it
does not exist.

Change-Id: I85071d5c2a54fe38f47661d62aca6dfb70b685f7
Related-Bug: #1847814
2019-10-15 10:23:23 -03:00
Rafael Folco 39bb0d6250 Attempt to fix slow cleanup of cached files
As part of the cleanup we remove cached repos in /opt/git. This
causing some transient timeouts, as rm -rf spawns a new process
for every file that matches in the pattern. And this results in
very long execution due to I/O degradation.

Change-Id: I1ff20467bb2222336a0e2e307cff3380e3761122
Closes-Bug: #1847814
2019-10-14 16:45:23 -03:00
Sagi Shnaidman 53f21c56f3 New vexxhost CI settings
Configure new settings for running OVB jobs on vexxhost cloud.
Change-Id: I1d38e369dea02bf85f55104f7b5b4b35e3d45ca1
2019-08-19 21:37:48 +03:00
yatin 93768b46ee OpenDev Migration Patch 2
These changes were missed by Sysadmin's proposed
Migration Patch, this patch takes care of these
missings.

Also updated kolla review pull task to use
review.opendev.org instead of opendev.org as
remote url because opendev.org currently don't
have review refs/changes synched due to gitea bug.

Related-Bug: #1825732
Change-Id: I30646b0c5b95f391e9ab4bd767b468280ccb3842
2019-04-22 11:04:00 +05:30
Wes Hayutin ec47cd4dc0 update toci_gate_test for no tebroker
Remove options to run w/ te-broker

Change-Id: Iefefe74355a4621c221806b69dbc5cf7bef29397
2019-01-10 16:46:30 +00:00
Sagi Shnaidman 78644b035b Add option to run OVB jobs without te-broker
Change-Id: I18816d4678b79a114343a3c4412d477b3bc3882e
2018-12-14 21:01:37 +02:00
Quique Llorente 41f4ea298c Use zuul src dir for tqe
Changes at tripleo-quickstart-extras were not visible as installed
roles.

Change-Id: I18e3383bc07c4417f3de2dbf15e0eb33a730e2cc
2018-12-04 12:35:20 +01:00
Zuul 6cffbbf90e Merge "Add tripleo-ha-utils to extra-requirements" 2018-11-19 06:02:53 +00:00
Sofer Athlan-Guyot e7c0dced93 New workflow for standalone upgrade.
Implement the standalone upgrade in CI.

This deploy a N-1 standalone deployment, upgrade the repository, the
packages, and run tripleo upgrade.

The upgrade coverage is limited to:
 - upgrade_tasks.
 - non-HA services.

This means that no upgrade orchestration is tested and that HA is not
covered.

Change-Id: Id4877152ca6c233e193593995dd13890e17a535b
Depends-On: I2a4ffd8ae26e0965028422c649243a65fef79e65
2018-11-15 17:43:18 +00:00
yatin 09bc3f1c7c Also support rdo-cloud provider
https://review.openstack.org/#/c/596432 added vexxhost
provider, since then jobs running under "rdo-cloud"
provider are broken. This patch adds regex match with
"rdo-cloud"* to handle both rdo-cloud and rdo-cloud-tripleo.

Closes-Bug: #1803133
Change-Id: I9a7ddef4e4f57dc599b9030a0afbe116b1075b68
2018-11-13 19:10:33 +05:30
Ronelle Landy 12a5fb3acc Add tripleo-ha-utils to extra-requirements
tripleo-ha-utils tests are running upstream now.
The roles need to be included in extras-requirements.

Change-Id: Ifa70831fb3a51714e67ddd6bff770c7d4bb33252
2018-10-31 14:01:32 +00:00
Nicolas Hicher 52364c8632 provider: Add vexxhost
Add vexxhost provider data for tripleo-ci jobs

Depends-On: I53851edbb8bb562dc4194fb99d6ade259227d2f9
Change-Id: I39efbfc94fe3650704b636e94445ad859f3ac801
2018-10-12 01:12:50 +00:00
Jiri Stransky 8ac067890d Switch previous release of master from 'queens' to 'rocky'
It also calculates the releases with the emit releses script for fs047

Depends-On: Ic578de2237f9a43ff4fcd24141802a49a06be59c
Depends-On: https://review.openstack.org/#/c/605989/

Closes-Bug: 1792892
Change-Id: Ic1aea1052a9518999f0f02539459eeef516f9654
2018-10-02 12:02:07 +02:00
Marios Andreou d2e5725fea Remove tripleo.sh --bootstrap-subnodes from toci_gate_test.sh
In https://review.openstack.org/583195 we are removing the bootstrap
subnodes invocations for the zuul v3 jobs and the templated version
of toci_gate_test.sh.j2. Here we do the same for the legacy bash
version of toci_gate_test.sh and add a deprecation note on the
tripleo.sh --bootstrap-subnodes function itself.

The invocation of tripleo.sh is removed with the now unused functions
echo_vars_to_deploy_env_oooq subnodes_scp_deploy_env

Instead the creation of ceph /dev/loop3 is handled in the base job
pre.yaml added in the Depends-On below

Depends-On: https://review.rdoproject.org/r/15000
Depends-On: Ib95b02767488aaddfe95633d03cb118dd492a700
Change-Id: I039388e4c3d4959270c45e827e76993636bd2990
2018-08-22 19:56:19 +00:00
Ronelle Landy a16c6a66d4 Add Browbeat env settings to rdocloud
Required for testing fs053 - where the cloud
and logging hosts have to be set.

Also add browbeat playbook to ovb playbooks list.
Only to be run conditionally.

Change-Id: Ice5de11d0c0ac0a808a0036f57a3f91b73a961bd
2018-08-14 10:59:51 -04:00
Zuul f221ec482e Merge "Use correct release file for periodic jobs" 2018-07-05 10:54:47 +00:00
Quique Llorente 90cce3d112 Use correct release file for periodic jobs
After emit releases script refactoring, we were using
{stable_release}.yml as release file for fs010 periodic jobs
The correct release file for it should use
promotion-testing-hash-{stable_release}.yml

Closes-Bug: 1779108

Change-Id: I7bd0ebba906887db31c34085a1c8a7efa31871a9
2018-07-02 07:55:33 +02:00
Gabriele Cerami bc05b89289 Migrate undercloud jobs to the new base configurations
This changes make the undercloud jobs use the new base jobs, nodeset and
playbooks requireed to run the job with the configuration that are
closer to zuulv3.
It also adds logic to not run any vxlan networking on our own for all
the v3 runners.

Change-Id: Idf7b8a54499ef252bf7d34b3b5f16a9a34e6a83f
2018-06-29 12:50:32 +01:00
trown c605fd193f Add back $WORKSPACE/logs directory creation
This is required to exist by the following line where we write
the fake subunit file. This works in CI because the directory is
created already, but fails in a reproducer environment. It seems
fine to just ensure this exists here.

Closes-Bug: #1778974
Change-Id: I8f03c14f1636a33162c8ea904714f6154ec3623a
2018-06-27 15:12:11 -04:00
Sagi Shnaidman 8c6db50589 Remove unnecessary code from toci_* scripts
Detect and remove unnecessary code from toci_* scripts
Simplify tripleo-upgrades roles installation with ZUUL_BRANCH

Change-Id: Ie230aa0640e41a33e10e6656b69e1db4a6819127
2018-06-25 14:56:07 +03:00
Gabriele Cerami ab7914d28d Quickstart transition: replace toci_gate_test.sh
This change modifies the way CI jobs are handled.
Current toci_gate_test.sh is renamed to toci_gate_test-orig.sh, and its
content will not be changed. toci_gate_test-oooq.sh is added, with
toci_gate_test.sh modified to be a link to it.
This new script will drive jobs to be launched using quickstart, it will
work initially as additional layer with backwards compatibility to old
script that will run jobs with tripleo.sh.
The old set of playbooks specific to toci is copied (not moved) from the
experimental scripts, and the toci-quickstart dir, containing
configurations for quickstart specific to tripleo ci is added.
Script toci_quickstart.sh will be the new single runner for every job
which configuration is assembled through toci_gate_test-oooq.sh script
To transition a job to quickstart, the only thing needed is to change
the job name to contain "featureset" keyword.
Make sure that the correspondent featureset file and nodes configuration
exist.

Change-Id: Ieb181db13e63e046bffc2c65120c2c24177488c5
2017-03-13 21:00:17 +01:00
James Slagle d23ec7bbd1 Don't do minimal bootstrap on newton
The environment file needed when doing the minimal subnodes bootstrap is
not available in newton, it's only available from ocata and forward.
Fall back to the full bootstrap for newton.

Change-Id: I52a9dba47ef8f101d35318dd6d4723f9ec0a01ae
Closes-Bug: #1671555
2017-03-10 23:13:32 +00:00
Jenkins 095e0d6543 Merge "Use bootstrap subnodes environment in CI" 2017-03-09 05:04:11 +00:00
Alfredo Moralejo 54f2fd6f93 Test upgrades ocata->master
https://review.openstack.org/#/c/440596/ implemented it only
partially. I think changing STABLE_RELEASE is also required.

Change-Id: Ia9810dcc4f76a619fe811161f84476ac2bdf58f4
2017-03-07 13:43:46 +01:00
Jenkins f750389166 Merge "Test upgrades ocata->master" 2017-03-06 18:57:36 +00:00
James Slagle 4a4c8a1c76 Use bootstrap subnodes environment in CI
Use the bootstrap subnode environment in CI that was added in
I6be94604a46382e6288df1b36b9de8fab58696cc instead of bootstrapping the
subnodes manually first. Even when using the environment, we need to do
a minimal bootstrap to do some cleanup from the infra spawned nodes and
initially install the agent packages.

Change-Id: I90619e8027b43dd2f2efc5a9d3cc7de80a906fb5
2017-03-02 17:30:26 -05:00
Steven Hardy 8709ac5f2f Test upgrades ocata->master
Currently we're testing newton->master but we need to switch this
when ocata is released

Change-Id: Ie49e1d777bb58d8948d7e5628f8fb45b4229b874
2017-03-02 14:26:20 +00:00
Dan Prince f57192de17 Undercloud containers job with tripleo.sh
We still use tripleo.sh for the undercloud CI jobs so this
patch follows suite to add a containers job to the mix to
give us some coverage on undercloud CI containers features.

Change-Id: Ie6506c2a4176246246fa4c4af0d920d4cb76e0fb
2017-03-01 10:53:25 -05:00
Emilien Macchi 3c3e78a29f Export UPGRADE_ENV for scenario-upgrades
It's required when upgrading scenarios in CI, so we can add the new
services during the upgrade process and pingtest won't fail to find new
resources.

Change-Id: I0ac0dac42286994241700f803159764fa3a6aee6
2017-02-27 15:51:36 +00:00
Emilien Macchi 5a16fac513 upgrades: run pingtest at the very end of the CI job
When upgrade has been completed, run a pingtest to check if we can
actually consume the OpenStack Cloud.

That is a first iteration. The next will be:
1. Run pingtest just before the upgrade
2. Verify that resources survived to the upgrade
3. Run pingtest again when we know resources survived

Change-Id: I83f45efd0b4608ec29489b8f8e717945b22469d4
2017-02-24 14:29:29 -05:00
Jenkins d5aeb65a22 Merge "Revert "Temporarily disable ceph in the updates job"" 2017-02-21 13:16:29 +00:00
Emilien Macchi a52bbde43f remove test-environments/multinode_major_upgrade.yaml
This is now in t-h-t so we should only use that version.

Note this means we use the master version of the env for
defining the service list for the deployed (newton) overcloud.

Change-Id: Ia7cc49daf8e9e26e3dee9db6f1bdb53b543b658e
2017-02-17 23:29:50 +00:00
Jenkins b136e93a9b Merge "Fix quickstart issues" 2017-02-17 01:22:50 +00:00
Sagi Shnaidman f34fbafc51 Fix quickstart issues
Run tempest in the same playbook.
Don't run postci function.
Use exclude list collect only logs we need.

Change-Id: Ib72a70facfb4fa180334ae5f470d34d1fb201668
2017-02-16 18:15:30 +02:00
Juan Antonio Osorio Robles b0f72f0026 Deploy novajoin in the TLS-everywhere job
This deploys novajoin in the fakeha-ca-server job which deploys
TLS-everywhere.

bp novajoin

Depends-On: I4c055e4b4086b02fa706380f01911f499966dfc1
Change-Id: If2d392caa54a0090da5f2654d37742d5aecaa4b0
2017-02-16 15:14:21 +02:00
Emilien Macchi 62400b2b04 Revert "Revert "toci_gate_test: allow to run upgrade jobs for scenarios""
This reverts commit 21fc8d4f8c and adjust
to pass multinode-upgrades job this time.

Change-Id: I6e800ec41e0abf600c88a24c2895906d4c77180c
2017-02-14 10:29:50 -05:00
Steven Hardy 21fc8d4f8c Revert "toci_gate_test: allow to run upgrade jobs for scenarios"
There are failures related to the deploy.env path, lets see if this
helps

This reverts commit aad509b99f.

Change-Id: Ic73b10440e54391688822edc8e67a2b693fa6ccc
2017-02-14 12:43:35 +00:00
Gabriele Cerami 6e8e27488d Installs openssh packages that try to workaround sshd start problem
This packages are a preview of openssh that try to fix
https://bugs.launchpad.net/tripleo/+bug/1657173
Since the bug is intermittent, this change should be merged for 4/5 days
and then reverted, just to check that the error we're seeing is really
gone with this patch

Change-Id: Ide7ceb18fae0bd5eb7a98cfc0e2aee550db1ea72
2017-02-13 22:14:37 +02:00
Emilien Macchi aad509b99f toci_gate_test: allow to run upgrade jobs for scenarios
Allow to re-use the bits done for first multinode-upgrade job in
scenario-upgrade jobs.

We just relax the first condition to export the right env and load the
multinode environment when needed only.

Change-Id: I24afa8f56ed9bcdcad0888ba480099ec5beb2961
2017-02-10 20:28:12 -05:00
Emilien Macchi 3d1d3ccaf2 Enable Debug: True on OVB jobs
Debug should be enabled in CI, and there is never enough logs to help in
debugging and solving complex problems.
We should not use the default value in TripleO and override it in CI to
let our developers debugging correctly.

Note: it's already enabled for multinode jobs.

Change-Id: I219214c8a77f35fcd41414b3d83b3ebb84c4cb0f
2017-02-09 22:25:53 -05:00
Jenkins 64e3eb1fbd Merge "Make graphite metrics more granular" 2017-02-09 10:18:56 +00:00
Jenkins 688d2d53eb Merge "Disable predictable placement tests in oooq jobs" 2017-02-08 12:37:12 +00:00
Jenkins 61113b5240 Merge "allow centos-opstools repo to be enabled for multinode jobs" 2017-02-08 06:58:41 +00:00
Sagi Shnaidman ba6075221d Disable predictable placement tests in oooq jobs
Scheduler hints and predictable replacement are not supported in
quickstart yet, remove them from existing job.

Change-Id: I5657e19a1b7b5eda51a592a0b9c8086e38ca7740
2017-02-07 22:14:10 +02:00
Ben Nemec 905eac0eee Make graphite metrics more granular
Right now, most metrics are recorded the same regardless of branch,
and some ignore the job type as well.  Since many of the metrics
can vary significantly depending on those details (mitaka jobs take
far less time than master, for example), let's separate out the
metrics more.

This change adds a .release.jobtype specifier to most of the
metrics.  The notable exception is the testenv wait time because
that is not release-specific.  Also, the image metrics do not
actually need to be split based on job type since they don't vary,
but for consistency with the other overcloud metrics I did anyway.

With this change we do not lose the ability to look at broader
aggregate numbers either.  We can still combine these newly
separated metrics back together in the Graphite UI.

Change-Id: I1df58f3a0c44708728e6ea1d705a6e8bf49ef330
2017-02-06 19:02:02 +00:00
Lars Kellogg-Stedman a82cfe7ed6 allow centos-opstools repo to be enabled for multinode jobs
The ci tests for collectd, fluentd, and sensu all require that the
centos-opstools SIG repository be enabled.  We're running those tests
as part of ci/environments/scenario001-multinode.yaml, so this change
only enables the opstools repo for scenario001.

Change-Id: I03cfbd96778a76125d18e2ca2f48d96e292608de
2017-02-03 15:26:57 -05:00
Jenkins aa9658897d Merge "Test with scheduler hints" 2017-02-01 23:32:26 +00:00
Jenkins d7ebf58a39 Merge "Remove references to Liberty (now EOL'd)" 2017-01-31 02:04:59 +00:00