This "removes" devstack-gate content in order to retire it. Devstack
grew the ability to bootstrap its own CI environments using ansible and
no longer needs devstack-gate.
Part of the motivation for this chagne is that it will help us in our
quest to remove old Ubuntu Xenial test nodes from the CI system as
devstack-gate still relies on them.
Depends-On: https://review.opendev.org/c/openstack/project-config/+/919625
Change-Id: Ife60f1dd6fae7577cee78054b69d8ab83df9a8ce
Ansible 6 interprets the shebang line to know what version of python to
run a module under. Unfortunately, this is at odds with using the
shebang line normally on a unix system to execte the module as a normal
script. Devstack-gate uses the test-matrix library in both ways as an
Ansible module and as a normal script. To reconcile the differences we
drop the shebang entirely to force Ansible to use a default
interpretation, and on the script side we force users to run the script
with the python they want explicitly.
This is not ideal, but there isn't a better way to reconcile the
difference in Ansible 6 expectations and using things as a normal
script.
Change-Id: I9a331d508276d9abe72c789fd91fc77a4136c5ca
Per [1]. Stop running the legacy-tempest-neutron-full-stable job since
it is broken. Stop running the devstack job since it no longer includes
the roles from this repo.
[1] http://lists.zuul-ci.org/pipermail/zuul-discuss/2022-May/001801.html
Change-Id: Iebcd055d7e8439ff67723ab2e1b93f20c114112d
The job called neutron-tempest-dvr-ha-multinode-full does not use
devstack-gate any longer.
See https://review.opendev.org/c/openstack/neutron/+/848461 for more
information.
Change-Id: I91b86913007e29b71ff4f4de739ac53c83e5bf58
we do have legacy jobs in ussuri and might be in victoria also and
as we are pinning tempest in both stable branches they need to use the
respective stable branches constraints instead of master constraints.
- https://review.opendev.org/q/topic:ussuri-pin-tempest
- https://review.opendev.org/q/topic:victoria-pin-tempest
Hoping this is last time we are updating the tempest setting in d-g
as all jobs in victoria onwards should be migrated to zuulv3 native.
Change-Id: I07e1cb9b038e8d0c8ce83e8554188f9eb72cb339
Without this grenade job in stable/train fails as it uses
master constraints and master is dropping py3.6 support,
like oslo-log already dropped that and is causing issues[2].
Tempest in stable/train is already pinned in devstack[1]
to 26.1.0. So let's use stable constraints for Tempest venv.
[1] https://github.com/openstack/devstack/commit/8a22f738
[2] https://review.opendev.org/c/openstack/neutron/+/841698
Change-Id: I81233ea91cdd24919db245dd8475341d7532daf3
legacy-tempest-neutron-full-stable deploy's stable/wallaby
and is running on ubuntu-bionic(py3.6) and failing in tempest
setup as tempest master no longer works with py3.6.
Master is dropping py3.6 support, currently oslo.log has already
dropped the support and it's latest release is not installable
on py3.6.
Pin Markusafe, as since version 2.1.0 it dropped
module 'soft_unicode' which is required by Jinja2.
Also update ansible version to 2.9.6 as of focal
which should auto discover python as per distro.
So let's switch this job to ubuntu-focal which is py3.8.
Change-Id: I37887bf430b4bce2b9d2179b2d6dd6c050bb1768
In TC PTG, we decided to retire the d-g once
stable/wallaby is in EM state and update it
in README file so that anyone still using it
will know the retirement date.
- https://etherpad.opendev.org/p/tc-zed-ptg#L379
Change-Id: I3e7eed4d260051d72e3ee9d6ed2ce726e85583fe
The old version of Ara used by d-g doesn't cap off dependencies which
are now no longer working together. We manually cap things off in our
Pip install step.
Note users should stop using this tool. There are alternatives like
zuul-jobs' ensure-devstack role [0] for Zuul/Ansible users. The issue is
that d-g is not very maintainable and on its last legs for the openstack
until the Xena release is no longer maintained. This is noted in the d-g
README.rst file.
[0] https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-devstack
Story: 2009973
Change-Id: I781ce6e2be88d6724c6908490e17ba8acaa3b911
It seems PyYAML==6.0 breaks the test-matrix code, let's just cap it.
Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>
Change-Id: Id7bc0433315334657f78c0ee29bd100213479939
neutron-lbaas was retired [1] and old branches that still use
devstack-gate started to fail with the following error:
functions.sh:setup_workspace:L461: rsync -a '/home/zuul/src/*/openstack/neutron-lbaas/' neutron-lbaas
rsync: change_dir "/home/zuul/src/*/openstack/neutron-lbaas" failed: No such file or directory (2)
This patch removes the neutron-lbaas from the PROJECTS list to fix the
stable gate jobs that are based on devstack-gate.
[1] I04bf076a051e0bf8333f5dc7c000952048dcb523
Change-Id: Ia62245bbeaf4f1a4b50c07efe14b58b550a9817f
Only legacy jobs test the devstack-gate code and all the zuulv3 native jobs
use the devstack only.
Many of the current job running in this gate has been converted to
zuulv3 with same name so we are running zuulv3 native job which does
not use d-g code on d-g gate.
Example: Ibe613a48116aed9cbcc7c689a50c1ef9fba60f05 migrated the neutron
greande job to zuulv3 native.
Also this remove ocata legacy job which is EOL.
To cover the testing for supporting the stable branches in d-g, we have
'legacy-tempest-neutron-full-stable' job running on last supported stable
branch (stable/wallaby - https://review.opendev.org/c/openstack/devstack-gate/+/785003).
Adding it in gate pipeline too to have 'integrated' queue testing.
Also removing the below broken jobs, they need more work to migrate to latest distro
or so but we do not have bandwidth to fix them now.
- legacy-tempest-dsvm-neutron-full-centos-7:
- legacy-tempest-dsvm-multinode-full:
We are not adding any stable branch grenade legacy job here as preparing the
one will be more work. If any issue occur for grenade legacy job side then we can
fix/test it via depends-on.
Change-Id: If7b870331cae42e3250bdf548c572f7067d835f5
We are officially deprecating the devstack-gate for
master (Xena onwards) but continue supporting the
old stable branch until stable/wallaby.
Change-Id: I5063de76d531d9b017cbee70a17e6ca945848acc
It is easy to know all the jobs running on devstack-gate
if they are listed in-tree.
This will also help in deprecation of devstack-gate for master
(Xena onwards) while converting those jobs to run for stable branch.
Depends-On: https://review.opendev.org/c/openstack/project-config/+/795379
Change-Id: Id5262a22fb119447eecb0a77f1d2be2940786226
There are still grenade legacy jobs in few projects,
so for them we need to update the grenade setting in d-g.
Hope this is last release we need to support in d-g.
Depends-On: https://review.opendev.org/c/openstack/devstack/+/784974
Change-Id: I5f98212be14ac3ebad961595e60a099c58fedada
We have stable/wallaby branch as latest stable and
d-g test only latest stable branch to make sure the compatibility
of legacy jobs. Hope this is last stable we need to update/support
in d-g.
This commit moves the legacy stable job testing to stable/wallaby.
Depends-On: https://review.opendev.org/c/openstack/devstack/+/784974
Change-Id: I5542dca0f8050a6e21aff773f49eb4799ec26828
We have stable/victoria branch as latest stable and
d-g test only latest stable branch to make sure the compatibility
of legacy jobs.
This commit moves the legacy stable job testing to stable/victoria.
Change-Id: I78a0f55c360df2804200cc801109741276248550
bashate job on d-g fail with error, as d-g
is moving towards deprecated phase let's keep
bashate job running on bionic.
Change-Id: Ibe644c9ed207bf2f76895319774d7376e08391e3
As of Ansible 2.9, using a jinja test as a filter fails; switch it to
"is" format.
The "--sudo" flag has become "--become", switch it.
Change-Id: If75cb934d386ab25240df9f21f9c948843bdb8fb
We have stable/ussuri branch as latest stable and
d-g test only latest stable branch to make sure the compatibility
of legacy jobs.
This commit moves the legacy stable job testing to stable/ussuri.
Depends-On: https://review.opendev.org/#/c/723605/
Change-Id: Id57e5590a5b24c2d821381f52e1c445cbbd1105b
As part of our efforts to ship bare nodes, we want to install as
little as possible in any sort of pre-run jobs. Since all infra nodes
have python3 available, use venv to create this small environment for
the test matrix production, and avoid having to pull in any other
dependencies.
Change-Id: Ie8b09ab60841f9d1b15ae1a7afec51906cd89f95
This checks if the task failed; which it never does because of the
failed_when: false. What we want to check is the return value of that
check.
Change-Id: Ic975b53d60f44e8e743bcc31fc864cc8416b3a92
In zuul job results the 'logs' directory contains gzip'd files which are
now unbrowsable. This happened due to changes in swift behavior [1].
This patch removes unnecessary compression of files under logs
directory.
[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html
Change-Id: I1d0e7869d418612bb9a20fdf01da2641693ed8bb
There are errors with the recently released
virtualenv 20 for example: https://github.com/pypa/virtualenv/issues/1551
It has been capped on devstack side also
I3b447557f013934719aa357efeffb093c7f6bd95
Let's use the lower version and we can move to
latest once issues are fixed.
Change-Id: I341437856c709e1e0e281357b96901ae6ef7cd00
Stable branches till stable/rocky is using python
version <py3.6. Tempest test those branch in venv
but Tempest tox use the master upper-constraint[1]
which block installation due to dependencies
require >=py3.6. For exmaple, oslo.concurrency 4.0.0
is not compatible for <py3.6.
As we pin Tempest for EM stable brach, we should be
able to use stable constraint for Tempest installation
as well as while running during run-tempest playbook.
tox.ini is hard coded to use master constraint[1] which force
legacy ocata job to use the master constraints and fail
- https://review.opendev.org/#/c/706161/
Devstack can set stable u-c to use via env var but this is
not enough as Tempest recreate the tox env with master u-c
when run test via devstack-gate.
All other branches have been fixed by fixing the run-tempest playbooks
in same way.
- https://review.opendev.org/#/c/705870/
Because stable/ocata and grenade job use devstack-gate, we need to fix this.
This is required to fix the grenade jobs on each stable branch to
get the other fixes in.
[1] bc9fe8eca8/tox.ini (L14)
Change-Id: Ibfc5c3d5e64e274fd674e6c42878d98bb194fa73
When devstack reverted the pip cap in [0], it was necessary to disable
the peakmem_tracker service as there was no easy way to make it work in
that setup. So we need to delete it from the test-matrix here, too.
We could decide to add it only for older stable/branches, but as ds-gate
is to be obsoleted anyway, I'm not convinced that that is worth the
effort.
[0] https://review.opendev.org/561597
Change-Id: I9dd57d3bdb56c64377efbdd55429bd075223c746
Following on from Ia85ea5d338f07cb248f60de44b21826862d09d26 n-net also
needs to be renabled on these older branches to allow cellsv1 testing.
Change-Id: I300a93142355517382c8ba55105ac7c1e88f29c8
n-cauth serviec has been remvoed from nvoa in Ussuri and that is why
it was removed from default services[1]. But that is requried
for stable/queens|pike|ocata which still depends on text-matrix
for ENABLED_SERVICES. Since stable/rocky we have migrated the
service enable in devstack base job[2].
This commit fix the Tempest master and stable/queens|pike|ocata
gate by re-enable the n-cauth service for listed stable branches
only. Later we can discuss to remove the test-matrix dependency for
these branches also.
Related-Bug: 1858666
[1] https://review.opendev.org/#/c/700217/
[2] https://review.opendev.org/#/c/546765/
Change-Id: Ia85ea5d338f07cb248f60de44b21826862d09d26
test-features.sh wasn't testing anything for subnodes
so this adds a subnode feature support matrix test for
grenade. It also highlights that the grenade config
is applied to all nodes regardless of role so a TODO
is added to test_matrix.py in case someone needs to make
that per-role, per-config service override support at
some point (hopefully that never really happens and all
jobs are moved to zuulv3 by that point).
Change-Id: I485d76c1db5c3a4363c3e26fea204cc7782887f3