Current .zuul.yaml file has 36 jobs definition and
it is growing more which makes it hard to read and
error prone.
This commit move the jobs definitions to zuul.d directory to
different yaml files:
- base.yaml includes base jobs definition
- integrated-gate.yaml includes integrated jobs to be
used in other openstack projects too.
- stable-jobs.yaml includes all stable jobs
- tempest-specific.yaml includes jobs supposed to run on Tempest
gate only
- project.yaml includes different pipelines (check, gate etc) definition
Change-Id: I984ecee81a9730b663764800f604333f28fd8180
There are Tempest tests (also new tests proposal) for glance
multistores setup. It will be good to see the result of those
tests via glance multistore job. Adding that as non voting because
that is nv in glance side too.
Change-Id: I3cf2c473a33ef59b6388565a18d84a0e495be58d
tempest-full is py2 job and only supported until
stable/train as Tempest/devstack or any other OpenStack
service (except swift) are python3-only from ussuri onwards.
This job can be run on ussuri gate onwards for py2.7 test coverage
but it needs to be overridden with stable/train or any stable branch
less than stable/train. Supported nodeset for overridden stable
will be handled by branched devstack.
Also replace few jobs parent from tempest-full to tempest-full-py3.
Change-Id: Icbd0ed88736f0ac746cd1fe20eb9b1f7d739f6bd
During migrating the testing to Ubutnu Focal,
we skipped few device detach tests due to bug#1882521
- https://review.opendev.org/#/c/734700/8
Now Nova bug#1882521 is fixed so let's unskip those tests.
Change-Id: I9e48d72fc1192a775671ca339e0339e8ec1afa17
Related-Bug: #1882521
Related-Bug: #1894804
The job is lately very unstable and fails randomly which blocks
other tempest patches. Let's make it temporarily non-voting.
Change-Id: I5f53953c1fa9e88e8406ec6a080314d813137774
Now we have stable/victoria branch ready for devstack
and so does for all service projects.
This commit adds the Tempest testing for stable/victoria
by adding new jobs running on stable/victoria version of
openstack.
Change-Id: Ibf6f167793bc157c915ebbcd3ce860207e8fa21b
The recently uncovered undefined QEMU behaviour when sending multiple
requests to detach a device should now be avoided with the introduction
of Ib9ed7069cef5b73033351f7a78a3fb566753970d allowing this job to move
to Focal on master as defined in the devstack-minimal base job.
Related-Bug: #1882521
Related-Bug: #1894804
Depends-On: https://review.opendev.org/#/c/755799/
Change-Id: Ic66285ef5dcefa9556c34cda42744ea30902cd37
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).
Most of the Tempest jobs will be migrate automatically once devstack
base job start running on Focal(Depends-On).
Few job like tempest-full-multinode and plugin sanity job needs to override
the nodeset. multinode job needs to run on Bionic till stable/ussuri and
on focal from master(victoria) onwards.
stable jobs testing stable branch needs to keep running on their supported
distro version which is bionic from stein till ussuri.
Keep 'tempest-integrated-compute' to run on bionic until
https://bugs.launchpad.net/qemu/+bug/1894804 is fixed.
Depends-On: https://review.opendev.org/#/c/731207/
[1] https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal.html
Change-Id: I51fbd32a60c931d404e59e975049f7b01ed900dc
This adds an initial test for glance image interoperable import
that uses the glance-direct method. It will skip if the server
does not support glance-direct.
Adding feature flag to enable the import tests as devstack on
stable branches cannot support image import feature.
Change-Id: I09e7fb4e7758edd5256ae70ceeea6f143466c3e3
Replace legacy-tempest-dsvm-lvm-multibackend with its native version,
cinder-tempest-lvm-multibackend.
Remove legacy-tempest-dsvm-neutron-dvr-multinode-full, which was defined
as an experimental job in neutron and removed during the ussuri lifecycle.
See https://review.opendev.org/#/c/693630/
It seems neutron-tempest-dvr-ha-multinode-full should cover its use case.
Change-Id: I6edfd00f0c43cd0bfe688db5e43768288dd4c1c1
The patch adds a new ansible role called tempest-cleanup which will
allow us to test tempest cleanup in the gate jobs.
Change-Id: I2cef2da6fee13e622da07b890da88850fe420152
Currently ceph job is n-v, if I remember
correctly it was kept n-v due to its stability.
But it is stable and voting on many projects. With
n-v it is hard to monitor it all the time.
let's make it voting and if any new tests failing we
can add that in the ceph blacklist in advance.
Example: https://review.opendev.org/#/c/724866/
Change-Id: Ic484d233b325c887f0a19f3ec06376d403beb964
'grenade' is zuulv3 native job for py3 (because devstack is default to
py3 since Ussuri) which replace the old 'grenade-py3'
legacy job. 'grenade-py3' job is alias to the new zuulv3 native
'grenade' job but that is only for migration time. Later once
all switch to new job name, we will remvoe the 'grenade-py3' alias
job.
Change-Id: Iea355514ec7cc2a52ed5e88c356bcb1cdeadd639
Now we have stable/ussuri branch ready for devstack
and so does for all service projects.
This commit adds the Tempest testing for stable/ussuri
by adding new jobs running on stable/ussuri version of
openstack.
Depends-On: https://review.opendev.org/#/c/723605/
Change-Id: Ifa7887675d34ab8169347b69a8e1ff723b55e466
tempest-multinode-full is python2 version
of mutlinode testing for stable branches and
supposed to run on python 2 but it was left during
- I75868d5c9b6630fe78958ff89e58a0aced09a6b3
Change-Id: Ibec72b578424cb278006ac810bdd0359ec23de3f
devstack-plugin-ceph-tempest is py2 job and not
supposed to run on master gate. Moving
devstack-plugin-ceph-tempest-py3 from experimental pipeline
to check.
Change-Id: I8a15d919f9902315c4a8d27d73dabbcc5be8d8de
I saw in Neutron queue that default 2h timeout for this job wasn't
enough sometimes. So it's better to keep this job running a bit longer
sometimes rather than recheck everything.
Change-Id: I7c256f1ca5790cd13411d3af78ec97efcfd28b0a
Tempest, its plugins and their dependencies in ussuri
cycle are python-requires>=py3.6 which makes distro not
having python 3.6 to do hack to install py3.6 etc.
We cannot do >py3.6 in basepython so one way is to drop the
py3.5 support and basepython to py3 so that it can choose
the available py version in env.
It time to drop the py3.5 from Tempest. Last supported version of
Tempest for py3.5 is 23.0.0.
oslo drop py2 so we need to remove the py2 unit test job which
is failing and blocking gate.
There is seoarate work to drop the py2 things from Tempest in
compplete set.
Change-Id: I872dbb57df46d1193c0d409bb00d56f372d295fe
Related-Bug: 1861308
This fixes used python version on subnodes in jobs like
tempest-slow-py3 and tempest-multinode-full-py3
Change-Id: I851d2dbcb863f0e21e6cbcbb6b856ce1f3d3f092
Closes-Bug: #1853004
This job is still running python 2.7. As we are dropping py2 support in
Ussuri cycle, lets drop this job now.
There is same job called "grenade-py3" which runs on python 3 already
and this is still used in project's CI.
Change-Id: I6a4ce001d6cbb4455386285c0d0a43be592e57d7
Cinder backup tests suffer from a high failure rate and
given they do not interact with many other services (glance
and swift for the most part it looks like) we should disable
them from running in the tempest-full job which is part of
the integrated-gate project template, which is what this change
does.
My recommendation would be to make sure cinder backup test
coverage is happening in some other non-integrated-gate jobs
which are running on cinder changes already, like the
cinder-tempest-dsvm-lvm-lio-barbican job (which is voting but
not gating on cinder changes).
This should also help with bug 1783405 where tempest-full
can timeout due to backup tests which aren't marked slow.
c-bak was already disabled in tempest-full-py3 because
swift is disabled but this copies the same note to the
tempest-full-py3 job definition.
Change-Id: I9d39d9d7d706ba3fcba5ff352e8c9e31ab4639a2
Related-Bug: #1483434
Related-Bug: #1745168
Related-Bug: #1783405
Related-Bug: #1813217
Now we have stable/train branch ready for devstack
and so does for all service projects.
This commit adds the Tempest testing for stable/train
by adding new jobs running on stable/train version of
openstack.
Change-Id: I0ea8008ad0ef18b9e45c41f9ba40a70fd6d57b6a
This commit sets the tempest-irrelevant-files-2 for the bashate job. We
just need to run the job when we change bash scripts. Currently, bash
scripts are located in the tools/ directory only. So,
"tempest-irrelevant-files-2" is better than "tempest-irrelevant-files".
Change-Id: I0f55ffaa844736056769f1fbeca82fc0cb0a9a86
opensuse-150 nodeset is referring to openSUSE 15.0, which is still in
maintenance but openSUSE 15.1 has been released already. "opensuse-15"
is going to refer to the "latest openSUSE 15.x" build released and
working for OpenStack going forward, so add this nodeset and use
it by default going forward.
This is the remaining work to be done after https://review.opendev.org/#/c/667539
got merged earlier
Change-Id: I3c0e14c606c88b5deecfad71bc156e53335d543e
This commit adds 4 irrelevant files to both "irrelevant-files" and
"irrelevant-files-2". We don't need to run tempest tests with updating
such files because they don't affect tempest tests.
Change-Id: I6f84abc1b9273f38b99678edaff54deb0fd99e0c
This commit removes required projects for the sanity job. It should be
better to remove them since we don't need for sanity checking.
Change-Id: Iad2f9f3d08aa1a422a6a94cd56467a16f683fa3b