Commit Graph

189 Commits

Author SHA1 Message Date
Ghanshyam Mann 61f5733a66 Decentralize the zuul jobs into zuul.d
Current .zuul.yaml file has 36 jobs definition and
it is growing more which makes it hard to read and
error prone.

This commit move the jobs definitions to zuul.d directory to
different yaml files:
- base.yaml includes base jobs definition
- integrated-gate.yaml includes integrated jobs to be
  used in other openstack projects too.
- stable-jobs.yaml includes all stable jobs
- tempest-specific.yaml includes jobs supposed to run on Tempest
  gate only
- project.yaml includes different pipelines (check, gate etc) definition

Change-Id: I984ecee81a9730b663764800f604333f28fd8180
2020-11-25 18:03:56 +00:00
Zuul c6d6ac2df1 Merge "Add glance multistore job (nv) in tempest gate" 2020-11-13 15:39:41 +00:00
Zuul 78e3512bef Merge "Clarify tempest-full job description" 2020-11-10 14:26:16 +00:00
Ghanshyam Mann fec0dc182d Add glance multistore job (nv) in tempest gate
There are Tempest tests (also new tests proposal) for glance
multistores setup. It will be good to see the result of those
tests via glance multistore job. Adding that as non voting because
that is nv in glance side too.

Change-Id: I3cf2c473a33ef59b6388565a18d84a0e495be58d
2020-11-09 13:31:54 -06:00
Ghanshyam Mann 3fdbab4e3d Clarify tempest-full job description
tempest-full is py2 job and only supported until
stable/train as Tempest/devstack or any other OpenStack
service (except swift) are python3-only from ussuri onwards.

This job can be run on ussuri gate onwards for py2.7 test coverage
but it needs to be overridden with stable/train or any stable branch
less than stable/train. Supported nodeset for overridden stable
will be handled by branched devstack.

Also replace few jobs parent from tempest-full to tempest-full-py3.

Change-Id: Icbd0ed88736f0ac746cd1fe20eb9b1f7d739f6bd
2020-11-05 13:26:10 +00:00
Ghanshyam Mann 721aeca8ef Unskip Device detach compute tests on Focal
During migrating the testing to Ubutnu Focal,
we skipped few device detach tests due to bug#1882521
- https://review.opendev.org/#/c/734700/8

Now Nova bug#1882521 is fixed so let's unskip those tests.

Change-Id: I9e48d72fc1192a775671ca339e0339e8ec1afa17
Related-Bug: #1882521
Related-Bug: #1894804
2020-11-01 18:47:32 +00:00
Zuul 711e9f21c8 Merge "zuul: Move tempest-integrated-compute to Focal" 2020-11-01 01:39:43 +00:00
Zuul b439c974fa Merge "Add Tempest gate job for stable/victoria" 2020-10-22 16:07:19 +00:00
Martin Kopec cfd6159f97 Make neutron-tempest-dvr job non-voting
The job is lately very unstable and fails randomly which blocks
other tempest patches. Let's make it temporarily non-voting.

Change-Id: I5f53953c1fa9e88e8406ec6a080314d813137774
2020-10-19 17:42:02 +00:00
Masayuki Igawa f0547d6068 Add Tempest gate job for stable/victoria
Now we have stable/victoria branch ready for devstack
and so does for all service projects.

This commit adds the Tempest testing for stable/victoria
by adding new jobs running on stable/victoria version of
openstack.

Change-Id: Ibf6f167793bc157c915ebbcd3ce860207e8fa21b
2020-10-08 16:21:40 +00:00
Lee Yarwood 9667217d5e zuul: Move tempest-integrated-compute to Focal
The recently uncovered undefined QEMU behaviour when sending multiple
requests to detach a device should now be avoided with the introduction
of Ib9ed7069cef5b73033351f7a78a3fb566753970d allowing this job to move
to Focal on master as defined in the devstack-minimal base job.

Related-Bug: #1882521
Related-Bug: #1894804

Depends-On: https://review.opendev.org/#/c/755799/
Change-Id: Ic66285ef5dcefa9556c34cda42744ea30902cd37
2020-10-06 09:56:33 +01:00
Ghanshyam Mann 1ca760cd29 Migrate tempest jobs to focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

Most of the Tempest jobs will be migrate automatically once devstack
base job start running on Focal(Depends-On).

Few job like tempest-full-multinode and plugin sanity job needs to override
the nodeset. multinode job needs to run on Bionic till stable/ussuri and
on focal from master(victoria) onwards.

stable jobs testing stable branch needs to keep running on their supported
distro version which is bionic from stein till ussuri.

Keep 'tempest-integrated-compute' to run on bionic until
https://bugs.launchpad.net/qemu/+bug/1894804 is fixed.

Depends-On: https://review.opendev.org/#/c/731207/

[1] https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal.html

Change-Id: I51fbd32a60c931d404e59e975049f7b01ed900dc
2020-09-17 17:34:16 -05:00
Abhishek Kekane 7cff130795 Tempest tests for glance import workflow
This adds an initial test for glance image interoperable import
that uses the glance-direct method. It will skip if the server
does not support glance-direct.

Adding feature flag to enable the import tests as devstack on
stable branches cannot support image import feature.

Change-Id: I09e7fb4e7758edd5256ae70ceeea6f143466c3e3
2020-07-24 13:09:12 -05:00
Luigi Toscano b4e0e2c7e7 zuul: clean up some legacy jobs
Replace legacy-tempest-dsvm-lvm-multibackend with its native version,
cinder-tempest-lvm-multibackend.

Remove legacy-tempest-dsvm-neutron-dvr-multinode-full, which was defined
as an experimental job in neutron and removed during the ussuri lifecycle.
See https://review.opendev.org/#/c/693630/
It seems neutron-tempest-dvr-ha-multinode-full should cover its use case.

Change-Id: I6edfd00f0c43cd0bfe688db5e43768288dd4c1c1
2020-07-15 15:40:28 +02:00
Zuul 257f3b009f Merge "Move ceph job to voting" 2020-05-30 16:14:20 +00:00
Zuul 006e8d175e Merge "Switch testing to Victoria testing runtime" 2020-05-11 02:04:23 +00:00
Ghanshyam Mann de69845d75 Switch testing to Victoria testing runtime
Updating the testing template from ussuri to victoria
testing runtime
- https://governance.openstack.org/tc/reference/runtimes/victoria.html

Change-Id: If964909a73a52836e3adbb7b695f1c7322b81830
2020-05-05 14:35:52 +00:00
Martin Kopec f62dbc1c22 Add tempest-cleanup ansible role
The patch adds a new ansible role called tempest-cleanup which will
allow us to test tempest cleanup in the gate jobs.

Change-Id: I2cef2da6fee13e622da07b890da88850fe420152
2020-05-05 12:07:51 +00:00
Ghanshyam Mann 8c5333b06a Move ceph job to voting
Currently ceph job is n-v, if I remember
correctly it was kept n-v due to its stability.

But it is stable and voting on many projects. With
n-v it is hard to monitor it all the time.

let's make it voting and if any new tests failing we
can add that in the ceph blacklist in advance.
Example: https://review.opendev.org/#/c/724866/

Change-Id: Ic484d233b325c887f0a19f3ec06376d403beb964
2020-05-01 18:29:44 -05:00
Zuul 7d1b080f17 Merge "Add Tempest gate job for stable/ussuri" 2020-04-30 22:20:00 +00:00
Zuul 5cc3ffce8c Merge "Remove the stable rocky from supported branch in Tempest master" 2020-04-29 21:54:31 +00:00
Ghanshyam Mann f8b8987c5b Move the grenade-py3 job to new zuulv3 grenade job name
'grenade' is zuulv3 native job for py3 (because devstack is default to
py3 since Ussuri) which replace the old 'grenade-py3'
legacy job. 'grenade-py3' job is alias to the new zuulv3 native
'grenade' job but that is only for migration time. Later once
all switch to new job name, we will remvoe the 'grenade-py3' alias
job.

Change-Id: Iea355514ec7cc2a52ed5e88c356bcb1cdeadd639
2020-04-27 20:58:17 +00:00
Ghanshyam Mann 6d6bf5e6e8 Add Tempest gate job for stable/ussuri
Now we have stable/ussuri branch ready for devstack
and so does for all service projects.

This commit adds the Tempest testing for stable/ussuri
by adding new jobs running on stable/ussuri version of
openstack.

Depends-On: https://review.opendev.org/#/c/723605/

Change-Id: Ifa7887675d34ab8169347b69a8e1ff723b55e466
2020-04-27 17:18:15 +00:00
Ghanshyam Mann ba416467e6 Remove the stable rocky from supported branch in Tempest master
Rocky is in Extended Maintainance state now so we can
remove this from supported branch and also remove its
jobs to run on master gate.

-https://releases.openstack.org/

Depends-On: https://review.opendev.org/#/c/722186/

Change-Id: I46f4abf07839fb5e8767635e2502e97e8409b8b8
2020-04-23 02:30:32 +00:00
Ghanshyam Mann 0fb306f2e0 Make tempest-multinode-full py2 job on py2
tempest-multinode-full is python2 version
of mutlinode testing for stable branches and
supposed to run on python 2 but it was left during
- I75868d5c9b6630fe78958ff89e58a0aced09a6b3

Change-Id: Ibec72b578424cb278006ac810bdd0359ec23de3f
2020-03-15 14:43:44 -05:00
Zuul f61e18ff7b Merge "Remove devstack-plugin-ceph-tempest py2 job" 2020-03-04 04:04:41 +00:00
Ghanshyam Mann d2bdd8c0b8 Remove devstack-plugin-ceph-tempest py2 job
devstack-plugin-ceph-tempest is py2 job and not
supposed to run on master gate. Moving
devstack-plugin-ceph-tempest-py3 from experimental pipeline
to check.

Change-Id: I8a15d919f9902315c4a8d27d73dabbcc5be8d8de
2020-03-02 01:40:41 +00:00
Slawek Kaplonski 8cb1b47481 Set 3h timeout for tempest-ipv6-only job
I saw in Neutron queue that default 2h timeout for this job wasn't
enough sometimes. So it's better to keep this job running a bit longer
sometimes rather than recheck everything.

Change-Id: I7c256f1ca5790cd13411d3af78ec97efcfd28b0a
2020-02-19 13:12:54 +01:00
Ghanshyam Mann 4062a5cebb Re-enable the stable rocky job
stable rocky is fixed and green now[1],
This commit re-enables those.

[1] https://review.opendev.org/#/q/topic:fix-stable-gate+(status:open+OR+status:merged)

Change-Id: Ia25c8022f6bf2a0015641ef097f09b29f34e6d16
2020-02-14 13:30:15 +00:00
Ghanshyam Mann 551e8d7a59 [ussuri][goal] Drop python 2.7 support and testing
OpenStack is dropping the py2.7 support in ussuri cycle.

Tempest is ready with python 3 and ok to drop the
python 2.7 support. Last Tempest version officially supported
for py2.7 is 23.0.0.

Now onwards, Tempest will test all stable branch with py3 jobs.
tempest-full and other py2 version of jobs definition are kept
for stable branch gate.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal:
https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html

Change-Id: I75868d5c9b6630fe78958ff89e58a0aced09a6b3
2020-02-12 00:11:31 +00:00
Ghanshyam 535cfb05f9 Disable stable/rocky temporarily on Tempest master
Stable/rocky jobs are broken due to py2
drop by Tempest dependency.
- http://lists.openstack.org/pipermail/openstack-discuss/2020-February/012371.html

Fixes are on devstack stable/rocky and tempest side
- https://review.opendev.org/#/q/topic:fix-stable-gate+(status:open+OR+status:merged)

To get the Tempest fix and other patches merged
we need to disable the rocky jobs on master gate
temporary and bring them back once everything is fixed.

Tempest fix blocked due to stable/rocky jobs
-https://review.opendev.org/#/c/705870/

Change-Id: I2238387c42650aceb9bacf51a4116ce6887cc460
2020-02-06 15:41:50 -06:00
Ghanshyam b0a8057fbb Drop python 3.5 support from Tempest
Tempest, its plugins and their dependencies in ussuri
cycle are python-requires>=py3.6 which makes distro not
having python 3.6 to do hack to install py3.6 etc.

We cannot do >py3.6 in basepython so one way is to drop the
py3.5 support and basepython to py3 so that it can choose
the available py version in env.

It time to drop the py3.5 from Tempest. Last supported version of
Tempest for py3.5 is 23.0.0.

oslo drop py2 so we need to remove the py2 unit test job which
is failing and blocking gate.

There is seoarate work to drop the py2 things from Tempest in
compplete set.

Change-Id: I872dbb57df46d1193c0d409bb00d56f372d295fe
Related-Bug: 1861308
2020-02-04 19:23:01 +00:00
Ghanshyam 64da1a1403 Remove the Queens stable branch jobs from master gate
Tempest 23.0.0 is released now, which marks the end of support
for Queens release - https://review.opendev.org/#/c/703521/

We do not need to run the Queens stable jobs on master gate now.

Depends-On: https://review.opendev.org/#/c/703521/
Change-Id: I2ae25eb7aa88258580a4163f617548df35e74bdb
2020-01-21 09:45:39 -06:00
Zuul d3c82c7922 Merge "Drop old neutron-grenade job" 2019-12-11 19:03:00 +00:00
Slawek Kaplonski c0a4346a4d Use python 3 on all nodes in multinode jobs
This fixes used python version on subnodes in jobs like
tempest-slow-py3 and tempest-multinode-full-py3

Change-Id: I851d2dbcb863f0e21e6cbcbb6b856ce1f3d3f092
Closes-Bug: #1853004
2019-11-19 15:00:15 +01:00
Zuul 86baf1d6ef Merge "Set irrelevant-files for bashate job" 2019-11-18 12:45:50 +00:00
Slawek Kaplonski 39f5153ff9 Drop old neutron-grenade job
This job is still running python 2.7. As we are dropping py2 support in
Ussuri cycle, lets drop this job now.
There is same job called "grenade-py3" which runs on python 3 already
and this is still used in project's CI.

Change-Id: I6a4ce001d6cbb4455386285c0d0a43be592e57d7
2019-11-14 11:48:54 +01:00
Zuul 9ef4316091 Merge "Remove unused opensuse150 job definition" 2019-11-12 22:48:39 +00:00
Dirk Mueller 8557f46538 Remove unused opensuse150 job definition
After all remaining users have been migrated we can
remove this one.

Depends-On: https://review.opendev.org/692035
Depends-On: https://review.opendev.org/692526
Change-Id: I62c2f80aa46133948a084775e72ed027c8005407
2019-11-01 10:09:20 +00:00
Matt Riedemann f66aea04a5 Disable c-bak service in tempest-full* jobs
Cinder backup tests suffer from a high failure rate and
given they do not interact with many other services (glance
and swift for the most part it looks like) we should disable
them from running in the tempest-full job which is part of
the integrated-gate project template, which is what this change
does.

My recommendation would be to make sure cinder backup test
coverage is happening in some other non-integrated-gate jobs
which are running on cinder changes already, like the
cinder-tempest-dsvm-lvm-lio-barbican job (which is voting but
not gating on cinder changes).

This should also help with bug 1783405 where tempest-full
can timeout due to backup tests which aren't marked slow.

c-bak was already disabled in tempest-full-py3 because
swift is disabled but this copies the same note to the
tempest-full-py3 job definition.

Change-Id: I9d39d9d7d706ba3fcba5ff352e8c9e31ab4639a2
Related-Bug: #1483434
Related-Bug: #1745168
Related-Bug: #1783405
Related-Bug: #1813217
2019-10-17 19:48:24 +00:00
Zuul 7fdd39c6db Merge "switch to the newly created opensuse-15 nodeset" 2019-10-16 19:02:42 +00:00
Ghanshyam Mann 910f9c5202 Add Tempest gate job for stable/train
Now we have stable/train branch ready for devstack
and so does for all service projects.

This commit adds the Tempest testing for stable/train
by adding new jobs running on stable/train version of
openstack.

Change-Id: I0ea8008ad0ef18b9e45c41f9ba40a70fd6d57b6a
2019-10-04 17:30:00 +00:00
Masayuki Igawa f2104a8460
Set irrelevant-files for bashate job
This commit sets the tempest-irrelevant-files-2 for the bashate job. We
just need to run the job when we change bash scripts. Currently, bash
scripts are located in the tools/ directory only. So,
"tempest-irrelevant-files-2" is better than "tempest-irrelevant-files".

Change-Id: I0f55ffaa844736056769f1fbeca82fc0cb0a9a86
2019-09-25 11:47:23 +09:00
Dirk Mueller f352241b07 switch to the newly created opensuse-15 nodeset
opensuse-150 nodeset is referring to openSUSE 15.0, which is still in
maintenance but openSUSE 15.1 has been released already. "opensuse-15"
is going to refer to the "latest openSUSE 15.x" build released and
working for OpenStack going forward, so add this nodeset and use
it by default going forward.

This is the remaining work to be done after https://review.opendev.org/#/c/667539
got merged earlier

Change-Id: I3c0e14c606c88b5deecfad71bc156e53335d543e
2019-09-18 14:00:55 +02:00
Masayuki Igawa 3044a29a17
Add irrelevant files to .zuul.yaml
This commit adds 4 irrelevant files to both "irrelevant-files" and
"irrelevant-files-2". We don't need to run tempest tests with updating
such files because they don't affect tempest tests.

Change-Id: I6f84abc1b9273f38b99678edaff54deb0fd99e0c
2019-09-17 15:30:54 +09:00
Masayuki Igawa f33ae3a5b4
Remove required projects for sanity job
This commit removes required projects for the sanity job. It should be
better to remove them since we don't need for sanity checking.

Change-Id: Iad2f9f3d08aa1a422a6a94cd56467a16f683fa3b
2019-09-03 17:21:19 +09:00
Zuul 2394557b4f Merge "Make plugin-sanity-check job as voting" 2019-09-02 16:12:32 +00:00
Zuul cf50c87d69 Merge "Remove the Pike stable branch jobs from master gate" 2019-08-04 17:22:45 +00:00
Zuul 236a14bf3c Merge "Introduce bashate" 2019-08-02 02:53:28 +00:00
Jens Harbott (frickler) 6b4232b70f Merge "Revert "Use memcached based cache in nova in all devstack-tempest jobs"" 2019-08-01 14:01:52 +00:00