Commit Graph

400 Commits

Author SHA1 Message Date
Dr. Jens Harbott f74d878f4f Add openstack-tox-py312 job
Use pyenv flag for the ensure-python role since python3.12 isn't
available yet as distro pkg on bookworm.

Change-Id: If42cb167c3395e530e3dcd0090bbca86023ac738
2024-03-18 10:56:18 +01:00
Clark Boylan c24b26ae7f Remove CentOS 7 jobs
We're removing CentOS 7 test nodes from OpenDev and before we can do
that we need to clean up the supporting infrastructure for things like
wheel caching/mirroring which in turn depends on openafs packaging.
Enough time has passed since we announced the CentOS 7 nodes would be
removed that we should be good to start dropping this supporting
infrastructure. Go ahead and make that happen.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/912283
Change-Id: I5c56e0f081b4a4720ca59c8d2b59621fcaaad39d
2024-03-08 12:35:54 -08:00
Zuul 4a9060649a Merge "Drop Debian Buster python wheel mirror jobs" 2024-02-28 17:06:23 +00:00
Clark Boylan 77d3be7031 Remove tripleo projects from legacy-dsvm-base
These tripleo projects were removed from zuul entirely so it is no
longer valid to have them listed as required projects in zuul jobs. This
cleanup also points out that we can probably clean up the entire
legacy-dsvm-* job structure at this point.

Change-Id: I0e3e43cc0525871b39cc1b85c955bcedddfbe0cf
2024-02-28 08:15:59 -08:00
Clark Boylan a6902bb563 Drop Debian Buster python wheel mirror jobs
We are in the process of dropping this node type from nodepool and our
mirrors entirely. Stop running jobs to build the python wheel
mirror/cache for this release.

Note we may need to force merge some of these depends on in order to get
this change in. Maybe we'll force merge this change instead or as well.

Depends-On: https://review.opendev.org/c/openstack/requirements/+/910247
Depends-On: https://review.opendev.org/c/openstack/requirements/+/910241
Depends-On: https://review.opendev.org/c/openstack/requirements/+/910242
Depends-On: https://review.opendev.org/c/openstack/requirements/+/910243
Depends-On: https://review.opendev.org/c/openstack/requirements/+/910244
Depends-On: https://review.opendev.org/c/openstack/requirements/+/910245
Depends-On: https://review.opendev.org/c/openstack/requirements/+/910246
Change-Id: I0d328220b1679c8ac514bf534dbb6a908db0a2dd
2024-02-26 16:50:04 +00:00
Zuul 28b8ae6aaf Merge "Add openstack-tox-functional-py311" 2024-02-26 16:20:04 +00:00
Elod Illes 8edb975e6c Clean up Train and Ussuri branch filters
Train and Ussuri transitioned to End of Life [1] so let's remove all
stable/train and stable/ussuri related filters from the zuul jobs.

[1] https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/UJ7Y76LRWTZQSSDAGMPWCCVVGGIX3TOG/

Change-Id: I666fb6c534672de22b01185da24c358753b3e532
2024-02-20 18:39:33 +01:00
Ghanshyam Mann d85300e755 Extend the tox<4 pinning for unmaintained branches also
Tox was pinned < version 4 for all stable branches <=zed.
With new branch namespace, those stable branches moving to
unmaintained/* name[1] and endup using the latest tox version
and fail[2]. To fix that, we need to extend the tox pin for
those unmaintianed branches also.

Currently only unmaintained/yoga is proposed but soon or in
future all branches from victoria to zed are moving to
unmaintained/ so pinning tox for those branches also.

[1] https://review.opendev.org/q/topic:%22create-yoga%22
[2] https://zuul.opendev.org/t/openstack/build/201ecdc067e646868c4f17374093f328

Change-Id: I2a977fa9c57e540ded4cc5017283302106f5c807
2024-02-06 12:04:39 -08:00
Tom Weininger cb96722681 Add openstack-tox-functional-py311
Python 3.11 is supported runtime in 2024.1.

Change-Id: I647dbac4e80518561b91a1be5b296d0d98395cda
2024-01-09 09:39:50 +01:00
Elod Illes 0fad4c0162 Clean up stein branch filters
Stein transitioned to End of Life [1] so let's remove all
stable/stein related filters from the zuul jobs.

[1] https://lists.openstack.org/pipermail/openstack-discuss/2023-September/034965.html

Change-Id: I5923fda875183e6ead678a60a85e888c6955ed49
2024-01-04 13:28:46 +01:00
Brian Haley 77eea99bb8 Create py311 jobs for neutron
There are three job definitions here for testing
neutron with the master branches of other projects,
specifically neutron-lib, oslo, and ovsdbapp. As
neutron is no longer testing py310 in its master
gate, create py311 versions of these jobs so we
can move forward.

Also changed the periodic jobs here to start using
the py311 versions.

Change-Id: I28e1d41ebd36fbbe9ed3e4c18dd9604a906af043
2023-10-31 15:19:04 -04:00
Elod Illes 1ec1739229 Clean up rocky branch filters
Rocky transitioned to End of Life [1] so let's remove all
stable/rocky related filters from the zuul jobs.

[1] https://lists.openstack.org/pipermail/openstack-discuss/2023-January/031922.html

Change-Id: Id8b5001955d9d6d2631e1eb88364e379f44e7ee7
2023-09-07 17:19:58 +02:00
James E. Blair 450dec3a86 Use re2 compatible regexes in branch matchers
Python regexes are deprecated in Zuul, so update the use of regexes
in branch matchers with re2-compatible syntax.

Change-Id: I2216976a9c040cdf1d324f90831a543f7cf4a15d
2023-09-05 15:06:55 -07:00
Zuul a8cd29fa1a Merge "Remove ocata branch filters" 2023-08-22 05:11:35 +00:00
Jeremy Stanley 94e44f1c81 Run project-config-nodepool on debian-bookworm
Nodepool now requires Python 3.11 and so cannot be installed with
the default Python on our default nodeset. Specify a debian-bookworm
nodeset where this version of Python is the default.

Change-Id: I961430b678c3d126a2808320a8529d8649d879ac
2023-08-19 20:05:31 +00:00
Ghanshyam Mann be15cc9558 Adding Python3.11 non voting job for 2023.2 cycle testing
Python3.11 is default in Debian 12 and which is going to be
mandatory testing in future cycle. It is good to test it
as non voting in this cycle so that projects will get time
to fix the things in advance.

Change-Id: I8c74a3f21b8696389d692c7b0706cfe6f43120f8
2023-08-16 16:05:11 -07:00
Elod Illes 977deeb97b Remove ocata branch filters
Projects ocata branches have transitioned to End of Life, which means
that all ocata related branch filters and unnecessary definitions can
be removed.

Change-Id: I6bae6ce07c58855379db7afd9394b94de3781fee
2023-08-16 21:14:38 +02:00
Dr. Jens Harbott e98954049a Add openstack-tox-py311 job
Some projects want to include python3.11 in their testing, provide a
generic job for that like we have for older python versions.

Change-Id: I725b94bee6601a81b5e64db204bf3488674eff9d
2023-08-11 08:37:40 +02:00
James Page 25215327e0 openstack-tox-snap-with-sudo: increase timeout
Increase the timeout for building a snap to 60 minutes; with some
of the transient changes in the Python dependency chain the snaps
have to build quite a few more native extensions, pushing out the
build time.

Change-Id: Icd7f2e10522c2cf69107db74823bf8b767a9e53d
2023-08-03 16:24:44 +01:00
Jeremy Stanley b3cad4f7a3 Exercise changes to Gerrit ACL normalization
Changes to the normalize_acl.py script should be self-testing so
that we don't break the project-config-gerrit job.

Change-Id: Ib42ee415d39f0239a8ea62c9c3d39b3f215a9ae4
2023-04-07 17:38:58 +00:00
Antoine Musso 699e811cb8 Remove ignored success-url job attribute
Since Zuul 4.7.0:

> The following attributes are now ignored:
>
> * The ``report-build-page`` tenant configuration setting.
> * The ``success-url`` job attribute.
> * The ``failure-url`` job attribute.

Remove `success-url` from all jobs.

Change-Id: I1379221d47edefff716875d801bedf8eee067314
2023-03-17 12:02:23 +01:00
Cyril Roelandt e2e6e1fa15 openstack-tox-functional: pre-install python packages
Stable branches of some projects (Glance, for instance) use Python2.7
for their functional tests. Pre-install Python2 packages for these
stable branches.

Change-Id: Id629fb84ab64db136b12f6e36dfd7aed1c593cd6
2023-02-28 15:20:29 +01:00
elajkat da46058e0a Use py39 or py310 as base job for oslo-master jobs
Recently openstack-tox-py310-with-oslo-master jobs started to fail
with "No package matching 'python' is available", due to that [1]
dropped py2 from nodepool images, and the base job's parent is
openstack-tox-py27.

[1]: https://review.opendev.org/c/openstack/project-config/+/872476
Change-Id: If66af5320d9a208035d9d1ea219eae7d87a31072
2023-02-13 10:11:19 +00:00
Zuul 64464f23ff Merge "FIPS changes to allow FIPS to run on multinode Ubuntu jobs" 2023-02-09 19:51:50 +00:00
Ian Wienand d267af41de openstack-tox-py27 : pre-install python packages
As noted inline, we dropped the install from the base images.  This
should pre-install python2/-dev to return us to about the same state,
but just for the legacy jobs.

Change-Id: Ia8cf6911cb48dfbef59fcf890d4b29d162dc11ad
2023-02-07 21:03:59 +00:00
Zuul 4f2e80c616 Merge "VPNAAS, FWAAS: remove old jobs from legacy jobs" 2023-02-07 08:32:48 +00:00
Ade Lee 176daf9c82 FIPS changes to allow FIPS to run on multinode Ubuntu jobs
There are two problems we need to solve when enabling FIPS for
multinode Ubuntu jobs.

1. Ubuntu nodes require a subscription to be activated with a
   subscription key that is stored as a secret in project-config.

2. Because enabling FIPS requires a reboot, we need to execute the
   enable-fips playbook before the multinode playbook.  If not,
   resources set up by the multinode playbook may not survive the
   reboot.

To solve these problems, we have created a new base job for
OpenStack multinode jobs.  (openstack-multinode-fips).  We expect
to use this job as the base job for OpenStack multinode jobs
instead of the multinode job in zuul-jobs.

The openstack-multinode-fips inherits from openstack-fips, which
is a job defined in project-config that access the UA subscription
key and activates the UA subscription.  This solves problem #1.

It then executes the enable-fips and multinode playbooks
(FIPS first!), which in turn, invoke the enable-fips and multinode
roles in zuul-jobs.  This solves problem #2.

This has the unfortunate result of having to duplicate the logic
of the multinode/pre.yaml playbook in zuul-jobs here in
openstack-zuul-jobs instead, but I can't see a way around that.

Note that unless the variable enable_fips is defined to be true
in the job, all the FIPS logic is essentially a no-op.

If enable_fips is set to True, then jobs will also need to specify
nslookup_target for the post-reboot-tasks role invoked by the
enable_fips role.

Depends-On: I8a88d6a9bcf5725986b00b063e03686d3225b48e
Change-Id: I080df90af850088893976c8649aa528638c6f373
2023-01-30 22:35:16 +01:00
Elod Illes 791854227d Clean up queens branch filters
Queens transitioned to End of Life [1] so let's remove all
stable/queens related filters from the zuul jobs.

[1] https://lists.openstack.org/pipermail/openstack-discuss/2022-November/031323.html

Change-Id: I2a41f6399d1063125c22885fa89dc022b78037e6
2023-01-24 13:45:22 +01:00
Ghanshyam Mann 4888ad13e9 Pin tox<4 for stable branches (<=stable/zed) testing
tox4 need changes in tox.ini file to be compatible with it
and while fixes are merged in master and backported to stable
(if project decide to backport) let's cap the stable branch
testing to tox<4.

This only pin for jobs running for stable branches <=stable/zed.

Change-Id: Id468500746bc5c0986ec3334bfdafc24eeaba2f8
2023-01-05 14:27:41 -06:00
Jiri Podivin 7ce5a0e1da Fixing documentation of the openstack-tox-job to correctly state the node set used
Signed-off-by: Jiri Podivin <jpodivin@redhat.com>
Change-Id: I80fedc9a6f806e4d1b27bc6a390b13538de10272
2022-12-06 09:43:11 +01:00
Zuul 65af8a8e72 Merge "Add py310 master template jobs" 2022-11-28 13:06:40 +00:00
Ghanshyam Mann 6d85fd8399 Migrate OpenStack tox base jobs to Ubuntu Jammy (22.04)
As per 2023.1 testing runtime[1], we need to move gate
test jobs on Ubuntu Jammy (22.04).

OpenStack tox base jobs are migrated to ubuntu jammy for
2023.1 onwards and they will continue running on Focal
until stable/zed.

[1] https://governance.openstack.org/tc/reference/runtimes/2023.1.html

Change-Id: If9bab60107ea2f049f0940766cf44ce3ebb002ee
2022-11-18 16:50:03 -06:00
Zuul fe8e994bef Merge "Run build-openstack-puppet-tarball on Focal" 2022-10-31 12:07:38 +00:00
Takashi Kajinami b20eb582a0 Run build-openstack-puppet-tarball on Focal
The build-openstack-puppet-tarball job consistently fails since
the default node set was switched from Focal to Jammy. This change
pins the node set back to Focal until we fix the current issue.

Change-Id: Ib1a55d624c72aa773ab03b736efed0699f35e946
2022-10-31 15:13:22 +09:00
elajkat 4d28e8dcff Add py310 master template jobs
The following py39 based jobs has been changed to py310 based in these
templates:
- periodic-jobs-with-neutron-lib-master
- periodic-jobs-with-oslo-master
- periodic-jobs-with-ovsdbapp-master

Change-Id: I96023fb323647465dacc450567d4a6adf6f59314
2022-10-25 10:30:44 +02:00
Elod Illes a4936e55bc Clean up ocata and pike branch filters
Since ocata and pike have transitioned to EOL, these filters are not
needed anymore and can be deleted.
This patch also removes some job definition which were only used for
ocata and pike branches.

Change-Id: I69ebf0ae122220ae8c88310094468aedb3f4a660
2022-10-24 18:28:54 +02:00
Elod Illes 834910ed86 Add missing openstack-tox-py310-arm64 job
When adding the latest py310 jobs the arm64 job was forgotten.
This resolves the zuul config error by adding the job.

Change-Id: I6a691ccdf62db9117e9e26962af1592486c94288
2022-09-16 16:54:16 +02:00
Ian Wienand bf16bbd394 project-config-grafyaml: remove job
This has been replaced by project-config-grafana

Change-Id: Ida2feba2c5745f6a3398efb2e3a63cc64779dba1
Depends-On: https://review.opendev.org/c/openstack/project-config/+/851954
2022-08-03 16:21:14 +10:00
elajkat 9d5fa22af5 VPNAAS, FWAAS: remove old jobs from legacy jobs
neutron-vpnaas Train and Ussuri branches are no more maintained (see
[1]), so the EOL process has been started on them (see [2]), and as a
consequence for these and for older branches vpnaas can be removed from
legacy job requirements.
neutron-fwaas EOL-d these branches already so it can be also removed.

[1]: http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028728.html
[2]: https://review.opendev.org/c/openstack/releases/+/843167

Change-Id: I90023d9cdf763bc86235e050a917203945bc39bc
2022-07-22 15:40:30 +02:00
Ian Wienand 96991ebe40 project-config-grafana: collect container logs
Add a post step to collect the logs of the grafana and selenium
container for debugging purposes.

Change-Id: I8224046d265aebbfbec4bf5d0b0f2c2ac18f1076
2022-06-29 15:16:24 +10:00
Ian Wienand 45d96f730e Revert "project-config-grafana: make opendev-buildset-registry soft dep"
This reverts commit ace49f32d9.

This job calls use-buildset-registry which needs a registry running to
work.  We think this is basically as designed;
https://review.opendev.org/#/q/I74c771d048c7a808511864445ed1a124644f661a
adds this to project-config.  Since we've decided this is a hard
dependency, revert this change.

Change-Id: Id07f728b8414d29f107ee2d00590d417d20867e5
2022-06-28 10:55:14 +10:00
Ian Wienand ace49f32d9 project-config-grafana: make opendev-buildset-registry soft dep
This job was meant to work by either pulling through the registry for
speculative testing, or for project-config just running on released
images.  Make this soft so project-config doens't have to start a
registry.

Change-Id: Icd1b531de30a34780a340ea02209f49eb925de36
2022-06-28 08:40:53 +10:00
Zuul fb7158602f Merge "grafana : import and screenshot project-config graphs" 2022-06-27 22:17:53 +00:00
Ian Wienand 59e8221e7c grafana : import and screenshot project-config graphs
This is a job that imports the graphs we have defined in
project-config/grafana to a testing grafana instance, then takes some
screenshots to validate the layout and aid review.

Operation is fairly straight-forward; a grafana container is setup
(see related work in Ibbc2b116d0c496655a7ce6bb6971e8270ac32647) and
grafyaml is used to import the dashboards from project-config.  We
query the grafana instance to find the dashboards, then use selenium
and a small helper to take screenshots of each.

It pulls graphyaml from the buildset registry as a soft dependency, so
we can also add it as an extra test to the grafyaml repo.

Change-Id: Ice0863d5a180738119d572df1871093a292126be
2022-06-24 13:56:09 +10:00
Ade Lee c74bc566da Add nslookup_target to fips jobs
New parameter needed because of [1]
[1] https://review.opendev.org/c/zuul/zuul-jobs/+/844704

Change-Id: Ia8088df3fed23da6ec0ba38afc8d6af76b47cffe
2022-06-22 12:11:35 -04:00
Slawek Kaplonski 5c9d242fdb Define "python_version" in the openstack-tox-py39-with-oslo-master
This job runs on Ubuntu focal in which by default there is no python 3.9
installed.
To install it we need to define "python_version" variable in that job.

Change-Id: I9aee024e2055056a44224f675f786d8633445568
2022-06-02 11:44:44 +02:00
Zuul b740b42fb1 Merge "Add build-wheel-cache jobs for Ubuntu Jammy" 2022-05-23 22:16:24 +00:00
Ghanshyam Mann 25f15a9163 Remove py36 lib master testing job
Below patch moving lib master testing to py39
- https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/842646

and depends on replacing the below py36 jobs usage
to py39. Witht that we can remove the below py36 jobs.
- openstack-tox-py36-with-neutron-lib-master
- openstack-tox-py36-with-oslo-master
- openstack-tox-py36-with-ovsdbapp-master

Depends-On: https://review.opendev.org/c/openstack/project-config/+/842843
Change-Id: I87070e249637942330d084115774fe960d03787a
2022-05-21 09:23:50 -05:00
Ghanshyam Mann 8dfc7c011e Move master template from py36 to py39
Below master template has been moved to py39 based
testing
- periodic-jobs-with-neutron-lib-master
- periodic-jobs-with-oslo-master
- periodic-jobs-with-ovsdbapp-master

Change-Id: Ic176f01330e680b0dcebf955e219b634c50d55c8
2022-05-21 09:21:54 -05:00
Dr. Jens Harbott 7b1b763bf8 Add build-wheel-cache jobs for Ubuntu Jammy
Change-Id: I3f190dadb927fe44d7122c170f7b0e2ea5b8bd6b
2022-05-21 13:23:28 +02:00