Commit Graph

869 Commits

Author SHA1 Message Date
Clark Boylan 8325a38fa9 More CentOS 7 Cleanup
This removes publication of centos 7 build artifacts (like those for
openafs packages) from our centos artifacts publication job. We split
this into a separate change because centos 7 got a new kernel recently
and our existing dib images hadn't refreshed to pull that in yet which
is required for successful package updates on centos 8 and 9 stream.

Now the kernel should be updated and everything should work.

Change-Id: I369ceb1dda81f698d8b591b5f2991f99a7a823af
2024-03-11 08:34:37 -07:00
Clark Boylan 9ec0fa8ca5 Cleanup legacy CentOS 7 jobs and nodesets
We are starting work to remove CentOS 7 from Zuul and Nodepool. The
first step there is to delete everything that appears to be unused. We
do that here cleaning up nodesets and jobs that should be unused at this
point in time.

Note we keep the wheel cache/mirror build and publication jobs around
for just a bit longer. We will clean those up when we are closer to
being able to remove everything CentOS 7 related.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/910978
Change-Id: I984c494afc5ba58b50350bc9eae58260cc66f2ee
2024-03-04 10:19:33 -08:00
Zuul 6d2d07fd8f Merge "Cleanup orphan jobs after stable/train EOL of nova" 2024-01-06 07:45:06 +00:00
Ghanshyam Mann cd04a735ee Remove unused zero-downtime job
zero-downtime job is used only in nova experimental pipeline
which is going to be removed now (depends-on).

This job is failing 100% https://zuul.opendev.org/t/openstack/builds?job_name=legacy-grenade-dsvm-neutron-multinode-zero-downtime

Depends-On: https://review.opendev.org/#/c/741603/
Change-Id: Iabb6bc307cae3f03d6aa52c4a1af2d9756a5f04e
2024-01-04 15:18:06 +01:00
elajkat 8bc650905a Remove legacy only jobs for bagpipe and bgpvpn projects
As we EOL queens, rocky and stein for networking stadium projects some
legacy jobs can be removed:
- legacy-tempest-dsvm-networking-bagpipe
- legacy-tempest-dsvm-networking-bgpvpn-bagpipe
- legacy-networking-bagpipe-dsvm-fullstack

Change-Id: I5782410fc0303599e101912719c7b630908921e5
Depends-On: https://review.opendev.org/c/openstack/releases/+/846188
2024-01-04 10:19:51 +01:00
Elod Illes 82d28a6895 Cleanup orphan jobs after stable/train EOL of nova
These jobs were used only in nova's stable/train, but that went to EOL,
so job definitions can be removed from here.

Change-Id: Ib6005dcd7eefbe693a400ef016103ed1df064d83
2024-01-03 14:25:26 +01:00
Elod Illes 1ec1739229 Clean up rocky branch filters
Rocky transitioned to End of Life [1] so let's remove all
stable/rocky related filters from the zuul jobs.

[1] https://lists.openstack.org/pipermail/openstack-discuss/2023-January/031922.html

Change-Id: Id8b5001955d9d6d2631e1eb88364e379f44e7ee7
2023-09-07 17:19:58 +02:00
Elod Illes 977deeb97b Remove ocata branch filters
Projects ocata branches have transitioned to End of Life, which means
that all ocata related branch filters and unnecessary definitions can
be removed.

Change-Id: I6bae6ce07c58855379db7afd9394b94de3781fee
2023-08-16 21:14:38 +02:00
Clark Boylan 6e81c37e80 Revert "Pull grafyaml from quay.io"
This reverts commit d6f701cfeb.

OpenDev is moving back to docker.io to preserve speculative container
image testing.

Depends-On: https://review.opendev.org/c/opendev/grafyaml/+/884291
Change-Id: Ib58e053c8d354f7a223dce1070cae9731f5c32e1
2023-05-24 13:56:33 -07:00
Clark Boylan d6f701cfeb Pull grafyaml from quay.io
The grafyaml image has moved to quay.io. Ensure we are pulling it from
that new maintained location.

Depends-On: https://review.opendev.org/c/opendev/grafyaml/+/882493
Change-Id: I4b2dfc8436d4238470af31f5a8d7a881fe254558
2023-05-08 09:21:06 -07:00
Tim Burke 7d3ab66ee0 Fix installation of py27 on CentOS 7/8
Some projects (such as pyeclib) might want to run openstack-tox-py27
with a centos-7 nodeset.

Change-Id: If636f5350021d8733a8ecc52c71626aa3d601064
2023-04-28 13:17:21 -07:00
Ade Lee fa4d1e7e9a Fix playbook to enable fips
Change-Id: If986f85b961f081296328392beb3836f96b5b80e
2023-02-13 14:01:13 +01:00
Zuul 64464f23ff Merge "FIPS changes to allow FIPS to run on multinode Ubuntu jobs" 2023-02-09 19:51:50 +00:00
Sandeep Yadav 7d79c95fe5 Fix Installation of py27
After merge of [1], we are hitting a new issue in py27 jobs.

detailed log[2]
~~~
ERROR! unexpected parameter type in action:
<class 'ansible.parsing.yaml.objects.AnsibleSequence'>
~~~

Fixing this playbook with this patch.

[1] https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/873020/2/playbooks/tox/py27.yaml
[2] https://c3f93530c9211d80493c-aff6bc2b39e4d26360d25c473974606e.ssl.cf5.rackcdn.com/872983/5/gate/openstack-tox-py27/e8389a8/job-output.txt

Change-Id: I117b1371f2504e2d97c970480e733bedbed98343
2023-02-08 11:22:56 +05:30
Ian Wienand d267af41de openstack-tox-py27 : pre-install python packages
As noted inline, we dropped the install from the base images.  This
should pre-install python2/-dev to return us to about the same state,
but just for the legacy jobs.

Change-Id: Ia8cf6911cb48dfbef59fcf890d4b29d162dc11ad
2023-02-07 21:03:59 +00:00
Ade Lee 176daf9c82 FIPS changes to allow FIPS to run on multinode Ubuntu jobs
There are two problems we need to solve when enabling FIPS for
multinode Ubuntu jobs.

1. Ubuntu nodes require a subscription to be activated with a
   subscription key that is stored as a secret in project-config.

2. Because enabling FIPS requires a reboot, we need to execute the
   enable-fips playbook before the multinode playbook.  If not,
   resources set up by the multinode playbook may not survive the
   reboot.

To solve these problems, we have created a new base job for
OpenStack multinode jobs.  (openstack-multinode-fips).  We expect
to use this job as the base job for OpenStack multinode jobs
instead of the multinode job in zuul-jobs.

The openstack-multinode-fips inherits from openstack-fips, which
is a job defined in project-config that access the UA subscription
key and activates the UA subscription.  This solves problem #1.

It then executes the enable-fips and multinode playbooks
(FIPS first!), which in turn, invoke the enable-fips and multinode
roles in zuul-jobs.  This solves problem #2.

This has the unfortunate result of having to duplicate the logic
of the multinode/pre.yaml playbook in zuul-jobs here in
openstack-zuul-jobs instead, but I can't see a way around that.

Note that unless the variable enable_fips is defined to be true
in the job, all the FIPS logic is essentially a no-op.

If enable_fips is set to True, then jobs will also need to specify
nslookup_target for the post-reboot-tasks role invoked by the
enable_fips role.

Depends-On: I8a88d6a9bcf5725986b00b063e03686d3225b48e
Change-Id: I080df90af850088893976c8649aa528638c6f373
2023-01-30 22:35:16 +01:00
Riccardo Pittau 229f592754 Remove legacy virtualpdu job
Cleaning up legayc virtualpdu job in parallel with [1]
We'll start dealing with CI jobs directly in the project with [2]

[1] https://review.opendev.org/c/openstack/project-config/+/869979
[2] https://review.opendev.org/c/x/virtualpdu/+/869983

Change-Id: If6a465f5b167e8e3625b8d104787a45add9c2480
2023-01-16 12:23:46 +01:00
Elod Illes c794f36e58 Remove bindep for announce-release job
The bindep install causes problem for announce-release and it seems
unnecessary for this job, so let's get rid of it.

Change-Id: Id3eeb168dd72e379fd8bf3fba0407ce1c1314ecb
2022-11-11 15:32:41 +01:00
Elod Illes a4936e55bc Clean up ocata and pike branch filters
Since ocata and pike have transitioned to EOL, these filters are not
needed anymore and can be deleted.
This patch also removes some job definition which were only used for
ocata and pike branches.

Change-Id: I69ebf0ae122220ae8c88310094468aedb3f4a660
2022-10-24 18:28:54 +02:00
Ian Wienand 78f01dc19e grafana: explicitly validate graphs
Explicitly validate the graphs early to avoid doing anything if the
graphs won't load.

Change-Id: Ie9e858e4d8ce92e72de4358fecc40196f79b0229
2022-08-03 16:08:49 +10:00
Zuul 8d15ae16d9 Merge "linters: fix yaml whitespace" 2022-08-02 22:01:25 +00:00
Ian Wienand 9815c29cd8 linters: fix yaml whitespace
Fix whitespace issues revealed by yamllint with a later ansible-lint

Change-Id: I2bd97c294fd5c83f83ed30f57a9e9c265ab4c8ac
2022-07-28 15:22:44 +10:00
Ian Wienand 96991ebe40 project-config-grafana: collect container logs
Add a post step to collect the logs of the grafana and selenium
container for debugging purposes.

Change-Id: I8224046d265aebbfbec4bf5d0b0f2c2ac18f1076
2022-06-29 15:16:24 +10:00
Zuul fb7158602f Merge "grafana : import and screenshot project-config graphs" 2022-06-27 22:17:53 +00:00
Ian Wienand 59e8221e7c grafana : import and screenshot project-config graphs
This is a job that imports the graphs we have defined in
project-config/grafana to a testing grafana instance, then takes some
screenshots to validate the layout and aid review.

Operation is fairly straight-forward; a grafana container is setup
(see related work in Ibbc2b116d0c496655a7ce6bb6971e8270ac32647) and
grafyaml is used to import the dashboards from project-config.  We
query the grafana instance to find the dashboards, then use selenium
and a small helper to take screenshots of each.

It pulls graphyaml from the buildset registry as a soft dependency, so
we can also add it as an extra test to the grafyaml repo.

Change-Id: Ice0863d5a180738119d572df1871093a292126be
2022-06-24 13:56:09 +10:00
elajkat eb16004254 Remove legacy only jobs for fwaas and fwaas-dashboard
As we EOL queens, rocky and stein for networking stadium projects some
legacy jobs can be removed:
- legacy-neutron-fwaas-dsvm-fullstack
- legacy-neutron-fwaas-dsvm-functional
- legacy-neutron-fwaas-v1-dsvm-tempest
- legacy-neutron-fwaas-v1-dsvm-tempest-multinode
- legacy-neutron-fwaas-v2-dsvm-tempest
- legacy-neutron-fwaas-v2-dsvm-tempest-multinode

Depends-On: https://review.opendev.org/c/openstack/releases/+/846196
Change-Id: Iab4b7801735fdcbcf8fd9ed46907bf457c2e4bfd
2022-06-17 14:24:23 +00:00
elajkat a2e036ba10 Remove legacy pike only jobs for networking projects
As we EOL pike for networking projects some legacy jobs can be removed:
- legacy-tempest-dsvm-neutron-scenario-linuxbridge
- legacy-tempest-dsvm-neutron-dvr-multinode-scenario
- legacy-tempest-dsvm-networking-ovn-ovs-release-ovsdbapp-src

Change-Id: Ifdf942f311b06182f1ba623c9a20d67cccaf019b
Depends-On: https://review.opendev.org/c/openstack/releases/+/841086
2022-05-18 13:51:00 +02:00
Ian Wienand 9796e40ccf vhd-util-deb-package-build: add publish job
The generic promote job has been tested with OpenAFS now, we can add
the vhd job.

Change-Id: I94039c5822904d968b4fcb059a544f278ac1a1d6
2022-05-10 14:13:55 +10:00
Ian Wienand e54c2bc3bc openafs-deb-package: fix role var typo
Change-Id: I6de06de8758f8aaf66496d493e7ce076a1ed3d37
2022-05-10 12:31:37 +10:00
Ian Wienand b48bf53f49 debs : add generic PPA publish role, switch openafs to it
Use the generic role from I11e2bdcbf2894d86105d75c3d3580aefb6aa18fc
and make a generic publishing role too.

Remove the openafs specific bits that are no longer used.  Move the
description of the OpenAFS jobs above the job definition.

Change-Id: Ie61b82903644605d07f510ad1071fa551e7086c9
2022-05-10 11:00:45 +10:00
Ian Wienand f4ab3e465e debs: Add vhd-util job
Add a job to build the vhd-util packages using the generic build
infrastructure.

Change-Id: I69ee6b48cc1e9dc50487e301f6bdfac1969ef934
2022-05-10 10:46:17 +10:00
Ian Wienand a26c93712f openafs-deb-packge-build: fix dput argument
Change-Id: Id624aa1ec6213be70809a8f911ab4aadc8a6ed53
2022-05-05 12:06:16 +10:00
Ian Wienand 68d03b5f86 openafs-deb-package-build: push to test PPA
The keys should be setup, run a test push to a temporary PPA to test
building.

Change-Id: I31fd91f3be32bc9109924d6363d0e32fd9d68b94
2022-05-05 11:27:51 +10:00
Ian Wienand 58cb728310 openafs-deb-package-build: sign created debs
This is step 1 in promoting the openafs deb packages to the
openstack-ci PPA.  It should grab the debs from the gate build and
sign the .changes file with our key.

This is intentionally not uploading yet as we just want to test the
secret import and signing path before we add the key and permissions
to the upstream PPA.

Change-Id: Idd91818093588113b84c1d91b4895df589aa7912
2022-05-05 10:19:54 +10:00
Ian Wienand 8e4d342807 openafs: generate deb packages for openstack-ci PPA
This imports the latest debian/* from the upstream openafs packages,
and builds source packages meant for upload to the PPA we use for
openafs.

Over the years we have found that maintaining our own PPA for this is
useful.  We have hit bugs that require immediate patches to be applied
and rolled out to production, and having a private build facilitates
this.  Generally we hope to have no delta to the upstream packaging,
which is currently the case.

Currently we have a fairly manual process to produce and upload these
debs (once there, the source is obviously available).  This allows us
to keep a little clearer view of what we've changed or are working on.

This doesn't publish anything, yet.  We'll work on that after this;
the idea is that the publishing job will consume the artifacts this
returns.

Change-Id: I07780595331da29af9f72185cbb3499210e89c19
2022-05-04 13:39:10 +10:00
Ian Wienand 164b4e29a4 openafs: don't create non -stream directory for arm64
I copied this wrong, we are just having a "9-stream" directory to be
clear about what it is.

Change-Id: Ic21488249b004329bee149c03bae550118b97188
2022-05-03 11:27:08 +10:00
Ian Wienand a27a266f31 openafs: add 9-stream ARM64 builds
Depends-On: https://review.opendev.org/c/opendev/base-jobs/+/840255
Change-Id: Id81490d34bcef18792c4b938893bf5168900d98f
2022-05-03 10:13:21 +10:00
Ian Wienand c309a7a401 openafs: there is not centos-9 arm64 build (yet)
Don't try and copy this, it doesn't exist yet.

Change-Id: If4f02cfe91c7567b99e76298d8e9bf7d6f02468d
2022-05-02 14:13:37 +10:00
Ian Wienand 34300b6526 openafs: fix 9-stream dir typo
Change-Id: I5a4491f4ffc65e37f353ca66139d015eb097e5a6
2022-05-02 12:37:23 +10:00
Ian Wienand 1d7825865e openafs: fix extraction
The promote job is failing with "... openafs/centos8-stream' must be
an existing dir".  We probably don't need both 8 and 8-stream now, but
let's just get this working first.

Change-Id: I142786153efb37b19e9994c49f16636bd26c4376
2022-05-02 11:30:15 +10:00
Ian Wienand 6a6f4ecf70 Build CentOS 9 RPM packages
This builds and publishes openafs packages for CentOS 9

Change-Id: I26c727caba12e544dd483dc3e8f04fd7d6bf7daa
2022-04-29 21:21:31 +10:00
Clark Boylan 60a63f1bb1 Use the official RDO yoga repo for liberasurecode on centos 9
We had to workaround this repo not existing when we first spun up wheel
builds for centos 9 stream. But the repo appears to exist now so use the
official production stuff rather than the test builds.

Change-Id: I85cf1c29d501817254ddc54ef02bd75b848ed942
2022-04-20 09:59:23 -07:00
Marcin Juszkiewicz 09f3a61793 Add build-wheel-cache jobs for CentOS Stream 9
Change-Id: I01aeeeaed1d76d0980de1a327c3a49dbddafceef
2022-04-11 10:48:47 +10:00
Zuul 1f9d9b40f5 Merge "wheel-cache: update openstack package for 8-stream" 2022-02-08 05:49:44 +00:00
Ian Wienand d7cfa6b003 wheel-cache: update openstack package for 8-stream
This old openstack package brings in centos-release-ceph-nautilus
which actually has an incorrect mirrorlist entry in it's .repo file
that tries to point it at the centos-8 repos [1].  When upstream
retired CentOS 8 this stopped responding.  Update to Xena (we don't
rely on any of these bits, it's just one or two packages we need
bindep to install for the wheel builds).

[1] https://bugzilla.redhat.com/show_bug.cgi?id=2051792

Change-Id: Ice106cfee23c514a5e5716d4368af9f62360e2f7
2022-02-08 14:22:15 +11:00
Clark Boylan eaa4324e6d Remove centos-8
This removes wheel build jobs for centos-8 (we already have them for
-stream) and convers the openafs package builds over to centos-8-stream.

This bumps the openafs version to try and accomodate the changes to the
stream kernel on aarch64.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/824243
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824258
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824257
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824256
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824240
Change-Id: I7e196f6b3b2bf785b8a94bb04de7062da3042b34
2022-01-11 15:21:19 -08:00
Slawek Kaplonski 9a00135243 Remove neutron and networking-midonet Ocata jobs definitions
This patch removes legacy-neutron-dsvm-api job definition
It seems that this job was used only in the Neutron stable/Ocata branch
which is going to be EOL with [1].
In the stable/Pike branch Neutron is using only
"legacy-neutron-dsvm-api-pecan" job which isn't removed by that patch.

It also removes networking-midonet jobs:
* periodic-tempest-dsvm-networking-midonet-aio-ml2-full-ocata
* periodic-tempest-dsvm-networking-midonet-aio-v2-full-ocata

As those jobs were also used only in Ocata branch which is EOL in
networking-midonet already.

[1] https://review.opendev.org/c/openstack/releases/+/790904

Change-Id: I7b9e6cb20d7b8d8d1dff9b8bee2c652df743b2ba
2021-08-30 16:59:16 +02:00
Ade Lee c3c1b422ab Add FIPS job
The job makes sure that functional tests pass when the nodes are
set to be in fips mode.

Depends-On: https://review.opendev.org/c/zuul/zuul-jobs/+/788778
Change-Id: Ib0388771ee1d9151850f4513f016b85b2970df93
2021-06-07 13:52:57 -04:00
Antoine Musso aa276402ff Retire gearman-plugin jobs
Remove jobs and playbooks for x/gearman-plugin which is being retired:

- legacy-gearman-plugin-maven-build
- legacy-gearman-plugin-hpi-artifact
- legacy-gearman-plugin-jenkinsci-upload

Depends-On: Ib6010d7ce85a934501c50a53e9ac78dcf74bc403
Change-Id: I5e35464c6b63f97770835d2adb927cb08c40e952
2021-05-27 17:18:20 +02:00
Andreas Jaeger 1d96b09987 Remove legacy-dsvm-os-loganalyze
The repo is retired, we can remove the job now.

Change-Id: Ic8a3bd61412fafc5966c132de574b407ce10108a
2020-09-29 14:32:54 +02:00