Commit Graph

292 Commits

Author SHA1 Message Date
Zuul 506d3bae49 Merge "[Feature] Add skyline deployment capability" 2024-04-16 10:45:07 +00:00
James Denton 2c06a65a75 [Feature] Add skyline deployment capability
This change adds Skyline deployment options to OSA.

New files have been added / integrated into the normal deployment
process to support the use of skyline.

Co-Authored-By: Jonathan Rosser <jonathan.rosser@rd.bbc.co.uk>
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
Needed-By: https://review.opendev.org/c/openstack/openstack-ansible-os_skyline/+/912333
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_skyline/+/914439
Change-Id: Ia5c8c60fb152e3eb27e2719f6d7032ca62690601
2024-04-05 10:56:31 +00:00
Dmitriy Rabotyagov 2a13bc557d Add ovn-bgp-agent to source install requirements
Change-Id: I8f7ec0d29c316bf428caadaf35e18617e5a82d50
2024-03-05 09:15:35 +00:00
Zuul 2c19da0d8b Merge "Remove galera_client from required projects" 2024-02-13 14:04:32 +00:00
Zuul dd65a44893 Merge "Add Octavia OVN provider to required repos" 2024-02-13 14:04:29 +00:00
Zuul e4eabf0b76 Merge "Add SLURP upgrade jobs" 2024-02-12 13:57:32 +00:00
Zuul 08aa54330d Merge "Allow zuul pre playbook bootstrap to be skipped" 2024-02-10 00:48:45 +00:00
Dmitriy Rabotyagov aa8d40bf65 Remove galera_client from required projects
Repository has been deprecated a while ago, so should not be fetched
anymore.

Change-Id: I268603d3466af05ba2fb8938d2b79180fedf520f
2024-02-09 19:32:02 +00:00
Dmitriy Rabotyagov 37e15db17f Allow zuul pre playbook bootstrap to be skipped
This is needed if a child job in an openstack-ansible role repo
needs to do some configuration before bootstrap-ansible is run.

An example might be configuring extra roles, collections or
pythin modules to be installed during bootstrap.

Change-Id: I463cf5df7c2aa4e2cdf399efaeb17df980d29edc
2024-02-08 09:26:11 +00:00
Dmitriy Rabotyagov fc75a09d35 Add Octavia OVN provider to required repos
Needed-By: https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/868462
Change-Id: Iac5e66076cc8caee4f47a286d2f5e0145697d59a
2024-02-07 15:39:22 +00:00
Dmitriy Rabotyagov d1d2aa00f2 Remove distro_ceph template from project defenition
We never had a template for distro_ceph jobs, so it's resulting in zuul
configuration errors for all our stable branches.

Change-Id: Ied048e041abc5563d01cd58f57c1a4b685de0586
2024-02-07 16:38:54 +01:00
Dmitriy Rabotyagov 8215dcce9e Add SLURP upgrade jobs
Since we're to support 2023.1 -> 2024.1 upgrades, it would be good
to add CI testing as well.

Change-Id: I106d86c702300673a142e15bbeead0642287474d
2024-02-07 10:57:36 +00:00
Dmitriy Rabotyagov 48eed425ef Add tempest tests for Blazar
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/904785
Needed-By: https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/904791
Change-Id: I05ff19772a4df012cced134c81c9befd3d33d3b5
2024-02-01 21:35:00 +00:00
Jonathan Rosser f205f0f005 Run deploy guide publish jobs when .gitreview changes
This will make the deploy guide be published when the .gitreview
file is changed on a newly created branch during the release process.

Change-Id: I17fa99fde903367d6e617130e7bd4a6f2a612d1c
2023-12-12 16:53:09 +00:00
Dmitriy Rabotyagov f33a8b1836 Disable RabbitMQ quorum queues by default
During PTG we agreed to disable quorum queues by default during this
cycle and wait for improvements proposed as part of [1] before enabling
it by default.

This also adds a separate job that will test scenario with enabled quorum
queues.

[1] https://review.opendev.org/q/topic:bug-2031497

Change-Id: I0807cc1ed991fd85f9f74d4a360d3fd23cde227c
2023-11-27 10:23:49 +00:00
Dmitriy Rabotyagov 9e41877425 Tune SSH in pre-step setup
This intends to disable some time-consuming settings for SSH connection to
speed up further setup.

Change-Id: I2c7961fca688fb50c01e2c7cdbc04a262fed42a0
2023-10-27 07:45:43 +00:00
Zuul 719e4c9ac0 Merge "Add CI jobs for debian bookworm" 2023-10-25 14:02:06 +00:00
Jonathan Rosser 25f1e9651d Add CI jobs for debian bookworm
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/894558/
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/894621
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-memcached_server/+/894624
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/894740
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/894795
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/897656
Depends-On: https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/897701
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/898463

Change-Id: Ic2c6dc470f0a76d0451724211c2010762207f796
2023-10-16 18:01:18 +00:00
Zuul 9af39fd4d1 Merge "Add tls upgrade jobs" 2023-09-26 17:44:49 +00:00
Damian Dabrowski 46ffb2702b Add tls upgrade jobs
This patch adds new jobs to test upgrade scenario where TLS is fully
disabled on SOURCE_SERIES but enabled on TARGET_SERIES.
Keystone proto is set to 'http' to ensure that
`openstack_service_accept_both_protocols` works as expected.

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible/+/885190
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/885337
Change-Id: I6d967f444b2de67fc394cf8c52f4e236418b5f98
2023-09-18 13:19:23 +02:00
Dmitriy Rabotyagov d72b3394a2 Remove Ubuntu 20.04 support
With ansible-core>=2.14 python 3.8 support has been dropped. Moreover,
nova has bumped minimal required version for libvirt/qemu, which makes
us to remove support for Ubuntu 20.04 Focal Fossa.

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/884362
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/884363
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/884361
Change-Id: I3e6e22553248a9199113a65b0dbe992c38ccb22e
2023-07-07 12:39:23 +02:00
Dmitriy Rabotyagov b97c4860eb Start 2023.2 (Bobcat) development
Depends-On: https://review.opendev.org/c/openstack/tempest/+/884584
Change-Id: I124942ace678765b01bcb642798bdca6d14f3141
2023-06-06 17:08:01 +00:00
Zuul 20ba785441 Merge "Switch ubuntu upgrade jobs to Jammy" 2023-05-23 21:00:08 +00:00
Dmitriy Rabotyagov 965dd83a1b Switch ubuntu upgrade jobs to Jammy
Since Zed we're fully supporting jammy as distirbution and thus should
execute upgrades from Zed to 2023.1 using jammy. At the same
time upgrades from Yoga to 2023.1 will remain on focal as jammy
was not supported yet on Yoga.

We're also adding workaround for OVS bug that's present for Jammy and
OVN scenario.

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/883740
Change-Id: I3c41c756812336d9ed0efec05d602a6781e20b81
2023-05-22 17:18:42 +00:00
Zuul d61ce4f2f7 Merge "Add 'tls' scenario" 2023-05-22 10:40:49 +00:00
Dmitriy Rabotyagov 9fca8555df Move repo_packages to group_vars
At the moment it's not possible to apply different versions of
services to the different groups due to playbook vars having
prescedence over group_vars. However, it can be quite important
to  such use cases, for example for phased rollouts of newer versions.

This will also reduce amount of unnecessary variables that are included
for each host, since only required git details will be loaded.

Closes-Bug: #2007296
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/881954
Change-Id: Icaa3a958926d9f9aa6cb649bd9f3da9449dd7490
2023-05-18 08:49:51 +00:00
Dmitriy Rabotyagov 0e92e00777 Populate scenario properly in CI for N-2 upgrade job
After adding upgrade_yoga job, I have missed to adjust regexp to parse
SCENARIO properly. Due to that, infra jobs were attempting to
run aio_lxc upgrade job rather then just infra.

Change-Id: I7215b9c43ccd539f117787a510078368ba7034cf
2023-05-17 14:22:53 +00:00
Damian Dabrowski b029cfd880 Add 'tls' scenario
This patch adds new 'tls' scenario along with its jobs.

TLS scenario changes two things in default deployment:
- TLS is enabled on all openstack endpoints(by default only public
endpoint is available over https).
- TLS backend is enabled for all services(traffic between haproxy and
service backends is encrypted)

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/876429
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/874810
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/879380
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/874966
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/873654
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/821011
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/879379
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/879517
Change-Id: If4cc13e3d0907e36de6d932936cac81f02b4dc2c
2023-05-15 23:04:29 +02:00
Dmitriy Rabotyagov 9f56dc611a Add Yoga upgrade jobs
This patch aims to implement testing of SLURP upgrades. While
2023.1 is the first SLURP release, upgrade from Yoga to 2023.1 is
considered as unofficial SLURP upgrade.

With that we're adding changes to gate-check-commit to be able to
provide source release from which upgrade will be perfromed.

While running upgrade script user is required to provide source
release as input to script for SLURP releases.

Also regular upgrades are now switched to Zed as they supposed to be.

Change-Id: I64e55b2c685782d23bb84e7e9f7c60708c276cc3
2023-04-25 07:34:43 +00:00
Dmitriy Rabotyagov b2e12a6ae5 Replace CentOS 9 Jobs with Rockylinux
During PTG there was an agreement to focus more on Rocky testing
comparing to CentOS Stream since these jobs are quite troublesome
lately and not due to our fault. Right now CentOS is completely borked
due to gnupg release backport [1]
With that to unblock CI and to execute PTG decision, we're marking
all CentOS jobs as non-voting and replacing them with Rocky 9 jobs.
We also mark Rocky as voting for upgrade jobs.

[1] https://bugzilla.redhat.com/show_bug.cgi?id=2184640

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/879680
Change-Id: Id431dd8d49f86079b6ca3f0f16718489f60ffa77
2023-04-05 19:19:23 +00:00
Dmitriy Rabotyagov 80d839ba04 Disable CentOS LXC jobs due to the bug in systemd packaging
At the moment systemd-udev package is being resolved to
systemd-boot-unsigned due to CentOS packaging issue [1]. Resolution to this
issue would be providing a full path to any of file that is not provided
but systemd-boot-unsigned but provided by systemd-udev
which does not have a really clean and good workaround.

So we're disabling CentOS LXC jobs for now and waiting for CentOS
waiting to fix this. There're bunch of bug reports and all systemd there
in quite a messy state overall.


[1] https://bugzilla.redhat.com/show_bug.cgi?id=2183279

Change-Id: I98c62db4c7b9e191e3fe0395337420aa331730e9
2023-03-30 18:19:21 +00:00
Jonathan Rosser b59b392813 Use certbot to generate SSL cert for the external VIP in 'stepca' scenario
This patch uses the certbot functionality to issue a certificate
from a locally installed ACME server on the AIO node, when the
string 'stepca' appears in the scenario.

This allows testing of the certbot code in the haproxy role and the
wider integration with Openstack-Ansible to be tested in CI jobs.

Change-Id: Ide769f54505898630aae67e25b238624ba4f4fdb
2023-03-15 23:16:48 +01:00
Jonathan Rosser c024e4f9d0 Switch proxy job from focal to jammy
Change-Id: I03a1eeb6614275a422f4fe82b3711667404689ff
2023-03-13 09:01:19 +00:00
Jonathan Rosser 41d887973c Add validation zuul job for hosts setup
Run a hosts scenario job when any of the basic host setup playbooks
or the hosts validation playbook is changed.

Change-Id: I1a6334951c815fc70c93b5a950ea3fcd1606b669
2023-02-23 11:11:17 +00:00
Jonathan Rosser 57a68e760f Add tempest and tempest plugins to required jobs for source deploys
This allows the local zuul repos to be used rather than clone from
the internet.

Change-Id: I8d6825b0aa7edf9ccdac27f67a6bedfc16a60f01
2023-01-17 16:42:12 +00:00
Dmitriy Rabotyagov bb3a58604b Restore dynamic_inventory unit testing
It seems that we have dropped unit testing of our dynamic_inventory
some time ago. This patch aims to setup zuul tests using tox
and restore test functionality to make it passing with current codebase

Change-Id: I8ccee779fd629e8696ec2e12397b148b52cd0c73
2023-01-11 10:14:43 +00:00
Dmitriy Rabotyagov 9335103807 Run zookeeper installation for validate job
Depends-On: https://review.opendev.org/c/openstack/ansible-role-zookeeper/+/865449
Change-Id: I5da11b989dae712a1dac70358d5aee1274a0d00b
2022-12-10 08:44:58 +00:00
Dmitriy Rabotyagov efb4ef94be Reduce amount of distro jobs
Leave distro jobs only for CentOS 9 Stream and Jammy as distro packages
are officially supported for these 2 distros. Jobs are still non-voting
and distro support is in experimental state, so no need to spend more
CI time then needed.

Change-Id: I470a2f0c0fb70fd3158d82db316518b9c0cdcdea
2022-12-08 12:27:09 +01:00
Dmitriy Rabotyagov b1d3ba19b3 Switch distro jobs to Jammy
Distor jobs for Ubuntu 22.04 should be fairly good to mark them as
experimental. We also mark CentOS/Rocky 9 distro jobs as experimental.
Currently there's a but in RDO that makes instalaltion fail due to
absent bmemcahed packaged, but they already working on fixing it.

Change-Id: I1a10d5ac8ad0f07f9822f043f64e13238664c8be
2022-12-06 17:19:44 +00:00
Dmitriy Rabotyagov 65ce2753fa Add zookeeper deployment
Zookeper is being added as a coordination backend which is
required for some service features to work properly.

Change-Id: I2d464ae339f057ea4ba08bd343b6a51c029a74f3
2022-11-25 09:13:22 +00:00
Zuul 460da383c5 Merge "Make Ubuntu Jammy voting" 2022-11-08 17:43:06 +00:00
Dmitriy Rabotyagov c93a42c297 Make Ubuntu Jammy voting
We are moving Ubuntu 22.04 support out of experimental state
which means that Jammy should be voting now. With that we are also
replacing focal jobs with jammy in gates to save CI resources.

Change-Id: I91c5e130348f4080cf947cb1097f78da6a34bfb4
2022-10-28 10:32:59 +02:00
Dmitriy Rabotyagov bc5428b21d Remove usage of rsyslog roles
We've switched all services to store logs to journald by default and
rsyslog roles are not used except really small amount of usecases that
also hardly valid as of today. With that we deprecate repos and remove
their usega to reduce maintenance load.

Change-Id: Iefd4143f83f4df44b917180000a1aa57161b2811
2022-10-19 15:10:59 +02:00
Neil Hanlon f2cc3bbfce Add Rocky Linux 9 to zuul and docs
* Fix up messaging in a couple of playbooks to describe Rocky as a
  supported install host

Change-Id: Ief4023bab570836b41c6837a6abbbbcde2644bb3
2022-09-29 12:17:46 +00:00
Andrew Bonney 25d9d01d17 zuul: fix definition of centos 9 stream job
Minor typo/omission meaning some jobs are still using CentOS 8

Change-Id: I3dc516c7369d3bebf163f74277d2ebfbe20b15ee
2022-07-27 15:29:46 +01:00
Dmitriy Rabotyagov 8e50bfc565 Continue Zed development
Unfreeze roles and switch services back to master branch

We also make distro jobs NV as Zed packages are not released yet, and Yoga sdk is not
working with current ansible-collections-openstack.

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/848589
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/848666
Change-Id: I1db9cf99afde2b8dc64149ea29bfef651a406f34
2022-07-05 19:31:23 +00:00
Jonathan Rosser 4faf9006cc Set zuul post-timeout to 3 hours
This is completely excessive but part of debugging why there is occasional
POST_TIMEOUT jobs failures when uploading logs to swift storage.

Change-Id: I070284b8c35cdaa098a28c052995ebf5c3f4250c
2022-06-27 15:35:25 +01:00
Jonathan Rosser 69f76b8dc6 Switch ARA report type from html to database for openstack-ansible jobs
The sqlite database is useful for post-processing ARA reports. The HTML
generation makes thousands of files which can take a very long time
to upload to a swift endpoint.

Also fix the collection location for the ARA sqlite file.

Change-Id: I754e236594eddc7b80cbb293ebb9ae217c864c62
2022-06-25 08:26:56 +01:00
Jonathan Rosser e112e895e9 Add mistral-extra to required projects in CI
We can't reference the local zuul version of this repo without
adding it here.

Change-Id: I5d778dd4fbe216eb2c0c88f5c397268e39980808
2022-06-16 09:58:50 +01:00
Jonathan Rosser 566d4ec5de Add experimental Ubuntu 22.04 support
This is not officially supported by openstack for the Yoga
release due to 22.04 shipping python3.10, but the jobs are
passing with only small adjustments so experimental support
is added during the Yoga release.

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/838836
Depends-On: https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/838830
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/838832
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/839521
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/840278
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/840313
Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/840518
Change-Id: Ieee9c0d690d4e8207a0806bd385ffccc12188906
2022-05-31 18:01:48 +02:00