Commit Graph

103 Commits

Author SHA1 Message Date
Will Szumski 9c1951478f Skip buggy release of docker PyPI package
The tag regex is buggy and fails if the docker registry contains a port
number[1].

[1] https://github.com/docker/docker-py/issues/3195

Change-Id: I5d85e751b490ab1e39e417ff8797ca8f8688590b
Closes-Bug: #2054715
2024-03-01 19:08:17 +00:00
Alex-Welsh aef2ce0ae2 CI: Add SLURP upgrade jobs
Change-Id: Id4af9fcfd56c8101276996555e07f6cefe433dd8
2024-02-23 09:57:36 +00:00
Will Szumski 280e84be82 Remove docker devicemapper support
This has now been removed from upstream docker-ce packages.

```
the devicemapper storage-driver has been deprecated and removed
```

and has shown deprecation warnings for some time.

This change also includes some fixes necessary for CI to pass:

* update the Zuul previous_release variable to 2023.2

Closes-Bug: #2051233
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/906858
Change-Id: I263f59ea77e39accffe4febe0d47e56b35d9800e
2024-02-01 14:10:09 +00:00
Pierre Riteau dd8cf81607 Revert "Use OpenStack 2023.2 release"
This reverts commit 99f5b64956.

Reason for revert: 2023.2 has been branched and released

Change-Id: I38fc5dcadda5103d63a11022825e8e167408677d
2023-12-08 11:55:04 +01:00
Pierre Riteau 99f5b64956 Use OpenStack 2023.2 release
Switch all dependencies to use the OpenStack 2023.2 release.

This commit should be reverted on the master branch once the
Kayobe stable/2023.2 branch has been cut and RC1 released.

Change-Id: I749a1ac30fa15cf7faa456fcb90c4ddbbef77cc9
2023-12-01 15:58:47 +01:00
Pierre Riteau 990370a367 Revert "CI: Disable bare metal testing on RL9/c9s"
This requires disabling libvirt_vm_trust_guest_rx_filters, which when
enabled triggers the following errors when booting baremetal instances
with Tenks on Libvirt 9 (and most likely since 8.9.0):

    Cannot set interface flags on 'macvtap1': Value too large for defined data type

This is apparently triggered by a Libvirt commit refreshing rx-filters
more often [1].

As explained in I71a2051d8acd63379bd70bc1287a059d4a7f6387, this setting
was added to allow traffic destined for other MAC addresses to reach VMs
when using a macvtap interface.

This will prevent multicast from working, but we don't need it for
baremetal tests in CI.

This setting will be enabled again once the issue is resolved in either
Libvirt or Tenks.

This reverts commit 21c68bbfaf.

Also increase timeout of upgrade jobs which is too short now due to the
added delay added by bare metal testing.

[1] 060d4c83ef

Change-Id: I2cfd2667abb1ae8988b7a7fd9761b75c20a0eaa4
2023-10-09 09:25:04 +02:00
Bartosz Bezak e87a744734 set previous_release to 2023.1
Change-Id: I391d3387bd68e29a25689499bc4b3ebe8156a2fa
2023-06-20 13:23:05 +00:00
Bartosz Bezak d7b648a82e Revert "Use OpenStack 2023.1 release"
This reverts commit 16a61da41a.

Reason for revert: 2023.1 has been branched and released

Change-Id: Ief6b68144dd2d161ca6e98888934888cdfee49a4
2023-06-20 13:22:50 +00:00
Matt Crees 16a61da41a Use OpenStack 2023.1 release
Switch all dependencies to use the OpenStack 2023.1 release.

This commit should be reverted on the master branch once the
Kayobe stable/2023.1 branch has been cut and RC1 released.

Change-Id: Id5e946fd7b0526faea99536f4a055f0f5c2b8176
2023-05-29 10:56:08 +00:00
Pierre Riteau 21c68bbfaf CI: Disable bare metal testing on RL9/c9s
Rocky Linux 9.2 shipped with Libvirt 9.0.0 which breaks our bare metal
testing. Temporarily run bare metal testing only on Ubuntu.

This allows us to make rocky9 jobs voting again.

Change-Id: I8866cbc07fc28897648f3dc6f2a163323184e8a9
2023-05-22 14:57:04 +02:00
Pierre Riteau d80189611a Add neutron-ovn-agent group to Kolla inventory
This fixes the following issue seen while pulling Neutron images, caused
by a kolla-ansible change [1] adding support for neutron-ovn-agent:

    'dict object' has no attribute 'neutron-ovn-agent'

CI: Make Rocky Linux jobs non-voting to allow this to merge.

[1] https://review.opendev.org/c/openstack/kolla-ansible/+/871297

Change-Id: I9e0a315fe2c9ff91bdeffb15adcc353a20204d9a
2023-05-20 21:47:52 +02:00
Mark Goddard c9f8d80ba6 Stop using kolla-ansible bootstrap-servers
The 'kayobe * host configure' commands no longer use the 'kolla-ansible
bootstrap-servers' command, and associated 'baremetal' role in Kolla
Ansible. The functionality provided by the 'baremetal' role has been
extracted into the openstack.kolla Ansible collection, and split
into separate roles. This allows Kayobe to use it directly, and only the
necessary parts.

This change improves failure handling in these Kayobe commands, and aims
to reduce confusion over which '--limit' and '--tags' arguments to
provide.  This ensures that if a host fails during a host configuration
command, other hosts are able to continue to completion. Previously, if
any host failed during the Kayobe playbooks, the 'kolla-ansible
bootstrap-servers' command would not run. This is useful at scale, where
host failures occur more frequently.

This change has implications for configuration of Kayobe, since some
variables that were previously in Kolla Ansible are now in Kayobe.

Several parts of the baremetal role have been split out and used here:

* apparmor-libvirt: disable AppArmor rules for libvirt on Ubuntu.
* docker: Docker installation & configuration. The docker role in
  openstack.kolla combines functionality from kolla-ansible and kayobe.
* etc-hosts: it proved difficult to generalise this, so we have some
  almost duplicated the code from kolla-ansible here. Requires delegated
  fact gathering for the case when --limit is used.
* firewall: support to disable UFW, for feature parity.
* kolla-packages: miscellaneous package installs & removals.

The addition of the stack user to the docker group has been moved to the
user bootstrapping playbook, and the docker SDK installation has been
moved to the virtualenv setup playbook.

Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/829587

Story: 2009854
Task: 44505

Change-Id: I61a61ca59652b13687c2247d5881012b51f666a7
2023-03-30 13:52:54 +00:00
Bartosz Bezak 094852e3c6 CI: add Rocky9 upgrade jobs
Change-Id: I1687ea33f27dee6ba145514db5cf213b28cc8cd2
2023-01-26 14:59:19 +01:00
Bartosz Bezak 059c223b32 CI: move ubuntu upgrade jobs to jammy
Change-Id: I0519b5251a743138fe64528d265607a919d04763
2023-01-17 09:14:20 +01:00
Bartosz Bezak 717f4d9fe1 set previous_release to zed
Upgrade CI job needs clouds.yaml to be used from Zed

Newer version of ansible-collections-openstack uses different return
value. [1]

[1] https://review.opendev.org/c/openstack/ansible-collections-openstack/+/841224

Change-Id: Ic0608bc6033025cb47655d601ffaf3744637832f
2023-01-13 21:22:43 +01:00
Bartosz Bezak 0c11102afe Revert "Use OpenStack Zed release"
This reverts commit 65c59b9f59.

Reason for revert: Zed has been branched and released

Change-Id: I2d87017c27139b5e0154edef006ad61d665ede2a
2023-01-12 10:46:49 +00:00
Bartosz Bezak 65c59b9f59 Use OpenStack Zed release
Switch all dependencies to use the OpenStack Zed release.

This commit should be reverted on the master branch once the
Kayobe stable/zed branch has been cut and RC1 released.

Change-Id: I1ea18a68bb2c1ea6a2a45f6cbd3c48fd30bb1c8a
2022-12-14 20:42:32 +00:00
Pierre Riteau 5b84ef3760 Use master upper constraints
Yoga upper constraints were used to keep compatibility with Python 3.6.
This is not needed with all supported OS using Python 3.9 or newer.

This reverts commits d2e0d64eb0 and
d190e9e3a3.

Change-Id: I35a07bcc2b7c9cbb49fa60e6802cc6288a34fbd8
2022-12-14 08:58:30 +01:00
Bartosz Bezak 2f447f6545 Move to Rocky Linux 9
CentOS Stream 8 support has been dropped. Migration path will be present
in Yoga release - as a followup change.

MichaelRigart.interfaces does not support custom routes for
NetworkManager yet. It has been disabled in CI for Rocky Linux 9
temporarily.

Non-voting CentOS Stream 9 CI overcloud job is using RL9 container
images (as kolla CI is not building CS9 images anymore).

Change-Id: Idf5ee822b03ba40179803c981500a6bad37594bf
2022-12-12 22:24:47 +01:00
Michal Nasiadka 05a2c1acbd CI: Set previous_release to Yoga
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/859828

Change-Id: I295e8f5f1cc9b7af1cd45ac788db473510220170
2022-09-29 10:11:52 +00:00
Michal Nasiadka ebf8cfca62 Add support for Ubuntu Jammy Jellyfish (22.04) LTS
Co-Authored-By: Bartosz Bezak <bartosz@stackhpc.com>

Change-Id: I06a3e9922cf95979f3bca120cd82633046270fa3
2022-07-29 11:26:58 +02:00
Pierre Riteau d2e0d64eb0 Use yoga upper constraints to avoid Python version conflict
Requirements upper constraints bumped python-novaclient to version
18.0.0 [1], which requires Python 3.8 [2]. This results in failures when
installing python-openstackclient on CentOS and Rocky with Python 3.6.

    ERROR: Cannot install python-openstackclient==5.8.0 because these package versions have conflicting dependencies.

    The conflict is caused by:
        python-openstackclient 5.8.0 depends on python-novaclient>=17.0.0
        The user requested (constraint) python-novaclient===18.0.0

Work around this issue by using yoga upper constraints until we upgrade
to CentOS Stream 9 and Rocky Linux 9.

This also fixes another issue seen on Ubuntu where image uploads to
Glance through Ansible fail with a 400 Bad Request error. This is caused
by the bump of openstacksdk to version 0.99.0 and will be fixed by a new
release of ansible-collections-openstack.

[1] https://review.opendev.org/c/openstack/requirements/+/842808
[2] https://review.opendev.org/c/openstack/python-novaclient/+/838944

Change-Id: I40c6b898963c2218d41d37bd73d40ce8dcf22b87
2022-05-25 09:41:01 +02:00
Zuul 23285083ed Merge "CI: Add some more irrelevant files to zuul jobs" 2022-04-29 09:17:15 +00:00
Mark Goddard 07f8e41bbb Revert "[release] Use OpenStack Yoga release"
This reverts commit 88dd02dc92.

Reason for revert: Master is now Zed

Change-Id: I9a18c41dbdc369a7a719632d6e41e2373784f29e
2022-04-14 08:09:18 +00:00
Mark Goddard fcf154266a CI: Add some more irrelevant files to zuul jobs
Change-Id: Ia63efdd8a904cac09237dde7d8ae283ed5ae6bea
2022-04-14 09:04:50 +01:00
Mark Goddard 88dd02dc92 [release] Use OpenStack Yoga release
Switch all dependencies to use the OpenStack Yoga release.

This commit should be reverted on the master branch once the
Kayobe stable/yoga branch has been cut and RC1 released.

Change-Id: Ib7495c1bf79de8b1ea67e4a8652345c22e9d1a3e
2022-04-07 13:51:18 +01:00
Zuul 60d74df815 Merge "CI: separate image builds into a non-voting job" 2022-04-06 12:49:57 +00:00
Mark Goddard 8b3494e2a4 Revert "CI: Revert from UEFI to BIOS mode in TLS jobs"
This reverts commit b2e8e71553.

Reason for revert: Other measures were taken to reduce memory overhead.

Change-Id: I4987480b4ed1bd4bd95a0ae72861f471cc229e20
2022-04-06 07:00:38 +00:00
Mark Goddard a7ee3ac5c8 CI: separate image builds into a non-voting job
Disk and container image builds tend to be fairly unreliable.
With 3 voting seed jobs all building images, this can introduce
instability into the CI jobs.

This change adds a non-voting kayobe-seed-images-centos8s job, which
does the following:

* Builds IPA images
* Builds an overcloud host image
* Builds a base container image

Similar Rocky and Ubuntu jobs are added to the experimental pipeline,
and may be run by commenting 'check experimental' in gerrit.

The existing kayobe-seed-* jobs no longer build images.

Change-Id: Idecda342f3ab86733e8d59061458d44af834dbb0
2022-03-31 08:52:17 +00:00
Zuul 4616c87010 Merge "Add support for Rocky Linux 8" 2022-03-20 22:20:24 +00:00
Michal Nasiadka 8e55ea08a4 Add support for Rocky Linux 8
Change-Id: If7d6e58b19f98ccb7cc4c209e458cb6f4f4765ad
2022-03-18 15:04:21 +00:00
Mark Goddard 07eb06755e CI: Pin ansible-lint to <6
The molecule job is failing with the following since the release of
ansible-lint 6.0.0:

    ModuleNotFoundError: No module named 'ansiblelint.prerun'

Pin ansible-lint to <6.

Also ignore changes to molecule-requirements.txt for jobs that don't use
it.

Change-Id: I00ea1b4cd57a22a1a0939ddc463ef336da2f0902
2022-03-15 15:10:01 +00:00
Mark Goddard 3efc551e7e Install Ansible collections for kolla-ansible
This change uses the new Galaxy requirements file in Kolla Ansible to
install the openstack.kolla collection.

Cross-project dependencies on ansible-collection-kolla are supported.

Story: 2009854
Task: 44504

Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/819430
Change-Id: Iac185dd2bbbca128c6cf71b2734e94b3e1c6133b
2022-02-22 09:23:35 +00:00
Mark Goddard 06c6191799 Install openstack.kolla collection
This patch adds the openstack.kolla collection to the Galaxy
requirements. It is installed from the OpenDev git repository. The
collection is not yet used by Kayobe.

Zuul cross-project dependencies on the ansible-collection-kolla
repository are supported (and used in this commit).

Story: 2009854
Task: 44503

Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/820165/
Change-Id: I91cbac839f816a00ac54bc4a350f44b5ae457cc3
2022-02-22 09:23:14 +00:00
Mark Goddard b2e8e71553 CI: Revert from UEFI to BIOS mode in TLS jobs
We keep hitting the OOM killer in the TLS job, and the switch to UEFI
mode in bare metal testing seems like the most likely culprit.

This change keeps in place most of the changes of
Id1b4e9775c834b8b97e086241ee8b247977225a2, but removes the override of
ironic_boot_mode in the TLS job.

Change-Id: Id35894be893183b0b84e6dacb81e1b72e4a828f9
2022-02-21 17:34:08 +00:00
Mark Goddard b57b94bbad CI: test ironic UEFI boot mode in overcloud TLS jobs
Set the Ironic boot mode to legacy BIOS explicitly in Tenks config in
anticipation of an upcoming change to the default boot mode.

Override the boot mode to UEFI in the overcloud TLS job to improve
coverage. This requires enabling iPXE booting.

Depends-On: https://review.opendev.org/c/openstack/tenks/+/827479/

Change-Id: Id1b4e9775c834b8b97e086241ee8b247977225a2
2022-02-08 11:16:03 +00:00
Zuul e61d8f24a6 Merge "[release] Set previous_release to xena" 2021-11-25 19:22:59 +00:00
Zuul dbb2b06ee5 Merge "Revert "Use OpenStack Xena release"" 2021-11-25 19:19:59 +00:00
Zuul e55fab9674 Merge "CI: add Infra VM jobs" 2021-11-11 22:20:57 +00:00
Mark Goddard 4bf7cdf1e3 [release] Set previous_release to xena
Also remove some Wallaby upgrade compatibility code in CI playbooks

Change-Id: I84e336bec37eac12c659c7a9d9fc4ddd191a379d
2021-11-09 17:31:53 +00:00
Mark Goddard 7f72fdbe55 Revert "Use OpenStack Xena release"
This reverts commit e0c42ea940.

Xena has branched and is almost ready for release.

Change-Id: I9315110fa767ff62681486e436fca5503339cabf
2021-11-09 17:31:48 +00:00
Mark Goddard 104e383fc7 CI: add Infra VM jobs
Depends-On: https://review.opendev.org/c/openstack/kayobe/+/812670
Depends-On: https://review.opendev.org/c/openstack/kayobe-config-dev/+/805239
Depends-On: https://review.opendev.org/c/openstack/kayobe/+/813212

Change-Id: I7dbd643fec72223bfda20cbbc37809ae78073804
2021-10-26 09:35:17 +01:00
Michal Nasiadka e0c42ea940 Use OpenStack Xena release
Switch all dependencies to use the OpenStack Xena release.

This commit should be reverted on the master branch once the
Kayobe stable/xena branch has been cut and RC1 released.

Change-Id: Iee21230217ab1614977498dcbc2a18952ab7d64e
2021-10-15 11:08:38 +02:00
Mark Goddard 3b90164102 Ubuntu: add upgrade jobs in CI
Now that the previous release is Wallaby, we can add overcloud and seed
upgrades on Ubuntu.

Change-Id: I69868dca6e1f3e4a1bf123c9e7f1f3412162b264
2021-10-01 16:05:33 +02:00
Zuul 4faaebec0d Merge "[release] Set previous_release to wallaby" 2021-06-09 10:23:01 +00:00
Mark Goddard 1dc6d98be7 Revert "Use OpenStack Wallaby release"
This reverts commit 3f76d7d134.

The version of IPA images has been pinned to wallaby to ensure they are
compatible with the Wallaby Ironic in current Kolla master images.
Without this, bare metal tests fail with

    'Not found: Extension with id iscsi not found.'

Ironic removed the iscsi driver in Xena.

Change-Id: Ia4c70965d9f3f099046591bac7f702ee982fef71
2021-06-07 15:19:52 +01:00
Mark Goddard 8e825118c5 [release] Set previous_release to wallaby
This controls which release we are upgrading from.

Change-Id: Id4c3841d506d6b6ea082d0b9a294897761105dbd
2021-05-05 10:35:21 +01:00
Michał Nasiadka 3f76d7d134 Use OpenStack Wallaby release
Switch all dependencies to use the OpenStack Wallaby release.

This commit should be reverted on the master branch once the
Kayobe stable/wallaby branch has been cut and RC1 released.

Change-Id: I977943e81a79e4a40cca04d80d786ca49afd3d39
2021-04-26 08:45:42 +00:00
Zuul 83951b01ac Merge "zuul: add more irrelevant files" 2021-04-26 07:44:09 +00:00
Mark Goddard 2c21bb0172 CI: Switch to CentOS Stream 8
This change switches CentOS CI jobs to use CentOS stream 8 nodepool
images. Kolla containers switched to CentOS stream already.

Depends-On: https://review.opendev.org/c/openstack/kayobe/+/784926
Depends-On: https://review.opendev.org/c/openstack/kayobe/+/784853

Story: 2008795
Task: 42196

Change-Id: I02c76344bcb0b350fd96010becca52f259e1ee6f
2021-04-06 13:11:04 +00:00