Commit Graph

143 Commits

Author SHA1 Message Date
Pierre Riteau ede6bf4624 Revert "Mark kayobe-tox-ansible job as non-voting"
The kernel bug causing kayobe-tox-ansible to fail was fixed in
5.15.0-102.112 [1]. This job can be made voting again.

[1] https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2056143

Change-Id: I75fae789aee0824d3d6e0157999301a38ff76c53
2024-04-11 10:19:15 +02:00
Will Szumski 997a1b2c63 CI: Make SLURP jobs non-voting
At least until we get to the bottom of the rabbitmq SLURP upgrade
issues[1].

[1] https://bugs.launchpad.net/kolla-ansible/+bug/2058512

Change-Id: I4778d41fd18665c25b635e761cddb7b3bfd1560f
2024-03-20 18:09:37 +00:00
Will Szumski 9c1951478f Skip buggy release of docker PyPI package
The tag regex is buggy and fails if the docker registry contains a port
number[1].

[1] https://github.com/docker/docker-py/issues/3195

Change-Id: I5d85e751b490ab1e39e417ff8797ca8f8688590b
Closes-Bug: #2054715
2024-03-01 19:08:17 +00:00
Alex-Welsh aef2ce0ae2 CI: Add SLURP upgrade jobs
Change-Id: Id4af9fcfd56c8101276996555e07f6cefe433dd8
2024-02-23 09:57:36 +00:00
Pierre Riteau 7d8a43764f Mark kayobe-tox-ansible job as non-voting
This job is currently failing following a Ubuntu Jammy kernel update.
The job succeeds on 5.15.0-86.96 but fails on 5.15.0-94.104.

Change-Id: I7561e82e811c74276a87074c7aa52a9adb414483
2024-02-09 17:39:15 +01:00
Will Szumski 280e84be82 Remove docker devicemapper support
This has now been removed from upstream docker-ce packages.

```
the devicemapper storage-driver has been deprecated and removed
```

and has shown deprecation warnings for some time.

This change also includes some fixes necessary for CI to pass:

* update the Zuul previous_release variable to 2023.2

Closes-Bug: #2051233
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/906858
Change-Id: I263f59ea77e39accffe4febe0d47e56b35d9800e
2024-02-01 14:10:09 +00:00
Pierre Riteau dd8cf81607 Revert "Use OpenStack 2023.2 release"
This reverts commit 99f5b64956.

Reason for revert: 2023.2 has been branched and released

Change-Id: I38fc5dcadda5103d63a11022825e8e167408677d
2023-12-08 11:55:04 +01:00
Pierre Riteau 99f5b64956 Use OpenStack 2023.2 release
Switch all dependencies to use the OpenStack 2023.2 release.

This commit should be reverted on the master branch once the
Kayobe stable/2023.2 branch has been cut and RC1 released.

Change-Id: I749a1ac30fa15cf7faa456fcb90c4ddbbef77cc9
2023-12-01 15:58:47 +01:00
Michal Nasiadka 86570531d2 CI: Drop tox-py38 job
Stop using openstack-python3-jobs template, because Ansible 8 does not
support Python 3.8.

Change-Id: I8f5338b7eee31f1b8bc3e783d10666e3092a6540
2023-10-26 15:17:37 +02:00
Pierre Riteau 990370a367 Revert "CI: Disable bare metal testing on RL9/c9s"
This requires disabling libvirt_vm_trust_guest_rx_filters, which when
enabled triggers the following errors when booting baremetal instances
with Tenks on Libvirt 9 (and most likely since 8.9.0):

    Cannot set interface flags on 'macvtap1': Value too large for defined data type

This is apparently triggered by a Libvirt commit refreshing rx-filters
more often [1].

As explained in I71a2051d8acd63379bd70bc1287a059d4a7f6387, this setting
was added to allow traffic destined for other MAC addresses to reach VMs
when using a macvtap interface.

This will prevent multicast from working, but we don't need it for
baremetal tests in CI.

This setting will be enabled again once the issue is resolved in either
Libvirt or Tenks.

This reverts commit 21c68bbfaf.

Also increase timeout of upgrade jobs which is too short now due to the
added delay added by bare metal testing.

[1] 060d4c83ef

Change-Id: I2cfd2667abb1ae8988b7a7fd9761b75c20a0eaa4
2023-10-09 09:25:04 +02:00
Bartosz Bezak e87a744734 set previous_release to 2023.1
Change-Id: I391d3387bd68e29a25689499bc4b3ebe8156a2fa
2023-06-20 13:23:05 +00:00
Bartosz Bezak d7b648a82e Revert "Use OpenStack 2023.1 release"
This reverts commit 16a61da41a.

Reason for revert: 2023.1 has been branched and released

Change-Id: Ief6b68144dd2d161ca6e98888934888cdfee49a4
2023-06-20 13:22:50 +00:00
Matt Crees 16a61da41a Use OpenStack 2023.1 release
Switch all dependencies to use the OpenStack 2023.1 release.

This commit should be reverted on the master branch once the
Kayobe stable/2023.1 branch has been cut and RC1 released.

Change-Id: Id5e946fd7b0526faea99536f4a055f0f5c2b8176
2023-05-29 10:56:08 +00:00
Pierre Riteau 21c68bbfaf CI: Disable bare metal testing on RL9/c9s
Rocky Linux 9.2 shipped with Libvirt 9.0.0 which breaks our bare metal
testing. Temporarily run bare metal testing only on Ubuntu.

This allows us to make rocky9 jobs voting again.

Change-Id: I8866cbc07fc28897648f3dc6f2a163323184e8a9
2023-05-22 14:57:04 +02:00
Pierre Riteau d80189611a Add neutron-ovn-agent group to Kolla inventory
This fixes the following issue seen while pulling Neutron images, caused
by a kolla-ansible change [1] adding support for neutron-ovn-agent:

    'dict object' has no attribute 'neutron-ovn-agent'

CI: Make Rocky Linux jobs non-voting to allow this to merge.

[1] https://review.opendev.org/c/openstack/kolla-ansible/+/871297

Change-Id: I9e0a315fe2c9ff91bdeffb15adcc353a20204d9a
2023-05-20 21:47:52 +02:00
Mark Goddard c9f8d80ba6 Stop using kolla-ansible bootstrap-servers
The 'kayobe * host configure' commands no longer use the 'kolla-ansible
bootstrap-servers' command, and associated 'baremetal' role in Kolla
Ansible. The functionality provided by the 'baremetal' role has been
extracted into the openstack.kolla Ansible collection, and split
into separate roles. This allows Kayobe to use it directly, and only the
necessary parts.

This change improves failure handling in these Kayobe commands, and aims
to reduce confusion over which '--limit' and '--tags' arguments to
provide.  This ensures that if a host fails during a host configuration
command, other hosts are able to continue to completion. Previously, if
any host failed during the Kayobe playbooks, the 'kolla-ansible
bootstrap-servers' command would not run. This is useful at scale, where
host failures occur more frequently.

This change has implications for configuration of Kayobe, since some
variables that were previously in Kolla Ansible are now in Kayobe.

Several parts of the baremetal role have been split out and used here:

* apparmor-libvirt: disable AppArmor rules for libvirt on Ubuntu.
* docker: Docker installation & configuration. The docker role in
  openstack.kolla combines functionality from kolla-ansible and kayobe.
* etc-hosts: it proved difficult to generalise this, so we have some
  almost duplicated the code from kolla-ansible here. Requires delegated
  fact gathering for the case when --limit is used.
* firewall: support to disable UFW, for feature parity.
* kolla-packages: miscellaneous package installs & removals.

The addition of the stack user to the docker group has been moved to the
user bootstrapping playbook, and the docker SDK installation has been
moved to the virtualenv setup playbook.

Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/829587

Story: 2009854
Task: 44505

Change-Id: I61a61ca59652b13687c2247d5881012b51f666a7
2023-03-30 13:52:54 +00:00
Bartosz Bezak 094852e3c6 CI: add Rocky9 upgrade jobs
Change-Id: I1687ea33f27dee6ba145514db5cf213b28cc8cd2
2023-01-26 14:59:19 +01:00
Bartosz Bezak 059c223b32 CI: move ubuntu upgrade jobs to jammy
Change-Id: I0519b5251a743138fe64528d265607a919d04763
2023-01-17 09:14:20 +01:00
Bartosz Bezak 717f4d9fe1 set previous_release to zed
Upgrade CI job needs clouds.yaml to be used from Zed

Newer version of ansible-collections-openstack uses different return
value. [1]

[1] https://review.opendev.org/c/openstack/ansible-collections-openstack/+/841224

Change-Id: Ic0608bc6033025cb47655d601ffaf3744637832f
2023-01-13 21:22:43 +01:00
Bartosz Bezak 0c11102afe Revert "Use OpenStack Zed release"
This reverts commit 65c59b9f59.

Reason for revert: Zed has been branched and released

Change-Id: I2d87017c27139b5e0154edef006ad61d665ede2a
2023-01-12 10:46:49 +00:00
OpenStack Release Bot b9e8128221 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I8fda05aa952f3d8501b93f1afffed9e8ebc7ec49
2022-12-16 08:46:41 +00:00
Bartosz Bezak 65c59b9f59 Use OpenStack Zed release
Switch all dependencies to use the OpenStack Zed release.

This commit should be reverted on the master branch once the
Kayobe stable/zed branch has been cut and RC1 released.

Change-Id: I1ea18a68bb2c1ea6a2a45f6cbd3c48fd30bb1c8a
2022-12-14 20:42:32 +00:00
Zuul 4b20bb62a8 Merge "CI: Add kayobe-seed-images-centos9s to experimental jobs" 2022-12-14 15:48:01 +00:00
Pierre Riteau 5b84ef3760 Use master upper constraints
Yoga upper constraints were used to keep compatibility with Python 3.6.
This is not needed with all supported OS using Python 3.9 or newer.

This reverts commits d2e0d64eb0 and
d190e9e3a3.

Change-Id: I35a07bcc2b7c9cbb49fa60e6802cc6288a34fbd8
2022-12-14 08:58:30 +01:00
Pierre Riteau 7af1d246c5 CI: Add kayobe-seed-images-centos9s to experimental jobs
Change-Id: Ia663ef4a2e6f16e277f2aaef0b0136e473f37698
2022-12-13 14:40:40 +01:00
Bartosz Bezak 2f447f6545 Move to Rocky Linux 9
CentOS Stream 8 support has been dropped. Migration path will be present
in Yoga release - as a followup change.

MichaelRigart.interfaces does not support custom routes for
NetworkManager yet. It has been disabled in CI for Rocky Linux 9
temporarily.

Non-voting CentOS Stream 9 CI overcloud job is using RL9 container
images (as kolla CI is not building CS9 images anymore).

Change-Id: Idf5ee822b03ba40179803c981500a6bad37594bf
2022-12-12 22:24:47 +01:00
Michal Nasiadka 05a2c1acbd CI: Set previous_release to Yoga
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/859828

Change-Id: I295e8f5f1cc9b7af1cd45ac788db473510220170
2022-09-29 10:11:52 +00:00
Michal Nasiadka 9cbd1e2f52 CI: Drop centos8s and rocky8 jobs
After I3f7b480519aea38c3927bee7fb2c23eea178554d kolla-ansible
does not support EL8.

Those will be readded as Rocky9 via [1].

[1]: https://review.opendev.org/c/openstack/kayobe/+/855656

Change-Id: I6c3f9d8c54d0c6819092bd68b724a28048ac9e16
2022-09-13 13:03:37 +02:00
Michal Nasiadka ebf8cfca62 Add support for Ubuntu Jammy Jellyfish (22.04) LTS
Co-Authored-By: Bartosz Bezak <bartosz@stackhpc.com>

Change-Id: I06a3e9922cf95979f3bca120cd82633046270fa3
2022-07-29 11:26:58 +02:00
Pierre Riteau d2e0d64eb0 Use yoga upper constraints to avoid Python version conflict
Requirements upper constraints bumped python-novaclient to version
18.0.0 [1], which requires Python 3.8 [2]. This results in failures when
installing python-openstackclient on CentOS and Rocky with Python 3.6.

    ERROR: Cannot install python-openstackclient==5.8.0 because these package versions have conflicting dependencies.

    The conflict is caused by:
        python-openstackclient 5.8.0 depends on python-novaclient>=17.0.0
        The user requested (constraint) python-novaclient===18.0.0

Work around this issue by using yoga upper constraints until we upgrade
to CentOS Stream 9 and Rocky Linux 9.

This also fixes another issue seen on Ubuntu where image uploads to
Glance through Ansible fail with a 400 Bad Request error. This is caused
by the bump of openstacksdk to version 0.99.0 and will be fixed by a new
release of ansible-collections-openstack.

[1] https://review.opendev.org/c/openstack/requirements/+/842808
[2] https://review.opendev.org/c/openstack/python-novaclient/+/838944

Change-Id: I40c6b898963c2218d41d37bd73d40ce8dcf22b87
2022-05-25 09:41:01 +02:00
Pierre Riteau 19f783b04b [CI] Move queue setting to project level
Per [1].

[1] http://lists.zuul-ci.org/pipermail/zuul-discuss/2022-May/001801.html

Change-Id: I9cab915803bab882a12841cd40ccc6af2a78dae2
2022-05-18 10:12:58 +02:00
Zuul 23285083ed Merge "CI: Add some more irrelevant files to zuul jobs" 2022-04-29 09:17:15 +00:00
Zuul 45231fdd66 Merge "Revert "[release] Use OpenStack Yoga release"" 2022-04-14 14:33:56 +00:00
Mark Goddard 07f8e41bbb Revert "[release] Use OpenStack Yoga release"
This reverts commit 88dd02dc92.

Reason for revert: Master is now Zed

Change-Id: I9a18c41dbdc369a7a719632d6e41e2373784f29e
2022-04-14 08:09:18 +00:00
Mark Goddard fcf154266a CI: Add some more irrelevant files to zuul jobs
Change-Id: Ia63efdd8a904cac09237dde7d8ae283ed5ae6bea
2022-04-14 09:04:50 +01:00
OpenStack Release Bot 341bde30b9 Add Python3 zed unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for zed.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I6fd030ca884d5048a6612ee42ddaa4d267efb3e9
2022-04-14 07:05:03 +00:00
Mark Goddard 88dd02dc92 [release] Use OpenStack Yoga release
Switch all dependencies to use the OpenStack Yoga release.

This commit should be reverted on the master branch once the
Kayobe stable/yoga branch has been cut and RC1 released.

Change-Id: Ib7495c1bf79de8b1ea67e4a8652345c22e9d1a3e
2022-04-07 13:51:18 +01:00
Zuul 60d74df815 Merge "CI: separate image builds into a non-voting job" 2022-04-06 12:49:57 +00:00
Mark Goddard 8b3494e2a4 Revert "CI: Revert from UEFI to BIOS mode in TLS jobs"
This reverts commit b2e8e71553.

Reason for revert: Other measures were taken to reduce memory overhead.

Change-Id: I4987480b4ed1bd4bd95a0ae72861f471cc229e20
2022-04-06 07:00:38 +00:00
Mark Goddard a7ee3ac5c8 CI: separate image builds into a non-voting job
Disk and container image builds tend to be fairly unreliable.
With 3 voting seed jobs all building images, this can introduce
instability into the CI jobs.

This change adds a non-voting kayobe-seed-images-centos8s job, which
does the following:

* Builds IPA images
* Builds an overcloud host image
* Builds a base container image

Similar Rocky and Ubuntu jobs are added to the experimental pipeline,
and may be run by commenting 'check experimental' in gerrit.

The existing kayobe-seed-* jobs no longer build images.

Change-Id: Idecda342f3ab86733e8d59061458d44af834dbb0
2022-03-31 08:52:17 +00:00
Zuul 4616c87010 Merge "Add support for Rocky Linux 8" 2022-03-20 22:20:24 +00:00
Michal Nasiadka 8e55ea08a4 Add support for Rocky Linux 8
Change-Id: If7d6e58b19f98ccb7cc4c209e458cb6f4f4765ad
2022-03-18 15:04:21 +00:00
Pierre Riteau 2d16a70e00 CI: Enable overcloud TLS job again
Change If483a6a6fb6d5b2c9b6b7dbd22939b0b46599538 which fixed the job
should have included this bit.

Change-Id: I22e2e6d361bc15fe7aa47ff833b3c5a525266221
2022-03-16 15:40:19 +01:00
Mark Goddard 07eb06755e CI: Pin ansible-lint to <6
The molecule job is failing with the following since the release of
ansible-lint 6.0.0:

    ModuleNotFoundError: No module named 'ansiblelint.prerun'

Pin ansible-lint to <6.

Also ignore changes to molecule-requirements.txt for jobs that don't use
it.

Change-Id: I00ea1b4cd57a22a1a0939ddc463ef336da2f0902
2022-03-15 15:10:01 +00:00
Pierre Riteau 5fb6362e25 CI: Disable TLS job until fixed
The overcloud job with TLS is failing frequently with the Tenks VM
triggering the OOM killer. Disable until we find a reliable fix.

Change-Id: If42d1f0580d8305a36dd4fd4431680559eb5d68f
2022-03-11 10:19:31 +01:00
Mark Goddard f477473bd7 Revert "CI: drop jobs requiring kolla-ansible"
This reverts commit f00a65ead9.

Reason for revert: fix for kolla-ansible installation with
openstack.kolla has merged.

Change-Id: I361c68904eb66e9728b4a902a0998e4bc06d2dcd
2022-02-22 10:13:04 +00:00
Mark Goddard 3efc551e7e Install Ansible collections for kolla-ansible
This change uses the new Galaxy requirements file in Kolla Ansible to
install the openstack.kolla collection.

Cross-project dependencies on ansible-collection-kolla are supported.

Story: 2009854
Task: 44504

Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/819430
Change-Id: Iac185dd2bbbca128c6cf71b2734e94b3e1c6133b
2022-02-22 09:23:35 +00:00
Mark Goddard 06c6191799 Install openstack.kolla collection
This patch adds the openstack.kolla collection to the Galaxy
requirements. It is installed from the OpenDev git repository. The
collection is not yet used by Kayobe.

Zuul cross-project dependencies on the ansible-collection-kolla
repository are supported (and used in this commit).

Story: 2009854
Task: 44503

Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/820165/
Change-Id: I91cbac839f816a00ac54bc4a350f44b5ae457cc3
2022-02-22 09:23:14 +00:00
Mark Goddard f00a65ead9 CI: drop jobs requiring kolla-ansible
Drop Kayobe jobs until we support installing kolla-ansible with
openstack.kolla collection
(Iac185dd2bbbca128c6cf71b2734e94b3e1c6133b).

Change-Id: Ia6cc7e2f7a9a9fb0a1c3e0fdf07e7cdd1cbd431c
2022-02-22 09:17:18 +00:00
Mark Goddard b2e8e71553 CI: Revert from UEFI to BIOS mode in TLS jobs
We keep hitting the OOM killer in the TLS job, and the switch to UEFI
mode in bare metal testing seems like the most likely culprit.

This change keeps in place most of the changes of
Id1b4e9775c834b8b97e086241ee8b247977225a2, but removes the override of
ironic_boot_mode in the TLS job.

Change-Id: Id35894be893183b0b84e6dacb81e1b72e4a828f9
2022-02-21 17:34:08 +00:00