Commit Graph

186 Commits

Author SHA1 Message Date
Zuul 4486100614 Merge "CI: Break OVN cluster before reconfigure" 2024-04-29 08:57:09 +00:00
Uwe Jäger a4e6e58e4e Update Skyline configuration to enable SSO
Change-Id: I5b4a30e605bb143cf342f83f0c811c25046269ef
2024-03-15 20:18:29 +01:00
Michal Nasiadka b04486df07 Bump ansible-core versions to 2.15 and 2.16
Change-Id: Iab40eb92c7e4a9092471bef9d4477a4fa34f1c85
2024-03-14 06:13:38 +00:00
Michal Nasiadka ed1b410af9 CI: Break OVN cluster before reconfigure
This is a CI level check that we are able to recover from one
node OVN NB/SB DB failure

Change-Id: I3185811fed50b2ab18f9493c6dc9f4afc970ab34
2024-02-27 10:33:27 +00:00
Michal Nasiadka 63cf525af5 CI: Increase RADOS timeout for cephadm jobs
Default timeout is 5 and we're often hitting that on our poor man's
Ceph.

Change-Id: Ide92b3c32150c0045b0723155f94b21ea9cdce66
2024-02-14 10:02:35 +00:00
Zuul 07bbf1707f Merge "[CI] Enable testing horizon" 2024-02-09 13:03:12 +00:00
Michal Nasiadka 09fb029569 CI: Run SLURP upgrade job
Change-Id: I246b14c9b547c6a0ff0be68ad57e723839cc3275
2024-02-08 13:13:35 +00:00
Michal Arbet 05462c471c [CI] Enable testing horizon
Change Ib7f72b2663199ef80844a412bc436c6ef09322cc
disabled horizon testing. This patch enabling
horizon tests again.

Change-Id: Iff670525c91c8adbcf2a01288b12456cb4a31809
2024-02-07 16:13:27 +01:00
Michal Arbet 47ddac4131 Bump ansible-lint version
The version that we were capping to is no longer compatible with latest
upper-constraints.txt, so let us free float again.

The resulting linting errors are included for now to unblock the gate,
these will still need to be discussed or fixed later.

NOTE(kevko): Temporarily disabling horizon deployment, as it's not
possible to unblock gates without it

Co-Authored-By: Michal Arbet <michal.arbet@ultimum.io>
Change-Id: Ib7f72b2663199ef80844a412bc436c6ef09322cc
2024-01-22 22:49:46 +01:00
Michal Nasiadka 56cbf8c031 CI: Move openstack clients setup to a role
Change-Id: Id5c53b63e88502c999b89cbc62405bb8953fef3a
2023-12-14 16:38:26 +01:00
Zuul 7a29abb590 Merge "CI: Move test-ovn before test-core-openstack" 2023-12-07 16:30:17 +00:00
Michal Nasiadka 4a3d6b6e51 CI: Add SCENARIO env var to upgrade.sh
Change-Id: I373f6d13809674c521155ca51962785a8b1ac598
2023-12-06 14:59:23 +01:00
Zuul e9dd15967b Merge "Add support for ansible-core" 2023-11-08 15:01:02 +00:00
Michal Nasiadka bc203433f1 Add support for ansible-core
Collections version taken from official Ansible 7 package [1]
and limited to the same major version.

[1]: https://github.com/ansible-community/ansible-build-data/blob/main/7/ansible-7.7.0.yaml

Change-Id: I0f1ea9717397adc2d2c3215d74ec3759f351a57a
2023-11-08 09:52:20 +00:00
Boxiang Zhu 69d979c048 [CI] Add skyline scenario
Skyline is a new service for dashboard.
This patch adds a CI scenario which tests Skyline deployment.

Depends-On: https://review.opendev.org/c/openstack/kolla/+/826948
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/828464

Implements: blueprint skyline
Change-Id: I48488a24d6c8a03cd129929347b1bdac25f198b0
2023-11-08 09:28:53 +08:00
Will Szumski 1235c7253d CI: Adds a kolla-variables parent job
This allows us to share variables between jobs without inheriting any
of the pre-run, post-run or cleanup playbooks of the parent job. These
run due to the zuul inheritance rules, see:

https://zuul-ci.org/docs/zuul/latest/config/job.html#job

Signed-off-by: Will Szumski <will@stackhpc.com>
Change-Id: Id0a34778accafdc62ebe916e81d69f31c6274d4c
2023-11-07 14:51:36 +00:00
James Kirsch 5581a28253 Add support for LetsEncrypt-managed certs
Add support for automatic provisioning and renewal of HTTPS
certificates via LetsEncrypt.

Spec is available at:
https://etherpad.opendev.org/p/kolla-ansible-letsencrypt-https

Depends-On: https://review.opendev.org/c/openstack/kolla/+/887347
Co-Authored-By: Michal Arbet <michal.arbet@ultimum.io>
Implements: blueprint letsencrypt-https
Change-Id: I35317ea0343f0db74ddc0e587862e95408e9e106
2023-11-07 10:59:51 +01:00
Michal Arbet c5f3f23e05 [podman] Fix cross dependency image build
When the kolla-ansible project has a cross dependency on
the kolla project, CI have to build an image from that change
locally. However, Podman refuses to push to localhost, so it is
necessary to set the local repo as insecure for the test.

Change-Id: I786b22ff0cd581f90ba4bec08842651a6509a745
2023-11-03 12:05:04 +01:00
Michal Nasiadka 79637cb99e Revert "CI: Pin ansible-core due to breakage"
This reverts commit d3c4ff8b95.

Reason for revert: workaround is present

Change-Id: I40f794ce5f401a7357099dff10f7f8e05e1c4826
2023-10-19 08:20:03 +00:00
Michal Nasiadka d3c4ff8b95 CI: Pin ansible-core due to breakage
It seems latest ansible-core 2.14 and 2.15 breaks a filter
in kolla-ansible - let's pin for now and fix the issue in a
separate patchset.

Change-Id: I200ad775094230e4bf8bb40988c12ea03471008f
2023-10-11 10:26:38 +02:00
Michal Nasiadka 6abbbce6f1 CI: Move test-ovn before test-core-openstack
Currently we don't really know what is the OVN cluster status
when test-core-openstack fails on Neutron operations.

Change-Id: Id8ca7c7cd6d741e406f609527016edff592352d7
2023-09-29 16:17:42 +02:00
Zuul daf7174283 Merge "ansible: bump min version to 2.14 and max to 2.15" 2023-09-20 11:40:53 +00:00
Jan Gutter 73dcad3263
CI: Add back ARA logging
Up till now the ARA plugin has been pinned to a very old version,
and is no longer functional.

This installs a much newer version of ARA and adds a README file
to guide developers on how to view the sqlite file.

The ARA plugin is installed by default, but not activated. This
is intended to catch a small amount of regressions and
integration failures.

Developers can enable the plugin by adding the string `#ara`
to their commit message. This avoids extra load on the CI.

Change-Id: Id8328e374c9590b1363026fa2b2b24e191183987
2023-09-03 16:43:13 +01:00
Michal Nasiadka 71dd6eb983 ansible: bump min version to 2.14 and max to 2.15
Change-Id: Ia982df80d688522dbaa5fc3e462c1a009d512cb6
2023-08-30 12:24:06 +00:00
Zuul a34f1cd7e6 Merge "Add support for checking Octavia cert expiration" 2023-08-17 07:21:28 +00:00
Mark Goddard 6c037790f2 Refactor MariaDB and RabbitMQ restart procedure
Ansible 2.14.3 introduced a change that broke the method used for
restarting MariaDB and RabbitMQ serially [1][2]. In
I57425680a4cdbf0daeb9b2cc35920f1b933aa4a8 we limited to 2.14.2 to work
around this. Ansible upstream claim this behaviour was unintentional,
and will not fix it.

This change moves to a different approach where we use separate plays
with a 'serial' keyword to execute the restart.

This change also removes the restriction on the maximum supported
version of 2.14.2 on ansible-core - any 2.14 release is now supported.

[1] 65366f663d
[2] https://github.com/ansible/ansible/issues/80848

Depends-On: https://review.opendev.org/c/openstack/kolla/+/884208

Change-Id: I5a12670d07077d24047aaff57ce8d33ccf7156ff
2023-06-17 21:02:49 +00:00
Maksim Malchuk 5fd8117098 Fix passwords.yml permissions
The kolla-genpwd, kolla-mergepwd, kolla-readpwd and kolla-writepwd
commands now creates or updates passwords.yml with correct
permissions. Also they display warning message about incorrect
permissions.

Closes-Bug: #2018338
Change-Id: I4b50053ced9150499d1d09fd4a0ec2e243cf938b
Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2023-05-31 14:22:34 +03:00
Zuul 62be98f90c Merge "Add container engine option to scripts" 2023-05-19 11:59:56 +00:00
Michal Nasiadka 10fc1b748a ansible: bump min to 2.13 and max to 2.14.2
We limit to 2.14.2 due to a regression in ansible-core [1] that breaks
conditional include_task loops in handlers. This is used for controlled
restarts of MariaDB and RabbitMQ.

[1]: 65366f663d

Change-Id: I57425680a4cdbf0daeb9b2cc35920f1b933aa4a8
Co-Authored-By: Michal Nasiadka <michal@stackhpc.com>
2023-05-18 20:04:48 +01:00
Martin Hiner 53e8b80ed3 Add container engine option to scripts
This patch add a way to choose container engine inside tool and test
scripts. This is in preparation for Podman introduction but still
leaves Docker as default container engine.

Signed-off-by: Martin Hiner <m.hiner@partner.samsung.com>
Change-Id: I395d2bdb0dfb4b325b6ad197c8893c8a0f768324
2023-04-28 16:16:55 +02:00
Matt Crees d9451f49f3 Add support for checking Octavia cert expiration
Adds a flag ``kolla-ansible octavia-certificates --check-expiry <days>``
to the ``octavia-certificates`` command to check if the certificates
will expire within a given number of days.

Change-Id: I869b8afd85fe282d823ecf3593aa22f94a61b2a0
2023-04-27 15:22:12 +01:00
Dr. Jens Harbott b98a71e5d4 Revert "ansible: bump min to 2.13 and max to 2.14"
This reverts commit 9867060b6b.

Reason for revert: seems this broke some jobs

Change-Id: I1ca81214ece403351c0a522ea05bf07802e4c4c0
2023-04-20 09:26:11 +00:00
Michal Nasiadka 9867060b6b ansible: bump min to 2.13 and max to 2.14
Change-Id: Ibc9cc91f64b0450de3cae6e2830b4ff2c52c0395
2023-04-13 14:10:28 +00:00
Radosław Piliszek 7367427338 [CI] Test Neutron with IPv6 networks
Make sure to actually test IPv6 connectivity to our test instance in the
IPv6 jobs.

Change-Id: I7845448804e191af356e82f8ad33c563ffd8ebd5
2023-03-26 09:34:53 +00:00
Bartosz Bezak ee658f4549 remove elasticsearch remnants in antelope cycle
Change-Id: I115b491eca413437926f5bcaf53336151f9a7c0b
2023-02-07 11:25:27 +01:00
Pierre Riteau a7fcf1fcdf CI: Run validate-config at the end of deploy
Change-Id: I40021caf3f94e718ea42d9ef77e5d9c77c3133de
2022-12-22 14:01:07 +00:00
Michal Nasiadka e1ec02eddf Replace ElasticSearch and Kibana with OpenSearch
This change replaces ElasticSearch with OpenSearch, and Kibana
with OpenSearch Dashboards. It migrates the data from ElasticSearch
to OpenSearch upon upgrade.

No TLS support is in this patch (will be a followup).

A replacement for ElasticSearch Curator will be added as a followup.

Depends-On: https://review.opendev.org/c/openstack/kolla/+/830373

Co-authored-by: Doug Szumski <doug@stackhpc.com>
Co-authored-by: Kyle Dean <kyle@stackhpc.com>
Change-Id: Iab10ce7ea5d5f21a40b1f99b28e3290b7e9ce895
2022-12-01 10:27:50 +00:00
Doug Szumski adb8f89a36 Remove support for deploying OpenStack Monasca
Kolla Ansible is switching to OpenSearch and is dropping support for
deploying ElasticSearch. This is because the final OSS release of
ElasticSearch has exceeded its end of life.

Monasca is affected because it uses both Logstash and ElasticSearch.
Whilst it may continue to work with OpenSearch, Logstash remains an
issue.

In the absence of any renewed interest in the project, we remove
support for deploying it. This helps to reduce the complexity
of log processing configuration in Kolla Ansible, freeing up
development time.

Change-Id: I6fc7842bcda18e417a3fd21c11e28979a470f1cf
2022-11-11 15:48:11 +00:00
Michal Nasiadka 35f90a31eb CI: Fix init-swift
Container image naming scheme has changed

Change-Id: I775ea3f796290c670e4b04640f4429304dae609c
2022-10-10 08:19:17 +00:00
Michal Nasiadka 98a691a7c9 Bump Ansible min version to 2.12/5 and max to 2.13/6
Change-Id: Ie09bf108250a71d539002dd5ccfa63dd71bcfe90
2022-10-04 11:45:28 +00:00
Michal Nasiadka ec0367c039 CI: Always build images for centos jobs
CentOS 9 Stream images are not getting published so we need to build
them every time.

Change-Id: I782ab105da4f23979dcbe2348c7141a1ae272b9a
2022-10-03 12:47:41 +00:00
Radosław Piliszek 166ee3d20c [CI] Do not use the kolla user
The kolla user is not obligatory and the docs default to keeping
using the existing users.

Needed-By: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/854985
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/855071
Change-Id: I917f493d395cc7efcbf95bc55af8191d70ec3edb
2022-09-13 12:06:39 +00:00
Radosław Piliszek 2c7a8497fa [CI] Run Kolla Ansible from its own venv
This avoids polluting the module path for other deployed projects,
like Tenks.

Change-Id: I17802f628e1e7db8d1f5caaa815170a8415e995c
2022-09-09 16:28:19 +00:00
Radosław Piliszek c1c332da7c [CI] Let Tenks manage its own venv
This way it works closer to what Tenks does in its own CI.

See-also: https://review.opendev.org/c/openstack/tenks/+/856296
Change-Id: I5bebcb3520aada3abc8b7d0d4087e7a3f9277df2
2022-09-07 19:57:58 +00:00
Radosław Piliszek 125646b911 Honour the linuxbridge experimental status
This patch follows upstream and disables linuxbridge testing.
Users are notified of the situation via the release note.

Change-Id: I524682ceb5287c14ef0ba99baae0c081850f4c5e
2022-08-03 15:19:40 +02:00
Zuul 8f3b61cedd Merge "CI: cephadm: Add osds/pools/users in one run" 2022-06-20 16:35:27 +00:00
Michal Nasiadka c922d458df CI: cephadm: Add osds/pools/users in one run
Change-Id: If9b40079d42cdabfd14d27603357dd0aa027a49b
2022-06-20 09:49:55 +00:00
Michal Nasiadka ebe570bb84 CI: Switch upgrades xena->yoga to yoga->master
R-17: Switch source images to current release

Disable rocky8 and openeuler jobs as master no longer works with
python3.6.

Change-Id: I89dd99b5f25502f5ebe15a9e90ccecc4bd6feafa
2022-06-13 15:04:09 +02:00
Radosław Piliszek c906ab2a91 [CI] Use the script module for running core tests
Depending on the way the testing script is called, it may sense
stdin being available and not being a tty [1]. The logic in the
Glance part of the client is then broken [2] as it detects both
volume and stdin as sources of the image and fails.
The proposed approach uses the script module for these tests.
This fixes the cephadm upgrade jobs where this script was called
using the shell module which causes this behaviour. The script
module is not affected. FWIW, the command module is affected
the same as shell because shell extends the command module.

[1] 6810414e45/openstackclient/image/v2/image.py (L114-L120)
[2] 6810414e45/openstackclient/image/v2/image.py (L414)

Change-Id: I3ce4059063e3a51eb1c5b42bda79893b56bd85f0
Story: 2006294
2022-05-29 16:57:47 +00:00
Radosław Piliszek 3cef2671ce [CI] Properly use Yoga u-c everywhere
Follow-up to [1].
This unbreaks CI which was broken by a recent change to
master upper-constraints. [2]

[1] I82c4ff3b246c7db65ac8660b096d4a9a15dda8d7
[2] https://review.opendev.org/c/openstack/requirements/+/843722/3/upper-constraints.txt#b244

Change-Id: Idc7a893f53c6975cc4a3f6090020d973fa2288bb
2022-05-29 16:56:40 +00:00