Commit Graph

162 Commits

Author SHA1 Message Date
Zuul 437a3dca5d Merge "Remove unused ingress.sh script" 2024-04-22 18:08:21 +00:00
Zuul 3b189c5433 Merge "Utilize OSH plugin for deployment test scripts" 2024-04-22 18:08:19 +00:00
Vladimir Kozhukalov 3d748215ec Remove unused ingress.sh script
This script used to deploy the ingress controller
using OSH-infra ingress chart. We switched all
the test jobs to the upstream Ingress-nginx
Helm chart some time ago and now we can remove
this script.

Change-Id: I5282e98eb4387ce05ae4dec4fba8f21550a22617
2024-04-20 01:47:32 -05:00
Vladimir Kozhukalov df1c999e41 Utilize OSH plugin for deployment test scripts
Depends-On: I8f30fbdf94d76ef9fa2985a25c033df290995326
Change-Id: I35b3793a660cfc27faf700b9679529b154e41df4
2024-04-20 01:31:03 -05:00
Vladimir Kozhukalov 92c8360947 Update base deployment job
Add openstack-helm-plugin to required projects
and set the helm_plugin_repo pointing to the
openstack-helm-plugin source code directory.

If we try to install the plugin from
https://opendev.org/openstack/openstack-helm-plugin.git
it often fails.

Change-Id: I71ab6ad104beb491b5b15b7750e2fc0988db82bf
2024-04-17 19:03:10 -05:00
Vladimir Kozhukalov e3f7a67971 Add 2024.1 overrides
Depends-On: Iefe943b6fa608cafcda418cedf48b5148eefadd1
Depends-On: Iadc9aec92b756de2ecfcb610e62c15bdbad4bb9e
Depends-On: Icf98f9af863f60fa93ff70d2e8256810bed2b9f9
Change-Id: I76f5699e74a51374c644527c58ffc4527b4f6100
2024-04-03 17:26:56 -05:00
Zuul 2a94566004 Merge "Add 2024.1 jobs" 2024-03-27 21:04:32 +00:00
Vladimir Kozhukalov 6529ae46fe Add 2024.1 jobs
At this point we don't include them into
any pipelines. This will be performed in later
commits, once the 2024.1 images are ready.

Change-Id: Ie7aa59685898f065b7054b5072cb2fe0ab706b1c
2024-03-27 12:09:36 -05:00
Vladimir Kozhukalov 718fa2c2e0 Add Metallb job
Metallb be is a L2/L3 load balancer that we
use for exposing the Openstack services
outside the cluster.

Before that we used to deploy the ingress-nginx
contoller in the host network namespace.

Change-Id: I9fdb5f1b2f9403ce04f9d34b1792a0f29f55d879
2024-03-26 19:34:46 -05:00
Vladimir Kozhukalov 96f2a1fcec Pre-setup provider gateway using deploy-env role
Recently we refactored the deploy-env role which
among other things can deploy Openstack provider
network gateway.

Depends-On: I41f0353b286f817cb562b3bd59992e4baa473568
Change-Id: Iece2cc83c68cc282389f8380ceebeebf17f788fb
2024-03-26 16:57:38 -05:00
Vladimir Kozhukalov 82d1b86b2a Update for future ingress improvements
- Openvswitch agent init script skips attaching
  interface if it does not exist. And the compute-kit.sh
  deploys neutron with

  auto_bridge_add: {"br-ex": "provider1"}

  where "provider1" is a tap interface that is going
  to be created while deploying the test env.

- Heat test script checks only public endpoints

- Add 1+2 nodes nodeset. The primary node is used
  as a client node and not a member of K8s cluster.

Change-Id: If7c8763dd619dec31f9d141f21399d159395049a
2024-03-19 16:13:14 -05:00
Vladimir Kozhukalov 04dc3ab3d0 Temporarily disable job utilizin ceph-osd on Jammy
Recent changes in ioctl made it incompatible
with parted which is used by OSH ceph-osd chart when
deploying ceph on a loop device.

The issue appears on Ubuntu Jammy.

See details here https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2049689

We temporarily disable jobs that utilize ceph-osd on Jammy.

Change-Id: Ic4657ee7c71a46e56f98b1f6ef8ad0a434593c06
2024-02-13 15:11:14 -06:00
Vladimir Kozhukalov 2d9457e34c Bump Calico version to v3.27.0
Depends-On: I9abf8f93a4566411076190965f282375846dc5db
Depends-On: I8daa54e70c66cec41733d6b9fd5c9dd4597ff9c1
Change-Id: I3c3b8f4c91bd4df43be43d76ce36e81ea0b51c55
2024-02-02 14:14:17 -06:00
Vladimir Kozhukalov 57b09a7ba2 TLS job with upstream ingress-nginx chart
Change-Id: Ia206277343a05316ad71cb92346655bfe08519d5
2024-01-31 12:34:26 -06:00
Vladimir Kozhukalov f3286ded3d Use upstream ingress-nginx
Change-Id: Iecd53115f4ee2f4dc6ea4f575cfdb4a934aacb1a
2024-01-30 22:27:47 -06:00
Vladimir Kozhukalov fd519debfb Use containerized Openstack client
Change-Id: I982cd3a831701d002eb128fb92e1514070f30e15
2024-01-19 10:21:40 -06:00
Vladimir Kozhukalov d025c02ce6 Enable 2023.2 compute-kit-ovn job
Depends-On: I9f852ff54cfc42536387fa51a73f019b56070345
Change-Id: I80e98df09693dcf5e4666e2bf3209ee34d11eedf
2024-01-04 11:51:49 -06:00
Zuul 65bd23fba8 Merge "Run 2023.2 umbrella job" 2023-12-13 22:24:06 +00:00
Vladimir Kozhukalov 3858d1d3a5 Bump Kubernetes version to 1.28.4
Depends-On: Ic6b3478e53504622804b6f003ca176a679573d5b
Change-Id: Ibfdc1b41b280f8a024d438e4bde6c3417925d6d5
2023-12-13 12:17:32 -06:00
Vladimir Kozhukalov 1ea7f30ea0 Run 2023.2 umbrella job
Also keystone-ldap and horizon jobs
are run with the 2023.2 release.

Change-Id: I79c7590a501ddb24e1bc6a88046edef5a70dbcec
2023-12-12 14:02:38 -06:00
Vladimir Kozhukalov 67090246b7 Run 2023.2 tls job
Change-Id: I2d7d48b6e26e975a1eb91669b89672a8068e1038
2023-12-11 13:54:35 -06:00
Vladimir Kozhukalov 444f1fd161 Use rook ceph for some cinder jobs
Change-Id: I2af04eb6ad313593fb25f9430a00b4e2c5d503fb
2023-12-07 14:37:33 -06:00
Vladimir Kozhukalov 0f106414a5 Remove test jobs for old Openstack releases
The PR removes test jobs for:
- Victoria
- Wallaby
- Xena

Change-Id: I7f5623685b61435d6bfc7092915a35baa13fc8c1
2023-11-06 17:09:13 -06:00
Vladimir Kozhukalov 52cd767c84 Cleanup unnecessary files
We recently re-worked all the deployment jobs
so they use `deploy-env` Ansible role which works
for both multi-node and single-node environments.
This means there is no need to have diffrent sets
of scripts for these two cases.

Also when we deploy Openstack components it is better
to have values overrides for different scenarios but
not different sets of scripts. Here we remove unused
deployment scripts which in many cases duplicated
the code base.

We will be cleaning up the code base even further to
provide excelent user experience.

Change-Id: Iacda03964a4dd0e60873593df9f590ce20504f2f
2023-11-02 16:12:27 -05:00
Vladimir Kozhukalov 2815d67688 Use osh-bandit role for the bandit job
Change-Id: I1ced9902237777683feb36e5a3a261b9c0d56c42
2023-10-30 14:54:26 -05:00
Vladimir Kozhukalov c987d4a3a0 Update osh-selenium image used by default
Change-Id: I31dce9be26f0e36ac00ef8e359d2ad72d6e46272
2023-10-26 12:49:04 -05:00
Vladimir Kozhukalov 82a6aa8ce9 Add 2023.2 (Bobcat) jobs
Change-Id: Iea2a16db8acaa94259aeb3e21097bb771b70c38e
2023-10-13 12:40:12 -05:00
Vladimir Kozhukalov 069d8e9320 Use deploy-env role for all deployment jobs
The change updates all deployment jobs so they use
deploy-env role which leverages kubeadm to deploy k8s.
This role works for both single-node/multi-node
inventories.

Also all jobs are reorganized to improve job
maintenance. Check pipeline runs tests for 3
most recent releases: Yoga, Zed, 2023.1

We are focusing on 2023.1 for which we run both
Focal and Jammy jobs.

Change-Id: Ibba9b72876b11484fd7cc2e4710e92f964f15cc3
2023-09-15 20:30:42 +03:00
Vladimir Kozhukalov 5aadee0dc8 Add Ubuntu Jammy overrides
Change-Id: Icabf43efee2e64c856ae14a69881d96b380d7751
2023-09-07 00:12:04 +03:00
Ayumu Ueha 97c1c61ea2 Add Tacker chart
At this point it requires nfs provisioner that provides
ReadWriteMany volumes for vnfpackages, csar files and
also the same storage class is used for logs.

Also this patch adds a job that only deploys Tacker but
does not tests it in any way. This job is put to the experimental
pipeline.

Co-authored-by: Vladimir Kozhukalov <kozhukalov@gmail.com>

Story: 2010682
Task: 47771
Change-Id: I56d7ba489746ab4f818086440a7783f4b1ecb292
2023-09-01 05:01:02 +00:00
Zuul 2db78031bc Merge "Configure containerd mirrors for multinode tests" 2023-08-14 21:25:57 +00:00
Vladimir Kozhukalov c39638a148 Configure containerd mirrors for multinode tests
The compute-kit jobs are used to test new images
which are published to buildset registry. We have
to configure containerd which is used for multinode
compute-kit jobs to use this buildset registry.

The role use-buildset-registry that we used before
does not properly configure containerd. So we
extended deploy-docker playbook to configure
both buildset registry and registry mirror
if they are defined.

Change-Id: Idb892a3fcaf51385998d466dbdff8de36d9dd338
2023-08-11 20:48:05 +03:00
Vladimir Kozhukalov 38e7a27477 Add tls job to the check pipeline
The job openstack-helm-tls is updated to use 2023.1 release.
Also we renamed the tls job to openstack-helm-tls-2023-1-ubuntu_focal
to make it more convenient. And since this feature is important
we add the job to the check pipeline.

Change-Id: I5fdba8e5a4c6497c352bf4f1e3d2c7ab7e2a3076
2023-08-03 13:45:10 +00:00
Vladimir Kozhukalov 2024cc361e Use multinode nodeset for compute-kit jobs
For recent releases we use 32GB nodes for compute-kit
jobs. The number of such nodes is extremely limited.
So we'd better use multinode nodesets for compute-kit
jobs.

We deploy K8s using kubeadm and then we set labels to the
K8s nodes so charts can use these labels for node selectors.
We deploy L3 agent only on the node where we run test scripts.

This is because we want test virual router to be always created
on this node. Otherwise the L2 overlay needs to be created
to emulate provider network (will be implemented later).

Glance is deployed w/o backend storage (will be fixed later).

Change-Id: Id2eb639fb67d41006940a7d7b45a865b2f1124f7
2023-08-03 01:22:06 +03:00
Vladimir Kozhukalov fcac5812ec Use ubuntu-focal-32GB label for compute-kit tests
The change https://review.opendev.org/c/openstack/project-config/+/888901
introduces two new labels ubuntu-focal-32GB and ubuntu-jammy-32GB.
These labels are available in only one region (Vexxhost ca-ymq-1)
and the number of such nodes is extremely limited. So we are
going to switch compute-kit jobs to multinode nodesets ASAP and
this is in progress at the moment.

This change is a temporary solution to unblock all our
activities.

Change-Id: I2c2a54f4a90656bc6fb441b8a794744e4a636cb6
2023-07-26 14:09:51 +03:00
Zuul 7b8d8f3938 Merge "Run keystone-ldap test job with 2023.1 release" 2023-07-14 04:43:03 +00:00
Vladimir Kozhukalov d2892c11ec Run keystone-ldap test job with 2023.1 release
Change-Id: Ie037cced5f31d8a7047a94e2b9f3cbdb4a59244b
2023-07-08 14:36:45 +00:00
Sadegh Hayeri 66f2affb8d Add ubuntu-jammy based images
Change-Id: If224d1162a531759fe6ad2d636406be60721f16b
2023-07-08 14:25:54 +00:00
Vladimir Kozhukalov 1a3b7b5c25 Run tests for older releases periodic-weekly
Openstack releases older than Yoga are now in
extended maintenance. To reduce the CI
footprint we don't run test jobs for older
relases as part of the check/gate pipelines.

Instead we are going to run those jobs as
part of the periodic-weekly pipeline.

See the detailed description of extended maintenance
status here
https://docs.openstack.org/project-team-guide/stable-branches.html#maintenance-phases

Change-Id: Ie227e7d2dd297b6095a40f6114ef6b0a2f226790
2023-07-08 05:10:41 +00:00
Vladimir Kozhukalov 77fe3a0fb2 Run rally tests sequentially in compute-kit jobs
Change-Id: I27600cc732039ef82d41cea8d1ef9bba2eb6001b
2023-07-08 04:08:04 +03:00
Vladimir Kozhukalov b1f74a351a Add 2023.1 test jobs
- Also run last two test scripts in compute-kit job
  sequentially. This is handy since it allows to see
  what is happening during the test run. Both these
  test scripts usually take just few minutes. But if
  we run them using ansible async feature and one of
  the scripts fails then we are forced to wait for
  a long timeout.

Change-Id: I75b8fde3ec4e3355319b1c3f257e2d76c36f6aa4
2023-07-04 18:34:31 +03:00
Vladimir Kozhukalov 277ade0506 Run compute-kit umbrella job with Zed release
Change-Id: I6fba78163f193dbe053f2e33befe95e6b4d03a03
2023-07-04 03:32:17 +03:00
Vladimir Kozhukalov 3154dc22ee Run horizon test job with Zed release
Change-Id: I511a382654cb06e443ec824f2b63acadc47a3e0e
2023-07-04 00:30:06 +03:00
Vladimir Kozhukalov 02a9e1e0ed Enable Zed compute-kit and cinder jobs
Also a new nodeset was temporarily added.
The aio compute-kit jobs for recent releases require
a huge node to work reliably. We'll remove the temporary nodeset
once this is merged
https://review.opendev.org/c/openstack/openstack-helm-infra/+/884989

Change-Id: I7572fc39a8f6248ff7dac44f20076ba74a3499fc
2023-06-01 16:15:50 +03:00
Vladimir Kozhukalov 638cd297b2 Add Zed test jobs
Change-Id: I2687a6c176c6b6448396244c3650e688a14967fa
2023-05-25 21:07:10 +03:00
Vladimir Kozhukalov a1c0645c36 Enable yoga compute-kit job
Change-Id: I6860194ca90d2f81f32cb9bb8633a5af1d798b31
2023-04-12 06:07:06 +03:00
Zuul 112b540b86 Merge "Re-enable Xena jobs" 2022-10-24 20:35:47 +00:00
Gage Hugo bb52836c93 Re-enable Xena jobs
After a lot of debugging and changes, it appears that with several
tweaks the Xena jobs now are running successfully.

This change uncomments the Xena jobs for both cinder and
compute-kit.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/862440
Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/862441
Change-Id: Icb7e71599863b0236872fa8c39725cdfcee09feb
2022-10-23 20:28:07 -05:00
Gage Hugo 65aa849ea5 Remove Ussuri release jobs
This change removes the ussuri-bionic jobs from check in zuul
for openstack-helm. Ussuri is the only release that is still
using bionic images and this change is part of our effort to
stay up-to-date.

A future change will update the charts to remove ussuri overrides
to reflect this.

Change-Id: I18a55426d92654e7baa422ad92ea9f092d854460
2022-10-19 23:27:04 -05:00
sunile 94a8d348a9 Added horizon to install as default component
Added horizon to the openstack umbrella chart to deploy but disabled
by default.

Change-Id: Ia835c0c142d0e0878623af9165d595a386b7c4c2
2022-10-03 16:39:33 +00:00