Commit Graph

794 Commits

Author SHA1 Message Date
Vladimir Kozhukalov 718fa2c2e0 Add Metallb job
Metallb be is a L2/L3 load balancer that we
use for exposing the Openstack services
outside the cluster.

Before that we used to deploy the ingress-nginx
contoller in the host network namespace.

Change-Id: I9fdb5f1b2f9403ce04f9d34b1792a0f29f55d879
2024-03-26 19:34:46 -05:00
Vladimir Kozhukalov 96f2a1fcec Pre-setup provider gateway using deploy-env role
Recently we refactored the deploy-env role which
among other things can deploy Openstack provider
network gateway.

Depends-On: I41f0353b286f817cb562b3bd59992e4baa473568
Change-Id: Iece2cc83c68cc282389f8380ceebeebf17f788fb
2024-03-26 16:57:38 -05:00
Vladimir Kozhukalov 82d1b86b2a Update for future ingress improvements
- Openvswitch agent init script skips attaching
  interface if it does not exist. And the compute-kit.sh
  deploys neutron with

  auto_bridge_add: {"br-ex": "provider1"}

  where "provider1" is a tap interface that is going
  to be created while deploying the test env.

- Heat test script checks only public endpoints

- Add 1+2 nodes nodeset. The primary node is used
  as a client node and not a member of K8s cluster.

Change-Id: If7c8763dd619dec31f9d141f21399d159395049a
2024-03-19 16:13:14 -05:00
Vladimir Kozhukalov 17ca3983c2 Update neutron chart to enable dpdk tests
Running dpdk test job on a sinlge node env
does not require a real hardware dpdk interfaces
to be attached to the tunnel bridge. Let's
make the list of dpdk interfaces empty which
will allow us to test the Openvswitch in user space
but not touch real hardware.

Change-Id: I2f9d954258451f64eb87d03affc079b71b00f7bd
Co-Authored-By: Arina Stebenkova <astebenkova@mirantis.com>
2024-02-13 22:21:07 -06:00
Vladimir Kozhukalov f3286ded3d Use upstream ingress-nginx
Change-Id: Iecd53115f4ee2f4dc6ea4f575cfdb4a934aacb1a
2024-01-30 22:27:47 -06:00
Vladimir Kozhukalov fd519debfb Use containerized Openstack client
Change-Id: I982cd3a831701d002eb128fb92e1514070f30e15
2024-01-19 10:21:40 -06:00
Vladimir Kozhukalov d025c02ce6 Enable 2023.2 compute-kit-ovn job
Depends-On: I9f852ff54cfc42536387fa51a73f019b56070345
Change-Id: I80e98df09693dcf5e4666e2bf3209ee34d11eedf
2024-01-04 11:51:49 -06:00
Vladimir Kozhukalov 67090246b7 Run 2023.2 tls job
Change-Id: I2d7d48b6e26e975a1eb91669b89672a8068e1038
2023-12-11 13:54:35 -06:00
Vladimir Kozhukalov 444f1fd161 Use rook ceph for some cinder jobs
Change-Id: I2af04eb6ad313593fb25f9430a00b4e2c5d503fb
2023-12-07 14:37:33 -06:00
Vladimir Kozhukalov b52ceef053 Use get-values-overrides.sh script from osh-infra
Depends-On: I5cfaad8ebfd08790ecabb3e8fa480a7bf2bb7e1e
Change-Id: I2a76a73974b874774d2ed5871d7280a2a0a9179c
2023-11-29 23:38:29 -06:00
Vladimir Kozhukalov 52cd767c84 Cleanup unnecessary files
We recently re-worked all the deployment jobs
so they use `deploy-env` Ansible role which works
for both multi-node and single-node environments.
This means there is no need to have diffrent sets
of scripts for these two cases.

Also when we deploy Openstack components it is better
to have values overrides for different scenarios but
not different sets of scripts. Here we remove unused
deployment scripts which in many cases duplicated
the code base.

We will be cleaning up the code base even further to
provide excelent user experience.

Change-Id: Iacda03964a4dd0e60873593df9f590ce20504f2f
2023-11-02 16:12:27 -05:00
Vladimir Kozhukalov 2815d67688 Use osh-bandit role for the bandit job
Change-Id: I1ced9902237777683feb36e5a3a261b9c0d56c42
2023-10-30 14:54:26 -05:00
Vladimir Kozhukalov 82a6aa8ce9 Add 2023.2 (Bobcat) jobs
Change-Id: Iea2a16db8acaa94259aeb3e21097bb771b70c38e
2023-10-13 12:40:12 -05:00
Vladimir Kozhukalov fc365b8dd5 Bump Cirros image version to 0.6.2
In Bobcat by default the ssh keypair is generated
with ed25519 algorithm which is incompatible with
Cirros 0.3.5. The Cirros 0.6.2 also requires minimum
128Mi of RAM

Change-Id: I0135c09a9ae5bc3171891576b29a450f7000f180
2023-10-12 13:45:53 -05:00
Vladimir Kozhukalov a4ee07744e Fix buildset registry usage for multinode jobs
The issue was that we used to add buildset registry
name to the /etc/hosts file only on the primary node.
This PR fixes this.

Change-Id: I48a861c7c6661e3fe1e7384f4b987f1646d652d7
2023-09-20 01:44:13 +03:00
Vladimir Kozhukalov b9da4fcbf6 Fix deployment jobs when used for testing images
Change-Id: I0f12c83c4896c699a0b6c13bbff7bc520ca56e46
2023-09-19 04:52:41 +03:00
Vladimir Kozhukalov 56842b39d4 Update ingress deployment script
We recently merged https://review.opendev.org/c/openstack/openstack-helm-infra/+/891720
which updates ingress controller deployment and assumes
we now use IngressClass objects instead of annotations.

We have to update the ingress deployment script
so it creates IngressClass objects with correct names.

Change-Id: I547f27250ba21bb068bc83c62954092111df8b50
2023-09-17 08:49:05 +03:00
Vladimir Kozhukalov 069d8e9320 Use deploy-env role for all deployment jobs
The change updates all deployment jobs so they use
deploy-env role which leverages kubeadm to deploy k8s.
This role works for both single-node/multi-node
inventories.

Also all jobs are reorganized to improve job
maintenance. Check pipeline runs tests for 3
most recent releases: Yoga, Zed, 2023.1

We are focusing on 2023.1 for which we run both
Focal and Jammy jobs.

Change-Id: Ibba9b72876b11484fd7cc2e4710e92f964f15cc3
2023-09-15 20:30:42 +03:00
Vladimir Kozhukalov 5aadee0dc8 Add Ubuntu Jammy overrides
Change-Id: Icabf43efee2e64c856ae14a69881d96b380d7751
2023-09-07 00:12:04 +03:00
Ayumu Ueha 97c1c61ea2 Add Tacker chart
At this point it requires nfs provisioner that provides
ReadWriteMany volumes for vnfpackages, csar files and
also the same storage class is used for logs.

Also this patch adds a job that only deploys Tacker but
does not tests it in any way. This job is put to the experimental
pipeline.

Co-authored-by: Vladimir Kozhukalov <kozhukalov@gmail.com>

Story: 2010682
Task: 47771
Change-Id: I56d7ba489746ab4f818086440a7783f4b1ecb292
2023-09-01 05:01:02 +00:00
Vladimir Kozhukalov 8366d679dd Fix hosts.toml template for containerd
The issue is that playbook that configures containerd
defines buildset registry namespace w/o skip_verify
parameter which leads to the error in the template.

This change add additional check whether skip_verify
parameter is defined or not.

Change-Id: I7b6f19d4fe881e33fef2370bac887e9cd66c7b35
2023-08-15 17:03:12 +03:00
Vladimir Kozhukalov c39638a148 Configure containerd mirrors for multinode tests
The compute-kit jobs are used to test new images
which are published to buildset registry. We have
to configure containerd which is used for multinode
compute-kit jobs to use this buildset registry.

The role use-buildset-registry that we used before
does not properly configure containerd. So we
extended deploy-docker playbook to configure
both buildset registry and registry mirror
if they are defined.

Change-Id: Idb892a3fcaf51385998d466dbdff8de36d9dd338
2023-08-11 20:48:05 +03:00
Vladimir Kozhukalov 2024cc361e Use multinode nodeset for compute-kit jobs
For recent releases we use 32GB nodes for compute-kit
jobs. The number of such nodes is extremely limited.
So we'd better use multinode nodesets for compute-kit
jobs.

We deploy K8s using kubeadm and then we set labels to the
K8s nodes so charts can use these labels for node selectors.
We deploy L3 agent only on the node where we run test scripts.

This is because we want test virual router to be always created
on this node. Otherwise the L2 overlay needs to be created
to emulate provider network (will be implemented later).

Glance is deployed w/o backend storage (will be fixed later).

Change-Id: Id2eb639fb67d41006940a7d7b45a865b2f1124f7
2023-08-03 01:22:06 +03:00
Vladimir Kozhukalov 1651f252aa Allow custom loopback devices in multinode scripts
story: 2010760
task: 48047
Change-Id: Ie370429a9fe48c98894ce60470e3266649c4685c
2023-06-09 23:20:03 +03:00
okozachenko a81317569f Add Manila chart
Change-Id: I5098b1b57c3afed01e90f489de34415d69056e25
2023-04-21 16:30:16 +03:00
Zuul 8457810b19 Merge "Get resource_type of kubernetes cgroup" 2023-04-13 17:41:39 +00:00
Vladimir Kozhukalov a1c0645c36 Enable yoga compute-kit job
Change-Id: I6860194ca90d2f81f32cb9bb8633a5af1d798b31
2023-04-12 06:07:06 +03:00
jinyuanliu 03c22c3c76 Get resource_type of kubernetes cgroup
Cgroup name of Kubernetes is determined by the
cgroup driver of Docker. If cgroup driver of Docker
is systemd, there will be an error in deploying HugePages.

https: //github.com/kubernetes/kubernetes/blob/release-1.26/pkg/kubelet/cm/cgroup_manager_linux.go#L77-L81
Change-Id: If709a968dde24d01e17fef63f09ebf9d7a23fc62
2023-03-31 01:36:49 +00:00
Sadegh Hayeri c83582a866 Add ovn
Change-Id: Iacf6423399d51134af5b00b472ef6b42e17dfd6a
2023-03-17 21:31:48 +03:30
Stephen Taylor 884a734833 [ceph] Update all Ceph images to Focal
This change updates all Ceph image references to use Focal images
for all charts in openstack-helm.

Change-Id: I67cd294e2aabf3c3af404da42204f9b6157b06f7
2023-03-17 07:50:10 -06:00
Stephen Taylor 46beb87574 Allow Ceph pools to use 1x replication
Beginning with the Pacific release, Ceph pools are not allowed to
use 1x replication by default. This is problematic for the
openstack-helm gate scripts, which frequently use 1x replication
for automated testing. This change adds Ceph configuration and
command overrides to allow those gate scripts to continue to use
1x replication for testing.

Change-Id: I21ed3e43f3773d5ea830959f1b66b35f38185ca7
2023-03-15 07:10:10 -06:00
Vladimir Kozhukalov 58facb9e50 Fix ceph deployment
When deploy ceph on loop devices we need lvm2
to be installed on the host to create necessary
device links like /dev/<vgname>/<lvname>

Change-Id: Ice7031da38009e913cd43b95398218d25dc97930
2023-02-20 19:15:01 +03:00
Zuul e199168df8 Merge "Fix for creation endpoins and services when v1/v2 are disabled." 2023-01-20 18:00:59 +00:00
Terekhin, Alexey (at4945) 9216563be2 Fix for creation endpoins and services when v1/v2 are disabled.
Change-Id: I187e882c653c93ad4e1ef83a88ac4fcc3e60f763
2023-01-19 14:09:43 -08:00
Wahlstedt, Walter (ww229g) 9286d03d77 create namespace before deploying nfs
Change-Id: I0a6641ac5e3b79c62999136839d651b923405b0c
2023-01-18 09:23:00 -05:00
Stephen Taylor 5f645609c8 [Ceph] Add final_osd value to test deployment scripts
The ceph-rbd-pool job is being changed to use the "final_osd"
target instead of the "osd" target to determine if more OSDs than
expected are running. The deployment test scripts therefore must
be updated to include this value.

Change-Id: I63e4a0b3ba58d5ee79cda75bd9e9650d5a49aff5
2022-12-13 14:57:09 -07:00
Zuul 7bb3f30c9d Merge "Deploy placement before nova" 2022-10-24 20:20:16 +00:00
Gage Hugo ba0b7eeb05 Run 1 replica of rabbitmq in the gate
Occasionally rabbitmq replicas fail to come up when running in
zuul due to resource constraints. This causes random failures
and needless rechecks when it comes up.

This change sets the number of replicas when deploying the compute
kit script to 1 from the default 2.

Change-Id: Icdcc075a88d05f87a7f787d306d6b430485964c9
2022-10-23 20:18:59 -05:00
Gage Hugo 3001bd2750 Deploy placement before nova
With the placement db migrate job removed, we can now deploy
placement ahead of nova. This fixes issues of several nova pods
failing due to placement not being up before nova is.

This change moves the placement service to deploy before nova
in the compute-kit script.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/860975

Change-Id: I62f82224e898761d5b388867c63a259967601d45
2022-10-23 20:13:24 -05:00
sunile 94a8d348a9 Added horizon to install as default component
Added horizon to the openstack umbrella chart to deploy but disabled
by default.

Change-Id: Ia835c0c142d0e0878623af9165d595a386b7c4c2
2022-10-03 16:39:33 +00:00
josebb 41cf532623 Fix indentation of placement value overrides in compute-kit script
Change-Id: Icc58b4399c45400bbc9ad6553ece43c9600e351a
2022-08-11 13:17:09 +00:00
Zuul ffc9c3788d Merge "make 170-setup-gateway idempotent" 2022-07-25 15:32:53 +00:00
Zuul 2a558fd536 Merge "Dont create openstack objects if they exist" 2022-07-22 16:53:16 +00:00
Dustin Specker 1aadb948aa make 170-setup-gateway idempotent
Before if we tried to add an address that was already added to the
br-ex device the script would error out. Now, use replace which is
idempotent.

Change-Id: I34bbb361c4fa2f347431629f79753f75b458926f
2022-07-22 11:02:11 -05:00
Kostiantyn Kalynovskyi 5644b08c5c Dont create openstack objects if they exist
Change-Id: Ib2d5a4d1dd456d9bf272624295f9ee5ffa2a9035
2022-07-19 16:49:57 +00:00
Zuul 0bc4ad5aee Merge "Create cron jobs idempotently" 2022-07-19 00:59:47 +00:00
Zuul 88b451187e Merge "Add idempotency to setup-gateway.sh" 2022-07-19 00:59:45 +00:00
Kostiantyn Kalynovskyi 18fdc30961 Create cron jobs idempotently
Change-Id: Ib7d74ed3b202237027e6da9908c257e81c8cfc25
2022-07-15 20:20:14 +00:00
Kostiantyn Kalynovskyi 5b6192746a Add idempotency to setup-gateway.sh
Now docker container will not be run if it already
exists.

Change-Id: Ife797c0326d36e4c20a89014621b3a1f111ec51d
2022-07-15 16:30:14 +00:00
Dylan Murphy a207621467 Add helm dep up before umbrella deploy
This is useful for avoiding using stale dependencies
in local development.

Change-Id: Ifa7af2184de2a707ca0d46308b7d19c9cd10793b
2022-07-11 19:53:01 +00:00