Commit Graph

60 Commits

Author SHA1 Message Date
Michal Nasiadka fa5aa8f625 Drop k8s_fedora_ironic_v1 driver
Change-Id: Ic7114e5923b74a4202a043388701826b4e47326e
2024-02-05 08:14:56 +00:00
Michal Nasiadka 4eef6e8290 Add newer cluster-autoscaler versions to Docker Hub
Updated golang version since it's required for 1.26+
Removing builds for 1.24 and below - since those are long time
end of life
Bumping build job timeout to 3600s since it's timing out now

Change-Id: I1a40f10d438281c2cbd9a0c73c24d311f7c57b3f
2023-11-13 14:48:42 +00:00
Bartosz Bezak b73c6d25eb Update cluster autoscaler build to v1.23
* Add v1.23
* Update the go version in the build Dockerfile

Change-Id: Id11e5c4830a4538fd3e1869dddd56c977241aac3
2022-02-25 12:03:33 +01:00
Thomas George Hartland 6468aad3d1 Update cluster autoscaler build for v1.22
* Add v1.21/v1.22
* Update v1.18/v1.19 to newest point releases
* Drop v1.16/v1.17
* Update the go version in the build Dockerfile

Change-Id: If31d8027fa3541f6124777392539200dd68ae7af
2021-08-11 16:28:58 +02:00
Bharat Kunwar 7be7a5a123 [hca] Use wallaby-stable-1 as default HCA tag
Additionally:
- update syntax for compatibility with Ansible 2.9+.
- explicitly check for "not found" to prevent rebuild due to
  other types of errors, e.g. "pull rate limit".

Story: 2007264
Task: 42009

Change-Id: I68ca057e500ea293bde398288432a67eb758af25
2021-03-09 11:46:49 +00:00
Bharat Kunwar ff57593984 [hca] Only build/push stable images if unpublished
At present, the only mechanism we have for publishing a stable heat
container agent image through manual tagging. This PS aims to automate
this through the CI by only building them if they have not already been
published. This should allow us to keep better track of which commit was
used to build a given heat container agent image.

Story: 2007264
Task: 40045

Change-Id: Ifb80575c18a34584afddc8b83084702713a802b7
2021-03-03 12:21:18 +00:00
Spyros Trigazis 1f33b6c1fa Build autoscaler 1.20
Change-Id: Ib5c50a4aadc3ad0c0340fd7497a368c43b6e8ac1
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2021-03-01 11:39:20 +01:00
Spyros Trigazis 1f07c32002 ci: Log in to DockerHub using docker_login
Change-Id: Icd923f9e020dfe27f4e9b14e40f0ad53da49e0ff
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2020-08-26 17:05:30 +02:00
Spyros Trigazis f2718315d0 ci: Quote password on docker login
The password contains special characters, so we need to
quote the password string on docker login.

Change-Id: Ie826c78309395765911db01e6d412426e46f176e
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2020-08-24 12:09:35 +02:00
Thomas George Hartland 37c216543c Build cluster-autoscaler v1.19.0
Also update v1.17 and v1.18 to the latest
patch versions.

Change-Id: Id5e9d346733cf8a3b2e2d0da7f86340800aec090
2020-08-03 17:36:22 +02:00
Bharat Kunwar b3936451cd [ci] Fix gate by installing python3-docker
Change-Id: I34be042f7e664af69fd2892b0aa6a107fe017daf
2020-06-30 13:03:24 +00:00
Bharat Kunwar 81d0699c4c [hca] Pin fedora to 32 until new greenlet release
Eventlet used by many openstack packages depends on greenlet which does
not have a pip release supported by Python 3.9 (default Python version
on Fedora 33). Therefore, pin Fedora to version 32 until new greenlet
release is cut which includes the required fix [0].

Also update default heat_container_agent_tag to victoria-dev.

[0] https://github.com/python-greenlet/greenlet/pull/161

Change-Id: Ice75ae880925cd15c096eb6d1cdabf7f802bccde
Story: 2007264
Task: 39941
2020-06-03 08:55:30 +00:00
Bharat Kunwar 67d5b08178 [ci] Fix publish of helm-client containers
The publish step was using helm_version which has been renamed to
helm_versions to accomodate build of v2 and v3 clients.

Story: 2007514
Task: 39733

Change-Id: I69aa13b708a95530a4a86eb066885f3e56a91273
2020-05-19 09:52:56 +00:00
Bharat Kunwar 51681ba53d [k8s-fedora-atomic] Build kube_tag v1.15.12
Despite the policy that Kubernetes project maintains release branches
for the most recent three minor releases (1.18, 1.17, 1.16) [0],
v1.15.12 has been released so this change partially restores the
builder for this tag as an alternative to completely reverting
26411c2970.

[0] https://kubernetes.io/docs/setup/release/version-skew-policy/#supported-versions

Story: 2005124
Task: 39686

Change-Id: Ia458c5a87ba2357f845eb095548403cc7a25b58c
2020-05-11 15:01:20 +00:00
Bharat Kunwar 26411c2970 [ci] Remove unnecessary container build tasks
Since Train release, we use upstream hyperkube image for fedora-atomic
(when use_podman=True label is set) and fedora-coreos drivers. The last
image we needed to build through the CI was for v1.15.x (because the
Kubernetes project maintains release branches for the most recent three
minor releases: 1.18, 1.17, 1.16 [0]) and v1.16.x+ has never been
supported by the fedora-atomic driver without the use_podman label.

This PS proposes removing the Ansible tasks to build these containers
through the CI. This does not affect already published older images:
https://hub.docker.com/search?q=openstackmagnum%2Fkubernetes&type=image.

[0] https://kubernetes.io/docs/setup/release/version-skew-policy/#supported-versions

Story: 2005124
Task: 39398

Change-Id: I458767dc12b46d665777ebe019c46565f37dd959
2020-05-05 10:35:19 +00:00
Zuul 07103112a1 Merge "[k8s] Build helm-client containers v2.16.6 and v3.2.0" 2020-04-29 11:48:55 +00:00
Bharat Kunwar 8a35cba25c [k8s] Build helm-client containers v2.16.6 and v3.2.0
Use buster-slim base image which is the latest stable [0].

[0] https://www.debian.org/releases/index.en.html

Story: 2007514
Task: 39525

Change-Id: I1ff8224cf064b7138f8868b2ac17710014f1e988
2020-04-29 10:10:21 +00:00
Zuul 6ad146a42b Merge "Use ensure-* roles" 2020-04-29 08:19:40 +00:00
Bharat Kunwar 39ccad9cc4 Build new autoscaler containers
Versions: 1.16.5, 1.17.2 and 1.18.1

Story: 2007465
Task: 39152

Change-Id: Ie70e5ba38799c3da17ec9a34f6990f8c2d853732
2020-04-14 09:05:00 +00:00
vass c09b7dede5 Use ensure-* roles
The install-* roles in zuul-jobs have been renamed to ensure-*, follow
the rename.

Change-Id: Ie42c76f3659f4944435b2227dfea9e11c0607587
2020-04-12 10:45:14 +02:00
Feilong Wang f77aba5ee3 Release k8s v1.15.11 image
Task: 39053
Story: 2005124

Change-Id: I56632f561471d113cec36f3038aa6c39b695e785
2020-03-13 17:52:14 +13:00
Andreas Jaeger a4190dc9d0 Remove buildimage jobs
Remove buildimage jobs, they have been disabled in April 2019 and the
project uses upstream images now.

Remove them so that the legacy parent job can be removed, this repo
is one of the final users.

Change-Id: Ieb4fe3e6122270b4e9114012dee5af747d88d539
2020-02-26 08:46:50 +01:00
Spyros Trigazis 0bf18002ed Release k8s v1.14.10 and v1.15.7
Release atomic system container images.

story: 2005124
task: 37814

Change-Id: I2c0be773128b483acb992030f30ea71bcf364934
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-12-14 20:54:17 +01:00
Feilong Wang 380aa1cf8c Release k8s v1.14.9 and v1.15.6
Rlease atomic system container images for k8s v1.14.9 and v1.15.6.

story: 2005124
task: 37590

Change-Id: I6ba7e6b11ca9d98e6a1f4579cdc28928304ed838
2019-11-22 11:35:20 +13:00
Spyros Trigazis 66ebe442c2 heat-agent: Check if scripts exists
When we start or restart the heat-agent, we run
configure_container_agent.sh which writes a few scripts. Make sure that
the scipts do not exist before writing to avoid overwriting any values
created on runtime.

When the heat-agent starts, /etc/os-collect-config.conf includes only
the reference to the os-refresh-config command. After the agent
bootstap, this file contains the credentials to check for software
deployments in the [heat] section. Before this patch, when the agent
restarted /etc/os-collect-config.conf was cleared resulting the agent to
stop working. I have the survive restarts, skiping only
os-collect-config.conf should be enough, but it is better to not touch
files on just service restart.

Additionally, fix file permissions for /etc/os-collect-config.conf.

Change heat-container-agent tag to ussuri-dev.

Change-Id: I3efd4e55e885b95721f13279b44dc1246e2fd2e4
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-10-23 09:57:44 +02:00
Feilong Wang 1b1d841097 Release k8s v1.13.12, v1.14.8, v1.15.5, v1.16.2
Story: 2005124
Task: 37198

Change-Id: Ic10485eda8b4ddd8d63197d1f7be2cf205d3acbd
2019-10-17 09:56:28 +13:00
Thomas Hartland 25c0f46169 Build cluster autoscaler container images
Add Dockerfile and CI config for building cluster autoscaler
container images specifically for magnum.
The autoscaler is built with the build tag "magnum" so that
only the magnum provider is included in the binary. This cuts
the size of the image in half compared to building with all
cloud providers.
The container-build job in .zuul.yaml has to have its timeout
increased, as the build time was already close to the timeout.

Change-Id: Iecbae5866278afe1687a4533b71af60fce537a4a
2019-10-16 08:05:23 +00:00
Spyros Trigazis 45730c787e Build k8s images v1.16.0 and minor bumps
v1.15.4
v1.14.7
v1.13.11

story: 2005124
task: 36730

Change-Id: I79221423314545978d30be474f7d2b78a918a30f
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-09-20 10:55:12 +02:00
Spyros Trigazis efff708625 Publish 1.16 k8s images
Missed from I35617f67af1157cb39d22a17f10defa26bce2f09

story: 2005124
task: 36320

Change-Id: I8b4d20fb393883ca700347d94ed9d7adb4d176f5
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-08-23 10:10:58 +02:00
Spyros Trigazis 68c0e86a46 kubernetes builds for v1.{13,14,15,16}.x
kubernetes_version_v1_13: v1.13.10
kubernetes_version_v1_14: v1.14.6
kubernetes_version_v1_15: v1.15.3
kubernetes_version_v1_16: v1.16.0-beta.1

story: 2005124
task: 36320

Change-Id: I35617f67af1157cb39d22a17f10defa26bce2f09
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-08-22 09:15:47 +00:00
Feilong Wang 243eb6aa73 Release k8s images v1.15.2, v1.14.5, v1.13.9 and v1.12.10
Story: 2005124
Task: 36111

Change-Id: Ib719dc4ce8b00eb7ebbef663c99c4d2117590c2f
2019-08-07 13:53:08 +12:00
Feilong Wang c6bf1da085 Set train-dev as the default tag for heat-container-agent
Based on the policy of heat-container-agent tag, now it's updated
as train-dev and as long as we release Train, it will be updated
with train-stable.

Change-Id: Iec43df292dbd6a7e7ee33a0d4b8670b653a7ebbd
2019-07-26 10:01:27 +12:00
Spyros Trigazis fe0f0efa72 Add build-arg for --allow-privileged
https://github.com/kubernetes/kubernetes/pull/77820
https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.15.md#node

story: 2005124

Change-Id: I2935d34ace08800c805028f1673bc515f2f577e6
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-06-21 11:47:50 +02:00
Spyros Trigazis 85bd42474b Build kubernetes v1.15.0
story: 2005124
task: 30581

Change-Id: I38157a8af7e38b007344942f54608eb413a4dfd9
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-06-19 20:44:57 +02:00
Spyros Trigazis e99b0e8d6e Build kubernetes images
v1.11.10
v1.12.9
v1.13.7
v1.14.3
v1.15.0-rc.1

story: 2005124
task: 30581

Change-Id: I16cb54bb1d8e6e47b997d0314d00dbc9b7853aa0
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-06-12 09:43:52 +02:00
Zuul 981bf12a5a Merge "Disable broken image building" 2019-05-01 13:30:01 +00:00
Feilong Wang 5a74b45453 Release k8s v1.12.8
Task: 30675
Story: 2005124

Change-Id: I97ca231d70308862ed8b84d9364a6028c43e3382
2019-05-01 12:42:40 +12:00
Andreas Jaeger 42c75c4d3d Disable broken image building
The periodic jobs for building images are all failing, add some
low-hanging fruits for fixing:

1) Remove usage of own Fedora image build tools, they were removed as
   part of change Ie6a8496c202ff0bf330dd0f434cff8777e5ef112.
2) Add openstack/tripleo-image-elements and
   openstack/heat-templates as required-repo for the build
   jobs, they are requirements.

Still, these are still failing, let's disable the periodic jobs.
They have been broken since ages without fixing. There's no
record of a successful run under Zuul v3.
Last images at http://tarballs.openstack.org/magnum/images/ are from
2017.

Change-Id: I01122fa029b4124d912e80ea43bca07b8f2ebe5c
2019-04-30 15:26:02 +02:00
Andreas Jaeger ef0678ec98 Fix container-build job
Fix container-build variable due to move from git.openstack.org to
opendev.org.

Also, rename the job following the naming guidelines [1]. We have a
shared namespace and job names need to start with the repo name.

[1] https://docs.openstack.org/infra/manual/drivers.html#consistent-naming-for-jobs-with-zuul-v3

Change-Id: Ieed605c8e6d020b224cacf377b5a6178669ecf1a
2019-04-30 15:25:55 +02:00
Zuul cfc2bbec45 Merge "Build kubernetes v1.15.0-alpha.1" 2019-04-21 11:26:23 +00:00
OpenDev Sysadmins 79e7931e6e OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:44:16 +00:00
Spyros Trigazis e98b8e52dc Build kubernetes v1.15.0-alpha.1
story: 2005124
task: 30581

Change-Id: I2e5afd0d9a35c8bb800c6aad9911d7c20df4cd78
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-04-18 12:48:14 +02:00
Spyros Trigazis 0ba46679bd Build kubernetes v1.14.1
story: 2005124
task: 30491

Change-Id: Id9e9a1867305e1bcd51a5606a21cbb3fa0e0fd73
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-04-12 15:30:52 +02:00
Feilong Wang 5b3489057d Publish k8s v1.14.0 image
Task: 30220
Story: 2005124

Change-Id: If1bc3e46a11b62cd5aa7bc5904f4262ee2eb2e24
2019-03-28 16:35:20 +13:00
Feilong Wang 70f1dbd9c7 Kubernetes images release
Releases:

v1.11.9
v1.12.7
v1.13.5
v1.14.0

Change-Id: I07539727744ad4dc7b6f665ef14cdbe1b6c00611
2019-03-28 10:03:02 +13:00
Ian Wienand ae6933ffce Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Ie288c147a3cbdd19abd257bf14972c316db6d67c
2019-03-24 20:34:05 +00:00
Feilong Wang 83c8b13bf0 Release k8s v1.11.8, v1.12.6 and v1.13.4
Release new k8s version because of CVE-2019-1002100[1]

[1] https://discuss.kubernetes.io/t/kubernetes-security-announcement-v1-11-8-1-12-6-1-13-4-released-to-address-medium-severity-cve-2019-1002100/5147

Task: 29789
Story: 2005124

Change-Id: I6435a10b05932ea71e825e944d53859eba374e91
2019-03-03 20:55:47 +00:00
Spyros Trigazis 0b5f4260d9 k8s_fedora: Deploy tiller
Add enable_tiller  label to install tiller in k8s_fedora_atomic
clusters. Defaults to false.

Add tiller_tag label to select the version of tiller. If the
tag is not set the tag that matches the helm client version in
the heat-agent will be picked.  The tiller image can be stored
in a private registry and the cluster can pull it using the
container_infra_prefix label.

Install tiller securely using helper container.

TODO:

*add instructions on how RBAC is designed
https://docs.helm.sh/using_helm/#example-deploy-tiller-in-a-namespace-restricted-to-deploying-resources-in-another-namespace
* add docs on how to install addon in the cluster using this tiller
* how users can get the creds to talk to tiller

NOTE:
The main goal of this tiller is internal usage!
Users can still deploy other tillers in other namespaces.

story: 2003902
task: 26780

Change-Id: I99d3a78085ba10030200f12bbfe58a72964e2326
Signed-off-by: dioguerra <dy090.guerra@gmail.com>
2019-02-11 11:18:08 +01:00
Feilong Wang 0a5fd471c3 Support multi k8s image versions
Change-Id: Icae30a7d6c5f779e75587f398d06dc149378e827
2019-01-30 12:59:24 +13:00
Spyros Trigazis 9f3719674b Use python3 for functional tests
* Run by default with python3.
* Add python2 functinal-api job.

Change-Id: Ic5c3c4ef57284767665d3c5dc92c59671218ebe1
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2019-01-18 12:12:16 +00:00