Commit Graph

56 Commits

Author SHA1 Message Date
SPEARS, DUSTIN (ds443n) 7c1865b7db Update helm to v3.14.2
Change-Id: I6952261625d74a7a2205b34b3fe08b02afab6089
2024-03-15 14:04:42 -04:00
Sergiy Markin 03a55bbc31 Kubeadm based Airskiff gate
This PS replaces old airskiff integration gate
with new kubeadm based airskiff integration gate.
The main goal of this gate is to test new Armada
image and chart together with other Airship
components.

Change-Id: I2351b55fa136453a0a6a27a2875208c5e18e579e
2024-03-13 15:11:30 +00:00
Sergiy Markin e85f0ccdeb Airflow stable 2.8.2
This PS bumps up Airflow version to the latest
2.8.2 and also bumps up openstack dependences to
Antelope 2023.1

Change-Id: I5c7fb6ae950ea0f906106fc2184d5c6eb7858f5a
2024-02-26 21:00:58 +00:00
Sergiy Markin b3b8d05fe7 Airflow stable 2.8.1
Change-Id: I46c97108d50304fd4e3417f6057d999c891b0661
2024-02-21 22:24:46 +00:00
Ruslan Aliev d9e2248172 Add configurable support of armada-operator for armada-api
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: I76fb41062d152bf360a85d781c19ab5b204769b8
2024-02-12 11:09:18 -06:00
SPEARS, DUSTIN (ds443n) ea56249752 Update helm to v3.13.2
Change-Id: I6f235d1fba8d9c1c47a1dcf655e35b97e0382763
2023-11-15 09:27:52 -05:00
Anselme, Schubert (sa246v) 5df69442b0 Deprecating the Ingress Class Annotation
Upgrading htk to version 0.2.55, which deprecates the ingress class
annotation (kubernetes.io/ingress.class) with .spec.ingressClassName

https://review.opendev.org/c/openstack/openstack-helm-infra/+/891720

Change-Id: I304b3239f6d9f1951de03bd821c8ba4c0a5b9a60
Signed-off-by: Anselme, Schubert (sa246v) <sa246v@att.com>
2023-10-05 22:55:39 +00:00
Sergiy Markin 6595dd83ea Add docker image tag
This PS adds  airflow_2.6.2-${distro} tag to published image that was prevoulsly tagges as latest-${distro}.

Change-Id: I74d61110b235ab5618f2c4e45320cf51c90635ce
2023-08-25 20:02:56 +00:00
Sergiy Markin cdcdbd292d Airflow stable 2.6.2
This PS updates python modules and code to match Airflow 2.6.2:

- bionic py36 gates  were removed
- python code corrected to match new modules versions
- selection of python modules versions was perfoemed based on
  airflow-2.6.2 constraints
- airskiff deploy pipeline was aligned with latest in treasuremap v1.9

Change-Id: If6f57325339995216d2553c7a5ff56e7673b5acc
2023-08-19 00:37:37 +00:00
Sergiy Markin 25c3d621d6 Armada updates
This PS makes the following changes:

- makes sure the airskiff-deploy playbook is using 80Gb partition if
  available
- adds available security updates to docker images

Change-Id: I405743f9ae69194407bcc49a736b63e9993655c3
2023-08-18 21:53:29 +00:00
SPEARS, DUSTIN (ds443n) 4f43e2cc55 Update helm to 3.12.2
Also this PS updates airskiff deployment playbook based on the latest
treasuremap changes and makes sure the airskiff deployment uses freshly
built armada image.

Change-Id: I913f93d695e4068199e193a5839bf27e257a535e
2023-08-03 16:29:51 +00:00
Sergiy Markin 812546c875 Update armada image run test
This PS improves armada image run test by enriching it with config
generator. Also this test was removed from make images section of
Makefile. Build images zuul gate has make run_images task to test
the freshly built image now.

Change-Id: I87e089e5d268d248cda1dad1cd417694d166fdfb
2023-05-24 20:14:32 +00:00
Sergiy Markin 275dc4506f Updates to armada
- update github.com ssh host key
- fix bionic image upload to Quay.io
- fix armada_image_run.sh script
- fix armada config presense

Change-Id: I2af589baabb9e76e2e1a29ff266d6c3b7ae412e3
2023-05-22 21:37:16 +00:00
Sergiy Markin 966742ec74 Restored ubuntu_bionic image build
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integratinal
tests.

Also the latest osh-infra commit was used with kubernetes 1.27.1 or
integration tests.

Make images section of Makefile was enriched with run_armada step in
order to quicktest the freshly built images - this is vital for focal
and bionic images differences.

Change-Id: Ida43eebd4aa51fff6261ac9cf5f8259359bc99a9
2023-05-19 13:52:30 +00:00
Sergiy Markin b778f9faf8 Update airskiff deployment gate
This PS updates armada to use new reliable airskiff site manifests for
testing armada.

Change-Id: I5c07f19755731b6df678aad0c066cfe588c79a80
2023-05-09 13:50:15 +00:00
Sergiy Markin 386a686e69 [focal] Python modules sync with Airship project
- armada-airskiff-deploy is voting gate again
- fixed falcon.API deprecation - -> falcon.App
- fixed collections.abc.defaultdict not found error
- fixed tox4 requirements
- implemented requirements-frozen.txt approach to make allike as other
  Airship projects
- uplifted docker version in the image building and publishing gate

Change-Id: I337ec07cd6d082acabd9ad65dd9eefb728a43b12
2023-04-21 23:49:14 +00:00
SPEARS, DUSTIN (ds443n) 0e9d828fe6 Update armada to focal
Update kubernetes client to v26.1.0
Updating armada to focal base image
Remove xenial and opensuse dockerfiles
Update tox python from py35 to py38
Add apparmor for docker build
Uplift HTK chart version 0.2.52
Bumping up some python dependencies to get in sync with shipyard
Added clear-firewall role for airskiff-deploy playbook

Change-Id: If06a3f60466702d05a21c24a7cb8041bed41507a
2023-03-20 11:30:37 -04:00
Ruslan Aliev ef0ac2f252 Bump helm version from 3.6.3 to 3.8.2
Also bump k8s dependency to v1.23.

Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: I188788a41419184cc3dd9172f54ab3a290cabe83
2022-06-30 22:19:56 -05:00
Sean Eagan a5730f8db8 Remove Tiller
For now we leave the tiller status enpdpoint, until
Shipyard has had a release to stop depending on it [0].

[0]: https://review.opendev.org/c/airship/shipyard/+/802718

Signed-off-by: Sean Eagan <seaneagan1@gmail.com>
Change-Id: If8a02d7118f6840fdbbe088b4086aee9a18ababb
2021-10-05 02:41:32 +00:00
Sean Eagan 5f1ffbbbbe Revert "Airship 2 support features"
This reverts commit c75898cd6a.

Airship 2 ended up using the Flux helm-controller instead:
https://github.com/fluxcd/helm-controller

So this is no longer needed. Removing it to get rid of tech
debt to ease introduction of Helm 3 support.

This retains the part of the commit which extracts the
chart download logic to its own handler as this is still useful.

Change-Id: Icb468be2d4916620fd78df250fd038ab58840182
2021-09-30 17:22:16 -05:00
anthony.bellino 84edebc470 Gate fixes for Armada
* airskiff gate fixes
  - Pin treasuremap to v1.9 branch
  - Pin openstack-helm-infra to master
  - Remove openstack client setup as it's not used
* Pin typing-extensions to 3.7.2

Change-Id: I52bf733fb1d2b9164378729e17660ec401fbb89a
2021-06-02 14:45:14 -07:00
Drew Walters 7bf1423752 Add documentation to docs.airshipit.org
This change adds publishing to docs.airshipit.org and updates the theme
to match the other Airship projects on the site. This change also
updates orphaned links and removes the Read the Docs jobs.

The documentation can be found at docs.airshipit.org/armada when this
change merges.

Change-Id: I9641753f6084f911e3286c623d0c2de7b3f6040a
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-08-03 10:33:13 +00:00
Sean Eagan c75898cd6a Airship 2 support features
Airship 2 is using Argo for workflow management, rather
than the builtin Armada workflow functionality. Hence, this
adds an apply_chart CLI command to apply a single chart at
a time, so that Argo can manage the higher level orchestration.

Airship 2 is also using kubernetes as opposed to Deckhand as the
document store. Hence this adds an ArmadaChart kubernetes CRD,
which can be consumed by the apply_chart CLI command. The chart
`dependencies` feature is intentionally not supported by the CRD,
as there are additional complexities to make that work, and ideally
this feature should be deprecated as charts should be building in
there dependencies before consumption by Armada.

Functional tests are included to excercise these features
against a minikube cluster.

Change-Id: I2bbed83d6d80091322a7e60b918a534188467239
2020-03-25 13:56:32 -05:00
Drew Walters 6d6bdf76bd CI: Use Ubuntu Bionic in jobs
Many of the supporting infrastructure used to run Armada jobs, adopted
form OpenStack-Helm infra, no longer supports Ubuntu Xenial. This change
changes the default job distribution to Bionic in order to consume new
infrastructure code changes.

Change-Id: I3a2f1f95eae98cacc08641dc64ba7afbee628284
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-02-06 13:22:04 -06:00
Arun Kant 3514d0f3d5 Removing flag added to opensuse gate job to make it non-voting
Reverting change made earlier when opensuse gate starting to fail
randomly few days ago. (https://review.opendev.org/#/c/676524)

Change-Id: I3c8e23935c921dcb27e5ef46eaad3208c412b158
2019-08-19 11:37:28 -07:00
Sean Eagan 77deecc294 Temporarily disable voting for opensuse image build
Disabling voting until the issue is resolved.

Change-Id: Iddc95c44766a683c1e80122397a805583742a09f
2019-08-15 13:36:26 +00:00
Michael Beaver fd0c7875ef Remove required-projects from Airskiff gate
This removes several of the the required-projects from the Airskiff
gate as the scripts for the gate can already clone down the necessary
repositories and the required-projects can overwrite and pins that may
have been included in the Airskiff scripts.

Change-Id: I065bdfd66a09c8515b6e55355d5282523699f9c4
2019-06-10 12:01:28 -05:00
Kaspars Skels bbb74f74d5 Correct Armada github sync key
Change-Id: Ia547cde4d85a850c87d10a4a5a680581a2cbdc11
2019-06-03 13:57:15 -05:00
Michael Beaver 232a814f73 Add ubuntu_xenial image build to Armada
All other Airship projects that use Ubuntu currently have a build
for Xenial, and until they all move to Bionic we should support
using the same version on all of them

This adds an ubuntu_xenial Dockerfile in addition to the ubuntu_bionic
Dockerfile, and updates the gates to add ubuntu_xenial jobs

Change-Id: I63753b02cb6d6ccc40cace9dd35b6e1ba67d1e31
2019-05-31 14:56:30 -05:00
Kaspars Skels 7137e0f281 Encrypt git mirroring ssh_key to specific project
Change-Id: I9c9372eb24f05a162cc2351f5ee0c9a30beaf3e7
2019-05-23 11:58:18 -05:00
Kaspars Skels e65f58c986 Add Zuul job for mirroring to GitHub
Change-Id: I89d4d33d486c2f3846f68a002b54486073eac8ed
2019-05-22 15:13:07 -05:00
Andreas Jaeger 877600a61d Fix rtd publishing
The trigger URL is https://readthedocs.org/api/v2/webhook/{{ rtd_project_name }}/{{ rtd_webhook_id }}

The tooling sets rtd_project_name to "airmada" but the project is
named "airship-armada" in RTD. Introduce rtd_project_name and set it to
correct value.

See also
https://zuul-ci.org/docs/zuul-jobs/general-roles.html#rolevar-trigger-readthedocs.rtd_project_name

Change-Id: If44c1d56290726b974d8a3d64be0e65d203a8283
2019-05-17 14:43:57 +02:00
Arun Kant 1110c23cd1 Fixing secret name used for publishing image on quay.io
Fixing incorrect secret name used in previous review to address
image publish failure
https://review.opendev.org/#/c/637327/

Change-Id: I874f182d8eba704454594c84ff2a659eb5cdca11
2019-05-15 14:00:30 -07:00
rajdharwadkar 2d82080249 Support armada to run on opensuse image leap15
Added Dockerfile for opensuse so it builds leap15 image
Modified to support multiple distros for image building.

Change-Id: Iffa7d0dbe4bc301e78a0bba1adc927d8aa2cbdcc
2019-05-06 10:06:46 -07:00
Drew Walters b881e176f5 CI: Update jobs for OpenDev
On April 19, OpenStack completed the migration from openstack.org to
opendev.org [0]. During this migration, Airship projects moved from the
"openstack" namespace to the "airship" namespace. This change removes
the "armada-" prefix from all jobs to reflect the new repository name
and fixes the Airskiff check job to use the correct OSH-infra relative
path.

[0] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005011.html

Change-Id: I7f261bb36676be9b8039778d87758186bfc94c65
2019-04-23 19:29:04 +00:00
OpenDev Sysadmins 567a7f992b OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:52:21 +00:00
Zuul fe8ad58605 Merge "CI: Add Airskiff check" 2019-04-17 21:56:35 +00:00
Drew Walters febf0d43a9 CI: Add Airskiff check
This commit adds a non-voting Zuul job that deploys Memcached using the
Airship-Treasuremap airskiff site and submitted Armada changes.

[0] https://airship-treasuremap.readthedocs.io/en/latest/airskiff.html

Change-Id: I597bef0f9cd7352c66ababa56ce7f396f6da88b0
2019-04-15 14:53:22 +00:00
Drew Walters c6fb131022 CI: Add chart build job for latest Helm toolkit
This commit introduces a non-voting job to lint Helm charts against the
latest version of Helm toolkit from OpenStack-Helm Infra. This job
should serve as an indicator of when it's safe to advance the version of
Helm toolkit used by Airship.

Additionally, this commit modifies all Helm chart lint jobs to run on
each commit, regardless of the files modified by a change. This should
not introduce a noticeable difference in CI runtime, as these jobs
execute quicker than the tox jobs.

Change-Id: I6c205d983a9556120ec9ce7ed70a44e7286eb6dd
2019-04-03 14:24:21 +00:00
Drew Walters 3abea31a1f CI: Add chart build gate
This commit introduces a chart build gate that triggers when changes are
made to charts in the charts/ directory.

Change-Id: Ieec10c36adfd0538e70ac47ad30ce314f24f712f
2019-01-28 11:35:58 -06:00
Drew Walters 0d65744779 CI: Remove OpenStack-Helm-Infra CI job
Currently, the airship-armada-ubuntu job deploys K8s using outdated
playbooks. The job fails due to a change [0] that introduced an AppArmor
requirement to Calico. This change removes the failing job, as its
success does not depend on changes in Armada. In the future, jobs
requiring K8s should be deployed using playbooks from
Airship-Treasuremap [1].

[0] https://review.openstack.org/614805
[1] https://git.openstack.org/cgit/openstack/airship-treasuremap/tree/tools/deployment/airskiff/developer/010-deploy-k8s.sh

Change-Id: I40dc1e0ccfd956c157a6bef60f106eb9c5e9ca04
2019-01-17 09:52:58 -06:00
Felipe Monteiro 57316d98d4 chore: Move openstack tox cover job to Armada
This patch set moves openstack tox cover job to Armada
to satisfy the following requirement:

https://docs.openstack.org/infra/manual/zuulv3.html#where-should-jobs-and-templates-live

Change-Id: Iab6b5594b341761a7202ae2d8a5a24ef48b6b654
Needed-By: I1203714e6e0907b902d07267cbfced722e2a200c
2018-10-26 18:35:42 +00:00
Felipe Monteiro 501d1e13b3 Remove redundant pep8 job from .zuul.yaml
This patch set drops a redundant pep8 job from .zuul.yaml.
openstack-tox-pep8 is already as a job, so
airship-armada-lint-pep8 can be dropped.

Change-Id: Iaaa0c8d34a2de93b7f105f7c686951df4e3b6824
2018-10-17 09:13:58 -04:00
Felipe Monteiro 0aa0935c7c chore: Combine pep8 with whitespace linter
This patch set combines whitespace linter and pep8 together
(as both do code linting) into the same job by dropping the
.zuul.yaml whitespace-linter job and rolling it up into the
same pep8 tox.ini check, just like Deckhand [0].

[0] 0462b7b929/tox.ini (L106)

Change-Id: I31ed60adfd431157ffc96a0f4d5d77d54af37352
2018-10-14 17:52:32 -04:00
Felipe Monteiro 2f4f36a8ca add python 3.6 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.6 as part of the python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I99bd1097c3da97e77f33059a6adab41c45f53906
Story: #2002586
2018-09-21 21:05:33 +01:00
Sean Eagan 80e513219b Correct docs-on-readthedocs to work with RTD publish
This patch set follows the guide [0] to leverage
the Zuul template [1] for correctly publishing RTD
doc changes via openstackci. Accordingly, all the
old code for doing this has been removed.

[0]
http://lists.openstack.org/pipermail/openstack-dev/2018-August/132836.html
[1]
https://docs.openstack.org/infra/openstack-zuul-jobs/project-templates.html#project_template-docs-on-readthedocs

Change-Id: Ibb38c5a420a2b06c0872840e054f7edc0b717cf6
2018-09-10 21:44:29 +00:00
Gage Hugo 72983451ed Add global PEP8/Bandit zuul job
This change adds the global openstack zuul job for
running pep8 via tox. Bandit is also ran as part of
this job.

Change-Id: I34c880ade2c4ff5f6b2badca8512b84b43d8636b
2018-08-21 02:33:28 +00:00
Tin Lam 1ffdf2ef57 refactor(gate): refactor rtd trigger
This patch set uses the same mechanism as airship-deckhand to trigger
the readthedoc publish job in the post pipeline.

Change-Id: If750baebef23bf84c7ccf5d8e3ab6335f97bdfb6
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-28 19:05:49 +00:00
Tin Lam 1e97cec611 fix(gate): update .zuul.yaml
This patch set associates a node set to the job that was missing.

Change-Id: I21d5835b996abdd95b439000267c8581edb5bf56
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-20 22:36:40 -05:00
Tin Lam c17f14f058 chore(rtd): add a rtd publish trigger
This patch set adds in a trigger on post to trigger a RTD job to start
building the documentation merged.

Change-Id: I6ffcaeced19d75e39055e73770070d3388238bd5
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-20 18:05:45 +00:00