Commit Graph

54 Commits

Author SHA1 Message Date
Ritchie, Frank (fr801x) aa1ebf9207 Update helm toolkit reference
Update helm toolkit reference

Update helm toolkit ref so that ingress will be created with a pathType
of Prefix.

https: //review.opendev.org/c/openstack/openstack-helm-infra/+/905757
Change-Id: I07dde50ba811aaf040a45b6e30ec53352e25fe55
2024-01-23 17:30:55 -05:00
Anselme, Schubert (sa246v) e57f77613b Deprecating the Ingress Class Annotation
Upgrading htk to version 0.2.55, which deprecates the ingress class
annotation (kubernetes.io/ingress.class) with .spec.ingressClassName

https://review.opendev.org/c/openstack/openstack-helm-infra/+/891720

Change-Id: Ib4fb99c475ce8bb5d2225f9ba84086e919029785
Signed-off-by: Anselme, Schubert (sa246v) <sa246v@att.com>
2023-10-05 22:27:56 +00:00
Sergiy Markin f99abfa433 Airflow stable 2.6.2
This PS updates python modules and code to match Airflow 2.6.2:

- bionic py36 gates  were removed
- python code corrected to match new modules versions
- selection of python modules versions was perfrmed based on
  airflow-2.6.2 constraints
- postgresql image updated to 14.8

Change-Id: Ibdcc75e600166c20b842508aa5539587cca466f0
2023-08-29 00:50:54 +00:00
Sergiy Markin 25456d677b Drydock updates
This PS makes the following changes:

- increases timeout for docker images build jobs
- adds available security updates to docker images

Change-Id: Ib10309bab017e864d14cad2dec816645220fba06
2023-08-24 01:45:45 +00:00
Sergiy Markin 6609d561e1 Fix go binary path
This PS fixed Go binary path in some bionic image docker build process.

Change-Id: I9975b4898b7cd312672bbad92765bc2ab5ed3089
2023-05-31 14:33:28 +00:00
Sergiy Markin 73d22a488f Restored ubuntu_bionic image build
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integrational
tests.

Change-Id: I695fb42efff29aeda737f2b9c1eaeb84b95aa57c
2023-05-24 18:37:21 +00:00
Sergiy Markin d00eaf0303 Drydock focal related upgrades
This PS implements the following changes:
- switches freeze approach to requirements-direct.txt and
  requirements-frozen.txt files
- adjusts code tabulation style according to  yapf recommendations
- replaces deprecated usage of responce.body attribute with
  responce.text
- fixes integration tests in controlled by Makefile + tox
- uplifts Helm to v3.9.4

Change-Id: I751db72eb8f670825382f11a36657112faeb169a
2023-04-26 22:32:49 +00:00
Sergiy Markin 415a8b52c5 [focal] Python modules sync with Airship project
- uplifted some python modules
- fixed tox4 requirements
- added focal build node as a default one
- added bindep.txt and bindep role to playbooks and docker image build process
- changes Makefile to reflect GoLang and dependency management changes
- upgraded Helm to v3 for chart build process
- uplifted postgresql version to 14.6
- fixed deprecated falcon.API - replaced with falcon.APP
- fixed upstream docker image publishing process

Change-Id: I307d72bb7680f6f5c71e42ad30666cf786420460
2023-04-08 08:20:22 +00:00
Phil Sphicas 1dee9c7d77 Update HTK stable commit (Ingress)
Update helm-toolkit to include updated Ingress templates that use
current API versions (i.e. networking.k8s.io/v1)

https://review.opendev.org/c/openstack/openstack-helm-infra/+/813115

Change-Id: Iaee8e2a597a43f2391ff6b73bdaa9804155e48ed
2021-10-18 11:50:21 -07:00
Sean Eagan c90fa60e2a Helm 3: Fix Job labels
See the dependency below for details.

Depends-On: https://review.opendev.org/c/openstack/openstack-helm-infra/+/811826
Change-Id: Id72e8c97603aa205ea1d071e6b99ad81513bacfc
2021-10-01 13:03:25 -05:00
anthony.bellino 34597ae0f1 (zuul) Drydock Post Gate Fixes
Change-Id: I293f83385af97943232dac1bf381442e401e6a07
2021-09-16 08:36:31 -07:00
Maximilian Weiss 10469ed3e5 Update HTK stable commit to 0.2.19
Update helm-toolkit stable commit to merge of this change:
https://review.opendev.org/c/openstack/openstack-helm-infra/+/802925

Change-Id: I78b5061ae38644a6ff5b9965488d4f4ae889df25
2021-08-17 17:55:44 +00:00
Maximilian Weiss de3d51d452 Update helm installation script
Updates the helm installation script to download and install v2.17.0
from get.helm.sh (instead of v2.14 from storage.googleapis.com).

Change-Id: I98a92c52ee1ecd28eb7a5beb6b72c4565b47cdfe
2021-08-17 17:55:44 +00:00
Phil Sphicas d883770ad9 Update HTK stable commit
Update helm-toolkit stable commit to merge of this change:
https://review.opendev.org/#/c/734702/

Change-Id: I2c1c0d8ca8b3f495e440009bb42dc3355ffd2aa2
2020-07-28 16:32:11 +00:00
Alexander Hughes 6a9c6b092b Fix image build checks missing setuptools
Use apt to install python3-pip, and use pip3 in event system has
both pip2 and pip3 installed. Use apt to install setuptools for
Ansible's consumption.

Change-Id: Id80c809c636abe41a1cbb4d465f82ed1e8e0e9d7
Signed-off-by: Alexander Hughes <Alexander.Hughes@pm.me>
2020-06-19 13:32:58 +00:00
Prateek Dodda 67716a7841 Add Docker default AppArmor profile to drydock
Change-Id: I50be2f08e69123afbef136683134abffc4e44197
2020-02-13 10:42:28 -06:00
Ahmad Mahmoudi 2a02bc9b3f Add support for ubuntu bionic base image
Adds support to build drydock image using either a xenial or a bionic base
image. Currently only xenial base is supported.
The default base image is set to ubuntu bionic.

Change-Id: I93672cf35879d8525d28e870ea83e5512c1043f9
2020-01-17 11:38:56 -06:00
Ahmad Mahmoudi 54675558fd Update image build script to run in a docker
Updated Makefile to run the build baclient package for go on the
host instead of as a docker container, to allow the Makefile be
called from another container. Reason being, in a docker-in-docker,
volume mapping requires knowledge of host filesystem path instead
of the docker daemon filesystem path.

Corrected proxy configuration in the scripts to use the USE_PROXY,
PROXY and NO_PROXY environment variables.

Updated Dockerfile to add multi-stage build, to avoid including the
golang-go package in the docker image. Stage one creates the
baclient Go library, and stage two creates the drydock image, and
copies the baclient from stage one image.

Change-Id: I29a30e870da8f44279dcd62bb1173165fa939d43
2020-01-14 17:39:27 -06:00
Drew Walters 1a9eb6d7f4 tools: Move helm-toolkit pin to latest commit
This change updates the helm-toolkit version used to build the Drydock
chart in order to introduce a change that removes use of the echo binary
from the Kubernetes entrypoint init container [0]. This is required in
order to use the new Kubernetes entrypoint image, which does not include
the binary.

[0] https://review.opendev.org/688435

Change-Id: I3c291367541aca9d2d8f2a7c3c0600d9d9efb84f
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-10-21 14:53:28 +00:00
Roman Gorshunov 161326fe06 Fix: Drydock Exceptions docs rendering on RTD
Readthedocs failed to render Drydock exceptions with error:
> WARNING: autodoc: failed to import exception xxx from module
> 'drydock_provisioner'; the following exception was raised: No module
> named 'drydock_provisioner'

Trying to add Drydock requirements to the installed requirements list,
so that Readthedocs has all modules, including those needed for the
Drydock itself.

Unify docs building by utilizing Zuul docs-on-readthedocs template job.

Cosmetic readability changes:
1. combined all Makefile .PHONY targets into one
2. merged multiple LABEL instructions in Dockerfile into one

Change-Id: I6a9b47cffc66d739968fa886c51e25b1e09ef124
2019-08-27 22:56:32 +02:00
Sean Eagan b25ec69145 Move to helm 2.14.0
Change-Id: I6a48cdff2742eec979e0f945dc427ebbe16949a4
2019-05-21 13:52:45 -05:00
Hussey, Scott (sh8121) dfe7c0508d (fix) Remove typo from build-args
- The make command to build images had extra characters
  causing invalid build-args

Change-Id: I0ae46d8760f0898c254d2f05991b9703f76078b2
2019-04-29 16:29:35 -05:00
Zuul 22a4f01cb7 Merge "CI: Add chart build job for latest Helm toolkit" 2019-04-17 16:26:28 +00:00
Scott Hussey e44ad39421 (zuul) Fix image publish post pipeline
- Fix issue in post pipeline image publish job introduced by
  Ansible update

Change-Id: I184bbdda3cf496ce652e72264423b83f43be5603
2019-04-03 14:49:42 -05:00
Drew Walters ed489d2c81 CI: Add chart build job for latest Helm toolkit
This commit introduces a non-voting job to lint Helm charts against the
latest version of Helm toolkit from OpenStack-Helm Infra. This job
should serve as an indicator of when it's safe to advance the version of
Helm toolkit used by Airship.

Additionally, this commit modifies all Helm chart lint jobs to run on
each commit, regardless of the files modified by a change. This should
not introduce a noticeable difference in CI runtime, as these jobs
execute quicker than the tox jobs.

Change-Id: I90473fd73a740f2711eb85e131edfa457944ea5e
2019-04-03 14:25:17 +00:00
Drew Walters 407ba6c47e tools: Update Helm to v2.13.1
Helm v2.13.1 has been released [0]. This change uplifts Helm to v2.13.1
and restores usage of the latest Helm toolkit to match other Airship
projects.

[0] https://github.com/helm/helm/releases/tag/v2.13.1

Depends-On: https://review.openstack.org/647812
Change-Id: Ide23b334b78ba41b7886ea791ba2f4ff4908f9c0
2019-03-28 15:20:38 +00:00
Aaron Sheffield 144642c490 Updating Docker Gate use of zuul.newrev
- Zuul updated ansible to 2.7, no longer allows missing variables.
- Using default value when it isn't available.

Based on Aaron Sheffield's PS for Pegleg: https://review.openstack.org/#/c/645631/

Change-Id: Icf23f769ca1c82f20da77f2a0d67b788ca14facb
2019-03-22 12:53:01 -05:00
Drew Walters ac997fd6ec images: Allow base image substitution for Drydock
Currently, Drydock images are built using the Ubuntu:16.04 base image.
This change allows users to specify different base images using the
UBUNTU_BASE_IMAGE build argument.

Change-Id: I9ddaa89eb5262571703a3dbf7ebb6deed1505842
2019-03-07 12:09:52 -06:00
Nishant Kumar ebe95d1875 Use helm toolkit for DB initialization
Depends-On: https://review.openstack.org/#/c/635348/

Change-Id: I55fa7a08b919581552dd512316fc42581762a6a4
2019-03-04 18:02:37 +00:00
Drew Walters 5904c9938e CI: Add chart build gate
This commit introduces a chart build gate that triggers when changes are
made to charts in the charts/ directory.

Change-Id: I8c2c428302f3297109f37213b93c088321b13204
2019-01-28 11:24:02 -06:00
Scott Hussey a2418241ce (fix) Use endpoint for MAAS URL
- Instead of forcing a user to provide the full URL for the MAAS API,
  instead use the endpoints pattern and render the URI via HTK templates.
- Add secret name to chart to support HTK ingress
- Install libyaml to take advantage of faster parsing by pyyaml
- Add exception logging when node compiling fails.
- Add caching of parsed design to gain efficiency
- Add TLS certificate secret for use by the ingress document

Change-Id: I5a2dbc415483c336d38d67edcebdfc5812f7bb0c
2018-11-27 12:04:38 -06:00
Roman Gorshunov 2c09054c4b Fix: adding back the possibility to add arbitrary labels
Arbitrary labels could be added as `make` parameter `LABEL=`, which is used in
att-comdev/cicd Jenkins pipelines.

Sample parameter:
'LABEL=org.label-schema.vcs-url=${GERRIT_CHANGE_URL} \
--label org.label-schema.base-image=${base_sha256}'

Sample usage:
See Jenkinsfile files under images/ directory in att-comdev/cicd repo.

In addition to that, if `COMMIT` variable is undefined when invoking `make`, we
use result of `git rev-parse HEAD` command, which should output latest git
commit ID.

[0] https://github.com/att-comdev/cicd

Change-Id: I9193ca03cb3970e3a3e1cb64ff643a4d24543636
2018-11-08 19:07:51 +01:00
Zuul c38a38fa4c Merge "Add release uuid to pods and rc objects (drydock)" 2018-10-04 21:27:18 +00:00
Zuul 9625febab6 Merge "Fix: git commit id labels on images" 2018-10-03 00:14:27 +00:00
Roman Gorshunov 34f7d760e8 Fix: git commit id labels on images
1) Use OCI Image Specs for labels instead of custom 'commit-id=xxxxx'
   or legacy "Label Schema"
2) Fix missing git commit id labels on images (.revision)
3) Add human-readable title (.title) of the image, URL (.url), and
   a few other properties (annotations) according to the latest Specs

Change-Id: I78ae651cdcba69e3a9a7a27bafa9a3a13c8eb557
2018-09-21 03:31:12 +02:00
Matt McEuen d8f4a1fbe3 Add release uuid to pods and rc objects (drydock)
This PS adds the ability to attach a release uuid to pods and rc
objects as desired.  This can be used, for example, to force an
artificial manifest change in CICD scenarios, for upgradability
testing purposes.

Change-Id: I784c0ad26c34338c9acda3dbe271f2139ba3f1f9
2018-09-14 18:19:36 -05:00
Matt McEuen 2bfb9c59cd Uplift Drydock to master Helm-Toolkit
Update the Drydock chart to be compatible with the latest Helm-Toolkit,
including taking advantage of some HTK manifest generation functionality
and updating the helm_tk.sh script to pull down master
openstack-helm-infra. Also update the default drydock image to point
to the current airshipit master rather than the old attcomdev in quay.

Change-Id: I9a818ae054361749ce16e9a6213fbeed82581f02
Co-Authored-By: Pete Birley <pete@port.direct>
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-14 11:59:29 -05:00
Scott Hussey 472fc0f232 (critical-fix) Fix Dockerfile entrypoint.sh
Dockerfile changes to support Go broke the resulting image by
omitting entrypoint.sh. This updates the Dockerfile to include
entrypoint.sh and set working directory correctly.

- Add the 'run_drydock' make target to the omni test so that
  the Dockerfile image build is gated

Change-Id: I4c3ee7fd3acb037940e17997b47fff94e0e7fc6f
2018-09-14 11:45:09 -05:00
Scott Hussey 0f39a55942 Refactor build to include Go
Adding the baclient code to Drydock requires a refactor
of the build automation to support multiple languages
and multiple artifacts included in a single Docker image

NOTE: the go source here is a placeholder 'hello world' sample

Change-Id: I1b4883f018b33b3d4fcd7cbcb6cba660fcdc93de
2018-09-04 13:13:21 -05:00
Scott Hussey 812cef9335 (zuul) Improve image building
Improve image building to get closer to
support zuul package mirrors

Change-Id: I57285b242ddc50e8e902ad2820982a2d4b351bc3
2018-08-10 21:09:50 +00:00
Scott Hussey e27eaf94f5 (zuul) Consolidate tests
- Consolidate tests to minimize Zuul node consumption
- Remove WS linting as content-specific lints should catch
  this if it is valuable

Change-Id: I18065027644b8412d88219a40d490c12d558969b
2018-07-20 08:52:44 -05:00
Scott Hussey a577164443 (zuul) Enable docker image jobs
- Check/gate jobs to build docker image
- Post job to publish image to quay.io

Change-Id: I44b813a5bd38965208affcee12709e097d3d1665
2018-06-08 05:15:05 -05:00
Scott Hussey 20873ad4f9 Update docs for developer overview
- New diagrams and documents for developer overview
- Update conf.py for docs to work w/ readthedocs.io
- Add policy and config gen to `make docs`
- Update zuul-linter to support checked in images
- Last fix to document publishing

Change-Id: I4faa1b87032ae5b0e786aa0fd998f809124b7987
2018-06-01 14:50:05 -05:00
Scott Hussey c85e6ad668 Fix playbook to provide logs
Change-Id: I5d670634c8be5e5f577f5b5a5b69e5f6c681c351
2018-05-31 09:12:03 -05:00
Scott Hussey fec2ecfb80 More logs on doc publish
Change-Id: I36e162f4e5535bb20ecb616fcdcd5b604daf87a0
2018-05-30 16:58:52 -05:00
Scott Hussey e594ca7935 [Fix] Fix post-merge doc publish job
- Add secret attachment to the job

Change-Id: I21b7e83abc3a457e88e888be3609bb78cec23cb2
2018-05-30 15:42:56 -05:00
Scott Hussey 5ee84cc622 Log on doc publish job
- Allow logs on publish job to understand failure. Credentials
  will be promptly changed.

Change-Id: I3d9f2fb260f93269db4b26ec3a27b77a577da8bb
2018-05-30 15:07:07 -05:00
Scott Hussey 708fedf70e Documentation gating
- Add gate for doc build per change and on merge
- Add automation for document publishing

Change-Id: If82ce4c97da5f2c47ba5de050b8f3982bd08d30b
2018-05-29 15:48:36 -05:00
Scott Hussey 53f6ccbfb7 Clean up gates
- Remove OSH-based gate as it is not relevant at this point
- Add entries for unit testing, linting and security scans
- Some trivial changes to trigger all gates

Change-Id: Icb2731573b45f3824cde8cb44ef64e9d04c017bc
2018-05-25 16:36:45 -05:00
Scott Hussey dbad75775b Libvirt OOB driver
- Create a driver to support OOB actions via libvirt API
- Update Makefile with external dependency target
- Update Makefile and tooling to support new chart pipeline
   - Add 'drydock' make target for chart building
   - Add step to install helm binary

Change-Id: I8a3984d8fd70f99a82a954b7a869eab8e30145b4
2018-05-25 11:13:53 -05:00