Commit Graph

207 Commits

Author SHA1 Message Date
Ghanshyam Mann a606c60efc Retire Tripleo: remove repo content
TripleO project is retiring
- https://review.opendev.org/c/openstack/governance/+/905145

this commit remove the content of this project repo

Depends-On: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/910044
Depends-On: https://review.opendev.org/c/openstack/neutron/+/910099

Change-Id: I338ed19678cf4a6248c46551bdf9cb23abc511bd
2024-02-24 20:22:39 +00:00
Sofer Athlan-Guyot 9e7cf30337 Add content provider using current tag to build containers for minor update
Add content provider job, which builds containers using `current` dlrn
tag on same release branch as regular content-provider job.

Apart from new content provider job, the change adds new variable called
`minor_update`, which enables to consume containers created by new
content provider job in depended multinode-oooq-container-updates job.

minor_update variable is used in featureset068.
The featureset is activated in jobs for wallaby branch and onwards.
Train job uses featureset038 as previously.

Related-Bug: #2015993
Change-Id: I7a7713be0cd15321d5b16f6b8ca85f06d296219f
2023-06-22 15:03:51 +02:00
Sandeep Yadav e732f1fa2b Correct indentation in run-v3.yaml
ansible-lint is complaining about wrong indentation[1],
correcting indentation with this patch.

[1] https://e76b8a042504872b0b7d-f18cd0734c7002742f0baf633d0573f2.ssl.cf1.rackcdn.com/865240/2/gate/openstack-tox-linters/5480d23/tox/linters/4-commands%5B0%5D.log

Related-Bug: #2002526
Change-Id: I2d68592aa1c840acc483ba29a48494bb0dabc3be
2023-01-11 17:47:01 +05:30
Marios Andreou 666d733213 Fix gating repo for mixed OS content providers
This is not taking into account the mixed OS job where we
need to use registry_ip_address_distro instead of
registry_ip_address_branch.

The _branch is still default, and we override with _distro when
it is in use (i.e. when it has more than one key). The current
code causes related-bug because we end up trying to install
tripleoclient from the *8* content provider for the *9*
undercloud.

Related-Bug: 1983004
Change-Id: Ic77a58ce04153d9ee70772284a13fe1c37d9350f
2022-07-29 16:45:13 +03:00
Marios Andreou 6a73e5550e Add new multinode-mixed-os job and required content provider changes
Includes changes to pass the registry_distro var through to the toci
playbook executions. Also adds the registry_ip_address_distro and
_hash_distro into the content provider return data for use by the
mixed-os-job. See topic at [1] for related reviews.

The new job is in the tripleo-multinode-container-minimal-pipeline
layout so it will run across the tripleo repos (wallaby only).

[1] https://review.opendev.org/q/topic:oooci_mixed_rhel

Change-Id: I1690fbece3ef8d40cef01ef0d10f5f5edbfe2747
2022-07-25 12:01:31 +03:00
Marios Andreou efbc9522ba Revert "Adds tripleo-repos/-operator-ansible collection push jobs"
This reverts commit 74be796580.
We are seeing a strange zuul error at [1] but since we ended up
not using this we should just remove it. We are consuming the
get-hash from source instead of from galaxy [2]

[1] https://review.opendev.org/c/openstack/tripleo-ci/+/839518/8#message-23c7677c86b0457399ecc41e41ff97834a3f361b
[2] 1b31dbca29/roles/tripleo-build-jobs-repos/tasks/main.yaml (L25)

Change-Id: I915796ef3d42eb0c60c5184e91e1f87f429f8dfe
2022-05-10 10:55:22 +03:00
Zuul b479f7022a Merge "Move 'setup-compose-repos' pre playbook to base jobs" 2022-03-15 20:50:33 +00:00
Chandan Kumar (raukadah) c7291b48ce Added tripleo-ci-post ansible role
playbooks/tripleo-ci/post-artifact-mult.yml and
playbooks/tripleo-ci/post-artifact-sa.yml are used in post-run
to collect zuul artifacts.

Both are defined in multinode and standalone CentOS 8 base jobs.

While doing Zuul job reparenting, We found that It cannot be used
in different jobs defined in downstream or RDO. As zuul looks for
playbook in the project where zuul jobs are defined.

In order to reuse it in downstream and RDO, we are converting it
into role and call it in starting as a part of post.yaml playbook.

It also removes it from post-run.

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Ibae7eaa6e6e91c88ac233c8fd52550e89bf2defc
2022-03-08 21:44:51 +05:30
Douglas Viroel b4506daf62 Move 'setup-compose-repos' pre playbook to base jobs
This patch moves setup-compose-repos.yml playbook[1] to tripleo-ci repo
to be used on its base jobs.
This playbook is responsible for configuring and enabling CentOS compose
repos based on a provided compose URL.
It has no effect if 'dependency' var is not set to 'compose-repos'.
'centos_compose_url', if omitted, will be set by default to the latest
CentOS compose (for Stream 8 or 9).
With this change, the playbook can be deleted from previous repo.
The playbook is renamed to centos-compose-repos.yml

[1] https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/dependency/setup-compose-repos.yml

Change-Id: I09cf2d74638f9c056e62fdaaa2ff41047fce925d
Signed-off-by: Douglas Viroel <dviroel@redhat.com>
2022-03-07 11:29:54 +00:00
Amol Kahat 63a0dbc3fc Use release file for C8 images
This change implements similar solution to another,
implemented for C9: I39fc32cf1249b4f14bdc35a4af7a1f8784c19801

Testproject: https://review.rdoproject.org/r/c/testproject/+/38921

Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart/+/827544

Change-Id: I4c47797c5b656af9e42b2401201b885380a29039
Co-Authored-By: Dariusz Smigiel <dsmigiel@redhat.com>
Signed-off-by: Amol Kahat <amolkahat@gmail.com>
2022-02-03 07:52:16 +00:00
Sagi Shnaidman cfbbcc8b36 Add zuul artifacts for SA logs
Show link to log files in Zuul Artifacts tab

Change-Id: Iabaf5da054ab13988907bc69b9dbd3b5338cbcfd
2022-01-31 18:07:48 +02:00
Marios Andreou 2c2cf59209 Re-run repo-setup in image/container run plays after pre mirror setup
In RDO jobs the mirror-info-fork is included after the repo-setup
role. This means we don't have NODEPOOL_CENTOS_MIRROR available
in /etc/ci/mirror_info.sh and we use mirror.stream.centos.org
which is proving unreliable eg 404 for 9-stream/AppStream [1].

This patch re-runs the repo-setup role in the run plays for
containers and image builds. The mirror-info-fork is run in pre so
this way NODEPOOL_CENTOS_MIRROR is available when we do repo-setup
e.g. mirror used at [2]

[1] https://logserver.rdoproject.org/67/36267/36/check/periodic-tripleo-ci-build-containers-centos-9-push-master/575a6f3/logs/container-builds/c9967fc5-5f3b-4c06-b93b-eff2cd775c84/base/os/manila-base/manila-base-build.log
[2] https://logserver.rdoproject.org/17/36817/13/check/periodic-tripleo-centos-9-buildimage-overcloud-hardened-uefi-full-master/d4e06e9/yum.repos.d/quickstart-centos-appstreams.repo

Co-Authored-By: Douglas Viroel <viroel@gmail.com>
Change-Id: Ibb5617c84b7a31a320aebecc82d980ba8e9751b6
2021-12-08 11:13:25 +02:00
Marios Andreou bc27851617 Use repo-setup role and tripleo-quickstart config for C9 images
Adds a new role tripleo-build-jobs-repos that is used by
container and image build pre playbooks to setup repos with
the repo-setup role for Centos9.

Depends-On 817161 modifies the release files to use the c9 stream
repos and carries workaround until a better fix is merged like [1]
or similar.

[1] https://review.opendev.org/c/opendev/base-jobs/+/820018
Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart/+/817161

Change-Id: I39fc32cf1249b4f14bdc35a4af7a1f8784c19801
2021-12-03 09:28:16 +02:00
Marios Andreou 071b58ce23 Move tripleo-ci common role to ci-common-vars due to name clash
In [1] we are wiring up a role from the tripleo-quickstart repo.
There is already a 'common' role in t-q. Because of the name
clash we can rename the tripleo-ci common role.

[1] https://review.opendev.org/c/openstack/tripleo-ci/+/818222

Change-Id: I2bf7cebcefc19888058e368783a77ff8b524c998
2021-11-26 14:53:24 +02:00
Zuul 3eb74a2ab2 Merge "Wire up centos9 master buildimage jobs for check and gate" 2021-11-17 15:23:33 +00:00
Ronelle Landy dd077fbaaf Exclude libvirt/qemu from AppStream: container
libvirt/qemu are rebased to newer version in
AppStream repo than advanced-virtualization, and
likely due to that jobs started failing. Somehow
jobs are passing in releases before wallaby even
with newver version.

This patch is a temporary fix to
exclude libvirt/qemu from AppStream repo.

Change-Id: Iac4425d655df2f519f5b467e3754dad08ac9b1f5
Related-Bug: #1950916
2021-11-16 21:47:37 -05:00
Marios Andreou 9942c04a5f Wire up centos9 master buildimage jobs for check and gate
The job definitions are added at [1] and the new
single-centos-9-node nodeset is added in the parent at [2]

Also fixes issue with the 'release' var which is not present
in the check/gate version of these jobs so we try to discover
it using the relevant build-containers tasks.

This also disables the image_sanity check for overcloud-full
because of related-bug.

Finally adds wallaby to the branches negative match for c9
build jobs as we aren't ready for W yet.

Related-Bug: 1950453

[1] https://review.opendev.org/c/openstack/tripleo-ci/+/813618
[2] https://review.opendev.org/c/openstack/tripleo-ci/+/816821

Change-Id: I5c78c975afa3efb2c478339cacd006e064b24e71
2021-11-12 13:28:02 +02:00
Chandan Kumar (raukadah) 8f3daa94ec [CS9] Drop container-tools:latest
https://gitlab.com/redhat/centos-stream/release-engineering/pungi-centos/-/merge_requests/176
drops the container-tools module stream from cs9 and
uses non-modular repo to install podman.

It removes the reference of container-tools:latest for the same.

Related-Bug: #1949456

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: I031e69780c3734d35b76f6fc552ec3cb655eb9a1
2021-11-02 16:16:25 +05:30
Chandan Kumar (raukadah) 86274966bf Adding support for CentOS Stream 9 overcloud image builds
Depends-On: https://review.opendev.org/c/openstack/diskimage-builder/+/806819
Co-Authored-By: Marios Andreou <marios@redhat.com>

Change-Id: Icd6416d8b13c436bfd9623d49a83871c6edc9188
2021-10-19 12:11:55 +03:00
Zuul 5e294fc097 Merge "Added support for CentOS stream 9 container build" 2021-10-12 15:57:36 +00:00
Marios Andreou 74be796580 Adds tripleo-repos/-operator-ansible collection push jobs
In [1] a release job was added for tripleo-operator. Now we need
to add the same for the tripleo-repos collection. This proposes
we move the playbook, secret and job definition to here so that
both jobs can share them. Then the jobs can be wired up into their
respective repo zuul layout files.

Once we are happy with testing (this needs to merge so we can test)
we can merge [2] and remove the duplication in t-o-a.

[1] https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/803588
[2] https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/810259
Change-Id: I09b24c4782db2e7cad117fb98a70a1c3d36a4301
2021-10-11 10:08:49 +00:00
Ronelle Landy 23b0638641 Added support for CentOS stream 9 container build
In order to build openstack containers on centos stream 9,
build-containers role and playbooks has went through following
changes.
* Make sure /etc/nodepool dir exists in pre
* Moved all required repos config in pre9.yaml to avoid multiple
  failure in main container build inline.
* Added support for unqualified-search-registries
* Added support for passing tcib_extra[1] vars needed for EL9
* use container-tools:latest for c9
* Use tripleo yum config module to generate the tripleo-repos via
  compose_url and compose_id.

[1]. https://review.opendev.org/c/openstack/python-tripleoclient/+/807098

Signed-off-by: Ronelle Landy <rlandy@redhat.com>
CoAuthored-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Ic3923fd02875b02adbc0fdf46dace180685e76ef
2021-10-11 13:11:45 +05:30
Ronelle Landy 9d5ff817ea Enable supported container-tools before login
Container-tools module needs to be set before
the podman login step.
Going forward, this should be done with tripleo-repos.

This review also removes unnused container stein
jobs from check and gate.

Closes-Bug: #1942078
Change-Id: I448a8d6d2dad94cb413a8f82adb85867c043f5b7
2021-08-31 15:01:45 -04:00
tushargite96 e4c60d9bc3 Moving IRC network reference to OFTC
Change-Id: Ic41af5bd953152712d6cf92b265b7a480dba118b
2021-07-17 12:27:41 +05:30
Wes Hayutin d05916c71d Add code comments on why content-provider check
Add code comments on why content-provider check
can fail.  The context was not clear to me, so
a little code comment may help others.

Related-Bug: #1918320
Change-Id: I9ba4c22544f0ddd1efb4a798d75ac133bfbb846d
2021-03-10 17:37:51 +00:00
Zuul aa130ec67c Merge "Fixed yamlint violations" 2021-02-17 16:26:16 +00:00
Zuul 5e3f39ba97 Merge "Upgrade linters" 2021-02-17 16:26:02 +00:00
Sorin Sbarnea a3c9dc40e4 Fixed yamlint violations
Change-Id: I7468ef9929cd6a7c0969bcd6befb320bfd671097
2021-02-10 15:24:59 +00:00
Sorin Sbarnea aa581590b3 Upgrade linters
Change-Id: Ie9a560a62a20b97b9a94968e627c834ea5529472
2021-02-10 15:04:16 +00:00
yatinkarel 3b38789799 Fix conditions for Executing build-report
These tasks were still running for centos7 based
build-containers and provider jobs, this patch fixes
the conditions for use_kolla to default to true like
it's other usage as default needs to be assumed same.
For provider job decide based on OS version to avoid
injecting additinal use_kolla var in provider jobs.

Change-Id: Iabaf3d0939ccf15694e3774c92883d6a30524b13
2021-02-10 13:03:16 +05:30
Amol Kahat 1809fd12de
Log directory workspace/logs do not exists.
When job fails in pre playbooks and goes to
logs collection, it fails because doesn't
find logs directory.

Closes-Bug: #1913077
Change-Id: I3140b910312ad35b550f69d05311d3ab79adfdb1
Signed-off-by: Amol Kahat <amolkahat@gmail.com>
2021-02-02 19:36:58 +05:30
Rafael Folco a70bdcd462 Enable html report for content provider jobs
Wire-up build-report post playbook on content provider jobs,
and use podman to check built images (buildah was inconsitent).

This change also advertises zuul artifacts using zuul_return and
change the build work dir to ansible user home.

Change-Id: Ie7c26c28e38035783ec1c5f87b3b6bdd6381376a
2020-12-29 09:29:42 -03:00
Wes Hayutin b573197039 toci- ensure the gating repo is release aware
The gating repo needs to be release aware.
This is REQUIRED for upgrade jobs where the release
changes during the course of the job.

This is also nice for transparency to ensure
the gating repo is set to the correct content-provider

related-review: https://review.opendev.org/c/763747
Please see the bug for more details

Partial-Bug: #1907122
Change-Id: I10d932e00f0639af8151f66f0751e48dae7b71ba
2020-12-08 11:51:39 +02:00
Marios Andreou b120a5e6e0 Remove the registry_ip_address variable from content providers
We should never use registry_ip_address var instead relying on
registry_ip_address_branch to avoid related-bug.

This removes registry_ip_address from returned zuul data and
updates the last few references to it.

For the install-built-repo pre-run play we can't rely on
release to determine the right ip_address_branch. This re-uses
logic from the build-containers role after moving it to its own
tasks file to prevent duplication.

Change-Id: Id594d301d18bc33753e56ef3b7519e36a396cd82
Related-Bug: 1904565
2020-12-03 12:37:59 +02:00
Sagi Shnaidman 462db675d2 Pass DLRN hash from provider with branch
Change-Id: I362276fb80281f291d0acbd0e605b93cc334a117
2020-10-22 03:54:40 +00:00
Zuul 2781d196ad Merge "Added CentOS-7 queens/train content provider job" 2020-10-21 22:37:24 +00:00
Chandan Kumar (raukadah) 0feb5c3c74 Added CentOS-7 queens/train content provider job
* Collect the logs of container workspace
* tripleo-ansible will be automatically installed by
  python-tripleoclient package.
* Set tripleo_common_path for packages.
* Make sure docker service is running and docker user
  and group exists
* Added insecure registeries
* serve quickstart-centos repos on http server
* set container_cli_opts only when use_buildah is used.


Depends-On: https://review.opendev.org/#/c/752419/

Change-Id: Ia3c09a33ca92ed68cbaa3baf5f37ad61751a8a89
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-10-20 01:43:53 +00:00
Sagi Shnaidman d6a8e9cddf Use always IPv4 for publishing in provider job
When we have ipv6 VMs in cloud, use private ipv4 address for
publishing in provider jobs. Infra guarantees all dependent jobs
will run on the same cloud, so they will have access to private
address of the same cloud.

Change-Id: If68dd7f506557a2e4389d3aa95959247bed50d9b
2020-10-19 17:11:00 +03:00
Sagi Shnaidman bcc7aa3790 Load dlrn tag from disk and return with Zuul
Depends-On: https://review.opendev.org/#/c/756670
Change-Id: Ic0a3928c393b5aee49afa9d7a46cb92bedce0833
2020-10-13 20:39:45 +03:00
Sagi Shnaidman 0ff91a0dd2 Pass branchful variables in provider
Add variables in branch inside the names. Upgrades job will use it
for detection target and deploy IP addresses and DLRN hashes.

Change-Id: I6aadd80a509135a0f860255c77e590818521f489
2020-10-09 14:10:58 +05:30
Sagi Shnaidman 75db84391e Pass dlrn hash from provider to consumers
In case promotion hash changed during the providers run, we pin
dlrn hash of provider and pass it to consumers to use it.

Change-Id: I0989b78edb2b4d424fd2a55336ba7048128ecb15
2020-10-06 21:26:42 +03:00
Sagi Shnaidman 393b2d7502 Fail job if it's configured by parameter
There should be an option to force job failure when running it
in reproducer to leave the node by Zuul autohold.
See also I0b984b3b166fae2a742b41c0152afe64a94e03d1

Change-Id: I388c17e0a61d4c53a4222510b86b41f645705d21
2020-09-03 16:18:53 +03:00
Sagi Shnaidman f360f4168f New CI job: configure a new standalone template
Provide the new template for a pipeline:
provider job builds containers and repository,
while consumer standalone jobs use this repository and containers
registry, without using docker.io or building package itself.

Depends-On: https://review.opendev.org/746719
Depends-On: https://review.opendev.org/748424

Fix for SA errors:
Depends-On: https://review.opendev.org/#/c/748360/

Change-Id: I52e0a425f8933c0fae99224aec842d4695e91362
2020-08-27 18:56:24 +03:00
Sagi Shnaidman 47e66205c0 Don't fail on EPEL disable if not exists
If EPEL repos don't exist the task will fail.
Ignore errors if repos don't exist.
Change-Id: I3d75734031bc8f1f6f44a671e71ae0b4f6769f0d
2020-07-08 10:30:12 +03:00
Sagi Shnaidman 2ac0c23b5e Revert "turn off NetworkManager in CentOS-8 TripleO"
This reverts commit 7dd82ca385.
Depends-On: https://review.opendev.org/#/c/738964/

Change-Id: I6554aaa610db9f260785917587b4c2870db34702
2020-07-02 09:58:09 +03:00
Wes Hayutin 7dd82ca385 turn off NetworkManager in CentOS-8 TripleO
NetworkManager is restarting unexpectedly during
deployments of TripleO. Ensure the service is
disabled prior to deployment

Partial-Bug: #1885286
Change-Id: I67501aaaf34c8fdfa09da37e0e0a3eb6982cff3a
2020-07-01 13:41:55 -06:00
Sagi Shnaidman 6f5b4ed3c7 Fix tmpfiles issue in tripleo build jobs
Ported from fix for periodic jobs because we have the same problem
in upstream: https://review.rdoproject.org/r/#/c/28041/
Change-Id: Iabb6b20e703c4680d2edeb0abad235a1190fe1e2
2020-06-29 17:07:40 +00:00
Sagi Shnaidman 9ee316cecf Disable EPEL repositories for build jobs
Closes-Bug: #1885315
Change-Id: Ia51c56856568c8ac01f7a49faecdce29f4fa837b
2020-06-29 16:34:45 +03:00
yatinkarel b24e471ec8 Fix usage of pip constraints in tripleo ci jobs
https://review.opendev.org/#/c/715427/ wrongly added
the pip constraints to be used in ci jobs, this patch fixes it.

Change-Id: I99117b02fb598a08f87fc46b4a4141207e2d5c20
2020-05-28 21:01:09 +00:00
Sagi Shnaidman 380e0e668d Add conditional job fail when logs collection failed
In usual jobs we don't fail jobs if logs collection failed, only
print the message. And that's totally fine, because job should
test TripleO and not logs collection.
But for repos like collect-logs role the logs collection
functionality is critical and when job pass in CI it's possible
that logs collection failed in the patch. Because logs are core
functionality in these repos we should fail the job if logs
collection failed on patch.
For that add variable fail_logs_collection that is false by
default and will be true only for jobs running on logs collection
repository.
In order not to reset whole gate and fail other patches, don't
fail jobs in gate because of logs collection.

Change-Id: I3a946d170c0cb90476e8b23ef0d619fd8d7fcae6
2020-04-24 18:56:35 +03:00