Commit Graph

42 Commits

Author SHA1 Message Date
Ghanshyam Mann a606c60efc Retire Tripleo: remove repo content
TripleO project is retiring
- https://review.opendev.org/c/openstack/governance/+/905145

this commit remove the content of this project repo

Depends-On: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/910044
Depends-On: https://review.opendev.org/c/openstack/neutron/+/910099

Change-Id: I338ed19678cf4a6248c46551bdf9cb23abc511bd
2024-02-24 20:22:39 +00:00
Amol Kahat 63a0dbc3fc Use release file for C8 images
This change implements similar solution to another,
implemented for C9: I39fc32cf1249b4f14bdc35a4af7a1f8784c19801

Testproject: https://review.rdoproject.org/r/c/testproject/+/38921

Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart/+/827544

Change-Id: I4c47797c5b656af9e42b2401201b885380a29039
Co-Authored-By: Dariusz Smigiel <dsmigiel@redhat.com>
Signed-off-by: Amol Kahat <amolkahat@gmail.com>
2022-02-03 07:52:16 +00:00
Marios Andreou 2c2cf59209 Re-run repo-setup in image/container run plays after pre mirror setup
In RDO jobs the mirror-info-fork is included after the repo-setup
role. This means we don't have NODEPOOL_CENTOS_MIRROR available
in /etc/ci/mirror_info.sh and we use mirror.stream.centos.org
which is proving unreliable eg 404 for 9-stream/AppStream [1].

This patch re-runs the repo-setup role in the run plays for
containers and image builds. The mirror-info-fork is run in pre so
this way NODEPOOL_CENTOS_MIRROR is available when we do repo-setup
e.g. mirror used at [2]

[1] https://logserver.rdoproject.org/67/36267/36/check/periodic-tripleo-ci-build-containers-centos-9-push-master/575a6f3/logs/container-builds/c9967fc5-5f3b-4c06-b93b-eff2cd775c84/base/os/manila-base/manila-base-build.log
[2] https://logserver.rdoproject.org/17/36817/13/check/periodic-tripleo-centos-9-buildimage-overcloud-hardened-uefi-full-master/d4e06e9/yum.repos.d/quickstart-centos-appstreams.repo

Co-Authored-By: Douglas Viroel <viroel@gmail.com>
Change-Id: Ibb5617c84b7a31a320aebecc82d980ba8e9751b6
2021-12-08 11:13:25 +02:00
Marios Andreou bc27851617 Use repo-setup role and tripleo-quickstart config for C9 images
Adds a new role tripleo-build-jobs-repos that is used by
container and image build pre playbooks to setup repos with
the repo-setup role for Centos9.

Depends-On 817161 modifies the release files to use the c9 stream
repos and carries workaround until a better fix is merged like [1]
or similar.

[1] https://review.opendev.org/c/opendev/base-jobs/+/820018
Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart/+/817161

Change-Id: I39fc32cf1249b4f14bdc35a4af7a1f8784c19801
2021-12-03 09:28:16 +02:00
Ronelle Landy dd077fbaaf Exclude libvirt/qemu from AppStream: container
libvirt/qemu are rebased to newer version in
AppStream repo than advanced-virtualization, and
likely due to that jobs started failing. Somehow
jobs are passing in releases before wallaby even
with newver version.

This patch is a temporary fix to
exclude libvirt/qemu from AppStream repo.

Change-Id: Iac4425d655df2f519f5b467e3754dad08ac9b1f5
Related-Bug: #1950916
2021-11-16 21:47:37 -05:00
Chandan Kumar (raukadah) 8f3daa94ec [CS9] Drop container-tools:latest
https://gitlab.com/redhat/centos-stream/release-engineering/pungi-centos/-/merge_requests/176
drops the container-tools module stream from cs9 and
uses non-modular repo to install podman.

It removes the reference of container-tools:latest for the same.

Related-Bug: #1949456

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: I031e69780c3734d35b76f6fc552ec3cb655eb9a1
2021-11-02 16:16:25 +05:30
Ronelle Landy 23b0638641 Added support for CentOS stream 9 container build
In order to build openstack containers on centos stream 9,
build-containers role and playbooks has went through following
changes.
* Make sure /etc/nodepool dir exists in pre
* Moved all required repos config in pre9.yaml to avoid multiple
  failure in main container build inline.
* Added support for unqualified-search-registries
* Added support for passing tcib_extra[1] vars needed for EL9
* use container-tools:latest for c9
* Use tripleo yum config module to generate the tripleo-repos via
  compose_url and compose_id.

[1]. https://review.opendev.org/c/openstack/python-tripleoclient/+/807098

Signed-off-by: Ronelle Landy <rlandy@redhat.com>
CoAuthored-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Ic3923fd02875b02adbc0fdf46dace180685e76ef
2021-10-11 13:11:45 +05:30
Ronelle Landy 9d5ff817ea Enable supported container-tools before login
Container-tools module needs to be set before
the podman login step.
Going forward, this should be done with tripleo-repos.

This review also removes unnused container stein
jobs from check and gate.

Closes-Bug: #1942078
Change-Id: I448a8d6d2dad94cb413a8f82adb85867c043f5b7
2021-08-31 15:01:45 -04:00
Sorin Sbarnea a3c9dc40e4 Fixed yamlint violations
Change-Id: I7468ef9929cd6a7c0969bcd6befb320bfd671097
2021-02-10 15:24:59 +00:00
Chandan Kumar (raukadah) 0feb5c3c74 Added CentOS-7 queens/train content provider job
* Collect the logs of container workspace
* tripleo-ansible will be automatically installed by
  python-tripleoclient package.
* Set tripleo_common_path for packages.
* Make sure docker service is running and docker user
  and group exists
* Added insecure registeries
* serve quickstart-centos repos on http server
* set container_cli_opts only when use_buildah is used.


Depends-On: https://review.opendev.org/#/c/752419/

Change-Id: Ia3c09a33ca92ed68cbaa3baf5f37ad61751a8a89
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-10-20 01:43:53 +00:00
Sagi Shnaidman 393b2d7502 Fail job if it's configured by parameter
There should be an option to force job failure when running it
in reproducer to leave the node by Zuul autohold.
See also I0b984b3b166fae2a742b41c0152afe64a94e03d1

Change-Id: I388c17e0a61d4c53a4222510b86b41f645705d21
2020-09-03 16:18:53 +03:00
Sagi Shnaidman 47e66205c0 Don't fail on EPEL disable if not exists
If EPEL repos don't exist the task will fail.
Ignore errors if repos don't exist.
Change-Id: I3d75734031bc8f1f6f44a671e71ae0b4f6769f0d
2020-07-08 10:30:12 +03:00
Sagi Shnaidman 9ee316cecf Disable EPEL repositories for build jobs
Closes-Bug: #1885315
Change-Id: Ia51c56856568c8ac01f7a49faecdce29f4fa837b
2020-06-29 16:34:45 +03:00
Sorin Sbarnea 8ce78d3a18 Bumped and hardened linting
- Fixes one bashate problem
- Updates linters
- Addressed most of the skip_list exclusions and removed them

Assure the `pre-commit run -a` is always run on all files instead
of old behavior which allowed linting to be broken when merging.

Bumping operation is mostly automated, we just need to run:
`pre-commit autoupdate` from time to time and fix eventual issues.

Change-Id: If75a3e49a9d570e744063ea35ea41919261ad876
2019-06-26 12:31:29 +01:00
Gabriele Cerami 45b57eb67c build containers: multiple platfrom support
- rearrange container build job and parenting so we can fit different
parameters for different distribution
- Explicitly upgrade python decorator module for platform that already
have it installed (pip ansible module doesnt' update)
- Parametrize some hard coded values
- ansible_distribution for kolla base does not work with all
distribution

Task: https://tree.taiga.io/project/tripleo-ci-board/task/994
Change-Id: I4c6c6effc9572b07c341d0cfaf452845835aeaeb
2019-05-15 15:05:26 +01:00
OpenDev Sysadmins 8a21afc7ce OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:29:30 +00:00
yatin e863d0c086 Convert tripleo-buildcontainers to a role
Needs to be done so it can be reused in different
repos like [1], [2].

[1] https://review.rdoproject.org/r/#/c/20144/
[2] https://review.rdoproject.org/r/#/c/20031/

Also use seperate venv for build-containers as venv
created by tripleo-repos role uses become: true.

Change-Id: Ia627b7e128608a5897f9607aca831380278cd785
2019-04-15 19:11:26 +05:30
Alex Schultz ee784f6a31 Make config file optional for container builds
Change-Id: I98625ab9a01adf111e3754f34d389221e681db44
Depends-On: https://review.openstack.org/#/c/639847/
2019-03-29 17:09:24 -06:00
Zuul 6ce9e25870 Merge "Collect containers file in build job" 2019-03-28 19:40:54 +00:00
Sagi Shnaidman 373bb47c80 Collect containers file in build job
Change-Id: I29b213fd77cccad395ab53b301e84a5c3659d535
2019-03-28 14:06:58 +00:00
Sagi Shnaidman e7317c7a58 Rocky containers branchfull job
As tripleo-ci repo is branchless and has only master, we need
a rocky containers job that will run on this repo and will check
that we don't break anything for rocky containers building.
Breaking this job will affect periodic promotion because we started
to use this job for containers building in promotions.

Depends-On: https://review.openstack.org/#/c/648358
Change-Id: I8a1c69a9ab1de6992eb52b76862cacacaf265896
2019-03-28 09:56:38 +00:00
Zuul 7b132dc072 Merge "Collect yum/dnf configuration on build-containers" 2019-03-27 01:30:46 +00:00
Marios Andreou 63c8791d20 Change branch calculation for tripleo jobs
In [1] we added temporary excludes with sed for rocky container build
This changes release calculation for all jobs that use tripleo-repos
role.
First priority - release of periodic jobs, then goes branch override
of branchless jobs and only then the default zuul.branch.

[1] https://review.openstack.org/644932

Change-Id: I00125923c0dfbfb3b7ebfb09ee633268697ae40d
2019-03-26 16:06:53 +00:00
Sorin Sbarnea 822f5d10ca Collect yum/dnf configuration on build-containers
Previous code was not collecting the yum/dnf configuration which
made impossible to debug issues specific to these files.

Change-Id: I6c0f7befc75ab573b7f0e936c0ffc85fa151b411
2019-03-26 15:58:12 +00:00
Zuul 92b2ac6fdd Merge "Enable debug mode for containers build" 2019-03-25 21:17:49 +00:00
Zuul d5faea64ae Merge "Remove retag tripleo-ci-testing for periodic containers build job" 2019-03-22 17:15:09 +00:00
Marios Andreou d44b16a12e Remove retag tripleo-ci-testing for periodic containers build job
As described in the bug the retag added at [1] isn't working.

However we are correctly pushing with the tripleo-ci-testing delorean
repo hash and that should be sufficient for the periodic jobs that
consume containers built by this job.

This removes the retag logic altogether and also removes the
push_tag variable. A related review in [2] also removes it in the
periodic jobs that were using this variable (no one else does/was)

Related-Bug: 1819583
[1] https://review.openstack.org/641348
[2] https://review.rdoproject.org/r/19484
Change-Id: I42f8e05bf1e5be230acdb7be16b056c8aff117f2
2019-03-22 13:15:22 +02:00
Marios Andreou 92384cd10d Adds conditional skip excludes in containers build for rocky
The excludes list is needed for f28 containers build. For the
rocky periodic we need to skip it as there is no such parameter
in the container build there.

Instead uses sed to remove excludes from containers list.
Once we cherrypick that [1] we can remove sed and use --excludes.

Test runs in [2]

[1] https://review.openstack.org/#/q/topic:cherrypick-excludes-containers-build
[2] https://review.rdoproject.org/r/#/c/19533/
Co-Authored-By: Sagi Shnaidman <sshnaidm@redhat.com>
Change-Id: I668a8557165972324e11707c2f3f32199658b6b9
2019-03-21 15:36:07 +00:00
Zuul dd0415df01 Merge "Fail container job if command failed" 2019-03-20 19:06:00 +00:00
Sagi Shnaidman 784f6c5286 Fail container job if command failed
When script fails, the job continues and passes.  Remove
unnecessary code saving and let the task to fail.
Make script to be generated for easier investigation what
command was running.
Change-Id: I1edce370458769a1479ee568b745e78ddcef693a
2019-03-20 13:23:06 +02:00
Marios Andreou 91d075a34d Fix namespace for containers build job - needed for rocky
This is currently hardcoded to tripleomaster but we need it to be
tripleorocky for the new job added in [1] (not wired up yet)

[1] https://review.rdoproject.org/r/19452

Change-Id: I123bf07d7bc02bd81b6dd91d63faf5b014d5e132
2019-03-20 11:30:15 +02:00
Rafael Folco ff80737012 Enable debug mode for containers build
DEBUG messages for capturing trace on errors when building
containers with kolla.

Change-Id: I78248cc0069235d69ad7352d05f6fe3514b40c70
2019-03-14 13:51:42 +00:00
Rafael Folco 7c8d723304 Add timestamp to containers' build log
In order to ease investigation of failures for containers build,
add timestamp to stdout and stderr log files.

Change-Id: I59198457044326193593948ed8c780e24ccebbc4
2019-03-12 07:21:06 -03:00
Marios Andreou 0f61e33f01 Adds retag with version hash for periodic container builds
For the periodic jobs once we build containers and push to rdo
registry we also need to tag the images with the delorean repo
hash

This switches the current tagging so we instead tag during build
using the version-hash and then tag with tripleo-ci-testing
when its periodic

Testing at https://review.rdoproject.org/r/#/c/19131/

Change-Id: I727e748eee641e12cede74773497dce49fcb317c
2019-03-07 11:40:50 +00:00
Rafael Folco 126eb6381f Add py3/f28 support to tripleo-container-build-base
Enable Fedora 28 and Python3 support on tripleo-buildcontainers
playbook and on tripleo-repos role.

Centos-7 job would run upstream and its fedora-28 counterpart would
be run on RDO and be non voting

Uses: https://review.openstack.org/637212
User-Story: https://tree.taiga.io/project/tripleo-ci-board/us/650
Change-Id: Ie46d0d7fa7c41427bb44bcfad5cf59af745ac627
Co-Authored-By: Sorin Sbarnea <ssbarnea@redhat.com>
2019-03-01 17:37:51 +00:00
Marios Andreou d427ed641d Add override_repos into tripleo-ci tripleo-repos role
The tripleo-repos role in tripleo-ci defaults to current-tripleo
for master and current for everything else. There is no support
for the tripleo-ci-testing repo.

This adds 2 params: i) override_repos as a param
to tripleo-ci tripleo-repos and ii) buildcontainers_override_repos
as a param in the tripleo-buildcontainers job. ii) is passed from
periodic version of buildcontainers in [1] and is then used to
set the value of override_repos, passed into ci tripleo-repos.

The depends-on adds tripleo-ci-testing as an option for
tripleo-repos itself as it is currently unsupported.
Tracked by tripleo ci squad with [2]. See test review at [3] which
runs the periodic container build in check with this code.

Also adds /etc/yum.repos.d/ into collected buildcontainer logs.

[1] https://review.rdoproject.org/r/18975
[2] https://tree.taiga.io/project/tripleo-ci-board/task/773
[3] https://review.rdoproject.org/r/19000
Depends-On: https://review.openstack.org/638651 # tripleo-repos
Change-Id: I37bc90881ef19ae4aeace65750da4dd93da5f4e2
2019-02-28 10:28:42 +00:00
Emilien Macchi 0079e9496f Create a new container build job with Buildah on centos7
This job will run in Stein and beyond, where we replace Docker by
Buildah to build images.

blueprint podman-support
Depends-On: I7608136cb213bdca81348a0c3c751b488f48d712
Change-Id: Ia43d96326fdcc9629696c972df1cf677cd69c87f
2019-02-28 00:13:39 +00:00
Emilien Macchi 33f0539043 kolla-build: remove quotes in namespace config
We don't want quotes in inifile.

Change-Id: I2cb8aac75314d1babcec319836aa79313270b679
2019-02-21 08:26:17 -05:00
Marios Andreou 1d76bb1ecb Parameterize build-containers job to allow push to registry
As tracked by ci team in [1] the current periodic container
build job is very different to the upstream job
tripleo-build-containers-centos-7. In order to re-use this
upstream job as part of the periodic, we need to parameterize
it so we can push to the rdo registry and containers have the
right tags (when periodic container build & push).

This review leaves the upstream job unchanged with parameters
defaulting to their current value. The periodic job defined
in [2] inherits from this job and will handle secrets/login
and passing the right values for registry/tag.

[1] https://tree.taiga.io/project/tripleo-ci-board/us/652
[2] https://review.rdoproject.org/r/#/c/18729
Change-Id: Idf1f5a696a5163bd54cb000aed09daf00d51400b
2019-02-15 10:50:08 +02:00
Alex Schultz 21c4f37fd7 Fix repo configuration
The wrong parameter name was used for the repo configuration.
It should have been rpm_setup_config not rpm_setup. Additionally the
iptables rules did not allow for the containers to fetch the repos from
the CI host. This change lets docker manage the docker iptables rules
and adds a rule to allow port 80 from the docker container ip range.

Depends-On: https://review.openstack.org/#/c/634064/
Change-Id: I037465f7bbc7b6016373385f07c7c944a09299c9
Closes-Bug: #1813527
2019-02-12 14:43:56 +00:00
Alex Schultz c1327819bb Remove duplicated tasks from build jobs
https://review.openstack.org/#/c/607288/ shuffled some basic setup tasks
around and put them in tripleo-ci/pre.yaml. Unfortunately the
configure-swap task isn't idempotent so let's stop duplicating the tasks
in the build jobs now.

Change-Id: I046aeea86b3b63cae0b44865dc8ee0a59a3f7f5f
Closes-Bug: #1810777
2019-01-07 07:32:20 -07:00
Alex Schultz 73d40aec70 TripleO Container build CI job
We don't currently have coverage for the container build process in CI,
let's add some.

Depends-On: https://review.openstack.org/#/c/616022/
Change-Id: I97ceb9533a38ec7b175623784649de277aaf4274
2018-11-06 22:51:05 +00:00