Commit Graph

62 Commits

Author SHA1 Message Date
Vladimir Kozhukalov 6537fe480e Add nodesets.yaml and stop using tmpfs for docker
Change-Id: I6fa07a45f491e7101f85cb90731611409a279719
2023-12-05 17:06:42 -06:00
Vladimir Kozhukalov ec70407d68 Build jammy images
Change-Id: I639588a618816f6ff70a7736963589977bb36eb1
2023-07-11 19:34:19 +03:00
Vladimir Kozhukalov 7c3c53c375 Add more info to the /etc/image_info
Change-Id: I956985410f55293c998e75c9fa8960e2b9106d45
2023-06-16 20:30:51 +03:00
Vladimir Kozhukalov e09a032257 Fix setup-gate.yaml playbook
- Use roles from zuul-jobs
- Unpin docker python package version. It used
  to be pinned to 2.7 and it is incompatible
  with the latest docker api.
- Also do not build Ubuntu Bionic images which
  by default use Ussuri release (not supported).

Change-Id: I958677e3df88028d00ac0df812c0030419d517a7
2023-06-15 19:58:47 +03:00
Sam Yaple 4ff506ae5c Remove PYTHON3
The python2 is long dead and the PYTHON3 flag has been noop for a while.

Change-Id: Ia7be53e84090cc8b80e1dd5753ba1460ff454851
Related-Id: I3f4f60756887ad07229cf522803b30d4e16463cd
2022-09-21 21:28:12 -04:00
Gage Hugo e77485f8b0 Bump centos version up to 9-stream
This change updates the version of centos that we currently
contain in the repository to 9-stream.

Change-Id: Ia4f4d6eaee6d9e272f5276ce961691fa980cd957
2022-08-02 11:40:36 -05:00
Gage Hugo 2537db07aa Refactor docker image task values
Due to an ansible upgrade, the docker_image tasks are currently
failing. This was due to a change in ansible, several values were
deprecated and moved/renamed.

This change modifies the docker_image task definitions to be
up-to-date with the latest ansible changes to fix the gate.

Change-Id: I653cd55256426f8fac3fce2fed460a14aa6b1d37
2022-07-25 15:58:03 +00:00
Mohammed Naser 9e7b71c304 Reduce build targets
OpenSUSE LEAP is currently not in use by any known downstream
users and it has been broken for quite sometime, leaving the gate
in a broken state and unable to land any code.  There's no active
maintainer for it as well.

Debian support was added by us (VEXXHOST) but we decided that
we're not going to continue using it and move towards Ubuntu, so
we do not want to maintain it, as well as that it is building images
for Train only.

It also updates the README file accordingly as well as includes
focal in there which has been recently added.

Change-Id: Ideb497c169828184d301b6be4359a7c2228aa444
2022-05-23 15:59:49 +00:00
Zuul 6e91f1e877 Merge "debian: stop building images" 2022-04-26 22:10:06 +00:00
Andrii Ostapenko 3eceae492d
Add required args for ussuri build
Change-Id: I7e02ef7a2f13b315b344dc84e7c51c91630a3352
Signed-off-by: Andrii Ostapenko <aostapenko@microsoft.com>
2022-04-26 14:20:37 -06:00
Mohammed Naser 08b559993b debian: stop building images
We were testing against an EOL'd release of Debian, no one seems
to have maintained it so we should drop the jobs here to avoid
breaking things.

Change-Id: I233dd497caeeb8a03077c44b87ffb77d64755613
2022-04-11 16:33:08 -04:00
Mohammed Naser dee49b0ed0 Disable centos-8 builds
CentOS 8 builds are failing because the distro is EOL and the mirrors
have been removed from upstream CI.

If any contributors want to pick up fixing it, they can do that but
we need this to unblock the gates.

Change-Id: Ifec4d2021e0a87a79fc212aa4613d43ead5acf67
2022-02-02 13:56:31 -05:00
Thiago Brito a52d700d86 Fixing job issues
- Missing nss-devel-3.53.1 pkg on centos
- Commenting out leap15 job until the mirror are updated to 15.3
- Commenting configurations related to not yet set debian mirror

Depends-On: https://review.opendev.org/c/openstack/watcher/+/823606
Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: Idee88bd7eac1994fa899b22ccd3c6676a643583b
2022-01-12 14:39:54 +00:00
Andrii Ostapenko a2a88b8ffb Make py3 default
Change-Id: Iaa3f707e48dec32aadc2f8849196990915e36451
2021-10-13 00:30:23 +00:00
Andrii Ostapenko a61c73e9b2
Update gates
* Use bionic for ussuri build as it's the latest supported
release [0][1].
* Switch to centos 8 to run master [1][2].
* Switch default base image to ubuntu:focal.

[0] https://governance.openstack.org/tc/reference/runtimes/ussuri.html
[1] https://governance.openstack.org/tc/reference/runtimes/victoria.html
[2] https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: I9a70aebd9636e170c6e04398356933668a2bfbba
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-10-12 18:30:09 -06:00
Andrii Ostapenko c19db02c6d
Fix setup_pip.sh and remove xenial based builds
Also fix monasca bindep.

Change-Id: I2b5b1a31165e98ce71380824e8f57af8906701c6
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-07-29 17:27:51 -06:00
Sam Morrison 8baeb8ecea Add focal base to dockerfiles
Change-Id: I2e57506e94d468e8c342814dad740b8a450aa23d
2021-04-15 20:05:06 +00:00
Andrii Ostapenko 3e5730cd53 Enable Debian gate build and fix mirrors related issues
Also fixes related issue with distutils installation for Debian Stretch
and Ubuntu Xenial with py3: unlike in Bionic, distutils is installed with
python3 and python3-distutils package is not available in these distributions.

Run Debian build with py3 against stable/train, as master requires at
least python3.6, not available for distribution out of box.

Also increases job timeout to 5400 due to increased amount of builds.

Change-Id: I04c9253af80d941afb45231bee20f7bb1c4a96d4
2021-02-16 14:33:04 +00:00
Andrii Ostapenko 5e3fa8dd2c
Fix gates
opendev luminous ceph mirror is no longer available for xenial ocata
build, thus using original location.
Setting locale to resolve salt installation failure for master.

Change-Id: I8b25d7ddf5432de65cfd814193e10afee516fd1a
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-12-10 12:07:58 -06:00
Mohammed Naser 409c784dc5 gate: fix repository url
The repository was changed by the OpenDev infrastructure in order to
properly mirror systems, this change reflects that modification.

Change-Id: I93ea021810568a7998c99958c622aacb3d39e908
2020-09-22 17:49:51 -04:00
Andrii Ostapenko d41750aa03 Fix image push
Change-Id: I5bb674f4ce5752d37cac74aed6f97fba21ba3e0d
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-03 15:37:25 +00:00
Andrii Ostapenko d910229ce9
Allow to specify eol release for project and fix gates
There's a need to keep building images from eol releases. This commit
introduces ability to specify eol release for project and clone to
{release}-eol instead of stable/{release}

Octavia moved to eol, using ocata-eol instead.

Also fixes gates providing ensure-pip role to executor.

Also pins openSUSE image to 15.1

Change-Id: I041033bb6c9cfe193c4bae9a0b6b4028f4602c5f
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-03 10:36:44 -05:00
Andrii Ostapenko 8ed58b10f6 Allow comments in dep files
Change-Id: I2d4c65268cec70c1d03ed1556c5ab5dbab94c398
2020-01-27 12:15:08 +00:00
Andrii Ostapenko d5ff58a973 Update dockerfiles and gates
Introduces image build for bionic with py3 and nautilus.
Switches centos to py3 and fixes related issues.
Xenial is now run with stable/ocata.

Adds ability to skip specific build for particular component specifying
"supported_releases" in zuul component configuration. Sets
supported_releases for placement not available for releases prior to
Stein.

Removes redundant parameters for project reference using defaults
instead, as they relate to loci project, not to project we build
with loci. Also hard-codes parameters in playbooks/vars.yaml, making
it a definitive build configuration.

Change-Id: I7290203d80461f46ed70d5e3bea55c9765f9e746
2020-01-20 19:37:55 -06:00
Jean-Philippe Evrard 086ace64e9 Move to opendev
Change-Id: I6706ee3f611b21a4d470c68fec4bf090dc6a4cc0
2019-04-24 16:44:58 +02:00
Jean-Philippe Evrard 982f601058 Add python3 testing
This ensures some python3 testing is done in our gating.
Leap 15 will mostly be python3 only, so it makes sense to test
python3 with Leap15.

Change-Id: I40661f49a13f60c91f6ac73479e4aa3927ec4f58
2019-03-28 15:12:32 +01:00
Chris Hoge 3f3a672d25 Make various spelling and usage fixes in Loci
This patch is an audit of the Loci documents and code for trivial
spelling and usage errors.

Change-Id: I64ee9d4eb5b299852c53ee9c6ab8e7d9b862ac73
2019-01-29 14:04:49 -08:00
Zuul 886620357f Merge "Add branching in LOCI" 2018-12-07 22:05:39 +00:00
Chris Hoge 1fe0468291 Remove async jobs to debug and possible async instability
Individual Loci gate jobs are failing about 1 out of 10 times.
Remove async to help debug and remove potential instability.

Change-Id: I3a3dbeebe4c5c928c21181500a7e07be4015b858
2018-11-07 14:00:39 -08:00
Chris Hoge d0ef425ef6 Clean up comment style and identify bugs and workarounds
Cleans up the comment style to remove author names and clarify
the comment as it relates to the code. Using the NOTE (NAME):
format is redundant and takes away attention from the purpose
of documenting why an action is being taken.

Also updates status of TODO and FIXME items, including removing
code was a workaround fixed by a recent patch.

Change-Id: I2e087be1e204c618d1dbe499b3f69eae34ce656f
2018-10-25 11:33:25 -07:00
Jean-Philippe Evrard f78e45c304 Build OpenSUSE Leap 15 by default
This includes the building of OpenSUSE Leap 15 in checks/gates.

As the build of each project requires the building of the
requirements first, added to the fact that a new distro is added
into the jobs, this extends the timeout for the base job beyond
the maximum time for requirements, so that all the projects
(excluding requirements) have more time to complete.

Change-Id: I73b055b3942a6d80b8474544a9d65df0b3005e15
2018-10-23 08:34:59 +00:00
Zuul a4892664c8 Merge "Improve setup-gate" 2018-10-19 04:47:29 +00:00
Jean-Philippe Evrard 6bcde4f007 Add branching in LOCI
This will allow us to create jobs with branches to publish
images for different upstream branches direcly in LOCI.

Change-Id: I57e6cadd647e2bb624da4fea9749534de4617926
2018-10-17 06:53:51 +00:00
Jean-Philippe Evrard baf6a5b524 Always build requirements image in the pipeline
Without this patch, the loci builder automatically consumes a
previously published requirements image when the project is not
"requirements". This also means the first step in checks/gates
for non requirement images would be to pull a requirement.

Currently there is neither a "pipeline" nor consumption of
artifacts between jobs. Which means the "requirements" build
and the other image build have to be considered as independant.

However, by default, the "non-requirements" image built is
consuming previously published "requirements" image, but not
immediately previous built requirements image.

This is a problem, as it leaves us open to a race condition
where a new build of "requirements" and "non-requirements"
can succeed in a commit, but would cause all the next
"non-requirements" builds to fail, as it is possible the
newly published "requirements" to be incompatible with
the next "non-requirements", as they are not tested together.

This should fix the problem by ensuring that "requirements"
are always built and consumed in the "non-requirement"
building process, instead of re-using the previously built
requirements. For this, project needs to be overriden to
build the requirement image, and therefore a new profile
'requirements' was added to the buildargs of the distros.
Requirements repo also needs to be cloned in the gating
environment, and therefore was added to all the required
projects.

This will also allow new branches to be created, as there
would be no need of a previous build and publish
of requirements in the gating.

Change-Id: I093e4dfc0eef03c47d2d029011fdb5429242ae79
2018-10-12 09:53:06 +02:00
Jean-Philippe Evrard 56418ef3a8 Improve setup-gate
This includes a small optimisation to make sure the packages
are passed as a list instead of iterating over them in the apt
commands.

It also ensures the argument "recurse" is passed into the copy
argument, as this was not done previously.

Change-Id: If93fda5a2efad550b5d58e215f2f7ef9a06cdacf
2018-10-11 10:39:34 +02:00
Jean-Philippe Evrard 4403a89e5a Sort bindep properly in gates.
Bindep sorting is in gates will return a different, less natural
sorting, than what humans would naturally do.

This changes the behavior of the sort to take the -f argument,
which would mean a case-insensitive (and more natural) sort.

Change-Id: If680e0df83250f45a6a087912c0bcf38288ce4c7
2018-08-02 16:54:11 +02:00
Paul Bourke 3193983c1c Sort bindep.txt
Sort bindep.txt alphabetically to more easily allow new additions. Also
add a small check to the gate to make sure it and pydep.txt stay this
way.

Change-Id: I7ac98db6538fbc49392b6f385645298bc1c6addd
2018-07-18 00:00:01 +01:00
Sam Yaple 0d4142f12b
Fix enum-compat in a better way
Upstream requirements generator has a bug and is not pulling in
enum-compat. lower-contraints.txt has it strangely. This is the quick
fix to the issue.

Change-Id: I7c8bfbb89f13db1c251e762dfaf2020fa1f2fdc8
2018-05-18 11:51:54 -04:00
Sam Yaple fd31a2f0d5
Add enum-compat for upstream requirements
This patch can be reverted once enum-compat is un upper-constriants.txt

Change-Id: I0a32d4aca22bf592b80479a01151e67e91232259
2018-05-08 16:30:36 -04:00
Sam Yaple 2b85b07298
Disable debian
Missing mirrors upstream prevent this from working correctly,
temporarily disable

Change-Id: I6808f8cf06b3de0e31acb20b0f05ec164a346ed5
2018-05-08 16:30:36 -04:00
Sam Yaple c0b4c042db Re-enabled docker registry mirrors
Change-Id: Ifa0f3583a6f8f009d6780e1852dfd0a2fdc632e5
Depends-On: I837f562331603a7c00f9ba8554b6aa2975169eeb
2018-02-12 22:34:55 +00:00
Sam Yaple 9ad4fe0d41
Pin pip docker version
Change-Id: Iee65af745b8c16e6f93acf121a0e3ba3613db288
2018-02-08 02:27:17 -05:00
Sam Yaple a169c97643
Fix gate
Change-Id: I557735a0adb5cb1429b0479d8c4eb5dacbf36e07
2018-01-25 22:23:33 -05:00
Sam Yaple aeff89ce24
Switch to loci org
The secret needed to be updated to make this work. Now we are pushing to
quay.io as well, both under the same loci namespace

Change-Id: I086aec21c2ebe69bcdf0aa25749280d8878f946d
2017-12-21 14:59:09 -05:00
Sam Yaple f272aa3cd0
Fix requirements building
We were not failing when wheels failed to build. Implement a quick fix
for that issue

Change-Id: I934beb526caca90db93c01c8ec5ac9dd63d6ddc9
2017-12-14 01:53:33 -05:00
Sam Yaple 471ad839dd Add back debian support
We cannot build python-qpid-proton pip package on debian due to it
having 1.1.0 openssl. This seems like a lesser used package, so for now
we will just skip building it and give the world some time to resolve
the issue.

Change-Id: I4af88cb57ce2fc614d373c83cf3745c4aaaa5c7b
2017-10-31 03:03:14 -04:00
Zuul 132338f112 Merge "Switch requirements to new tagging scheme" 2017-10-27 05:01:23 +00:00
Sam Yaple 3546f8f6a2 Switch requirements to new tagging scheme
We are not consuming the images we are pushing right now. Oops!

Change-Id: I72b3de6bb3c1601b0b3051486a14fb3f16040578
2017-10-19 22:45:30 -04:00
Sam Yaple 5adaaf3447 Collect more logs
Change-Id: If2c2579c9e2d6145c82e2d56bae5c185e6e193de
2017-10-19 20:43:40 -04:00
Zuul d9a5525190 Merge "Switch path for loci dockerfiles" 2017-10-17 17:25:25 +00:00