Commit Graph

62 Commits

Author SHA1 Message Date
Andreas Jaeger 56fd982f69 Retire repository
Depends-On: https://review.opendev.org/726461
Needed-By: https://review.opendev.org/726463
Change-Id: I4deefcafc286f60c1dfc64d95ce8369fe322af95
2020-05-08 21:21:16 +02:00
vass a6172b6b54 Use ensure-* roles
The install-* roles in zuul-jobs have been renamed to ensure-*, follow
the rename.

Change-Id: I329fc3e12624fe5cdae2b2e89506922014e70247
2020-04-13 09:32:17 +02:00
Andreas Jaeger 8e35292880 Fix tox-py35 job
The job needs to run on Xenial, fix it.

Change-Id: I315ca3c37a517558db795f3aea0bc3bd9a817c40
2020-01-02 15:55:31 +01:00
Andreas Jaeger 2202ec699b Fix playbooks/container-images/pre.yaml after OpenDev
The repository was moved as part of the OpenDev migration to a new
place, fix pre.yaml for new repo URL.

Change-Id: I0c20b843a5fd2d40ecf4bc366a14720e9512354a
2019-04-21 19:24:43 +02:00
OpenDev Sysadmins af565480e7 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:51:43 +00:00
Monty Taylor f4757115f0 Remove container build jobs
We've kind of given up on this as an approach. Get rid of the jobs.

Depends-On: https://review.openstack.org/636018
Change-Id: I454a50349e579d0899fde1cdf7ede70ad67503e1
2019-02-09 14:09:30 +00:00
Andreas Jaeger 5da817f475 Use publish-to-pypi
The publish-to-pypi-python3 template has been renamed to
publish-to-pypi, use that one now.

Depends-On: https://review.openstack.org/615239
Change-Id: I89985f446e4da5a47b5be79eabea3f06738fe300
2018-11-02 19:44:39 +01:00
Monty Taylor f2a47fea64
Run an sdist before the bdist_wheel command
The hook sequencing doesn't work as well for bdist_wheel as it does for
sdist because bdist_wheel creates a build destination before setup hooks
run, but the setup hooks get run the context of the source dir, so that
the content gets generated but not in the right location.

sdist does not do a build directory, so by running an sdist first,
we cause setup hooks to get run in the correct context and before the
bdist_wheel step gets run. This means when bdist_wheel gets run, the
results of any setup hooks will be appropriately in place.

Change-Id: I5ca72b9cebcb27d7ab7b44198a98f7a8287de0b3
2018-10-12 13:46:43 -05:00
Monty Taylor f899ba2170
Add debug info about base image sha
In order to debug issues, knowing what version of a base docker image is
in use can be helpful. Grab it and print it out.

Change-Id: I741b56bf4f8f8d1edd7e40da415b26c2e3dd13d7
2018-10-12 09:27:38 -05:00
Steve Kowalik 2cd72150d7 Correct small typo
tools/test-siblings.sh was misspelling constraints.

Change-Id: I1b5082cf3b0198b691adbb114ba74505f92da6e1
2018-09-12 16:47:42 -06:00
Steve Kowalik cfca55bc4e Revert "Don't store apk indexes in cache"
This causes job failures with psycopg2_binary being unable to locate
pg_config.

This reverts commit 1c04073e6c.

Change-Id: I781aa72f3fd5c1aad42d9ba740807bc34a8dcbc4
2018-09-12 15:35:09 -06:00
Paul Belanger 1c04073e6c Don't store apk indexes in cache
To help save some space in images, we can use apk --no-cache flag.

Change-Id: Ife43f43aa6493f0a85c03ec593ff040a7d06f8e7
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-28 15:59:57 -04:00
David Shrewsbury a1cc08f014 Implement basic image push
Pushes all images built with build-image. This requires a --prefix
option to be specified since that is the user (or organization) to
which we push and helps to identify the local images.

Change-Id: I13eee575c329deb58285f9cc913be298b43bb438
2018-08-16 17:19:29 -04:00
David Shrewsbury 221674d1b9 Clear up "tag" vs "image"
We incorrectly reference things in the code as "tags" when what we
really mean is "image". We are only using actual tagging to create
a new prefixed image name that references the original image.

This changes code references from "tag" to "image" in places it
makes sense. Also, we no longer use tagging to create the prefixed
image name, and instead only create the prefixed image and commit
over it, leaving the resulting local images looking much cleaner
(with no duplicates).

Change-Id: I6234a62d927cb9f35f8f4b731eee375f4c208870
2018-08-16 11:42:06 -04:00
Monty Taylor db532692d1
Fix configparser import for python2
Change-Id: Icdd57c970119698455d928b5f5eb42d0c8f10b40
2018-08-07 08:48:17 -05:00
Ian Wienand af775c8f12 Add readthedocs webhook id
This value is taken from the webhook URL for the project given on the
RTD website.  It is required for the rebuild ping done by
docs-on-readthedocs template.

Depends-On: https://review.openstack.org/583834
Change-Id: I05d798cacaad4328d84663e7338d026928123b09
2018-08-03 09:26:33 +10:00
Zuul d89aa31431 Merge "Add documentation about build-images" 2018-07-23 17:25:21 +00:00
Clark Boylan 7d00b4a5b1 Don't truncate sh produced logs
By default an uncaught sh exception is nicely formated and printed. This
is great except that it also truncates stdout and stderr. If you rtfs
you discover that you can override this behavior by setting the
_truncate_exc flag on commands to False.

Do this so that we can get complete process output for debugging.

Change-Id: Ibae19ac891ad7978a5bd128626adaa35a1c354e6
2018-07-20 18:30:26 -07:00
Monty Taylor 5772d4fda9
Add documentation about build-images
The build-image command got added already, but without docs. Let's fix
that.

Change-Id: Ic003a837b71da81a0dde6bdf1eee7016331923fa
2018-07-20 13:33:25 -05:00
Monty Taylor ea266224d7
Add docs and content publication jobs
We want to build docs and trigger readthedocs builds. We also want to
publish things to pypi.

Change-Id: I9faad5d824adc1f1ec94449adafb4dbca1055962
2018-07-20 08:19:14 -05:00
Monty Taylor a34e7f031f
Use released bindep
bindep now supports alpine, so stop installing from git.

Change-Id: I441740379fc4cad374e3e6cb85b02e706b1575cc
2018-07-17 12:40:03 -05:00
Monty Taylor 9b9c7a099d Put tmpdir chown into a try/finally
When stuff goes wrong in the images we miss chowning the tempdir back to
the original uid so we get a double exception. But it in a finally.

If only we had deterministic destructors ...

Change-Id: Ide62c5bd6eee824f40005a7628b8dba65544f428
2018-07-17 00:28:00 +00:00
Monty Taylor 19463f937d Add support for supplying alpine mirror url
In order to build images and use a local mirror, add an option which
updates the built-in alpine mirror. It puts it back at the end because
someone might otherwise use the output as a base image and it would
point to a random location.

Change-Id: I32cd19f79f1d474b0c011e39d139a78e196ce563
2018-07-17 00:27:51 +00:00
Monty Taylor ea3d7cbf2a Plumb in pypi mirror config from build host
If the build host has pypi mirror configured, we should use it inside of
the container builds. Bind-mount build-host pip config.

Change-Id: Ib1540dfe3c4172eeb8a70b29becd73a2828b3efb
2018-07-17 00:27:46 +00:00
Monty Taylor aafe28f839 Add image debug print at the end of the job
After we build images, print out `docker images` so that images and
image sizes can be verified.

Change-Id: I4eb92cef1c2510e62ada7f6ca308198cc8bd3a86
2018-07-17 00:27:41 +00:00
Monty Taylor 7d35e81912 Add job to build container images of zuul
This way we can ensure that we don't break zuul with pbrx changes.

Depends-On: https://review.openstack.org/582276
Change-Id: I99c23b41f339708508a2cb6a01801d00b3c7f3cf
2018-07-17 00:27:32 +00:00
Zuul 63ea4a33e0 Merge "Remove some left over debug logging" 2018-07-16 20:37:42 +00:00
Zuul 3eff58e407 Merge "Actually tag the actual images we make" 2018-07-16 20:37:42 +00:00
Zuul da41143b63 Merge "Add prefix support to pbrx-build-container-images" 2018-07-16 20:37:41 +00:00
Zuul af52fe659c Merge "Fix the alpine build" 2018-07-16 20:37:40 +00:00
Zuul 3394531fab Merge "Clean up job run playbook" 2018-07-16 20:22:40 +00:00
Zuul 591ac33cd8 Merge "fix tox python3 overrides" 2018-07-15 10:43:03 +00:00
Zuul 199b5c1bb1 Merge "Install bindep from git source" 2018-07-13 14:21:50 +00:00
Monty Taylor 07027f1f49
Remove some left over debug logging
We want good debug logging. But we had some things from having tried to
figure out why the wheels weren't building/caching. Remove those,
they're silly.

Change-Id: Ifb661a6474b01e461303248b891e45bbee32bfc5
2018-07-12 18:35:57 -05:00
Monty Taylor bcf471e37d
Actually tag the actual images we make
Well, making an image and not tagging it is just lame, because then it's
just, well, a uuid. And nobody likes uuids.

Change-Id: If8cfd530499aa9574703ac2a95eb306bc10d9b6b
2018-07-12 18:35:57 -05:00
Monty Taylor b405f744b8
Add prefix support to pbrx-build-container-images
The pbrx command supports an optional 'prefix' to use when tagging
images. Add support to the job for specifying it.

Change-Id: Ic7ad8dd92f377bb3b091a83bc3dd963380991acf
2018-07-12 18:35:57 -05:00
Monty Taylor 1f0bf4659d
Fix the alpine build
Ok. So the previous alpine patch didn't work QUITE as much as you might
want.

In fact, it didn't work even a little bit.

Update it to work.

But also, change it a little bit and allow for expressing per-image
additional dependencies in python extras. If there is an extra matching
the image name, it'll get installed into that image.

Change-Id: I9eda25829be6d2916bb131cb6bc8f0382ef44f1b
2018-07-12 18:35:53 -05:00
Monty Taylor 8144016ed3
Clean up job run playbook
We had a hard-coded path to the zuul repo, which is sort of lame.

Also, remove the connection reset, which is in zuul-jobs now.

Depends-On: https://review.openstack.org/580730
Change-Id: Idae460f4eb170a74b583fc4d19510f34630b9fec
2018-07-12 16:32:34 -05:00
Monty Taylor 8fb6ffa5c6
Install bindep from git source
We'll be releasing a new bindep soon, but for now, install from source.

Change-Id: I8e4a9b4928c573f726b7e1b5d8761cb945015754
2018-07-12 16:32:31 -05:00
Zuul 93b3886399 Merge "Add job for using pbrx to build container images" 2018-07-12 16:43:13 +00:00
Zuul 94fb9c820d Merge "Switch from python:slim to python:alpine" 2018-07-12 16:36:18 +00:00
Monty Taylor 5fb2fb69d1
Add job for using pbrx to build container images
The pbrx build-images command is directly applicable to any python
project with pbr and bindep. Make a simple job that will run pbrx
to produce images.

Change-Id: Ica28f42bd0acc78a0e960ceef30e5e5045e8b389
2018-07-12 10:18:59 -05:00
Monty Taylor f49197ffc8
Switch from python:slim to python:alpine
Alpine is smaller. Also, for our first user, Zuul, alpine already has
all the things needed from extra repos (yarn and bubblewrap) Switch to
alpine so we can keep things simple.

NOTE: This isn't going to work until we cut a new release of bindep with
the depends-on patch in it.

Depends-On: https://review.openstack.org/579056
Change-Id: I8c8a3b94b5aa562f54034825c3af871893b4bf89
2018-07-12 10:16:06 -05:00
David Shrewsbury 09f68422d3 Add test for no arguments
Add a test that no arguments to the pbrx command works.

Change-Id: If429ae03feb1a8c6bb662444c31cbbcf7ac1eece
2018-07-11 15:27:38 -04:00
Zuul 0f6b175d71 Merge "Handle no arguments" 2018-07-11 18:33:51 +00:00
David Shrewsbury ed9b3f98d2 Handle no arguments
Running 'pbrx' with no arguments is a thing folks may do. We shouldn't
throw exceptions at them in this case, but, instead, some help text.

Change-Id: Ibed0da165f062125cf298e2d9b3dce54c4b93420
2018-07-11 12:57:30 -04:00
Zuul 9b9b539ebb Merge "Remove python2" 2018-07-11 16:56:30 +00:00
Monty Taylor bab58a11ab
Remove python2
Nothing depends on pbrx yet. Python2 is weird. Just get rid of it.

Change-Id: Ief4fe4d46e03946b2452d6e2d6377d229426687e
2018-07-10 16:27:11 -05:00
Zuul 091a2457eb Merge "Bump min version in tox.ini to 3.1.1" 2018-07-10 21:19:59 +00:00
Zuul 25b1f427ea Merge "Move basepython to testenv section" 2018-07-10 21:15:22 +00:00