Commit Graph

176 Commits

Author SHA1 Message Date
Ian Wienand 213fe7d1e0
openafs-rpm-package-build: update to openafs 1.8.10
Change-Id: I07089a90e25b2a2400cce91e7de41cdca111e7a2
2024-01-11 08:25:32 +11:00
Zuul 381d27c389 Merge "Add some output to the `find' command" 2023-11-01 17:07:23 +00:00
Cédric Jeanneret 036cf2733c Add some output to the `find' command
This, alongside the "df -h" output, may provide some useful information
about the /opt content (not as precise as a `du -shxc /opt', but at
least it's already something). It can then be compared with the
existing `df -h' information located in the zuul-info/ directory. 

The goal here is to understand the actual impact of this task.

Change-Id: I201eba6ec6db9f0caaaabb0a3d15b0894125c7d6
2023-10-30 07:04:23 +00:00
Ian Y. Choi 18c6b74f55 Disable translation sync for openstack-helm
Disables translation sync with Zanata on Zuul part
since OpenStack-Helm would like to cancel translation.

Depends-On: Ica81dfefaf848f03c972db79786735ffcff99351
Change-Id: I95db692d0243af0b49a8c04c2fd18f01914dd743
2023-10-29 10:56:53 +09:00
Akihiro Motoki 1ece06158a generatepot-rst.sh: Drop UUID filtering
tools/generatepot-rst.sh has an awk filter to drop UUID from POT files,
but it is unnecessary now. It was introduced to strip UUID information
which was added by default in Sphinx <1.3 [1] in openstack-manuals.
Sphinx >=1.3 does not output UUID information by default [2],
 so is is no longer needed.

In addition, (g)awk 5.0 or later (adopted in Ubuntu 20.04 or later)
complains the current awk regexp. I think it is the time to drop it
rather than fixing the regexp.

[1] 993647f316
[2] https://www.sphinx-doc.org/en/master/usage/configuration.html#confval-gettext_uuid

Related-Bug: #2035226
Change-Id: I57ce0c7d662a4cfd84d9647645a0c6ed9c56ac91
2023-09-18 17:13:36 +09:00
Ian Wienand ab0fad7f58
infra-deb-package-build: run mk-build-deps in separate directory
As noted, this can leave behind extra files that make generation of
the final .deb fail.

Change-Id: I2f0efe182f881da792bde686dd73d1d9efea9dad
2023-06-05 11:21:20 +10:00
Ian Wienand 575b517ba4
openafs rpm - update to 1.8.9 final
Change-Id: Iaecafad91576822555d400a3794f082f884b039b
2023-04-26 11:15:49 +10:00
Ian Wienand 43caa50e86
rpm-openafs: bump to 1.8.9pre1
OpenAFS 1.8.8.1 doesn't build on centos 9-stream, so this is the next
available release.  Even though it's a pre-version, it's got to be
better than cherry-picking patches.

Change-Id: I02ef7fd5500cd43b3fdc210e88d133f50a93c017
2022-11-10 11:41:31 +11:00
Jeremy Stanley 6ced4627bd Address breakage due to ansible-lint 6.5
Pin ansible-lint<6.5 for now due to the
https://github.com/ansible/ansible-lint/issues/2320 regression which
ignores our skip tags.

Also add the zuul.d directory to the list of directories to avoid
linting, since those YAML files aren't Ansible files and it doesn't
seem to know not to try parsing them anyway.

While we're here, "fix" a task name not starting with an upper-case
letter, which for some reason ansible-lint now seems to think is
important. If we decide to continue using ansible-lint, it's
probably going to persist in complaining about that.

Change-Id: I46826210dfa4442af5c36d1439d1a1047ca0ba90
2022-09-07 19:22:50 +00:00
Ian Wienand 9815c29cd8 linters: fix yaml whitespace
Fix whitespace issues revealed by yamllint with a later ansible-lint

Change-Id: I2bd97c294fd5c83f83ed30f57a9e9c265ab4c8ac
2022-07-28 15:22:44 +10:00
Ian Wienand 3d766af7e9 linters: minor cosmetic updates
Make sure all blocks are named, and fix up whitespace around jinja
filters.

Change-Id: Iaaeca20d53a927fab660f45b5bb9b552a15146e2
2022-07-28 15:22:44 +10:00
Ian Wienand 95966f83c0 wheels: Add "wheel" to build venv
Lots of builds fail with

 $ grep -r "invalid command 'bdist_wheel'" *  | wc -l
 388

I think perhaps we need wheel in the venv, as packages don't specify
the depdency explictly?

Change-Id: I2ed1b07e9e6dd5513f30b3007ee187da7665bf35
2022-05-25 09:30:38 +10:00
Ian Wienand b183a9d628 infra-deb-ppa-push: push to production repos
Now that we have shown this working with a test PPAs, this pushes the
packages to the repos used by production.

Change-Id: I170d38c311a37880081c8b195ce3a99075907f29
2022-05-10 17:09:55 +10:00
Ian Wienand b48bf53f49 debs : add generic PPA publish role, switch openafs to it
Use the generic role from I11e2bdcbf2894d86105d75c3d3580aefb6aa18fc
and make a generic publishing role too.

Remove the openafs specific bits that are no longer used.  Move the
description of the OpenAFS jobs above the job definition.

Change-Id: Ie61b82903644605d07f510ad1071fa551e7086c9
2022-05-10 11:00:45 +10:00
Ian Wienand 377b569473 debs: Add generic infra-deb package build role
This is a reworking of the openafs package build script to be more
generic.  This will be used by vhd-util in follow-on changes.

Change-Id: I11e2bdcbf2894d86105d75c3d3580aefb6aa18fc
2022-05-10 10:45:34 +10:00
Ian Wienand 11cc19b1b9 openafs-deb-package-build : rework into generic job
Per the notes in Ie00c42857e7a541aa1ccb8fe480756c1e7a38dc4 having one
debian/ directory checked in here doesn't work across multiple
distributions.  Rather than trying to keep mulitple versions around,
or munge files, we've split the debian/* and source generation into a
separate repo.

This makes the job more generic to build the debs from this repo.  See
Ie66d3b1e39ef9fa714b1dabdb7eb61cc43538587 for an example of using this.

Change-Id: Ia250acf64b76ef4e1b981f2ebb1febe6e063157c
2022-05-06 10:29:39 +10:00
Ian Wienand 183000d937 openafs-deb-package-build: use upstream source
As noted inline, if the source already exists we need to use it from
the primary archive.  Do this for 1.8.8.1 but leave notes behind on
building non-packaged versions.

Change-Id: I6d637c81dd4a8d712b5fa84722d7559178e40de2
2022-05-05 14:01:13 +10:00
Ian Wienand 8f228941cf openafs-deb-package-build: add some explainers to README
Change-Id: I0d47522d7135df22159671808d1b8f96e2eb8288
2022-05-05 09:13:20 +10:00
Ian Wienand 8e4d342807 openafs: generate deb packages for openstack-ci PPA
This imports the latest debian/* from the upstream openafs packages,
and builds source packages meant for upload to the PPA we use for
openafs.

Over the years we have found that maintaining our own PPA for this is
useful.  We have hit bugs that require immediate patches to be applied
and rolled out to production, and having a private build facilitates
this.  Generally we hope to have no delta to the upstream packaging,
which is currently the case.

Currently we have a fairly manual process to produce and upload these
debs (once there, the source is obviously available).  This allows us
to keep a little clearer view of what we've changed or are working on.

This doesn't publish anything, yet.  We'll work on that after this;
the idea is that the publishing job will consume the artifacts this
returns.

Change-Id: I07780595331da29af9f72185cbb3499210e89c19
2022-05-04 13:39:10 +10:00
Ian Wienand 6a6f4ecf70 Build CentOS 9 RPM packages
This builds and publishes openafs packages for CentOS 9

Change-Id: I26c727caba12e544dd483dc3e8f04fd7d6bf7daa
2022-04-29 21:21:31 +10:00
Zuul a7d6b8a882 Merge "build-wheel-cache: Don't use virtualenv on python3 platforms" 2022-03-20 23:29:11 +00:00
Ian Wienand d1fd2e556c build-wheel-cache: Don't use virtualenv on python3 platforms
As noted inline, platforms are starting to decide to deprecate
virtualenv for "python3 -m venv".  Put in logic to use venv in our
Python 3 paths.

Change-Id: I46778642647d7be995d476fb567a9943cae66b8f
2022-02-16 11:14:26 +11:00
Ian Wienand 0d321449db prepare-zanata-client: upgrade pip in venv
Make sure the pip in the venv is upgraded past the system-version so
it can install all the latest requirements.

Change-Id: I601aca1507d16912e08ee9aba8842bc205ea2a91
2022-02-08 16:51:04 +11:00
Clark Boylan eaa4324e6d Remove centos-8
This removes wheel build jobs for centos-8 (we already have them for
-stream) and convers the openafs package builds over to centos-8-stream.

This bumps the openafs version to try and accomodate the changes to the
stream kernel on aarch64.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/824243
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824258
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824257
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824256
Depends-On: https://review.opendev.org/c/openstack/requirements/+/824240
Change-Id: I7e196f6b3b2bf785b8a94bb04de7062da3042b34
2022-01-11 15:21:19 -08:00
Clark Boylan 1bc98d2ee8 Update ansible-lint to fix deps problem
Older ansible-lint has an uncapped dep on 'rich' and newer rich breaks
ansible-lint. New ansible-lint has addressed this. We update
ansible-lint to get those fixes.

This adds task names to a number of tasks to correct a linting error.

Change-Id: I38284fef54213e0fceb1b348d5839129cc15148e
2022-01-10 12:00:49 -08:00
Seongsoo Cho 107065b1c8 Add swfit to DOC_TARGETS for docs translation
The swift team want to translate docs into other language.
For docs translation in zanata, I add swift to DOC_TARGETS

Change-Id: I0d9f46d576edf10117d73526505d1a59b40886dc
2021-10-24 20:46:12 +09:00
Zuul e453657fdb Merge "Remove retired neutron-lbaas and django-openstack-auth from job" 2021-07-27 09:05:19 +00:00
Ghanshyam Mann 7a3eb3afeb Remove retired neutron-lbaas and django-openstack-auth from job
neutron-lbaas is retired now and we can
remove it from zuul jobs. It also retire django_openstack_auth
in this patch to unblock the gate.

`django_openstack_auth`` code was merged into the main horizon
repository during the queens release. This repo is already
deprecated and now we can retire it. This patch removes all
references of ``django_openstack_auth`` as mentioned in [1].

[1] https://docs.openstack.org/project-team-guide/repository.html#retiring-a-repository

Change-Id: I5310983bed6c5b1618b7e131996e09571be9f13d
2021-07-27 13:46:28 +05:30
Sean Mooney 4c3e97ccc8 add tex-gyre package for tgtermes.sty
This change fixes the pdf-docs job by installing
tex-gyre to provide the missing tgtermes.sty style.

Change-Id: I885ed9153d9ccd9d3a486b5fc573238520474592
2021-07-26 14:41:21 +00:00
Ian Wienand 58873cad48 wheel-build: reduce Bullseye build
Likely due to many less Python 3.9 wheels the Bullseye builds take too
long.  Given this is a new distro, limiting the builds to the latest
releases is a practical solution here.

Add the bullseye jobs so they test in the gate.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/798029
Change-Id: I9130014837d297fad6802c99da417dbb8f3a8b76
2021-06-25 09:52:47 +10:00
Ian Wienand 4dbf2dfc3b openafs: update centos to 1.8.8pre1
Although this is a pre-release, it is required to build with some
recent CentOS 8 kernel changes.

Change-Id: Ia141f97e971d4a8a701f02294f7b33a097124607
2021-06-17 08:09:14 +10:00
Akihiro Motoki b515ef9819 translation: Handle renaming of Chinese locales in Django
Horizon is switching Chinese locales from zh-cn/zh-tw to zh-hans/zh-hant
in horizon and horizon plugins.
This change follows Django change which happend more than five years ago
and the new language code form is commonly used.

Language codes in Zanata are not changed, so we need to covert the
relevant language codes in propose_translation_update.sh.
It allows us to avoid doing it manually and also allows us to
switch these language codes almost once across horizon and plugins.

The detail is explained in the mailing list post.
http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020169.html

Change-Id: I1420508f0513c52866aa637784a51f7c22f6d204
2021-02-03 08:32:53 +09:00
Clark Boylan 8a6fe25654 Build openafs 1.8.7 on centos
The openafs 1.8.7 release fixes a fatal bug in 1.8.6 that occurs after
January 14, 2021. Bump up the version to 1.8.7 to package up the fix.

Change-Id: I83fea73f0f68d297ed95b14c29cc1e6bb12d6d5d
2021-01-18 09:40:50 -08:00
Ian Wienand 39c49b3133 build-wheel-cache: Ignore missing .whl when removing
Per the issue linked inline, the new pip resolver downloads (and
reports) wheels that it ultimately seems to discard itself.  As of
this writing, it's unclear exactly what is going on.  We can simply
ignore missing files here with -f to safely work around this.

Change-Id: I30700e0a0a242f9d7d2563c989a1d25eb6acd6e4
2020-12-14 14:55:50 +11:00
Jens Harbott 75f14ac790 Update readme with updated default swap size
In [0] the default swap size was reduced from 8G to 1G, update the
readme to match the current default.

[0] I5ce9064a5546d85ab6f41c4e60aa56fa56ff47c1

Change-Id: I5fa3ea0b22cb9e4ce3aa140409f3ee23d3cade35
2020-11-05 09:19:54 +01:00
Jeremy Stanley 26b528c2cc Replace texlive-full with cm-super
PDF builds need to continue working on Ubuntu Focal. Installing
texlive-full is an easy answer but pulls in 3GB worth of additional
packages and is causing jobs to frequently hit build timeouts.
Re-add just the focused dependencies needed to keep this working
without requiring the kitchen sink.

This is a partial revert of 3f5d26a1c0
which initially added texlive-full in an attempt to solve PDF build
issues.

Change-Id: Id8f50ccd75bbfe5ac126c61fe8e9223e0b6ae2b7
2020-09-22 17:26:10 +00:00
Zuul d68d355170 Merge "configure-swap: Always use dd and limit swap size to 1024MB" 2020-09-10 20:05:22 +00:00
Lee Yarwood 45f555fdf0 configure-swap: Always use dd and limit swap size to 1024MB
A recent kernel update in Fedora has highlighted that fallocate produced
swap files on ext4 partions are no longer accepted by swapon:

swapon failed if the swap file is created by fallocate in ext4 partition
https://bugzilla.redhat.com/show_bug.cgi?id=1827115

This change assumes that all distros will eventually encounter this and
removes the fallocate task from the role and defaults to using dd. As
this is considerably slower the overall size of the swap file is reduced
to 1024MB.

Change-Id: I5ce9064a5546d85ab6f41c4e60aa56fa56ff47c1
2020-09-10 11:01:47 +01:00
Zuul 08a017f0d8 Merge "Migrate openstack-tox-docs jobs to Ubuntu Focal" 2020-09-09 19:00:10 +00:00
Ghanshyam Mann 3f5d26a1c0 Migrate openstack-tox-docs jobs to Ubuntu Focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

openstack-tox-docs jobs is migrated to ubuntu focal for victoria
onwards and bionic from stable/stein till stable/ussuri and xenial
till stable/rocky.

Also add texlive-full to be installed for pdf doc building otherwise
it fails on Focal:
- https://zuul.opendev.org/t/openstack/build/72a590901f43415c93f5352363561de6

[1] https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal.html

Change-Id: Ifeeced1a5f54f1de28c89cc7d1fcd3b2ab343354
2020-09-09 15:57:19 +00:00
Ian Wienand 156073a4d5 Bump openafs build to new 1.8.6 release
Change-Id: I1548989b1153a137282fd12cbab2d128592069bb
2020-08-26 08:05:57 +10:00
Zuul 5192f7b9a7 Merge "Stop to use the __future__ module." 2020-07-09 12:54:17 +00:00
Zuul 6265bb90d0 Merge "Update the common_translation_update role to use python3" 2020-07-02 07:13:34 +00:00
Hervé Beraud 11175cf7d7 Stop to use the __future__ module.
The __future__ module [1] was used in this context to ensure compatibility
between python 2 and python 3.

We previously dropped the support of python 2.7 [2] and now we only support
python 3 so we don't need to continue to use this module and the imports
listed below.

Imports commonly used and their related PEPs:
- `division` is related to PEP 238 [3]
- `print_function` is related to PEP 3105 [4]
- `unicode_literals` is related to PEP 3112 [5]
- `with_statement` is related to PEP 343 [6]
- `absolute_import` is related to PEP 328 [7]

[1] https://docs.python.org/3/library/__future__.html
[2] https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html
[3] https://www.python.org/dev/peps/pep-0238
[4] https://www.python.org/dev/peps/pep-3105
[5] https://www.python.org/dev/peps/pep-3112
[6] https://www.python.org/dev/peps/pep-0343
[7] https://www.python.org/dev/peps/pep-0328

Change-Id: I908d097adbd739869915baa93de2797acf6b8ef9
2020-07-01 10:20:52 +02:00
Hervé Beraud 56d8c85af4 Update the common_translation_update role to use python3
Change-Id: I0834f209d99ed9a1e4491c54fd648e1ef646a9b3
2020-07-01 10:20:52 +02:00
Andreas Jaeger 1410723a22 Update echo for pdf-docs to match recent change
Display in the echo exact command that is executed.

Change-Id: Ic02d1c351dcc048a67a1e7c140efb3f9c031a069
2020-06-16 11:07:48 +02:00
Andreas Jaeger e7f5a3d7a8 Fix pdf building
tox lives in {{ tox_executable }} which is set by the tox role,
so don't use the hardcoded 'tox' name, it might not exist.

Change-Id: I4c93fb838d6476357959a2d4459dede80caa2ad2
2020-06-16 10:12:51 +02:00
Ian Wienand 541b574222 build-wheel-cache: Reduce arm64 builds and various small updates
Because there are many more wheels to build on arm64, we need to
reduce the arm64 builds to just latest two branches to have a
reasonable build time.

Output the script output to logs; if the job gets timeout killed we
still get some log output.

Remove --progress from parallel as it just floods the logs with output
that isn't useful to store.

Remove --verbose from pip to try and reduce logs.  We can still see
failures but currently they are like 500mb compressed.

Zip and remove the logs in post so we don't copy over uncompressed
logs if we are timeout killed.

Change-Id: I5fba52af7fcafb12d0d2c4b416d5e0b7e4feb238
2020-06-12 09:29:58 +10:00
Ian Wienand 2dda50a56c wheel-build-cache: skip scipy / scikit-learn on arm64 for now
As mentioned inline, these are blowing out the build time.  For now,
skip them.

Change-Id: I13d6f27f0403e91fe4daf532d7d726c1dce91e6d
2020-06-11 16:06:24 +10:00
Ian Wienand 2fcfa7362b openafs-rpm-package-build: tar results
It turns out there are many issues doing a recursive download from our
log servers.  Tar the results so we can pass it through a single file,
and extract that file in the publish jobs.

Change-Id: I2b54c061ae3563a8244a39d08e2fe49c2f885d2e
2020-06-05 12:37:04 +10:00