Commit Graph

19124 Commits

Author SHA1 Message Date
Zuul cfc5e72479 Merge "Mark source repos as safe in install-ansible-role" 2024-06-07 19:00:47 +00:00
Zuul 136d3be3c0 Merge "Add Gerrit 3.10 upgrade testing" 2024-06-07 16:14:54 +00:00
Zuul f1093da7f8 Merge "Add Gerrit 3.10 image builds and testing" 2024-06-07 16:14:52 +00:00
Zuul 2ec5aa70d7 Merge "Remove Gerrit 3.8 images and related jobs" 2024-06-06 21:04:19 +00:00
Zuul 548b697ddb Merge "Fixups: for jitsi-meet" 2024-06-06 19:07:36 +00:00
Zuul 037c965528 Merge "Increase the number of mailman3 outgoing runners to 4" 2024-06-05 18:56:10 +00:00
Zuul 7d800c045b Merge "Remove inmotion cloud management" 2024-06-05 18:56:08 +00:00
Clark Boylan a4c79cdd07 Increase the number of mailman3 outgoing runners to 4
By default mailman3 uses a single outgoing mail runner. We have seen
lists with large membership (openstack-discuss for example) delay mail
delivery for 5-10 minutes. In an attempt to increase throughput we bump
the number of outgoing runner instances to 4.

This upstream thread [0] has more info on this and other tuning options
we might consider. We start with this one as the other options have
behavior implications and will need more thought.

[0] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/W4F2OEM4VIEEU4U6MAPVMFIEGERBMY55/

Change-Id: I9e353960fe55468be1dadffd37aada7da6ed7db0
2024-06-05 09:41:02 +00:00
Clark Boylan f679683728 Add Gerrit 3.10 upgrade testing
This adds upgrade testing of gerrit from 3.9 to 3.10. This is the very
first step in the very long process of eventually upgrading to Gerrit
3.10.

Change-Id: Iaa77287b1334dc761e8de815704fec4d8d69d863
2024-06-04 13:30:19 -07:00
Clark Boylan 400514a1b6 Add Gerrit 3.10 image builds and testing
This adds Gerrit 3.10 image builds and our system-config-run-gerrit jobs
for Gerrit 3.10.

Change-Id: I6525090f78a1f1440f2cccda96f83158cb08d2ac
2024-06-04 13:29:25 -07:00
Tony Breeds 716eff81f1 Fixups: for jitsi-meet
When updating jitsi-meet to jammy we switched to using {meetpad,jvb}99
as the hostnames but were setting host-vars for {meetpad,jvb}01.  Fix that
Also a pointless and harmless ')' was left in a comment so clean that up.

Change-Id: Iad3079d9295559fd286bb41361f4de26efc14091
2024-06-04 13:43:15 -05:00
Clark Boylan 8c4977181b Remove inmotion cloud management
This removes management of the inmotion cloud mirror and cloud launcher
configs in prepration for retirement of this cloud. We don't remove the
cloud from clouds.yaml files as it is a bit more ambiguous as to how
long that will be useful (potentially necessary for manual cleanup
steps). Instead when we get around to adding openmetal after inmotion
has been shutdown and resurrected as a new openmetal cloud we can
replace clouds.yaml config then.

This cleanup is necessary to avoid errors when the cloud goes away. We
will be working with OpenMetal to make this happen. It shouldn't matter
if we land this before or after the project-config changes for nodepool
cleanup as things are decoupled sufficiently well.

Change-Id: I9d224318a9cfac35b867babff92e1071ca23c574
2024-06-03 13:21:31 -07:00
Clark Boylan ed9aae01c3 Mark source repos as safe in install-ansible-role
Our install-ansible-role role is used to install the cloud launcher and
puppet ansbible roles on bridge. It does this by cloning the zuul repos
for these roles into the appropriate ansible role path location. Recent
versions of git will not clone repos owned by different users by default
due to security concerns. This breaks install-ansible-role because zuul
owns the zuul repos and install-ansible-role is cloning as root. In this
case we do trust the zuul repos though so we mark them as safe
directories in the root .gitconfig file.

Change-Id: I0cc4a011bbfb484fcc2ccf0d8b1d254c01fc03d6
2024-06-03 12:27:04 -07:00
Clark Boylan 109c509a95 Remove Gerrit 3.8 images and related jobs
This is followup to our Gerrit 3.9 upgrade and should only be merged
when we are confident that a revert is unlikely. We don't need to build
this image anymore as it is in our past so stop building it. Followup
changes will add 3.10 image builds and then resurrect the gerrit upgrade
job to test upgrades from 3.9 to 3.10.

Change-Id: I6fd8fd0eaa6b9b466679bead813b0877eadcaaa0
2024-05-31 14:33:03 -07:00
Clark Boylan 560bbe9b54 infra-prod-service-review depends on Gerrit 3.9
This was missed when switching over to the Gerrit 3.9 image in prod. We
do the same for manage projects as well.

Change-Id: Ia0c5bca1dc0d34089f41ab3ebe343a0e65bd496f
2024-05-31 14:29:39 -07:00
Clark Boylan f01ae8a271 Update Gerrit image tag to 3.9 (from 3.8)
Note this will not perform the upgrade for us. Gerrit upgrades are still
manual. But we will land this change after the upgrade is completed to
reflect the new state.

Change-Id: I439d5588e05a15b2d2fad4bafad8d59babf9d468
2024-05-24 12:23:00 -07:00
Clark Boylan a1fecd216b Update Gerrit images to 3.8.6 and 3.9.5
There are new bugfix updates for both of the Gerrit images we are
building. Bump up to these new releases. The delta between these updates
and what we are already running should be quite small since we just
updated updates recently which will update the main gerrit repo off of
stable branches. Many plugins are fixed to tags but many of those simply
get retagged with new versions. There are some exceptions to this like
the codemirror-editor plugin though.

Overall though should be a straightforward update.

Change-Id: Ic8df1922672317f463e39548f318eae77796b9fd
2024-05-21 09:50:36 -07:00
Jeremy Stanley fe7d211d86 Add ubuntu noble arm64 to our package mirrors
This adds noble to the existing ubuntu packge mirrors for AArch64.
In order to not overload the AFS servers we added x86 packages in a
previous change.

Note that afs quotas have already been increased in order to mirror
this content.

Change-Id: Id56bf5775b38cb932550d4cb8250c238918e6ce3
2024-05-17 16:45:41 +00:00
Clark Boylan 9a275a9e28 Add ubuntu noble to our package mirrors
This adds noble to the existing ubuntu packge mirrors for x86_64. In
order to not overload the AFS servers we avoid adding both x86 and arm
packages at the same time. A followup change can add arm packages.

Note that afs quotas will almost certainly need to be increased in order
to mirror this content.

Change-Id: I7ddf4be4663aa9d96844359361337ed73f0e9544
2024-05-15 13:50:49 -07:00
Jeremy Stanley 82a3c31641 Host a redirect for api.openstack.org
There is some ancient redirect we don't control somewhere in Liquid
Web's IP space which has been serving a redirect from
api.openstack.org to developer.openstack.org for who knows how long.
Since we already have a farm of redirect vhosts for other sites on
static.openstack.org, add this one as well so we can clean up this
strange and confusing external dependency.

Change-Id: I8051121761366ccbd07f3795c9aecc766f9fb7ff
2024-05-14 19:49:32 +00:00
Zuul 764b9968e0 Merge "Add a new infra-root-keys for 2024" 2024-05-14 16:30:36 +00:00
Zuul 4ab7d3e24d Merge "Rotate fungi's SSH key" 2024-05-14 16:26:53 +00:00
Zuul 01d1e08208 Merge "Rotate frickler's SSH key" 2024-05-14 16:22:52 +00:00
Zuul 08f0af0d8e Merge "Remove old infra-root-keys content" 2024-05-14 16:20:50 +00:00
Zuul 1fe5b366d5 Merge "Switch +meetpad_jvb_xmpp_server to the correct server" 2024-05-10 20:46:38 +00:00
Tony Breeds 6ab0c84546 Switch +meetpad_jvb_xmpp_server to the correct server
Change-Id: Iae3605e5f3ab6be094f044d152f0bec633a61787
2024-05-10 14:52:48 -05:00
Zuul 702025e427 Merge "Add inventory records for new Meetpad and JVB servers" 2024-05-10 18:35:58 +00:00
Zuul fb9d7b9779 Merge "Upgrade Gerrit's backend database to MariaDB 10.11" 2024-05-10 16:46:15 +00:00
Zuul 345a8eb610 Merge "Actually rebuild Gerrit images to get a new 3.9 image" 2024-05-10 16:46:01 +00:00
Zuul 2a95a9a4fd Merge "Remove old infra team puppet testing" 2024-05-08 17:09:11 +00:00
Tony Breeds 6d00212618 Add inventory records for new Meetpad and JVB servers
If I did it correctly LE shoudl be handled via group_vars

Change-Id: I6616f15f8cc714adfa59b49b4969f59d33923735
2024-05-06 16:54:51 -05:00
Zuul ca64c03380 Merge "Switch meetpad test servers to jammy" 2024-05-06 19:59:09 +00:00
Zuul 1bf660bdc7 Merge "Use group var to define letsencrypt_certs" 2024-05-06 19:59:07 +00:00
Zuul afb4a957a3 Merge "Allow overriding of meetpad PUBLIC_URL" 2024-05-06 19:34:46 +00:00
Clark Boylan d56d5fb080 Actually rebuild Gerrit images to get a new 3.9 image
The last rebuild only promoted our Gerrit 3.8 image. This appears to
have happened because we only modified the jobs and not the Dockerfile
itself. Fix this by modifying the Dockerfile which should rebuild and
promote both 3.8 and 3.9 images ensuring that our upgrade testing tests
what we want to upgrade to.

Change-Id: I8d06ea9971a6ee0c0e06e6fe2b73391526be6220
2024-05-06 09:52:33 -07:00
Tony Breeds ef1f976faa Remove some old CentOS compatibility and address FIXMEs
In earlier commits it was noted that we aren't as complete as we could
be with the scripts in launch.  This commit removes detection of yum as
a package manager (which stopped being a real thin in CentOS-7).

And creates a more complete list of tools used in the appropriate
scripts

Change-Id: I4cd05da18155169fd640c06a151467aed6112a3d
2024-05-02 18:21:11 -05:00
Tony Breeds 5684a75119 Add a helper script for doing the LVM setup on mirror nodes.
Mirror nodes have an atypical LVN setup.  In that the volume, once
visible to the guest, is split between 2 equal volumes for proxy and
afs caches.

This will do that work for us.  As the volume (at least in ord.rax) is
attached to the guest after initial creation this script isn't integrated
into launch_node (like mount_volume.sh).

Change-Id: I9ebc6daa9a65a654d9e8622ea6004ebbc28348a2
2024-05-02 18:21:11 -05:00
Zuul ec9bf6ea28 Merge "Force new build of the etherpad container" 2024-05-02 22:59:01 +00:00
Tony Breeds c341d6b403 Force new build of the etherpad container
Change-Id: I77dfef77a18f0480c8a62836b01336c592a02018
2024-05-02 15:52:21 -05:00
Tony Breeds cca0c34e7b Switch meetpad test servers to jammy
Also while we're there use 99 as the host index to make it slightly
harder to confuse testing with production.

Change-Id: I62193418feb9401fc06da39bd100553aef3dc52d
2024-05-02 13:46:03 -05:00
Tony Breeds 5f0e06963a Use group var to define letsencrypt_certs
Change-Id: Ibcc11bd4fb120a046b428fe3c6eb9ba8505495d0
2024-05-02 13:42:56 -05:00
Tony Breeds ba511c4d1c Allow overriding of meetpad PUBLIC_URL
In testing jammy updates we discovered that this value need to match
so that websockets are directed to the correct host.

Change-Id: Id44bf92edff411389f05a652dad2ae78607e4d55
2024-05-02 13:41:47 -05:00
Jeremy Stanley f75191dbd4 Tighten permissions on Etherpad settings file
The file in which our Etherpad settings reside is templated with
sensitive data like an API key and DB password. Remove the world
readable bit from it, and also drop user/group write perms while
we're at it. Also switch the service's effective GID to match its
UID and make sure the config's ownership is set accordingly.

Change-Id: I65b70237b4bc8f4e63aa0b717702c124e01ed777
2024-05-01 19:18:59 +00:00
Zuul f6a131ebc0 Merge "Update etherpad to v2.0.3" 2024-05-01 16:08:38 +00:00
Zuul 2653c922cc Merge "roles/openafs-client: small overhaul of rpm builds" 2024-04-30 18:21:55 +00:00
Clark Boylan b2607979ab Update etherpad to v2.0.3
This updates changes how Etherpad is built and how authentication is
managed for API requests. This ends up changing a lot of our tooling
around etherpad but etherpad itself (other than the auth changes)
doesn't seem to change much. In response to this I update our admin docs
on common api tasks to use the new process. Then update our testinfra
testing as well to cover that to ensure it all continues to work
properly after this change.

Note the Dockerfile updates are all adapted from upstream. I'm actually
not fond of the decisions they have made in this image build, but being
in sync is probably more important than fixing the multistage builds and
being different.

This change jumps us from v1.9.7 to 2.0.3 (covers releases 2.0.0, 2.0.1,
and 2.0.2 too). A changelog can be found here:

  https://github.com/ether/etherpad-lite/blob/v2.0.3/CHANGELOG.md

Change-Id: Ia7c4f26d893b4fc4a178262e1a6b9f3fa80d2a5c
2024-04-29 14:17:55 -07:00
Zuul 095ac2ae8a Merge "Ubuntu 22.04: Add ceph quincy and reef to mirror" 2024-04-29 16:58:19 +00:00
Clark Boylan 0ce1ba2b38 Remove old infra team puppet testing
The OpenDev team is planning on removing Ubuntu Xenial in the nearish
future. One of the things still running on Xenial is our old puppet
testing. We've decided taht we'll just have to manually manage those
nodes going forward without CI as there are few of them at this point
and we really want to clean up old Ubuntus in nodepool and our mirrors.

There is a risk that this will allow things to break without detection
or otherwise create new problems, but this stuff has been neglected so
that risk was there anyway.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/917198
Change-Id: I4560ae9bbb61e950a7baa1d29aaf677403249012
2024-04-26 16:22:07 +00:00
Zuul 69da8432f9 Merge "Upgrade Gitea's backend DB to MariaDB 10.11" 2024-04-25 18:33:07 +00:00
Jeremy Stanley 17276d0d31 Override upstream ADMINS address for mailman
Deliveries to root@localhost don't work, use the same as the from
address instead.

Change-Id: Id509f652be3b4b6f77edc85161aed7200f672571
2024-04-24 18:02:00 +00:00