Commit Graph

19096 Commits

Author SHA1 Message Date
Zuul 1fe5b366d5 Merge "Switch +meetpad_jvb_xmpp_server to the correct server" 2024-05-10 20:46:38 +00:00
Tony Breeds 6ab0c84546 Switch +meetpad_jvb_xmpp_server to the correct server
Change-Id: Iae3605e5f3ab6be094f044d152f0bec633a61787
2024-05-10 14:52:48 -05:00
Zuul 702025e427 Merge "Add inventory records for new Meetpad and JVB servers" 2024-05-10 18:35:58 +00:00
Zuul fb9d7b9779 Merge "Upgrade Gerrit's backend database to MariaDB 10.11" 2024-05-10 16:46:15 +00:00
Zuul 345a8eb610 Merge "Actually rebuild Gerrit images to get a new 3.9 image" 2024-05-10 16:46:01 +00:00
Zuul 2a95a9a4fd Merge "Remove old infra team puppet testing" 2024-05-08 17:09:11 +00:00
Tony Breeds 6d00212618 Add inventory records for new Meetpad and JVB servers
If I did it correctly LE shoudl be handled via group_vars

Change-Id: I6616f15f8cc714adfa59b49b4969f59d33923735
2024-05-06 16:54:51 -05:00
Zuul ca64c03380 Merge "Switch meetpad test servers to jammy" 2024-05-06 19:59:09 +00:00
Zuul 1bf660bdc7 Merge "Use group var to define letsencrypt_certs" 2024-05-06 19:59:07 +00:00
Zuul afb4a957a3 Merge "Allow overriding of meetpad PUBLIC_URL" 2024-05-06 19:34:46 +00:00
Clark Boylan d56d5fb080 Actually rebuild Gerrit images to get a new 3.9 image
The last rebuild only promoted our Gerrit 3.8 image. This appears to
have happened because we only modified the jobs and not the Dockerfile
itself. Fix this by modifying the Dockerfile which should rebuild and
promote both 3.8 and 3.9 images ensuring that our upgrade testing tests
what we want to upgrade to.

Change-Id: I8d06ea9971a6ee0c0e06e6fe2b73391526be6220
2024-05-06 09:52:33 -07:00
Tony Breeds ef1f976faa Remove some old CentOS compatibility and address FIXMEs
In earlier commits it was noted that we aren't as complete as we could
be with the scripts in launch.  This commit removes detection of yum as
a package manager (which stopped being a real thin in CentOS-7).

And creates a more complete list of tools used in the appropriate
scripts

Change-Id: I4cd05da18155169fd640c06a151467aed6112a3d
2024-05-02 18:21:11 -05:00
Tony Breeds 5684a75119 Add a helper script for doing the LVM setup on mirror nodes.
Mirror nodes have an atypical LVN setup.  In that the volume, once
visible to the guest, is split between 2 equal volumes for proxy and
afs caches.

This will do that work for us.  As the volume (at least in ord.rax) is
attached to the guest after initial creation this script isn't integrated
into launch_node (like mount_volume.sh).

Change-Id: I9ebc6daa9a65a654d9e8622ea6004ebbc28348a2
2024-05-02 18:21:11 -05:00
Zuul ec9bf6ea28 Merge "Force new build of the etherpad container" 2024-05-02 22:59:01 +00:00
Tony Breeds c341d6b403 Force new build of the etherpad container
Change-Id: I77dfef77a18f0480c8a62836b01336c592a02018
2024-05-02 15:52:21 -05:00
Tony Breeds cca0c34e7b Switch meetpad test servers to jammy
Also while we're there use 99 as the host index to make it slightly
harder to confuse testing with production.

Change-Id: I62193418feb9401fc06da39bd100553aef3dc52d
2024-05-02 13:46:03 -05:00
Tony Breeds 5f0e06963a Use group var to define letsencrypt_certs
Change-Id: Ibcc11bd4fb120a046b428fe3c6eb9ba8505495d0
2024-05-02 13:42:56 -05:00
Tony Breeds ba511c4d1c Allow overriding of meetpad PUBLIC_URL
In testing jammy updates we discovered that this value need to match
so that websockets are directed to the correct host.

Change-Id: Id44bf92edff411389f05a652dad2ae78607e4d55
2024-05-02 13:41:47 -05:00
Jeremy Stanley f75191dbd4 Tighten permissions on Etherpad settings file
The file in which our Etherpad settings reside is templated with
sensitive data like an API key and DB password. Remove the world
readable bit from it, and also drop user/group write perms while
we're at it. Also switch the service's effective GID to match its
UID and make sure the config's ownership is set accordingly.

Change-Id: I65b70237b4bc8f4e63aa0b717702c124e01ed777
2024-05-01 19:18:59 +00:00
Zuul f6a131ebc0 Merge "Update etherpad to v2.0.3" 2024-05-01 16:08:38 +00:00
Zuul 2653c922cc Merge "roles/openafs-client: small overhaul of rpm builds" 2024-04-30 18:21:55 +00:00
Clark Boylan b2607979ab Update etherpad to v2.0.3
This updates changes how Etherpad is built and how authentication is
managed for API requests. This ends up changing a lot of our tooling
around etherpad but etherpad itself (other than the auth changes)
doesn't seem to change much. In response to this I update our admin docs
on common api tasks to use the new process. Then update our testinfra
testing as well to cover that to ensure it all continues to work
properly after this change.

Note the Dockerfile updates are all adapted from upstream. I'm actually
not fond of the decisions they have made in this image build, but being
in sync is probably more important than fixing the multistage builds and
being different.

This change jumps us from v1.9.7 to 2.0.3 (covers releases 2.0.0, 2.0.1,
and 2.0.2 too). A changelog can be found here:

  https://github.com/ether/etherpad-lite/blob/v2.0.3/CHANGELOG.md

Change-Id: Ia7c4f26d893b4fc4a178262e1a6b9f3fa80d2a5c
2024-04-29 14:17:55 -07:00
Zuul 095ac2ae8a Merge "Ubuntu 22.04: Add ceph quincy and reef to mirror" 2024-04-29 16:58:19 +00:00
Clark Boylan 0ce1ba2b38 Remove old infra team puppet testing
The OpenDev team is planning on removing Ubuntu Xenial in the nearish
future. One of the things still running on Xenial is our old puppet
testing. We've decided taht we'll just have to manually manage those
nodes going forward without CI as there are few of them at this point
and we really want to clean up old Ubuntus in nodepool and our mirrors.

There is a risk that this will allow things to break without detection
or otherwise create new problems, but this stuff has been neglected so
that risk was there anyway.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/917198
Change-Id: I4560ae9bbb61e950a7baa1d29aaf677403249012
2024-04-26 16:22:07 +00:00
Zuul 69da8432f9 Merge "Upgrade Gitea's backend DB to MariaDB 10.11" 2024-04-25 18:33:07 +00:00
Jeremy Stanley 17276d0d31 Override upstream ADMINS address for mailman
Deliveries to root@localhost don't work, use the same as the from
address instead.

Change-Id: Id509f652be3b4b6f77edc85161aed7200f672571
2024-04-24 18:02:00 +00:00
Zuul a713d1ded5 Merge "Add robots.txt to Zuul web" 2024-04-24 00:09:28 +00:00
Clark Boylan e7e560e559 Upgrade Gerrit's backend database to MariaDB 10.11
This change won't automatically perform the upgrade because we don't let
ansible manage Gerrit's containers directly. But it will update the
docker-compose file for us so that we can manually pull images, down,
then up the containers again which will do the upgrade for us.

This SQL database behind Gerrit only keeps tracks of which files users
have reviewed so its importance is minimal. Getting it updated so we can
bother even less about it is a good thing.

Change-Id: I78b683770496bb3d8e97464ddedaf813780a2a4e
2024-04-23 15:18:29 -07:00
Clark Boylan 691903f1c1 Upgrade Gitea's backend DB to MariaDB 10.11
After upgrading MariaDB behind several services from 10.4 to 10.11 it is
now Gitea's turn. Use the auto upgrade method as we've done elsewhere
and update Gitea's DB too.

Change-Id: I01aab3c55f1af4f883efe05bf8862ccd50a07631
2024-04-23 15:16:41 -07:00
Zuul 4683a2342e Merge "Apply apache us filter to Zuul" 2024-04-23 19:27:34 +00:00
Zuul 1a7ad511da Merge "Rebuild our base python images" 2024-04-23 18:19:05 +00:00
Zuul f57a5aa61b Merge "Use UA filter in mailman apache vhost" 2024-04-23 17:42:14 +00:00
Zuul 196817156d Merge "Add robots.txt to our list servers" 2024-04-23 17:25:21 +00:00
Clark Boylan 6c37d8f202 Rebuild our base python images
This is our semi regular python base image rebuild. This ensures we're
running relatively up to date python builds as well as base system
packages (though many of our image builds update the base system too).

Change-Id: Ice918219a64bd5845de9dc3330bf292261c6a80e
2024-04-23 09:01:43 -07:00
Clark Boylan e3cf34414b Use UA filter in mailman apache vhost
We're noticing that mailman's uwsgi queue is filling up. Before we try
to extend the queue apply our user agent filter to apache to reduce the
number of requests that hit the queue in the first place.

Change-Id: Ib821a7fffa6239a9affcc4c6698eef2dc9378cd1
2024-04-23 08:51:53 -07:00
Clark Boylan c499b57e16 Add robots.txt to our list servers
We've noticed that our uwsgi queues are filling up and a lot of requests
are being made to robots.txt which ends up 500/503 erroring. Add a
robots.txt file which allows crawling of our lists and archives with a
delay value in hopes this will cause bots to cache results and not fill
up the queue with repetetive requests.

Change-Id: I660d8d43f6b2d96663212d93ec48e67d86e9e761
2024-04-23 08:51:50 -07:00
Zuul 1d1f8bee20 Merge "reprepro: mirror Ubuntu UCA Caracal for Ubuntu Jammy" 2024-04-23 06:16:24 +00:00
Takashi Kajinami 0b0010dbb2 Ubuntu 22.04: Add ceph quincy and reef to mirror
Ceph quincy and reef packages for Ubuntu Jammy are required by Puppet
CI jobs.

Change-Id: I701e61c9e30515b140c3c2e8131f0a72938b9552
2024-04-21 02:40:37 +09:00
Takashi Kajinami e9428a7dc3 reprepro: mirror Ubuntu UCA Caracal for Ubuntu Jammy
Change-Id: Ib57086a526afb995bdbca43080f4ed16688038ed
2024-04-20 01:02:25 +09:00
Dr. Jens Harbott be45290054 gitea: move robots.txt to public directory
Gitea wants us to move the robots.txt file to a new location. It
currently logs a warning about it:

2024/04/17 19:30:56 cmd/web.go:191:serveInstalled() [E] Found legacy public
      asset "robots.txt" in CustomPath. Please move it to
      /custom/public/robots.txt

Change-Id: Ic4a7f3bbe4633972e0409b37b511fdb03f968442
2024-04-19 14:17:41 +02:00
Zuul 481f128257 Merge "Move gerrit replication waiting queue aside during project renames" 2024-04-17 22:48:39 +00:00
Zuul a89fab4a40 Merge "Upgrade Etherpad's MariaDB to 10.11" 2024-04-17 20:23:23 +00:00
Zuul f56968c92e Merge "Upgrade gitea to v1.21.11" 2024-04-17 19:23:50 +00:00
Zuul 6bb2a585e3 Merge "Add more User Agent filters" 2024-04-17 19:15:19 +00:00
Zuul 62e62af380 Merge "Switch Gitea archive cleanup from weekly to daily" 2024-04-17 18:55:14 +00:00
Zuul 4661dad3b5 Merge "Cleanup lingering Mailman 2 playbook" 2024-04-17 17:54:54 +00:00
Zuul d9d15d9a1c Merge "Upgrade Mailman's MariaDB to 10.11" 2024-04-17 17:04:59 +00:00
Clark Boylan 3e5a2968ff Add more User Agent filters
These filters match Windows with old Chrome that appear to be doing
inappropriate crawling.

Change-Id: Ia83c5596cc82b28f265af55240e52f364baef728
2024-04-17 09:35:20 -07:00
Jeremy Stanley 6466fa8419 Switch Gitea archive cleanup from weekly to daily
Crawlers that ignore our robots.txt are triggering archive creation
so rapidly our rootfs fills up between weekly purges, so doing it
once a day should hopefully mitigate further problems.

Change-Id: Ib4e56fbd666f7bf93c017739697d8443d527b8c7
2024-04-17 14:15:49 +00:00
Clark Boylan 3a44e0cf64 Upgrade gitea to v1.21.11
This is a bugfix update upgrade from v1.21.10 to v1.21.11. None of the
templates we override have been changed between these two versions
according to git diff.

A full changelog can be found here:

  https://github.com/go-gitea/gitea/blob/v1.21.11/CHANGELOG.md

Change-Id: I4d3648e311fe87b275856f2d73aca4a79c2c5507
2024-04-16 08:32:22 -07:00