Commit Graph

93 Commits

Author SHA1 Message Date
Clark Boylan c12ac287cc Remove unused nl0X.openstack.org config files
Once the opendev launchers are handling these duties and these servers
have all been removed from the system-config inventory we can go ahead
and land this change to clean up the unused config files.

Change-Id: I9792620eea81a07b6cbbfee37c08807114d2b390
2021-03-16 14:50:53 -07:00
Clark Boylan e35112e17e Flip nl01.openstack.org to nl01.opendev.org
This flips the active control of the rax providers from
nl01.openstack.org to nl01.opendev.org. This change should only be
landed once we are happy with the deployment of a new nl01.opendev.org
instance.

Change-Id: Idc838c3cb2d631ef684f733b564f7d4713fc3a41
2021-03-10 12:45:27 -08:00
Carlos Goncalves 374b24a4bd CentOS 8 Stream initial deployment
Change-Id: I0b04d92de6287b78bc422dd177403570eb18294a
2020-10-03 10:38:34 +00:00
Clark Boylan 45e8b6e3de Remove fedora-30 from nodepool launchers
This serves as a sanity check that we don't have any fedora-30 usage
hiding somewhere. If this goes in safely then we can remove the image
from the builders.

Change-Id: I09b21e812081f5855a069ca8ab1eedadf090c1b8
2020-09-25 12:03:26 -07:00
Lee Yarwood 91da9f92f6 Add Fedora 32 builds
Change-Id: I0acf6c581cd22a8835928ef643d4237f66ca6181
2020-09-10 13:45:08 +10:00
Jeremy Stanley bb5c75ddf3 Revert "Temporarily disable rax-dfw for mirror reboot"
This reverts commit 3c2a4a34a9.

To be merged once this region's mirror reboot has completed.

Change-Id: Ia692c82579b5be4c775b8b61092a63b6b55faceb
2020-09-04 16:24:11 +00:00
Jeremy Stanley 3c2a4a34a9 Temporarily disable rax-dfw for mirror reboot
While attempting to replace the Cinder volume attached to the
rax-dfw mirror server, the xenwatch reported a page allocation
failure. In order to ensure the new block device is correctly seen
by the guest OS we should reboot it. Temporarily wind down testing
there so as not to disrupt any running jobs when we do so. This can
be reverted after we complete the reboot.

Change-Id: I96f69bfa7e3bb2928f24755fd1ff2cb1b347548c
2020-09-04 16:21:45 +00:00
Ian Wienand 5580f9057f Remove plain images
These are no longer necessary after the merge of
I76befd9e2a054798e8e36500b723870f7c7ae328.

Depends-On: https://review.opendev.org/735774
Change-Id: Id98743d6d2884a15e8496bdefb764287f37cd248
2020-06-16 16:29:17 +10:00
Ian Wienand 5e6125346c Turn -plain nodes down to min-ready 0
After I76befd9e2a054798e8e36500b723870f7c7ae328 we don't need these
nodes, turn them down so none are ready.

Change-Id: I9a539010280ca9611ac32d9c3ba6a64e62d984bd
2020-06-16 16:26:06 +10:00
Ian Wienand 8ec916fa40 Add centos-7 plain nodes
I'm not quite sure why I didn't add this with the other -plain nodes;
add it for completeness.

Change-Id: Ia14c2733272ea4c108dccef4b5c724769ed22a01
2020-06-13 10:22:23 +10:00
Clark Boylan 60f352bfce Use infra-root-keys-2020-05-13 in nodepool
This should only be landed once we've landed the dependency and
confirmed all clouds have the new key value.

This does our semi regular key rotation.

Depends-On: https://review.opendev.org/727865
Change-Id: Ic55c96ad5dd867b70fa52c396e792d5a2e2e0470
2020-05-18 08:52:19 -07:00
Ian Wienand 9e38d47f8e Stop building opensuse-15-plain images
Depends-On: https://review.opendev.org/725750
Change-Id: I36efdede5c3feccb90e470590da146c0be406814
2020-05-07 21:18:47 +02:00
Ian Wienand 59e06614c1 Activate more plain nodes
These are for testing nodes without pip-and-virtualenv.  They have
built correctly and can be used.

Change-Id: I1d7a78dc6bf2b225098195b22974ebe2a0d9af6d
2020-04-28 12:58:12 +10:00
Dr. Jens Harbott d14b65cf46 Launch focal nodes
Focal images were built with [0] and the result looks successful, so
let's start launching them.

[0] https://review.opendev.org/720719

Change-Id: I2b825178df230d13d75e782c60dd247e6d65ac8b
2020-04-26 11:56:28 +00:00
Ian Wienand 378161469b Add Fedora 31 to launchers
Images are built and seem ready to go

Change-Id: I9677af7e15d8b6c561f9f2dc5ed968a6708dd93e
2020-04-03 08:34:52 +11:00
Ian Wienand 7602343b6a nodepool-elements: Use venv for utilities
Since all platforms have Python 3, use the new ensure-venv element
from the dependent change to install bindep and os-testr.

Since we are no longer using pip to install anything during the
builder, this drops the dependency on pip-and-virtualenv from
nodepool-base.  Avoiding this element is our long-term goal, as it's
modification to system state are problematic in a number of ways.  To
maintain the status-quo, the pip-and-virtualenv element is added
explicitly to each build's element list, with a note on it's future.

The current plan for backwards compatability is to replicate the
environment pip-and-virtualenv provides in a base role/job that can be
optionally included.  To test this, provide a new node type
"ubuntu-bionic-plain" that will not include the pip-and-virtualenv
element.  This is put on just one provider (rax) to minimise impact.

The dependent-change (and a dib release) is required before merge so
the ensure-venv element is available.

Depends-On: https://review.opendev.org/707513
Change-Id: I85438baf5bb31790a56fe5b38327361f0a2398e9
2020-03-11 10:12:00 +11:00
Andreas Jaeger dc09dffbe2 Remove Fedora 29 from nodepool
All jobs using Fedora 29 have been removed, we can remove it from
nodepool and thus OpenDev now.

Depends-On: https://review.opendev.org/711969
Change-Id: I75c0713d164c29a47db9a0cdfc43fadb370e81f8
2020-03-10 10:50:37 +01:00
Andreas Jaeger 398adb791f Bye, Bye, Trusty
This removes trusty from the repo and thus from OpenDev.

Afterwards the AFS volume mirror.wheel.trustyx64 can be deleted.

Depends-On: https://review.opendev.org/702771
Depends-On: https://review.opendev.org/702818
Change-Id: I3fa4c26b0c8aeacf1af76f9046ea98edb2fcdbd0
2020-01-19 16:00:55 +01:00
Clark Boylan 88dcfdb488 Remove opensuse-150
The opensuse-150 image is being removed as the 15.0 release is EOL.
Similar to centos the expectation is that users keep up to date with
minor releases. For this we have the opensuse-15 image which should be
used instead.

Depends-On: https://review.opendev.org/#/c/682844/
Change-Id: I8db99f8f2fd4b1b7b9a5e06148ca2dc185ed682b
2019-11-12 12:06:49 -08:00
Sorin Sbarnea a7cda9f926 Bump min-ready for ubuntu-bionic
Flip the min ready values for Xenial and Bionic. This should've been
done when we did the initial transition from Xenial to Bionic but was
missed. We want to have ready nodes for the common up to date ubuntu
platform (Bionic) and don't as many on the previous release (Xenial).

Thank you to zbr for catching this after noticing that linter jobs took
a while to start.

Change-Id: I5e2c4b6a056b50077ab343535a4bbe3bc49a0acf
2019-10-25 22:21:49 +00:00
Ian Wienand b4daf4e47b Remove fedora-28 nodes
The time has come to retire fedora-28; remove from configuration.

Change-Id: Ic0b4b065a217dcfaa8c230cda53114793e93b803
2019-10-23 09:38:40 +11:00
Ian Wienand 00d8bb0587 Stop building Fedora 28, turn down min-ready
In preparation for removal

Change-Id: I4d9fbc9c8f946cb20efca2b742476db2c1b4b5ff
2019-10-23 09:35:09 +11:00
James E. Blair 19380c9b59 Remove opensuse-423 from nodepool
This label/image is no longer supported.

Change-Id: Ic48d7db4c6b7b1dd2589118c630f45deee19730f
2019-10-16 07:50:22 +02:00
Ian Wienand 0a13b1dd92 CentOS 8 initial deployment
This is for an initial build and debug purposes

Change-Id: I5bbb83bf313f13c216ca3e031d7a8e3dc8ba7cc7
2019-10-09 17:02:01 +11:00
Ian Wienand e38efe3a84 Add Fedora 30 nodes
Fedora 30 is supported with diskimage-builder's 2.27.0 release
recently tagged

Change-Id: Ic0316a0e755b67181ae74c06f712e351ea485de7
2019-09-09 16:56:02 +10:00
Dirk Mueller eb81a56ac1 Add openSUSE 15.1 to the nodepool building as opensuse-15
The main reason why we can do this cleanup now is because there has been a policy
change with openSUSE Leap 15: the minor releases like 15.1 and 15.2 are similarly
backwards compatible like e.g. minor releases in centos 7.x are, as such
we can build an opensuse 15 image in the ci and update all jobs to that
one to have less continuous effort in maintaining the opensuse builds.

Depends-On: https://review.opendev.org/#/c/660137/

Change-Id: I2b1f21fb6e01558c8cee27de116dfc857a1a1c91
2019-06-14 17:08:40 +02:00
Thomas Goirand 7bd7b5f044 Add a Debian Buster image.
Change-Id: Ia55d240fa8ce1d19ef69608e68c47e02776f15ca
2019-05-21 13:47:04 +02:00
Ian Wienand 1fdd6945d6 Revert "Add CentOS NetworkManager testing node"
This reverts commit 32e63aa0c8 (and
small follow-on fix 0eeb4395d1)

The base CentOS node is switched to NetworkManager support

Change-Id: Ic254273afdf0637194b608b781ea9e3ff4bd73a3
2019-01-14 09:42:59 +11:00
Ian Wienand 32e63aa0c8 Add CentOS NetworkManager testing node
This enables NetworkManager control of interfaces on a new centos7-nm
node type.  This is intended only for short-term initial testing.

Change-Id: I43318f33d206c28e1f06ac7a8f07c3fb8c8f0626
2019-01-10 10:03:31 +11:00
Ian Wienand 1c650ef2c7 Add Fedora 29 nodes
Add Fedora 29 nodes

Depends-On: https://review.openstack.org/618671
Change-Id: Icea5721c295d31a7efc953bd71fa914727c56d08
2019-01-09 15:53:57 +11:00
Clark Boylan 57eaa73695 Switch nodepool launchers to use new zk cluster
This should happen at the same time as we switch the zuul scheduler over
to the new zk cluster and after the nodepool builders have populated
image data on the new zk cluster.

This gets us off the old nodepool.o.o server and onto newer HA cluster.

Change-Id: I9cea03f726d4acb21ad5584f8db7a4d15bc556db
2018-10-22 09:23:12 -07:00
Ian Wienand 156ffcd032
Add gentoo to providers
We've added gentoo images for building, but no providers currently
have a gentoo image defined.  Add them.

Change-Id: I89ee589df468d0eb32952fd3a899b834f823ad39
2018-09-14 12:00:02 -05:00
Matthew Thode 8bd4bbc909
set Gentoo's min-ready to 1
Also correct the name of the gentoo image

Change-Id: I30d6c7e8401e03e8b6efdff4d703e36064caf406
2018-09-13 14:47:25 -05:00
Paul Belanger 578d1dcc58
Remove fedora-27 from nodepool
We have no jobs using these images, we can safely remove them
from nodepool.

Change-Id: I6634317838bce4f5bbffe756d96e7dc4588b46fa
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-13 12:01:50 -04:00
Paul Belanger d3b3fb1910
Set fedora-27 min-ready to 0
We are in the process of remove this image from nodepool, and jobs are
now using fedora-28.

Change-Id: I58db5231681ccb033f23c7110050e814266abf2a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-13 10:37:48 -04:00
Monty Taylor 27bf8d6d6f Use infra-root-keys-2018-06-15 in nodepool
The new keypair object has the updated set of ssh keys. Once the new
object is in the clouds we can consume it for nodes.

Change-Id: I5d71fee91504d88129cc307d4855f83b85c6a2b4
2018-06-15 19:55:29 +00:00
Markos Chandras 814513410f nodepool: Set min-ready to '1' for opensuse-150
We can now build openSUSE Leap 15 images, so allow the various
clouds to use it.

Change-Id: Iab5cb1679b999d40ad4034f6cac8b24711a78f0f
2018-06-04 08:18:20 +01:00
Paul Belanger c1118e51bb
Set min-ready 1 for fedora-28
Now that we have properly built a fedora-28 image, allow our cloud
providers to use it.

Change-Id: I3b6a333c0a19d091a2935ca422afc311fe15bc6c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-30 16:46:33 -04:00
Paul Belanger e53995db51
Remove debian-jessie from nodepool
We no longer have any jobs using debian-jessie, so it is now safe to
remove debian-jessie.

Change-Id: I26d14287f8ef236ba80f24a6a45b0754043968db
Depends-On: https://review.openstack.org/562870
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-20 12:25:15 -04:00
Paul Belanger b1899f692d
Set min-ready for debian-jessie to 0
We are in the process of remove debian-jessie from nodepool, this is
the first step to doing so.

Change-Id: I81a978772efa69424a2c3afdc7ced3e6ed47c847
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-20 10:20:41 -04:00
Paul Belanger a2f6d62208
Clean up diskimages for debian-(jessie|stretch)
Ensure both amd64/arm64 DIBs for nodepool are using the same settings.

Also adds missing label for debien-stretch on nl01.o.o.

Change-Id: Ifc6759637c287754a298576cc5c0409f19ded142
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-09 15:30:46 -04:00
Xinliang Liu 7af4e3a2e9 Add debian stretch nodes to arm64/amd64 clouds
Stretch is the latest stable debian release.  So add debian stretch
nodes to arm64 and amd64 clouds.

Note we're updating to use our internal debian mirrors, which now have
arm64 too.

Depends-On: https://review.openstack.org/557942
Change-Id: Idb88d863b5b13286d791970be396c92eff470a81
2018-04-05 09:21:53 +10:00
Paul Belanger 0b8d14fefd
Remove fedora-26 nodes from nodepool
We've had fedora-27 nodes online for a while now, plus we've recommend
jobs be moved to fedora-27:

  http://lists.openstack.org/pipermail/openstack-dev/2018-March/127945.html

We really only want to keep a single fedora node online, due to how
long the support lifecyle is.

Change-Id: Ie13e68eb3e7a266aa51d883b6d410832565e8f16
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-04 11:07:34 -04:00
Paul Belanger c529ef831a
Set min-ready for fedora-26 to 0
Start the process of removing fedora-26 nodes from nodepool.  This
will happen over a series of commits.

Change-Id: I5fac84e9d21817438ba1561e8c609bd856d07985
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-04 11:03:28 -04:00
Paul Belanger 8d86f7184f
Add ubuntu-bionic to nodepool
As ubuntu-bionic is the new LTS for ubuntu, start providing images in
nodepool.  Something to note, bionic isn't actually released yet.
However our tooling does work and is able to create workable images.

We should hold off to migrating jobs from ubuntu-xenial to
ubuntu-bionic until it is officially released, and we have a migration
plan in place.

Change-Id: If12435969ca37400bfd04abe8470048146be7aa3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-27 06:56:41 -05:00
Paul Belanger 9f5b8baa96 Remove max-ready-age from nodepool
We've landed a fix in nodepool to help reduce the chance of a provider
wedge. Remove max-ready-age, to allow our nodepool fix to handle the
issue.

Change-Id: I02b7112d4fdfb0315ad964924692b0968bdf76b4
Depends-On: https://review.openstack.org/539316
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-27 09:19:45 +00:00
Ian Wienand 653c54d96e Add arm64 min-ready to nl03
The launcher calls self.labelImageIsAvailable when calculating the
min-ready values.  This doesn't work if the launcher doesn't have
entries for that label.

Move the arm64 min-ready into nl03 (and out of nl01) and add a note on
this behaviour.

[1] https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/launcher.py#n946

Change-Id: I060af7501a8e1106cea673a99fce332fcda73290
2018-02-23 16:14:22 +11:00
Ian Wienand 2b78cddaad Add arm64 nodes to launcher
Add configuration for arm64 nodes to nl03

Change-Id: Id97a09a459a2336cf528aa551d022217b85b5f01
Depends-On: https://review.openstack.org/546834
2018-02-23 10:43:11 +11:00
Paul Belanger a9b3c04b47
Bring online opensuse-tumbleweed images
Now that we've been able to build / upload an images, add
configuration and have nodepool boot it.

Change-Id: Ieaaaa8d5f3c65e41964a0eda18072d298cfb15a8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-21 19:30:07 -05:00
Paul Belanger 2d8f0f5a9a
Reduce duplicate data in nodepool configuration
We can use yaml anchors to help reduce duplicate data in nodepool.yaml
files.

Change-Id: I59b43d87340fc0adf37d251c01a0c3092deb3be7
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-21 19:24:08 -05:00