Commit Graph

413 Commits

Author SHA1 Message Date
Clark Boylan 09288c7c37 Manage clouds.yaml files in ansible
This manages the clouds.yaml files in ansible so that we can get them
updated automatically on bridge.openstack.org (which does not puppet).

Co-Authored-By: James E. Blair <jeblair@redhat.com>
Depends-On: https://review.openstack.org/598378
Change-Id: I2071f2593f57024bc985e18eaf1ffbf6f3d38140
2018-09-04 08:49:00 -07:00
Mohammed Naser 1534c42409 Adding SJC1 for VEXXHOST
Change-Id: Ia4bf3fcd576d415418f756cb07609b817d035534
2018-08-27 11:34:53 -04:00
Ian Wienand cbff37f82e Cleanup nodepool.openstack.org to be a zk server
This is just a zookeeper server now, so doesn't need all these
passwords, a cloud.yaml file or a launcher-esque deployment.

Change-Id: I3cb20d9c8af150ecdc1fb0a16208a774e3fb530f
2018-07-30 14:12:33 +10:00
David Shrewsbury 10e4c57128 Use nodepool-builder.logging.conf from puppet-nodepool
Generating a openstack-infra specific version of this file was
deprecated with change I6fdc3b622454b069f3ad2cf42da584d8df23a110 when
build logs was moved out of Python logging.

This means (post the depends-on) the file is exactly as kept in
puppet-nodepool.  Remove the system-config template and just use that.

Depends-On: https://review.openstack.org/586231
Change-Id: I2db37868be12c146678f1c8934db80050c788540
2018-07-30 14:07:53 +10:00
Paul Belanger 39d667591e
Set image_format to raw for packethost
To avoid the cost of converting nodepool image from qcow2 to raw on
compute nodes, just upload raw images (not qcow2).

Change-Id: I325af734f843fc618a40ca992a0086ffb1c21cfd
Depends-On: https://review.openstack.org/585838
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-07-25 14:08:55 -04:00
Monty Taylor 0d2063cf68
Set vexxhost auth_type to password
There is a bug in sdk that is being fixed that causes auth discovery to
work improperly. Setting auth_type to password works around it.

Change-Id: Id8e8fe82827987660c4dc64bd9cf3d65ffd20cf4
2018-07-18 19:28:06 -05:00
David Shrewsbury ebee144eda Add logging config for openstacksdk
Nodepool is switching away from using shade to using openstacksdk.
The adds the logging for openstacksdk, but does not yet remove
shade in case we need to revert nodepool. The next review should
remove shade logging entirely.

Change-Id: I7e6820c2f8ea044cc97c322ae9b91fe0bee559db
2018-07-17 14:31:59 -04:00
Jeremy Stanley 059115aa2f Revert "Force nodepool to use ipv4 in vexxhost"
This reverts commit 6baef98ed6.

Letting nodes without working IPv6 but with IPv6 global routes into
the pool does nothing but cause jobs which attempt to run on them to
fail.

Change-Id: I8921936dd5fdcb4565669f34ea49006ced40e996
2018-07-01 17:13:55 +00:00
Clark Boylan 6baef98ed6 Force nodepool to use ipv4 in vexxhost
Ipv6 is currently having routing issues to vexxhost IPs. Force ipv4
temporarily until this is corrected.

Change-Id: Ib935e10edd8285f7f42f7091fb47f6d872dbc57a
2018-06-29 14:35:32 -07:00
Ian Wienand a05486fa22 Add identity_api_version to packethost
Every "openstack" cli operation gives

 Ignoring domain related config project_domain_name because identity API version is 2.0
 Ignoring domain related config user_domain_name because identity API version is 2.0

I feel like this should be auto-detected to v3 but not sure how.  Add
the identity_api_version as done in the other clouds.

(I proposed making that message clearer in
https://review.openstack.org/577324)

Change-Id: I22f8d342968c9084d05d841d6e3ab660a62c3262
2018-06-22 11:47:39 +10:00
Ian Wienand 47c7ee6086 packethost: fix default network setting
It's actually "default_interface", not just "default".  I must have
tested with it correct, then copied it in wrong to system-config :/

Change-Id: I38a76c2d162a9ef35ebaa87080d6986af1a3daa2
2018-06-19 11:44:37 +10:00
Ian Wienand 9f0bbc738a Fix typo in packethost configuration
This typo was introduced with
I88ccdca80477fa06d33e5785d764a546e88a76a5; I copy-pasted it wrong.

Change-Id: Ia1b66107b332bbb8cbb82c26ed6246c9506c014e
2018-06-15 13:53:32 +10:00
Ian Wienand c9dfa29fc0 Add default network to packethost
For ... reasons ... it seems we can't detect the default network on
packethost.  Override it in clouds.yaml, while we possibly figure out
what is going wrong.

Change-Id: I88ccdca80477fa06d33e5785d764a546e88a76a5
2018-06-15 07:24:47 +10:00
Clark Boylan 7a68034f5d Update vexxhost to use keystone v3 auth
They appear to have disabled v2.

Change-Id: Ie9025ee196a57bcdb3be046ee22e585debc1aa30
2018-06-13 10:55:18 -07:00
Jeremy Stanley acb2e9e6f0 Template credentials for Packet Host/Platform 9
Packet Host and Platform 9 have generously agreed to donate some
compute resources to our testing efforts. Add Nodepool and
Puppetmaster credentials for them.

Change-Id: I705c4204abca060c35a1a417791a67229b78cd02
2018-06-12 00:59:09 +00:00
Colleen Murphy ac9a031e32 Stop managing infracloud things
Infracloud is sadly deceased. The upside is we can delete a lot of code
we don't need anymore. This patch removes infracloud nodes from
site.pp so that the puppet-apply test no longer bothers to validate
them, removes the infracloud modules from modules.env so that we don't
bother to install those modules in puppet-apply and puppet functional
tests, and removes the infracloud-specific data from the public hiera.
Additionally stop the puppetmaster from trying to run the infracloud
ansible playbook and finally remove the chocolate region from nodepool's
clouds.yaml (vanilla was already done).

This patch leaves the run_infracloud.sh script and the
infracloud-specific ansible playbooks as well as the infracloud
manifests in the openstack_project puppet module. It's possible those
tools could come in handy in the future if we ever have another
infracloud, and leaving those tools in place doesn't add confusion about
which hosts are actually active nor does it leave cruft that gets
unnecessarily tested.

Change-Id: Ic760cc55f8e17fa7f39f2dd0433f5560aa8e2d65
2018-04-24 09:13:40 +02:00
Paul Belanger 758977bf17
Set floating_ip_source for limestone cloud in nodepool
Because of ipv6 support in limestone-region one, we don't actually
need to ask for FIPs.  Stop doing this so we can bring more servers
online.

Change-Id: I48fe176c4a78683834246f59850276133c26e19f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-03-26 13:34:39 -04:00
David Moreau Simard cb48653415
Fix bad path for limestone certificate on nodepool servers
Copy/pasta from puppetmaster.o.o meant that we tried to put and use
the certificate in /etc/openstack/ which is not a thing on nodepool
nodes.

Fix that to be the right location and update the nodepool clouds.yaml.

Change-Id: Ib9c17a58fc2aa9ad5eb9091a6a3fd23ff5825731
2018-03-24 15:33:12 -04:00
David Moreau Simard ead85b623f
Add limestone credentials to nodepool's cloud.yaml
This makes the credentials available so nodepool launcher and builder
can use them.
The limestone credentials have been added to hiera for the nodepool
group.

Change-Id: Idb56db19110e6b30f6231869ff278b90caf99f4b
2018-03-22 18:16:30 -04:00
Paul Belanger 64d7c4e082
Update vexxhost to use raw images
A request from mnaser to use raw images for the provider. There is
also a proposed change to os-client-config to add this, but will need
to be tagged as a new release.

See: https://review.openstack.org/554351

We can revert once os-client-config has been released to pypi.

Change-Id: Ifc3d5656b7b972d5978b4d806c41bf2cc3443842
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-03-19 16:46:24 -04:00
Ian Wienand 53ac2cfeae Remove per-image logging from nodepool-builder logging config
Change Ia7415d2fbbb320f8eddc4e46c3a055414df5f997 removed per-image
logging from nodepool; it now keeps a series of named log files.  The
"image" logger is removed, along with all the specific build logs.

I972a66f9c153f52df934d25ab2f77596bb2e5429 removed the
image_log_document_root argument; which wasn't doing anything in
nodepool::builder, but was actually being used to fill-out the
builder-logging.conf file.  Thus we need this to not have a bad path
in the config file.

Change-Id: I6fdc3b622454b069f3ad2cf42da584d8df23a110
2018-02-26 14:12:35 +11:00
Ian Wienand 2869020b49 Add linaro cloud to nodepool clouds.yaml
I have added the keys in hiera

Change-Id: Ief447157bb1e14024b8ae5b06dddb8d12b2f62db
2018-02-23 14:05:43 +11:00
Paul Belanger a21fde83ca
Remove tripleo-test-cloud-rh(1|2) support
We longer have any jobs or need to manage VMs in
tripleo-test-cloud-rh(1|2).  This hardware still eventually be removed
so lets also remove it from our configuration.

Change-Id: I588ae945df15beceaf7a60bf6a65b1615b2074f0
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-01-31 15:27:48 -05:00
Paul Belanger d05e28dbd5
Remove old clouds from nodepool-builder logging
We no longer have infracloud or tripleo-test-cloud-rh1 online, we can
remove them from nodepool-builder logging.

Change-Id: Ie71b5bd1ee56417846b2a62c40dbd2fd4fa8221e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-01-31 15:25:28 -05:00
Paul Belanger 4ca2a7a598
Remove support for snapshot images in nodepool
Update our nodepool_log_config.py script and remove support for
snapshots.

Generate latest version of nodepool-builder logging.

Change-Id: Ib87e8c352b56f63ca44668f43fa440645fab9f37
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-01-21 18:20:00 -05:00
Paul Belanger 5c78357e9e
Remove infracloud-vanilla from clouds.yaml
The controller for infracloud-vanilla is no longer working, remove
access to it from our services.

Change-Id: Ic2a44f74493d3f328398b67262ae93253714bf67
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-01-12 14:02:05 -05:00
Paul Belanger 8203794c1d
Move api_timeout into clouds.yaml for nodepool
It seems api_timeout has moved out of nodepool into clouds.yaml. So
add the settings here.

Change-Id: I01613df6d64e7af635018ad3837a50487ecd5950
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-12-06 14:35:02 -05:00
Ian Wienand 4dce569343 Remove Fedora 25, add Fedora 27 mirror
Remove Fedora 25 from the mirror script and add Fedora 27.  Update the
nodepool builder logging conf file, as the builds were removed
in I1fae6458402d6afe97069c3a17bbbf563afff20b.

Change-Id: Ib8d1b4bb3069cf48d1abc7c6fccd56d16bf54739
2017-12-01 14:47:35 +11:00
Clark Boylan cb51d5b332 Force OVH to use ipv4 in shade
OVH instances are getting ipv6 addresses now. This is great except that
the only info on these addresses seems to be in the nova/neutron api and
not via ipv6 router advertisements or config drive metadata. Until we
sort out a programmatic way to configure ipv6 on the instances at boot
lets not attempt to use ipv6 when connecting to OVH instances.

Change-Id: I48e773b9f29fae9a15f6c95fc64831ab0749cc60
2017-09-07 10:32:10 -07:00
Jenkins 98c9bdf5bd Merge "Force IPv4 on Rackspace for nodepool" 2017-09-03 23:30:28 +00:00
Monty Taylor c7f6e065d8
Force IPv4 on Rackspace for nodepool
We don't support v6 for centos in glean, and we need glean for
networking in rackspace. Turn off v6 until we support it.

Change-Id: I0b1f6bd0a699f85e84a4414bc72c3aaaf1672555
2017-09-03 18:13:27 -05:00
Paul Belanger 3f9d060795
Remove datacentred credentials
We currently are not using these in production, remove them to help
clean up our clouds.yaml files.

Change-Id: I81b4de2fda50b61a17e99c30cfe4ec44c55df343
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-09-03 16:13:24 -04:00
Paul Belanger e9b7e5e9ce
Remove entercloud credentials
Clean up our clouds.yaml files and remove any clouds we are not using
in production.

Change-Id: Ib13f394126d44187d170ebfd976c34087305c835
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-09-03 16:11:08 -04:00
James E. Blair 1b5d1ddb11
Remove internap clouds
This removes remaining references to internap (renamed to inap).

It also updates some items (cacti/nodepool logging) that were missed
in the rename.

Change-Id: Ibafd416e9e55aa458a50eb71922065a35e3d99f4
2017-09-03 16:02:16 -04:00
Paul Belanger 1bc4dabc45 Remove internap-nyj01
We don't actually use this region any more, remove it so we don't
attempt to access it with dynamic inventory with ansible.

Change-Id: Ic6d4474a61ee32d198f4d70800fd79b8bd80623f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-08-17 12:12:51 -04:00
James E. Blair 9b6582d673 Add inap cloud definition
This is a step in the internap -> inap rename.

Change-Id: I24b7a61236a40b4aecb61475930bd74271ba56d6
2017-08-11 13:46:59 -07:00
Andreas Jaeger 3556931d59 Regenerate nodepool-builder log
Regenerate file with current data.
This adds:
 dib_fedora-26
This removes:
 osic-cloud1-s3500_upload
 osic-cloud1-s3700_upload

Change-Id: I3d87c67c0a8d1399c3595858497028a5af25c2b9
2017-08-05 18:38:07 +02:00
Andreas Jaeger 45e9393300 Remove OSIC cloud
OSIC has been decommissioned, remove configuration for it.

Change-Id: I18e5f604042740b03273d4506f8e8254e77c3e3e
2017-08-05 18:37:14 +02:00
Dirk Mueller 6bd7cc7e7b Prepare nodepool-builder logging config for openSUSE 42.3
openSUSE 42.3 is currently in feature freeze so it will become
the default stable release. Prepare infrastructure to handle
42.3 nodepool image builds.

Change-Id: I50cf826c13e40dd191ad62298d94dbf32a11e518
2017-07-13 21:51:52 +02:00
Jesse Keating 1d41039356 Remove bluebox cloud
This cloud is being decommissioned.

Change-Id: I26b51425d21e3ee86eb36763e1dedfd65e78d2b7
2017-06-29 17:14:35 -07:00
Paul Belanger fbab4c56e1
Rename to opensuse-422 for DIB logging
Change-Id: I6dc19c3e43ecd7003967f3ec7599db48bba70f32
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-24 17:54:24 -04:00
Paul Belanger 3a63a9fd04
Sync latest nodepool-builder log file
Pull in opensuse DIBs and citycloud provider.

Change-Id: Ic9148d0333a8f991d9d5ee1dc10999bd99a61b83
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-24 16:42:07 -04:00
Jenkins 7ec488e24b Merge "Refresh nodepool-builder.logging.conf file" 2017-05-24 18:07:16 +00:00
Kevin Carter 894fc58c08 Changed the domain name for cloud1.osic.org
Sadly the domain name osic.org has gone away, this change adjusts the
domain name to "cloud1.osic.xyz".

Change-Id: If697dfc9ba005ab8ea0eb54eff5dee21ca27158a
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2017-05-23 14:53:11 -05:00
Clark Boylan 188e67ff64 Override Bluebox Keystone endpoint for v3
Bluebox keystone v3 api isn't properly discoverable which causes
problems when attempting to perform actions like creating new projects.
Address this by explicitly setting the endpoint location using a config
override.

Change-Id: I57c6a6733ee520fb074c72f0a3e15f7c45468730
2017-05-19 11:57:02 -07:00
Clark Boylan 787c7d7f8d Flip cityclouds projects around
The way we got quotas assigned we need to flip the projects assigned to
users around so that the zuul user gets to run 50 instances per region
and the ci user has just enough to boot the region local mirrors.

Change-Id: I053cf630e513fbb795f8039672a8073a354bf9b6
2017-05-11 12:40:32 -07:00
Clark Boylan 92eaecc0a3 Update citycloud to non demo accounts
This updates our citycloud clouds.yaml info to non demo accounts. Step
zero into taking citycloud to production.

Change-Id: Id7b1c739fffc7973c27eca6c5066dc3143611cb8
2017-05-10 07:33:56 -07:00
Paul Belanger 5cb54fe82a Refresh nodepool-builder.logging.conf file
Change-Id: Ieb4b910dc82706dfdb15465ac582d251f0069aa2
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-07 12:32:10 -04:00
Monty Taylor 6125601ddb
Bump shade logging to debug for nodepool builders
There aren't that many cloud interactions that the builders do - but
tracking the interactions would be nice in terms of tracing issues that
arise.

Change-Id: I6a0e8afb3c1334195d7b74b55d727e5d05975b3f
2017-02-01 09:39:29 -06:00
Paul Belanger 6d07f896af Refresh nodepool-builder logging for fedora-25
Change-Id: I00206e3bd4eec460639954c8d7d4a58322bcc1f1
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-01-13 13:28:52 -05:00