Commit Graph

17 Commits

Author SHA1 Message Date
Ian Wienand cbff37f82e Cleanup nodepool.openstack.org to be a zk server
This is just a zookeeper server now, so doesn't need all these
passwords, a cloud.yaml file or a launcher-esque deployment.

Change-Id: I3cb20d9c8af150ecdc1fb0a16208a774e3fb530f
2018-07-30 14:12:33 +10:00
David Shrewsbury ebee144eda Add logging config for openstacksdk
Nodepool is switching away from using shade to using openstacksdk.
The adds the logging for openstacksdk, but does not yet remove
shade in case we need to revert nodepool. The next review should
remove shade logging entirely.

Change-Id: I7e6820c2f8ea044cc97c322ae9b91fe0bee559db
2018-07-17 14:31:59 -04:00
Clark Boylan a6c2ec56b5 Log gear at debug level on nodepoold
We need to log gear at a debug level temporarily in order to debug a
gear communication issue between zuul and nodepool. tcpdump shows the
data is moving between the hosts we just aren't making use of it
properly.

Change-Id: I40e957452721a0e3e82cca4e39f9c56825736d38
2016-08-29 14:22:52 -07:00
Clark Boylan 8ed863ad9d Provide separate nodepool builder log config
Now that the nodepool builder is running as a separate daemon it needs
its own log config file. Move the auto generated nodepool logging config
stuff over to the new builder logging config as we can manage the main
daemon's logging config by hand trivially now.

Depends-On: I013835621dfbc311a0f7bd7c957b7d4656dfa628
Change-Id: Ic1da30eab949876e5bd6c88e83979bdedc6dd50a
2016-01-29 10:20:40 -08:00
James E. Blair 5e6c18ef69 Add shade logging to nodepool
At warning level.

Change-Id: Iac65988477a0c0c80e0b2f3c8829e09c8e4e50f9
2015-11-19 18:14:04 -08:00
Derek Higgins a00b4713fb Add Fedora 22 images to the tripleo cloud
We will soon be switching our f21 based jobs to f22, so adding a small number
of nodes to test an initial periodic job on, prepare_node.sh has been tested
and works on these nodes.

Change-Id: Ide20099eb181382b792112cbfb06ef20aa358f9c
2015-10-15 13:55:43 +01:00
Derek Higgins f149da339c Remove unused node templates from tripleo cloud
Both tripleo-f20 and tripleo-precise are no longer in use, remove them
and with the extra capacity increase the number of tripleo-f21 nodes we
keep ready.

Change-Id: I3c603677a5425a8d073df4e6927ccce4d5bb2da3
2015-10-14 12:34:23 +01:00
Ian Wienand 4de87db276 Turn image logging level up to DEBUG
In I54db78b028017500b58693ec717c23eaf6a220b6 I added some handy values
that are intendend to go into public log files to help you establish
when an image-build has started or stopped (for example, [1] is
currently ~300MiB of looping build log data and it's really hard to
pick out where things are going wrong).

The problem is, I put them in at DEBUG level and the image loggers are
only set to INFO level.  So the messages aren't making it into the
public logfiles as hoped, and thus not available to help people
diagnose issues with their builds.

I think the best idea is to turn these up to DEBUG level to capture
these, and any other low-level messages from this logger, in the
public output.

[1] http://nodepool.openstack.org/image.log

Change-Id: Ib9ac5fc81ccef73f1b1e20b8381bdd1afac4bcae
2015-10-01 13:14:45 +10:00
Ian Wienand 620de8bc70 Add Fedora 22 DIB nodes
Working on bringing up Fedora 22 nodes.  The dependent chain will need
to be merged to diskimage-builder; still verifying nodepool element &
devstack-gate scripts but having the logs from real builds will be
helpful.

Note the plan is get rid of F21 nodes as soon as this is ready and
doing devstack CI.

Change-Id: I4ca94054b6f96f6e3b258517bdf12ce070692ffa
Depends-On: Icbd08fb5aa69446ad65ff72af631902c4e1fa12b
Depends-On: Ic8b0fd2a19cbb90e1d57e3025a3d2513ebada2e2
2015-09-18 15:21:10 +10:00
Jeremy Stanley 7d2ceb6e79 Simplify nodepool diskimage logging
There's no need to create per-provider image update logs for
providers which only use diskimages of the same.

Change-Id: I06e5413ac9357587cd4aa7afa34414b0cc01c124
2015-05-27 00:07:33 +00:00
Clark Boylan 3e5d02828b Add ubuntu-trusty images to rax
We are using shade to upload dib images now which means we can upload
images built with glean to rackspace and expect them to work as long as
they have config drives attached. Update nodepool's config to host
ubuntu-trusty nodes in rackspace using the shade image upload feature.

Change-Id: I6604cdb2b20225cb9b17474a490ddebc7813cc03
2015-05-26 23:35:01 +00:00
Derek Higgins 0617507f4d Add a Fedora 21 node to tripleo cloud
Make Fedora 21 nodes available on the tripleo cloud, leave
F20 nodes available and in use while we test everything is
working on F21.

Change-Id: If4edb6915a274e552cd78733d01066c790fa7b6e
2015-05-07 20:46:06 +01:00
Monty Taylor 6f26bc0b6a Start building ubuntu-trusty nodes
As the next step in dib-nodepool, start making nodes called
ubuntu-trusty based on the ubuntu-minimal element which is now in
diskiamge-builder 0.1.44. No jobs should be targetted at this label yet,
however, it is named with the new naming in mind, $distro-$release.

Once these exist, we should be able to start aiming some experimental
devstack jobs at them to make sure that nothing is missing.

Change-Id: I75838d89b6ad7271d8022abbaa0aa4cca3e16525
2015-05-05 02:40:35 +00:00
Ian Wienand 11b08498da Split diskimage-builder built images out
This is the second part of splitting out log files for image builds;
putting diskimage-builder logs into separate files.  They are added
with a special "dib" provider to keep them grouped.

Change-Id: I6406f63df2f625beee57d7ff9707bd3b4f3fc060
2015-05-04 01:40:18 +00:00
Jeremy Stanley ca10afe824 Add a centos-6 node label
These are the "centos6" corollary to devstack-.* node labels, but
we're not likely to run DevStack on them. Avoid confusion by going
ahead and using the new platform naming pattern settled on in the
2015-03-31 Infra meeting.

http://eavesdrop.openstack.org/meetings/infra/2015/infra.2015-03-31-19.00.html

Also update the nodepool logging config to get it back in sync with
reality.

Change-Id: Ie629b6b8e8f2401e3769a7b2c54844d950d9fd60
2015-04-24 01:19:39 +00:00
Ian Wienand 0e3de8026f Remove devstack-f20 nodes
After the dependent changes merge, no jobs are using devstack-f20
nodes so we can remove them.

The one specific work-around in the puppet-scripts is removed.  The
logging configuration for nodepool is also regenerated.

Change-Id: I435f0d95dbe7f5d8e90c1fe8368dd42ebb241c88
Depends-On: Ifa742ba5bdae0b796b8b92336e41234fd8b7939e
Depends-On: I4773d3ba1ee29880e928e25257ce188e7bd7dc90
2015-04-08 16:53:21 +10:00
Ian Wienand 3bafd2c691 Generate nodepool logging configuration
Generate a logging configuration template for nodepool that splits
image-build logs out into separate files.

A tool to generate and maintain this file based on the nodepool
configuration is added.

The logging configuration template this tool creates is added
alongside the main configuration.  This is passed to the deployment
puppet module via a parameter.

Change-Id: I4723c68e5c83b536560e0a8bd7b73e312b46fc02
Depends-on: Iec77fb62c353d09186140b23912caf02225a643b
2015-03-19 10:32:24 +11:00