Commit Graph

14 Commits

Author SHA1 Message Date
Clark Boylan fb7c8790dd Retire this project
We've shutdown the log processing service and don't need to manage it
with puppet any more.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/839235
Change-Id: I451488faf6a7502a5171d2a4299d7a4e40d96072
2022-04-25 09:48:21 -07:00
Clark Boylan 772a94ff6d Force geard to listen on ::
By default geard only listens on ipv4 0.0.0.0 which means ipv6
connectiosn don't work. Because we run dual stack and things expect ipv6
to work (we have AAAA dns records after all) force geard to listen on ::
which will accept ipv6 and ipv4 connections.

Change-Id: Ibf3bfc5f80ca139b375ee2902dc3149ac791ef96
2018-10-18 15:47:14 -07:00
Clark Boylan ffb50e9e8e Add support for running a standalone geard
We don't use the jenkins log client 0mq events anymore with zuulv3.
Instead zuul jobs submit the log indexing jobs directly to the gearman
queue for log processing. This means we only need a geard to be running
so add support for running just that daemon.

Change-Id: Iedcb5b29875494b8e18fa125adb08ec2e34d0064
2017-12-22 10:21:52 -08:00
Jens Harbott c646602e20 Fix multiple workers for systemd
systemd evaluated the "# Provides:" comment, need unique keys there.

Change-Id: I1ac6032edf9e14d45bc922221c4e7dd2c221fe11
2017-12-11 17:55:10 +00:00
Jenkins 3aa0ef4305 Merge "Fix deprecated warning for suffix" 2017-03-05 21:57:50 +00:00
K Jonathan Harker d2de15f0e6 Check known pid file when checking service status
This is needed to support running multiple services on the same host,
otherwise all services will report as running if any single service is
running.

Change-Id: Ie6b7918af846af2189324b0b177b45ac858eadba
2016-06-17 08:47:37 -07:00
Paul Belanger 693d42c9a6
Fix deprecated warning for suffix
Change-Id: I5a0ed09fe881e857a66a1d52f5a0117f912be39f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-26 10:50:38 -04:00
Clark Boylan 8491d10d26 Decouple log processing from logstash
As part of the move to logstash 2.0 we are relying on upstream packaging
for logstash. This packaging replaces a lot of the micromanagement of
users and groups and dirs that was done in puppet for logstash. This is
great news because its less work for us but means that the log
processors can't rely on puppet resources for those items and we don't
actually want to install logstash package everywhere we run log
processor daemons.

Since the log processors don't need a logstash service running and
actually don't need any of the logstash stuff at all decouple them
completely and have the log processor daemons use their own user, group,
log dir, config dir, etc. With this in place we can easily switch to
using the logstash packages only where we actually need logstash to be
running.

Change-Id: I2354fbe9d3ab25134c52bfe58f562dfdf9ff6786
2016-03-09 13:52:35 -08:00
K Jonathan Harker 84c7e72312 Revert "Switch to using the new log_processor project"
This reverts commit b548b141ce.

b548b141ce was supposed to depend-on
https://review.openstack.org/248868

Change-Id: If3d4ad8a1cd45e6e63155a76dc1477ab38b156e3
2015-12-07 16:21:00 -08:00
K Jonathan Harker b548b141ce Switch to using the new log_processor project
The python scripts have been moved to their own project at
openstack-infra/log_processor. Delete the files here and start
installing that project from source. As a part of this split, the
.py extension has been dropped from the filename of the installed
executables.

Change-Id: Ied3025df46b5014a092be0c26e43d4f90699a43f
2015-11-25 15:23:26 -08:00
Colleen Murphy 3a57b1fe30 Add Gemfile and puppet 4 checks
In anticipation of puppet 4, start trying to deal with puppet 4 things
that can be helpfully predicted by puppet lint plugins. Also fix lint
errors caught by the puppet-lint-absolute_classname-check and
puppet-lint-empty_string-check gems.

This patch changes a scope.lookupvar function call to ruby instance
variable in the jenkins-log-client.default.erb template. This is safe
to do because the template is called in the log_processor::client class
and the variable in question is within that scope.

Change-Id: Ia7d6af8bc76a65e37f5dfd184e37855fe3b97046
2015-08-03 22:33:26 -07:00
Clark Boylan e3641f727f Start processes after network and named
Log processing requires networking and name resolution to be available.
Specify these deps in the LSB init headers so that we get proper boot
time start sequences for these services.

Change-Id: Ic36eba2654e7425f3aba8ee5c215150b7d94d658
2015-03-04 08:36:51 -08:00
James E. Blair bba311f301 Enable statsd for jenkins-log-client
Change-Id: I4395ce2151fc666cae1d9ea76b43bc3663e98ac8
2014-02-21 10:54:24 -08:00
James E. Blair dea5d91239 Refactor logstash_worker into log_processor module
Separate the jenkins log client and worker bits into a new module
called log_processor with ::client and ::worker classes.

Instantiate two workers on each logstash worker node.

Change-Id: I7cfec410983c25633e6b555f22a85e9435884cfb
2013-12-18 00:40:49 +00:00