Reduce log worker internal queue size

We are having OOM problems with larger log files. Attempt to make this
more robust by having much smaller internal log line message queues (we
reduce the queue size to about 10% the original size). The idea here is
that if we have the old 130k queue size full then grab a large log file
the overhead there is fairly significant whereas if we have a small 16k
queue size and grab a large log file we really only have to worry about
the size of the logfile itself.

Depends-On: Iddbbab9ea5996df4922bf7927deb8f0354378ab7
Change-Id: I761fabaa1b5aae64790def721980151f9fdc720d
This commit is contained in:
Clark Boylan 2017-11-16 09:53:43 -08:00 committed by Clark Boylan
parent 22c22b0356
commit f35b4e2490
1 changed files with 1 additions and 1 deletions

View File

@ -407,7 +407,7 @@ class Server(object):
# Pythong logging output file.
self.debuglog = debuglog
self.retriever = None
self.logqueue = Queue.Queue(131072)
self.logqueue = Queue.Queue(16384)
self.processor = None
self.filter_factories = []
crmscript = self.config.get('crm114-script')