Commit Graph

15 Commits

Author SHA1 Message Date
Ramy Asselin 20e6ffb579 Use common log server implementation
Depends-On: Ib8476df83b7c5491158fa3cab588213be60fa2ab

Change-Id: I390f6ea8aaace276d211d55a0e17f25dd6ae26b5
2015-04-02 11:59:51 -07:00
Ramy Asselin d94b5a25a2 Log server can run on Apache 2.4 / Ubuntu Trusty
Apache 2.4 is the default version for Ubuntu Trusty.
Upgrade the apache configuration with the additional permissions
required to run on both Apache 2.2 and Apache 2.4.

Follows work done in I70d814a5eaefea5a3fb6a47bc215f4ab64be884f

Change-Id: Ie63cf936709b0f272b7129a2dc613d07a4d2fab2
2015-03-16 15:25:37 -07:00
James E. Blair fcf7b069c1 Add more @ signs to logs-dev and status vhosts
To make puppet more happy.

Change-Id: I22755ef7d7772b2dbf68b0663985785f50767d14
2014-09-12 10:43:55 -07:00
Joshua Hesketh 7244de8baf Fix the apache rules for fetching from swift
Change-Id: I8c1a39a65dc1eefc782664ea5f020150821ebce6
2014-07-17 13:19:54 +00:00
Clark Boylan d65853f8da Fix logs rewrite passthrough
The logs vhost rewrite rules were passing through and failing matches
because of apache2's internal rewrites. Stopping passing through to
avoid apache2 breaking us.

Change-Id: I86fafad9a0c991f00a86c042ff1174ca2ccd8c4d
2014-07-16 05:32:19 -07:00
Joshua Hesketh cf71602cc7 Add in rewrite rule to check swift
If the requested file doesn't exist locally ask the os-loganalyze
wsgi app to handle the request anyway incase it can fetch the request
from swift.

Change-Id: I8ed3a4c7b9a9fa682dbc4c3f3ffee8ddf2c237c6
2014-07-16 19:52:39 +10:00
James E. Blair f52d2eb2b6 Revert "Fixing deprecation warnings"
This reverts commit 82b9b59522.

Change-Id: I746d7ae57802dc76618db9024a0cf94c43774c02
2014-07-02 17:35:02 +00:00
Spencer Krum 82b9b59522 Fixing deprecation warnings
Non instance variable representation is deprecated
so needs to be changed. This change changes varibles
to their instance variable representation.

See more details see:
http://docs.puppetlabs.com/guides/templating.html

Change-Id: Ib77827e01011ef6c0380c9ec7a9d147eafd8ce2f
2014-06-19 22:41:42 -07:00
Joshua Hesketh c6cb34aec5 Fix log Footer README's for 'check-tempest-dsvm'
Previously the footer readme in the apache configuration for
logs.openstack.org only matched 'gate-tempest-dsvm' and not the check
jobs (eg check-tempest-dsvm).

This commit also removes depreciated log store patterns

Change-Id: I2628be003801eee8bfea5162bdfd034529cf30fb
2014-02-21 12:57:37 +11:00
James E. Blair 85a2a5b0e8 Make job names shorter
Replace the use of '-default' in the new JJB devstack templates
with the empty string.

Shorten 'stable-BRANCH' to '-BRANCH'.

Shorten 'devstack-vm' to 'dsvm'.

Add 'devstack' in the position normally occupied by 'tempest' if
appropriate for the job (eg cells).

Set the single use flag for jobs that match 'dsvm'.

Add 'dsvm' to the requirements integration job name (which incidentally
was not matching the regex before, which is an error).

Adjust elastic-recheck graph and log host directory patterns to
match new job names.

Change-Id: I79562f79f41c02b5898a1c5e15194ed9d7dc1a39
2013-12-02 15:16:57 -08:00
Sean Dague 129f521c88 only run the console.html logs through os-loganalyzer
... not other html.gz files, as that massively messes up the
testr result files.

Change-Id: Ie77ce3d87617c35cfee3900646bb0bb61b986fcf
2013-10-14 17:19:05 -04:00
Sean Dague 3168f541e7 switch over to os-loganalyze on logs.o.o
this is the switch over for os-loganalyze on logs(-dev).o.o. It
direct deploys from git to the environment. It will bring with it
support for keystone, console logs, and being smarter about when
level filtering is applied.

While I would still like the have a tick / tock CD environment to
deploy to dev then to prod on a stable branch, there are enough
fixes in os-loganalyze over the old htmlify script that it's worth
deploying to master now, then work on CD next.

Change-Id: Iaa0c1993128032842b0d6ee496b0047fb65cb6a8
2013-10-14 13:03:06 -04:00
Jeremy Stanley 7e480c6c18 Additional path patterns for log readme files.
* modules/openstack_project/templates/logs-dev.vhost.erb
* modules/openstack_project/templates/logs.vhost.erb: With the
recent advent of an additional parent node in the job log path, the
ReadmeName was no longer being applied to new log directories. This
corrects it by adding duplicate Directory blocks for them with the
new pattern. Note that ReadmeName does not work inside regular
expression blocks like DirectoryMatch, but the old Directory blocks
can be removed when those logs expire in about 6 months time. Also
added patterns to provide readme files for equivalent periodic jobs.

Change-Id: Ib12f1d6f033b8129af38d694f7b221bea9614ecd
2013-07-29 18:02:37 +00:00
Sean Dague c7a2bf51b7 updated htmlifier for safety and features
ensure that path of the file we're going to open is actually
inside our log root. If not return a 400.

escape dates in the regex so they are easier to pass around,
unencoded spaces kind of suck for that.

catch the possible IOError of openning a file that doesn't exist,
be nice and give people a 404 in that case.

move the content negotiation into a function, for readability

Change-Id: I334e1ac0419cd140c6af35c78634a2d7c05dcf01
2013-07-24 20:15:01 -04:00
Sean Dague fcc4dd4995 add utility to htmlify screen logs for devstack runs
this adds a wsgi application which processes all the txt.gz log
files and htmlifies them on the fly before sending them to the
user. It uses content negotiation to only do this if the client
says it Accepts text/html, otherwise it just dumps them back out
as text/plain.

In either case the content is compressed with mod_deflate, which
provides a 15x-20x bandwidth savings vs. if we left it
uncompressed on the wire.

Should get more testing before general deployment, but this is
getting close to the approach I think we want to use.

This enables the functionality on a new logs-dev.openstack.org
vhost so that we can do live testing that this works before
switching over the main site to it.

Change-Id: I12a06c4b55be05fb8060b76f5aea9ebc801c0537
2013-07-23 15:27:37 -04:00