Commit Graph

11 Commits

Author SHA1 Message Date
Clark Boylan 86a69a5b4d Retire this repo
The opendev project has been moving away from puppet and this is one of
the puppet modules that is no longer used. To simplify things for us we
are taking the extra step of retiring this repo.

Change-Id: I46ccab87f063c51dd3236757dbb0567738803fae
2022-02-17 12:46:57 -08:00
Andreas Jaeger f494aa8762 Handle robots.txt on logs.o.o
We don't want to delete the top-level robots.txt file - but everything
that is part of the logs hierarchy.

Change-Id: I369565a780eb749eab95e4bf8e7d8d7fd5bf0630
2019-08-07 14:04:57 +00:00
Ian Wienand 329f330b3e Log archive maintenance; also clear out symlinks
Currently if a log directory has a symlink it is skipped in the find;
thus the directory does not become empty and it is never removed.
Also match symlinks.

Change-Id: Id34c74d848638182819a9c81d051b83820244463
2019-08-06 19:13:44 +10:00
Ian Wienand 3eacddb2d7 Allow viewing of .log.gz files
I'm not sure why, but previously we have not passed .log.gz files
through to the htmlify web-app.  This means clicking on it in the
browser prompts to download the file.  This is unlikley to be what
devlopers investigating logs interactively want.

Traditionally in devstack-gate there's been a bunch of renaming
log->log.txt that happens to make the files presentable [1].  With
zuulv3 native jobs this happens less and everyone has to be aware of
this behaviour (e.g. Ia7415d2fbbb320f8eddc4e46c3a055414df5f997 is a
good example of raw .log files being added).  I think it is fine to
assume a .log file is text that is safe to pass through os-loganalyze.

From my reading of os-loganalyze [2], a .log.gz file would get mached
by util.use_passthrough_view and by default be filtered via a HTMLView
-- thus the file_conditions.yaml update is perhaps unnecessary, but
provided just to keep things in sync with .txt which has always been
there (I9cda9c05f42c5658d1c1dde8aa2efbc0abcc48a2)

[1] https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n869
[2] https://git.openstack.org/cgit/openstack-infra/os-loganalyze/tree/os_loganalyze/view.py#n237

Change-Id: I72e4f752713e7947bd66dfe8164976f0a4e3af24
2018-02-12 10:05:15 +11:00
Jeremy Stanley b3649db8fc Stop expiring contents for docs-draft.o.o
Since static.openstack.org is no longer serving a
docs-draft.openstack.org vhost, and downstream consumers of this
module are unlikely to have been doing so themselves either, stop
bothering to attempt to expire content for it.

Change-Id: I413ac425d752f4fe839648808c0df8c620bef1a5
Depends-On: Ib44df24100192f7903eb60c6fc93feeea0894b90
2017-12-07 21:03:10 +00:00
James E. Blair 325dd27fd4 Reduce log archive to 30 days
It's full again.

Also, it's weird that this isn't parameterized.  But now is not the
time.

Change-Id: I20c6f662d20089a1e8d9c4358878cb5f1ce2c05d
2017-03-17 17:39:29 -07:00
Jeremy Stanley 34c7f1ba65 Reduce job log retention to 45 days
In recent months, log volume has picked up even more. Since we can't
increase the size of this volume any further, reduce retention from
60 days to 45 days for now.

Change-Id: I13695e665541cb604e81fcd43cf26681447224ba
2017-02-15 21:21:43 +00:00
Jeremy Stanley a4487c5a50 Reduce job log retention to 60 days
In recent months, log volume has picked up considerably. Since we
can't increase the size of this volume any further, reduce retention
from 120 days to 60 days for now (manual expiration efforts indicate
90 days is roughly 100% of the filesystem size, so we need to go
lower).

Change-Id: Iedaf77303b00a0e2960cca22776969dca38ccd43
2016-09-29 15:53:41 +00:00
Clark Boylan 6e8061c0ec Match file conditions to apache rewrite rules
Our os-loganalyze file conditions didn't quite match up to how apache's
rewrite rules were handling things. Basically only .*console.html(.gz)?
should be htmlified, all other html files should be passed through as
is. Not doing this broke the rendering of testr results html files when
we started sending all requests through os-loganalyze for proper index
generation between swift and disk.

Fix this with an update to the rules that restricts html htmlification
to console.html.

Change-Id: If03f6e2eda733c0abe572fe7f5cdabc8dd0c7268
2015-10-08 10:39:52 -07:00
Joshua Hesketh 5b73b4d2a9 Set up file conditions for os-loganalyze
This will enable us to use different filters/views for various files.

By explicitly setting txt+html, we allow other formats (such as images
and tarballs) to be streamed from swift and hence downloaded.

Change-Id: I9cda9c05f42c5658d1c1dde8aa2efbc0abcc48a2
2015-08-11 21:36:40 +10:00
Ramy Asselin e8106a86e6 Create a log server like http://logs.openstack.org
Copy the log server templates & files used in:
https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project

Refactor the log server portion out of:
https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/static.pp

Additional modifications:
1. Add protections for portions that are likely to conflict.
2. Update os_loganalyzer install to use pip instead of python

Related system-config change: I390f6ea8aaace276d211d55a0e17f25dd6ae26b5

Change-Id: Ib8476df83b7c5491158fa3cab588213be60fa2ab
2015-05-04 16:30:18 -07:00