Commit Graph

128 Commits

Author SHA1 Message Date
Ian Wienand dcc23be55b Remove static site puppet
Remove the puppet related to the static server

Story: #2006598
Task: #36758

Change-Id: I744da83d811e715ff8049eacf3013cd4831e1c49
2020-03-26 10:36:16 +11:00
James E. Blair 96aec261da Add logs.opendev.org vhost
This is a near-copy of the vhost template from puppet-openstackci.

Change-Id: I191e41b501629e2cdd82381d66daa3b850e0be81
2019-07-31 14:32:00 -07:00
Monty Taylor b415375f8b Revert "Add cache-control headers for service-types.openstack.org"
This reverts commit fc98399aa4.

Change-Id: Ie9562c096f865195bc44e55ea6425ad207d44e50
2019-05-03 17:20:21 +00:00
Zuul 65e6f62090 Merge "Add cache-control headers for service-types.openstack.org" 2019-05-03 16:25:45 +00:00
Monty Taylor fcab9a407a Update opendev git references in puppet modules
Not updating the gerrit git links thing, because that needs to
be a wider patch that updates the link syntax too.

Change-Id: I98013ba79e707540879e0cf2849a35c52f3371e8
2019-04-20 18:26:07 +00:00
Monty Taylor fc98399aa4 Add cache-control headers for service-types.openstack.org
In implementing the library to consume the service-types data, it became
clear that the behavior could be much more consistent across
implementations if we set cache-control headers. This allows a combined
ETag and time-based approach, so that the data will only be fetched if
it has a stale etag, but it will only be checked for staleness once a
week. Since the data in question is expected to change only rarely, and
then only in additive ways, this should allow pervassive use of the data
without significant cost to the API consumer.

Change-Id: I6de3c79e22fdea9bf70fd725447ca7141af80b50
2019-04-05 15:53:44 -07:00
David Moreau Simard e8fd13ae70
Bump amount of mod_wsgi processes for static vhosts to 16
The default of 8 processes does not appear to be sufficient to handle
the concurrent requests for openstack's log analyzer and ara
simultaneously under load.

Change-Id: I928fcbcc670c68bfb7b206949edca1a5e6daf35a
2018-11-07 15:34:47 -05:00
David Moreau-Simard 9200007502 Enable and configure the ara middleware for logs-dev.o.o
This installs the ara middleware for the logs.opentack.org server.
The depended-on review only enables it for logs-dev.o.o.

Change-Id: I9a2d996de46cb8ce34dc75ccda42b1799969e7ac
Depends-On: I3b10c93b4902a9b45e23c227863e472697f662ef
2018-03-05 20:15:18 +00:00
Jeremy Stanley 66dea3f74e Remove docs-draft vhost from static.o.o
All draft documentation jobs now just publish content into an "html"
subtree of their job logs on logs.openstack.org and have been doing
so since longer than our configured content expiration period, so
the separate vhost for docs-draft.openstack.org is no longer
required and can be removed.

While here, change up the CORS configuration for
storyboard.openstack.org and storyboard-dev.openstack.org to respect
draft storyboard-webclient copies on logs.openstack.org rather than
simply removing these stanzas.

Once this change merges and configuration gets applied to
static.openstack.org, the allocated resources for the old docs-draft
vhost (logical volume, DNS entry) can be safely removed.

Change-Id: Ib44df24100192f7903eb60c6fc93feeea0894b90
2017-12-07 20:57:25 +00:00
Thierry Carrez 9ccb2fb522 Create publish space for SIGs under governance.o.o
Create space for publication of the content from the
upcoming openstack/governance-sigs repository under
governance.o.o.

Change-Id: I5d30976f00418b6d8002e5db86343fdb7459d32e
2017-11-23 14:12:07 +01:00
Emilien Macchi e3a1a8cade Add a static footer for TripleO Quickstart logs
Use a static html file from the tripleo-ci repo to help users debug
TripleO Quickstart jobs, the same way as devstack-gate.

Change-Id: If0d50040f9935976765d537e9ef0213631fe7e76
2017-07-25 21:27:19 +00:00
Emilien Macchi ddaa1a0e7d puppet/static: stop using legacy parameter
Not needed anymore after the refactoring.

Change-Id: I18cc3431f32b169cb0d950ff25ef24a3a6550404
Depends-On: I4656a511aa21b1096e60155e5f7de1ae089a95ae
2017-07-25 21:11:28 +00:00
Emilien Macchi 2a6d01e53f puppet/static: move logs resources in system-config
Move resources for OpenStack logs from puppet-openstackci to here.

Change-Id: I354639545c9cbc12f1b844946962946aa2bb4fb0
Depends-On: I65e8ecf39130377c088c053e5623212f7db60f7a
2017-07-25 21:10:59 +00:00
Jeremy Stanley e1e3234c7b Clean up references to deleted releases SSL files
These files have been deleted by Puppet, so we don't need to
maintain the old reference indefinitely. Clean up the manifest.

Change-Id: Ia68db75b2210382d358f194b4350192db44bf20b
2017-06-30 20:34:59 +00:00
Jeremy Stanley 08c165cd92 Roll releases site into common cert
Now that the static.o.o SSL cert has been renewed, additional
CNs have been included in the SAN set for it. As a result, we can
simplify configuration for the newer sites added since the prior
renewal.

Change-Id: I77f49cea53b0a06ce4399d46b00806a2cbd7e509
2017-06-30 20:30:54 +00:00
Monty Taylor 9fdd972b59 Add vhost on static.o.o for service-types.o.o
We want to publish json information from the service-types-authority to
service-types.openstack.org. We need a vhost for that, and also a
directory for the post job to copy data to.

Change-Id: Ia53a6e508e4b6d79fab08b4c51dc3ad97a929502
2017-06-30 20:06:20 +00:00
Monty Taylor ff52dd32e1
Add legacy redirects to static.o.o
The legacy redirects that are on old-wiki.o.o should go away. But they
certainly should stop being served by old-wiki.

Note, this excludes quantum, which is a dead redirect anyway and
workitems which never really got off the ground and only contains out of
date info from diablo-4.

Change-Id: If78ba98ff927420d003fa69b49ed073e3a44ea09
2017-03-08 09:30:59 -06:00
Jenkins 63fc0139c4 Merge "Switch static.openstack.org to worker MPM" 2017-03-02 04:01:59 +00:00
Ian Wienand 91bca8d574 Remove mlocate from static.o.o
mlocate is filling up the disk trying to index logs and docs.

Its default is not to index remote mounts, but since these are mounted
on static.o.o as block devices it descends into them.  Another option
is to update PRUNEPATHS in updatedb.conf, but since this is wholly
unnecessary let's KISS and just get rid of it.

It is only installed because it is a "suggests" of findutils, so has
no reverse-dependencies.

Change-Id: Ib23f3f1fb3397b66f897a0d284da521ce50293e8
2017-02-14 10:40:08 +11:00
Ian Wienand 5216b02904 Switch static.openstack.org to worker MPM
We are seeing in the static.openstack.org logs the problem metioned in
[1] which is leadning to dropped connections.

  This mpm showed some scalability bottlenecks in the past leading to
  the following error: "scoreboard is full, not at MaxRequestWorkers".
  ...
  From 2.4.24 onward, mpm-event is smarter and it is able to handle
  graceful terminations in a much better way

I don't think we want to go outside the packages provided by Trusty,
and it seems that even upping the number of servers/threads is not a
reliable work-around to this problem.

It seems like the simplest thing to do is avoid the problem all
together by switching to the woker MPM, which is very simliar but not
optimised for HTTP keep-alive.  Since this is not an ajax-y type
interactive server with a lot of long-lived clients, I think this will
work fine.

[1] https://httpd.apache.org/docs/2.4/mod/event.html

Change-Id: I064b81076bcfcb200e0990627fc1aa0be8bbf058
2017-01-30 14:35:45 +11:00
Thierry Carrez 5ae6fba0bc Switch governance.o.o root to governance-website
Switch the governance.openstack.org docroot to the neutral
content from the governance-website repository.

This completes the plan to switch to a neutral governance website,
as described in [1].

[1] http://specs.openstack.org/openstack-infra/infra-specs/specs/neutral-governance-website.html

Change-Id: I3b67ef932ca1f8150d0e7ba50481c32b85eeff71
2016-12-13 18:06:25 +01:00
Thierry Carrez 3df19676f8 governance.o.o: add redirect for badges
Badges are published under /srv/static/tc, and links pointing to
http://governance.openstack.org/badges were created everywhere.
In order to avoid breaking those links when we switch the docroot,
create an additional redirect for the /badges/ subdirectory.

Change-Id: Id2eb469cd1be16da04e73a752aa586a58330499c
2016-12-13 18:06:25 +01:00
Jenkins 12a99645a0 Merge "Set Cache-Control to no-cache for badges" 2016-12-13 14:03:04 +00:00
Flavio Percoco 84ebdebe00 Set Cache-Control to no-cache for badges
Some services might cache badges for a very long time, which may no
reflect the latest changes in the governance repo. Set Cache-Control to
no-cache to instruct these services to not cache badges ever.

Change-Id: I535107c49d5c89b9e09b440f7aac139de213f796
2016-12-08 10:18:07 +01:00
Thierry Carrez a2687e42b4 Set up redirects to preserve governance.o.o links
Before switching the governance.o.o docroot to neutral content
from openstack/governance-website, set up some redirects to
preserve old links to TC reference documents and resolutions.

This is steps 7 and 8 in the plan to switch to a neutral
governance website, as described in [1].

[1]
http://specs.openstack.org/openstack-infra/infra-specs/specs/neutral-governance-website.html

Change-Id: I12a60816b9fcbe8c467a7bc3219149e6a053ffa8
2016-11-30 11:09:29 +01:00
Thierry Carrez 15b97e88d2 Also serve TC contents from governance.o.o/tc
In preparation of moving TC content under governance.o.o/tc/,
set up a redirect from /tc/ to /srv/static/tc, while still
using /srv/static/tc as docroot.

This is step 5 in implementing a neutral governance website,
as described in [1].

[1]
http://specs.openstack.org/openstack-infra/infra-specs/specs/neutral-governance-website.html

Change-Id: I7a4c4d16118821ad87fd5ae507765ad0d522a2f7
2016-11-30 10:44:28 +01:00
Thierry Carrez 3cee1a6152 Use /srv/static/tc as governance.o.o docroot
Complete the openstack/governance docroot rename by setting
the newly-created /srv/static/tc as governance.o.o docroot.

This is step 4 of:
http://specs.openstack.org/openstack-infra/infra-specs/specs/neutral-governance-website.html

This should ideally be approved after we trigger at least one
publication of openstack/governance on the new location.

Change-Id: I9d6fb051e4a6d64636c5731d03264b158a3ee841
Depends-On: Id6e8f10ba5da6106faf77387be44781bd963041c
2016-11-09 16:03:29 +01:00
Thierry Carrez 8ff73ec48c Create /srv/static/tc for publication purposes
As a first step to publishing TC documents under /tc/, get the
/srv/static/tc directory created.

This is the first part of step 3 in:
http://specs.openstack.org/openstack-infra/infra-specs/specs/neutral-governance-website.html

Change-Id: Id6e8f10ba5da6106faf77387be44781bd963041c
2016-11-09 15:56:07 +01:00
Thierry Carrez e0588e2f9f Create space for governance.o.o/uc publication
The governance.o.o website will provide a space for publication
of User Committee documents (openstack/governance-uc) under
governance.o.o/uc/, under a model similar to what was followed
for /election.

Change-Id: I8bb109c38832b04440210f7be6bb18d25b91750d
2016-09-05 14:34:16 +02:00
Jeremy Stanley 8d19f4e474 Set up HTTPS for releases.openstack.org site
Add separate HTTPS cert/key/chain files for the
releases.openstack.org site since our current certificate vendor
requires us to renew a cert to update the SubjectAltNames list in
it. Note that this depends on RFC 4366 (Server Name Indication)
support in browsers, but basically all "modern" browsers should be
fine with it (if someone is still using IE6, I'll be happy to print
out and mail them a copy of the site). Also, the relatively strict
TLS options we've been using for the other HTTPS sites on this
server basically already preclude browsers of that vintage, so it's
unlikely to come up at all.

This site can be folded into the static.openstack.org multi-site
cert when it's renewed next year and switched to the normal
static-https-redirect.vhost.erb template at that time.

Change-Id: I92f7fd163fc36ab06116233622a9a07c5f20440d
2016-08-10 19:02:32 +00:00
Joshua Hesketh 4ebafcde34 Add election alias to governance.openstack.org
Add an alias for /election/ to go to /srv/static/election where
the election repo will be published to.

This is a reworked resubmission of
Ie5e783c65396e9fb74f3d739e775e51a948652fe which was reverted in
I808e654a6fb77440e7aecbde4456ddc720fe0d9a .

Change-Id: I1a8e179d26e57247322fe3ed604e838722d43334
Partially-Implements: spec publish-election-repo
Co-Authored-By: Jeremy Stanley <fungi@yuggoth.org>
2016-07-03 15:06:33 +00:00
Jeremy Stanley a167ed03c1 Revert "Add election alias to governance.openstack.org"
This reverts commit 91dcb510ba.

The implementation ignored that the referenced template is being
used by many vhosts but the lists for aliases and directories were
defined at (and referenced from) the containing class scope. This
coupled with the newly introduced conditional for the directories
array caused all other vhosts using this template to no longer get
Directory blocks for their docroots.

Change-Id: I808e654a6fb77440e7aecbde4456ddc720fe0d9a
2016-07-01 23:18:56 +00:00
Joshua Hesketh 91dcb510ba Add election alias to governance.openstack.org
Add an alias for /election/ to go to /srv/static/election where
the election repo will be published to.

Partially-Implements: spec publish-election-repo
Change-Id: Ie5e783c65396e9fb74f3d739e775e51a948652fe
2016-04-07 10:14:27 +10:00
Doug Hellmann c14e678f12 add new vhost for releases.openstack.org
This patch adds the new virtualhost for releases.openstack.org, to
receive documents published by the release management team.

Change-Id: I41221d84e6c985bcc55f9b2a6f15210d2410bc84
2016-01-12 17:55:02 +00:00
Evgeny Antyshev 4e1b8cd90a Use httpd::mod instead of httpd_mod
httpd::mod is a high-level wrapper around httpd_mod,
and, since it is used, e.g. in puppet-jenkins and puppet-zuul,
it should be uniform across all puppet projects,
to be able to properly detect
whether Httpd_mod instance defined, like below:

if (! defined(Httpd::Mod['rewrite'])) {
    httpd::mod { 'rewrite': ensure => present }
}

Change-Id: I2b453b6f15d80bba9b1c29bc0d35651cfae05427
Depends-On: I69e7f9c54d06d7f98b50fdc7d5a67dd10e3e0050
2015-12-08 15:00:14 +00:00
Jeremy Stanley f80688f0ef Add HTTPS for trystack.openstack.org
Add HTTPS for trystack.openstack.org and incorporate ServerAlias
support into the static-http-and-https and static-https-redirect
vhost templates.

Change-Id: I7c3ab22485689bf22dfe706fa7b0f6777604db25
2015-10-22 19:40:31 +00:00
Jeremy Stanley 9c98a1edcb Add HTTPS for docs-draft.openstack.org
Change-Id: If9df38e2e96299af3d193f615acf7dd5e06c195f
2015-10-22 17:59:01 +00:00
Jeremy Stanley ba628fcd02 Add HTTPS for specs.openstack.org
Change-Id: I134de97c99ad296ca5c9e35eb68d98f15e0cd585
2015-10-22 17:59:00 +00:00
Jeremy Stanley 0adb22b371 Add HTTPS for governance.openstack.org
Change-Id: I294d7f18472ad5b172797fe4309e2a5ba1173866
2015-10-22 17:58:57 +00:00
Jeremy Stanley 9ddfa7e0ff Add HTTPS support to tarballs.openstack.org
Add HTTPS support to tarballs.openstack.org taking advantage of the
SUbjectAltName entry for it in the current static.openstack.org
X.509 certificate. Use a generalized vhost template for sites like
this which should support access via both HTTP and HTTPS rather than
redirecting from one to the other.

Change-Id: I04aa73750f8fcee1c6af6efb1667127fd284f359
2015-10-13 18:40:19 +00:00
Jeremy Stanley edb95c4d3a Rename security.o.o vhost template for reusability
There is no longer any security.openstack.org specific content in
the vhost template, so rename it to something more general in
preparation for use by additional similar vhosts.

Change-Id: Ifb6843ec25cecdf497df107f066cc59bd81c5a19
2015-10-13 18:40:19 +00:00
Jeremy Stanley 9609fcaa9c Remove cleanup cruft from security.openstack.org
Remove the ensure=>absent entries for security.openstack.org
specific key/cert files now that they've been cleaned up.

Change-Id: I72f379fa5c9a223e17d94bb6f153dbf73c9c0ce1
2015-10-13 18:37:08 +00:00
Jeremy Stanley 954ece8642 Use SNI/SAN on static.openstack.org
A new cert bundle and key have been obtained for
static.openstack.org with SubjectAltNames for most of its relevant
vhosts. Switch it into place and generalize the current HTTPS
configuration for security.openstack.org in preparation for adding
HTTPS support to the remaining vhosts in subsequent commits. Also
add sane snakeoil fallback behavior for undefined certificate/key
files.

Change-Id: I65b7dbc3b5ad8735c158a1ac0b41b848ad5d2077
2015-10-11 13:01:07 +00:00
Paul Belanger e7bca57aa2 Also add serveralias for www.trystack.org
Change-Id: I59d930c1c358f81c70f98f8533fd50c8ddda3ce0
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-08-14 11:03:28 -04:00
Paul Belanger 884a1c3432 Rewrite trystack.org to trystack.o.o
Add the required serveraliases and rewrite settings needed to support
both trystack.openstack.org and trystack.org.

Change-Id: I1a6560be8a1a24b50b1d047ed990e5f029ac5ee5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-08-13 15:29:23 -04:00
Paul Belanger dc81e2816f Migrate to puppet-httpd module
puppet-httpd is the openstack-infra module for of puppetlabs-apache (0.0.4)
release.

This patchset will remove the puppetlabs-apache namespace from -infra
allow for possible future patchsets to use newer puppetlabs-apache
modules.

Change-Id: Id9f08de5ca32eac884a01f11a2cf34e1044d3048
Depends-On: I4f4648538801a60f45b28cedc73b24d8905cfe14
Depends-On: Ifcc60d173430e30159aa794e5adb5ba71107e647
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-08-05 13:47:16 -04:00
Paul Belanger 586afa264c Add trystack.o.o into -infra
trystack.org is a simple static site, moving it under -infra
will provide an easy way of maintaining it.

Change-Id: I662769ede97f147f35f63accef7ef1769d7938f0
Depends-On: I96b0d459cb8ffcde42fae751c01f9a3b78760390
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-06-24 18:41:00 +00:00
Paul Belanger 82e75b1884 Break out openstack_project::server from static.o.o
Change-Id: I2c3c5d0f3075ca1c289dd00d0e529957d2e3dfa7
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-06-24 17:57:51 +00:00
Jenkins 9844824dcd Merge "Move security.openstack.org to HTTPS" 2015-05-14 00:57:39 +00:00
Jenkins 518c54f841 Merge "Use common log server implementation" 2015-05-06 18:26:09 +00:00