This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.
This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.
This update should result in no functional change.
For more information see the thread at
http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html
Change-Id: I40158b08c789c9134a609c2be55a6421733010a2
The logic in the Gemfile was relying on Zuulv2 variables to find out
whether the spec helper gem was already available on disk, and since
Zuulv3 has changed things it was failing to find it and downloading the
master version instead. This patch ensures the Gemfile looks for the gem
in the right place when running in CI.
Change-Id: I6923d679c1e499e1e1451bc250173603211ec133
There shouldn't be a need to do this, as the contents are generated
directly from elasticsearch.
Change-Id: I99ec3cfcc146477ee011f6dd926191c65495e90f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Instead of keeping a local copy of spec_helper_acceptance.rb and
requiring updates to all modules for any change, we can move it into the
common helper gem and require it from there. This will make it easier to
create and review changes that affect all puppet modules. Also change
the Gemfile to look for the gem in the local workspace if running in a
zuul environment.
Change-Id: I090e8ed3c8dbaf5f1a23cf09806d9dbc03c5f143
Since the beaker jobs are being run on xenial, we need a special nodeset
for it, otherwise beaker gives an error:
beaker-hostgenerator was not able to use this value as input.
Exiting with an Error.
We also want to install puppet from the Ubuntu repos rather than from
puppetlabs, since puppetlabs doesn't support puppet 3 for Xenial. For
centos we can keep the install process the same.
Additionally, this patch updates params.pp to distinguish between JRE
packages based on the Ubuntu release so that these module will work on
Xenial. We still keep support for trusty.
Finally, remove spec assertions that are not useful, including
verifications that packages are installed and config files existing. It
is enough to assume that if the puppet ran without errors that it was
able to also successfully find and install packages and lay down config
files. We remove these tests instead of updating the package check for
the new JRE package.
Change-Id: Ifd2244ae9dd212b2475f9cd6adb994bc058a4769
Depends-On: I053d437ceb7895fe2b1e2c46bf9cf19f73bdb20c
Bindep is a tool for checking the presence of binary packages needed
to use an application / library. It started life as a way to make it
easier to set up a development environment for OpenStack projects.
Change-Id: I053d437ceb7895fe2b1e2c46bf9cf19f73bdb20c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
To prevent this on every puppet run:
(warning): Variable access via 'es_template_config' is deprecated. Use
'@es_template_config' instead.
template[/etc/puppet/modules/elasticsearch/templates/elasticsearch.yml.erb]:33
Change-Id: Ie6c685d0748ce26c2bd2d227ce3b4e0578a95018
It is possible when we move volumes from one server to another that
our UID permissions are not currect. Have puppet ensure they are setup
properly.
Change-Id: I8f15b60507d1d52235d2db49753df144bea046fe
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Elasticsearch now hosts at elastic.co. The old name still functions but
update this before upstream can break us.
Change-Id: Ia39471881f2946eaab6e37dea8a19ed5d36d0662
Order and intendation of those parameters are changed
to follow Puppet Style Guide recommendation [0].
Moreover, it will allow to an user to find much faster
a variable in a list of variables.
[0]. https://docs.puppetlabs.com/guides/style_guide.html
Change-Id: Ie516f4a5aafc724d8f290c6d12f5ee2f6fe99a94
Add support for index.routing.allocation.total_shards_per_node in the
elasticsearch.yml.erb template. This value sets the total number of
shards across all indices to store on any single node. A value of -1
specifies unlimited shards.
Change-Id: I8a7472fb8daf97015d47ab33476b78779e762dbe
The network publish host value defaults to the ip address of the
first non-loopback interface, but this is not always an appropriate
value.
In some cases this value may need to be set to something other than
the ip address of the local interface, such as when connections should
be made to a floating ip address.
Change-Id: I9ace9bc80607e8d60478e869ef13feea8c49e10a
They can be very verbose, and on the controller, include things
like full tracebacks for a simple inability to finish a query.
Such instances are still logged at WARN.
Change-Id: I32844cbd7fdd57881ae83d9a78f23e3e8eaa2587
The indices.breaker.fielddata.limit config option specifies how much of
the heap can be used before breaking out and failing to prevent OOMing.
By default this is set to 60% of heap which may be too conservative if
you have larger datasets.
Change-Id: I46c0cb5157aae40a0029ff1b425ecc663d171768
With newer ES we need to set CORS controls properly because it seems to
care about that now. This change allows you to enable the use of CORS
and specify which origins are allowed.
By default ES doesn't allow any cross origin requests so you have to
explicitly enable it with these options if you want to allow it.
Change-Id: I0aa8d5167c770c1024b7596da582d6cc089b1b47
Add acceptance tests for puppet-elasticsearch module so that once the
module is applied we check if files were created, packages were
installed and services were started.
Co-Authored-By: Danilo Ramalho <dramalho@thoughtworks.com>
Change-Id: Id902337b8f6ca3210644f9401002755d9f6b3e0b
Use same target directory for zuul-cloner and
the regular git command.
Change-Id: Iddd6ca6b4e1d8d2ec90d7aa7013068f172928f1c
Co-Authored-By: Fabien Boucher <fabien.boucher@enovance.com>
In anticipation of puppet 4, start trying to deal with puppet 4 things
that can be helpfully predicted by puppet lint plugins.
Change-Id: I4bb194d3eedea05f4bbfa9b70920793e2b30d10c
This is useful if you want to run multiple clusters, or if you just want
to change the default value to something custom.
Change-Id: Id1731a209b43057090852a3bc484f61529717bd3
Keep elasticsearch from fillings its disk with logs by deleting logs
older than two weeks. Note we do not use logrotate because elasticsearch
expects to be doing the log rotation itself, it just doesn't delete
older logs. Instead we setup a cron with find to delete the older logs.
Change-Id: Ia2611cbf6e4aa1945ec8b3914d7ba042d2a7b0c1
The http://ci.openstack.org/ documentation site has been deprecated,
replaced by redirects to corresponding paths within
http://docs.openstack.org/infra/ where other Project Infrastructure
documentation already resides.
Change-Id: I81e2e8010c2fd7f7a12185da9d3c87f04e5fbd39
The shard count and replica count are some of the primary ways to tune
an elasticsearch cluster and should be tunable through this template.
Change-Id: Id6dd65ed3ca75e464f294774282eb36f6c001c67
The content of this project is Apache 2 licensed, but we should
include a standard LICENSE file just to be clear about that.
Change-Id: Iee6320b9d7e35fbe8d3b0a9794f3e485c18ef2c8
Set up small non master non data elasticsearch daemons on logstash
workers to act as local load balancers for the elasticsearch http
protocol.
Change-Id: Ie3729f851ebef3331a6b69f718e57d663209bfc2
Non instance variable representation is deprecated
so needs to be changed. This change changes varibles
to their instance variable representation.
See more details see:
http://docs.puppetlabs.com/guides/templating.html
Change-Id: Ib77827e01011ef6c0380c9ec7a9d147eafd8ce2f
The resource has _deb in it, which was left out.
Also, the java package name resource was replaced in only
one of two locations.
Change-Id: Ia47beeeff80f2cba1e7dfff0538156bd6464b9a1
java7-runtime-headless is an empty package that can never be
installed, so it attempts to install every time. Replace it with
openjdk-7-jre-headless, which is the real package.
Also, add a refreshonly on the exec for checking the diff, because
it runs every time as well.
Change-Id: I5195d27ae90cd7f9f3e20d92aca43d7b8d0e504a
We rely on curl to query the elasticsearch api for cluster state,
deleting indexes and so on. Ensure it is installed on the elasticsearch
nodes.
Change-Id: I843c6be65e5750856cb0b68f68eb7fac47e04e29
The package maintainer scripts start elasticsearch when it gets
installed, but it seems to return control before the pidfile is
created which allows puppet to race for it and ultimately launch a
second daemon resulting in an OOM condition. It's configured to
start at boot anyway, so the puppet ensure running isn't buying us
much.
Change-Id: I1b374f90c198b9cb73d412fe63b439623f434d9a