This patch updates the version of the Puppet module to be able to use
the netlink plugin that is available since 4.2.0.
Change-Id: I6df3b9b42b2a7e1649897efa4da59478029c5078
This package includes a fix that avoids flooding logs in case the
output buffers are full.
Change-Id: I43db2fe1e5d2e9f2de9f35c576451fd6a04eed31
Closes-Bug: #1562148
This change drops the download of the fuel-library Puppet modules into
the plugin package. Instead the Puppet tasks look for Puppet modules
first in the plugin's path and alternatively in the default
/etc/puppet/module path.
This is required to have the same release of LMA supporting multiple MOS
versions more easily.
Change-Id: I7303a161d3826ed26430733339869f0a02e9ca00
This commit moves the Pacemaker/Corosync Puppet code from the
lma_collector module to the Fuel-specific base.pp manifest.
This involves the following changes:
* Fuel's "pacemaker_wrappers::service" define is now used in base.pp
to configure the LMA service resource to using the "pacemaker"
provider.
* To configure "pacemaker_wrappers::service" we need to know the Heka
user. So to avoid hacks where we'd use private variables from the
lma_collector and heka modules to determine the Heka user the
lma_collector and heka modules are changed to make the Heka user
configurable. For this the "heka" class "run_as_root" parameter is
removed in favor of a "user" parameter.
* In other manifests we use a resource collector to make sure that
the LMA service resource is not re-configured with the default
provider. This part is a bit hackish, but we haven't been able to
come up with a better way to address the issue.
Change-Id: I0ed0bddb245dc3a65b034e5caec14a65cfa908cb
Implements: blueprint lma-without-fuel
There are many changes between 7.0 and stable/8.0 and it is safer to
base our work on stable/8.0. Eventually we'll switch to the 8.0 tag once
it is available.
The OpenStack Puppet modules are pulled from upstream since
fuel-library has switched to upstream too.
Change-Id: Ie6fcedc738d45061d52e32567cf6cfed8ffa2e51
This version will allow us to enable the buffering for the output
plugins and deal properly with RabbitMQ connection drops.
Change-Id: I087236ecc7756d005a98cd11d3e5efe8cbdc00cb
Closes-Bug: #1503251
Partial-Bug: #1488717
The hiera('internal_address') is no longer available with MOS 8.0, this
change uses the Fuel way to retrieve the management IP address.
Change-Id: I9b25f1b79b59ac9ed52531704bf5e829f23812da
This change configures the HAProxy service to send the traffic received
on port 5565 to the local LMA collector service. It also configures a
dummy HttpListen input that is used by HAProxy to check the
availability of the LMA collector service.
Change-Id: Ifd92148b6be4e248fe15bdeafebb9356f6f989be
Implements: blueprint lma-aggregator-in-ha-mode
This change installs the latest version of Heka (0.10.0b0). This version
of Heka is required because it comes with updated Lua plugins and
modules for InfluxDB.
Change-Id: I4cbb65603cc8e49679c1a89c5a3792c977e44b7a
Implements: blueprint upgrade-influxdb-grafana
Previously, we ship from fuel-library concat v1.1.0 with a bug fix
from v1.1.1 (cherry-picked).
Version 1.2.4 comes with many bug fixes.
Change-Id: Iecbf625d527df8b610e28be0ca34fabe5c1188a3
Previously, we shipped stdlib v4.2.1 from the fuel-library but we can easily
switch to the latest version since there is not compatibility break,
many fug fixes and fuel-library doesn't diverged (except few changes).
Change-Id: I4913dd30b6fa809588ca2e1833fdcc689c48cbb9
This change installs the latest version of Heka (0.10.0b0). This
version of Heka is required because it comes with updated Lua plugins
and modules for InfluxDB.
Change-Id: Ibcb51909658d908979c9f13bdec6a754e2698df2
Implements: blueprint upgrade-influxdb-grafana
This reverts commit e6c0b44eb0 to support
deployments using fuel-createmirror. In this case, the nodes don't have
access to the external Ubuntu repositories and the installation of
collectd fails.
Change-Id: I92110dfcc3c86336ba275162302e6d879d85d000
This change fixes all problems reported by ShellCheck [1] which is a
nice linting tool for sh/bash scripts.
[1] http://www.shellcheck.net/about.html
Change-Id: I7104597e309fed5a4d52f5fc39ab0f4350fb3217
As nodes should have access to ubuntu repository we don't need to
download ubuntu packages in the pre_build_hook before installing the
plugin.
Change-Id: I4dd2d3a08607048f9e34d998705595ff27b283c0
This version fixes a nasty bug [1] that may cause Heka to loop over
infinitely when reading too large messages from log files.
[1] https://github.com/mozilla-services/heka/issues/1367
Change-Id: I38d1bbbd00a2182cbb932ee75024bebef2472ddc
This change adds collectd packages for CentOS. In addition, a few fixes
are needed to ensure successful deployment of the LMA collector on
CentOS platforms:
- Install collectd-dbi package on controller nodes.
- Modify Python scripts using subprocess to workaround issues with
Python 2.6.
- configure a valid database name for the MySQL plugin.
- set hasstatus and hasrestart parameters to true for all OpenStack
services otherwise Puppet fails to restart them.
Change-Id: I06891b069ba6047dfa40bcef7937b52964bda268
collect number of services in state disabled, up or down.
These metrics are collected from DB with collectd DBI plugin.
Change-Id: I546d9c14f1a0c2d5e3b3c96f8908d83d52720839
This change adds the collectd packages (for Ubuntu) and the collectd
Puppet module to the LMA collector Fuel plugin.
Change-Id: Ibc376ba3bc0f99e3ad9507b3ea118bd4ed66ef25
This change enables the LMA collector to receive OpenStack notifications
and store them into ElasticSearch. Note that we configure an additional
notification topic ('lma_notifications') instead of high-jacking the
topic used by Ceilometer ('notifications').
This adds a new checkbox option in the UI to enable/disable the
notification collection (default value: disabled).
Change-Id: Ie934c244e7cf58f58487ed903aeb94af2e2e0495
This is an import of the initial LMA PoC code. For now, it only covers
the collection of logs (notifications will be added in a subsequent
commit).
There's been a bit of rewrite to:
- decouple the Heka configuration from the LMA collector.
- run the Heka service as non-root when possible (Ubuntu only for now
due to file permission issues on CentOS [1]).
- adapt to version 0.9 of Heka.
[1] https://bugs.launchpad.net/fuel/+bug/1425954
Change-Id: I4472b49a25e18e06984b5b29bdce18f917137bc8