MOS 9 comes with a new orchestration engine (so-called v2 or task-based
deployement) which reduces greatly the time necessary to deploy new
environments. This change updates the deployment tasks to be fully
compatible with the v2 engine since when a deployment mixes v1 and
v2 tasks, the engine falls back to the v1 (slower) mode.
Note that we need to keep the backward compatibility with MOS 8 so the
deployment tasks still define the v1 attributes like 'requires' and
'required_for'.
Related-bug: #1558669
Change-Id: I92ede3808ad0b2bc9a39d4ec6560b1cc7ae256c3
This change drops the download of the fuel-library Puppet modules into
the plugin package. Instead the Puppet tasks look for Puppet modules
first in the plugin's path and alternatively in the default
/etc/puppet/module path.
This is required to have the same release of LMA supporting multiple MOS
versions more easily.
Change-Id: I7303a161d3826ed26430733339869f0a02e9ca00
The patch adds a new manifest executed on both influxdb and elasticsearch
nodes to configure collectd specially for them and also move here related
configuration from base.pp.
Implements: blueprint elasticsearch-clustering
Change-Id: I0e75446dd97e8c7108be87513a2b13e6909fcf44
The Hiera data from the LMA collector plugin is used by other plugins
such as the LMA Infrastructure Alerting plugin so it needs to be
available right after checking that the configuration is valid.
Change-Id: Id2902c5091a715f05ab936820991ec96d8b59962
This change modifies the Hiera configuration to add a datasource for
the LMA collector (located at /etc/hiera/override/lma_collector.yaml').
It also modifies the Puppet manifests to use hiera_hash() instead of
hiera() when looking up hashes: this ensures that hashes are merged with
the 'deeper-merge' strategy. Otherwise the 'lma_collector' key in
/etc/astute.yaml would be hidden.
Change-Id: Ia9fd3505aae05f63dfae99fc4bac11e831b63133
We need to support the installation when using fuel-createmirror. It
means that we need to embed all packages that are required to install
collectd. As we don't want to embed recommended packages we need to
configure the packaging tool accordingly.
Closes-Bug: #1494186
Change-Id: I22ec782d747b3ccd0a0a4d4e39e7a94ba51a56e3
This change configures the HAProxy service to send the traffic received
on port 5565 to the local LMA collector service. It also configures a
dummy HttpListen input that is used by HAProxy to check the
availability of the LMA collector service.
Change-Id: Ifd92148b6be4e248fe15bdeafebb9356f6f989be
Implements: blueprint lma-aggregator-in-ha-mode
Pick priorities 8200+ from the range reserved for
monitoring services deployment (8000-8999).
Lower priorities are used to install "backends" before the LMA collector.
Change-Id: Id2783da6a6f549c4fd4fdf34c5e8af5461b28c11
This change adds a post-deployment task that verifies that the plugin
configuration matches with the configuration of the environment. The
task checks that when using local Elasticsearch and InfluxDB nodes,
these nodes exist effectively in the deployed environment. The goal is
to stop the deployment as soon as possible if the configuration isn't
valid.
This couldn't be done in a pre-deployment task because Hiera isn't
available at this stage.
Change-Id: I318a214407a9e287f8376ec32907300bea554781
Collect metrics from controllers about cluster health, pools, placement
groups and OSD daemons.
OSD daemon perfomance metrics are collected from ceph-osd nodes,
but notice metrcics are only collected on nodes with a dedicated ceph-osd role.
Change-Id: I3d1774ab9b7b19d7cf54ac69a53276a4454647e2
This change moves away from the big monolithic Puppet manifest. Instead
we introduce separate tasks for each role that the plugin supports.
Change-Id: I370c9e8267f86da742f5cca48f1fec8bc3d9c4a9
This is an import of the initial LMA PoC code. For now, it only covers
the collection of logs (notifications will be added in a subsequent
commit).
There's been a bit of rewrite to:
- decouple the Heka configuration from the LMA collector.
- run the Heka service as non-root when possible (Ubuntu only for now
due to file permission issues on CentOS [1]).
- adapt to version 0.9 of Heka.
[1] https://bugs.launchpad.net/fuel/+bug/1425954
Change-Id: I4472b49a25e18e06984b5b29bdce18f917137bc8
Andreas Jaeger