Commit Graph

58 Commits

Author SHA1 Message Date
Danila Balagansky f9de8b2b78 Enable Ceilometer resource cache
This change should significantly reduce load on Gnocchi due to caching
`resource` objects in Memcached.

Depends-On: https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/896017
Change-Id: I72a0b1728e6f6e761bf75e7d57675434230475d4
2023-10-25 10:34:14 +00:00
Dmitriy Rabotyagov bfca55e20d Fix logic of defining polling_namespaces
Previous logic did excluded possibility for ceilometer-polling agent
to poll multiple namespaces at the same time. This resulted
in a wrong config for AIO metal scenario.

Change-Id: I2ad3f748d18bf571dc7b82422fbcd8269cbe168e
Closes-Bug: #2018619
2023-05-05 21:22:41 +00:00
OpenStack Release Bot 8ffebf5848 Update master for stable/zed
Add file to the reno documentation build to show release notes for
stable/zed.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/zed.

Sem-Ver: feature
Change-Id: I3877ba2c6189f130a520f85b45d844d4c618962d
2022-12-13 13:12:35 +00:00
Dmitriy Rabotyagov be84a509c4 Unify deployment of ceilometer files
This aims to make possible to define ceilometer_pipeline_user_content
filepath instead of making huge overrides. In the meanwhile default
behaviour should be kept with minimal influence on the existing
deployments.

Change-Id: I0a0ac1b9bbdb8b6a68f870f0ae03edbee8c63d68
2020-11-20 08:05:17 +00:00
Andreas Jaeger 335f931661 Use newer openstackdocstheme and reno versions
The sync from https://review.opendev.org/733244 updated to
openstackdocstheme 2.2.1 and reno 3.1.0 versions.

Set openstackdocs_pdf_link to link to PDF file. Note that
the link to the published document only works on docs.openstack.org
where the PDF file is placed in the top-level html directory. The
site-preview places the PDF in a pdf directory.

openstackdocstheme renames some variables, so follow the renames
before the next release removes them. A couple of variables are also
not needed anymore, remove them.

See also
http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014971.html

Change-Id: I9a9c582a6a9a1505b4dfe0095c5d04f9b7cada88
2020-06-03 19:12:27 +02:00
OpenStack Release Bot 1466c43a1a Update master for stable/ussuri
Add file to the reno documentation build to show release notes for
stable/ussuri.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/ussuri.

Change-Id: Ibb5e90953364300b8dd2a1f5f9c51787449883b3
Sem-Ver: feature
2020-06-01 13:12:32 +00:00
Andreas Jaeger 0618b16995 Update docstheme for style
New version of openstackdocstheme (Victoria+) respects pygments_style.
Since this repo is using now Victoria (master) requirements but has
not branched for Ussuri yet, it uses the new version.

Change pygments_style to 'native' since old theme version always used
'native' and the theme now respects the setting and using 'sphinx' can
lead to some strange rendering.

Change-Id: Ia006ee0643dc3fff183643a43a0d65911c0249f0
2020-05-20 18:47:09 +02:00
Dmitriy Rabotyagov 8bc32e3858 Replace git.openstack.org with opendev.org
This patch replaces git.openstack.org with opendev.org as redirection
from old path was enabled.
Also we change upper constraints url due to [1]

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006478.html

Depends-On: https://review.opendev.org/693841/
Change-Id: I50c1ce9025bd9b947bfd0cd516eb5b3c0a54e62b
2019-11-14 16:58:29 +00:00
OpenStack Release Bot 17e7ac195f Update master for stable/train
Add file to the reno documentation build to show release notes for
stable/train.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/train.

Change-Id: Ie3755f7c39ed34e6b68a11f7e86a986c4f6f0051
Sem-Ver: feature
2019-10-22 18:56:58 +00:00
OpenStack Release Bot 59d8eae9ff Update master for stable/stein
Add file to the reno documentation build to show release notes for
stable/stein.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/stein.

Change-Id: I2ec9816beb74beb0dd1280c519204a54a71df42d
Sem-Ver: feature
2019-04-08 09:17:19 +00:00
Gaudenz Steinlin 15da928766 Fix polling namespace on compute nodes
Previously only ceilometer-polling services running in the central
container had a polling_namespace configured. Those running on compute
nodes used the default which is to run all pollsters from the central
and compute namespace. But there is no need to gather the data for the
central namespace on every compute node.

With this fix the central container only runs the central pollsters and
those on the compute nodes only the compute pollsters. This can be
adjusted by config_template overrides in group_vars if needed.

Change-Id: Ia130bd7f9000882b556aea2190de97ddb290bafc
2019-03-26 10:32:37 +01:00
Dmitriy Rabotjagov ed4d7ed536 Cleanup files and templates using smart sources
The files and templates we carry are almost always in a state of
maintenance. The upstream services are maintaining these files and
there's really no reason we need to carry duplicate copies of them. This
change removes all of the files we expect to get from the upstream
service. while the focus of this change is to remove configuration file
maintenance burdens it also allows the role to execute faster.

  * Source installs have the configuration files within the venv at
    "<<VENV_PATH>>/etc/<<SERVICE_NAME>>". The role will now link the
    default configuration path to this directory. When the service is
    upgraded the link will move to the new venv path.
  * Distro installs package all of the required configuration files.

To maintain our current capabilities to override configuration the
role will fetch files from the disk whenever an override is provided and
then push the fetched file back to the target using `config_template`.

Change-Id: Ia467e20c32732152a03579216a0ced0dbb4038c4
2019-02-04 21:25:57 +02:00
Francois Deppierraz 475e2c15c3 releasenotes: oslo-messaging-separate-backends add project name
Without this patch, the release notes published at
https://docs.openstack.org/releasenotes/openstack-ansible/rocky.html contains
the same line multiple times which is not very clear.

[...]
    Support separate oslo.messaging services for RPC and Notifications
    to enable operation of separate and different messaging backend servers.

    Support separate oslo.messaging services for RPC and Notifications
    to enable operation of separate and different messaging backend servers.
[...]

Change-Id: I0ed1a43670d97f2e2215d04c641f7bd4cfbe4f44
2018-10-15 16:56:09 +02:00
Dmitriy Rabotjagov 1128c21955 Fix of oslomsg undefined variables for services notifications
A buch of defaults oslomsg related variables were configured.
In case of enabling ceilometer for services, role failed unless
all required vars has been specified manually by deployer.

Also vars ceilometer_oslomsg_rpc_servers
and ceilometer_oslomsg_notify_servers were removed
They were not used anywhere except ceilometer.conf.j2
and might be easily replaced with host_group vars.
Their removal allowed to simplify macros.

Fixed distro_install functional test for ubuntu,
as ceilometer-agent-notification package was missing.

Change-Id: I148ccaff9576b09d33d889b79963e88ca84d2ffe
Closes-Bug: 1794688
2018-10-04 15:54:08 +03:00
Zuul 2d201e2082 Merge "Remove the duplicated word" 2018-08-17 04:40:53 +00:00
OpenStack Release Bot 8675128f8b Update reno for stable/rocky
Change-Id: Ib5fc56dbad571c27905fbbe631940f7a46956786
2018-08-10 16:46:09 +00:00
Kevin Carter 195aed6f51 Add systemd journal logging to the service config
The systemd journal would normally be populated with the standard out of
a service however with the use of uwsgi this is not actually happening
resulting in us only capturing the logs from the uwsgi process instead
of the service itself. This change implements journal logging in the
service config, which is part of OSLO logging.

OSLO logging docs found here: <https://docs.openstack.org/oslo.log/3.28.1/journal.html>

Change-Id: I5ae4ee8b0f69a4ed9b6088f043abaa1c4b1291d8
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2018-07-31 12:58:57 -05:00
Andy Smith 8daaa755dd Update to use oslo.messaging service for RPC and Notify
This introduces oslo.messaging variables that define the RPC and
Notify transports for the OpenStack services. These parameters replace
the rabbitmq values and aure used to generate the messaging
transport_url for the service. The association of the messaging
backend server to the oslo.messaging services will then be transparent
to the ceilometer service.

This patch:
* Add oslo.messaging variables for RPC and Notify to defaults
* Update transport_url generation in config template
* Add oslo.messaging to tests inventory
* Update tests
* Add release note

Change-Id: Ib14a7a5ec0348933eee4fb1a151010841b29ca1f
2018-07-12 09:56:32 -04:00
Jesse Pretorius 4766a2fa14 Execute service setup against a delegated host using Ansible built-in modules
In order to reduce the packages required to pip install on to the hosts,
we allow the service setup to be delegated to a specific host, defaulting
to the deploy host. We also switch as many tasks as possible to using the
built-in Ansible modules which make use of the shade library.

The 'virtualenv' package is now installed appropriately by the openstack_hosts
role, so there's no need to install it any more. The 'httplib2' package is a
legacy Ansible requirement for the get_url/get_uri module which is no longer
needed. As there are no required packages left, the task to install them is
also removed.

The openstack_openrc role is now executed once on the designated host, so
it is no longer necessary as a meta-dependency for the role.

Ceilometer no longer has an API service, so the service setup task for it is
removed as it is unnecessary, along with the related variables which are no
longer used.

Depends-On: https://review.openstack.org/579233
Depends-On: https://review.openstack.org/579959
Change-Id: I4072acc1770432526a8bc26ebb5833b6fdd61f0a
2018-07-03 20:00:28 +00:00
zhulingjie a054385167 Remove the duplicated word
Change-Id: I54491010b6a1612493cb3a8a282e419e1c80cca4
2018-06-12 12:22:35 -04:00
Markos Chandras 5e0a16e624 Add support for using distribution packages for OpenStack services
Distributions provide packages for the OpenStack services so we add
support for using these instead of the pip ones.

Change-Id: I3edabacc3978cd42988a6c0c04a011c22159b9fa
Implements: blueprint openstack-distribution-packages
2018-05-18 15:25:38 +01:00
OpenStack Release Bot c14c698b75 Update reno for stable/queens
Change-Id: I96c5434302536566c1f7c5094750e92e53dcd55d
2018-02-14 15:47:25 +00:00
wangqiangbj bbe4af7ef0 fix misspelling of 'configuration' and 'list'
fix misspelling of 'configuration' and 'list'

Change-Id: I060cd03fe075f60cc738cbbdc2999b74931fd378
2018-02-07 19:32:58 +00:00
Mohammed Naser 33f5dfa7e3 Drop MongoDB installation and API file configurations
Ceilometer no longer stores any data so the MongoDB installation
playbook is not used.  In addition, it no longer has an API so
the api-paste file is useless as well.

Closes-Bug: #1747612
Change-Id: I20104cc357f78b01e2b1246a3f51d609bb2f4f24
2018-02-06 15:28:48 -05:00
Andreas Jaeger 55bb04eaad Remove setting of version/release from releasenotes
Release notes are version independent, so remove version/release
values. We've found that projects now require the service package
to be installed in order to build release notes, and this is entirely
due to the current convention of pulling in the version information.

Release notes should not need installation in order to build, so this
unnecessary version setting needs to be removed.

This is needed for new release notes publishing, see
I56909152975f731a9d2c21b2825b972195e48ee8 and the discussion starting
at
http://lists.openstack.org/pipermail/openstack-dev/2017-November/124480.html
.

Change-Id: Ia73e43f262b36eb19b7854830c329e36e3807859
2017-11-17 07:54:58 +01:00
Jean-Philippe Evrard bcc6ea58dc Initial OSA zuul v3 role jobs
This patch implements an initial set of jobs intended to match
the current job execution method. It does not intend to improve
how the jobs are executed - only to replicate what is currently
in openstack-infra/openstack-zuul-jobs and provide the platform
to iterate on.

Change-Id: Ie76b4452e58b3da82c8119b9bdb3bbb274e17137
2017-10-20 09:23:24 +00:00
OpenStack Release Bot 7ec99d8a17 Update reno for stable/pike
Change-Id: I8a7459e52fdfd1379b3b955e9a0b11d4fa869ed8
2017-08-21 10:32:25 +01:00
ZhongShengping a5c5c4f145 Fix openstackdocstheme settings
To use openstackdocstheme 1.11.0 properly, this patch fixes
some settings according to follow[0].

[0]https://docs.openstack.org/openstackdocstheme/latest/

Change-Id: I24d8749c87fa86b4edd6893baf0be1d3581c0e0e
2017-07-03 16:13:04 +08:00
ZhongShengping 0c1423e960 Switch from oslosphinx to openstackdocstheme
As part of the docs migration work[0] for Pike we need to switch to use the
openstackdocstheme.

[0]https://review.openstack.org/#/c/472275/

Change-Id: I09aea2ac911f6b62c048a0f861c88053cc320ef1
2017-06-26 11:30:35 +08:00
Jesse Pretorius 9e96b65126 Source template files from git or deploy host
Instead of sourcing the paste/policy files from the role,
the deploy host will first be checked, then the git source.

The current mechanism uses a lookup, causing the fetch of
the default templates to happen via curl from the deployment
node. This causes problems if the deployment node does not
have access to the repo server web service, which may be the
case in high security environments.

This patch changes the mechanism to only use the lookup
module for the file content that is on the deployment node,
then falls back to using the uri module to fetch the default
content. This ensures that the deployment node does not have
to reach into the environment for the content.

Additionally, the following variables and related tasks are
removed as the files they applied to no longer exist in the
source git repository:
- ceilometer_event_definitions_yaml_overrides
- ceilometer_event_pipeline_yaml_overrides

The pattern applied is the same as that used in the
combination of the following two reference patches:
- https://review.openstack.org/446235
- https://review.openstack.org/463390

The rootwrap.conf template is re-added because it cannot be
used verbatim from the upstream repository. It requires the
addition of the service venv bin in the exec_dirs. A mechanism
to implement this dynamically will be figured out in a later
review along with an implementation which will fetch the
rootwrap files directly from the git source too.

Change-Id: I248910a544f611b590bc93449aea98434802cae3
2017-05-19 16:12:28 +00:00
Jesse Pretorius 1678896b2c Rename release note to unique hash
Change-Id: Iad97bc7023350e34ae5b4e27b12a6367ba0eac95
2017-04-28 11:38:15 +01:00
Jesse Pretorius a10f8ded99 Reduce init restart/kill times
The systemd unit 'TimeoutSec' value which controls the time
between sending a SIGTERM signal and a SIGKILL signal when
stopping or restarting the service has been reduced from 300
seconds to 120 seconds. This provides 2 minutes for long-lived
sessions to drain while preventing new ones from starting
before a restart or a stop.

The 'RestartSec' value which controls the time between the
service stop and start when restarting has been reduced from
150 seconds to 2 seconds to make the restart happen faster.

These values can be adjusted by using the *_init_config_overrides
variables which use the config_template task to change template
defaults.

Change-Id: I17334c4685fb7a749ef16dee1e1e7f54398781fc
2017-04-26 13:02:17 +00:00
Andy McCrae 1f61711ce3 Rename reno to avoid conflict on integrated repo
Change-Id: I3bac6623cb8796ab0d085b35a2bab144ba9553ff
2017-04-11 11:49:00 +01:00
Kevin Carter 178ad8245f Ensure the components are isolated from the system
This creates a specific slice which all OpenStack services will operate
from. By creating an independent slice these components will be governed
away from the system slice allowing us to better optimise resource
consumption.

See the following for more information on slices:

* https://www.freedesktop.org/software/systemd/man/systemd.slice.html

See for following for more information on resource controls:

* https://www.freedesktop.org/software/systemd/man/systemd.resource-control.html

Tools like ``systemd-cgtop`` and ``systemd-cgls`` will now give us
insight into specific processes, process groups, and resouce consumption
in ways that we've not had access to before. To enable some of this reporting
the accounting options have been added to the [Service] section of the unit
file.

Change-Id: I6ad4fbf820938eef633aa48db217350a97786541
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2017-04-04 18:33:10 +00:00
ZhongShengping 41f644e6b0 Add a release note
The review[0] has been merged, it needs a release note, so add it.

[0]https://review.openstack.org/#/c/448360/

Change-Id: Id4205ba63d56d96635edb87b0aaa1110f35b6bb4
2017-03-25 12:36:25 +08:00
Miguel Alex Cantu 5e6ff1ea5f Remove Ceilometer API Service
Ceilometer API is now deprecated in favor of using
Gnocchi, Aodh, and Panko to pull telemetry information.

Change-Id: I4464fc6bd4ad3ef14e2638abcdb86180e82615e1
Closes-Bug: 1666640
2017-03-02 15:42:08 +00:00
Miguel Alex Cantu 8784e73eec Deprecate ceilometer-collector
Per https://review.openstack.org/#/c/413920/, the ceilometer-collector
service is now deprecated.
This commit removes the inventory group mappings to the
ceilometer-collector service/container. It also removes
the service from the bootstrap and testing inventory.
Gnocchi is now explicity used as a publisher in the
pipeline.

Partial-Bug: 1666238
Change-Id: I396b154d106c0afba44d57792ae6dad39b33a6f5
2017-02-22 10:42:06 -05:00
Andy McCrae 37890ba89a Add release note for git_config_lookup_location
Although the feature doesn't impact upgrades or users experiences, we
now expose the option to adjust the git repository that is required to
retrieve the configuration files.

This feature is important for deployers with no access out (except for
from the repo host for example), so we should add a releasenote to bring
attention to this.

Change-Id: I0f0ab474a7ac86fd0273949b54be6c0ad4a89721
2017-02-08 14:32:44 +00:00
Cao Xuan Hoang faf5792b51 Use https instead of http for git.openstack.org
Trivialfix

Change-Id: Ic19a9323606f690b7ec4bf7b26bbd23e8263619a
2017-02-06 16:48:10 +07:00
OpenStack Release Bot 90170fb228 Update reno for stable/ocata
Change-Id: Icd9ac5ba7068b2acfa6d12ce5a4f14d08c104d8d
2017-02-03 18:58:08 +00:00
Andy McCrae e58f6e0082 Remove unrequired templates in favour of upstream
This patch updates the templated files we have failed to update, and
will pull these from upstream in future. This will ensure the version of
Ceilometer matches the conf files that are used.

pipeline.yaml is still carried because we override some vars in that
file. This is a TO-DO for later, but this patch will reduce the amount
of files we need to carry in templates.

Change-Id: I64fa7af1ca7a58214b6c302131964b819aad4915
2017-01-25 14:05:26 +00:00
Marc Gariepy 4487698ad3 Add CentOS support for os_ceilometer role
Depends-On: Iaf51101bbaa5eba49f78e950152095913951430e
Change-Id: If002cf8f8f5c04df0dee664640ab725cea8c1a3b
2016-12-20 19:14:13 +00:00
Jesse Pretorius 2b02a015f4 Simplify pip options/constraints mechanism
The current constraints generation for the
installation involves multiple tasks and multiple
variables.

Using multiple tasks extends the installation time
unnecessarily and the additional variables are
unnecessary.

This patch aims to simplify the mechanism and
hopes to speed it up a little.

Change-Id: I483d1eae983a8ff7211bcbe51158eb78a859ed3a
2016-11-02 16:41:00 +00:00
Gaudenz Steinlin 6ca135ebbc Make ceilometer sample interval configurable
This could already be configured via the ceilometer_pipeline_yaml_overrides
in theory, but in practice this is very unpractical as one would have to
override the whole sources configuration. Only overriding one key in a
list of dicts is not possible.

Change-Id: Ieb5569982f080446295cecc33fb70c6b5d1cb9d6
2016-10-27 17:38:55 +02:00
Andreas Jaeger 9de950f1f9 Enable release notes translation
Releasenote translation publishing is being prepared. 'locale_dirs'
needs to be defined in conf.py to generate translated version of the
release notes.

Note that this repository might not get translated release notes - or
no translations at all - but we add the entry here nevertheless to
prepare for it.

Change-Id: Id37add4f9d6ce53db609ed2e34206c80133f0f73
2016-10-06 20:36:06 +02:00
Major Hayden 074870cb94 Update reno for stable/newton
Change-Id: I28ce5ebcdec3f5e78646b4a588f8790d8922936b
2016-09-29 14:15:15 -05:00
Kevin Carter 0d4b96182b Disable list_extend in config_template
This allow ceilometer pipelines to be fully controlled with config_template.
Previously a ceilometer pipeline would extend a nested list instead of
redefining it which can have undesirable effects. This change disables the
default list_extend property within the config_template allowing a deployer
to fully redefine a given pipeline.

Change-Id: Ibe64254dcbca99b6b720146d2d4f2a25e22236a3
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2016-09-19 09:19:15 +00:00
Steve Lewis 31cddcd762 Serve the ceilometer-api using mod_wsgi
With the dependent change merged Ceilometer API will no longer run
without a stand-alone wsgi engine. It is too late in the cycle right
now to bring over changes for nginx and/or uwsgi for this project so
only this deployment option is being supported at this time.

Change-Id: I3cff6b183feae3c346cd56602d7b733a6dd9a01b
Depends-On: I8812ea1a92d6dc7f41a490e971bb7a09dee9b304
2016-09-14 17:24:49 -07:00
Jesse Pretorius de037c4d3f Rename package lists (and related vars) appropriately
In order to make it easier to differentiate between the lists of
python packages, distribution packages, downloaded packages,
package pins and other similar variables the variable names are
being changed to ensure that they have a more explicit suffix
that defines the purpose and makes the naming more consistent.

This is to facilitate a lookup plugin which will be able to look
up all the package lists and present them as a consolidated piece
of data which may be used for artifact preparation.

Change-Id: Ia44a7a5eefdba72a55ffa877d92cdda2732d4c73
2016-08-30 16:41:49 +01:00
Jesse Pretorius f32fdb9317 Add ability to change apt/yum package state
The current method of installing the distribution packages required is
set in the tasks and cannot be changed by a deployer.

Currently the apt task always installs the latest package. This results
in unexpected binary changes when a deployer may simply be trying to
execute a configuration change.

This patch adds the ability for a deployer to change the desired state
so that the results are predictable.

Change-Id: Ibdec442314f2a3d0b175caef2696cddc96d4c9ed
2016-08-02 13:29:27 +01:00