Commit Graph

162 Commits

Author SHA1 Message Date
Jaromir Wysoglad 04c2c2baf9 Change default pipeline interval comment
Change the comment to match what's actually being used as default.
By default the devstack plugin uses the
etc/ceilometer/polling_all.yaml file, which has 300 pipeline
interval.

Change-Id: Id117ae910d0c592fdaad6759c2eebc039f92b8c7
2024-02-20 02:07:29 -05:00
Takashi Kajinami 5f1b0c8aed devstack: Use spaces instead of tabs
Spaces are used more commonly. Do not mix tables and spaces.

Change-Id: I24599981851ad593a18da44d8c289b3fe54d2f0b
2024-01-24 12:40:42 +00:00
Takashi Kajinami 55dfd1eee4 Drop authtoken middleware options from ceilometer config file
Ceilometer no longer provides API service.

Change-Id: Ice5d80f2f44a0a79f051cffb6fb84421160dd380
2023-12-25 21:45:23 +09:00
Jaromir Wysoglad 10ee6a9690 Fix devstack plugin for CEILOMETER_BACKEND=none
My recent changes to the devstack plugin broke the plugin for
situations, where CEILOMETER_BACKEND=none. The reason is the
addition of the CEILOMETER_BACKENDS variable, which uses
"," for delimiting individual backends. This meant, that
when using CEILOMETER_BACKEND=none, the CEILOMETER_BACKENDS
would in fact be ",none", which wouldn't equal to "none" in
a check in the plugin.sh

The fix is to delete all "," characters from the
CEILOMETER_BACKENDS before checking if it equals to "none"

Change-Id: Ief09bf1d5da79d7f9b7a2ba4055be2b2ef3dc1b8
2023-11-09 04:57:30 -05:00
Jaromir Wysoglad ef237e3c0b Add sg-core backend support in devstack plugin
This change also adds a new variable to set during
devstack deployment: "CEILOMETER_BACKENDS". Its
usage is similar to the "CEILOMETER_BACKEND". The difference
is, that CEILOMETER_BACKENDS expects a comma separated
list of backends (instead of only one backend). The
behavior of CEILOMETER_BACKEND is still the same for
backwards compatibility. If both CEILOMETER_BACKEND
and CEILOMETER_BACKENDS are set, then the value
of CEILOMETER_BACKEND is appended to CEILOMETER_BACKENDS.

The default backend if both "CEILOMETER_BACKEND" and
"CEILOMETER_BACKENDS" are empty is still gnocchi

Change-Id: Ib92fa062784479796c8a2ca4bd69a538e4e05f63
2023-10-19 08:19:53 -04:00
Sean Mooney cb7084ed18 Fix gnocchi install from git
Recent changes to git prevent git repos from being parsed if they
are not owned by the current user as part of a CVE fix. Some
project use stevedore to load plugins and this is broken if
gnocchi is installed from git via "sudo pip install".

This change uses devstacks git_clone to ensure that the gnocchi
repos is clonned under $DEST aka /opt/stack as the current user not
root. It then uses pip install -e to install the precloned repo.

To enable this GNOCCHI_REPO and GNOCCHI_BRANCH are intoduced
and the non standard GNOCCHI_GIT_PATH is removed.

A long standing comment to stop installing from git after
Gnocchi 4.0 is adressed by only installing from  git if
gnocchi is listed in LIBS_FROM_GIT. However since
4.4.2 is currently incompatible with openstacks upper-constraits
file the ci will continue to git however the git repo will
now be prepared by zuul using required-projects.

This will have the side effect of allowing
Depends on to work for PRs to gnocchi however testing that
is out of scope of this patch.

This patch adds a sample local.conf that can be used to deploy
locally for devopment.

Depends-On: https://review.opendev.org/c/openstack/telemetry-tempest-plugin/+/872350
Change-Id: I833ea3bffb18bec063423450be0f3b8ff92f9a5a
2023-02-03 07:59:20 -05:00
Yadnesh Kulkarni 8e57a3a6f3 Exclude metrics from "service" project
Upon installing ceilometer and gnocchi using devstack,
"filter_project" in "pipeline.yaml" is set to "gnocchi_swift"
project. However, no such project exists in keystone.
```
publishers:
  - gnocchi://?archive_policy=ceilometer-low&filter_project=gnocchi_swift
```

This change, will set "filter_project" to "service" project which
will exclude all metrics from it.

Also add the name of the project to the logs which couldn't be found
in keystone.

Closes-Bug: #1988923
Signed-off-by: Yadnesh Kulkarni <ykulkarn@redhat.com>
Change-Id: Ifc215f86134729665c142bb9bf64f66ca8de2a29
2022-09-07 19:41:20 +05:30
Takashi Kajinami 9366bc8f18 Do not install libvirt python bindings from pip
Since [1] was merged, devstack no longer installs libvirt python
bindings from pip but use distro packages. This change removes
the logic to install the python bindings using pip to follow that
change in devstack, otherwise installation fails because of conflict
between packages available in pip and one installed by distro packages.

[1] https://review.opendev.org/c/openstack/devstack/+/798514

Closes-Bug: #1939990
Related-Bug: #1933096
Change-Id: I369a95cf30e91738d10ad2e5a3d5f6988bdd76cb
2021-08-16 08:23:00 +00:00
Zuul 829cef1aee Merge "Do not install libvirt-python on RHEL via pip" 2021-08-12 10:59:32 +00:00
Matthias Runge f57a51e43c Do not install libvirt-python on RHEL via pip
since that is already in place.

Closes-Bug: #1896327
Depends-on: https://review.opendev.org/c/openstack/telemetry-tempest-plugin/+/801038

Change-Id: Ic158561b3f4d8ddcc092f4e8da1b3215f976fc98
2021-08-11 20:37:28 +02:00
Takashi Kajinami 2af5b376a2 Gnocchi: replace deprecated [storage] coordination_url
[storage] coordination_url was deprecated since Gnocchi 4.1.0 and
replaced by [DEFAULT] coordination_url[1].

[1] https://github.com/gnocchixyz/gnocchi/commit/70b9ca427

Change-Id: I7e271ca36216d10ce23942c06ae2f3575c00fdee
2021-07-06 21:35:15 +09:00
Matthias Runge 6c5102a548 Remove dependency to panko
Panko is being deprecated and removed from OpenStack.

Change-Id: I6948a965cba5e3bdba84edbbb49af279fd0310e5
2021-05-18 15:04:18 +02:00
Eyal ad550eb826 Revert "[goal] Migrate testing to ubuntu focal"
This reverts commit 3bb7b71e1a.

https://github.com/gnocchixyz/gnocchi/issues/1069 was fixed

Change-Id: I3277ed13b4b343c553a3c21eab2187bb8abd4251
2020-10-21 06:57:41 +00:00
Ghanshyam Mann 3bb7b71e1a [goal] Migrate testing to ubuntu focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

Story: #2007865
Task: #40223

Use mariadb because myql has issue on Focal which need below issue fix to be
released - https://github.com/gnocchixyz/gnocchi/issues/1069

Depends-On: https://review.opendev.org/#/c/734700/

[1] https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal.html

Change-Id: I42f104a924ea09ba13f12311dfdb2f79e0d2b78f
2020-09-17 01:41:30 +00:00
Zuul 668850c5fb Merge "Remove _ceilometer_check_for_storage check" 2019-04-25 04:07:47 +00:00
Zuul 3a40ddc0c8 Merge "tempest: Allow to configure tempest config" 2019-04-25 04:02:24 +00:00
zhurong 6052583756 Remove _ceilometer_check_for_storage check
We can check from the history[0], actually it doesn't matter if
gnocchi or panko is started first., so this check is unnecessary.
Also when i want to migration using native zuulv3, the enabled
plugins is in the alphabetical order, so this will caused can not
install devstack correctly.

[0]: https://review.opendev.org/#/c/387620
[1]: http://logs.openstack.org/99/651999/3/check/telemetry-integration-test/9066108/controller/logs/devstacklog.txt.gz#_2019-04-17_07_26_30_988
Change-Id: I5cbd93739f75b8141f8b79ae03bb8b99756b2a38
2019-04-22 06:37:20 +00:00
Zuul d5baab5745 Merge "Replace git.openstack.org URLs with opendev.org URLs" 2019-04-22 05:54:08 +00:00
ZhongShengping a2ab322aca Replace git.openstack.org URLs with opendev.org URLs
Thorough replacement of git.openstack.org URLs with their opendev.org
counterparts.

Change-Id: I4136406cd6c3e8dc3ac84ceeeed2aca011432272
2019-04-22 11:01:39 +08:00
zhurong 56fd8168d2 tempest: Allow to configure tempest config
Change-Id: Ied0822ee1031c399c7aa86482e8f570c48c3935e
2019-04-19 13:31:05 +08:00
zhurong de81f77988 Remove the unused function _ceilometer_config_apache_wsgi
Since ceilometer api has removed, _ceilometer_config_apache_wsgi
is the unsed function.

Change-Id: I51cf3339c581a0de72181026960ad2c8587eb2b7
2019-04-15 08:57:44 +08:00
Zuul f1ac9663e0 Merge "Reduce the alarm_threshold value to make autoscaling test stable" 2019-04-13 02:10:34 +00:00
Eyal c2c3263dc0 remove redundant line
get_apache_version function was removed
local apache_version is not used anywhere

Change-Id: Ib7c71aeda6023fcd587b180e4b1e209270528bf1
2019-04-12 13:39:06 +00:00
zhurong 21bab8171f Reduce the alarm_threshold value to make autoscaling test stable
telemetry-dsvm-integration sometimes failed due to
the alarm_threshold is too high[0], we can just deduce
the alarm_threshold value to make test stable.

[0]http://logs.openstack.org/62/643262/3/check/telemetry-dsvm-integration/9771ecc/logs/screen-aodh-evaluator.txt.gz#_Apr_11_15_36_33_279860

Change-Id: I63af7f6c804e123395b225244111543dedc67581
2019-04-12 00:40:43 +00:00
Ian Wienand ab63ab2ce6 Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: If416ba6fe80127f230cffed064da5837d021be80
2019-03-24 20:32:44 +00:00
Julien Danjou 9db5c6c9bf pipeline: remove transformer support
Transformers cannot work correctly on multiple nodes without workload
partitioning, which has been removed.
The transformation of data is no more the responsability of Ceilometer. The
data storage used by default (Gnocchi), is able to handle the scenario that
Ceilometer covered by default such as computing the rate of a metric.

Change-Id: If3683318b998a37c40bc09314dd8ab3eef326ba7
Depends-On: Ifd1d04ce813028f115c19bc983e7dd1e63c6f8a5
Depends-On: I0330c09d72c20d63d08770b52d3071512a418260
2018-09-06 10:38:25 +02:00
Julien Danjou 9d90ce8d37 notification: remove workload partitioning
Workload partitioning has been quite fragile and poorly performing so it's not
advised to use it. It was useful for transformers: since transformers are going
away too, let's simplify the code base and remove it

Change-Id: Ief2f0e00d3c091f978084da153b0c76377772f28
2018-08-31 13:29:51 +02:00
Julien Danjou 80239e48ea gnocchi: use ceilometer-low as default archive policy
Otherwise it's never used, at all.

Change-Id: I68c29a9f9312300474d5e5e9c6944ce617bc1e3a
2018-08-31 13:29:51 +02:00
Pavlo Shchelokovskyy cc337eaa00 Stop gnocchi during unstack
since it is ceilometer's devstack plugin who enables/starts gnocchi
services, it is appropriate to also stop them during unstack phase.

Change-Id: I97747a98ddb139a6f89fa54b4d17e0ca1d1bdf62
2018-04-18 13:27:17 +00:00
gord chung f17ba4f9de remove ceilometerclient references
it's gone.

Change-Id: Ibbe3f62714fa76e9b4338eeb507e35ad620208c8
2018-02-12 15:32:25 -05:00
ghanshyam b3539b9fd5 Remove use of unsupported TEMPEST_SERVICES variable
TEMPEST_SERVICES global variable is not supported
by devstack since long back.
- I380dd20e5ed716a0bdf92aa02c3730359b8136e4
- I9c24705e494689f09a885eb0a640efd50db33fcf

Service availability of tempest known services will be
set by devstack with local check.
- I02be777bf93143d946ccbb8e9eff637bfd1928d4

This commit removes the unused TEMPEST_SERVICES setting
Related-Bug: #1743688

Change-Id: I50bd32fc2103af0170ee8d350f31cf589d85422f
2018-01-23 16:48:55 +03:00
Mehdi Abaakouk 26d26d6776 devstack: fix gnocchi database setup
With postgresql, we must wait at least post-config to
create the database.

Change-Id: I72ce33828febb48136e239d0e70f07674aef9d4a
2018-01-16 09:49:13 +01:00
jing.liuqing 39aaf97e8e Minor update comment of devstack settings
Change-Id: I273b4bcf3897416ffa61cfc92369b475d29ea8fb
2017-12-22 14:14:46 +08:00
Zuul 0ae26d72f2 Merge "devstack: redis on opensuse needs to have default config" 2017-12-19 14:08:16 +00:00
Sumit Jamgade b0edc485ea devstack: redis on opensuse needs to have default config
this patch adds a default config and uses template version of
unit-file to restart redis

Change-Id: I3c3498f408ac832c50d8f0e1834247492570fd4c
2017-12-19 11:05:42 +01:00
pangliye 00dc0e2303 remove ceilometerclient
ceilometerclient is no longer maintained

Change-Id: I73587e194341670951b7edb321d86af4f256cb27
2017-12-04 14:02:35 +08:00
gordon chung 0dbdd043c4 Revert "devstack: Set an optimal processing queue"
This reverts commit f1bdf6751a.

this causes distribution to be either 50/50 or 100/0. in the latter
case, the single worker usually fails to process pipeline queues in a
timely manner

Change-Id: I7c34acb29290de641ccbef4844e1e6982fe8b173
2017-11-07 17:43:23 +00:00
Julien Danjou 9323f07f97 Remove deprecated storage drivers
Change-Id: I6b262dd440a72f25662b64d938ab9e5328709a97
2017-10-26 09:35:14 +02:00
Julien Danjou d881dd5228 Remove Ceilometer API
This removes the deprecated Ceilometer API.

Change-Id: I752b36b3dfe8f935b68c4d3d59ccb5b8b60c582f
2017-10-25 14:38:43 +02:00
gord chung fad69e9603 kill collector
Change-Id: I7720d20eab345a7835d57fac573332eca0e7d11e
2017-10-16 03:20:38 +00:00
Julien Danjou 83ffaffcb2 Replace the Gnocchi dispatcher by a publisher
This removes the deprecated Gnocchi dispatcher and replaces it by its
equivalent publisher.

Change-Id: Ie44baf20ccb8de5794f5f0c3d4717f7e56afa63b
2017-10-13 18:18:07 +02:00
Mehdi Abaakouk f67e4e0cf5 devstack: install ceilometer extra
Change-Id: I93ced9915e493f36fe3af42267a798b7ef30e40b
Closes-bug: #1720120
2017-10-05 09:44:24 +00:00
Lingxian Kong ab0be96b28 Set default ceilometer storage backend to gnocchi
The default storage backend is always set in ceilometer gate job,
but it needs to be set to a sensible default value.

Closes-Bug: #1707713
Change-Id: Ibe3939f114e843810a12c2f27c35a8a91dbce6ac
2017-09-27 11:20:34 +13:00
gord chung 36a31ff3f5 use gnocchi devstack script
check to see if gnocchi enabled independently via enable_plugin.
if so, let it do it's thing.

Change-Id: Idabbf9b6e874875f8dd3bad52501966385823395
2017-07-28 13:00:31 +00:00
Jenkins f1cc475e3f Merge "fix service path for fedora" 2017-07-26 03:45:55 +00:00
Julien Danjou b62fa85400 Limit the default numbers of metrics polled
Enabling everything to be polled and transformed by default is quite heavy and
can lead to a massive amount of unused metrics. Limit the default to a few
metrics known to be actually useful to common deployers.

We keep all pollsters enabled on unit tests and devstack.

Change-Id: Ifb5aa684e575b7904726276b7205824f2dcaa7ce
2017-07-11 17:35:23 +02:00
gord chung ad92c74078 fix service path for fedora
fedora uses /usr/bin and not /usr/local/bin

Change-Id: I2fde1cb5a0ad0a44213e9959c9edcdeeac1445c5
2017-06-14 20:07:37 +00:00
Julien Danjou 8981179024 devstack: install Gnocchi using pip
Depends-On: I7a7bc3deeadd094d7a42b47b16cde2e8a8805a24
Change-Id: I55193f2e39a41fe2bb378b4380f2ae52c5685c8d
2017-06-07 17:50:23 +02:00
Mehdi Abaakouk 3aaba70c3a tempest: Allow to configure granularity
Change-Id: I31344a9f8938ae9c7875cad76430508dd9fd4539
2017-05-02 19:23:50 +02:00
liusheng af7c046e7d Correct the configuration of pipeline_processing_queues in devstack
The [notification] section was missed in the configuration of devstack script.

Change-Id: If955fad4d5c1ceede8a24cd135c6c7b3195be3cf
Closes-Bug: #1678380
2017-04-01 14:39:22 +08:00