Commit Graph

412 Commits

Author SHA1 Message Date
Hasan Acar a24fd834d0 fix: migrate CI to jammy
fix: change tox.ini

fix: change queries for list_dimension_names and list_dimension_values because of influxdb time filter problem

fix: remove build_sphinx group from setup.cfg

fix: handle hashlib security problem

Change-Id: I0d31a8db5ed71c70e7b878ce5e7940e041d0fa43

Change-Id: I6f7066da10e834550cbf0c053c7bf425ac0ead93

Change-Id: If9575aee73d600bbc84fcdf58deb1c57b508d9c2

Change-Id: If515eaeee7539da3ca49997e88785dc65572b334
2024-02-22 14:35:03 +00:00
jayonlau 95747eec73 Clean up extra spaces
Although these errors are not important, they affect the code specification.

Change-Id: Iab8e8ce9e73722c78283323a2e350149e8713e78
2021-10-01 18:31:14 +00:00
Martin Chacon Piza a9f84a0263 Fix Vagrantfile
- Uncomment Ubuntu upgrade/update lines. On Sept. 30th 2021
ca-certificates DST Root CA X3 expired, until a new Bento box with
the update is released we need to update it.

- Purge simplejson before to stack Devstack, that library should
be handled by pip.

Change-Id: If23af3415be43bcb0b5b5de284c3b809c30de453
2021-10-01 16:26:59 +02:00
Zuul ef7d7d36d4 Merge "Fix log-metric configuration" 2021-04-06 12:33:33 +00:00
Adrian Czarnecki 1b5cd30298 Fix log-metric configuration
Fix incorrect if condition in log-metrics logstash configuration,
old if is no working with current version of logstash.

Change-Id: Ia43a5376b1e3074a70238056831797a21f41f269
2021-04-06 10:24:10 +00:00
Martin Chacon Piza a93e1cc979 Workaround for new pip 20.3 behavior
This WA set specific pip version to avoid the issue:
"ERROR: Links are not allowed as constraints" [1]
A proper fix would be to adapt to new pip behavior.
Similar issue on Devstack [2][3]

[1] https://github.com/pypa/pip/issues/8210
[2] https://bugs.launchpad.net/devstack/+bug/1906322
[3] https://review.opendev.org/c/openstack/devstack/+/764803

Change-Id: I49d436b0cf1503b148a04f82e1ee41941ebd9d0a
2021-03-31 16:43:28 +00:00
Martin Chacon Piza bbc9522bb5 Migrate DevStack plugin to Ubuntu Focal
We want to migrate to the latest Ubuntu LTS release 20.04 aka Focal.

Change-Id: Ie8f08a4b2124ff0d726b5faf3b2b4d89200e444e
Story: 2007865
Task: 40197
Depends-On: https://review.opendev.org/#/c/734700
2020-10-13 07:47:29 +00:00
Martin Chacon Piza 43922f8223 [goal] Migrate testing to ubuntu focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

-Bump the lower constraints for required deps which added python3.8 support
in their later version.

-Changing the way to install and configure Zookeeper.
Installing Zookeeper from official Apache's tarball.
Adding the possiblity to set the specific Zookeeper version.
Minor change in zookeeper logger.

-Use mariadb JDBC for monasca-thresh in devstack, since Drizzle isn't
compatible with MySql Server v8.0.x which is default in Focal

-Python 3.8 doesn't seem to like dictionary keys changing during
iteration.

Fixing RuntimeError: dictionary keys changed during iteration.

Tech. details:
It runs well in py27: 5 iterations
It runs risky in py37: 7 iterations
It is forbbiden in py38: raised RuntimeError
Fixed with list(dic.items()) or tuple(dic.items())

dic = {'1': 'a', '2': 'b', '3': 'c', '4': 'd', '5': 'e'}
for key, value in dic.items():
    print("Key: {0} Value: {1}".format(key,value))
    del dic[key]
    print(dic)
    dic[key] = value
print(dic)

Story: #2007865
Task: #40197
Depends-On: https://review.opendev.org/756859
Change-Id: Ieb4cf38038ffb4d1a152f8ab3b64a14098c7cbb3
2020-10-12 15:38:05 +02:00
Zuul 6eccc3f930 Merge "Set legacy_kafka_client_enabled = False on default" 2020-07-21 14:59:57 +00:00
Martin Chacon Piza 9d8ecbd2d9 Fix typo in http_check
This typo brakes the http_check metrics collection in devstack.

Change-Id: Ic6f7d79d944c21ea777038a6c43f71fc66ad588b
2020-07-20 14:07:47 +02:00
Witek Bedyk 3014c840d6 Set legacy_kafka_client_enabled = False on default
We change the default value of kafka.legacy_kafka_client_enabled from
True to False. The use of new Confluent Kafka client is recommended.

DevStack plugin does not set this option anymore.

Depends-On: https://review.opendev.org/740959
Depends-On: https://review.opendev.org/740966
Change-Id: I4d57b8893a6a131769009dc3299789d3fc89bab6
Story: 2007924
Task: 40338
2020-07-14 16:15:23 +02:00
Zuul a88d34ac5c Merge "Remove redundant `install_nodejs` function" 2020-05-31 13:52:01 +00:00
Witek Bedyk d6104a693b [DevStack] Allow testing different Kibana versions
Kibana API has changed between the versions. To allow testing
different Kibana versions `kibana_version` option should be set in
tempest.conf.

This is a partial port of https://review.opendev.org/727195

Change-Id: I0a21bd99c942ab05ce1eae51226132691518bd91
2020-05-26 13:39:46 +02:00
Witek Bedyk 8d31013da5 Remove redundant `install_nodejs` function
The change removes the redundant `install_nodejs` function. After
merging the DevStack plugins function is available in plugin.sh already.

Change-Id: I5e4d6e5b05f9506ba87bdecb601e411b8496453c
2020-05-25 18:10:20 +02:00
arseni.lipinski@ts.fujitsu.com aeed1c63dc Add build and installation for monasca-kibana-plugin in new API
Story: 2006376
Task: 38335

Depends-On: https://review.opendev.org/#/c/680075/

Change-Id: I5887c75dbf499027b21b86c2850370f6729fb451
2020-04-27 10:43:39 +02:00
Andreas Jaeger abad342eb2 Update hacking for Python3
The repo is Python 3 now, so update hacking to version 3.0 which
supports Python 3.

Fix problems found by updated hacking version.

Remove hacking and friends from lower-constraints, they are not needed
there at all.

Change-Id: I35d848e9af297d3561ea2838a4808166d1c36601
2020-04-22 07:37:55 +00:00
Zuul 28e89858f9 Merge "Set DEBUG log level for Elastisearch" 2020-02-11 15:14:07 +00:00
Zuul 7672d09424 Merge "Remove handling legacy monasca-agent service file" 2020-02-06 10:07:45 +00:00
Zuul 16ce482e66 Merge "Reduce number of partitions created by kafka" 2020-02-03 10:14:40 +00:00
Adrian Czarnecki 5918a87fb8 Reduce number of partitions created by kafka
This should help to reduce resource consumed by devstack plugin.

Change-Id: Id0bc58a21d11dda518710896e0fa0ec14e8e4042
2020-01-30 14:32:36 +00:00
Witek Bedyk 9be8348896 Set DEBUG log level for Elastisearch
Change-Id: I3eb37af59f5095b1cc090409b5427be7fe8ebcd8
2020-01-28 09:16:00 +01:00
Witek Bedyk 6d02001337 Remove handling legacy monasca-agent service file
monasca-agent service file is not used anymore. monasca-collector,
monasca-forwarder and monasca-statsd are new services defined in
monasca-agent target.

This change removes the legacy monasca-agent service file handling from
DevStack plugin.

Story: 2000975
Task: 36886

Change-Id: Iac7d608a202440381f211d04b0978218ac36c54d
2020-01-27 10:40:24 +00:00
Witek Bedyk c3993bf48a Disable not needed services in CI job
To improve reliability of logs tempests tests we deploy only necessary
services in CI environment. This should save a lot of resources.

Change-Id: Id5b8ddc0700b2b7bc100f1eefbe891d9016e918c
2020-01-24 10:01:30 +00:00
Zuul f482afc0d8 Merge "Upgrade Elkstack in new API" 2020-01-20 10:51:00 +00:00
arseni.lipinski ce0e62584f Upgrade Elkstack in new API
The commit contains upgrade of Elk components, default index pattern
creation in new API.

Story: 2006376
Task: 38125

Depends-On: https://review.opendev.org/#/c/679781

Change-Id: Ib0b966c0d7db993802b5372156c41b3ebdf1a77f
2020-01-15 12:32:34 +01:00
Zuul b3fb188fa7 Merge "Update nodejs and npm packages" 2019-12-18 15:12:49 +00:00
Witek Bedyk bd26facccf Update DevStack plugin Readme
* remove deprecated content
* add Apache Cassandra deployment option
* add monasca-tempest-plugin deployment description

Change-Id: Id28de21c89bbcde50a0eb947b833a98dde3cd691
2019-12-17 13:17:28 +01:00
Adrian Czarnecki 7c5615617f Update nodejs and npm packages
This updated allow to use python3 to build grafana

Update nodejs from 8.10.0 to 10.17.0
Update npm from 3.5.4 to 6.11.3

Change-Id: I709d1e6134150f1648a8f409ce438544e15ce403
2019-12-11 14:14:51 +00:00
Adrian Czarnecki 1e3e1173ad Update devstack plugin to support new api
Merge log-api and api

Story: 2003881
Task: 36195

Depends-On: https://review.opendev.org/681419/
Change-Id: Idb2361e5ab701cd3dee4eabb4b43116f6e1205c4
2019-12-04 13:52:57 +01:00
Adrian Czarnecki 1941530472 Fix python3 compatibility issue
Make grafana-init.py and influxdb_setup.py scripts compatible with  python3

Change-Id: Id2909094473d82844072a299b9e0dab2d4893557
2019-11-07 14:02:08 +01:00
Ghanshyam Mann 159bc64f41 Correct the IPv6 address and port parsing
There can be lot of possibility for IPv6 address with port,
for example [::1]:80 or [2001:db8:85a3::8a2e:370]:7334.

Parsing that in more standard way is provided by oslo_uilts.netutils
parse_host_port() method[1].

Also unquote '[]' the SERVICE_HOST in case of IPv6 case so that
DB can listen on correct address.

Story: #2006309
Task: #36028

[1] 1b8bafb391/oslo_utils/netutils.py (L37)

Change-Id: I2d0ef40ab71f60564549d031185f99bc7eec40a7
2019-10-22 10:19:07 +00:00
Zuul 57e501d8cf Merge "Enable monasca-agent libvirt plugin" 2019-10-07 09:31:34 +00:00
Witek Bedyk 91792de858 Enable monasca-agent libvirt plugin
The change configures and enables monasca-agent libvirt plugin in
Monasca DevStack plugin. It will allow easier integration of Monasca
with other projects for use cases based on VM measurements.

Story: 2005752
Task: 36842
Change-Id: I061e905bed06cc10c4d62201dcd945f715eb3a6e
2019-10-02 13:27:49 +02:00
Witek Bedyk 3f31ba407b Configure monasca-ui settings in Horizon dir
The default and preferred way of modifying the settings of Horizon
plugin is to add a configuration file to
openstack_dashboard/local/local_settings.d/ directory. For that to work
we should use the settings from django.conf.settings and not from
monitoring.config.local_settings.

[1] https://docs.openstack.org/horizon/latest/configuration/settings.html

Story: 2006556
Task: 36645

Depends-On: https://review.opendev.org/682321
Change-Id: I718b51ce94b09bb547f03686831c3b1ac1721399
2019-09-30 14:40:56 +00:00
Zuul 42cd1b6c1b Merge "Disable legacy Kafka client in notification engine" 2019-09-26 14:12:42 +00:00
Witek Bedyk 47c5ad37d5 Use Confluent Kafka client
The change introduces the possibility to run the API with the new
confluent-kafka client. It has to be enabled in the configuration file.

Story: 2003705
Task: 35859

Depends-On: https://review.opendev.org/680653
Change-Id: Id513e01c60ea584548c954a8d2e61b9510eee8de
2019-09-24 09:41:17 +00:00
Witek Bedyk 7f6dc5f2c2 Disable legacy Kafka client in DevStack
Story: 2003705
Task: 35844

Depends-On: https://review.opendev.org/671451
Depends-On: https://review.opendev.org/644844
Change-Id: Ic7e984df9f7a0aa97108cddc55b95834cabe3938
2019-09-17 13:26:55 +00:00
Witek Bedyk 29fa4e5e6b Disable legacy Kafka client in notification engine
The change disables legacy Kafka consumer in producer in monasca
notification engine in DevStack plugin.

Story: 2003705
Task: 36094

Depends-On: https://review.opendev.org/674812
Change-Id: Ic5d3523caa7e16f1fbebc73839d19fe0a07f162e
2019-09-01 13:39:41 +02:00
Witek Bedyk dfd9423526 Upgrade Apache Kafka to version 2.0.1
Upgrade Apache Kafka to current stable version 2.0.1.

Issues have been observed with legacy Kafka producer being used in
notification engine together with newer Kafka broker versions.

Following changes are included:

* Deprecated configuration option `advertised.host.name` is replaced
with `listeners`.
* Default `log4j.properties` is used.

Story: 2005624
Task: 30933
Change-Id: I898b511b2ab8f68e4850faab2098044cd3f94ee7
2019-08-14 14:51:44 +02:00
Zuul fb460f6421 Merge "Upgrade Storm to 1.2.2" 2019-07-23 13:28:14 +00:00
Doug Szumski 4f62c1d318 Upgrade Storm to 1.2.2
This is the current release and has been running in Kolla for some time,
see notes here:

https://storm.apache.org/2018/06/04/storm122-released.html

Change-Id: I73c5118912ca07d73d99ba893bc6e20f74774a6e
Story: 2005624
Task: 30934
2019-07-18 14:12:49 +00:00
Adrian Czarnecki 1629b13ac2 Make python3 default for devstack
Change-Id: I6f5fe641b1a9a98cc73b44477680f6363ddd2e84
2019-07-18 13:56:55 +02:00
Zuul 0309aca043 Merge "Update DevStack git repository URL in Vagrantfile" 2019-07-15 10:17:09 +00:00
Zuul 85244866b8 Merge "Use monasca-notification.conf during devstack runs" 2019-07-04 17:54:12 +00:00
Thomas Bechtold 2bf341c6dd Use monasca-notification.conf during devstack runs
Since [1], monasca-notification supports the standard oslo.config
based configuration style (ini file instead of yaml). The old
notification.yaml file still works but is deprecated.
So switching to use the new oslo.config based file is the way to go
forward.
Also adjust the zuul job to copy /var/log/monasca/notification and
/etc/monasca/notification.conf so debugging will be a bit easier.

[1] https://review.openstack.org/#/c/464768/

Story: 2004862
Task: 35646

Depends-On: https://review.opendev.org/668508
Depends-On: https://review.opendev.org/663960
Change-Id: I489d66d623c3e27ca28ba87ebde32264b13ac0f3
2019-07-02 12:21:52 +02:00
Witek Bedyk 37da650dc5 Update DevStack git repository URL in Vagrantfile
Change-Id: Ia127e0148c9e2b68c9b222591802cb5538e3154e
2019-07-01 13:26:44 +02:00
Isaac Prior 36aec23cac Enables InfluxDB TSI data storage as default
See https://docs.influxdata.com/influxdb/v1.7/concepts/time-series-index/
and https://docs.influxdata.com/influxdb/v1.7/concepts/tsi-details/
for details.

Change-Id: Id0daa331378473cb2629228f323d5bc01cb80750
2019-06-24 08:55:59 +00:00
Doug Szumski 07efdae819 Upgrade InfluxDB to latest release (v1.7.6)
Updated default config to use InfluxDB v1.7.6.
This appears to work, at least for viewing
metrics, persisting them, and some CLI commands.
Updated influxdb.conf to bring in line with sample
config.
Drops support for configs of older versions.

Story: 2005624
Task: 30877
Co-Authored-By: Isaac Prior <isaac@stackhpc.com>
Change-Id: Ib73151e6e7d0934303c9e801bb018bc22f1716ae
2019-06-17 08:36:24 +00:00
melissaml 45a5ab167b Replace git.openstack.org URLs with opendev.org URLs
Change-Id: Iecd4cdbdf9418d7dc17944a0001b3536bf8986c8
2019-06-04 10:00:35 +00:00
Dobroslaw Zybort 65def2e6df Improve devstack vagrantfile
Add `lnav` (Logfile Navigator) to tools installed by default.

Add commented out `USE_PYTHON3` variable and tempest plugin.

Story: 2005432
Task: 30470
Change-Id: Icaedb2f2a241dcd850cf942d31bc834d802fc841
2019-04-11 11:32:59 +02:00