Commit Graph

73 Commits

Author SHA1 Message Date
Martin Chacon Piza 43922f8223 [goal] Migrate testing to ubuntu focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

-Bump the lower constraints for required deps which added python3.8 support
in their later version.

-Changing the way to install and configure Zookeeper.
Installing Zookeeper from official Apache's tarball.
Adding the possiblity to set the specific Zookeeper version.
Minor change in zookeeper logger.

-Use mariadb JDBC for monasca-thresh in devstack, since Drizzle isn't
compatible with MySql Server v8.0.x which is default in Focal

-Python 3.8 doesn't seem to like dictionary keys changing during
iteration.

Fixing RuntimeError: dictionary keys changed during iteration.

Tech. details:
It runs well in py27: 5 iterations
It runs risky in py37: 7 iterations
It is forbbiden in py38: raised RuntimeError
Fixed with list(dic.items()) or tuple(dic.items())

dic = {'1': 'a', '2': 'b', '3': 'c', '4': 'd', '5': 'e'}
for key, value in dic.items():
    print("Key: {0} Value: {1}".format(key,value))
    del dic[key]
    print(dic)
    dic[key] = value
print(dic)

Story: #2007865
Task: #40197
Depends-On: https://review.opendev.org/756859
Change-Id: Ieb4cf38038ffb4d1a152f8ab3b64a14098c7cbb3
2020-10-12 15:38:05 +02:00
Witek Bedyk d6104a693b [DevStack] Allow testing different Kibana versions
Kibana API has changed between the versions. To allow testing
different Kibana versions `kibana_version` option should be set in
tempest.conf.

This is a partial port of https://review.opendev.org/727195

Change-Id: I0a21bd99c942ab05ce1eae51226132691518bd91
2020-05-26 13:39:46 +02:00
arseni.lipinski@ts.fujitsu.com aeed1c63dc Add build and installation for monasca-kibana-plugin in new API
Story: 2006376
Task: 38335

Depends-On: https://review.opendev.org/#/c/680075/

Change-Id: I5887c75dbf499027b21b86c2850370f6729fb451
2020-04-27 10:43:39 +02:00
arseni.lipinski ce0e62584f Upgrade Elkstack in new API
The commit contains upgrade of Elk components, default index pattern
creation in new API.

Story: 2006376
Task: 38125

Depends-On: https://review.opendev.org/#/c/679781

Change-Id: Ib0b966c0d7db993802b5372156c41b3ebdf1a77f
2020-01-15 12:32:34 +01:00
Adrian Czarnecki 1e3e1173ad Update devstack plugin to support new api
Merge log-api and api

Story: 2003881
Task: 36195

Depends-On: https://review.opendev.org/681419/
Change-Id: Idb2361e5ab701cd3dee4eabb4b43116f6e1205c4
2019-12-04 13:52:57 +01:00
Witek Bedyk dfd9423526 Upgrade Apache Kafka to version 2.0.1
Upgrade Apache Kafka to current stable version 2.0.1.

Issues have been observed with legacy Kafka producer being used in
notification engine together with newer Kafka broker versions.

Following changes are included:

* Deprecated configuration option `advertised.host.name` is replaced
with `listeners`.
* Default `log4j.properties` is used.

Story: 2005624
Task: 30933
Change-Id: I898b511b2ab8f68e4850faab2098044cd3f94ee7
2019-08-14 14:51:44 +02:00
Doug Szumski 4f62c1d318 Upgrade Storm to 1.2.2
This is the current release and has been running in Kolla for some time,
see notes here:

https://storm.apache.org/2018/06/04/storm122-released.html

Change-Id: I73c5118912ca07d73d99ba893bc6e20f74774a6e
Story: 2005624
Task: 30934
2019-07-18 14:12:49 +00:00
Doug Szumski 07efdae819 Upgrade InfluxDB to latest release (v1.7.6)
Updated default config to use InfluxDB v1.7.6.
This appears to work, at least for viewing
metrics, persisting them, and some CLI commands.
Updated influxdb.conf to bring in line with sample
config.
Drops support for configs of older versions.

Story: 2005624
Task: 30877
Co-Authored-By: Isaac Prior <isaac@stackhpc.com>
Change-Id: Ib73151e6e7d0934303c9e801bb018bc22f1716ae
2019-06-17 08:36:24 +00:00
Thomas Bechtold 96e13dad75 Replace api-config.conf with monasca-api.conf
api-config.conf is the deprecated path for the configuration file. The
new path is /etc/monasca/monasca-api.conf .

Story: 2004708
Task: 28987

Change-Id: If06d9114529c3ef4520247dfc7c32d3769f07084
2019-01-19 12:15:22 +01:00
Lukasz Zajaczkowski 12f1ae68b8 Add grafana init
Change-Id: I6c625272396c6b893f297265ae2389207e60b364
Story: 2003623
Task: 25752
2018-09-25 07:40:30 +02:00
Zuul 13759f6225 Merge "Upgrade InfluxDB to version 1.3.9" 2018-08-10 12:30:48 +00:00
Zuul 4d6594c312 Merge "Upgrade Apache Kafka to ver. 1.0.1 in devstack" 2018-08-08 10:49:27 +00:00
Witold Bedyk cec3b6e411 Upgrade InfluxDB to version 1.3.9
Bugfix for improved performance when writes exceed `max-values-per-tag`
or `max-series`.

Change-Id: Ibf62eb70ba8be9320ca15f905fb57a8ed7da5a42
2018-08-06 14:12:14 +02:00
Dobroslaw Zybort 054be06860 Upgrade the storm to 1.1.3
Storm 1.1.1 is affected by the security bug CVE-2018-1332 [1].
It is recommended to upgrade to 1.1.3 (latest in the 1.1.x series).

[1]: http://www.securityfocus.com/bid/104399

Story: 2003031
Task: 23059

Change-Id: I95e9235556c9e639083482b63398a657c52f6abb
2018-08-02 14:18:25 +02:00
Witold Bedyk 7ee549b422 Upgrade Apache Kafka to ver. 1.0.1 in devstack
Keep log message format to ver. 0.9.0 to support old kafka-python
consumers.

Story: 2002746
Task: 22599

Change-Id: I6a092d64906a939d404abb3e43fc017d2eee74ea
2018-06-28 14:44:13 +02:00
Adrian Czarnecki 5359e4e633 Enable uWSGI support in devstack
Story: 2001464
Task: 6181
Change-Id: If4329e51feebeb68538917d7a68aad53ae469b07
2018-06-12 14:36:46 +02:00
Zuul a8f1fb19ee Merge "Bump influxdb to 1.3.8" 2018-05-14 15:54:08 +00:00
Dirk Mueller b61025ab6b Bump influxdb to 1.3.8
Mostly bugfixes, should be easy to consume

Change-Id: I94fa437780c3d8c806923eb546e16dbeaabc2ec6
2018-05-14 08:22:49 +00:00
Tomasz Trębski 4a652c654d Enable ui & logviewer locally
Commit enables storm-{logviewer,ui} for the purposes
of the local development but keeps them disabled
in the gate runs.

Depends-On: Iccc30d411a49b9e47d6625909427f071397aedfd
Change-Id: I8cc2d6c616eff9ab058b24f837c655228b84f184
2018-05-11 14:27:04 +00:00
Zuul 66e2e8c463 Merge "Use monasca/grafana repository in devstack" 2017-12-18 08:41:45 +00:00
James Gu ba43f07726 Add cassandra support
Support Cassandra db installation and Cassandra related
configurations for Monasca api and persister services
in devstack. Add Monasca rest API Cassandra plugin for
retrieving metric, dimension, measurement, statistics
and alarms.

Change-Id: Ie60d668692e1f25f555dda2355f4e513d582736c
story: 2001231
task: 5759
2017-12-15 19:11:00 +00:00
Witold Bedyk 6ba8dbd740 Use monasca/grafana repository in devstack
sapcc/grafana repository is not maintained anymore.

Change-Id: I389a6b95825d7cfb052aeb7a2b6066377a277a2d
2017-12-08 09:36:08 +01:00
Witold Bedyk 3d2a3988e3 Download Kafka from Apache Archives
Apache Kafka 0.9.0.1 is not available on mirrors any more.

Change-Id: I47e0a9d1718bd5268610b2183397dec22911947a
2017-11-20 18:37:38 +01:00
Dirk Mueller c3316cbbed Bump influxdb to 1.3.5
Change-Id: If2aa765fd32aaeb722b6dcb1e36d12383e24a746
2017-10-31 05:24:17 +00:00
James Gu 8d87c463bb Remove keystone cache dir
Devstack lib/keystone deprecated the cache dir argument in the
configure_auth_token_middleware method. It was used for PKI.
Monasca devstack deployment fails due to this api change.

Change-Id: Ic88dc5ad38d3b5c136e092fc0b66d78eb19dd6a5
2017-10-19 04:14:15 +00:00
Jenkins a352660295 Merge "Upgrade the storm to 1.1.1" 2017-10-06 09:25:56 +00:00
Jenkins 2e92d72ec8 Merge "Upgrade the storm to 1.0.5" 2017-10-06 08:16:37 +00:00
Tomasz Trębski 42aba8031a Upgrade the storm to 1.1.1
Storm 1.0.3 is affected by the security bug
CVE-2017-9799 [1]. It is recommended to upgrade
to 1.1.1 (the latest release at the moment).

[1]: http://www.securityfocus.com/bid/100235

Depends-On: Ie32d184b2446e2db6b145712ec5ffadf1e3f18b3
Change-Id: I5ef6691782779a783e257a94ce16a2337596a2c6
2017-10-06 06:19:58 +00:00
Tomasz Trębski 4f246ae372 Upgrade the storm to 1.0.5
Storm 1.0.3 is affected by the security bug
CVE-2017-9799 [1]. It is recommended to upgrade
to 1.0.5 (the latest 1.0.x release at the moment).

[1]: http://www.securityfocus.com/bid/100235

Change-Id: Ie32d184b2446e2db6b145712ec5ffadf1e3f18b3
Depends-On: Iccc30d411a49b9e47d6625909427f071397aedfd
2017-10-06 06:19:53 +00:00
Tomasz Trębski 58d927d083 Better handling of storm processes
Use devstack utilities to launch storm processes
and be able to see their logs.

Change-Id: Iccc30d411a49b9e47d6625909427f071397aedfd
2017-10-06 08:19:11 +02:00
Tomasz Trębski b9315f83a4 Bump influxdb to 1.3.3
Commit updates influxdb to 1.3.3.
This is the same version as used in monasca-docker.

Change-Id: I49bc716d7fb0d7ec6f21d7927aa2eabaf9c93ba6
2017-08-17 05:13:22 +00:00
Jenkins 2e6ad43fca Merge "Bump Storm to 1.0.3" 2017-07-31 21:32:02 +00:00
Tomasz Trębski 2949612c63 Bump Storm to 1.0.3
Change-Id: I57db7954d271fa678ef215d98ae24b74e3313bab
2017-07-31 08:19:45 +02:00
Tomasz Trębski 2450256f92 Bumb kafka to 0.9.0.1-2.11
Change-Id: I43cf349384bf96efba739376597ae0c6db654985
2017-07-31 08:18:43 +02:00
Tomasz Trębski c4bafc79c1 Bump InfluxDB to 1.3.1
Change-Id: I54d56f0bf068a87095f071599c3bf58b8a96c8aa
2017-07-28 06:50:14 +02:00
Dirk Mueller 8c525af47d Raise influxdb version to 1.2.4
The influxdb 1.2.x branch provides a significant performance improvement
(over factor 2) for writes, so it's good to use the latest and greatest.

Change-Id: Ia0d9220dd53890d3b42ebcf4bc9f349bc43ba83d
2017-07-26 17:01:31 +02:00
Tomasz Trębski f9b41eefbe Use devstack utilities for monasca-notification
Adjust monasca-notification installation with changes:
- start/stop of monasca-notification proces handles through run_process
  and stop_process and no service files
- setting up environment with devstack function
- use USE_VENV for monasca-notification
- installing monasca-notification dependencies from git
- remove service file from devstack/files/monasca-notification

Also added code from Idbe5bdf56fb280412c34f04de8f2e2f301a7a432

Depends-On: Idbe5bdf56fb280412c34f04de8f2e2f301a7a432
Change-Id: Ic581fbdd2db57c9a2f13f1646eb9485c5dd0f62b
2017-07-12 13:11:27 +02:00
Tomasz Trębski 33fa35f03c Integrate keystoneauth based monasca-agent
Following makes it possible to run monasca-agent (based
on keystoneauth) inside devstack environment.

Depends-On: Iec97e50089ed31ae7ad8244b37cec128817871a5
Change-Id: I579f6bcd5975a32af2a255be41c9b6c4043fa1dc
2017-07-11 10:08:50 +02:00
Tomasz Trębski 751d4893c1 Allow to enforce APACHE_MIRROR
In some cases APACHE_MIRROR that is picked points
at the server from which it is not possible to download
the binaries.

Change-Id: I08f1d48cc8bdac7d9d489684e0f6e45c29b95119
2017-06-26 11:00:55 +00:00
Artur Basiak 41cf335127 Adjust monasca-api installation
Adjust monasca-api Python installation with changes:
- start/stop of monasca-api proces handles through run_process
  and stop_process and no service files
- setting up environment with devstack function
- use USE_VENV for monasca-api
- installing monasca-api dependencies from git
- remove configuration file from devstack/files/monasca-api/python
- setup up configuration files with iniset

Change-Id: I2faf48d17fb5e958e1d7ad2383c125ade3faaaf0
2017-06-21 08:32:22 +02:00
Tomasz Trębski b37d34f872 Add policies to monasca-ui
Adds copying policies of monasca dashboard into horizon
policies directory.

Extra:
* reworked installation process (now using setup_develop)
* installing python-monascaclient using setup_lib and cloning it
directly from referenced MONASCA_CLIENT_BRANCH

Depends-On: I273f06332fa11a81ea8de2c13059dce9d160e90d
Change-Id: I2cf1ae62e8b80aefe14d093a499f7103a5c288a5
2017-06-19 07:50:23 +02:00
Dirk Mueller f504cdb4ba Upgrade influxdb to 1.1.5
influxdb 1.1.5 provides bugfixes and small performance improvements

See https://docs.influxdata.com/influxdb/v1.1/about_the_project/releasenotes-changelog/
for details

Change-Id: I9d9bf9b58312f69bc58818e209491da4578cac30
2017-06-01 17:55:23 +00:00
Tomasz Trębski bfcd3eeece Restore zookeeper to devstack
openstack/devstack-dev has removed zookeeper support.
For details see [1].
Following commits brings back zookeper as it was
previously installed from devstack.

Extra:
* added concepts of devstack dependencies. That speeds
up installation a bit as common packages are installed
prior to the plugin code

Ref:
[1] c0d16c279a

Change-Id: I0323eacb5cbba8418550e3322189104c35cf4c36
2017-05-27 18:08:53 +00:00
Jenkins 68fd761658 Merge "Migrate keystone setup to devstack helpers" 2017-03-28 05:34:52 +00:00
Darren Hague c5ab7ca09b Update Grafana repo URL to SAP fork
Change-Id: I0a1eab4b172cb41909e210b422fd6e602728e5e3
2017-03-14 11:08:12 +00:00
Tomasz Trębski 8439531aa3 Migrate keystone setup to devstack helpers
Following commit migrates from usage of custom
python script to create users, roles, projects, service
and endpoint to the usage of builtin devstack's function
meant to manage keystone entities.

Benefits of doing so is that is the monasca plugin
will not depend directly on python-keystoneclient, which
API may change and may result in broken gate. Such situation
happened before, at least once.

Also new code is much more verbose and easier to understand
by simply refererring to documentation of aforementioned
functions.

Change-Id: Ie26021916a0c8a4190b3572743f99de3179671d2
2017-03-10 12:59:47 +01:00
Tomasz Trębski 8c0046e379 Simplify RDB setup
Following commits simplifies devstack setup
by relying on $DATABASE_USER (as provided by devstack)
instead of creating custom users.

Also removed methods that were creating users
for different databases which reduced amount of
code

Change-Id: Ida5308bb6945813b5b52035dab93ff4e5c82c45f
2017-02-22 09:47:46 +01:00
Tomasz Trębski 161ad011d1 Enabling Postgres + ORM in devstack
Following commit provides:
- possibility of using postgres as database backend
- possibility of using ORM mapping in monasca:
 - API
 - Thresh
 - Notification

Additionally:
- different approach of providing configuration settings
- removed unused winchester schema
- reworked execution phases of the plugin:
-- installing dependencies in the beginning

Implements: blueprint postgres-cli-support
Change-Id: Iae561b0c7e6b90cc7c9f5b122c0e4b37bc5ef843
2017-02-08 12:29:04 +00:00
Artur Basiak fb166d9a68 Refactor monasca libraries
Refactor the code about cloning and installing monasca-common
and monasca-statsd repos. Provide new variables in settings
for monasca-statsd.
Removed installation of monasca-common or monasca-statsd where it was
not needed.

Change-Id: I226e42655c834a9a8ac7e58989ac86018d7d4576
2017-01-24 12:25:57 +00:00
Jenkins dfd1b2f201 Merge "Add support for InfluxDB 0.11.0 to 1.1.0 in the Python API" 2016-12-14 08:17:08 +00:00