Commit Graph

52 Commits

Author SHA1 Message Date
Martin Chacon Piza 91022f3e80 Remove project content on master branch
This is step 2b of repository deprecation process as described in [1].

[1] https://docs.openstack.org/project-team-guide/repository.html#step-2b-remove-project-content

Change-Id: Ie446c1cd447789d189a9e723fff9ee783dd3cf4f
2021-02-22 14:57:15 +01:00
Andreas Jaeger 08739b0377 Update hacking for Python3
The repo is Python 3 now, so update hacking to version 3.0 which
supports Python 3.

Fix problems found by updated hacking version.

Remove hacking and friends from lower-constraints, they are not needed
there.

Change-Id: I7614df314c211dc3acca2e3e8cb647bddddd6c16
2020-05-26 20:18:43 +00:00
Witek Bedyk 95c7774a6d Update nodejs and npm packages
Update nodejs from 8.10.0 to 10.17.0
Update npm from 3.5.4 to 6.11.3

Configure Monasca tempest plugin to use the correct Kibana version.

This is a partial port of https://review.opendev.org/727195

Depends-On: https://review.opendev.org/730637
Change-Id: Id93ee30bcd803e7a48074da67b9538496e7d1063
Story: 2003881
Task: 38494
2020-05-25 18:00:57 +02:00
arseni.lipinski eed43d0233 Change Grafana dashboards initialization
The change was made due to plugin trying to install grafana dashboards
using python2 instead of python3.

Change-Id: I305b2930470b259b8abc6e28580f036862b454b9
2019-11-28 14:42:13 +01:00
Zuul d85bc00492 Merge "Replace git.openstack.org URLs with opendev.org URLs" 2019-07-01 15:10:53 +00:00
Adrian Czarnecki 5b73565afa Remove unused log v2 endpoints
Log v2 api is deprecated and should not be used.

Change-Id: I4c00809fd91de8266284dfb843c5af17c786373e
2019-06-27 14:17:21 +02:00
zhulingjie 55e7a787a7 Replace git.openstack.org URLs with opendev.org URLs
Change-Id: I4edf3307be5a2d668306efa33c0ab55f6867d8a6
2019-06-26 13:40:04 +00:00
Ian Wienand ea3f5b4beb Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I95cf79aa121b36ff559c21759e91b83be0cbecfe
2019-03-24 20:34:15 +00:00
Thomas Bechtold 5c2ebbed54 Use monasca-log-api.conf for doc, devstack and docker
api-log.conf is the deprecated path for the configuration file. The
new path is /etc/monasca/monasca-log-api.conf .
So use this new path in devstack, documentation and docker.

Change-Id: I2208b7e27d3dbec38290ffb8ba66bc64a5129744
Story: 2004831
Task: 29024
2019-02-05 06:31:28 +01:00
Thomas Bechtold c6d28fe2bf devstack: Use 2.4.6 as elasticsearch version
Update to the latest available 2.4.x version.

Change-Id: I3ffdcc8e2a6bfc9d390ac0e59c93d0b8d4f3cfd9
2019-01-21 12:25:31 +01:00
Zuul 397a25f1d8 Merge "Migrate DevStack plugin to Ubuntu Bionic" 2018-12-18 09:17:55 +00:00
Adrian Czarnecki 30de0514a6 Run init_agent only when agent is installed
Change-Id: Id6c608c6627d87aac8e9d9c888242b0fdbf4127b
2018-12-10 13:20:50 +01:00
Witold Bedyk db7388bd48 Upgrade Logstash Monasca output plugin
This change also installs the Monasca output plugin from RubyGems
instead of local gem file.

Change-Id: I828fddf75990e4b6841a33fcb16a8ccc664df3f6
Story: 2004514
Task: 28242
2018-12-03 16:38:19 +01:00
Witold Bedyk 53b8b96494 Migrate DevStack plugin to Ubuntu Bionic
We want to migrate to the latest Ubuntu LTS release 18.04 aka Bionic.
See [0] for the big picture.

This change installs Node.js from Ubuntu packages.

[0] https://etherpad.openstack.org/p/devstack-bionic

Story: 2004474
Task: 28175
Change-Id: I38c6c239597f58fb871171f7e25ac99edf8bf91b
Depends-On: https://review.openstack.org/618169
Depends-On: https://review.openstack.org/619572
2018-11-30 13:26:35 +01:00
zreigz 29a6e8f118 Add grafana dashboards
Change-Id: Ie8446cd863bdf1befb41f6324ef9b36ef9d37ea2
Story: 2003623
Task: 25752
2018-11-23 12:40:52 +01:00
Zuul fc125c3f90 Merge "Update configuration of kibana button" 2018-11-13 14:56:12 +00:00
Adrian Czarnecki 9d99aed62f Update configuration of kibana button
Update function that configure kibana button
to support new configuration format

Change-Id: I7e259d3f0deb86f72a7eba8eb9a7e95a88f5bbf4
2018-10-17 13:56:37 +02:00
Adrian Czarnecki 50e7a3293f Modify log-persister conf to support new index pattern
Story: 2003458
Task: 26555
Depends-On: https://review.openstack.org/#/c/593602/
Change-Id: I8adf533a9b4881c0bb0134ec706fc7ba328239fc
2018-10-17 12:49:52 +02:00
Adrian Czarnecki 63510b23f1 Enable python3 in devstack
Change-Id: Ie69bd634e6f3147d35711c49247458e4b1caec8c
2018-08-09 11:43:33 +00:00
Dobroslaw Zybort fa3b160b84 Show how to enable more OpenStack services in devstack
Change-Id: Ib6c577cca038dc50836264bd17c83ed8cd0acfb8
2018-07-03 14:48:00 +00:00
Zuul 18321cd6ee Merge "Enable UWSGI support in monasca-log-api" 2018-01-25 11:04:15 +00:00
Tomasz Trębski 71f0bdfb8c Enable UWSGI support in monasca-log-api
Community has set a community wide goal
in Pike cycle: "Control Plane API endpoints deployment via WSGI" [1].
monasca-log-api is already capable of being deployed under mod-wsgi but
not under uwsgi. This commits enables that feature. Until Queens release
API will hence support:

* gunicorn
* mod_wsgi (remove in Queens)
* uwsgi (preffered)

Refs:
[1]:
https://governance.openstack.org/tc/goals/pike/deploy-api-in-wsgi.html

Story: 2001464
Task: 6180

Change-Id: Ie4a94c9c2e166915c3f4a1783dc3527f4eb62f29
2018-01-16 14:36:45 +01:00
Witold Bedyk 6b0dcaedbb Delete Kafka topics in unstack phase
unstack.sh stack.sh sequence fails because of Kafka topics not being
deleted in unstack phase.

Change-Id: I0a5e0b029b5cb2aa5bc56131e62fa6d9cfa34be9
2018-01-10 14:06:32 +01:00
Adrian Czarnecki bd703dd2a7 Remove test_hook files
This file are no longer used because of zuulv3 migration.

Change-Id: I5e75195de6ffea533cf843b61d24c6cee8e991f1
Depends-On: I7bc913d0e5cd9e8a06a63cc3d11740056c7036d7
2017-10-25 10:57:01 +00:00
Tomasz Trębski 9c163622e2 Migrate log integration test to ZuulV3
- define .zuul.yaml to contain new job definitions
- move gate hooks to appropriate location

Story: 2001238
Task: 5763
Task: 5766

Depends-On: I263b1a92a9ec7b5e38d9c1dc8b02e214102a92c2
Change-Id: Icfb32df7e083c2c58c89fa3d2fe9a3eacfda6beb
2017-10-24 08:15:57 +00:00
Johannes Grassler 257fb55635 Fix WSGI application
* Partial revert of 0a82af18ab
  to restore main() method
* Add global `application` variable which will be set by main method to
  problem to preserve the fix from 0a82af18ab.
* Add check for application name starting with '_mod_wsgi' to ensure
  application runs in Devstack as well (Devstack does not use the entry point)
* Modify Devstack plugin to run WSGI entry point rather than app/wsgi.py from
  module directory.

Change-Id: I07001dccb663ed4e6e3347089ab96e6f8ec196d4
Story: 2001197
Task: 5702
2017-10-18 10:03:29 +00:00
Tomasz Trębski df1574ef8c Make ZuulV3 working
- pep8 [ fix history, no more ChangeLog ]
- legacy gates [use $USER instead of jenkins]

Change-Id: I9e4bbd6fd48454e37985ed5c408e8b935d535304
2017-10-18 08:02:51 +00:00
Tomasz Trębski 1787c33f20 Drop download_file for get_extra_file of devstack
devstack has introduced get_extra_file function
that aims at downloading the files from the URL.
The method is better alternative as it is integrated
into devstack caching process.

Change-Id: I90900d6a388c12bd20ce69608a1c10423839baaa
2017-09-26 13:06:23 +02:00
Hangdong Zhang ed3a3f0512 Update the documentation link for doc migration
Change-Id: Ic12495a215fc64ece62b9694c9154fed592b8593
2017-07-21 13:38:58 +08:00
Thomas Bechtold d243ed35d0 Use oslo-config-generator
It is common for OpenStack projects to use oslo-config-generator to generate
a sample config file which contains all available configuration options.

Work items:

* removed etc/monasca/log-api.conf (it is autogenerated)
* keep all config in one place to mimic the configuration file
* added configuration files to documentation

Story: 2000970
Task: 4121

Change-Id: I8777ed6cd38739e87b19be248b9c120e84626ad1
2017-07-05 09:44:35 +00:00
Tomasz Trębski 5e7ebdd9c5 Composite paste for monasca-log-api
Following commit introduces using composite
paste file to describe application pipelines.
With the help of composite feature it was possible to
define 4 distinct supapplications, each having different
pipeline setup:

* version_app => no keystoneauth, simple data return with error trap
* healthcheck_app => no keystoneauth, simple data return with error trap
* api_v2 => as it was, added error_trap though
* api_v3 => as it was, added error_trap though

Following approach opens up the possibilities of modelling an API
in far more flexible way and removes the need of any hacking inside
the codebase.

Note:
Keeps backward compatibility with older codebase.

Extra:
* removed dirty hack around skipping certain request.path
in keystonemiddleware (now described in paste file)
* removed 404 when issuing ```curl api_host:api_port/```. Request
is redirected down to VersionApp

Depends-On: I0323eacb5cbba8418550e3322189104c35cf4c36
Change-Id: I873e1376665c8cf66c8ee503975324f9b93ddb45
2017-06-02 14:20:43 +00:00
Tomasz Trębski 81d68d22b4 Enable tempest tests with uwsgi keystone
Adjusted log-api devstack configuration
to works with uwsgi deployed keystone.
It is done by removing custom pieces
of configuration regarding keystone
communication and replacing that with
devstack utilities wherever it is possible.

Summary:
* using configure_auth_token_middleware for log-api
  configuraton file
* removed custom tempest.conf
* using devstack/openrc to generate environmental
  variables OS_ containing necessary details for tempest.conf

Extra:
* moved kibana_version into monitoring group

Story: 2000995
Task: 4183

Depends-On: I22686d05670fc6c947611f8044dea498239a4212
Change-Id: Ia95b3bef2734d639c6fec57484b60bc5377d659f
2017-05-02 19:02:55 +00:00
Tomasz Trębski 4ae270263d Adding WSGI support
Following commits adds possiblity to run monasca-log-api
with Apache2 (mod_wsgi) in devstack environment.

Change-Id: I4aca9bebacb4799a0e45b785ba1997003c6b7165
2017-02-22 19:14:00 +00:00
Witold Bedyk 11435d99af Use openstack/monasca-kibana-plugin repo in devstack
* rename the target directory and tarball

Depends-On: Ida2a5e2dffb31a5d7fb8ce8492ed64508f371dd9
Change-Id: I782c1bedb475db0260466d46a693b4ce634910a2
2017-02-13 10:43:28 +00:00
Artur Basiak 85b78cd105 Lower log level
Remove --debug from log components to avoid overhead informations
in log files. Log files size where higher than 20 MB.

Change-Id: I31620de8529a3be1bca61f2e5c26e529250713e8
2017-02-13 10:15:52 +00:00
Artur Basiak 18c34fedd3 Use bento/ubuntu-16.04 box
Change-Id: Ie5d5a76da1160be4edec6d5b69ab663850d6bc62
2017-02-03 14:32:58 +01:00
Dobroslaw Zybort edef047506 Add bashate check to tox file
Fix errors:
    [E] E003: Indent not multiple of 4
    [E] E042: local declaration hides errors

Change-Id: I82a6d6d3e48d1cc63acc4dbaa8cd1237b5b7d0d7
2016-12-15 08:36:29 +01:00
wachowskij bd3a16a97d Uprade ELK tarballs
* Kibana 4.4.0 -> 4.6.3
* ElasticSearch 2.2.0 -> 2.4.2
* LogStash 2.2.0 -> 2.4.1

Change-Id: I73d8990a35a5a0220050e4e0302d66afb3176bd9
2016-12-09 11:35:35 +00:00
Tomasz Trębski 900e32ad8e Adjust monasca-log-api devstack to Xenial
Following change allows to run monasca-log-api
devstack plugin on the Xenial environment.
That was implemented with the help of:
* start/stop of processes handles through run_process
  and stop_process & no services files
* setting up environment using devstack functions
** monasca-log-api virtual env (USE_VENV)
** installing monasca-log-api dependencies from git
** saving data in keystone catalog with Openstack CLI

Additionally added method that downloads tarballs
only if they are not found in the system.

Change-Id: I08b2ddbe17b2c7899056a63a5633070ae9a2c2db
2016-12-07 10:18:09 +00:00
Jenkins 0f08c9f8ff Merge "Enable size-based log rotation for monasca-log-api" 2016-09-14 11:05:42 +00:00
wachowskij feb6897cbe Enable size-based log rotation for monasca-log-api
By default log file is rotated after reaching size of 100MB and 5 files
are archived.

Closes-Bug: 1621329
Related Change-Id: Iac7f29b3909354f75e5d3264ef2c987c9f3e2aec
Change-Id: I8d7e071e899eca1247b2db56ea348bb8775d68c3
2016-09-14 08:59:07 +02:00
Dobroslaw Zybort 77bc7a8dc5 Update logstash-output-monasca_log_api from 0.5 to 0.5.2
Change `domain_id` to `user_domain_id`
Add `project_domain_name`

Change-Id: Iafe334354bbf37251f2b74ecf7e8cc0ef7fbc1a3
2016-08-31 11:31:50 +00:00
Witold Bedyk d52f1fd1f5 Add tempest tests for Log API v3
Change-Id: I46c0fd4e5119ad04dce2a2d15af196ba262b3a81
2016-08-29 14:09:59 +02:00
Witold Bedyk 71ec276071 Set up tempest tests for gate job
* update credentials provider
* add log V2 endpoint
* add log-search endpoint

Change-Id: I3800f2890e689146c8eb807002825bcf0001d65a
2016-08-10 10:30:43 +02:00
Witold Bedyk a8faadf751 Install Kibana plugin in 'extra' phase
nvm which is required to build Kibana plugins is installed in monasca-api plugin
in the 'extra' phase.

Change-Id: Ia06fb0a3f6bb1e92b5329020e84a5037b030afa0
2016-07-20 19:59:45 +02:00
Witold Bedyk e649e0f5d5 Install Kibana plugin for Keystone authentication
The plugin implements keystone based authentication for communication between
Kibana and Elasticsearch.

https://github.com/FujitsuEnablingSoftwareTechnologyGmbH/fts-keystone

Change-Id: I23fd89737fe5106c547b87aade6d7cc34821a8b7
2016-07-14 14:03:25 +02:00
Witold Bedyk 689b891f13 Add monasca-log-metrics to devstack plugin
monasca-log-metrics component generates metrics based on logs. These can then be
visualized and used to define alarms.

Change-Id: Ib5ea62953c8aa8e2e8478cd06d6839124ba601c5
2016-07-11 16:24:12 +02:00
Witold Bedyk f831654008 Allow to reuse ELK tarballs
Introduce variable ALWAYS_DOWNLOAD_TARBALLS. Unless set to 'true', once
downloaded tarball will be reused.

Change-Id: Iad2f5a0ff16916f09dc820b86ce6088d5dc7631a
2016-07-06 13:22:16 +02:00
Jenkins fb188aeda4 Merge "Update monasca-log-agent in devstack plugin" 2016-07-06 06:33:58 +00:00
Witold Bedyk c47d0c56ca Update monasca-log-agent in devstack plugin
* adds batch support
* refactor

https://github.com/FujitsuEnablingSoftwareTechnologyGmbH/logstash-output-monasca_log_api.git

Change-Id: I18836667bd1305a3cd68c4d5a22c0565aa71e134
2016-06-29 10:46:05 +02:00