Commit Graph

145 Commits

Author SHA1 Message Date
Witek Bedyk aea6e4858d Remove project content
This is step 2 of the project retirement process as described in [1].
Project retirement has been anounced here [2].

[1] https://docs.opendev.org/opendev/infra-manual/latest/drivers.html#step-2-remove-project-content
[2] http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016830.html

Depends-On: https://review.opendev.org/751987
Change-Id: Id4c4f95fee1787e23a3156933c40c491f298128e
2020-10-22 15:11:34 +02:00
Zuul e1f3608242 Merge "WIP Add fard disks failure detection example" 2020-10-22 13:05:50 +00:00
Hisashi Osanai 87ab5ef397 WIP Add fard disks failure detection example
Change-Id: I06c128048456f8dee4245956a56b8216e7d2c56c
2020-09-22 11:19:13 +00:00
Daisuke Fujita a2f85ff7ae Add Monasca-analytics use-cases with Monasca
This patch add use-cases with Monasca which base on
monasca-analytics presentation in Sydney.

https://www.openstack.org/videos/summits/sydney-2017/use-case-help-me-from-tons-of-alarms

Change-Id: Id597961e6f6c58ccea9439fad623f5a5e6b58ceb
2020-09-22 11:18:47 +00:00
Witek Bedyk baff3866fc Disable Zuul jobs
This is to allow merging remaining documentation changes without having
to fix Zuul CI jobs configuration.

Change-Id: I39e3058ed89d5cc915751e687f3dfef746d320f5
2020-09-22 13:16:24 +02:00
Ghanshyam Mann 03a4b53808 [ussuri][goal] Drop python 2.7 support and testing
OpenStack is dropping the py2.7 support in ussuri cycle.

monasca-analytics is ready with python 3 and ok to drop the
python 2.7 support.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal:
https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html

Change-Id: Id65137faa25d9623207c046c5fc30c7e7d0177d6
2019-11-16 16:57:18 +00:00
Hisashi Osanai 28251697fc Fix Sparck StreamingListener for monasca-analytics
From Spark 2.2, it is necessary to implement the onStreamingStarted
method. This patch adds the method.

Change-Id: If2d9ef8ffad879319bceacad92dcf8e3d125f63e
2019-11-02 05:32:14 +00:00
Corey Bryant 5dbeff5746 Add Python 3 Train unit tests
This is a mechanically generated patch to ensure unit testing is in place
for all of the Tested Runtimes for Train.

See the Train python3-updates goal document for details:
https://governance.openstack.org/tc/goals/train/python3-updates.html

Change-Id: I29873a103a676b5f7b4919578610ba6afd82c7a8
Story: #2005924
Task: #34223
2019-09-13 05:59:46 +00:00
Hisashi Osanai d738153604 Drop Python2.7 support
Monasca-analytics builds on Spark and is supporting Python3.6
but the old version of Spark doesn't support Python3.6. So we
drop Python2.7 support with this patch.

Change-Id: Ib58d3a22c71e5237d57a8436e1208922586db091
2019-09-13 03:02:01 +00:00
Daisuke Fujita 0fe7c27e2f Update Spark version
This patch updates Spark version from 2.1.0 to 2.4.4 in order to support Python3.6 or later
because the old version of Spark doesn't support Python3.6. Monasca-analytics builds on
Spark so we will drop Python2.7 support instead of Python3.6 support.
And update some packages version depend on Spark.

Change-Id: Idd61243e9e23d99ea8754dc5b313d1583d08878c
2019-09-13 02:05:29 +00:00
Daisuke Fujita fcfd3bbc5f Improve Unittests
Delete unnecessary unittests.

Change-Id: I88c2f517c25e6449f6013e39f78605b52bdf78f0
2019-09-12 06:42:59 -07:00
Zuul 2e4eb76334 Merge "Replace git.openstack.org URLs with opendev.org URLs" 2019-05-29 07:41:53 +00:00
Zuul d284589ad7 Merge "Gate fix: Cap hacking to avoid gate failure" 2019-05-29 04:12:10 +00:00
ghanshyam b48e43eda6 Gate fix: Cap hacking to avoid gate failure
hacking is not capped in g-r and it is in
blacklist for requirement as hacking new version
can break the gate jobs.

Hacking can break gate jobs because of various
reasons:
- There might be new rule addition in hacking
- Some rules becomes default from non-default
- Updates in pycodestyle etc

That was the main reason it was not added in g-r
auto sync also. Most of the project maintained the
compatible and cap the hacking version in
test-requirements.txt and update to new version when
project is ready. Bumping new version might need code
fix also on project side depends on what new in that
version.

If project does not have cap the hacking version then,
there is possibility of gate failure whenever new hacking
version is released by QA team.

Example of such failure in recent release of hacking 1.1.0
- http://lists.openstack.org/pipermail/openstack-dev/2018-May/130282.html

Change-Id: I4172dd0c905760dd84e5ff60d3fa052aae794edf
2019-05-28 11:29:06 +00:00
melissaml d546193ed1 Replace git.openstack.org URLs with opendev.org URLs
Change-Id: I9e7e55a8868eeb5ae4a6fd1a7b7b2bb0dd54f329
2019-05-09 20:32:01 +08:00
Zuul ea892a4c71 Merge "add download_file function in devstack plugin.sh" 2019-04-20 14:53:49 +00:00
OpenDev Sysadmins c1f374877d OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:26:29 +00:00
Ian Wienand 492cdc3fc0 Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I31c0d10030d1dc3b7934cd0b22c7aebe888e9cd6
2019-03-24 20:34:13 +00:00
Daisuke Fujita aeab923ba9 Update requirements for "tornade"
- Pin tornade version less than 6.0.
  Currently, monasca-analytics use asynchronous decorator in tornade.web.
  But this decorator has been removed in tornade version 6.0.
  Therefore, openstack-tox-py35 in Zuul check is failed.

This is tentative approach. tornade should be replaced to flask in near future.

Change-Id: I5e2e310c17b1dcdd4ab8e71c37f4f59104e2e63e
2019-03-14 03:52:56 +00:00
sven mark e722185a59 add download_file function in devstack plugin.sh
1.add download_file function in devstack plugin.sh,to avoid file downloaded when
reinstall.
2.when unstack.sh, the spark download dir is rm -rf ,and file downloaded is removed
too. so change spark download dir to devstack default files dir to avoid the probem.
3.change sudo -u stack to sudo -u stack -g stack avoid
"user stack is not allowed to execute" problem
Blueprint add-downloadfile-function

Change-Id: I9f096c32c7b9a826541dca229ec1a294088e1e81
2019-03-13 10:59:49 +00:00
Zuul f3d5ed114f Merge "Aligned local.conf content in devstack ReadMe file" 2019-02-28 13:58:07 +00:00
Zuul 29e27cfddb Merge "fix tox python3 overrides" 2019-02-05 15:15:21 +00:00
Hisashi Osanai 3faa3201b9 Monasca-analytics supports Python3 officially
This patch changes the behavior of the py35 zuul job from nonvoting to
voting.

Change-Id: I9f420a8aa7fe11ed17d1f290a6c680ade709ddae
2019-01-29 10:28:11 +00:00
huang.zhiping f3480a7bda fix tox python3 overrides
We want to default to running all tox environments under python 3, so
set the basepython value in each environment.

We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.

We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.

Change-Id: Ib660c909b6b7afeb8edc6b802d5e6897d72f7980
2019-01-28 16:29:53 +00:00
Daisuke Fujita 6c7316ebbd Support python3.5 for monasca-analytics
This patch implements followings for py35 support using six(er) and 2to3.

- Python 3 map/filter returns iterator, must be converted to list
- use six.string_types instead of basestring
- use six.iteritems instead of iteritems
- use six.moves for using cPickle and SocketServer packages
- use six.assertCountEqual instead of assertItemsEqual
- remove relative imports
- update BytecodeAssembler(monasca_analytics/
  banana/bytecode/assembler.py) for python3

Can be tested with:
  tox -e py35

Change-Id: If1b92d0ffc56492950f6a02ebdbe1596d0dce368
2019-01-28 09:47:45 +00:00
melissaml 8a1dff0bbb Change openstack-dev to openstack-discuss
Mailinglists have been updated. Openstack-discuss replaces openstack-dev.

Change-Id: If0b8924e9d8cd5d806f1448d7d5010a0e3162500
2019-01-27 14:04:59 +00:00
Daisuke Fujita 474e4b8917 Update README
Currently, README has invalid markup which will not be rendered on PyPI.
This patch updates README to be rendered on PyPI and to be more readable.

Change-Id: Ic081c0729e44f4e09ac21c47a5dbbd0da6deb77f
2019-01-25 11:50:33 +00:00
Emma Foley 1d9583af98 devstack: $MAVEN_TARBAL -> $MAVEN_TARBALL
Renamed the variable in devstack/setting and devstack/plugin.sh

Change-Id: Ib518ebeb9df75abb6aeb9e1949f1fa6251738a79
2019-01-22 12:38:23 +00:00
Zuul 55300e3b10 Merge "Update links in README" 2019-01-22 10:34:06 +00:00
Zuul 627562cacf Merge "Remove empty files" 2019-01-22 10:14:09 +00:00
melissaml 01e701f7f5 Update links in README
Change the outdated links to the latest links in README

Change-Id: Ic81c2e1e9a27c745964315b99fb7990daf7c0b00
2019-01-22 10:12:29 +00:00
Daisuke Fujita fb9f2a2ec6 Change Apache Kafka download site
Currently, monasca-analytics's devstack-plugin downloads
Apache Kafka from "ftp.riken.jp".
It is better to use "archive.apache.org" instead of "ftp.riken.jp".
That archive site is also used in other projects(e.g. monasca-api).

Change-Id: I9be43c052ca46ffec5ed6a1ffe3278b9e0325efb
2019-01-20 08:37:32 +00:00
Zuul 0eb8e9dc2c Merge "Update Spark version" 2019-01-14 14:08:14 +00:00
Daisuke Fujita 98f3c60646 Update Spark version
This patch updates Spark version from 1.6.1 to 2.1.0 for maintenance reason.

Change-Id: Icfb6e678b38dcceba67b96f6bf72f48d6e18fba3
2019-01-12 17:02:14 -08:00
Zuul f980d98f41 Merge "Update devstack plugin" 2019-01-07 11:43:03 +00:00
Daisuke Fujita 3542d404c5 Update requirements
This patch includes the following updates.

- Remove "findspark" and "libpgm" packages.
    There are no longer in use.

- Rename "sklearn" to "scikit-learn".
    "global-reqirements" needs "scikit-learn" instead of "sklearn" which is old package name.

- Pin scipy version less than 1.2.0.
    Currently, according to upper-constraints.txt of openstack/requirements, scipy version is '1.2.0'.
    However, this scipy version seems to be unable to import and use some scikit-learn libraries.

- Remove "docopt" and re-wite code wihtout "docopt".
    "docopt" is not used in OpenStack.

- Remove requirements-check job.
    Currently, "tornado" is a required package, but requirements-check job has a error.
    However, to remove that error, adding "tornado" package to openstack/requirements was refused.

Change-Id: I3bb98ef733ff16558d241968b06c31fa7508d047
2019-01-06 21:14:48 -08:00
Daisuke Fujita 8707a01ab1 Update devstack plugin
* Current
  After devstack/stack.sh is completed, the monasca-analytics service 
  starts automatically. This service runs "Alert Fatigue Management" 
  example using Markov chain recipe.

* Issue
  This example keep running until kill the process. Therefore, user can
  not manually run the new example process after creating devstack env.

* Solve
  Do not automatically start "Alert Fatigue Management" example. And,
  remove the monasca-analytics service which is no longer necessary.


Change-Id: Ia37563c5b213d96f82f3361f33df135fcf5ad41c
2018-12-12 12:02:52 +00:00
zhouxinyong 3fbcb10690 Update url in HACKING.rst
Change-Id: I7090d72ecacee9d5807b0b8fb0bb61908c20c9b4
2018-11-16 10:48:35 +08:00
Daisuke Fujita ecf75f1919 Support Ubuntu 16.04 for devstack plugin
Update OS version name in the  README.

Update the openjdk/kafka version.

Control the kafka/zookeeper service by systemd.

Change-Id: If0866b4d816689ee54166a5061a4792fa205ae17
2018-11-08 17:01:25 -08:00
Daisuke Fujita 5809e66874 Fix unit tests for py27 and pep8 jobs
Some unit tests fail after "fix pep8 job" patch[1] was merged.
Fix unit tests for passing the py27/pep8 jobs.

This patch will be part of the update for python3.

[1] https://review.openstack.org/#/c/601606/

Change-Id: I418c5596f96f3994fbfc1651917c4e930b52a425
2018-11-07 02:27:22 +00:00
Doug Hellmann 564133a2a7 import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

Because this patch is generated by a script, there may be some
cosmetic changes to the layout of the YAML file(s) as the contents are
normalized.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I495dd93c5eb9dc7e2e388ff8bf55ae5534318bb0
Story: #2002586
Task: #24312
2018-09-11 10:12:21 -04:00
Doug Hellmann ac47c5fc58 fix pep8 job
Update the cap on flake8 to support newer versions that work with
python3.

Update tox settings for pep8 environment to use python 3.

Ignore the error caused by not having 2 blank lines before functions and
classes.

Fix 2 syntax errors in function definitions.

Change-Id: I4da79ceefcbf1c23d217716f7b25ac6a092794ff
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-09-11 10:12:21 -04:00
Nguyen Hung Phuong 0e3d22199f Remove empty files
monasca_analytics/exception/aggregator.py
monasca_analytics/exception/ml.py
monasca_analytics/exception/sink.py
monasca_analytics/exception/source.py
test/config/test_connections.py
are empty files. We probably should delete it.

Change-Id: I7b6b3f90da3d11888f84f5e8efe0996598b875fb
2017-12-28 19:55:27 +07:00
Pradeep Kumar Velusamy 027663f844 Aligned local.conf content in devstack ReadMe file
Story: 2001066
Task: 4676

Change-Id: I4f1f9c2c8301483238318d1bf0ecb9345e7eed81
2017-06-12 14:06:59 +00:00
rajat29 7330b1c6ee Optimize the link address
Use https instead of http to ensure the safety

Change-Id: I7a3ac4968031e627643a1018a154ea2c4a068d51
2017-04-11 14:15:29 +05:30
Jenkins e9fdb1fa8c Merge "Add __ne__ built-in function" 2017-03-28 04:45:07 +00:00
Cao Xuan Hoang b33f947572 Files with no code must be left completely empty
As per OpenStack licensing guide lines [1]:
[H104] Files with no code shouldn't contain any license header nor
comments, and must be left completely empty.

[1] http://docs.openstack.org/developer/hacking/#openstack-licensing

Change-Id: If01ebff066b535d46f04dc2d120cc8714bf1cad4
2017-01-17 11:09:44 +07:00
Hisashi Osanai 94495cb4b8 Change copyright to appropriate one
When I submitted the patches, I used wrong copyright on them.
This patch changes the copyright to appropriate one.

Change-Id: I0a48e9d416b99d72b4534de1f0376fd712f3a721
2017-01-16 15:28:15 +00:00
Hisashi Osanai 75999b9d6e Fix typos
Change-Id: I9fc28742ecbd0cf8d5bcadd7c330e428aa6460bc
2017-01-16 00:39:36 +00:00
Hisashi Osanai 5f9495f0e4 Add Svc as a SML
This patch adds a SML which uses Svc (Support Vector Classifier)
algorithm (supervised).

Change-Id: I8d5d7bd6aeaff4e325ffed206e9f1f1cd23a4612
2017-01-09 10:39:52 +00:00