Commit Graph

407 Commits

Author SHA1 Message Date
Zuul d256f05be6 Merge "Revert "Use external Zookeeper in Local mode"" 2021-06-07 15:35:26 +00:00
Martin Chacon Piza 37ccf62158 Revert "Use external Zookeeper in Local mode"
This reverts commit d156980a52.

Change-Id: I8a0bbf34db9d25503e50d4ef9d9da466f229fc78
2021-05-27 16:15:52 +02:00
Pierre Riteau d54904e585 Fix Docker build
The default nodeset was just changed to focal [1], which in the absence
of the python-is-python3 package doesn't provide a python binary.

[1] https://review.opendev.org/c/opendev/base-jobs/+/789098

Change-Id: I954ec191692c394f546219acdb17afc0f5f916ed
2021-05-20 18:33:08 +02:00
Martin Chacon Piza d156980a52 Use external Zookeeper in Local mode
By default Storm uses the in-process ZooKeeper when the local mode
is chosen.

The in-process ZooKeeper doesn't handle the trim of ZooKeeper
Transactional logs & snapshots.

There is a constructor which enables the possibility to use an
external ZooKeeper when the local mode is used. [1][2]

[1] https://issues.apache.org/jira/browse/STORM-213
[2] https://github.com/apache/storm/pull/137/files

Change-Id: I4c6e6f1dbacf093f94b566abc7251f4e33eff93f
2021-04-07 20:53:07 +02:00
bandorf d8420f5ec0 switch to storm version 1.2.3
Story: 2008674
Task: 41966
Change-Id: I71db8da82e3bbb6328e71cba6017182542d75fc9
2021-03-02 16:39:14 +01:00
Martin Chacon Piza bcb469e8dc Fix zuul publish docker image job
Add tag to docker push command with specific branch name

Change-Id: If51a4e21476750faac7401e57dbd1e03e37a2fd8
2021-02-16 17:55:36 +01:00
bandorf 05dc74a9ae Change storm config to eliminate storm warnings
Story: 2005483
Task: 30576
Change-Id: I5ac243ad6fa0755ddbc663177648c4ed7031613f
2021-02-15 16:18:46 +01:00
Zuul 67b9ab3a30 Merge "Enable usage of storm.yaml" 2021-02-11 13:12:58 +00:00
Martin Chacon Piza b50c1d1a1f Fix zuul publish docker image job
Add tag to docker push command

Change-Id: Iac161d730580f5a887a3ce87fb33beba1a11090b
2021-02-08 12:20:13 +01:00
bandorf 1464b7b541 Enable usage of storm.yaml
Story: 2008592
Task: 41749
Change-Id: I3a3a51f50ad64ab1bd73672b0bc7b09884309e68
2021-02-03 16:19:30 +01:00
Martin Chacon Piza 0ee0e79a73 Add mariadb-connector-j and bump version to 2.4.0
mariadb-connector-j is:

- Well maintained.
- Compatible (v2.7.0) with MySql Server 8.0.x
- LGPL Licensed

Change-Id: I44830b47a1de4ae69f635327a2da1802a67d92d2
Story: 2008236
Task: 41079
2020-10-08 16:45:14 +02:00
Witek Bedyk 846e255d78 Add CONTRIBUTING.rst
Change-Id: I66292e20d54334e31f5240b170bb98751bce6777
2020-05-19 16:27:30 +02:00
Zuul d400f7a2bb Merge "Push Docker image to Docker Hub from Zuul" 2019-09-25 10:06:11 +00:00
Zuul f45bebcf30 Merge "Create Docker image and build in Zuul for Monasca-Thresh" 2019-09-25 09:36:52 +00:00
Michał Piotrowski 5cb9f94387 Create Docker image and build in Zuul for Monasca-Thresh
Story: 2001694
Task: 30289

Change-Id: If3323a18ac3697a92ca3f06b0db154517582d7aa
2019-08-29 10:09:14 +02:00
Dobroslaw Zybort 78c66d7f2e Push Docker image to Docker Hub from Zuul
Story: 2001694
Task: 36260

Change-Id: I0717cc775fa1d7b38d14ade5c51996740d1b7e26
Depends-On: https://review.opendev.org/649298/
2019-08-12 13:52:59 +02:00
Zuul b1409c391f Merge "Enable monasca-thresh to set topology.max.spout.pending f. Storm" 2019-07-17 12:22:57 +00:00
bandorf e980ea71e0 Enable monasca-thresh to set topology.max.spout.pending f. Storm
topology.max.spout.pending allows to limit the number of concurrent
entries sent from spout to worker(s). However, this requires the
usage of a unique id when sending messages (emit).

Change-Id: I907a4574b80e7c3347ba6a9f12c7836767dc3dd7
Story: 2005471
Task: 30550
2019-07-17 12:03:38 +02:00
melissaml 5bbdcba0dd Replace git.openstack.org URLs with opendev.org URLs
Change-Id: Id612a46287fe03efc0115232b3f8cd7b79884a52
2019-05-09 20:28:59 +08:00
OpenDev Sysadmins de7f4c719c OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:42:11 +00:00
Thomas Bechtold 8c976339a7 Use storm version 1.1.3
monasca-api uses storm 1.1.3 [1] so adjust the version here to be in
sync with monasca-api.

[1]
https://git.openstack.org/cgit/openstack/monasca-api/tree/devstack/settings#n109

Story: 2003031
Task: 29275

Change-Id: I0f30e1353a40fb379fa7c389686f65226d5c222b
2019-03-15 15:03:24 +00:00
Witek Bedyk 443cce3951 Add tempest tests job
Change-Id: I29a294ee6bda6c6889dcc16320050f5ae485ec42
2019-02-07 12:19:19 +01:00
Witold Bedyk a9b759dbfb Fix Zuul job names to enable tempest tests
Zuul job names have been changed in 877f3d60. Update Zuul configuration
to reflect these changes, so that tempest tests are run.

Change-Id: I0b706627eafb7c1d4651679c28b61436e34138ba
Depends-On: https://review.openstack.org/550795
2018-09-24 15:10:01 +02:00
Doug Hellmann c4de5b01b6 import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

Because this patch is generated by a script, there may be some
cosmetic changes to the layout of the YAML file(s) as the contents are
normalized.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: Ibcbc62c9004e4a33a4f9ce3046decfd076bf4f8f
Story: #2002586
Task: #24312
2018-08-22 18:51:07 -04:00
Denis Poisson 2ce950c5b0 Convert README.md to ReStructuredTest format
Change-Id: I5d17a25b9a81286dd0c43f494d326e855706f097
story: 2002163
task: 22258
2018-06-20 13:36:09 +02:00
Zuul 5f76cf1668 Merge "Make Thresh logging compatable with Storm 1.1.1" 2018-04-10 15:28:04 +00:00
wangqi de6b9496de Update links in README
Change the outdated links to the latest links in README

Change-Id: I12f091c1cfdcd4421fc8271a2a041031b69c3be7
2018-03-12 08:30:57 +00:00
Zuul f689816936 Merge "Added license informaton for third-party libraries" 2018-03-06 15:14:57 +00:00
Kenan Karamehmedovic 344adcde36 Added license informaton for third-party libraries
Task:  6353
Story: 2001540

Depends-On: https://review.openstack.org/544813

Change-Id: Iff0d2f130defb4d26cbf047bed44f73f89bbcee8
2018-02-19 11:46:00 +00:00
Witold Bedyk 15f9962fcb Remove mysql-connector and bump version to 2.3.0
MySQL Connector is released under GPLv2 license which restricts the
distribution of the consuming project [1]. This change removes MySQL
Connector and leaves Drizzle JDBC which is licensed under BSD.

[1] https://governance.openstack.org/tc/reference/licensing.html

Story: 2001522
Task: 6324
Change-Id: I4c39ebc290475820b5ba3ab54c36198ca9069abe
Depends-On: https://review.openstack.org/541366
2018-02-09 15:54:47 +01:00
James E. Blair 31a65144c1 Zuul: Remove project name
Zuul no longer requires the project-name for in-repo configuration.
Omitting it makes forking or renaming projects easier.

Change-Id: Ibcb72c0a85dfb823abecb2814f86312a3bcc5962
2018-02-02 06:29:59 -08:00
Craig Bryant 106088887a Log as error failure to send to Kafka
Exception on failure to send to Kafka was only being logged
at the debug level. Increased to error level as this is a major
failure in the Threshold Engine functionality

Change-Id: I131d6d7a20cd0e907334cf5d0ff6fac342e8f320
2018-01-18 10:47:30 -07:00
Witold Bedyk be22e54fd7 Upper pom version to 2.2.0
Change-Id: I59e3d60f606791cc15bb0f2ee17d871e15aa754d
2017-12-20 14:32:08 +01:00
Monasca CI e8001abfac Make Thresh logging compatable with Storm 1.1.1
The newest version of Storm (1.1.1) looks for a log4j2 file
instead of a logback file

Change-Id: I31b1739e1e42b91c31e1cdd43b539da2b030933a
2017-12-04 16:34:28 -07:00
Tomasz Trębski 9e9f2caa44 Add .zuul.yaml file
Depends-On: I263b1a92a9ec7b5e38d9c1dc8b02e214102a92c2
Change-Id: I762911ed5120f3ff3d303e3b53be2dd8e0aa7db9
2017-10-24 11:32:41 +02:00
Jenkins 5c1fd542be Merge "Optimize the link address" 2017-04-17 10:20:01 +00:00
Witold Bedyk b0dfa21ea6 Add bindep.txt
Change-Id: Id76a18b5d44cbbf11ec35b69a5f1a10439ff3326
2017-04-12 18:12:22 +02:00
rajat29 71c01a76de Optimize the link address
Use https instead of http to ensure the safety

Change-Id: Ic616e81b902f65ad98e4871d24a0fe8b05b52dd9
2017-04-11 12:02:33 +05:30
Witold Bedyk 86b8634c9c Change version to 2.1.1
Depends-On: Ib3da5c9e1f6e5e2d6f77269129bd769179bfd3be
Change-Id: I6e4b73525b3c32c2bdd04c63ae73bcb4c50b5447
2017-02-15 13:48:30 +00:00
Jenkins 73196d3300 Merge "Change version to 2.1.0" 2016-12-15 11:51:58 +00:00
Flavio Percoco 92ead76880 Show team and repo badges on README
This patch adds the team's and repository's badges to the README file.
The motivation behind this is to communicate the project status and
features at first glance.

For more information about this effort, please read this email thread:

http://lists.openstack.org/pipermail/openstack-dev/2016-October/105562.html

To see an example of how this would look like check:

https://gist.github.com/e98335594e6d21bc76edbb62f3846f06

Change-Id: I6db6e40f8fee94bddbf6f9212c82b62d0df022de
2016-11-25 18:28:25 +01:00
Witold Bedyk 31a7b69b59 Change version to 2.1.0
Change-Id: Ic867645c7c77954bde27cecc64ec01057013f99a
2016-11-23 17:06:49 +01:00
Michael James Hoppal a62c27a165 Bump drizzle driver version to support millisecond resolution
Change-Id: I671d4e081191bd72bbb8bac97ff3a27812dc50dc
2016-08-15 15:45:42 -06:00
Craig Bryant 2acdd58dc3 Implement the Last Function
The Alarm state is driven by the last measurement with the newest
timestamp. Use the value even if the measurement is older than the
oldest bucket. This ensures the measurement will be used when the
Threshold Engine is started if the measurement
is received while the Threshold Engine is stopped

Never evaluate subAlarm with function Last except on receiving of
a measurement.

Add tests to ensure this works.

The change is dependent on the monasca-common change and the
change to monasca-api to add the state field to sub_alarm.

Change-Id: Ib5123ed035018757a50d9ebeb7335fbca48054f2
Implements: Blueprint last-value
2016-08-02 12:05:37 -06:00
Michael James Hoppal 865816dd78 Add millisecond resolution to alarms.
At the moment it we are using the mysql built in function
NOW() which returns in second resolution.

Change-Id: I1192abb5aab3a9110721cc68f5a1d16a38f77c10
2016-07-13 08:14:35 -06:00
Craig Bryant 3927da1697 Save Measurements that arrive before their SubAlarms
Thresh creates an Alarm when a new Measurement matches an
AlarmDefinition. The previous Thresh code just discarded the
Measurement if it arrived before the newly created SubAlarm,
which was likely to occur. This code saves a Measurement that
does not match an existing SubAlarm in the expectation that the
SubAlarm will arrive very soon. It then adds the Measurement
to the SubAlarm. If the measurement would cause the SubAlarm to
transition to the ALARM state, that happens.

This is more important for determinstic alarms because they will get
fewer Measurements and ignoring the first one may prevent an Alarm's
state going to ALARM when it should

Change-Id: I08e9e481ad55862ba602eba5a68eb371b1d35bbc
2016-06-27 08:39:02 -06:00
Craig Bryant 0d80a987db Treat empty windows as OK for deterministic alarms
Using the standard case of count(log_message) > 1, getting no
log_message measurements should be treated as OK. However, the old code
uses the emptyWindowObservationThreshold for both deterministic and
non-deterministic alarms which means that there must be 3 empty windows
before the deterministic alarm transitions to OK.

This change cause the evaluation of the Alarm to treat an empty window
as OK for deterministic alarms. So, count(log_message) > 1, getting no
measurements in a window will transition the alarm back to OK

Change-Id: I19a04bf78f907b23ef583409f2def54771c07d72
2016-06-20 12:30:42 -06:00
Craig Bryant d5d14ecdcd Clone the currentValues property in duplicate method
It is possible for the currentValues property to change which can cause
java.util.ConcurrentModificationException. Fix by cloning currentValues
before the SubAlarm gets emitted into storm

Change-Id: I555beffafe0208c0d256732517af401938876d3d
2016-06-09 16:42:47 -06:00
Craig Bryant 0e72d867ec Change to use Storm 1.0.0 instead of 0.9.x
Storm classes changed from starting with backtype to org.apache

Since this is a major backwards incompatible change, increment the
jar version

Copy some Stream classes from monasca-common. They were only used for
monasca-thresh anyways and having them in a separate repo made it
harder to make this change. A later review will remove these classes
from monasca-common

Need to have an explicit dependency on commons-codec

Change-Id: I36db83ce7fdea02ae4df267cf0820e49dcdf3001
2016-06-09 14:14:23 -06:00
Tomasz Trębski 080b11dc54 (Non)deterministic alarm processing
'deterministic' being part of alarm expressions
allows monasca-thresh to determine if
given alarms can go back to UNDETERMINED
state or not.

'deterministic' means that alarm
won't ever transititon to UNDETERMINED state,
even if there are no measurements received for
long enough. By default, all alarms
are assumed to be 'non-deterministic' which means
that they can transition to 'UNDETERMINED' state

Implements: blueprint alarmonlogs
Depends-On: Ia42f9a1be37c31416bdac341b092fe527f860c16
Change-Id: Ibe0839123a15494ad45b809e68600c0acef3d330
2016-06-07 12:00:58 +02:00