From Spark 2.2, it is necessary to implement the onStreamingStarted
method. This patch adds the method.
Change-Id: If2d9ef8ffad879319bceacad92dcf8e3d125f63e
This patch implements followings for py35 support using six(er) and 2to3.
- Python 3 map/filter returns iterator, must be converted to list
- use six.string_types instead of basestring
- use six.iteritems instead of iteritems
- use six.moves for using cPickle and SocketServer packages
- use six.assertCountEqual instead of assertItemsEqual
- remove relative imports
- update BytecodeAssembler(monasca_analytics/
banana/bytecode/assembler.py) for python3
Can be tested with:
tox -e py35
Change-Id: If1b92d0ffc56492950f6a02ebdbe1596d0dce368
Some unit tests fail after "fix pep8 job" patch[1] was merged.
Fix unit tests for passing the py27/pep8 jobs.
This patch will be part of the update for python3.
[1] https://review.openstack.org/#/c/601606/
Change-Id: I418c5596f96f3994fbfc1651917c4e930b52a425
Update the cap on flake8 to support newer versions that work with
python3.
Update tox settings for pep8 environment to use python 3.
Ignore the error caused by not having 2 blank lines before functions and
classes.
Fix 2 syntax errors in function definitions.
Change-Id: I4da79ceefcbf1c23d217716f7b25ac6a092794ff
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
monasca_analytics/exception/aggregator.py
monasca_analytics/exception/ml.py
monasca_analytics/exception/sink.py
monasca_analytics/exception/source.py
test/config/test_connections.py
are empty files. We probably should delete it.
Change-Id: I7b6b3f90da3d11888f84f5e8efe0996598b875fb
In Python 3 __ne__ by default delegates to __eq__ and inverts the
result, but in Python 2 they urge you to define __ne__ when you
define __eq__ for it to work properly [1].There are no implied
relationships among the comparison operators. The truth of x==y
does not imply that x!=y is false. Accordingly, when defining __eq__(),
one should also define __ne__() so that the operators will behave as
expected.
[1]https://docs.python.org/2/reference/datamodel.html#object.__ne_
Change-Id: I52633a8a4b19c5e0c0d7d786f21770496e128c7a
This commit add two APIs:
* POST /banana/typeck { "content": "<banana>" }
This API type check the provided banana content but does not
evaluate it.
* POST /banana/metadata { "content": "<banana>" }
This API returns the associated TypeTable of the provided banana
content. This is useful to provide auto-completion in an editor.
* GET /banana/metadata
This API returns the list of components availables. This is also
useful to provide auto-completion on existing components in an
editor for banana.
Change-Id: I31c1de86fe420458ac98aad9d9c8ae6ca73fcc81
In python 3, range() does what xrange() used to do and xrange() does not
exist. If you want to write code that will run on both Python 2 and
Python 3, you can't use xrange().
range() can actually be faster in some cases - eg. if iterating over the
same sequence multiple times. xrange() has to reconstruct the integer
object every time, but range() will have real integer objects.
(It will always perform worse in terms of memory however)
xrange() isn't usable in all cases where a real list is needed.
For instance, it doesn't support slices, or any list methods.
Change-Id: I5233438a864bb00d04ba7fb2b1688cacb0473691
This make the fake data generation much faster and configurable.
For the cloud example, the phase 2 is now triggered in less than 5
seconds instead of 6 minutes.
Change-Id: I9967c94d28a380fa19afe9275e769f1465f4f922
We will need more investigation when we want to re-enable
checkpointing.
Change-Id: I9340fd25b0e4d494bfd891cc7a5ddaa4fbdd5842
Co-Authored-By: David Subiros Perez <david.perez5@hpe.com>
Co-Authored-By: Joan Varvenne <joan.varvenne@hpe.com>
As of this commit, to change the configuration using Banana, we
need to make an HTTP POST request to `/banana` REST API. This API is
temporary and is likely to be changed later.
The implementation is done entirely in the `banana` module. Under this
module there are:
* `typeck` module contains the type checker,
* `grammar` module contains the parser and the AST and,
* `eval` module contains the interpreter.
Additionally, a test framework has been created to ease the test of
particular conditions of the language.
Within the banana module, there is a README.md file for each associated
sub-module explaining further the details of the language.
Once this commit is merged, there's still a lot that can be improved:
- All components should be tested in Banana.
- The 'deadpathck' pass could be improved (see TODO)
- We don't support generated JSON ingestors yet.
- Imports will be key for reusability (not implemented).
Change-Id: I1305bdfa0606f30619b31404afbe0acf111c029f
When an exception was caught and rethrown, it should call 'raise'
without any arguments because it shows the place where an exception
occured initially instead of place where the exception re-raised.
Change-Id: Id8b2e36a20821dfcea9c60c3c4ea74a40f2ec7fe
This commit introduces 3 examples of LDPs that process
monasca metrics:
* `Aggregate` - compute simple stats per metric name.
* `Combine` - allow mixing of different metrics by providing
a simple expression parser that gets transformed into
CPython bytecode.
* `Derivative` - compute a metric derivative.
While quite simple, those examples, will help us improve the
framework by emphazing some of the problems we will face when
working on more complex solution such as:
* Spark's inability to share data between sliding windows.
* Ordering of data.
* Sampling of metrics / events.
Change-Id: I259022f20e9b288aa2a08c24ad4a5f41a20e6095
This patch fixes followings:
*two lines of Apache license in order to pass H103
*using homedir in PYTHONPATH
Co-Authored-By: Daisuke Fujita <fuzita.daisuke@jp.fujitsu.com>
Change-Id: I8fbe26ae8547879fdda0f840bfc5d582e0395588
Witek Bedyk