Commit Graph

16 Commits

Author SHA1 Message Date
Monsyne Dragon b5191bb105 Add AtomPub handler
Adds AtomPub handler to send events to an atom server as a feed.

Also, fixed Usage driver to save new events directly from pipeline.
Fixed minor (but annoyingly hard to diagnose) bug in db layer
    where it didn't recognize 'long' values.

Change-Id: I792e9f77accfea4583fd75805a9ff0d946827df8
2015-08-19 06:52:04 +00:00
Monsyne Dragon 665c9ad328 Add optional database trimming for old events.
Alows you to trim events older than a configurable time from
the events database.

(Remerging to fix timex parse error)

Change-Id: Iaa290705815d1c3ac23c2ca7370a5d705f1f834c
2015-08-17 17:51:05 +00:00
Sandy Walsh f63e71dba8 Use compute.instance.finish_resize.end for usage comparison.
Vs. compute.instance.prep.resize.end as before.

Change-Id: I837329014a4f7e7bfee8f1943bbdb4597c1da855
2015-05-06 08:24:14 -07:00
Sandy Walsh a2710a98d9 Only consider the last interesting event when checking traits.
Was previously looking at the last .start event when
comparing important traits against the .exists event.
Now it will look at the last important .end event it found (if any).

For delete operations, it will be the last event in the chain.
This may need to change to a specific event as well, like
compute.instance.delete.end or something.

Change-Id: Ie85e69716cd730c3546d06bae28e52e0c301940f
2015-04-17 07:39:44 -07:00
Monsyne Dragon edca8bd8b1 Out darned typoes.
Out I say!

(Fix typo in pipeline_worker daemon)

Change-Id: I9c04044ce2583649306d7ccf42b954ddd01e3672
2015-04-03 20:54:02 +00:00
Monsyne Dragon 08d43dcdd7 Fix typo in pipeline worker daemon
log_file, not config_file.

Change-Id: I1fb6f6c8ac4decbd20816d60a365f7d9a66c8f4c
2015-04-03 19:59:47 +00:00
Monsyne Dragon 0a2bf4471e Improve logging.
Allow pipeline workers to log to different logfiles
(the python logging system is not entirely multiprocess safe)
Allow users to set a logging name for each worker process
to differentiate logs.

Change-Id: Ic93e88270d58495cda918dab503f65d9f550e2b6
2015-04-03 17:50:39 +00:00
Sandy Walsh 4cb16327c7 NotabeneHandler no longer formats notifications.
It just passes it through verbatim. Only required key is 'event_type'.

Change-Id: Idcd911c9f09d405d57ecaf5b14b72bfebe2a179a
2015-03-25 12:45:04 -07:00
Eddie Sheffield e08924f1f8 Add functionality for counting events
Similar to the existing streams functionality, this patch adds
the ability to get just a count of filtered events rather than
the full list of events.

There are corresponding changes in quince, quincy, and klugman.

Change-Id: Ic14845db48170a8481c764f5f2468f137758bd19
2015-03-20 12:42:00 -04:00
Sandy Walsh 7846f6a20f Add support for find_events()
For use with API. You can find events based on traits, event_type or dates.

Doesn't support wildcarding or anything just yet.

Change-Id: Ide6e13086d50bacf356d8e36b9de257db9d543ca
2015-03-04 09:22:11 -08:00
Sandy Walsh 4875e419a6 Fixes the .verified notification format.
Now it matches the notification format expected by the yagi
CUF handler. Requires expanded event_definition.yaml file
to include extra traits from .exists

Change-Id: I83ba05d73890a578699566648b37697d46b58040
2015-02-27 06:05:41 -08:00
Sandy Walsh 6557de033c Reset version back to 0.3
I know this may cause some headaches, but we want to keep the version #
below 1.0 under we're fully in production. The 1.0 hack was a
workaround for pbr problems.

And we need to bump anyway for the "count" option on find_streams to
get exposed.

This is all really just for pypi.

Change-Id: I8d2567d303c04a5b9e6c295522568cca301283ec
2015-01-29 06:03:05 -08:00
Sandy Walsh 641f7bee84 Bump to v1.0 for packaging
Change-Id: I82600e45aa502623c6f7de01fcdfd7a0ac9651d6
2014-12-05 08:40:46 -08:00
Monsyne Dragon 0c619c133d Add database admin command.
Add admin command for db schema upgrade/downgrade/etc.
Move alembic migrations so above can find them when installed
    as a package.
Fix up packaging to use setup.cfg and pbr.
Flesh out README.
2014-09-07 04:07:20 +00:00
Monsyne Dragon a8f373e4bf Added full stream processing, pipeline workers, etc.
Full trigger logic now works.
Added pipeline workers, and test handler.
Added example configs
Lots of unittests.
2014-09-04 01:49:19 +00:00
Monsyne Dragon aa8fb55e87 Initial commit of DB schema.
Initial commit of the event schema for the database.
This includes models and alembic migration.
2014-06-26 01:55:26 +00:00