mistral/mistral/engine
Renat Akhmerov 1a4c599a4d Improve join by removing periodic jobs
* This patch removes the approach with DB polling needed to
  determine if a "join" task is ready to run. Instead of running
  a periodic scheduled job, each task completion now runs the
  algorithm that finds all potentially affected join tasks
  and schedules just one job (instead of a periodic job) to check
  their readiness.
  This solves a problem of system cascaded overloading in case of
  having many very large joins (when a workflow has many joins with
  many  dependencies each). Previously, in such case Mistral created
  too many periodic jobs that just didn't let the workflow progress
  well, i.e. most CPU was used by scheduler to run those periodic
  jobs that very rarely switched "join" tasks to the RUNNING state.

Change-Id: I5ebc44c7a3f95c868d653689dc5cea689c788cd0
Closes-Bug: #1799356
2018-10-23 14:01:39 +07:00
..
__init__.py Renaming "engine1" to "engine" 2015-04-09 17:47:36 +06:00
action_handler.py Dynamic workflow name evaluation. 2017-08-16 13:17:10 +02:00
action_queue.py Improve join by removing periodic jobs 2018-10-23 14:01:39 +07:00
actions.py A mechanism to close stuck running action executions 2018-06-12 14:15:15 +00:00
base.py A mechanism to close stuck running action executions 2018-06-12 14:15:15 +00:00
default_engine.py A mechanism to close stuck running action executions 2018-06-12 14:15:15 +00:00
dispatcher.py Performance: remove unnecessary workflow execution update 2018-09-03 11:47:11 +07:00
engine_server.py New experimental scheduler: the first working version 2018-08-14 14:02:19 +07:00
policies.py Refresh a number of retry a task when task was rerun 2018-06-24 05:34:33 +00:00
task_handler.py Improve join by removing periodic jobs 2018-10-23 14:01:39 +07:00
tasks.py Make task execution logging more readable and informative 2018-10-01 11:37:48 +07:00
utils.py Create and run a workflow within a namespace 2017-08-01 13:51:05 +00:00
workflow_handler.py An execution hangs in the RUNNING state after rerun 2018-10-14 10:29:16 +00:00
workflows.py An execution hangs in the RUNNING state after rerun 2018-10-14 10:29:16 +00:00