Release note for batched evaluation of final workflow context

(cherry picked from commit 5073274dd1)

Change-Id: I9d1e85264bb9cdf6dc84e04cf85f9a14573a6248
This commit is contained in:
Renat Akhmerov 2018-04-20 18:32:19 +07:00 committed by Dougal Matthews
parent 1f79117fc1
commit d1e2856aa5
1 changed files with 12 additions and 0 deletions

View File

@ -0,0 +1,12 @@
---
fixes:
- Evaluation of final workflow context was very heavy in cases
when the workflow had a lot of parallel tasks with large
inbound contexts. Merging of those contexts in order to
evaluate the workflow output consumed a lot of memory.
Now this algorithm is rewritten with batched DB query and
Python generators so that GS has a chance to destroy
objects that have already been processed. Previously all
task executions had to stay in memory until the end of the
processing. The result is that now it consumes 3 times less
memory on heavy cases.