zuul-jobs/roles/stage-output
Clark Boylan e05b55fa67 Speed up log file fetching tasks
This replaces ansible loop tasks which rename log files to have a .txt
suffix with an ansible module task. The reason for this is each ansible
loop iteration can be very slow; up to 3 seconds per task. When
many log files need to be renamed this adds up quickly. The module can
do all of the renames in a single python process that should be much
quicker.

Note the old interface expected a list of extensions to rename. It then
converted that list of extensions into a regex used to find the files to
rename. The new code does not use regexes. It is possible someone abused
the old interface to hijack the regex and do something extra fun, but
that was not documented nor likely to be safe.

Change-Id: I7033a862d7e42b3acd8ad264aefca50685b317ff
2022-09-06 16:17:53 -07:00
..
defaults Stop compressing files during intermediate steps part 2 2020-01-08 09:24:45 -08:00
library Speed up log file fetching tasks 2022-09-06 16:17:53 -07:00
tasks Speed up log file fetching tasks 2022-09-06 16:17:53 -07:00
README.rst Stop compressing files during intermediate steps part 2 2020-01-08 09:24:45 -08:00
__init__.py Speed up log file fetching tasks 2022-09-06 16:17:53 -07:00

README.rst

Stage job output on the remote node

Takes as input a dictionary of files/folders named 'zuul_copy_output'. Copies contents into {{ zuul_output_dir }} on the remote node and is intended to be used before output fetching in a base job's post-playbook.

Role Variables