The non-zuul-based reproducer has been unmaintained for years. Its
functionality is a strict subset of the zuul-based-reproducer
nowadays. It has been removed from openstack/ansible-role-collect-logs
recently and since then is not used anymore. Hence let's get rid of it.
Change-Id: Id6b83f5e6287e70c01ad68c17eae147c5ff785ee
Libvirt reproducer defaults to openstack.org mirrors, which no longer
exist. Fix the reference to opendev.org to make defaults working as
well.
Change-Id: I6b7e11e431ec948c1c8f37be64aaed6f643ab67e
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
Fix undefined value substituted for mirror_fqdn, when there is no
mirror_path defined in inventory variables used for the zuul-based CI
reproducer.
Ditch confusing alternative variable mirror_path and use mirror_fqdn as
it directly comes from zuul ansible variables. For compatibility sakes,
if mirror_path is in inventory, its value will be used for mirror_fqdn
in zuul playbooks.
Also pass for zuul playbooks pypi_fqdn, if defined.
If pypi_fqdn is skipped, custom mirror_fqdn always also overwrites
the used (and trusted) pypi mirror, what might be undesired, like
when configuring different mirrors for packages versus pip eggs.
For the depreceted reproducer, wire in mirror_fqdn as well.
Depends-On: https://review.opendev.org/696337
Change-Id: I9f87ea6335ce0a0b7c3e8c4cb1fe00187f474dd1
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
when trying to use reproducer generator stand standalone, README file is taken
from collect logs.
This change moves it to the create reproducer role, and make it a standard
file, not a template, since it does not use any variable
Change-Id: Ie21f47264680b468ce51a3e1f8305670889ccb41
Use of exit instead of return in the check dependecy function prevented
us to list all missing dependencies before exiting.
Avoid case where user needs to run the script 6 or more times in order
to install missing dependencies.
Adds git which was a missing dependency.
Change-Id: I66f883bbd817ce809261b7408c945e527ab72549
Partial-Bug: 1787912
Adds command line option and environment variable that allows user to
run reproducer without wiping tq[e] repositories on each run.
When specified it will just pull and rebase them when they already
exist.
This allows us to test effects of changes made to these repositories
and re-run reproducer multiple times.
Change-Id: I7b489d5fba0e1f5dd0d34fff48107440cbc93c00
zuul_variables and zuul_console were added when there
was an investigation into simulating zuul behavior
for the reproducer. We are no longer following that
workflow for the reproducer and therefore these
failing lines can be removed.
Change-Id: I5f057ce78273ddf8cd6381c9a420b317713379b6
Use Ansible debug output callback unless user overrides it with his
own value. Same output is prefered on CI.
Change-Id: Ibd284dea867c002698238ec66a328f4267bd49e9
Related-Bug: 1787912
Upgrades yamllint to latest version and adots use of its strict
checking.
Fix all known problems reported by yamllint so we don't have to do
that while touching these files.
Change-Id: I4bdc520d9e2aff086c4b463718bc1e053261a4f5
Story: https://tree.taiga.io/project/tripleo-ci-board/task/381
This uses the zuul-variables file for zuul.projects and the json console
log written by the depends on, for the playbooks. This is tracked by the
ci team with [1]. These are made available to but not yet used in the
reproducer (that will come later, see the story linked in [1]).
[1] https://tree.taiga.io/project/tripleo-ci-board/task/270
Depends-On: https://review.openstack.org/615191
Co-Authored-By: Ronelle Landy <rlandy@redhat.com>
Change-Id: I64923cfd75e697b98507be1ff398c14654108ddf
The reproducer should use toci_quickstart,
toci_gate_test and related functions with the
same variables as the CI job.
This review creates a directory to copy those
ready templates for use when running the reproducer.
Change-Id: I1480a42bd78577fe2d2fb34981a2b02889b37ead
Story: https://tree.taiga.io/project/tripleo-ci-board/task/271
Currently, even if dlrn_hash_tag_newest is found, it's not rendered in
the env_vars_to_src.sh file.
This fix it, and make the EXTRA_VARS line more readable.
Change-Id: I604c7780ab7e37204360b74791b8522ff31ea695
Closes-Bug: #1799662
When $PLAYBOOKS variable is not quoted, it's impossible to source
it from the file because it contains spaces.
Change-Id: I8a8155845e52635d826dabdb5bc02e456b3f2421
This reverts commit c348e84ce1.
Local reproducer role should be from master, not from change. If we run
reproducer from a month ago, it will run reproducer role from a month
ago and most likely will fail or will have not up to date settings.
If one want to test changes to reproducer role, it's possible to edit
reproducer script manually.
It doens't make sense to use reproducer code from same data that patch
itself, if reproducer was broken then you just can't run it even now.
Close-Bug: #1790611
Change-Id: Ic699159da53ca6676bf4d1d845816d333893e8ec
Assure that if ZUUL_CHANGES contains any
changes made to tripleo-quickstart[-extras] repos we
would cherry pick them after cloning.
Change-Id: I8daeff664711650e72b6ef0a77f5091b45a451a5
If the workspace path doesn't exist then realpath fails
realpath: /the/final/result/: No such file or directory.
This minor edit ensures we don't fail in such cases since
the workspace is created anyway later on in the script.
Change-Id: Idea203eddc649a1ad7c17593d8ddc52c703383b7
Running reproducer fails if you don't have python-virtualenv installed.
This adds a check and warning which is nicer than the usual error
"reproducer-quickstart.sh: line 199: virtualenv: command not found"
After discussion also added check for pip and further testing also
showed the need for ansible and openstackclient.
Related-Bug: 1769538
Change-Id: Ic4a2740ef08c3f2a9746f78b69186a4feec9af3c
This is not for public consumption yet.
Adding a review to store documentation notes
for when this is available for general use.
Change-Id: I3b54f54430599fca2ff089aae866a781cdb01673
The symlink that resolved this is no longer in the repo. We only
have a single toci runner script now.
Related-Bug: #1778974
Change-Id: I2fc830c9452766719ec482f2b4ee1a97e7123b29
https://review.openstack.org/#/c/572220/ assumed
that the first part of TOCI_JOBTYPE is always
ovb/multinode/singlenode/standalone. This is not the case
with periodic jobs and half the reproducer script
is missing for multinode periodic jobs.
This review removes the 'periodic-' piece of the TOCI_JOBTYPE
string before the split and comparison occurs.
Change-Id: Id5650b43ead7269b6738a8d887ad018e188e517b
This is not an undercloud or overcloud deployment.
This is a new single node composable deployment for TripleO
The review adds the role to handle the logic. It also
updates the reproducer script to handle the new toci_jobtype
definition so the job can be recreated properly.
Change-Id: I8f2c3daed748ea7a6d6a17e9db420a5ec1779d7f
The zuul changes were not being apply, exporting
the variable make them accesible to ansible roles.
Change-Id: I2d297f73ed0eaf0b38d6bbdd311aec557f75105b
This patch adds the option of overriding the
parameters used for provisioning [0] the
multinode stack. The newly added option
--extra-params/-e allows you to pass different
values for the instances flavor or networking
parameters.
By adding this option we provide flexibility at
the time of running the reproducer script in
other cloud environments.
[0] https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/multinodes/templates/stack.yaml
Closes-Bug: #1769532
Change-Id: I998ffa98da5e2df783908bf003816a06dff30bbb
When reproducing CI job sometimes needs to run a specific set of
playbooks only. Support this by pasing PLAYBOOKS variable in
env_source script.
Usage example:
- one needs to run everything before undercloud installation:
* PLAYBOOKS="quickstart.yml" ./reproduce-quickstart.sh (in case of
multinode)
* PLAYBOOKS:-"ovb-setup.yml" ./reproduce-quickstart.sh (in case of
OVB job)
- one needs to deploy everything before overcloud deployment:
* PLAYBOOKS="quickstart.yml multinode-undercloud.yml multinode-overcloud-prep.yml"
./reproduce-quickstart.sh (in case of multinode)
* PLAYBOOKS="ovb-setup.yml baremetal-full-undercloud.yml baremetal-full-overcloud-prep.yml"
./reproduce-quickstart.sh (in case of OVB)
List of used playbooks is in toci_gate_test-oooq.sh script
in tripleo-ci repo:
http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_gate_test-oooq.sh#n157
Change-Id: I6388c5e20d499a2e6c5e06f23de9851ef53b40a6
Is very common to change the reproducer-quickstart.sh manually for re-runs,
reducing redundancy helps a little.
It is also moves the README html template to the correct path.
Change-Id: I59874e7da4b3ad1a72e8a71380c9eb7bcb602d63
The libvirt option should be valid for multinode jobs
that can run with 2 nodes - and singlenode jobs.
Documentation is added to the libvirt option.
Change-Id: I1c543a9669d6cbfba4cb852e2c4257d6c44db1b8
In 9251a3ec5a we added a "shift"
after the autorun option. This is incorrect, as autorun does not
take an argument, so there is nothing to shift.
This change removes the unintended shift.
Change-Id: Ibcfbcf39fbeaaa15ecd8e1a2a2085bb2dcbed8c8
Current default timeout for jobs running in CI is 180
minutes which is not sufficient for some of the scenarios
to complete. This patch set's default timeout for reproducer
script to 240 minutes which should be sufficient for most
of the scenarios and add an option -t|--timeout to override
this default.
Change-Id: Iad864e2edb03d66b09d612178c2fbec0d4501fc1
As we're using cloud instance the probability to get the same ip with
changed ssh keys is high. Avoid "WARNING: REMOTE HOST IDENTIFICATION
HAS CHANGED!" failure by making sure that we don't record the ssh key
locally.
Change-Id: I4f8955e387387606b76f1dbb91cbed6b94b47b15
Jakob Meng
yatin