Commit Graph

55 Commits

Author SHA1 Message Date
Ghanshyam Mann 72ea117f61 Retire Tripleo: remove repo content
TripleO project is retiring
- https://review.opendev.org/c/openstack/governance/+/905145

this commit remove the content of this project repo

Change-Id: Ic549bdcc76a5e12a0104143fbe79fd0db2c866b0
2024-02-24 11:44:35 -08:00
Ghanshyam Mann 38a0bc4cda Moving IRC network reference to OFTC
Change-Id: I0a35182f72eaef02bad22e6fb702af3651092c28
2021-07-08 14:44:17 +00:00
Wes Hayutin 82ea5a85c5 allow users to override nodepool settings for libvirt reproducer
copy the libvirt nodepool defaults from their hiding space
directly to the workspace of where users launch the reproducer.

This will allow users to customize the image, memory etc easily.

Change-Id: I41d98002fdd578cdd82adb48cabfc937370d5ba5
2021-03-02 21:01:19 +00:00
Wes Hayutin 6b9fcb17b0 reproducer: do not overwrite workspace by default
users should be allowed to tweak settings and rerun
this script w/o all their changes being overwritten

Change-Id: I66a3e827fab054fd320ba7554baae9597f9205d0
2021-02-26 02:15:23 +00:00
Zuul 8765bcd7da Merge "add the fresh box setup to reproducer.tar" 2021-02-22 11:42:55 +00:00
Wes Hayutin ada7a12b96 add the fresh box setup to reproducer.tar
Change-Id: I409ee11216e1adc3cace9700b316159daeccb38a
2021-02-19 11:35:13 -07:00
Bogdan Dobrelya 09819b58e2 Change defaults for mirror_path
Because rdo cloud is deprecated, let's use other mirror, for example
one from rax.

Change-Id: I3556bce94ff311bf9d72e64b651e740a1bcf71a2
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
2021-02-10 17:31:04 +01:00
Bogdan Dobrelya f8b23931a6 Add more flexible mirrors settings for CI repro
Fix undefined value substituted for mirror_fqdn, when there is no
mirror_path defined in inventory variables used for the zuul-based CI
reproducer. Avoid using mirror_path if mirror_fqdn is defined. For
compatibility sakes, if mirror_path is in inventory, its value will be
used for mirror_fqdn and pypi_fqdn in zuul playbooks although.

Also pass for zuul playbooks pypi_fqdn and package_mirror, if defined.
When pypi_fqdn is omitted, custom mirror_fqdn always overwrites
the used (and trusted) pypi mirror. That might be undesired behavior
when configuring different mirrors for packages versus pip eggs.

Additionally, unhardcode zuul_site_mirror_fqdn and mirror_path. It used
to end up hardcoded in zuul-config/zuul.d/jobs.yaml.
In order to properly interpolate overrided mirrors, parametrize those.

With https://review.rdoproject.org/r/27758 in place, users can define
more flexible mirrors configurations by using: mirror_fqdn, pypi_fqdn,
package_mirror, or zuul_site_mirror_fqdn and mirror_path.

Change-Id: I66ef983460f7bf8be6e18b379ef1952f577044fe
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
2021-02-02 11:40:19 +01:00
yatinkarel fa93a6a3bc Use job's featureset_override directly
featureset_override_file_output contain some additional vars
like standalone_custom_env_files.
To reproduce a job we want to have same set of override's
given in a job so let's use job.featureset_override instead, if
standalone_environment_files is part of featureset_override
then standalone_custom_env_files will be calculated within
standalone role.

Closes-Bug: #1897155
Change-Id: I7dbd8f1e34cabd41504150c886cbe9ff166b50ea
2020-09-25 17:39:40 +05:30
yatinkarel 2d0019061e Fix Syntax Error in reproducer script
Wrong variable name was used and space was missing,
this patch fixes these.

Change-Id: Iaa53097780b1bf4d7dc31666e59f559c6d9348b1
2020-07-20 10:43:14 +05:30
Zuul 09f9dde27d Merge "Add mandatory container_mode to reproducer script" 2020-07-17 12:20:39 +00:00
Sagi Shnaidman 9a3f78fc94 Add mandatory container_mode to reproducer script
Reproducer playbook requires container_mode, set it for 'podman'
by default.
Change-Id: If764a36d76278d303e07177b41d11db7370c5c87
2020-07-16 12:50:24 +03:00
Bogdan Dobrelya 290f1d27a8 Fix openstack org mirrors for reproducer
Libvirt reproducer defaults to openstack.org mirrors, which no longer
exist. Fix the reference to opendev.org to make defaults working as
well.

Change-Id: I6b7e11e431ec948c1c8f37be64aaed6f643ab67e
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
2020-07-14 15:03:23 +02:00
Steve Baker a05c3185d7 Make reproducer script centos-8 friendly
The install-deps.sh handles centos-8 just fine as long as the
USER_PYTHON_OVERRIDE isn't set.

Also, don't assume that docker is installed so put the docker group
setup in a conditional block.

Change-Id: Ib0aae3d17bee259d72ed964c289bf0b9f4406ce3
2020-03-12 22:32:46 +00:00
Sorin Sbarnea fce23f7646 lint: enabled whitespace fixes
Adds two checks that were used in order repos (liketq)but not on this
one.

Change-Id: I4ccaf3dc78777b4b661fa17382f2feef8eb0d03e
2020-01-05 14:07:37 +00:00
Bogdan Dobrelya b3a0b8258e Fix indentation for the rendered launcher-playbook
Fix badly formatted job vars placement, e.g.:

      - job:
          name: foo-dlrn-hash-tag
          parent: foo
          vars:
            mirror_fqdn: {{ mirror_path }}
            ready_releases_file: |
              #!/bin/env bash
              export STANDALONE_TARGET_HASH="bar"

                        registry_login_enabled: false

Change-Id: I80d06cb66bdc725b70ecb5ef938026a36e793dcf
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
2019-11-26 15:06:06 +01:00
Sorin Sbarnea 1c6b947bf2 ansible-lint: removed skip of 206
- Fixes 206 errors and removed the skip.
- Also replaces revision with latest tag (pushed today)

Bug: https://bugs.launchpad.net/tripleo/+bug/1848512
Change-Id: I69d75ba9de8ab0e91eb45fd4f9febfdb28cdcb3a
2019-10-25 17:15:40 +01:00
Chandan Kumar (raukadah) 8b6f71035b Set force_periodic to true in periodic job
Currently in zuul based reproducer, for running periodic
jobs, we need to specifically set force_periodic to true
in the launcher playbook manually. In order to fix that
we are enabling it based on job name.

Change-Id: Ic4aa91f061d9918fa91a69cb4c38eb476521c3d0
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-10-16 12:28:55 +05:30
Chandan Kumar (raukadah) 85be5ea1e6 [reproducer]Set registry_login_enabled to false
Since in reproducer, there is no access to RDO registry and
in our jobs registry_login_enabled: true is enabled by
default [1.] and it tries to authenticate with the registry and
we have no credentials leading to failure in the base job itself.

Setting it to false fixes the issue.

[1.] https://review.rdoproject.org/r/#/c/22304/

Change-Id: I102683b637d60afbdb3898c811ba5961b69fede4
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-10-14 16:01:19 +05:30
Arx Cruz 5a8bd7e162 Replace wget with curl
Using wget can lead to problems because it's not default.
We should use curl instead

Change-Id: Idc859c57582ed3b83c6177e91e14ba4828311826
Closes-Bug: #1847344
2019-10-09 10:50:30 +02:00
Bogdan Dobrelya 6d5a2a1021 Statically import CI reproducer roles
This allows to use the generated script with custom ansible's
--start-it-task, f.e. when want omitting libvirt manipulations and only
redeploy zuul et al.

Change-Id: Ic86cc2bd44dcaca73d4a3ff05542f8e46d32b599
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
2019-09-19 15:25:52 +00:00
Sagi Shnaidman d89990d5ba Always prefer local ansible install in reproducer
we can have different ansible versions in the host, installed both
globally and locally (with pip install --user). Let's prefer local
version that we control with pip.

Change-Id: Ibb1dc97aa210919f7846eac0670b678d97abdade
Closes-Bug: #1831877
2019-06-06 18:12:08 +03:00
Marios Andreou a04f3c986b Add fresh-box-setup script for zuul-reproducer first run
On first run or a fresh setup there are some required steps like
creating a user, a clouds.yaml and ssh keys for gerrit. This adds
a script into the create reproducer role which can be used for
this initial setup

Change-Id: I6d70a87006800447a12b4609ccc81400741290db
2019-05-09 18:20:13 +03:00
Zuul 59f9e498e4 Merge "Use just release file at reproducer if present" 2019-04-23 22:50:13 +00:00
Wes Hayutin bf138f2ec1 update tqe openstack -> opendev
Change-Id: I14443c5d5e8cddde01373ce6408ced47a7dc1403
2019-04-22 13:17:19 -06:00
Quique Llorente 55bbfbb684 Use just release file at reproducer if present
In case the job that we want to reproduce is using the output from emit
releases script, reproducer has to use just that otherwise upgrade jobs
will fail.

Change-Id: I8c144b6dab59fba2b10e190c8b0afd7580bfffba
Closes-Bug: #1823688
2019-04-22 14:18:52 +02:00
OpenDev Sysadmins db85f97e1d OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:42:23 +00:00
Ronelle Landy 320c77122d Remove newline spacing on dlrn_hash_tag vars
The newlines are not needed and putting the settings
on ths same line as the definition simplies templating.

Change-Id: Ib84c5c42d276333551d79ad0d175bcb4efdce936
2019-04-08 12:43:00 -04:00
Zuul b471f85599 Merge "Launch zuul reproducer at correct branch" 2019-04-08 08:52:58 +00:00
Quique Llorente c86f25dc15 Launch zuul reproducer at correct branch
Now that test1 project has release branches we can instruct the
reproducer ansible role to use the branch from zuul

Change-Id: Ieae08b8a37eae3615c6d942c36424ecd5e781d3c
Story: https://tree.taiga.io/project/tripleo-ci-board/task/933?kanban-status=1447275
2019-04-04 15:07:49 +02:00
Wes Hayutin 7c7c5f75cd update reproducer doc
* remove notes regarding image export/import
* add instructions for autohold (temporary)

Change-Id: I059e38e9668cfa4aaa5b0ce4988473789be2760e
2019-04-03 11:20:30 -06:00
Wes Hayutin 6c16c3f8be clean up reproducer files
The default log directory is getting very
cluttered.  Let's move what we can into
directories.

Change-Id: Ica442990bcb0ffa5ea098b9990a57df10d360a13
2019-03-21 14:56:06 +00:00
Zuul 9a90158e55 Merge "Improve warning message on docker group issue" 2019-03-14 18:07:47 +00:00
Zuul 071404a6d9 Merge "update reproducer doc w/ command options" 2019-03-14 00:15:47 +00:00
Wes Hayutin ca4f325098 update reproducer doc w/ command options
Let's doc the cli options, it will help
clarify what is needed when we explain things
to folks.

Change-Id: I798fe9518675c68a97e70367de9edc5175a32875
2019-03-12 13:20:22 -06:00
Rafael Folco f9ba72c7f3 Improve warning message on docker group issue
When running for the first time, user will be added to the docker
group and the script will exit. Ask the user to re-run the script.

Docker requires the user to log out and log in to refresh group
permissions.

Change-Id: I22f2ec00109337fa6f0d2a98868a56abd950d733
2019-03-12 17:48:41 +00:00
Sagi Shnaidman 4591eb5ecf Support patches in reproducer runs
Add support for patches checking for reproducer role and quickstart.
Pass patches as refspecs:
    ./reproducer-zuul-based-quickstart.sh .... \
        -e ooo_quickstart_refspec="refs/changes/08/641708/2" \
        -e reproducer_role_refspec="refs/changes/59/19259/1"
It will apply patches above to code before running reproducer.

Change-Id: I470213f4745464b652be5ff7a3b2aa320ac78cda
2019-03-11 20:56:50 +00:00
Zuul e673eba830 Merge "check that kvm kernel modules are inserted" 2019-03-11 20:03:28 +00:00
Zuul fd3581b4a9 Merge "Depends-On is not needed with periodic jobs" 2019-03-08 20:36:22 +00:00
Wes Hayutin ae22344c78 check that kvm kernel modules are inserted
The kvm flags in the kernel can be available
but turned off in the bios.  Check that the
kernel module for kvm is available.

Change-Id: Ibc2bc81cddd3698450723dd928f0c94dc510b7a8
2019-03-08 09:49:39 -07:00
Ronelle Landy 934b0f490e Depends-On is not needed with periodic jobs
Remove this case from the periodic reproducer
launcher playbook.

Change-Id: I934671580fa80c92eccef2443c277f336c662b7c
2019-03-07 18:42:21 +00:00
Marios Andreou 619c763dd4 zuul reproducer script add missing fi
In I0723140ff3df5a2aaaf9be79f81deb85b9114b0d there was a nit with
missing fi. See Issue 2@ [1] for info on the error

[1] https://tree.taiga.io/project/tripleo-ci-board/task/766

Change-Id: I146aadb3430fb0ec17e74695976e035753ca7924
2019-03-07 17:50:02 +02:00
Zuul f0b8ce6af0 Merge "prevent -l, libvirt on machines w/o capabilities" 2019-03-07 01:19:31 +00:00
Wes Hayutin ae2c0afeee prevent -l, libvirt on machines w/o capabilities
People may be tempted to run w/ -l on a vm.
Prevent libvirt workflow on noncapable machines.

Change-Id: I0723140ff3df5a2aaaf9be79f81deb85b9114b0d
2019-03-01 20:26:01 -07:00
Wes Hayutin a5f5b65317 ensure docker group exists
In the latest docker rpm on fedora28 the
docker group is not created at all.

Change-Id: I79dadf948494e1cb6881a5dfe47669424c2feacb
2019-03-01 18:04:27 +00:00
Zuul c175e18f19 Merge "make the git clone idempotent" 2019-03-01 16:27:16 +00:00
Wes Hayutin 71e5d89ce4 make the git clone idempotent
do not try to reclone tq/repro git repos
after they have initially been cloned.
set update: false

Change-Id: I213fd82b6cd9005762b1287292cb44e8c6f574af
2019-02-28 13:08:20 -07:00
Wes Hayutin f1b69d2e38 add image sharing instructions
Some members may not have access to the images

Change-Id: I0d7bb29c3391504bd1188b5efd7df9685a046cac
2019-02-26 11:14:15 -07:00
Wes Hayutin 518b7d2eb6 update the reproducer doc, with image import
* add image import
* test the clouds.yaml
* formatting

Change-Id: I5ba19879386645224e085e4baaec1ff43af15ead
2019-02-25 15:40:59 -07:00
Wes Hayutin 2db357c528 ensure pip is updated in reproducer
epel installs an older version of pip.
The older version of pip installs openstacksdk==.013
however is unable to import the library.  The
updated version of pip resolves this issue.

Change-Id: Iacb4dd3cd3229ff9d68749c01c8f89af3460d51d
2019-02-19 14:39:17 -07:00