Commit Graph

61 Commits

Author SHA1 Message Date
Ghanshyam Mann 72ea117f61 Retire Tripleo: remove repo content
TripleO project is retiring
- https://review.opendev.org/c/openstack/governance/+/905145

this commit remove the content of this project repo

Change-Id: Ic549bdcc76a5e12a0104143fbe79fd0db2c866b0
2024-02-24 11:44:35 -08:00
Takashi Kajinami 80c6f8b006 validate: Remove logic for unsupported old releases
This change removes logic for releases older than train, because these
releases are already EOLed. This covers only tempest roles and
playbooks.

Change-Id: I0b50cad30107a83b562b8c22b2afd7af7636c615
2022-10-25 17:16:18 +09:00
Lee Yarwood d9a1e8c3d6 Update to Cirros 0.5.2 ahead of switching to the q35 machine type
Before switching the default machine type of instances to q35 in
tripleo-heat-templates via I9f60a73577ae7cd712e2a8285abc0c0788906112 we
first need to ensure that Cirros is updated to 0.5.2 that includes the
ahci module [1][2].

As set out in I12e0bdb3699e5343592ab834468ba6b2fcdcaaf4 for devstack and
Iad1adbc23b31dd54a96299e7a8a4b622c15eed8d for Nova this is required to
allow Cirros based instances to see the now SATA based config drive
cdroms attached to them during a Tempest run.

[1] https://github.com/cirros-dev/cirros/releases/tag/0.5.2
[2] https://github.com/cirros-dev/cirros/pull/65

Change-Id: Ia3f839a3c5e4e4b59898c11561fe7ef7126bba5f
2021-04-09 09:04:05 +01:00
Marios Andreou c2b0910fe1 Remove all rocky related conditionals and tests after rocky End of Life
Rocky is now EOL since [1][2] so this removes all the rocky related tests
or conditionals.
Related reviews in topic branch tripleo-ci-reduce-rocky [3].

[1] https://review.opendev.org/c/openstack/releases/+/774244
[2] http://lists.openstack.org/pipermail/openstack-discuss/2021-March/020912.html
[3] https://review.opendev.org/q/topic:tripleo-ci-reduce-rocky

Change-Id: Icb999fa6c8278bd54c200c73963b5e364c94c23d
2021-03-29 11:54:27 +00:00
Sergii Golovatiuk 79a1e3b13c Update cirros image from 3.6 to 4.0
Sync to 0.4.0 across all repos

Change-Id: I09a96521a6cc83826fd7168d7544172f075b3e06
Related-Bug: #1896537
2020-10-01 19:16:08 +00:00
Andreas Jaeger 06787d5757 Use current stackviz tarball
https://tarballs.openstack.org/package-stackviz-element/ has not been
updated since 2017, use the current location for the stackviz tarball.

Change-Id: I8f56ca5597a29533ab744387c502f9515e53b485
2020-02-26 09:30:36 +01:00
François Charlier ae40f0ff93 'is in' is not a valid Jinja test
Ansible complains that "is in" is not a valid test, use "in" instead.
(introduced in f20c29689)

Change-Id: I02670fe00f9d9d5ef12a2f3af5bede35442f1397
2019-09-01 09:05:21 +00:00
Sagi Shnaidman dfe7238db1 Configure rhel container for tempest
Change-Id: I0a8611262c9f4246e6a3ac3acd49c0db81c3b03e
2019-08-14 13:33:11 +03:00
Arx Cruz a4b1340a1c Fix containerized tempest logic
We weren't testing containerized tempest in standalone job due the
missing logic on tempest-setup.sh script. This patch adds the logic for
when containerized tempest runs in standalone, copying the clouds.yaml
file instead of the stackrc/undercloudrc and also maintain the logic
when you execute tempest in the ovb, copying the rc file.
This also ensures that /var/lib/tempestdata and /var/log/tempest
directories exists in order to not fail the execution of containerized
tempest.

https://tree.taiga.io/project/tripleo-ci-board/issue/836

Depends-On: https://review.openstack.org/#/c/643212/
Change-Id: I90204150085a1c9b943f9e054c0420a8a5e66538
Related-Bug: 1819440
2019-03-15 10:34:40 +01:00
Zuul 2f434a2010 Merge "Change headless chrome port to 4444" 2019-02-12 11:58:15 +00:00
Honza Pokorny 55df6235f4 Change headless chrome port to 4444
The browser is running on that port inside the container.

Change-Id: If4f777b990099b67db631102d8f8be418b97b46b
2019-01-28 08:17:07 -04:00
Chandan Kumar b15450d986 Update cirros image from 3.5 to 3.6
The current cirros image ssh setup fails due to lack of disk space
causing config-drive setup to fail forcing fallback to metadata
server. It is currently seen in OSA and devstack gates.
It might affect tripleo also.

Change-Id: I84a335921f3dd55c8e319c6bed260aa41201cdbb
Related-Bug: #1808010
2019-01-25 19:37:46 +05:30
Zuul e9ac7a3c44 Merge "Added support for installing tempest plugins from git" 2018-12-27 16:54:10 +00:00
Quique Llorente ccca64f523 Install correct python version packages at tempest
The role validate-tempest was installing python- for f28 we need to
install python3 packages.

used/needed by https://review.openstack.org/618056

Story: https://tree.taiga.io/project/tripleo-ci-board/task/375

Change-Id: Iad3dde61173140321ede8f3549e01163cb4f4b41
2018-12-26 12:47:08 +01:00
Chandan Kumar 881d16fb42 Added support for installing tempest plugins from git
In order to use it, in any FS, set tempest_format to venv
and then set:
tempest_plugins_venv:
  - '<complete upstream openstack tempest plugin git url>'

Change-Id: I95a4449ca3976a914faf1ba5f3f4c0e756a6fefc
2018-12-24 10:49:42 +05:30
Honza Pokorny 7ff41dea0e Add option to install chrome when running tempest
Change-Id: Ie5892ee14cc5e9bbc09dc79aeac7611bfb26e5bb
Partially-implements: blueprint automated-ui-testing
2018-11-19 13:52:48 +05:30
Sorin Sbarnea baf8392455 Harden yaml linting on modified files
Allows us to slowly adopt yamllint by having to fix only the files
we would be touching. Once we lower the amount of differences we
can switch it to run on all files.

In addition to having a more consistent code-style this solves
*recurring* bugs like duplicate dictionary keys, like the one
fixes in this change. Only few weeks ago we had to fix a similar bug.

Change-Id: I2ef275700b420a0f700613568e43576079cd4d03
2018-11-14 20:55:47 +00:00
Chandan Kumar 2d255d14f8 Add podman support to validate-tempest role
* https://review.openstack.org/#/c/600517 introduces undercloud_container_cli
  to choose docker/podman container runtime. This changes introduces to use
  both docker/podman for running tempest tests.
* Tempest user does not have permission to create tempest workspace let's
  create the tempest workspace and own it with the tempest user.
* Introducing tempest_data directory to keep tempest related data
  which can be used by tempestconf and tempest run to tests
* Cleaned up stuff which is not necessary for tempest container.

Depends-On: https://review.openstack.org/#/c/614664/

Change-Id: I1b19b2580d1d4c9844e9221f18b23655b36b5a23
2018-11-06 15:41:48 +05:30
Arx Cruz 9db2de54ff Fix stackviz and subunit2html report generation
This is a better way to install and run stackviz, also removing some
tasks that's no longer necessary:
* Remove stackviz static files from the repo, since it's already in the
tarball
* Remove stackviz cloning, and using tarball
* Install stackviz directly from pip module
* Removing tempest-status.yml since we don't use to anything
* Move tempest-results.yml to run before stackviz, so we can take
advantage of the testrepository.subunit file to generate stackviz data
* Use testrepository.subunit to generate subunit2html report instead
of stestr/testr stream

Closes-Bug: 1779562
Change-Id: I918e5401b4f46e947bbaca99a48c2b21bce9a4bd
2018-10-12 17:02:00 +00:00
Zuul 28533f3e64 Merge "Remove volume.min/max microversion in tempest.conf from queens" 2018-09-16 01:06:49 +00:00
Alex Schultz 5a6ba28893 Add support for OS_CLOUD
Since the standalone deployment uses clouds.yaml, we need the validate
tempest role to allow for configuration using OS_CLOUD rather than the
traditional {stack,overcloud}rc files.

Change-Id: Ied55638618b718ee15a2ef5bc2f89cef232b5b7e
Related-Blueprint: all-in-one
2018-09-13 20:38:55 +05:30
Chandan Kumar f20c296892 Remove volume.min/max microversion in tempest.conf from queens
* with release to tempestconf-2.0.0 introduces support for volume
  microversion but in queens microversions were not configured and
  related tests were skipped. But due to tempestconf-2.0.0 in queens
  tests are failing. It removes the same from tempest.conf

Closes-Bug: #1791298
Change-Id: I42e436be9e7abbb47e9797735ebf5fabdeb6c2e5
2018-09-12 11:53:26 +00:00
Chandan Kumar 656c195b04 Updated tempest role for rocky branch
* https://review.openstack.org/592276 marks the release of tempest-
  19.0.0. Let's update the role to consume it
* Updated skiplist for rocky

Change-Id: I7a758d740d20ef8036d301aa612184186bac62f0
2018-08-16 14:54:22 +00:00
Chandan Kumar fbb9e59b22 Use local docker registry host for tempest container
* On Containerized undercloud, tempest container is already pulled
  and pushed to local docker registry through image prepare workflow
  and it gets updated if there is an package update. So let's use that
  once instead of pulling it again and test the stuff with that.
* new tempest_container_tag would be docker_image_tag + update_containers_append_tag
  which comes from image prepare workflow.
* make container_build_id, update_containers_append_tag as cacheable as it is need in
  different ansible run

Depends-On: https://review.openstack.org/#/c/589523/

Change-Id: Ibe5a285d6d26c9433d9ff6e7a85f266acc32815a
2018-08-07 15:48:37 +00:00
Chandan Kumar c570dd05e2 Enable tempest.log in /var/log/tempest for container
* In CI, when tempest container is used, It is good to dump the
  logs in /var/log/tempest so that it would be easier to verify
  tempest container is used.
* Introduced tempest_log_dir and tempest_log_file var to the
  validate-tempest-playbook

Depends-On: https://review.openstack.org/#/c/566364/

Change-Id: Ifd72d902c623b3941a6c714e36b7cf104109a570
2018-05-17 13:08:03 +05:30
Zuul 5e5a0eb462 Merge "Rename test_regex to test_white_regex with deprecation" 2018-04-30 12:52:35 +00:00
Chandan Kumar 4e33024277 Remove unused undercloud_public_net_name var
* undercloud_public_net_name is unused var in validate-tempest
  role and is not used anywhere and there is no public network
  on the undercloud installation. So it needs to be removed.

Change-Id: I18f63c79ddcf1cf3b1da02e5fef73c81876f2094
2018-04-27 10:24:30 +05:30
Chandan Kumae 6cff46c53b Rename test_regex to test_white_regex with deprecation
* https://review.openstack.org/551441 introduced test_black_regex
  in order to skip test directly from featureset files. In order
  to avoid confusion between test_regex and test_black_regex,
  we are renaming test_regex to test_white_regex.

* Added deprecation message for the same.

Change-Id: I7e6240117c9fbab0e51d6248d74180c7a91dc9e2
2018-04-26 04:56:59 +00:00
Chandan Kumar de5dd4cc17 Refactored validate-tempest role for undercloud and containers
* Introduced new workflow for validate-tempest role
- Remove previously created tempest artifacts
- Install tempest
- Create tempest workspace
- Create tempest resources
- Generate tempest configurations
- Run tempest
- Removed unused ironic undercloud fake services
- Removing public network from undercloud as there is no public network
- Added tempest_dir var to give path to tempest workspace
- use {{ working_dir }}/tempest_git for clonning stuff
- Added test_black_regex to skip a series of tests
- Fixed permission issue for tempest_dir to generate subunit files
- Install stestr subunit-filters and subunit for generating subunit files
- Added tempest_skip_master containing skip list for undercloud
- Introduced tempest_conf_version for installing particular version of
  tempestconf from git
- Enable set -e to find the exit status of command running inside
  container

Change-Id: I021432e222fae0e57a13ca4859ba77e990ac6c67
2018-04-10 10:00:49 +00:00
Arx Cruz e27546d59e Adding queens release
Adding queens release for tempest.
Closes-Bug: #1750265

Change-Id: Ida06bb44fa35969f8ad00a394782a5eb29be0383
2018-02-18 19:04:21 +01:00
Zuul 74396208d1 Merge "Updated tempest_version to 17.1.0 for Pike and 16.1.0 for ocata" 2017-12-13 13:01:17 +00:00
Wes Hayutin 11f5c2ec78 install python-neutron-tests for stable releases
python-neutron-tests-tempest is only available starting in queens.
older releases use python-neutron-tests

Closes-Bug: #1737227
Change-Id: Iee9ba7ebfad3afbf886a5ac96ada623099d54736
2017-12-09 16:50:59 -05:00
Wes Hayutin 465fed2524 add keystone and neutron tempest plugins to default config
keystone and neutron are the only two tempest plugins
that are required to be installed by default.

Change-Id: I58a955943191045324956bd61da0652076984e8c
2017-12-06 16:15:15 +00:00
Sagi Shnaidman 062f43b7dd Configure scenario image for tempest
Tempest uses scenario image parameter for scenario tests,
configure it in tempest.conf

Change-Id: I69b7cc926a05ca5293138fd833199e485edd44d2
Closes-Bug: #1736026
2017-12-04 09:31:40 +02:00
Arx Cruz 00f5c97bd9 Adding the possibility to pass the log url to tempestmail
Tempestmail is being used in other CI that don't work like the
openstack upstream ci, and logs are stored somewhere else.
This patch allows the possibility to pass --log-url option
to tempestmail script override the default log path.

Change-Id: Iab9b448551d1a2ed59b47f91d5a9bcc204e0a703
2017-11-21 11:06:06 +01:00
Chandan Kumar 4b05e5e7b3 Updated tempest_version to 17.1.0 for Pike and 16.1.0 for ocata
* https://review.rdoproject.org/r/10476 - tempest-16.1.0 for Ocata
* https://review.rdoproject.org/r/10265 - tempest-17.1.0 for Pike

Change-Id: I0da6116799cfbd64c7b1c1dc957f12df27c75387
2017-11-13 16:02:00 +05:30
Prateek Arora 6ac97afeaf Allow removing of options from tempest conf
This patch gives the option to pass parameters to tempest to
remove certain keys while generating tempest.conf by passing
it as tempest_conf_removal.

The tempest_conf_removal is applied in the final stage and
as such overrides even if values were prevously set.

dvr is default value in tempest_conf_removal - neutron extension.
python-tempestconf gets all available neutron extensions, even if
they are not enabled in a deployment. dvr is not generally configured
so to avoid failed tests, it's removed from tempest.conf

Change-Id: I708866aa3218b2e3c25e9b47672237bc1838d760
2017-10-08 12:04:21 +00:00
Sagi Shnaidman ea3e29b540 Make image path for tempest configurable
Testing image must be configurable in tempest config scripts.
Set it default for temporary github mirror until
1713358 is resolved.
Related-Bug: #1713358

Change-Id: Idc979d60e7ed5d36646d2a9c3fd41e5f85ee15ca
2017-08-29 00:51:01 +03:00
Chandan Kumar ba0c301420 Introduced tempest_extra_config flag for tempest.conf
* tempest_extra_config will contains a dict with section.option as
  a key followed by values like that
  tempest_extra_config:
	identity.admin_v2_api: True
* The above defined values will be overriden in tempest.conf with
  the help of discover-tempest-config tool

* With this flag we can have more control over tempest.conf while
  using it in featureset files.

Change-Id: If787aaf2de0f5a243aceb510f91915db32dc48c1
2017-08-21 20:34:32 +05:30
Arx Cruz ac32662b6b Change the default name of white list file
Adding a .conf in the default name of white list file in order
to be collected by collect-logs role, since it collect all the
files with .conf extension.

Change-Id: I23799a8afe40d6a589d64e1796d7707396b37b2b
2017-08-18 16:38:43 +02:00
Alfredo Moralejo cd8e6f9254 Add required variables for pike in validate-tempest
In order to run oooq jobs for pike release, we need to add
some variables in validate-tempest:

- add version of tempest to install when using venv (not default).
  I'm setting last released version 16.1.0
- Create tests skip file for pike. I'm copying it from master under
  the assumption that known issues for master apply also to pike.

Change-Id: If73d9fff826dc13c755041752d2ce1fc3e7d4a84
2017-08-09 09:32:24 +02:00
Arx Cruz 3c5b0d839a Install openstack services tempest plugin
Since scenarios will start to run tempest, some of them requires
the installation of openstack services tempest plugin. Before, all
the plugins was being installed by default, however the tests being
executed had some conflicts and was decided to not install all at
once, but install only what is required. This patch enables this
behavior.

Change-Id: I9600024b1bd998a15d3aa2629212bdd6591c37d6
2017-08-03 12:28:20 +02:00
Jenkins 35ff99b19d Merge "Enable tempest to run with whitelist" 2017-08-03 00:44:49 +00:00
Arx Cruz 150cd76f47 Enable tempest to run with whitelist
Due to scenario jobs starting to execute a set of tempest tests, it's
good to have an option to add these tests in a white list instead
of care about the complexity that a long regex line can bring.

Change-Id: Id1ba7af48173460ef41d9b4df3db723811dc67da
2017-07-31 11:04:11 +02:00
Jenkins 5d6334a7ee Merge "Remove Mitaka release reference from validate-tempest" 2017-07-28 16:33:24 +00:00
Chandan Kumar 517ce10604 Removed obseletes params from validate-tempest role
* --isolated, and --failing options does not work
  with ostestr as these options are used with testr. Since ostestr
  is used as a universal test runner for running tempest across the
  board. If the above options got enabled by mistake it will break
  the tempest run. So removing it.

*  --load-list is replaced by whitelist-files and is taken care
  by this review: https://review.openstack.org/#/c/485252/

Change-Id: I9745fdcf592c4dc5bf3cbaf11e9e6b11e209ea77
2017-07-25 15:57:15 +05:30
Chandan Kumar fa81a9da95 Remove Mitaka release reference from validate-tempest
As Mitaka OpenStack release is now EOL, it is good time to remove
mitaka reference from validate-tempest.

Change-Id: I477b2b38bea79838093d2bd17adfea3f4e3aee11
2017-07-25 12:41:31 +05:30
Arx Cruz 9ced8ecd72 Adding real time bug verification
This patch adds a script that will check all the bugs in the
yaml skip list file which has a bugzilla or launchpad attached
and verify if the bug still open or closed. If closed, it will
remove from the skip list.
This also can generate a report showing what is still open and
what was already closed, as well as generate the skiplist in
tempest/testr format.

Change-Id: Iadd508184c350d074600316ad15f5274df87f01b
2017-07-24 07:46:41 +00:00
Arx Cruz 7425bd3c7d Set run_tempest default value to false
This patch set run_tempest default to false. and it's also part of
scenario001 tempest enablement.
All the jobs running tempest explicty set this to true in extra-vars
so default to false won't make any difference.

Change-Id: Ifc26368f4a92c537343026cea9def627ca226cfd
2017-07-18 16:14:01 +02:00
Jenkins 787da9abf8 Merge "Track the tempest resources before and after tempest run" 2017-07-15 11:47:31 +00:00