Commit Graph

89 Commits

Author SHA1 Message Date
Ghanshyam Mann 72ea117f61 Retire Tripleo: remove repo content
TripleO project is retiring
- https://review.opendev.org/c/openstack/governance/+/905145

this commit remove the content of this project repo

Change-Id: Ic549bdcc76a5e12a0104143fbe79fd0db2c866b0
2024-02-24 11:44:35 -08:00
Takashi Kajinami 80c6f8b006 validate: Remove logic for unsupported old releases
This change removes logic for releases older than train, because these
releases are already EOLed. This covers only tempest roles and
playbooks.

Change-Id: I0b50cad30107a83b562b8c22b2afd7af7636c615
2022-10-25 17:16:18 +09:00
Martin Kopec af7de12aba python-tempestconf moved from osf/ to openinfra
python-tempestconf project got moved from osf/ namespace into
openinfra/one by:
https://review.opendev.org/c/openstack/project-config/+/808479
This commit reflects that.

Change-Id: I69c592cc4e17cd4ac8cbfeb4e9a03986cd4456a9
2021-10-18 11:04:00 +00:00
Sagi Shnaidman 5ee5804655 Skip mail send from tempest
Make validate_tempest send mail only when it's configured so.
It's used in queens, on recent branches we use os_tempest.
Change-Id: Id0d57b3f78b51f756f5ca4d5c1fcf60452bbcc16
2020-11-24 11:14:53 +00:00
Andreas Jaeger 2322ebce7c Fix tempestconf URL
Change I02ac67e333cc1a5133269bd8562f18a8d50bb036 renamed
openstack/python-tempestconf to osf/python-tempestconf. Update use in
this repository.

TripleO team: Please check whether this needs backporting and
do the backporting yourself.

Depends-On: https://review.opendev.org/#/c/735890/
Change-Id: I5221ea1324cf6dfbfd48153f6a99a396c36c042a
2020-07-08 07:22:44 +00:00
Sorin Sbarnea 8b2e5653e4 lint: fixed ansible-lint 301 rule
Change-Id: I8ce7e11cd6027b53f1112c5880a5891c778db9d4
2020-01-05 19:37:09 +00:00
Sorin Sbarnea 16649df878 lint: bumping to latest versions
- run `pre-commit autoupdate` and fixed new issues
- adopted newer pre-commit config for ansible-lint 4.2.0+
- fixed some reported broken rules
- temporary disabled few rules, just to contain the size of of review,
  planning to drop/fix them in follow-ups.

Change-Id: I807ba4e919527be56c85ec72d0f4c7148f04e994
2020-01-05 19:36:36 +00:00
Sorin Sbarnea 1c6b947bf2 ansible-lint: removed skip of 206
- Fixes 206 errors and removed the skip.
- Also replaces revision with latest tag (pushed today)

Bug: https://bugs.launchpad.net/tripleo/+bug/1848512
Change-Id: I69d75ba9de8ab0e91eb45fd4f9febfdb28cdcb3a
2019-10-25 17:15:40 +01:00
OpenDev Sysadmins db85f97e1d OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:42:23 +00:00
Arx Cruz 1ed9b910ff Changing the way you copy tempest data to shell
The copy module look for a directory or file locally, and copy to remote
machine. In upstream, this code works, because we run quickstart in the
undercloud machine. However, if you're running quickstart on a different
machine, it will try to search locally for /var/lib/tempestdata, which
doesn't exist. Use remote_src doesn't work for recursive directory. The
other option was to use synchronize but it's very slow for recursive
directories. The best option is to use command to copy locally.

https://tree.taiga.io/project/tripleo-ci-board/issue/836?kanban-status=2027734

Change-Id: I589241e657178909b115fcfdca907ac16dc79b71
Closes-Bug: 1819440
2019-03-19 15:48:46 +01:00
Arx Cruz a4b1340a1c Fix containerized tempest logic
We weren't testing containerized tempest in standalone job due the
missing logic on tempest-setup.sh script. This patch adds the logic for
when containerized tempest runs in standalone, copying the clouds.yaml
file instead of the stackrc/undercloudrc and also maintain the logic
when you execute tempest in the ovb, copying the rc file.
This also ensures that /var/lib/tempestdata and /var/log/tempest
directories exists in order to not fail the execution of containerized
tempest.

https://tree.taiga.io/project/tripleo-ci-board/issue/836

Depends-On: https://review.openstack.org/#/c/643212/
Change-Id: I90204150085a1c9b943f9e054c0420a8a5e66538
Related-Bug: 1819440
2019-03-15 10:34:40 +01:00
Chandan Kumar cd7bb9bc8a Fix tempest container post logging
Currently when podman tempest container tempest tests fails, it
stores the exit status as fail and exit the run_tempest.sh script
leading to not copying the stuff from tempest container to host.

It decouples the step of copying and managing permission for tempest
post log processing and run only when tempest run finishes with in
a container.

https://tree.taiga.io/project/tripleo-ci-board/task/819

Change-Id: I9c7f97f3aa97c0ea061ba6aeb125501bf3a1adbf
2019-03-07 10:37:46 +00:00
Chandan Kumar 36f51a1b42 Mount required files for running novajoin tempest tests
In order to run novajoin tempest tests for testing tls in tempest
container we need to mount ipa related files and export
KRB5_CLIENT_KTNAME within tempest container so that novajoin
tempest plugin ipaclient can access those and help to run tempest
tests.

Copy tls related files in pre-tempest phase.

https://tree.taiga.io/project/tripleo-ci-board/us/670

Change-Id: I105d7839a3cdbf6e69d006fc588fb7d13e4e3a03
2019-03-05 21:45:42 +05:30
Zuul c4bc379649 Merge "Remove double quote from tempestconf" 2019-02-12 11:55:17 +00:00
Honza Pokorny c39655fe07 Remove double quote from tempestconf
In tempest-venv, there is a space in the tempestconf command which results in a
double spacing issue in the final tempest-setup.sh file.

It looks like this:

export TEMPESTCONF=""/home/zuul/tempest_git/tools/with_venv.sh discover-tempest-config"
"

This patch removes the outer quote.

Change-Id: I690191f9abbad5f35063f57d53eb209332f30f15
2019-01-25 13:18:44 -04:00
Honza Pokorny 8cfab9f86b Fix tempest init path in tempest-venv
Change-Id: I6665540e139efb027bd28f629152da09f0340685
2019-01-25 10:25:15 -04:00
Sorin Sbarnea dd97585614 Makes tempest sendmail failure easier to track
This task can fail with various errors and this change enables us
to spot its failure with a single LogStash query.

In order to avoid false positive string match when bash is using verbose
more we encoded the W char in the source, so a string match would happen
only when printed and not on the source code.

Change-Id: Icbb7f71aba2e9d2a4cf4e4c07f953fe3613e6707
Partial-Bug: 1806495
2019-01-02 12:23:09 +00:00
Zuul e9ac7a3c44 Merge "Added support for installing tempest plugins from git" 2018-12-27 16:54:10 +00:00
Quique Llorente ccca64f523 Install correct python version packages at tempest
The role validate-tempest was installing python- for f28 we need to
install python3 packages.

used/needed by https://review.openstack.org/618056

Story: https://tree.taiga.io/project/tripleo-ci-board/task/375

Change-Id: Iad3dde61173140321ede8f3549e01163cb4f4b41
2018-12-26 12:47:08 +01:00
Chandan Kumar 881d16fb42 Added support for installing tempest plugins from git
In order to use it, in any FS, set tempest_format to venv
and then set:
tempest_plugins_venv:
  - '<complete upstream openstack tempest plugin git url>'

Change-Id: I95a4449ca3976a914faf1ba5f3f4c0e756a6fefc
2018-12-24 10:49:42 +05:30
Sorin Sbarnea 72141b7fab Adopt yamllint strict linting
Upgrades yamllint to latest version and adots use of its strict
checking.

Fix all known problems reported by yamllint so we don't have to do
that while touching these files.

Change-Id: I4bdc520d9e2aff086c4b463718bc1e053261a4f5
Story: https://tree.taiga.io/project/tripleo-ci-board/task/381
2018-11-26 12:37:21 +00:00
Zuul 7fcb5c2801 Merge "Adapt code to newer code style (linters)" 2018-11-20 06:34:00 +00:00
Sorin Sbarnea cc82349363 Adapt code to newer code style (linters)
Makes those files conformant with current linting rules and avoids
linting errors when we need to toch them again.

Previous doing "pre-commit run -a" uncovered these errors, now is no
longer reporting any other errors.

Change-Id: Ie4cf229c8f11c2b55b323eac23c89483b26d3781
2018-11-16 12:42:51 +00:00
Sorin Sbarnea 46c0b497c9 Replace yum with package on validate-tempest
Change-Id: Ic1792e98aa825f9b87df10e1da1077df373af63a
Story: https://tree.taiga.io/project/tripleo-ci-board/task/374
2018-11-16 12:30:33 +00:00
Zuul 632ac5c308 Merge "Add podman support to validate-tempest role" 2018-11-08 07:49:15 +00:00
Chandan Kumar 2d255d14f8 Add podman support to validate-tempest role
* https://review.openstack.org/#/c/600517 introduces undercloud_container_cli
  to choose docker/podman container runtime. This changes introduces to use
  both docker/podman for running tempest tests.
* Tempest user does not have permission to create tempest workspace let's
  create the tempest workspace and own it with the tempest user.
* Introducing tempest_data directory to keep tempest related data
  which can be used by tempestconf and tempest run to tests
* Cleaned up stuff which is not necessary for tempest container.

Depends-On: https://review.openstack.org/#/c/614664/

Change-Id: I1b19b2580d1d4c9844e9221f18b23655b36b5a23
2018-11-06 15:41:48 +05:30
Sorin Sbarnea 04585eb6f4 Use dnf and python3 on platforms where these are default
Roles do not need to make any assumptions about having some facts
already gathered, thus at start they should assure they gather any
missiong facts that are used inside the role.

Change-Id: I49fd1a0c070d96aecb880164acde490c9e7c95ef
Story: https://tree.taiga.io/project/tripleo-ci-board/task/153
Depends-On: https://review.openstack.org/#/c/615489/
2018-11-05 15:58:33 +00:00
Zuul fd7133a3c4 Merge "Fix pip installation" 2018-10-30 22:17:12 +00:00
Zuul ec56badbb9 Merge "Don't install setuptools/pip/virtualenv from RPMs" 2018-10-29 22:47:13 +00:00
Arx Cruz f02176b27f Fix pip installation
We don't need to have pip installed with easy_install because virtualenv
will install their own pip locally.

Change-Id: I1d469a685e59447bc2cad78031eeabd8f4fcd617
Closes-Bug: 1797931
2018-10-29 18:13:25 +00:00
Quique Llorente 3588ffbb7b Don't install setuptools/pip/virtualenv from RPMs
Openstack infra has them already installed and we are not supose to
install it, for example at fedora the exclude them explitcitly from the
dnf.conf

Change-Id: I3b276e159ff7534777219975995fc20c967d0e42
Store: https://tree.taiga.io/project/tripleo-ci-board/task/248?kanban-status=1447275
2018-10-25 11:54:12 +00:00
Chandan Kumar 107a4f913a Fixed stackviz report for standalone
* When Moving 'stackviz to /var/log/extra/stackviz' task is called,
  /var/log/extra/stackviz directory does not exist which leads to
  failure giving no such directory in order to fix that we need
  to check whether destination exists or not. If not first create
  it and then move the content and also make sure stackviz-export
  operation has successfully completed.

Change-Id: Ie84c150c74363da25e76bbb234a864a72c6c366a
2018-10-24 14:57:56 +00:00
Arx Cruz 9db2de54ff Fix stackviz and subunit2html report generation
This is a better way to install and run stackviz, also removing some
tasks that's no longer necessary:
* Remove stackviz static files from the repo, since it's already in the
tarball
* Remove stackviz cloning, and using tarball
* Install stackviz directly from pip module
* Removing tempest-status.yml since we don't use to anything
* Move tempest-results.yml to run before stackviz, so we can take
advantage of the testrepository.subunit file to generate stackviz data
* Use testrepository.subunit to generate subunit2html report instead
of stestr/testr stream

Closes-Bug: 1779562
Change-Id: I918e5401b4f46e947bbaca99a48c2b21bce9a4bd
2018-10-12 17:02:00 +00:00
Chandan Kumar da4fc17d58 Fix tempest related files permissions for tempest container
* https://review.openstack.org/#/c/583940/ added tempest user with
  tempest container to fix tempest init log issue and it broke the
  container as all the directory with in tempest container and files
  getting mounted from host have different permision. It fixes the
  same.

* It moves all the tempest related files to tempest_data dir and then
  mount the same to tempest container by changing dir permission if
  tempest user is present else run the docker run as it is.

* Moving tempest dir creation step under container shell script

Change-Id: I9696b490e5d4646044de5258c676a357ee2779bb
Closes-Bug: #1783055
Depends-On: I20f04e8b821058a89a5464c9be1bb14d30f1f223
2018-07-25 23:56:06 +00:00
Chandan Kumar 885ee1707d use upstream git url instead of github
* It changes the git url of python-tempestconf and tempest
  and list files to make sure directory get clonned.

Change-Id: I82ea378ac5da93e65db44613404965566903a89f
2018-07-16 16:51:28 +05:30
Chandan Kumar c570dd05e2 Enable tempest.log in /var/log/tempest for container
* In CI, when tempest container is used, It is good to dump the
  logs in /var/log/tempest so that it would be easier to verify
  tempest container is used.
* Introduced tempest_log_dir and tempest_log_file var to the
  validate-tempest-playbook

Depends-On: https://review.openstack.org/#/c/566364/

Change-Id: Ifd72d902c623b3941a6c714e36b7cf104109a570
2018-05-17 13:08:03 +05:30
Zuul 39457c3ed5 Merge "tempest: gen the JUNIT out from subunit v2 file" 2018-05-08 10:20:13 +00:00
Zuul a77c76e689 Merge "Install python-os-testr for subunit2html" 2018-05-03 19:23:22 +00:00
Chandan Kumar c243c1461d Install python-os-testr for subunit2html
* subunit2html is provided by python-os-testr and os-testr package is not
  available on undercloud which leads to failure to subunit2html command
  not found in tempest log.
* The above fixes the issue.

Change-Id: Id3c7688f97f1986514fb431ffc26e87a44341d7d
2018-05-02 12:44:28 +05:30
Zuul 84902bca5b Merge "Moving installation of tempest plugins to tempest-rpm file" 2018-05-02 00:15:27 +00:00
Zuul 82479b4fd3 Merge "Add ansible linter rule for set pipefail" 2018-05-01 09:25:07 +00:00
Arx Cruz 9f9386507b Moving installation of tempest plugins to tempest-rpm file
These packages are only needed when tempest_format is packages,
since the containerized tempest already have all the packages
installed in the docker image, let's save a few seconds here.

Change-Id: Id107ffc2f86ad0771658e77fb9e7c0aa84625005
2018-04-30 16:00:52 +00:00
Zuul 5e5a0eb462 Merge "Rename test_regex to test_white_regex with deprecation" 2018-04-30 12:52:35 +00:00
Sagi Shnaidman 69ad943add Add ansible linter rule for set pipefail
When using pipes in ansible shell module we can miss the error
because shell is executing without pipefail by default.
This rule will check every shell module if it has "set -e pipefail"
and will fail in case if not.
It excludes tasks which have 'ignore_errors: true' or register
variables.

Change-Id: I394c72040d62dff76180aeb9d703bb8a212bcc98
2018-04-26 21:32:24 +03:00
Chandan Kumae 6cff46c53b Rename test_regex to test_white_regex with deprecation
* https://review.openstack.org/551441 introduced test_black_regex
  in order to skip test directly from featureset files. In order
  to avoid confusion between test_regex and test_black_regex,
  we are renaming test_regex to test_white_regex.

* Added deprecation message for the same.

Change-Id: I7e6240117c9fbab0e51d6248d74180c7a91dc9e2
2018-04-26 04:56:59 +00:00
Arx Cruz f898aa28a2 Install stestr only when release is pike or newer
The stestr package was introduced on pike, so in order to not break the
ocata jobs, adding a conditional to not install if it's ocata release.
Also added conditional for newton just for compatibility

Change-Id: If134720ad00925b25cea0fb0d98e7833fe8e24ac
2018-04-24 14:18:07 +02:00
Arx Cruz b16a3afde9 Fixing stackviz generation
Stackviz is failing in multinode container because tempest runs as root,
so all the result files are created with root as owner, so when stackviz
tries to access these files, got a permission error. This patch set the
owner back to undercloud_user for tempest directory

Change-Id: Ia3b3dd4688a8d20c3750d299136211acc5a5db82
2018-04-19 13:49:29 +02:00
Chandan Kumae 7f68348ee7 Fixed tempestconf directory for newton
* https://review.openstack.org/#/c/551441/ refactored the whole
  validate-tempest role. It introduced a regression at few places.
  It fixes the path of tempestconf directory to use tempest_dir.

Change-Id: I69deba467157ad2134616aacec4368a5d0f5b92e
2018-04-16 16:10:00 +05:30
Gonéri Le Bouder 3673896a9e
tempest: gen the JUNIT out from subunit v2 file
Always uses the result file in the format 2 to generate the final JUNIT
file. The file works fine in all cases and this allow us to simplify the
logic. Tested on OSP9 and OSP10.

Change-Id: I6ac64fc6f9a574475984ebfec174d691a3504cbb
2018-04-11 18:26:16 -04:00
Chandan Kumar de5dd4cc17 Refactored validate-tempest role for undercloud and containers
* Introduced new workflow for validate-tempest role
- Remove previously created tempest artifacts
- Install tempest
- Create tempest workspace
- Create tempest resources
- Generate tempest configurations
- Run tempest
- Removed unused ironic undercloud fake services
- Removing public network from undercloud as there is no public network
- Added tempest_dir var to give path to tempest workspace
- use {{ working_dir }}/tempest_git for clonning stuff
- Added test_black_regex to skip a series of tests
- Fixed permission issue for tempest_dir to generate subunit files
- Install stestr subunit-filters and subunit for generating subunit files
- Added tempest_skip_master containing skip list for undercloud
- Introduced tempest_conf_version for installing particular version of
  tempestconf from git
- Enable set -e to find the exit status of command running inside
  container

Change-Id: I021432e222fae0e57a13ca4859ba77e990ac6c67
2018-04-10 10:00:49 +00:00