Commit Graph

1290 Commits

Author SHA1 Message Date
Ghanshyam Mann b540700061 Retire patrole
Patrole project is not active anymore and its gate is broken.
We waited for couple of cycle to see if there is any interest
in this project and anyone can maintain it. But we did not get any
new maintainers and current QA team does not have bandwidth/interest
to continue maintaining it.

This project was for RBAc testing which is moving towards unit/functional
tests on service side as well as tempest plugins tests.

In QA 2023.2 PTG, we decided to retire this project

- https://etherpad.opendev.org/p/qa-bobcat-ptg

Change-Id: I7721cf06104e5871ec27cdd87d4608dace60a8b7
2023-04-10 22:29:00 -05:00
Zuul aa7bc0dd9a Merge "Add cleanup for test_show_auto_allocated_topology test" 2022-04-25 07:46:36 +00:00
Ritchie, Frank (fr801x) f7d47d9c44 Update tempest to 30.0.0
This PS updates Tempest to 30.0.0. Due to

55414580c2

some refactoring was required around wait_for_interface_detach.

Additionally, the variables:

min_microversion
max_microversion

needed to be renamed to:

volume_min_microversion
volume_max_microversion

for volume related tests. See:

https://review.opendev.org/c/openstack/tempest/+/813676

Change-Id: Ie2183fdd2812d5d2fdfdc0815bf96e5c47a9f1e8
2022-04-01 16:46:31 -04:00
Ghanshyam Mann 7ce2d1472e Add releasenote to tag the Patrole for Yoga release
This commit adds the releasenote to tag Patrole for Yoga
release.

Change-Id: I52701cc3ec3b5c89d786dbd2e6e911114c203dd0
2022-03-02 10:27:42 -06:00
Lukas Piwowarski 4769f92f6b Add cleanup for test_show_auto_allocated_topology test
This patch makes sure that test_show_auto_allocated_topology
deletes resources that are created during its execution.

Before, the test didn't clean the following resources:
- network: auto_allocated_network
- subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6
- router: auto_allocated_router

Story: 2007941
Task: 40406
Change-Id: I8cc77f7d47918d8329298ee32733d569294f11b7
2021-11-03 11:18:22 +01:00
Martin Kopec fa0ee13512 Switch testing to Yoga testing runtime
Upating the tetsing template to Yoga testing runtime:
https://governance.openstack.org/tc/reference/runtimes/yoga.html

Change-Id: I800e6f273412671239eabd7d5e86b5ba7acd3745
2021-10-07 08:48:51 +00:00
Zuul 07a8a7cf0a Merge "Use py3 as the default runtime for tox" 2021-09-29 03:19:33 +00:00
Ghanshyam Mann 7304b7c8d5 Add stable/wallaby job on master gate
stable/wallaby is not supported stable branch and
we are in Xena cycle development so adding wallaby
job on master so that we keep testing branchless
Patrole for all maintained stable branches.

Change-Id: If7106cdff4dbf30b549bf9e5e4fddf1ed5156070
2021-09-23 14:14:47 +00:00
Ghanshyam Mann c341f4228d Move to Xena testing runtime template
Change-Id: Ifa54e4b7b809ce2b9c1652557aa50181a5639307
2021-09-23 14:14:42 +00:00
Ghanshyam Mann 57ffb341cf Remove stable/train job
stable/train is in EM state and master patrole
does not support it, this commit removing
the stable/train job from master gate.

Change-Id: If43d5ae46c99b1170e76e72a70b81559f2d36fc1
2021-09-23 14:14:23 +00:00
Ghanshyam Mann 588c33d6d7 [Fix gate]: Cinder policy change handling in tests
Cinder policies are made more granular and now we need
to adjust the patrole tests to handle those changed policies.

This commit introduces a new flag so that we test the old
policies in stable branches and new one in Xena onwards.

Change-Id: I4be60e3e92704f8e55d3acdb0e025078ae5b21f1
2021-09-21 22:38:37 +00:00
Ghanshyam Mann f304d7aaac Add release notes page for version 0.13.0
Patrole 0.13.0 has been released and this
commit adds a new page for 0.13.0 release notes.

Change-Id: Ib4975ffdc37ca9b347d241b652a165c427ba3821
2021-09-13 10:48:26 -05:00
Ghanshyam Mann 329f6a8dd7 Add releasenote to tag the Patrole for Xena release
This commit adds the releasenote to tag Patrole for Xena
release.

Change-Id: I9f1adc63e59581de90fea6426be665c71a9158c0
2021-09-11 00:39:08 -05:00
Ghanshyam Mann 8cac133b6a Fix gate: fix the failing network, image, volume RBAC test
1. Image update member test is failing because image owner
itself try to update the image member status but only
admin or that member can update it. Fixing this test.

2. Network tests are failing to create public network
on vxlan or so, fixing those with right parameters.

3. Volume type extra type specs is facing the race condition,
where same name specs is created for all the test which update
delete it. But still it fails so skipping this test too for now.

4. Skipping volume detach test for now, basically squashing
https://review.opendev.org/c/openstack/patrole/+/800594

Story: 2009210
Task: 43272
Story: 2009050
Task: 42820

Change-Id: I5fbcaf219d23d5c94a180c3447ca851d844e1dca
2021-09-11 03:58:10 +00:00
Zuul 82fd18ba85 Merge "setup.cfg: Replace dashes with underscores" 2021-06-02 10:07:22 +00:00
Ghanshyam Mann 1fc88fdafe Update IRC network to OFTC
Change-Id: Id5ea2ab50634156f3d190621302d74c2830b2351
2021-05-31 15:04:56 -05:00
Anand Bhat db856d2b25 setup.cfg: Replace dashes with underscores
Setuptools v54.1.0 introduces a warning that the use of dash-separated
options in 'setup.cfg' will not be supported in a future version [1].
Get ahead of the issue by replacing the dashes with underscores. Without
this, we see 'UserWarning' messages like the following on new enough
versions of setuptools:

  UserWarning: Usage of dash-separated 'description-file' will not be
  supported in future versions. Please use the underscore name
  'description_file' instead

[1] https://github.com/pypa/setuptools/commit/a2e9ae4cb

Change-Id: Icd9b8b1faa5e67e372fd411e6720f4c63f14d2bb
2021-05-28 11:32:32 +05:30
zhangboye e3a7ce27a2 Use py3 as the default runtime for tox
Moving on py3 as the default runtime for tox to avoid to update
this at each new cycle.

Change-Id: Ie18dd47beef0d15e168c3284c4cf0d3564467eff
2021-04-20 16:54:05 +08:00
Sam Kumar f4bae14ce9 Fixed issue with backup delete
1) Updated class level create_backup function to wait for resource delete
2) Switched the wait_for_resource_deletion handler before delete_backup,
   the clean_up function uses list pop() to perform cleanup. The backup
   has to be deleted before the wait_handler is called

Depends-On https://review.opendev.org/c/openstack/tempest/+/781142

https://storyboard.openstack.org/#!/story/2008683

Change-Id: I6ebc6dcb729baa775e36026081cd8bbf0d5c203f
2021-04-02 19:50:03 +00:00
Martin Kopec 43bf0d78b4 Add release notes page for version 0.12.0
Patrole 0.12.0 has been released [1].
This commit adds a new page for 0.12.0 release notes.

[1] https://review.opendev.org/c/openstack/releases/+/783115

Change-Id: Ibbb1000d633372e2ca37b306fec3c284059905ba
2021-04-01 14:35:28 +00:00
Martin Kopec ff6c9e8815 Add release notes page for version 0.11.0
Patrole 0.11.0 has been released [1].
This commit adds a new page for 0.11.0 release notes.

[1] https://review.opendev.org/c/openstack/releases/+/767164

Change-Id: I123cf4ad83abcbf883ac33bfb376470e71dc8ae6
2021-04-01 14:34:22 +00:00
Ghanshyam Mann 54fc749ddc Add releasenote to tag the Patrole for Wallaby release
This commit adds the releasenote to tag Patrole for Wallaby
release.

Change-Id: Idf680e5749368b81de2bc6cd1e3e8d3ec88cfbd9
2021-03-25 13:36:38 -05:00
Ghanshyam Mann f64b81ed69 Fix gate for handling of deprecated rules and image client
oslo.policy has made the changes to not modify the
rule check
- https://review.opendev.org/c/openstack/oslo.policy/+/774112

Patrole code for handling the deprecated code needs to make
changes to work with latest oslo policy.

Also fix the image namespace clients to be admin which were
recently changed in Tempest side
- https://review.opendev.org/c/openstack/tempest/+/780108

Change-Id: I93d74d71a3e085ab4f08053db83354e86f3f2d14
2021-03-23 21:15:54 +00:00
tushargite96 9ec7c46562 Changed minversion in tox to 3.18.0
The patch bumps min version of tox to 3.18.0 python in order to
replace tox's whitelist_externals by allowlist_externals option:
https://github.com/tox-dev/tox/blob/master/docs/changelog.rst#v3180-2020-07-23

Change-Id: Iad89625e7514d1046e0340db96a73960a17023cf
2021-02-25 22:29:38 +05:30
Zuul 0bfba962e8 Merge "Reuse tempest to create admin client manager" 2021-01-26 02:32:36 +00:00
Zuul 7dbfe24945 Merge "Restore test user's original roles during clean up" 2021-01-26 00:27:57 +00:00
Zuul 428f6dc102 Merge "Remove the tests for unsupported Nova APIs" 2021-01-25 17:41:57 +00:00
Lingxian Kong 27f671f1a2 Reuse tempest to create admin client manager
The previous code doesn't support PreProvisionedCredentialProvider, it
was getting admin credentials from tempest config file which are not set
when using test_accounts_file.

Change-Id: Ia34d08ad659b095a114c27d6d596507f7922149a
2021-01-16 23:45:24 +13:00
Lingxian Kong b73e1088e0 Restore test user's original roles during clean up
Depends-On: https://review.opendev.org/c/openstack/patrole/+/770867
Change-Id: I965d9e280ef0a85dfe6b2e4000eb47e1d06fed77
2021-01-16 10:42:30 +13:00
Zuul cdccb47b1d Merge "Fix creating of client manager for network tests" 2021-01-15 09:51:32 +00:00
Lingxian Kong f5699576d8 Remove the tests for unsupported Nova APIs
Change-Id: Ib582c984796cbcd93fdb3a505d0b3fcdf6a2fbf2
2021-01-15 10:22:21 +13:00
Ghanshyam Mann 700c1db070 Remove stable/stein testing jobs
stable/stein is not suported in Patrole now, so
let's remove their jobs from master gate.

In order to pass the CI, the following changes are also made:
* Added skip for Nova policy
  "os_compute_api:os-admin-actions:reset_network", which was removed in
  https://review.opendev.org/c/openstack/nova/+/749315
* Removed openstack-tox-lower-constraints job for now until we have a
  solution.

Change-Id: Id73342c24342637edc37104f2112235a2edcac39
2021-01-06 10:50:47 +13:00
Ghanshyam Mann 5c466a2301 Add releasenote to tag the end of support for Stein
This relesenote also mark end of support for Stein release
in Patrole as it is in EM state[1].

[1] https://releases.openstack.org/

Change-Id: I8f7d60e8a8e1766e14b37cbcbc3649c212520d00
2020-12-14 23:57:15 +00:00
Lukas Piwowarski 65fef1de1c Fix creating of client manager for network tests
Patrole network tests fail when pre-provisioned credentials are
used (Could not find user).

This is caused by missing 'user_id' and 'tenant_id' parameters
in the client manager.

The reason why this happens only with network tests is because
when client manager from neutron_tempest_plugin is created
the set_auth() function which refills the credentials is not
called (in contrast with tempest's get_client_manager() function
where the set_auth() function is called).

This patch makes sure that client manager contains 'user_id'
and 'tenant_id' by refilling the credentials using the set_auth()
function.

Closes-Bug: 1846410
Change-Id: I01ea0da7e43923f50053d41ac069f3f913d5b728
2020-12-09 16:09:46 +00:00
Ghanshyam Mann f6d7d0f8a9 Add Patrole gate job for stable/victoria
Now we have stable/victoria branch ready for devstack
and so does for all service projects.

This commit adds the Patrole testing for stable/victoria
by adding new jobs running on stable/victoria version of
openstack.

Change-Id: Icf6a2c86b92937089f7e3af96eec5ad6b1304e8d
2020-11-17 12:37:49 -06:00
Ghanshyam Mann 1b8838f189 Fix gate: Add feature flag for nova policies removed in Wallaby
This patch set adds a new feature flag called
``removed_nova_policies_wallaby`` under the configuration
group ``[policy-feature-enabled]`` for skipping Nova
tests whose policies were removed in Wallaby. This feature flag
is currently applied to os-agents which is removed in nova
recently - https://review.opendev.org/#/c/749309

Change-Id: Iaa0ddbdca454b93bd8373ce749603f28c5c59180
2020-11-17 14:15:05 +00:00
maaoyu a1e1ddc91c Remove install unnecessary packages
The docs requirements migrated to doc/requirements.txt
we need not install things from requirements.txt.

Change-Id: I6a50c553779a2d185da1a82898541adb35130f69
2020-09-23 17:18:33 +08:00
Masayuki Igawa 99ff11fd42
Add release notes page for version 0.10.0
Patrole 0.10.0 has been released [1].
This commit adds a new page for 0.10.0 release notes.

[1] https://review.opendev.org/#/c/752785/

Change-Id: I1c26117b14d48e6bda7e8c94cd8f3f18b6f95514
2020-09-22 17:06:38 +09:00
Masayuki Igawa 782375db0a Add releasenote to tag the Patrole for Victoria release
This commit adds the releasenote to tag Patrole for Victoria
release.

Change-Id: I4b39e0f1d027c684efabb98b5cdcf9e467574b71
2020-09-18 15:05:58 +00:00
Doug Schveninger ff2fba20db Clean up tox.ini and document zuul.yaml settings
I tried to remove --sitepacakges and the gate failed
so I added comment and in the .zuul.yaml so future people
will understand why.

I Updated the tox.ini environment description so if someone
does a tox -av it will list all command supportted and a
small description of what

While dcoumenting the zuul.yaml I noticed that I made
patrole-reader a job and I feel that we should also
have it as a gate.

I also saw that extension and multi-node non-voting jobs
where missing reader versions so I added them.

Change-Id: I7b8e4c06ece6b32cab4d7238d0bc250334a3adb3
2020-09-08 23:44:07 -05:00
Doug Schveninger 89d9ff89fe Fix Extension gates by supporting Skip Execption in test case.
The test test_delete_auto_allocated_topology is the only
test in patrole that does a Skip test exception in the test_ method
so I had to add support to the rbac_rule_validation decorator
so the framework would allow the skip exception to be thrown
through the decorator and make it through to the unittest
framework as a skip. Let me know if anyone has a better
way to do this.  I am just trying to get all of the gates running.

FYI I am down to one testing in multinode that is only
supported by system scoped token in Nova so I think that
we will have to wait until tempest supports scope token and
then when patrole support them we should be able to get all
voting gate and non voting gates to work.

https://storyboard.openstack.org/#!/story/2008018

Change-Id: Id8a599c8754dfc10ffa5fa18c232a9afff180a8e
Story: 2008018
Task: 40670
2020-09-07 20:30:39 -05:00
Doug Schveninger 8746b77bfe fix patrole-multinode-member non-voting gate by skip_because a bug
the bug is due to a nova api that is allowed with a system scoped
token and patrole does not support them at this time.

https://storyboard.openstack.org/#!/story/2008051
Closes-Bug:2008051

Change-Id: I6963fdff199fca342620ab15948ce2c1d29c2c7a
2020-09-02 05:51:59 -05:00
Zuul 3ab156a545 Merge "Set admin, member and reader gates to be the same" 2020-08-28 13:17:41 +00:00
Doug Schveninger 2c80e38e7c Get the patrole gate working due to Nova category changes in Victoria
for floating IP.  per [1] the action or category has changed in Nova
on a deprecated method per [2].

Used the exisintg nova victoria conf setting to support different
action or category for the floating ip apis

[1] https://github.com/openstack/nova/blob/master/nova/policies/floating_ips.py#L21
[2] https://docs.openstack.org/api-ref/compute/#floating-ips-os-floating-ips-deprecated

Change-Id: I0318aa910eb865171afb935aaf26a97182b6f381
2020-08-24 11:33:42 -05:00
Doug Schveninger 8e3b0322b3 Set admin, member and reader gates to be the same
Since the stein train and usuri and master gates are
running successfully I am proposing to turn on all
of the gates the same and make reader voting.

Add opendev.org to project reference in .zuul.yaml.
to clean up the yaml and make it more like the
tempest .zuul.yaml.

I will do small changes overtime to clean up little
issues and test the gate changes.  Some future area are
tox clean up and looking into the multinode failures
to see if we can make them voting gates.

Removed define concurrency value to allow it to
be set according to the CPU in the VM that the
test are running.

Change-Id: Iad76ad66605a12d55afcc3561e807374ba2943f9
2020-08-18 08:01:02 -05:00
Zuul 91fd70b98a Merge "[goal] Migrate patrole jobs to focal" 2020-08-17 15:19:24 +00:00
Ghanshyam Mann 8592e58477 [goal] Migrate patrole jobs to focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

Most of the Tempest jobs will be migrate automatically once devstack
base job start running on Focal(Depends-On).

stable jobs testing stable branch needs to keep running on their supported
distro version which is bionic from stein till ussuri.

Also fixing few lower constraints.

[1] https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal.html

Change-Id: Id1799fee94071c2eaea17bc50ef2845a8489fa92
2020-08-16 21:05:48 +00:00
Doug Schveninger a5b51b6f33 Shorten Identity project name due to 64 char limit.
Removed -testproject from identity project created using
setup_test_project since rand_name it already has tempest-
in front of the name. Adding -testproject to a project
provides no additional value on a name with restricted size limit.

Also removing -test_domain and -test_update_domain sufix from
domain name since they have a 64 char limit also.

remove -IdentityCosumer from test test_oauth_consumers_rbac.py.

Our downstream tooling we replace tempest- with shorter word
and unique id to find project, global and orphaned project resources
in test and production site. This will allow us to find resource
leaks and submit upstream corrections.

Change-Id: Ic4014938c4a2dae64892954d8638f9d8d519a234
2020-08-15 17:57:30 -05:00
Ghanshyam Mann cfac16a78c Fix gate for multiple issues
1. To have mock installed for unit tests

unit tests jobs use tempest version released in pypi
which has use of mock but in recent changed mock requirement
is removed from requirements file and it end up failing.

- https://zuul.opendev.org/t/openstack/build/c3a33c501c054db9b1eecedb7d4b2c48

Let's add mock into the requirement file to be installed for unit tests
job until we bump the min version of tempest to latest.

2. Nova policy granular work
https://review.opendev.org/#/q/topic:bp/policy-defaults-refresh-deprecated-apis+(status:open+OR+status:merged)
Adding new flag to handle the policy changed in Victoria.

Depends-On: https://review.opendev.org/#/c/745158/

Change-Id: I3683cca390b44146c217ce8600f63a9894057058
2020-08-14 11:49:39 +00:00
Hervé Beraud 7a69fa081c Stop to use the __future__ module.
The __future__ module [1] was used in this context to ensure compatibility
between python 2 and python 3.

We previously dropped the support of python 2.7 [2] and now we only support
python 3 so we don't need to continue to use this module and the imports
listed below.

Imports commonly used and their related PEPs:
- `division` is related to PEP 238 [3]
- `print_function` is related to PEP 3105 [4]
- `unicode_literals` is related to PEP 3112 [5]
- `with_statement` is related to PEP 343 [6]
- `absolute_import` is related to PEP 328 [7]

[1] https://docs.python.org/3/library/__future__.html
[2] https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html
[3] https://www.python.org/dev/peps/pep-0238
[4] https://www.python.org/dev/peps/pep-3105
[5] https://www.python.org/dev/peps/pep-3112
[6] https://www.python.org/dev/peps/pep-0343
[7] https://www.python.org/dev/peps/pep-0328

Change-Id: Iccbc3087d30712f30617349268b66bb7573f7bd4
2020-06-02 20:43:06 +02:00