Commit Graph

430 Commits

Author SHA1 Message Date
Zuul a1a2bed19f Merge "Add *.orig to .gitignore" 2024-03-07 16:21:46 +00:00
Omer 427701e776 Add missing cleanups after octavia resources creation
In some of the tests, cleanups were missing after creating Octavia
resources.

This patch adds the missing cleanups.

Change-Id: I848e08295580709fa739df2d216dad0efd19a795
2024-02-22 03:17:47 -05:00
Takashi Kajinami d7a446897f Replace stable/yoga job by stable/2023.2 job
The stable/2023.2 release was already created so we should start
testing it. Also stable/yoga already passed the end of its extended
maintenace phase and is no longer supported by latest tempst.

Change-Id: If54ec0211e7467583690144fdf450f89e06987fc
2024-02-06 17:03:59 +09:00
Zuul ffc51f76b2 Merge "Drop implementation to use pyOpenSSL to manage pkcs12 certs" 2024-01-19 18:34:26 +00:00
Zuul 19b90e9271 Merge "Add SCTP protocol listener api tests" 2023-12-05 13:39:44 +00:00
Takashi Kajinami 25872b36de Drop implementation to use pyOpenSSL to manage pkcs12 certs
The cryptography library has been bumped to 3.1 in upper-constraints
file during Ussuri, which is quite old. So we no longer have to
maintain logic for cryptography < 3.0.

Change-Id: I1a463e320b94b0e99e92541581e1ee5feffd356a
2023-11-06 23:26:15 +09:00
Zuul 5b2eca40a8 Merge "Update the README file to use tox -e all" 2023-10-19 15:45:45 +00:00
Zuul d7ddf4d785 Merge "Fix Zuul warnings" 2023-10-04 18:18:19 +00:00
Gregory Thiemonge bacca66926 Fixed typo in override-checkout branch for stable/2023.1
Change-Id: I61e431a7310d160daa1ba4728d8b4ae14cd18d29
2023-09-12 20:45:58 +02:00
Gregory Thiemonge 77424e6095 Fix Zuul warnings
Change the format of negative regexps
Zuul now reports a

invalid perl operator: (?!

warning

Change-Id: I094a31be5acd3db18b75ffe9ecaee3d924a00cca
2023-09-06 09:26:54 +02:00
Gregory Thiemonge 3c44d1cb9b Remove xena and wallaby jobs from the gates
It also cleans up some old stable branches jobs and the centos-8-stream
job.

Change-Id: I30c840a9981c5c9765fa2a9100e87efd7fd70521
2023-07-11 22:13:47 +02:00
Gregory Thiemonge ece5ab4369 Add SCTP protocol listener api tests
Story: 2007884
Task: 41174

Change-Id: I090045a0eac39cb64f0373f932e7b42640ee5ad9
2023-07-11 08:48:53 -04:00
Ghanshyam Mann 63b5c60964 Add stable/2023.1 jobs on master gate
As 2023.1 is released, we should add its job on master
gate to keep branchless tempest plugins compatible
to stable branch.

Ref: Tempest plugins guide for stable branch testing:
- https://docs.openstack.org/tempest/latest/stable_branch_testing_policy.html

Change-Id: Ia8f73e9fa07cbfaea5024047c650dfe5ca747420
2023-06-09 02:25:34 -05:00
Gregory Thiemonge c45b5546e4 Adding jobs for stable/zed
Change-Id: Id851d5a5388e290770c617267daa9fdd0a50dae6
2023-06-09 02:16:32 -05:00
Gregory Thiemonge b9af9163cb Splitting scenario jobs in 2 jobs
Each scenario job is splitted in scenario-traffic-ops and
scenario-non-traffic-ops jobs to avoid possible TIMEOUT in the CI.

Change-Id: Ib8af2af6696b27879eb923793959837646469905
2023-05-10 09:40:38 +02:00
Gregory Thiemonge 07909503b0 Fix jobs running on Jammy vs. Focal vs. Bionic nodes
Because octavia-tempest-plugin is branchless, job definitions need to
work for all octavia branches >=wallaby. Older branches should not use
the definitions from current master.

Change-Id: Ic76288560086d225fa59aee399cd75ae4c459559
2023-05-09 17:17:23 +02:00
Zuul e82bb6741f Merge "Updating Octavia tempest jobs on Ubuntu jammy (22.04)" 2023-05-06 01:30:17 +00:00
Zuul e7f794e685 Merge "Add h2 traffic/scenario test" 2023-05-03 10:28:27 +00:00
Tom Weininger da06895326 Updating Octavia tempest jobs on Ubuntu jammy (22.04)
Update nodeset to use Jammy nodes.

stable branches are pinned to the focal node pool.

Change-Id: I3faf27a64429ca4a078f96649aafac584cba0b9a
2023-04-27 19:33:21 +02:00
Zuul 8a6e50424a Merge "Fix the pool client auth test" 2023-04-13 05:39:07 +00:00
Gregory Thiemonge d698a18781 Fix request interval in _wait_for_lb_functional
The request_interval parameter is passed to the _wait_for_lb_functional
function but it wasn't used in the function.
Now the function sleeps for request_interval sec for each iteration of
the loop.
It mitigates some random failures with the TCP listener +
least_connection lb_algorithm tests that require a specific delay
between the requests [0]

[0] https://opendev.org/openstack/octavia-tempest-plugin/src/branch/master/octavia_tempest_plugin/tests/scenario/v2/test_traffic_ops.py#L854

Change-Id: Idf0a9fb71178abea732748f92f01eed5a55a3228
2023-04-06 09:50:42 +02:00
Zuul cbda95e727 Merge "Spliting centos scenario job into 2 jobs" 2023-03-28 16:03:37 +00:00
Michael Johnson 554873fc00 Fix the pool client auth test
There was an intermittent test failure in the
test_pool_reencryption_client_authentication test where members are detected
as unbalanced. This was due to the time it takes for the health monitor to
bring the member back into the pool.
This change adds a waiter for the members to go operating_status ONLINE before
checking for balanced member requests.

Story: 2010660
Task: 47710
Change-Id: Ibb1f351c77f3ed7a0c69c8295973f77ab2069dad
2023-03-24 21:25:05 +00:00
Michael Johnson 6dac8ff58f Update Octavia tempest tests for no scoped tokens
There has been a direction change in the "secure-RBAC" goal and scoped
tokens are no longer being implemented[1].
The Octavia tempest tests were updated for the new keystone roles and
scoped tokens at the same time with an (bad) assumption that they would be
turned on at the same time.
This patch updates the Octavia tempest plugin to not assume that scoped
tokens are in use when the RBAC type is set to keystone_default_roles.

[1] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html#direction-change

Depends-On: https://review.opendev.org/c/openstack/octavia/+/877433
Change-Id: Ia1c4ca0b675d39bd43640184d6d3deba823fd3f6
2023-03-14 23:21:51 +00:00
Zuul 5b73479a4d Merge "Reduce the number of load balancers in PoolAPITest" 2023-03-03 13:13:20 +00:00
Michael Johnson 73c703e2ca Update the README file to use tox -e all
This patch updates the README file to have instructions for running the tempest tests using the "all" environment instead of "all-plugins". The "all-plugins" environment has been deprecated for years and uses site-packages, which may cause unintended test scenarios.

Change-Id: I297babd2e97ad146f60f32ae9073e47a62973860
2023-02-28 18:15:58 +00:00
Gregory Thiemonge fb04e6ea97 Fix legacy admin in RBAC tests
The legacy admin continues to work as it is with the sRBAC [0]
if os_system_admin is allowed, os_admin should be allowed.

[0] https://governance.openstack.org/tc/goals/selected/\
    consistent-and-secure-rbac.html\#legacy-admin-continues-to-work-as-it-is

Depends-On: https://review.opendev.org/c/openstack/octavia/+/875620

Change-Id: I10d497a4b4e3a3b21cb24dba73d5074a71a3d381
2023-02-28 07:39:53 -05:00
Gregory Thiemonge 7664549b8c Spliting centos scenario job into 2 jobs
The duration of the c9s scenario job is really close to the max timeout
in Zuul, spliting it into 2 jobs would reduce the duration of the tests
and would avoid possible timeouts.

Change-Id: I3b70171624e5c42fd6055d73a040704af5910944
2023-02-28 09:07:55 +01:00
Omer 6590e6e6ee Add h2 traffic/scenario test
This patch adds a test where we test both h2 and HTTP traffic on the
same load balancer.

For this purpose, we deploy an HTTP listener, a TERMINATED_HTTPS
listener with h2 alpn protocols, and an HTTP pool with h2 alpn protocol
and backend re-encryption.

Change-Id: I470268c91cce18a00baf3fb1f721299bf4662e13
2023-02-21 12:55:00 +01:00
Michael Johnson 9e9f526d65 Add "member" role to non-admin test credentials
Some services are enabling "new defaults" RBAC by default. This will require all non-admin users to have either the "member" or "reader" role. This patch updates the Octavia tempest plugin to include the "member" role in test credentials when the tempest plugin is configured for "RBAC_test_type" other than owner-or-admin.

Change-Id: I8aadb98d438943b18a8d72ff54e216930cfd3ccc
2023-01-18 18:02:06 +00:00
Zuul f1061176af Merge "Make user role logging optional" 2023-01-09 11:13:05 +00:00
Zuul a98cd8787e Merge "Remove skip flag for tests skipped due to inactive bug" 2023-01-04 12:56:52 +00:00
Bas de Bruijne 530a88a434 Make user role logging optional
Not in every cloud does tempest have permissions to list the
role assignments. Since it is not critial for running the tests,
the logging of the user roles should be configurable.

Change-Id: I8aea2b597b9dd9bbdc5a1527fae03e86364aab4c
2023-01-03 17:41:29 +00:00
Tom Weininger 577953114e tox skipsdist seems to be problematic
Depends-On: https://review.opendev.org/c/openstack/tempest/+/868527
Change-Id: I293a52fe12972594690970b7d3bd91782b642669
2022-12-29 16:20:27 +01:00
Zuul dddf6515ab Merge "Add scenario test for Prometheus over TLS" 2022-12-02 19:05:24 +00:00
Zuul ceb813668e Merge "API and scenario tests for PROMETHEUS listeners." 2022-11-24 21:28:32 +00:00
Zuul 115cfa1e8e Merge "Pin barbican-tempest-plugin to version 1.6.0" 2022-11-23 18:28:38 +00:00
Michael Johnson 4a61eeb5de Add scenario test for Prometheus over TLS
This patch adds a scenario test for Prometheus listeners using TLS with
client authentication.

Change-Id: Idc68a6fb0423d7682be861429d8e09f3d8b24771
2022-11-21 23:44:27 +00:00
Michael Johnson 8646e5ae97 API and scenario tests for PROMETHEUS listeners.
This patch adds API and scenario tests for PROMETHEUS listeners. This
includes scenario tests that connect to the metrics endpoint.

Depends-On: https://review.opendev.org/c/openstack/octavia/+/812258
Change-Id: Ia46d8c0967bc5b0f7cd11b6e3ca3a4e03c0bc138
2022-11-21 23:29:13 +00:00
Tom Weininger 295576db04 Pin barbican-tempest-plugin to version 1.6.0
This version is the last that one that supports Python 3.6, which is the
version Ussuri uses.

Change-Id: I3da638eb97939186b923a5854f2ea260b61953e8
2022-11-17 17:28:25 +01:00
Zuul c6da8f6345 Merge "Adding 2 traffic based test cases." 2022-11-17 14:34:38 +00:00
Lukáš Piwowarski 5aa216efc7 Remove skip flag for tests skipped due to inactive bug
Several tests are skipped because of story 2007979 [1] even though it
seems that the bug tracked by the story has already been resolved.

This patch removes the skip flag for these tests as the bug has already
been resolved.

[1] https://storyboard.openstack.org/#!/story/2007979

Change-Id: Ibec0bf4fba52a32dd1c9980c5d6bd7afc35d81a3
2022-11-15 17:40:00 +01:00
Tom Weininger 4b2da54bdf Add *.orig to .gitignore
Change-Id: I8edb50e13d17e30d0eb3d51dc39590f473a84fff
2022-09-29 10:17:05 +02:00
Michael Johnson 031ecca513 Adds a pool client authentication scenario test
This patch adds a pool client authentication scenario test that uses
test servers that require client authentication.

Change-Id: Id5b200954cdf02280d31ed910012a1591a2d2697
2022-09-22 18:57:35 +00:00
Zuul 17902190af Merge "Add ALPN support to the pools service client" 2022-09-22 18:24:41 +00:00
Zuul 5486b8af92 Merge "Bump tox minversion to 3.18.0" 2022-09-12 14:15:01 +00:00
Zuul b6fe3c6884 Merge "Spliting member API tests in 2 classes" 2022-09-12 14:14:59 +00:00
Zuul 27152e3430 Merge "Update c9s job with new ssh key type" 2022-08-09 15:33:07 +00:00
Arkady Shtempler a186f060a0 Adding 2 traffic based test cases.
1) test_udp_update_pool_healthmonitor_listener
   Traffic should PASS after updating any of LB's components.

2) test_hm_op_status_changed_as_expected_on_update
   Update health monitor with various combinations of:
   HTTP method, expected HTTP status codes and backend URL.
   Validate that members' operation status is getting into
   appropriate state on each update.

Change-Id: Ie80378ac1a96941eefa905fd6f49c8fa7e9c3692
2022-08-02 11:22:06 +03:00
Zuul a753173a10 Merge "Remove install unnecessary packages" 2022-07-25 10:30:13 +00:00