* Update octavia-tempest-plugin from branch 'master'
to 094f6b56f045e94c7e40366764625b510baff83a
- Add TERMINATED_HTTPS listener API tests
So far we did not have TERMINATED_HTTPS API tests in the listener API
tests (we only had scenario tests).
This patch adds the missing API tests.
Change-Id: I90b1c7c00e8642ef7d3b7af63c9bb90ba8855adb
* Update octavia-tempest-plugin from branch 'master'
to 427701e77666955407ebe615437c368ed5f2232c
- Add missing cleanups after octavia resources creation
In some of the tests, cleanups were missing after creating Octavia
resources.
This patch adds the missing cleanups.
Change-Id: I848e08295580709fa739df2d216dad0efd19a795
* Update octavia-tempest-plugin from branch 'master'
to d7a446897f9e98c98821d9e176b88f0aaa46bbe2
- Replace stable/yoga job by stable/2023.2 job
The stable/2023.2 release was already created so we should start
testing it. Also stable/yoga already passed the end of its extended
maintenace phase and is no longer supported by latest tempst.
Change-Id: If54ec0211e7467583690144fdf450f89e06987fc
* Update octavia-tempest-plugin from branch 'master'
to ffc51f76b2a9c0e6b148d360c3f8b4c712fb84ca
- Merge "Drop implementation to use pyOpenSSL to manage pkcs12 certs"
- Drop implementation to use pyOpenSSL to manage pkcs12 certs
The cryptography library has been bumped to 3.1 in upper-constraints
file during Ussuri, which is quite old. So we no longer have to
maintain logic for cryptography < 3.0.
Change-Id: I1a463e320b94b0e99e92541581e1ee5feffd356a
* Update octavia-tempest-plugin from branch 'master'
to 5b2eca40a886ec3fc7c50605925a727247993612
- Merge "Update the README file to use tox -e all"
- Update the README file to use tox -e all
This patch updates the README file to have instructions for running the tempest tests using the "all" environment instead of "all-plugins". The "all-plugins" environment has been deprecated for years and uses site-packages, which may cause unintended test scenarios.
Change-Id: I297babd2e97ad146f60f32ae9073e47a62973860
* Update octavia-tempest-plugin from branch 'master'
to d7ddf4d78515b576e88f635ff7c361f5b291f54b
- Merge "Fix Zuul warnings"
- Fix Zuul warnings
Change the format of negative regexps
Zuul now reports a
invalid perl operator: (?!
warning
Change-Id: I094a31be5acd3db18b75ffe9ecaee3d924a00cca
* Update octavia-tempest-plugin from branch 'master'
to bacca6692696a79aa57f15c2815f8db41ff6adf3
- Fixed typo in override-checkout branch for stable/2023.1
Change-Id: I61e431a7310d160daa1ba4728d8b4ae14cd18d29
* Update octavia-tempest-plugin from branch 'master'
to 3c44d1cb9b9f311b3f2396a6b8adb33895083739
- Remove xena and wallaby jobs from the gates
It also cleans up some old stable branches jobs and the centos-8-stream
job.
Change-Id: I30c840a9981c5c9765fa2a9100e87efd7fd70521
* Update octavia-tempest-plugin from branch 'master'
to 63b5c60964578d2214ab6bcaa6c9bca733239263
- Add stable/2023.1 jobs on master gate
As 2023.1 is released, we should add its job on master
gate to keep branchless tempest plugins compatible
to stable branch.
Ref: Tempest plugins guide for stable branch testing:
- https://docs.openstack.org/tempest/latest/stable_branch_testing_policy.html
Change-Id: Ia8f73e9fa07cbfaea5024047c650dfe5ca747420
* Update octavia-tempest-plugin from branch 'master'
to c45b5546e42f590556d1abbff322def7c16c4f03
- Adding jobs for stable/zed
Change-Id: Id851d5a5388e290770c617267daa9fdd0a50dae6
* Update octavia-tempest-plugin from branch 'master'
to b9af9163cb7a5277e4c72dc1becb563148f7fa1b
- Splitting scenario jobs in 2 jobs
Each scenario job is splitted in scenario-traffic-ops and
scenario-non-traffic-ops jobs to avoid possible TIMEOUT in the CI.
Change-Id: Ib8af2af6696b27879eb923793959837646469905
* Update octavia-tempest-plugin from branch 'master'
to 07909503b014ad5f62b3d3075d5b5f919674224c
- Fix jobs running on Jammy vs. Focal vs. Bionic nodes
Because octavia-tempest-plugin is branchless, job definitions need to
work for all octavia branches >=wallaby. Older branches should not use
the definitions from current master.
Change-Id: Ic76288560086d225fa59aee399cd75ae4c459559
* Update octavia-tempest-plugin from branch 'master'
to e82bb6741ff82fa8b975990a7f5dbe8d4a295c66
- Merge "Updating Octavia tempest jobs on Ubuntu jammy (22.04)"
- Updating Octavia tempest jobs on Ubuntu jammy (22.04)
Update nodeset to use Jammy nodes.
stable branches are pinned to the focal node pool.
Change-Id: I3faf27a64429ca4a078f96649aafac584cba0b9a
* Update octavia-tempest-plugin from branch 'master'
to e7f794e685c083b6b87832f6801f57d78095344b
- Merge "Add h2 traffic/scenario test"
- Add h2 traffic/scenario test
This patch adds a test where we test both h2 and HTTP traffic on the
same load balancer.
For this purpose, we deploy an HTTP listener, a TERMINATED_HTTPS
listener with h2 alpn protocols, and an HTTP pool with h2 alpn protocol
and backend re-encryption.
Change-Id: I470268c91cce18a00baf3fb1f721299bf4662e13
* Update octavia-tempest-plugin from branch 'master'
to 8a6e50424aa0482ec287367c3be596f633431a1d
- Merge "Fix the pool client auth test"
- Fix the pool client auth test
There was an intermittent test failure in the
test_pool_reencryption_client_authentication test where members are detected
as unbalanced. This was due to the time it takes for the health monitor to
bring the member back into the pool.
This change adds a waiter for the members to go operating_status ONLINE before
checking for balanced member requests.
Story: 2010660
Task: 47710
Change-Id: Ibb1f351c77f3ed7a0c69c8295973f77ab2069dad
* Update octavia-tempest-plugin from branch 'master'
to d698a18781f112fc50341d3733bdf172cae02bc8
- Fix request interval in _wait_for_lb_functional
The request_interval parameter is passed to the _wait_for_lb_functional
function but it wasn't used in the function.
Now the function sleeps for request_interval sec for each iteration of
the loop.
It mitigates some random failures with the TCP listener +
least_connection lb_algorithm tests that require a specific delay
between the requests [0]
[0] https://opendev.org/openstack/octavia-tempest-plugin/src/branch/master/octavia_tempest_plugin/tests/scenario/v2/test_traffic_ops.py#L854
Change-Id: Idf0a9fb71178abea732748f92f01eed5a55a3228
* Update octavia-tempest-plugin from branch 'master'
to cbda95e7279e3da03ced8abff040ad8e0c2a9685
- Merge "Spliting centos scenario job into 2 jobs"
- Spliting centos scenario job into 2 jobs
The duration of the c9s scenario job is really close to the max timeout
in Zuul, spliting it into 2 jobs would reduce the duration of the tests
and would avoid possible timeouts.
Change-Id: I3b70171624e5c42fd6055d73a040704af5910944
* Update octavia-tempest-plugin from branch 'master'
to 6dac8ff58f3e40b63d8aeaa91f7f1355f794a724
- Update Octavia tempest tests for no scoped tokens
There has been a direction change in the "secure-RBAC" goal and scoped
tokens are no longer being implemented[1].
The Octavia tempest tests were updated for the new keystone roles and
scoped tokens at the same time with an (bad) assumption that they would be
turned on at the same time.
This patch updates the Octavia tempest plugin to not assume that scoped
tokens are in use when the RBAC type is set to keystone_default_roles.
[1] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html#direction-change
Depends-On: https://review.opendev.org/c/openstack/octavia/+/877433
Change-Id: Ia1c4ca0b675d39bd43640184d6d3deba823fd3f6
* Update octavia-tempest-plugin from branch 'master'
to 5b73479a4dabed580c3ff2e437030145b1119c3d
- Merge "Reduce the number of load balancers in PoolAPITest"
- Reduce the number of load balancers in PoolAPITest
PoolAPITest creates a new LB in each of its test_*_pool_list functions
(~20 functions), those creations are really time consumming.
Now each test ensures that the pools are deleted on test cleanup, and
that all the test functions use the same LB that has been created in
resource_setup. It speeds up the execution of the test class (from 55min
to 35min in my dev env).
Change-Id: Idb2c45cda4a407c41d314f195af03b4c6a22da07
* Update octavia-tempest-plugin from branch 'master'
to fb04e6ea97b1f457cb0b44f4086f2ba4f67c23af
- Fix legacy admin in RBAC tests
The legacy admin continues to work as it is with the sRBAC [0]
if os_system_admin is allowed, os_admin should be allowed.
[0] https://governance.openstack.org/tc/goals/selected/\
consistent-and-secure-rbac.html\#legacy-admin-continues-to-work-as-it-is
Depends-On: https://review.opendev.org/c/openstack/octavia/+/875620
Change-Id: I10d497a4b4e3a3b21cb24dba73d5074a71a3d381
* Update octavia-tempest-plugin from branch 'master'
to 9e9f526d656b0bc33173de21df2a6d7e3662b68b
- Add "member" role to non-admin test credentials
Some services are enabling "new defaults" RBAC by default. This will require all non-admin users to have either the "member" or "reader" role. This patch updates the Octavia tempest plugin to include the "member" role in test credentials when the tempest plugin is configured for "RBAC_test_type" other than owner-or-admin.
Change-Id: I8aadb98d438943b18a8d72ff54e216930cfd3ccc
* Update octavia-tempest-plugin from branch 'master'
to f1061176af8e99129cad136506004a363fff016e
- Merge "Make user role logging optional"
- Make user role logging optional
Not in every cloud does tempest have permissions to list the
role assignments. Since it is not critial for running the tests,
the logging of the user roles should be configurable.
Change-Id: I8aea2b597b9dd9bbdc5a1527fae03e86364aab4c
* Update octavia-tempest-plugin from branch 'master'
to a98cd8787e3d9146cdf6af75221297c2b275ce1e
- Merge "Remove skip flag for tests skipped due to inactive bug"
- Remove skip flag for tests skipped due to inactive bug
Several tests are skipped because of story 2007979 [1] even though it
seems that the bug tracked by the story has already been resolved.
This patch removes the skip flag for these tests as the bug has already
been resolved.
[1] https://storyboard.openstack.org/#!/story/2007979
Change-Id: Ibec0bf4fba52a32dd1c9980c5d6bd7afc35d81a3
* Update octavia-tempest-plugin from branch 'master'
to 577953114e2fe3750c93f05fd5be0602bb06e267
- tox skipsdist seems to be problematic
Depends-On: https://review.opendev.org/c/openstack/tempest/+/868527
Change-Id: I293a52fe12972594690970b7d3bd91782b642669
* Update octavia-tempest-plugin from branch 'master'
to dddf6515ab4cec0d02255f17bb6a41660eca6289
- Merge "Add scenario test for Prometheus over TLS"
- Add scenario test for Prometheus over TLS
This patch adds a scenario test for Prometheus listeners using TLS with
client authentication.
Change-Id: Idc68a6fb0423d7682be861429d8e09f3d8b24771
* Update octavia-tempest-plugin from branch 'master'
to ceb813668e618bcaf7b6b4d8b8f451d1af1b76a8
- Merge "API and scenario tests for PROMETHEUS listeners."
- API and scenario tests for PROMETHEUS listeners.
This patch adds API and scenario tests for PROMETHEUS listeners. This
includes scenario tests that connect to the metrics endpoint.
Depends-On: https://review.opendev.org/c/openstack/octavia/+/812258
Change-Id: Ia46d8c0967bc5b0f7cd11b6e3ca3a4e03c0bc138
* Update octavia-tempest-plugin from branch 'master'
to 115cfa1e8e87d123f5cb5be135764368bf77bb28
- Merge "Pin barbican-tempest-plugin to version 1.6.0"
- Pin barbican-tempest-plugin to version 1.6.0
This version is the last that one that supports Python 3.6, which is the
version Ussuri uses.
Change-Id: I3da638eb97939186b923a5854f2ea260b61953e8
* Update octavia-tempest-plugin from branch 'master'
to c6da8f6345641de46c957549eaaef6d0cc802c26
- Merge "Adding 2 traffic based test cases."
- Adding 2 traffic based test cases.
1) test_udp_update_pool_healthmonitor_listener
Traffic should PASS after updating any of LB's components.
2) test_hm_op_status_changed_as_expected_on_update
Update health monitor with various combinations of:
HTTP method, expected HTTP status codes and backend URL.
Validate that members' operation status is getting into
appropriate state on each update.
Change-Id: Ie80378ac1a96941eefa905fd6f49c8fa7e9c3692
* Update octavia-tempest-plugin from branch 'master'
to 031ecca5132c8491e55d93a9ff88c670fccd7983
- Adds a pool client authentication scenario test
This patch adds a pool client authentication scenario test that uses
test servers that require client authentication.
Change-Id: Id5b200954cdf02280d31ed910012a1591a2d2697
* Update octavia-tempest-plugin from branch 'master'
to 17902190afeb2fcf1986e20b86a8fb46a4194764
- Merge "Add ALPN support to the pools service client"
- Add ALPN support to the pools service client
This patch adds ALPN protocol selection support to the pools service
client allowing you to limit the ALPN protocols negotiated when connecting
to member servers.
A follow on patch should include test coverage for this.
Change-Id: Id0b93446dbfdde479fd573eed3e9a5c1e9400609
* Update octavia-tempest-plugin from branch 'master'
to 5486b8af9238677d4975493a8cc1afb62f56d8bc
- Merge "Bump tox minversion to 3.18.0"
- Bump tox minversion to 3.18.0
Since tox 3.18.0, the whitelist_externals option has been deprecated in
favor of the new allow_list_externals option[1].
This change bumps the minversion of tox so that we can replace
the deprecated option.
[1] https://github.com/tox-dev/tox/blob/master/docs/changelog.rst#v3180-2020-07-23
Change-Id: I39e2118e01d4ea87e782b7e3ba3956d5fa57f383
* Update octavia-tempest-plugin from branch 'master'
to b6fe3c68841cc9b21972e7d050215e9e2180864e
- Merge "Spliting member API tests in 2 classes"
- Spliting member API tests in 2 classes
Split MemberAPITest class into MemberAPITest1 and MemberAPITest2
classes. MemberAPITest contained 240 test funtions and it took 1h45 in
the octavia-v2-dsvm-noop-api job to run those functions sequentially.
By spliting this class, the load now spread on 2 workers and it reduces
the duration of the noop-api jobs, avoiding frequent timeout issues.
Change-Id: I2d2cf910bd5801bfeb92c1ede51bd120ced3b4f9
* Update octavia-tempest-plugin from branch 'master'
to 27152e34302cc69c75b088f9dcbeb53036e7e2e2
- Merge "Update c9s job with new ssh key type"
- Update c9s job with new ssh key type
RSA ssh keys are now rejected by ssh client in c9s, generate a ECDSA key
for this job.
Change-Id: Ia8b90d74b657612a02bc2c30514f09f179ab97e3
* Update octavia-tempest-plugin from branch 'master'
to a753173a10868b7d1acc2af71b7e9df4ed4c47b2
- Merge "Remove install unnecessary packages"
- Remove install unnecessary packages
The docs requirements migrated to doc/requirements.txt
we need not install things from requirements.txt.
Change-Id: I930b3602449ab75b9beceeffa346ddc05863fca5
* Update octavia-tempest-plugin from branch 'master'
to a66952e9628c1234fb549065863739e2fb4951e5
- Fix generate_pkcs12_bundle for FIPS
generate_pkcs12_bundle used the PKCS12 class of the pyOpenSSL module
which is not compliant with FIPS (uses SHA1).
Switch to the cryptography module for generating the PKCS bundles unless
for really old releases (<=3.0) that don't support it (stable/train is
still on 2.8).
Change-Id: Ibd50e9a6e406683b7faba093d716c83d2b994ad7
* Update octavia-tempest-plugin from branch 'master'
to 2f975b31c96f7141f2c5a1acfc4a5a9d17d59681
- Fix TLS*_METHOD for old pyopenssl releases
The TLS_METHOD constant was introduced in pyopenssl 21.0.0 [0], but some
older Octavia branches (from train to victoria) still use older releases
(19.1.0 for victoria) and then don't support it. Switch back to the
previous the SSL methods if the new constanst doesn't exist.
[0] 5dc698861c
Change-Id: Ib0eeb1136c168fcc32326f4ed8b008fb7f193a30
* Update octavia-tempest-plugin from branch 'master'
to dde9e6381bbd4a785698c1d9311db82faa9a3223
- Merge "setup.cfg: Replace dashes by underscores"
- setup.cfg: Replace dashes by underscores
Since setuptools v54.1.0[1], the parmeters with dash have been
deprecated in favor of the new parameters with underscore.
This change updates the parameters accordingly to avoid the warnings
like the example below.
UserWarning: Usage of dash-separated 'description-file' will not be
supported in future versions. Please use the underscore name
'description_file' instead
[1] https://github.com/pypa/setuptools/commit/a2e9ae4cb
Change-Id: I5f702cde6d5bc3f0019e556e881b1c49b600f80b
* Update octavia-tempest-plugin from branch 'master'
to 2a8713266a5e85fe6aaebf34f0d43968a808c3c4
- Merge "Remove deprecated OpenSSL methods"
- Remove deprecated OpenSSL methods
TLSv1_2_METHOD and SSLv23_METHOD are deprecated in OpenSSL [0], update
SSL.Context to use the generic TLS_METHOD.
This change also fixes the c9s-based FIPS jobs (they don't support
TLSv1.2).
[0] https://www.pyopenssl.org/en/stable/api/ssl.html#context-objects
Story 2009942
Task 44847
Change-Id: I39e293db39d2a9287b581833cfe9fd469f701a7c
* Update octavia-tempest-plugin from branch 'master'
to 194e8a058b80777bda97a42b25d6ed8c0fef13cc
- Merge "Update zuul queue configuration"
- Update zuul queue configuration
Zuul is changing how queues are declared[1]. This patch updates Octavia tempest plugin for the new way to define the queue.
[1] https://lists.zuul-ci.org/pipermail/zuul-discuss/2022-May/001801.html
Change-Id: I944028615f6fcc14bb5316ef790bb07ae28b1a1c
* Update octavia-tempest-plugin from branch 'master'
to 594485280a863396dae0b85c9c7177e42a28dc4c
- Merge "Remove old unmaintained jobs"
- Remove old unmaintained jobs
Thie commit removes jobs for EOM branches (victoria), and the
spare-pool job for branches that no longer support it
Note: some tls-barbican-stable jobs are still referenced by the barbican
project.
Change-Id: If1a951999d95332b879bfe0f26ec584d0b077165
* Update octavia-tempest-plugin from branch 'master'
to 1aeccba999a15e2e71feb520c233dd19299e6905
- Merge "Add missing RBAC enforcement tests for Listener API"
- Add missing RBAC enforcement tests for Listener API
Some checks were missing for the test_*_listener_update and
test_*_listener_delete tests in ListenerAPITest.
Change-Id: I1ee799c56286c687ea2d7c456f84f34103d58d91
* Update octavia-tempest-plugin from branch 'master'
to 403216a7676f796191ff6c23005cad71ef1b9c23
- Fix error on listener OPERATING_STATUS check
This patch fixes the check for listeners that
have been created with admin_state_up = False,
when running a driver in non-noop mode.
By error it is checking that the listener
is in ONLINE status, when this particular case
requires checking OFFLINE.
Change-Id: I07a9f6abdef29334d70e30755bb948c5b0b65d54
* Update octavia-tempest-plugin from branch 'master'
to 05816960f97c13de27efe2afb095b5af01129ea6
- Merge "Add waiting OPERATION_STATUS for the third listener in tests."
- Add waiting OPERATION_STATUS for the third listener in tests.
This commit fixes the situation when test _test_listener_list fails
because of a mismatch OPERATION_STATUS. This error can be reproduced
only in really slow environments.
Change-Id: Ie873a59fffda425c60e912abbb0d3aec68e134ed
* Update octavia-tempest-plugin from branch 'master'
to 5de58101c21910c170ff176d023c39dfe31b76c8
- Update 'Maintained' stable branch jobs on master gate
We have stable/yoga released and stable/ussuri is in
'Extended Maintenance' state. Current 'Maintained'
stable branches are yoga, xena, wallaby, and victoria.
As per tempest stable branch testing policy[1], adding the
newly released stable/yoga job and remove the EM stable/ussuri
job.
[1] https://docs.openstack.org/tempest/latest/stable_branch_testing_policy.html
Change-Id: I96ef69c79014c95e07a5b3848bf50485eaa46df5
* Update octavia-tempest-plugin from branch 'master'
to 9b0c0ff4bf9ad64e7a236eaa93909e34707887a4
- Merge "Fix incorrect subnet_id for ipv6 member servers"
- Fix incorrect subnet_id for ipv6 member servers
When adding an ipv6 member in test_ipv6_traffic_ops, the ipv4 subnet
from the same network was provided. This is incorrect, the ipv6 subnet
must be passed.
Change-Id: Id8f409a15e14c110f8075bbe943aed42224a948d
* Update octavia-tempest-plugin from branch 'master'
to a3a95b132eac0b37fe85835d89b195ac08436501
- Merge "Fix octavia-tempest-plugin on old tempest releases"
- Fix octavia-tempest-plugin on old tempest releases
This is a follow-up commit for 'Add type to allow ECDSA keys'
(I34ac429ab5442cef056ee8b63fcb2ba41e8b9b27), this commit allows
using octavia-tempest-plugin with older tempest releases
(ex: in our jobs on stable/train).
It catches the exception if [validation].ssh_key_type is not
supported and doesn't pass the ssh_key_type argument to tempest
functions.
Change-Id: I5c2db87975803b30ea230c3bbf5dab4b96da4614
* Update octavia-tempest-plugin from branch 'master'
to 3d8d6ca0ebeaa523f54ef043ecfc5a656d28df36
- Merge "Add centos-9-stream job"
- Add centos-9-stream job
Add octavia-v2-dsvm-scenario-centos-9-stream
Add extra args to the "scp" command to authorize the pubkey exchange
with a cirros VM.
Detect the openssh client version to enable the use of the SCP protocol
(starting with openssh 8.7, the SFTP protocol is the default protocol
with scp, SFTP is not supported by Cirros) when sending files to the
cirros VM.
Depends-On: https://review.opendev.org/828189
Change-Id: I689a50e6762fd22e1aaec8aa84ff5b075ff5bd45
* Update octavia-tempest-plugin from branch 'master'
to fe890485040cdd3220ba2d06086c48655b1be915
- Merge "Add stable/xena jobs on master gate"
- Add stable/xena jobs on master gate
We have stable/xena released so we should add
their job on master gate to keep branchless tempest
plugins compatible to stable branch.
This also removes the stable/train job as that is in EM
state now.
Ref: Tempest plugins guide for stable branch testing:
- https://docs.openstack.org/tempest/latest/stable_branch_testing_policy.html
Change-Id: Ia1ecf95d269af2f6edbd562f31fb69c2cc884cf0
Omer