* Update designate-tempest-plugin from branch 'master'
to 347fdbc9b4595a10b726526b3c0b5928e5b7fcf2
- Using a dedicated External network for PTR test suite
To avoid potential conflicts with other Tempest plugin like Neutron,
using a dedicated External network for Designate Tempest will be
a better practice.
Change-Id: I6a1c143bd3894d1461b1079b94dcc03b06380cc4
* Update designate-tempest-plugin from branch 'master'
to 8b1b7ca101c768a903bb9b69bd0c857461470e21
- Remove stable/yoga check job
Yoga is now tagged for end of maintenance and devstack is no longer supporting
focal. This patch removes the stable branch job for yoga.
Closes-Bug: #2056773
Change-Id: I6dc983a9f4ac49d76b45354b56c9aba29f897390
* Update designate-tempest-plugin from branch 'master'
to 5877572709c671561e8d7df72e2d151ad5e3eaa6
- Merge "Fix test_show_zone_impersonate_another_project"
- Fix test_show_zone_impersonate_another_project
Test test_show_zone_impersonate_another_project was testing by getting a list
of zones from the API instead of requesting a specific zone to show.
This patch corrects that, such that the test is using the show zone API code
path.
Change-Id: I67e709c9d61af3c5b75b79f27c0c2e9dc8fa08b9
Signed-off-by: Jan Hartkopf <jhartkopf@inovex.de>
* Update designate-tempest-plugin from branch 'master'
to cdbb6ff2774540596085816b09ee9c704591b7e9
- Merge "Add test_not_existing_project_id test"
- Add test_not_existing_project_id test
Zone creation should fail if provided project_id doesn't exist
Change-Id: Ic562354a3b5e5b6ce27cf24a1abce0e1bc7f2aa3
* Update designate-tempest-plugin from branch 'master'
to 1e733017424590f8e5c994b5ecd7b128618756ad
- Increase dns lookup timeout
We have been seeing a few DNS timeouts recently, most likely
due to the hardware not being able to keep up.
Change-Id: I8da4b3b284530428ac79af4ed0dd6e3060435ea9
* Update designate-tempest-plugin from branch 'master'
to 6eb43b36cc287d847ba2fc7805207545bca3be16
- Add a stable/bobcat BIND9 job
This patch adds a stable/bobcat BIND9 test job using Ubuntu Jammy.
Change-Id: I44a69e059a6e56d2b422b99d22578781fbb7fabb
* Update designate-tempest-plugin from branch 'master'
to 770507655a3d4dfb8cb3da2c63affda71032b4f3
- Use reasonable sizes for negative tests
These tests had numbers large enough to trigger the middleware
to limit the request body.
Related-Bug: #2036642
Change-Id: Ie0c07199b0f0257452aa0e0fb5a4bfe546c7de29
* Update designate-tempest-plugin from branch 'master'
to 428987b56adad4dccec683274f85bd36064a83c3
- Merge "Remove reference to 'all-plugin' tox environment"
- Remove reference to 'all-plugin' tox environment
The 'all-plugin' tox environment was deprecated by this patch [1].
Instead of the 'all-plugin' it is recommended to use the 'all' tox
environment.
This patch removes any reference to 'all-plugin' tox environment and
updates the documentation so that the installation steps work with
the 'all' venv.
[1] https://review.opendev.org/c/openstack/tempest/+/543974
Change-Id: Id3451147d172002d67b4557680560a59b026ed77
* Update designate-tempest-plugin from branch 'master'
to 60a908098f1ea5be4cd9f9f3b198348fc8a11538
- Merge "Add a scenario test for classless PTR delegation"
- Add a scenario test for classless PTR delegation
This patch adds a scenario test for classless in-addr.arpa delegation
(RFC 2317).
Change-Id: I11157615a1273d4f087e725cc09de3ad64e07d29
* Update designate-tempest-plugin from branch 'master'
to c3adc64e446dd8de1a41a1e835f2419a43591243
- Fix test_pool sorted list assertion failures
Some of the tests expect to be able to sort on the pool NS record priority. However, the rand_ns_records fake data generator can create NS records with equal priority which leads to undefined sort orders and ultimately invalid test failures.[2]
This patch makes sure the fake ns records created for tests never have equal priority values.
[2] https://zuul.opendev.org/t/openstack/build/69325d93f36042f390b4301cfadd3aa8/log/job-output.txt#21738
Change-Id: Ic04d1fe093dee54da64ccb238e9650ad5fc47eb8
* Update designate-tempest-plugin from branch 'master'
to fe6e065ccf08b67ec4ddd7f41add17c64811c555
- Merge "Removes "DDT" module from Designate-Tempest-Plugin"
- Removes "DDT" module from Designate-Tempest-Plugin
This patch removes DDT module from the code as well as
all *.json files related to it.
Change-Id: I2203d52c4a816dee0960339a8ea3e0ea023b131d
* Update designate-tempest-plugin from branch 'master'
to 0552b62a120e3ec84e2a4c00f2e7ed2be39278a3
- Merge "Shared Zones - new scenario test cases"
- Shared Zones - new scenario test cases
Tests scenarios to reproduce this Launchpad bug:
https://bugs.launchpad.net/designate/+bug/2025295
1) test_list_zones_shared_with_more_then_two_projects
2) test_create_recordset_for_zone_shared_with_two_projects
Change-Id: Ia73e4d9d037e5ab5e7ac55fa70c41a39bc927db8
* Update designate-tempest-plugin from branch 'master'
to 88a5fee15dc070e0d098648f26ea8029a1e55341
- Merge "Adds backend propagation check for E2E recordset scenario test"
- Adds backend propagation check for E2E recordset scenario test
It's worth adding propagation check to this test:
'test_create_and_delete_records_on_existing_zone'
This (DDT based) test covers almost all supported record types
and therefore it makes sense using a query client here
to ensure successfully create/delete of the recordset on the backends
for each tested type.
Change-Id: I4796efc3deb79b5135f667f6880349b70aa016c7
* Update designate-tempest-plugin from branch 'master'
to 89da05dc308a1c192ce903208717f24e9a440e1c
- Merge "[Designate] IPv6 detection check added"
- [Designate] IPv6 detection check added
The current code assumes that the nameserver value configured
in tempest.conf is one of these two options only: IPV4 or IPV4:PORT
There is no handling for IPV6 addresses(with/without PORT).
(If IPV6 is set it causes traceback).
This patch adds support for IPV6.
Change-Id: I6ee56fcc1f00bc55012bcd1895bddce5acfa07d4
* Update designate-tempest-plugin from branch 'master'
to 300523aa659223c85190c0028404fe07d448f22e
- Remove EM stable/xena job from master gate
stable/xena is in EM state. As Tempest and
plugins masters does not support EM stable branches
QA team will be pinning tempest in devstack stable/xena
soon. With that we do not need to test the stable/xena
jobs on master gate
- https://review.opendev.org/c/openstack/releases/+/881254
Change-Id: I94f8511ab4adab2dfba21260c69c6e691911e16d
* Update designate-tempest-plugin from branch 'master'
to 25c93a50ec2ce08677129071b123ce056fef9fe5
- Remove stable/wallaby job from master gate
stable/wallaby is in EM state. As Tempest and
plugins masters does not support Em stable branches
qa team is pinning tempest in devstack stable/wallaby
tesitng[1]. With that we do not need to test the
stable/wallaby jobs on master gate
[1] https://review.opendev.org/c/openstack/devstack/+/871782
Change-Id: If5db25580fc979f9b4184e3556d2e1f1ed227c6f
* Update designate-tempest-plugin from branch 'master'
to afdcc1c8f5a756bb12bbaad9f751b23ba2e08d92
- Update testing for show and list a shared zone
This patch updates the tests to account for projects that have a zone
shared with it can list and show the zone.
Change-Id: I218bbf0c4f6a1609b6500ccb91765959823bf911
* Update designate-tempest-plugin from branch 'master'
to 0480597cb6366413a6b841272a8d43ff043b0bcd
- Merge "This patch removes the usage of DDT module from test_unauthed.py"
- This patch removes the usage of DDT module from test_unauthed.py
Each test is now will have its own idempotent_id.
Change-Id: I878ec208f1c0179b6a7e01e41553531a8259a665
* Update designate-tempest-plugin from branch 'master'
to 6167f3abcf45fb5a074a85bb4a7dedf666a66f63
- Merge "Unroll test_update_records_propagated_to_backends"
- Unroll test_update_records_propagated_to_backends
This patch unrolls the test_update_records_propagated_to_backends tests from
DDT to ensure each test gets a proper idempotent ID. Previously fourteen tests
had the same ID.
This patch also fixes a scenario where if no nameservers are provided in the
tempest.conf, the test would pass instead of being skipped.
Change-Id: I85d871350fcacfb6e293092ff6c16a6dba7f952e
* Update designate-tempest-plugin from branch 'master'
to 64cf3eaf108de73dd35d146ef26abb2fb78640d0
- Merge "Update the README file to use tox -e all"
- Update the README file to use tox -e all
This patch updates the README file to have instructions for running the tempest tests using the "all" environment instead of "all-plugins". The "all-plugins" environment has been deprecated for years and uses site-packages, which may cause unintended test scenarios.
It also updates the example "run a single test" to be a non-admin API test.
Change-Id: I8645fb7577d52cd35e3d61d44ca9028ea3afe00f
* Update designate-tempest-plugin from branch 'master'
to 64a70abee1e7b17e61878e1a7c50ebd450987514
- Fix shared zones tests for scoped tokens
Scoped tokens do not have a project_id, which caused some of the new
shared zones tests to fail. This patch corrects that issue by using sudo
project ids if scoped tokens is enabled for the test.
Change-Id: Icf18d59a8fdf67e1e9ee893954703a53b0b9f070
* Update designate-tempest-plugin from branch 'master'
to 3b98486527503c96caca56268353bd09d83d32b5
- Merge "Extending "Shared Zones" test coverage"
- Extending "Shared Zones" test coverage
This patch adds:
1) API and Scenario test cases for Admin tenant
2) Quota tests, to ensure: "quotas enforced against owner"
3) Negative scenario tests
Change-Id: I0bbc6504ba2ef75bba8268d5e91b2588a4215555
* Update designate-tempest-plugin from branch 'master'
to f4935ea128b467ac98bed588b00a6f70e2ece6ef
- Accommodate stable branches with scoped tokens
This patch updates the Designate tempest plugin to accommodate stable
branches that still have keystone scoped tokens. The "Direction
change"[1] means scoped tokens were dropped in the Bobcat (2023.2)
release. However the stable branches back to Wallaby will still have
scoped tokens available as a configuration option.
[1] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html#direction-change
Change-Id: Ia57b5126dbc9fbe98cbcaa7ad0e11d36c21a14da
* Update designate-tempest-plugin from branch 'master'
to 1f63edcc338d3d235460eae319cb76f9be1069ae
- Re-enable the tempest tests and add Antelope
This patch re-enables the tempest tests with the keystone default roles
job and adds the Antelope (2023.1) stable job.
Change-Id: Idaa3e0e90fb3f7d6b754d9b0814e945bda009650
* Update designate-tempest-plugin from branch 'master'
to 288cdcf6973a399b761a4c5904f2152a8f678762
- Update designate-tempest-plugin "direction change"
The RBAC goal has changed[1] and system scope is no longer going to be
used. This patch updates Designate tempest plugin to align to this change in
direction by removing the system scope from the policy tests.
[1] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html#direction-change
Change-Id: I4e5c56630d5cca96278fe67232519c067356da23
* Update designate-tempest-plugin from branch 'master'
to 759ee725b804869729cae8b2d6699416bd600b50
- Merge "Add project_reader in new RBAC tests"
- Add project_reader in new RBAC tests
Tempest is fixing the bug#1964509 (depends-on) where
project_reader user will be created under the same project
as primary, project_member, project_admin users.
'primary', 'project_admin', 'project_member', and 'project_reader'
creds will be created in same projects. All the alt creds will be
created under the new projects. non alt and alt creds will use
different project, for example, 'project_alt_member' and
'project_member' creds will be created in different project.
Related-Bug: #1964509
Depends-On: https://review.opendev.org/c/openstack/tempest/+/871018
Change-Id: I143e69c1e150ddf7fa1757dea7bced6bff6739a9
* Update designate-tempest-plugin from branch 'master'
to a84e3194adf72fb2eb87f0c563065bb089b0d192
- Add tempest tests for shared zones
This patch adds API and scenario test coverage for the shard zones
feature.
Author: Igor Malinovskiy <u.glide@gmail.com>
Co-Authored-By: Sergey Drozdov <sergey.drozdov.dev@gmail.com, sergey.drozdov93@thehutgroup.com>
Co-Authored-By: Michael Johnson <johnsomor@gmail.com>
Change-Id: I53a1e4676c5bbb63bee0c4bb91eac03c95dd3a3c
Partial-Bug: #1714088
Depends-On: https://review.opendev.org/726334
* Update designate-tempest-plugin from branch 'master'
to 73065cdacabf428e8ad3934fc3008f4f405971e1
- Add API version check capabilities
This patch adds a method that allows us to get the current Designate API version under test for use in test classes to skip tests against new features introduced in a specific API version.
This patch also centralizes the "primary" zones client to be instantiated once and updates the tests to use a standardized name for the client.
Finally, it adds a missing requirement of oslo.serialization to requirements.txt.
Change-Id: I240911c0ab9b9bad7851268865d6a8e867627673
* Update designate-tempest-plugin from branch 'master'
to cc8f89b41c98080bf710b6fd038f7083bdaad6f4
- Add Designate hacking checks to the tempest plugin
This patch adds the Designate hacking checks to also run against
the Designate tempest plugin code to maintain consistent style
checking across the Designate repositories.
Change-Id: I8f41bb8188ba8442dbf493dac39b8601f5208938
* Update designate-tempest-plugin from branch 'master'
to fe4672da2591f3e2c812bcbd8243d294c0f9cdc4
- Merge "Fix to support batch increment serial"
- Fix to support batch increment serial
Change-Id: Ie2579c929875768c94658aef58bf97437ca92477
* Update designate-tempest-plugin from branch 'master'
to adf6319c1cfc3ca59e109865fb6cee5d8873d155
- Fix test_list_enabled_api_versions test case
The test_list_enabled_api_versions was not properly checking the enabled API versions and would always fail on new API version additions.
This patch corrects the list comprehension and updates the test to look for at least one of the base API versions in the returned results. This way the test will not artificially fail as we add new API versions.
Change-Id: Ibcee798b15aaccf8fddd28f80df7112cda3a9ed5
* Update designate-tempest-plugin from branch 'master'
to c9429994a4afeb7ee8cf82efbe543a615511a535
- Merge "Fix checking of the [dns].nameservers value"
- Fix checking of the [dns].nameservers value
This patch [1] introduced checking whether the CONF.dns.nameservers
is empty. If the CONF.dns.nameservers value is empty then the
initialization of the QueryClient fails. This change makes the majority
of designate-tempest-plugin tests fail even tests that do not use the
QueryClient.
This patch introduces three changes:
1) ValueError is raised only when the query() function is called so
that only tests that actually use the query() function fail.
2) wait_for_query() function is fixed so that it never succeeds when the
CONF.dns.nameservers value is empty.
3) Skip tests that rely upon [dns].nameserver value.
[1] https://review.opendev.org/c/openstack/designate-tempest-plugin/+/860116
Change-Id: Iedd151b2e47ed62adc168a97cb6021ccb47abb0f
* Update designate-tempest-plugin from branch 'master'
to c8d2a022e4c80a3abdc0b458c110ec8b29d44093
- Merge "Pin stable branch jobs nodeset to Ubuntu Focal (20.04)"
- Pin stable branch jobs nodeset to Ubuntu Focal (20.04)
In 2023.1 cycle. we are moving the default distro
version of Ubuntu to Jammy (22.04)[1] so we need to pin
the nodeset for stable branch job in master gate so that
they continue run on their supporting distro version which is
Ubuntu Focal since stable/victoria.
[1] https://governance.openstack.org/tc/goals/selected/migrate-ci-jobs-to-ubuntu-jammy.html
Change-Id: I20e9be1071c27301a07089ec70c9ceb53fca7633
* Update designate-tempest-plugin from branch 'master'
to ff6c24db8461975b9409505f0dca89909ea410c9
- Removing trigger_update_secondary_zone_negative
This patch removes the test_manually_trigger_update_secondary_zone_negative test because it is broken due to changes in dnspython and the need for this negative test is not clear.
Closes-Bug: 1968717
Change-Id: I08ea6758994a9bbd95bf9693ce344c2206818241
* Update designate-tempest-plugin from branch 'master'
to 1d5fbf7613a56f831bdf34dd3f8419271199b215
- Add designate-bind9-stable-zed job
After stable/zed was released, we should also test updates to the
tempest-plugin against that branch.
Change-Id: I877732fa51f60d2b50fb552a63e00df76f80b690
* Update designate-tempest-plugin from branch 'master'
to b0d3f9a54f4081dcacbff4151e7a91126c52691c
- Drop explicit queue configuration
It will be inherited via the designate-devstack-jobs project template,
so we can drop the explicit setting.
Depends-On: https://review.opendev.org/c/openstack/designate/+/861352
Change-Id: Ib555ea19c183149ebdf25f7915089c405c23644d
* Update designate-tempest-plugin from branch 'master'
to 6c251b44c57f8d08d45468ef00a5c4d53a9c923b
- DNS Query Client - raise ValueError if provided Nameservers list is empty
There is no sense to "dig" not existing DNS backends, therefor
when Query Client object is being created with an empty list for
the namesrevers attribute, ValueError will be raised.
Change-Id: I156508e404dc2d2966a189941b0b4ff13412953f
* Update designate-tempest-plugin from branch 'master'
to 66b9b0c7b914c273d388164bb895c989095d3e13
- Merge "Fix - test_admin_creates_zone_matches_blacklist_name_or_regex"
- Fix - test_admin_creates_zone_matches_blacklist_name_or_regex
Scenario:
1) Create two blacklist patterns: by regex and by exact name
2) Ensure Primary fails to create a zone if its name is in blacklist
3) Ensure Admin is able to create a zone even if its name is in blacklist
4) Ensure Primary fails to create a zone if its name matches blacklist regex
5) Ensure Admin is able to create a zone even if its name matches blacklist regex
Change-Id: I258b1135dedb00d18a143e23a98dd0e2f284b8c6
* Update designate-tempest-plugin from branch 'master'
to d1307ce3b0e7390bae12f4871a4c80ba3061055e
- Merge "Deprecate option for old api_export_size bug"
- Deprecate option for old api_export_size bug
This change deprecates the option to workaround the old bug. The bug
was fixed during Newton cycle and is fixed in all versions currently
maintained.
Related-Bug: #1573141
Change-Id: I88ca5b481f7728da38f53c4e67710314e78da24d
* Update designate-tempest-plugin from branch 'master'
to 04ec7e1b4190c8f554c1b5a5cddd089730443067
- Merge "New quota boundray test:"test_zone_quota_boundary""
- New quota boundray test:"test_zone_quota_boundary"
Test scenario:
1) Create a tenant and set its Zones quota to 1
2) Create a first zone --> PASS
3) Create a second Zone --> FAIL (413 over_quota)
Change-Id: Ic47888d83a77b6f65213c1e55bbfca73eb5346b7
* Update designate-tempest-plugin from branch 'master'
to be96bd2a9174a5d88287a74390faba8e85aae4ef
- Merge "Adds TLD cleanup to "test_recordset_validation" test suite"
- Adds TLD cleanup to "test_recordset_validation" test suite
TLDs created in "test_recordset_validation" weren't deleted
by the cleanup. This patch is about to fix this issue.
Change-Id: I7b3c80cbbcf74a16c94edbae88a8c4eb662c92dc
* Update designate-tempest-plugin from branch 'master'
to 4803be5ac103e7027bccf29fffd6115f3386d241
- Merge "Fix the test_list_enabled_api_versions"
- Fix the test_list_enabled_api_versions
This patch updates the test_list_enabled_api_versions to accomodate the
update to the API version document to match the OpenStack standard
format.
Change-Id: I7afca000f682cd72478cd45f863fad7d8a80b6f1
* Update designate-tempest-plugin from branch 'master'
to 63baf45083bbb9bf3f13c482c8ce7efd74b94b7e
- Merge "Recordset scenario test suite changes"
- Recordset scenario test suite changes
1) Re-factoring: replace underscores by index, use constants
2) Moving "test_create_soa_record_not_permitted" from Scenario to API
3) New test: "test_delete_ns_record_not_permitted"
Primary user is not able to delete NS type recordset
4) New test: "test_update_records_propagated_to_backends"
Update recordset TTL (all types except NS and SOA) and
make sure that the updated TTL is propagated to the backends
5) Adding backend validation check to the existing test:
"test_create_and_delete_records_on_existing_zone"
6) Remove "NS" type record from "recordset_data.json"
Reason: the test was bogus because it was creating an NS record
for a sub-zone
Change-Id: I169b3666a941ac61ac56619cdbe0f947340f669f
* Update designate-tempest-plugin from branch 'master'
to 407b60f84416b6aeb13bcdea16fa40fef2326dd0
- Disable admin API tests by default
Designate has deprecated the admin API and it is disabled by default in Designate. The tempest tests for it should also be disabled by default.
This patch corrects that mis-match between the tempest plugin and Designate default configurations.
Closes-Bug: #1982958
Change-Id: Ie854b23cb4e86439b427b13c0d769c538e8927e5
* Update designate-tempest-plugin from branch 'master'
to 2e59657bdfb9aacd3606940ea976f3baadeec3f5
- Merge "Transfer Request - refactoring and new test cases"
- Transfer Request - refactoring and new test cases
1) Refactoring:
- Replace Python underscore variable with indexing.
- Remove the "message" assertion
2)"test_create_transfer_request_404"
- Try to create a transfer request with random id
3)"test_zone_transfer"
- Validation that transfer_accept deleted
after the transfer_request delete
Change-Id: If7aa1033d52b71a6e01559b6cd468d2f5e6ddf9c
* Update designate-tempest-plugin from branch 'master'
to 3fe1bd10cc1254b67b97dfb10c5406d89de1befc
- Merge "Zone Imports - refactoring and new test cases"
- Zone Imports - refactoring and new test cases
1) Refactoring:
- Replace Python underscore variable with indexing.
- Use constants.
- Move negative test cases to dedicated "Negative" class.
- Client's "create_zone_import" had to be improved.
- Using provided "wait_until" in the existing tests.
2) "test_create_zone_import_invalid_file_data"
Try to create a zone import using invalid zone file data.
Expected: zone gets into the ERROR status.
3) "test_zone_cannot_be_update_by_import"
Try to update an existing zone using Zone import.
Expected: zone import gets into the ERROR status.
4) "test_create_zone_import_invalid_content_type" to test
"415 unsupported_content_type" error response.
Change-Id: Ifce7e6ed910c43aacc566cdf692eec45779811e4
* Update designate-tempest-plugin from branch 'master'
to 3cb3fadb48a5ce98848f84388a683e3c0ff1bba9
- Merge "Adds new test case to validate min_ttl equal to Zero"
- Adds new test case to validate min_ttl equal to Zero
1) Refactoring - moving negative test cases to the
dedicated class
2) "test_create_zone_ttl_zero" - create a Zone with TTL:0
and make sure that the created Zone has TTL:0
Change-Id: I96022307ef1e8deb59015c284c5fadce70720c82
* Update designate-tempest-plugin from branch 'master'
to ee45b4c893a18cda7852479a1b8c8197177bd0b8
- Merge "Adding new test cases to "quota" scenario test suite"
- Adding new test cases to "quota" scenario test suite
1) test_api_export_size_quota
Verifies: "Number of recordsets allowed in a zone export"
2) test_recordset_records_quota
Verifies: "Number of records allowed per recordset"
3) test_zone_records_quota
Verifies: "Number of records allowed per zone"
4) test_zone_recordsets_quota
Verifies: "Number of records allowed per recordset"
5) test_zones_quota (modify)
Verifies: "The number of zone allowed per project"
Change-Id: Ia89091087f004e174f38ca0685605057abbf5cdd