Commit Graph

322 Commits

Author SHA1 Message Date
Arkady Shtempler 347fdbc9b4 Using a dedicated External network for PTR test suite
To avoid potential conflicts with other Tempest plugin like Neutron,
using a dedicated External network for Designate Tempest will be
a better practice.

Change-Id: I6a1c143bd3894d1461b1079b94dcc03b06380cc4
2024-03-12 14:06:10 +00:00
Zuul 5877572709 Merge "Fix test_show_zone_impersonate_another_project" 2024-01-16 15:56:33 +00:00
Zuul cdbb6ff277 Merge "Add test_not_existing_project_id test" 2024-01-16 15:51:46 +00:00
Arkady Shtempler a3922846ac Fix "ttl" typos
Change-Id: I20b99ab09e8c8fb5246e4697b6b32eef54623425
2023-12-13 10:56:18 +02:00
Arkady Shtempler 2c4210966b Add test_not_existing_project_id test
Zone creation should fail if provided  project_id doesn't exist

Change-Id: Ic562354a3b5e5b6ce27cf24a1abce0e1bc7f2aa3
2023-11-19 17:06:02 +02:00
Jan Hartkopf d1c54e39a3 Fix test_show_zone_impersonate_another_project
Test test_show_zone_impersonate_another_project was testing by getting a list
of zones from the API instead of requesting a specific zone to show.
This patch corrects that, such that the test is using the show zone API code
path.

Change-Id: I67e709c9d61af3c5b75b79f27c0c2e9dc8fa08b9
Signed-off-by: Jan Hartkopf <jhartkopf@inovex.de>
2023-11-14 22:48:36 +00:00
Erik Olof Gunnar Andersson 1e73301742 Increase dns lookup timeout
We have been seeing a few DNS timeouts recently, most likely
due to the hardware not being able to keep up.

Change-Id: I8da4b3b284530428ac79af4ed0dd6e3060435ea9
2023-11-03 05:30:49 -07:00
Erik Olof Gunnar Andersson 770507655a Use reasonable sizes for negative tests
These tests had numbers large enough to trigger the middleware
to limit the request body.

Related-Bug: #2036642
Change-Id: Ie0c07199b0f0257452aa0e0fb5a4bfe546c7de29
2023-10-05 12:01:54 +00:00
Zuul 60a908098f Merge "Add a scenario test for classless PTR delegation" 2023-08-01 12:58:56 +00:00
Michael Johnson c3adc64e44 Fix test_pool sorted list assertion failures
Some of the tests expect to be able to sort on the pool NS record priority. However, the rand_ns_records fake data generator can create NS records with equal priority which leads to undefined sort orders and ultimately invalid test failures.[2]
This patch makes sure the fake ns records created for tests never have equal priority values.

[2] https://zuul.opendev.org/t/openstack/build/69325d93f36042f390b4301cfadd3aa8/log/job-output.txt#21738

Change-Id: Ic04d1fe093dee54da64ccb238e9650ad5fc47eb8
2023-07-31 15:39:00 +00:00
Zuul fe6e065ccf Merge "Removes "DDT" module from Designate-Tempest-Plugin" 2023-07-28 09:34:57 +00:00
Arkady Shtempler 462e39d73f Removes "DDT" module from Designate-Tempest-Plugin
This patch removes DDT module from the code as well as
all *.json files related to it.

Change-Id: I2203d52c4a816dee0960339a8ea3e0ea023b131d
2023-07-23 12:34:16 +03:00
Zuul 0552b62a12 Merge "Shared Zones - new scenario test cases" 2023-07-22 17:57:59 +00:00
Zuul 88a5fee15d Merge "Adds backend propagation check for E2E recordset scenario test" 2023-07-21 23:16:36 +00:00
Arkady Shtempler 725b25003e Shared Zones - new scenario test cases
Tests scenarios to reproduce this Launchpad bug:
https://bugs.launchpad.net/designate/+bug/2025295
1) test_list_zones_shared_with_more_then_two_projects
2) test_create_recordset_for_zone_shared_with_two_projects

Change-Id: Ia73e4d9d037e5ab5e7ac55fa70c41a39bc927db8
2023-07-21 22:27:08 +00:00
Lilach Avraham 9b0cec95fa [Designate] IPv6 detection check added
The current code assumes that the nameserver value configured
in tempest.conf is one of these two options only: IPV4 or IPV4:PORT
There is no handling for IPV6 addresses(with/without PORT).
(If IPV6 is set it causes traceback).

This patch adds support for IPV6.

Change-Id: I6ee56fcc1f00bc55012bcd1895bddce5acfa07d4
2023-07-14 10:58:45 +03:00
Michael Johnson a12691b086 Add a scenario test for classless PTR delegation
This patch adds a scenario test for classless in-addr.arpa delegation
(RFC 2317).

Change-Id: I11157615a1273d4f087e725cc09de3ad64e07d29
2023-06-06 14:28:55 +00:00
Michael Johnson afdcc1c8f5 Update testing for show and list a shared zone
This patch updates the tests to account for projects that have a zone
shared with it can list and show the zone.

Change-Id: I218bbf0c4f6a1609b6500ccb91765959823bf911
2023-06-01 00:40:16 +00:00
Zuul 0480597cb6 Merge "This patch removes the usage of DDT module from test_unauthed.py" 2023-05-25 00:55:59 +00:00
Zuul 6167f3abcf Merge "Unroll test_update_records_propagated_to_backends" 2023-05-24 21:02:49 +00:00
Arkady Shtempler d52cff86c4 This patch removes the usage of DDT module from test_unauthed.py
Each test is now will have its own idempotent_id.

Change-Id: I878ec208f1c0179b6a7e01e41553531a8259a665
2023-04-19 12:49:21 +03:00
Michael Johnson 64a70abee1 Fix shared zones tests for scoped tokens
Scoped tokens do not have a project_id, which caused some of the new
shared zones tests to fail. This patch corrects that issue by using sudo
project ids if scoped tokens is enabled for the test.

Change-Id: Icf18d59a8fdf67e1e9ee893954703a53b0b9f070
2023-04-17 23:17:21 +00:00
Michael Johnson a5ba980ef4 Unroll test_update_records_propagated_to_backends
This patch unrolls the test_update_records_propagated_to_backends tests from
DDT to ensure each test gets a proper idempotent ID. Previously fourteen tests
had the same ID.
This patch also fixes a scenario where if no nameservers are provided in the
tempest.conf, the test would pass instead of being skipped.

Change-Id: I85d871350fcacfb6e293092ff6c16a6dba7f952e
2023-04-17 20:07:11 +00:00
Zuul 3b98486527 Merge "Extending "Shared Zones" test coverage" 2023-04-13 19:24:07 +00:00
Arkady Shtempler fdbe35c32f Extending "Shared Zones" test coverage
This patch adds:
1) API and Scenario test cases for Admin tenant
2) Quota tests, to ensure: "quotas enforced against owner"
3) Negative scenario tests

Change-Id: I0bbc6504ba2ef75bba8268d5e91b2588a4215555
2023-04-13 15:13:45 +03:00
Michael Johnson f4935ea128 Accommodate stable branches with scoped tokens
This patch updates the Designate tempest plugin to accommodate stable
branches that still have keystone scoped tokens. The "Direction
change"[1] means scoped tokens were dropped in the Bobcat (2023.2)
release. However the stable branches back to Wallaby will still have
scoped tokens available as a configuration option.

[1] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html#direction-change

Change-Id: Ia57b5126dbc9fbe98cbcaa7ad0e11d36c21a14da
2023-04-11 17:07:07 +00:00
Michael Johnson 288cdcf697 Update designate-tempest-plugin "direction change"
The RBAC goal has changed[1] and system scope is no longer going to be
used. This patch updates Designate tempest plugin to align to this change in
direction by removing the system scope from the policy tests.

[1] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html#direction-change

Change-Id: I4e5c56630d5cca96278fe67232519c067356da23
2023-03-31 16:24:24 +00:00
Zuul 759ee725b8 Merge "Add project_reader in new RBAC tests" 2023-02-24 09:00:30 +00:00
Ghanshyam Mann ed18e74a69 Add project_reader in new RBAC tests
Tempest is fixing the bug#1964509 (depends-on) where
project_reader user will be created under the same project
as primary, project_member, project_admin users.

'primary', 'project_admin', 'project_member', and 'project_reader'
creds will be created in same projects. All the alt creds will be
created under the new projects. non alt and alt creds will use
different project, for example, 'project_alt_member' and
'project_member' creds will be created in different project.

Related-Bug: #1964509

Depends-On: https://review.opendev.org/c/openstack/tempest/+/871018
Change-Id: I143e69c1e150ddf7fa1757dea7bced6bff6739a9
2023-02-23 19:07:30 +00:00
Igor Malinovskiy a84e3194ad Add tempest tests for shared zones
This patch adds API and scenario test coverage for the shard zones
feature.

Author: Igor Malinovskiy <u.glide@gmail.com>
Co-Authored-By: Sergey Drozdov <sergey.drozdov.dev@gmail.com, sergey.drozdov93@thehutgroup.com>
Co-Authored-By: Michael Johnson <johnsomor@gmail.com>

Change-Id: I53a1e4676c5bbb63bee0c4bb91eac03c95dd3a3c
Partial-Bug: #1714088
Depends-On: https://review.opendev.org/726334
2023-02-23 15:29:34 +00:00
Michael Johnson 73065cdaca Add API version check capabilities
This patch adds a method that allows us to get the current Designate API version under test for use in test classes to skip tests against new features introduced in a specific API version.
This patch also centralizes the "primary" zones client to be instantiated once and updates the tests to use a standardized name for the client.
Finally, it adds a missing requirement of oslo.serialization to requirements.txt.

Change-Id: I240911c0ab9b9bad7851268865d6a8e867627673
2023-02-19 18:11:49 +02:00
Michael Johnson cc8f89b41c Add Designate hacking checks to the tempest plugin
This patch adds the Designate hacking checks to also run against
the Designate tempest plugin code to maintain consistent style
checking across the Designate repositories.

Change-Id: I8f41bb8188ba8442dbf493dac39b8601f5208938
2023-02-15 22:14:16 +00:00
Zuul fe4672da25 Merge "Fix to support batch increment serial" 2023-02-14 17:25:03 +00:00
Arkady Shtempler 75acd12c08 Adds backend propagation check for E2E recordset scenario test
It's worth adding propagation check to this test:
'test_create_and_delete_records_on_existing_zone'
This (DDT based) test covers almost all supported record types
and therefore it makes sense using a query client here
to ensure successfully create/delete of the recordset on the backends
for each tested type.

Change-Id: I4796efc3deb79b5135f667f6880349b70aa016c7
2023-01-29 14:35:25 +02:00
Erik Olof Gunnar Andersson bd21c75eaa Fix to support batch increment serial
Change-Id: Ie2579c929875768c94658aef58bf97437ca92477
2023-01-28 22:14:07 -08:00
Michael Johnson adf6319c1c Fix test_list_enabled_api_versions test case
The test_list_enabled_api_versions was not properly checking the enabled API versions and would always fail on new API version additions.

This patch corrects the list comprehension and updates the test to look for at least one of the base API versions in the returned results. This way the test will not artificially fail as we add new API versions.

Change-Id: Ibcee798b15aaccf8fddd28f80df7112cda3a9ed5
2023-01-29 04:18:58 +00:00
Zuul c9429994a4 Merge "Fix checking of the [dns].nameservers value" 2023-01-15 22:40:43 +00:00
Michael Johnson ff6c24db84 Removing trigger_update_secondary_zone_negative
This patch removes the test_manually_trigger_update_secondary_zone_negative test because it is broken due to changes in dnspython and the need for this negative test is not clear.

Closes-Bug: 1968717
Change-Id: I08ea6758994a9bbd95bf9693ce344c2206818241
2022-11-23 00:18:45 +00:00
Lukáš Piwowarski 4f2367f64a Fix checking of the [dns].nameservers value
This patch [1] introduced checking whether the CONF.dns.nameservers
is empty. If the CONF.dns.nameservers value is empty then the
initialization of the QueryClient fails. This change makes the majority
of designate-tempest-plugin tests fail even tests that do not use the
QueryClient.

This patch introduces three changes:

1) ValueError is raised only when the query() function is called so
   that only tests that actually use the query() function fail.

2) wait_for_query() function is fixed so that it never succeeds when the
   CONF.dns.nameservers value is empty.

3) Skip tests that rely upon [dns].nameserver value.

[1] https://review.opendev.org/c/openstack/designate-tempest-plugin/+/860116

Change-Id: Iedd151b2e47ed62adc168a97cb6021ccb47abb0f
2022-11-07 17:24:05 +01:00
Michael Johnson e52be15f30 Fix blacklist scenario test conflicts
A recent patch[1] reverted a fix for broad blacklists in scenario tests interferring with other test suites. This patch puts that fix[2] back in to stop cross-test suite failures due to blacklist collisions.

[1] https://review.opendev.org/c/openstack/designate-tempest-plugin/+/853873
[2] https://review.opendev.org/c/openstack/designate-tempest-plugin/+/816910

Change-Id: I9e90196e2df945855ef7d6a74afac13834a1339a
2022-10-12 21:50:40 +00:00
Arkady Shtempler 6c251b44c5 DNS Query Client - raise ValueError if provided Nameservers list is empty
There is no sense to "dig" not existing DNS backends, therefor
when Query Client object is being created with an empty list for
the namesrevers attribute, ValueError will be raised.

Change-Id: I156508e404dc2d2966a189941b0b4ff13412953f
2022-10-03 19:56:07 +00:00
Zuul 66b9b0c7b9 Merge "Fix - test_admin_creates_zone_matches_blacklist_name_or_regex" 2022-10-02 10:17:29 +00:00
Zuul d1307ce3b0 Merge "Deprecate option for old api_export_size bug" 2022-10-02 01:42:16 +00:00
Zuul 04ec7e1b41 Merge "New quota boundray test:"test_zone_quota_boundary"" 2022-09-22 19:39:29 +00:00
Arkady Shtempler ea0b668c81 New quota boundray test:"test_zone_quota_boundary"
Test scenario:
1) Create a tenant and set its Zones quota to 1
2) Create a first zone --> PASS
3) Create a second Zone --> FAIL (413 over_quota)

Change-Id: Ic47888d83a77b6f65213c1e55bbfca73eb5346b7
2022-09-21 23:36:02 +03:00
Zuul be96bd2a91 Merge "Adds TLD cleanup to "test_recordset_validation" test suite" 2022-09-21 15:38:38 +00:00
Takashi Kajinami db3be98cef Deprecate option for old api_export_size bug
This change deprecates the option to workaround the old bug. The bug
was fixed during Newton cycle and is fixed in all versions currently
maintained.

Related-Bug: #1573141
Change-Id: I88ca5b481f7728da38f53c4e67710314e78da24d
2022-09-04 22:40:59 +09:00
Zuul 4803be5ac1 Merge "Fix the test_list_enabled_api_versions" 2022-08-31 18:05:24 +00:00
Arkady Shtempler 25d20e6650 Fix - test_admin_creates_zone_matches_blacklist_name_or_regex
Scenario:
1) Create two blacklist patterns: by regex and by exact name
2) Ensure Primary fails to create a zone if its name is in blacklist
3) Ensure Admin is able to create a zone even if its name is in blacklist
4) Ensure Primary fails to create a zone if its name matches blacklist regex
5) Ensure Admin is able to create a zone even if its name matches blacklist regex

Change-Id: I258b1135dedb00d18a143e23a98dd0e2f284b8c6
2022-08-21 14:26:46 +03:00
Zuul 63baf45083 Merge "Recordset scenario test suite changes" 2022-08-17 11:30:25 +00:00