Commit Graph

38 Commits

Author SHA1 Message Date
ArkadyKanevsky de96ee2d12 Reorganize guidelines and improve consistency.sh
Reorganize guidelines into guidelines directory and create
current_guideline that is softlink to the latest approved guideline.
The same with add-ons guidelines - they are moved to guidelines
directory within add-ons one and soft links are created pointing
to the latest guidelines for each add-on.

Also cleaned up some tooling that hardwired where guidelines lived.

Change-Id: I5ad4b91b1afb44a0a6987b339f7efba14f395302
2021-06-29 22:16:59 +00:00
Martin Kopec c730eee368 Revert "Reorganize guidelines and improve consistency.sh"
This reverts commit a9fbc452a6.

Reason for revert: refstack server gives 404 on the guidelines: https://refstack.openstack.org/#/guidelines .. seems like https://review.opendev.org/c/osf/refstack/+/790940 didn't handle the update of the guidelines location everywhere - I suspect that some changes in refstack-ui are needed as well, ah

Change-Id: I2685eb8fccb4dbdcf42683f168ee2cb316137196
2021-05-25 13:27:13 +00:00
ArkadyKanevsky a9fbc452a6 Reorganize guidelines and improve consistency.sh
Reorganize guidelines into previous_guideline directory
and current_guideline that is softlink to the latest approved guideline.
Cleaned up some tooling that hardwired where guidelines lived.

Change-Id: Ia6be9ca6326718488ee5668df3806da5f76dc456
2021-05-23 10:02:02 +00:00
Artem Goncharov 6a5adfc915 Replace git.openstack.org URLs with opendev.org URLs
Change-Id: I16040e384b553ffb7d19dcda2363f3f07ce7855e
2019-05-08 12:20:31 +00:00
Mark T. Voelker 02698b5411 Fix "superceded" typo in schema
Clouds are hard.  English, doubly so.  We have a longstanding
spelling error in the schema: "superceded" should be spelled
"superseded".  This patch corrects it and updates all the documents
the typo was propagated to over time.

Change-Id: I72f24bf026919f4ccce0ce0c42e1c33c4042aca4
2017-09-12 09:38:36 -06:00
Chris Hoge 88c94ca7e0 2017.09 Interop Guideline Approved by Board of Directors
Co-authored-by: Chris Hoge <chris@openstack.org>
Co-authored-by: Mark T. Voelker <mvoelker@vmware.com>

Change-Id: I6582124284c66f032649ea7f580f8c7040cd1415
2017-09-10 21:20:39 -06:00
Neal Thomas Oakey d8eb66d166 Fix idempotent_id for test_volume_upload
Change-Id: Ib2382a3cc7e5887b08ea695f6344b0b02be618d2
2017-09-04 10:49:01 +02:00
Jenkins 3b1ec680b3 Merge "Add aliases for test_update_snapshot_metadata_item" 2017-07-12 16:31:51 +00:00
jeremy.zhang 2cc378997d Add aliases for test_update_volume_metadata_item
A new volume api test [1] will be added to the function
test_update_volume_metadata_item, the test name will be
changed on Tempest side. This patch adds aliases for
following this Tempest change.

[1] https://review.openstack.org/#/c/479152

Change-Id: Ica8b57f5f5392e2bf47e368e9b10ef9fa5695c30
Depends-On: Idb9d198383ce93453707f1204806e4ae82c1e46a
2017-07-07 09:50:20 +08:00
jeremy.zhang 082fd66159 Add aliases for test_update_snapshot_metadata_item
A new snapshot api test [1] will be added to the function
test_update_snapshot_metadata_item, the test name will be
changed on Tempest side. This patch adds aliases for
following this Tempest change.

[1] https://review.openstack.org/#/c/479124

Change-Id: I672bbcb9983e7a3ace7769722d6ff97f7bc0ccc8
Depends-On: I3697406e5541bbdb191e4d6e63831be31b471e78
2017-07-07 09:48:24 +08:00
Jenkins b397863e9a Merge "Add Aliases For VolumeV2 Test Cases Part 1" 2017-06-14 12:38:25 +00:00
Jenkins 521b947146 Merge "Flagging Regarding Public Cloud Subnet" 2017-06-14 05:17:09 +00:00
zhipengh 7936dc132d Add Aliases For VolumeV2 Test Cases Part 1
The recent version of Tempest (at least from v15) has renamed
all the previous VolumeV2* test case to Volume*. However the
current defcore guideline has not added such alias, which has
resulted in error when user wants to use new version of tempest
to test.

This patch is the part 1 of the fix, due to the large amount of
work. This patch has provided necessary aliases for all the
volume-v2-* capabilities (that means mission complete for required
capabilities) and some of the volume-v3-* ones.

We should expect another patch to provide the aliases for the
remaining volume-v3-* which are at the moment advisory capabilities

Co-Authored-By: Luz Cazares <luz.cazares@intel.com>
Signed-off-by: zhipengh <huangzhipeng@huawei.com>

Change-Id: I700b7009bfb3a93ade832198f4d58f487d641af8
2017-06-13 04:42:49 +00:00
zhipengh bd7dda8630 Flagging Regarding Public Cloud Subnet
In this flagging request two test cases are flagged:
"test_update_port_with_security_group_and_extra_attributes"
and "test_update_port_with_two_security_groups_and_extra
_attributes"

Reasoning: the concept of a network in OpenStack usually
refers to a l2 network, instead of concept like vpc in
aws. The flagged test cases require the cloud to support
subnets within a l2 network, which is a rather rare use
case for typical IPv4 public cloud implementation.

Specifically, in the first flagged test case update_port
action involves creating a new port in a new subnet and
update the previous port to the new one. The second test
case deals with a similar problem in a similar manner.

Proposal: flag these two test cases in defcore guideline
2016.08.json, 2017.01.json and next.json

Change-Id: I247d9247ba751f2d566ec2eb08905a264e784d7e
Signed-off-by: zhipengh <huangzhipeng@huawei.com>
2017-06-08 17:13:20 +08:00
Jenkins 7e90565100 Merge "Remove test_list_servers_by_limits" 2017-06-05 12:31:54 +00:00
Jenkins b0d0d7e9a6 Merge "Deprecate volume-v2/v3-attach-detach capability" 2017-05-30 20:28:01 +00:00
zhufl 8b26001d1a Remove test_list_servers_by_limits
test_list_servers_by_limits will be removed from Tempest
by https://review.openstack.org/463257, this is to remove
it from json file

Change-Id: I052e4305a08e2c63277903357ffe2696f2e85c95
2017-05-25 08:38:06 +08:00
zhipengh d234631f4f Deprecate volume-v2/v3-attach-detach capability
The rationale for this patch has been stated in:
http://lists.openstack.org/pipermail/interop-wg/2017-April/000116.html

In short, the os-attach/detach in Cinder only changes the volume
state, it does not actually attach/detach the volumes, which is already
covered by "compute-volume-attach" capability. Therefore there is no
need for "volume-v2-attach-detach" capability of which test could break
defcore testing for OpenStack clouds, especially for public clouds.

Based upon the above reasoning, this patch accomplish two things:
(1) Flag all the test cases under volume-v2-attach-detach in
2016.08.json and 2017.01.json, and all the test cases under
volumes-v3-attach-detach in 2017.01.json.
(2) Move volume-v2/v3-attach-detach from "required" to "deprecated"
section in both 2017.01.json and next.json, and remove the detailed
test sections below.

Action in (1) is mainly due to the fact that defcore does not have
a mechanism to flag capability. Therefore the only way I could do
is to flag all the related tests with [D400] which indicates that
the capability associated with the tests has problems.

Change-Id: Iabb1d0820300442e407d8b92dfb575ac71471d06
Signed-off-by: zhipengh <huangzhipeng@huawei.com>
2017-05-08 08:18:58 -07:00
Ken'ichi Ohmichi eaa1a889a4 Add aliase for test_update_extra_route
Since I6f2c2ebdce227705f073a43ff04c8bddc4ca5fd4 , the test name has
been changed on Tempest side. This patch adds an aliase for following
this Tempest change.

Change-Id: I8f8c0ceb291f0e666c323d6ad37b72bfbff9099b
2017-04-07 16:36:56 -07:00
Catherine Diep 8979b33bff Flag tests that require second set of user credentials
While the interop_test_spec does not clearly specify the number of
user credentials needed for tests, it was common practice in the
past for DefCore to flag tests that require more than one user
credential [2][3]. This patch flags the tests that require a second
set of user credential (if the Interop WG still wants to keep this
practice).
[1] https://github.com/openstack/defcore/blob/master/working_materials/interop_test_spec.rst
[2] https://review.openstack.org/#/c/253138/
[3] https://review.openstack.org/#/c/338609/

Change-Id: I518e7ffe1a05b111fe0ddcdfff9e98376efdae76
2017-03-16 10:00:04 -07:00
Catherine Diep ffc1bc4f65 Flag a must-pass test that appears in two capabilities
Test tempest.api.object_storage.test_account_services.AccountTest.test_list_extensions
is included in the objectstore-account-list and the
objectstore-info-request capabilities. This patch flags or removes
this test from the objectstore-account-list capability.

Change-Id: I92e3a66b3a1beb8ceee6342a8a57f14c08490068
2017-03-13 14:48:07 -07:00
zhipengh 35565299d0 Flagging two network-l2-CRUD capabilities
In this flagging requests two capabilities are flagged:
"test_create_port_with_no_securitygroups" and
"test_create_show_delete_port_user_defined_mac".

Reasoning: For a general public cloud setup, regarding
the first case, when user creates ports it is usually
required to have security group parameters for security
concerns. Regarding the second case, users are usually
not allowed to self-define mac addresses. The mac
addresses are usually pre-allocated.

Change-Id: Icead40f547e5d570250cf524bd6ae900c3fc82ea
2017-02-04 20:30:01 +08:00
Catherine Diep 2693ddb980 Add aliases for the ListImagesTest tests.
Add aliases to reflect the change that these tests are now inherited
from ListUserImagesTest [1].

[1] https://review.openstack.org/#/c/424935/

Change-Id: I6acaf4b1c4c0325c089ecbefaad22e18f493d960
2017-02-01 09:14:44 -08:00
Catherine Diep 0e2681ad3e Flag the test_upload_large_objects negative test.
The test_upload_large_objects negative test was removed from
Tempest [1].  This patch flags this test in 2016.08 & 2017.01
guidelines and remove it from next.json.

[1] https://review.openstack.org/#/c/354873/

Change-Id: I28244022dbc0b72c5ae56f93d08a0ee464f65132
2017-01-31 09:53:43 -08:00
Ken'ichi Ohmichi 91f1cc2f4e Fix the project name of images-v2-index
The project of images-v2-index should be glance, not nova.
This patch fixes it.

Change-Id: I3cfe851139f7a4058f1821185c983ea3971dc071
2017-01-16 09:34:02 -08:00
ghanshyam 842e46c78a Flag/Replace volume/snapshot update metadata test
Commit I8d9296f958e17d20a39a05800ac1808347d952bd, removed
this test as it is being merged to CRUD tests.

This patch flag the update metadata tests and also remove
from next guidlines.

Change-Id: Id9a53c13eb501a131d4bab48414dd8deecc17d90
Depends-On: I8d9296f958e17d20a39a05800ac1808347d952bd
2016-12-09 11:21:12 +09:00
ghanshyam c0a945ef88 Add aliases for test_create_get_delete_volume_metadata
Commit I8d9296f958e17d20a39a05800ac1808347d952bd , changed the
name of the tests on Tempest side. So this patch addes aliases.

Change-Id: I4707b4956c2b92dc76cf4720016e737edd21b8b3
Depends-On: I8d9296f958e17d20a39a05800ac1808347d952bd
2016-12-06 23:49:21 +00:00
ghanshyam 2ef7d49c01 Add aliases for test_create_get_delete_snapshot_metadata
Commit I8d9296f958e17d20a39a05800ac1808347d952bd , changed the
name of the tests on Tempest side. So this patch addes aliases.

Change-Id: I4d4432bc1d2fd8b1c68cd6d6183bc456ce3b4ff4
Depends-On: I8d9296f958e17d20a39a05800ac1808347d952bd
2016-12-05 00:50:51 +00:00
Ken'ichi Ohmichi 578ce077ff Add aliases for test_list_servers_filter_by_server_status
Since Ic19fd7bd4f0afd6a551133d7db96737487b52663 , the name has been
renamed on Tempest side. So this patch addes aliases.

Change-Id: Ie929b481d8989433922ab960d11590aba31e8374
Depends-On: Ic19fd7bd4f0afd6a551133d7db96737487b52663
2016-11-23 19:16:42 -08:00
Jenkins 8170d87c3b Merge "Flag/Replace a compute-volume-get test" 2016-10-20 08:30:58 +00:00
Ken'ichi Ohmichi d1136f5a5d Flag/Replace a compute-volume-get test
Since I7c99f61dc54ef7c437c7e4574eba935d76ef9318, QA team has removed
test_get_invalid_volume_id from Tempest because the test is duplicated
with test_volume_get_nonexistent_volume_id.

Then this patch changes the compute-volume-get test.

Change-Id: I54f9924c1c007ea2d34b7ef502df8edf8032549e
2016-10-19 10:44:44 -07:00
Ghe Rivero a7e9c5f867 Fix idempotent id names
Some cleanup of some idempotent ids that
were not properly specified

Change-Id: I9c910c96aebc94346f483f22165a88c03af8080c
2016-10-06 09:54:57 +02:00
Jenkins 0abe4b8c15 Merge "Add aliases for test_list_servers_filter_by_server_status" 2016-10-04 17:33:40 +00:00
Ken'ichi Ohmichi fb506afa93 Add aliases for test_list_servers_filter_by_server_status
Since Ieab05d793039cea1d4bb14e91ea0f4cbea3df02b , the name has been
renamed on Tempest side.
So this patch addes aliases.

Change-Id: Ibd8b3f2494046b194d77e9d563ebecef3a883b8f
2016-09-29 17:24:05 -07:00
Catherine Diep a4fd7fedaf Add aliases for test_snapshots_list_* test.
Tempest patch [1] will move these tests to a new file. This will
change the fully qualified test names.

[1] https://review.openstack.org/#/c/332066/

Change-Id: I3262f7414629d460b3660191e7f0c04198e22dd2
2016-09-29 11:59:13 -07:00
Mark T. Voelker 16668dddea Approve 2016.08, supersede 2015.07
This commit changes the 2015.07 Guideline from "approved"
to "superseded" and changes the 2016.08 Guideline from "draft"
to "approved" status.  This patch should not be merged until
the Board of Directors has approved the 2016.08 Guideline.  Voting
is planned for the August 23 Board meeting.

Note: this change also regenerates documentation for all other
superceded Guidelines.

Change-Id: I630978bdff9c166a4a3340f8c26bcdcbf7013cbf
2016-08-22 17:59:23 -04:00
Chris Hoge 8efae7f639 Update schema to 1.6 to disallow additional properties
Update schema to 1.6 to disallow additional properties in the
guidelines where possible.

Change-Id: I2bae41bfa7f4b45616ab7512d07c258001c5affd
2016-08-17 11:13:16 -07:00
Mark T. Voelker c5f87224b7 Create 2016.08 Guideline from next.json
This change creates a 2016.08 doc.  We'll iterate on this and then
present it to the Board of Directors on approximate August 8th
for approval.

Change-Id: I27e543fb522e77f697ead13d50da15f05367e581
2016-08-17 09:32:52 -04:00