Commit Graph

144 Commits

Author SHA1 Message Date
Ghanshyam Mann 72ea117f61 Retire Tripleo: remove repo content
TripleO project is retiring
- https://review.opendev.org/c/openstack/governance/+/905145

this commit remove the content of this project repo

Change-Id: Ic549bdcc76a5e12a0104143fbe79fd0db2c866b0
2024-02-24 11:44:35 -08:00
Arx Cruz 87cc93244f Deprecate validate-tempest skiplist
This remove all content of the tempest_skip_$branch but keep the file
with a warning pointing to openstack/openstack-tempest-skiplist.
The files remain because we are still in the proccess of moving

Depends-On: https://review.opendev.org/#/c/726773/

Change-Id: I7532b691732b119e89271b5a70fe6ec5696eeb6e
2020-10-12 18:40:08 +00:00
Slawek Kaplonski 085cc8a27a Revert "add ipv6 hotplug tests to skip list"
This reverts commit 393cac0970.

New OVN is now availble in the RDO so this test should be fine.

Change-Id: I46b966aba72d07f4961fca6914ac0cdbaa2fcdc0
2020-07-06 17:24:08 +00:00
Chandan Kumar (raukadah) c5f857606c Move TrafficOperationsScenarioTest to skip list
With octavia tempest tests, TrafficOperationsScenarioTest is failing
continously with ssh timeout. We are moving it to skip list for
train, ussuri and master release to enable octavia scenario
tests.

Related-Bug: #1883687

Change-Id: Ibe0aea3d2a45c66f62a32a940c4f52562085ca14
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-06-16 15:51:17 +05:30
Arx Cruz 0f3875d92c Remove horizon from skiplist
Horizon is supported on TripleO and having this job on skiplist make it
not run in the puppet-horizon-tripleo-standalone job

Change-Id: Ib71ccaa9f375c2c1dece18f58d34086516c7afa8
2020-06-09 18:11:42 +02:00
Rafael Folco 393cac0970 add ipv6 hotplug tests to skip list
full-tempest-scenario-master is conistently failing on
test_ipv6_hotplug:

neutron_tempest_plugin.scenario.test_ipv6.IPv6Test

Change-Id: I16ffef72673d5fdea46b2cb004757546e665c455
Related-Bug: #1881624
2020-06-01 14:04:45 -03:00
Bhagyashri Shewale dd702c2baf Remove octavia tempest tests from skiplist
This patch https://review.opendev.org/#/c/727739/ removed
the octavia tempest tests from master and train,
and it got missed during ussuri branching.

Here removed the octavia tempest tests from skiplist for ussuri.

Change-Id: Ib2659314e4b722e790ed7184460076c8b82cc34c
Signed-off-by: Bhagyashri Shewale <bshewale@redhat.com>
2020-05-27 16:01:36 +05:30
Rafael Folco 5a7f69b1a3 [skiplist] NetworkSecGroupTest timeout (train)
NetworkSecGroupTest timeout failures on train, producing
intermittent results.

To be investigated. Blocking train promotions on fs020.

Partial-Bug: #1878248

https://bugs.launchpad.net/tripleo/+bug/1878248

Change-Id: I107f169880c5bebeeeb61def0c4aadba4f8fa51a
2020-05-20 10:14:30 -03:00
Wes Hayutin e5bbd8803d add ussuri tempest skiplist
Change-Id: Icd713826a7e6533f2045b6c1481649aff45380e2
2020-05-18 11:50:02 +00:00
Zuul 7effb8308a Merge "Remove octavia tempest tests from skiplist" 2020-05-16 19:58:34 +00:00
Chandan Kumar (raukadah) c33163173d Remove octavia tempest tests from skiplist
Change-Id: I54a703bf2e79d789b2befd9e7426e7a534e15dc3
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-05-16 10:14:10 +00:00
Rafael Folco 790fd4a81a [skiplist] NetworkSecGroupTest timeout
NetworkSecGroupTest timeout failures on stein.

Partial-Bug: #1878248

https://bugs.launchpad.net/tripleo/+bug/1878248

Change-Id: I37592ca0f836d725570272c9a9020122bf83c9a7
2020-05-14 02:43:13 +00:00
Wes Hayutin e5b61ca995 Move test_port_security_disable_security_group to master skip
Related-Bug: #1869077
Change-Id: Id88e6f601b99faa7bff957404263742592f8c362
2020-03-30 20:15:08 +00:00
Marios Andreou 85d2f5ff34 Add VolumesSnapshotTestJSON test_volume_from_snapshot train skiplist
Adds the test_volume_from_snapshot test_volume_from_snapshot_no_size
tests to the train skip lists to unblock related-bug.

Related-Bug: 1864652
Change-Id: Ia01a495a85f533ff16bd60347a4ec0ac100aa591
2020-03-02 05:03:07 +00:00
Chandan Kumar (raukadah) 13fffef036 Revert "Add tempest.api.compute.images test_delete_saving_image to skip"
Depends-On: https://review.opendev.org/#/c/702808/

This reverts commit 50ae41cb84.

Closes-Bug: #1856723

Change-Id: I56a5cde56422093d7a2ddd30699cfcf3b5afd85f
2020-03-01 16:23:08 +00:00
Zuul b74529ce99 Merge "[Stein] Adding failing tests back to skiplist" 2020-02-18 21:59:30 +00:00
Zuul 270385c24c Merge "Revert "Unskip test_cross_tenant_traffic tempest test"" 2020-02-18 13:45:34 +00:00
Soniya Vyas 35c8399f5f [Stein] Adding failing tests back to skiplist
tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern
class has 'test_create_server_from_volume_snapshot' test failing.

So, just added above test back to skiplist
Related-Bug: #1863750

Signed-off by: Soniya Vyas<svyas@redhat.com>

Change-Id: Ia5790b7a86249c4a09ad290f0f76adb4d5c4ec52
2020-02-18 12:19:02 +00:00
Marios Andreou 094413ce1e Revert "Unskip test_cross_tenant_traffic tempest test"
This reverts commit 9e8f80b06d.
https://bugs.launchpad.net/tripleo/+bug/1856016/comments/15
blocks train promotion again

Change-Id: I4d5768de7d545a6117851a54139d7d1e12a85549
2020-02-17 15:10:20 +00:00
Chandan Kumar (raukadah) ece4dbc9f4 Unskip test_boot_server_from_encrypted_volume_luks from stein
Fixed is merged in this review https://review.opendev.org/706452

Closes-Bug: #1862142

Change-Id: I23dd5fc3855d1f538267e52f81c66ec11669373d
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-02-13 01:11:52 +05:30
Chandan Kumar (raukadah) 9e8f80b06d Unskip test_cross_tenant_traffic tempest test
It has started passing since we had updated tempest version
to 23.0.0 in Train.

Closes-Bug: #1856016

Change-Id: I98fdb2912c33a69aa543cf361a42664a782e7707
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-02-10 15:21:47 +05:30
Chandan Kumar (raukadah) a49edd82c4 Revert "update master skip list, nova issues and timeout"
# cinder-fix on tht
Depends-On: https://review.opendev.org/#/c/704805/

# ssh known host fix on tripleo-ansible
Depends-On: https://review.opendev.org/#/c/704880/

# Adding tripleo_role_networks on tripleo-common
Depends-On: https://review.opendev.org/#/c/704919/

Closes-Bug: #1861393
Closes-Bug: #1861296

This reverts commit 4a1526f8d4.

Change-Id: I888431e5d60591acb725a3e18ac133fa0cba496d
2020-02-09 11:12:49 +00:00
Chandan Kumar (raukadah) 699355b71b Updated tempest skip list for stein
Currently scenario 1 and 4 standalone stable/stein check and gate
job is broken due to volume encryption and swift related tempest
tests failure.

In order to unblock the gates, we are currently moving tests to
skip list.

Related-Bug: #1862143
Related-Bug: #1862142

Depends-On: https://review.opendev.org/#/c/706196/

Change-Id: Ieabc0d56e01ced15860da5642c9d62c620e9c0db
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-02-07 12:27:03 +00:00
Terry Wilson f8a8780009 Re-add agent list test
Change-Id: I66c0572dfa993425aad4c042d7d184039acb7005
Related-bug: #1855985
2020-02-03 20:19:25 +00:00
Chandan Kumar (raukadah) 734f93074e Remove Horizon tempest plugin from master
Horizon tempest tests is runned against puppet-horizon
in standalone job. It needs to be unskipped so that it should
run there.

Change-Id: I1fd455600f317b8be35dd80d0c29f3c092abd8bb
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-01-24 18:57:00 +05:30
Zuul 07692ad103 Merge "[Stein] Remove passing tests from skiplist" 2020-01-15 19:13:23 +00:00
Zuul cd44e94f7d Merge "[Rocky] Removed passing tests from skiplist" 2020-01-13 17:10:35 +00:00
Zuul 9fec48839d Merge "[Train] Remove passing tests from skiplist" 2020-01-13 12:08:48 +00:00
Zuul 7003294484 Merge "Unskip barbican tests so we can run them in scen2" 2020-01-10 19:48:36 +00:00
Soniya Vyas 5d393c80b8 [Stein] Remove passing tests from skiplist
Tests which are passing are being removed from the skiplist
with this patch.

Along with that, class
neutron_tempest_plugin.api.test_networks has maximum no. of
tests passing, so just kept failing test and other all tests
are removed.

Related-Bug: #1753209
Related-Bug: #1793482

Signed-off by: Soniya Vyas<svyas@redhat.com>
Change-Id: Iaf18f62f268b72148477a5416ac3b75a34344c75
2020-01-10 12:07:42 +05:30
Soniya Vyas f1b00f0475 [Rocky] Removed passing tests from skiplist
Class neutron_tempest_plugin.scenario has maximum
number of tests passed. Hence, it is removed and
only failing testsis kept.

In addition to above, added two more tests from
class 'TestSecurityGroupsBasicOps' and a test from
class 'ServersOnMultiNodesTest'

Related-bug: #1737940
Related-bug: #1753209
Related-bug: #1843259
Related-bug: #1793482
Related-bug: #1831223
Related-bug: #1857365

Signed-off by: Soniya Vyas<svyas@redhat.com>
Change-Id: I8239bb694187d7f912163742e836a7362cdb1483
2020-01-10 12:00:00 +05:30
Wes Hayutin 4a1526f8d4 update master skip list, nova issues and timeout
We'll need to update the bugs on this, but
for now we need to get fs020 running w/o
timing out. clearly there is an issue w/ nova

Related-Bug: #1858662
Change-Id: Ia30a3c07bbffc6d86539514b13aa258bd6eec8d8
2020-01-08 02:00:14 +00:00
Chandan Kumar (raukadah) f274615db5 Unskip barbican tests so we can run them in scen2
Barbican is configured in scenario02 standalone job and we need to
run it there, if it fails it needs to be added there as a skip list
as master skip list is runned in fs021 where barbican is not
configured.

It includes test_signed_image_upload_boot_failure barbican tests in
skip list and removes rest of the barbican test from there.

Related-Bug: #1820671
Closes-Bug: #1820668

Change-Id: I8b0cd11e5b884bde60f7f87479c2180649f3b95c
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-01-07 18:34:16 +00:00
Ronelle Landy 851fdafe3b Add failing tempest test to skip list
Queens and Rocky started failing fs020 recently.
Adding failing tempest tests to skip list to
allow time for failure investigation.

Change-Id: I7075f06923272bce67f9b5987e1a6c68c3372289
Related-Bug: #1857365
2019-12-23 13:45:09 -05:00
Marios Andreou 50ae41cb84 Add tempest.api.compute.images test_delete_saving_image to skip
Per related bug this adds test_delete_saving_image to maste skip
list as it often fails on race condition.

Change-Id: Ifea780d81ead74a25131a8f3f179cb967081c265
Related-Bug: 1856723
2019-12-18 11:43:55 -05:00
Soniya Vyas 361cc61be4 [Train] Remove passing tests from skiplist
Tests which are passing are being removed from the skiplist
with this patch.

Along with that, class
neutron_tempest_plugin.api.test_networks has maximum no. of
tests passing, so just kept failing test and other all tests
are removed.

Related-Bug: #1753209
Related-Bug: #1793482

Co-Authored-by: Soniya Vyas<svyas@redhat.com>
Co-Authored-by: Suraj Patil<surpatil@redhat.com>
Change-Id: I6a18555ba74018495daee5e5e6479bd2bd0427fd
2019-12-13 12:44:50 +05:30
Chandan Kumar (raukadah) c7eb7180a9 [Train] Move list_agent and traffic tests to skip list.
It is blocking our train promotion till then putting it in
skip list.

Related-Bug: #1856016
Related-Bug: #1855985

Change-Id: I0102c39c7ac8123d365a8fb34684615754e79b05
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-12-11 15:19:11 +05:30
Chandan Kumar (raukadah) c2da1fb75f [Stein] Updated neutron related dns tests to skip list
Recently dns-integrationg got enabled in stein, 3 skipped
tests started failing.

These tests are currently skipped in master also and it needs
to be fixed in master first then we can enable it.

We are currently putting it in skiplist to unblock the stein
promotion.

Related-Bug: #1854899

Change-Id: Ied6b5f973b2350c4b958fd049667e17d95eda5fd
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-12-03 15:22:55 +00:00
Ronelle Landy e1e470ae0e Revert "add test_security_groups.NetworkSecGroupTest to train skip"
This reverts commit 616b0f975b.

Change-Id: I8c6b55ff6c8bc72685e1bdb37e709319c8442dbe
2019-11-19 21:55:47 +00:00
Wes Hayutin 616b0f975b add test_security_groups.NetworkSecGroupTest to train skip
This test is not consistently passing both a full
deployment and standalone deployment. Let's
make the test more reliable if possible.

Related-Bug: #1852770
Change-Id: I8acbfddaf75e2b66de34d83aa9904f03e7d45397
2019-11-15 16:57:09 +00:00
Zuul b91bfb047b Merge "Adding tests to skip list in Rocky" 2019-10-05 23:09:11 +00:00
Arx Cruz 62babbfe37 Adding tests to skip list in Rocky
The two tests added to skip list are failing on featureset020. A
launchpad bug is open and the responsible team are investigating. Once
get fixed, we will remove from skip list.

Related-Bug: 1843259
Change-Id: I3aaa38ff0180826a6e749d0686d1a0e37e97eb84
2019-10-01 07:28:47 +00:00
Chandan Kumar (raukadah) 5ceb002005 Added train release tempest skip list
It is a copy of master release skip list as train is brached
from master.

https://tree.taiga.io/project/tripleo-ci-board/task/1299

Change-Id: I539d173693890710cef7ff5f5021ded7ae557c91
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-09-25 12:01:42 +05:30
Alan Bishop c5a6d012a1 Increase size of cinder LVM backend
Increase the size of the cinder LVM backend to 20GB, and re-enable
tempest tests that were previously skipped due to space limitation.

Tempest's volume tests don't actually need 20GB of storage, but rapidly
creating and deleting volumes in a short time span may cause cinder's
scheduler to report a reduced amount of free space. The actual amount
of space in use is updated by the cinder-volume service, but this is
done periodically. Increasing the size of the LVM backend allows the
scheduler to sustain a burst of volume creation requests during the
time interval between updates from the volume service on the actual
amount of storage in use.

Closes-Bug: #1841071
Change-Id: Ie02211f3a6706f6fa1102fb8dc5ee0e9e54252cc
2019-08-27 09:05:51 -07:00
Zuul f8b2ad7897 Merge "remove 1831866 from the skip list" 2019-08-25 12:24:46 +00:00
Chandan kumar c1801751ef Move SnapshotsActionsTest to master skip list
These tests are failing randomly due insufficient free virtual
space (-12.0GB) to accommodate thin provisioned 1GB volume on
host hostgroup in Cinder. Increasing LVM space does not fix the
actual issue.

Investigation is in-progress. Adding it to skip list for master
promotion.

Depends-On: https://review.opendev.org/#/c/674556/

Related-Bug: #1841071

Change-Id: I0e73bc0e4b1abb761c2f5f470297b2f16928021c
Signed-off-by: Chandan kumar <chkumar@redhat.com>
2019-08-23 13:14:17 +00:00
Chandan Kumar (raukadah) 0e51e3492c Remove VolumesSnapshotTestJSON from stein skip list
In https://logs.rdoproject.org/openstack-periodic-latest-released/
opendev.org/openstack/tripleo-ci/master/
periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset021-stein/83bbe80/logs/tempest.html.gz

tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON
is passing in fs021.

Closes-Bug: #1753211

Change-Id: I9e9472b2a2de8f92dab50f4fe2ab6df1cd3d87d9
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-08-08 12:15:45 +05:30
Wes Hayutin f105c24410 remove 1831866 from the skip list
https://bugs.launchpad.net/tempest/+bug/1831866
is fixed released.

Change-Id: I77ae608e6e8b2627bbda22afb4167bed9bfaa257
2019-06-27 10:56:51 -06:00
Kamil Sambor 26f3127b2e Skip dns related tests
In ovn recently dns dependent tests were enabled.
For some of them we need to add additional configuration
and for another one we are waiting for OVS 2.12 to be
released.

Change-Id: I8c5a316145dda6497971be46f75370511a8f2103
Partial-Bug: #1832166
2019-06-11 17:56:21 +00:00
Chandan Kumar (raukadah) a5dae7beee [ROCKY] put test_resize_server_revert in skip list
tempest.api.compute.servers.test_server_actions.
ServerActionsTestJSON.test_resize_server_revert test is failing with
the VIF creation failure, is a known issue as per the bug
https://bugzilla.redhat.com/show_bug.cgi?id=1678681

Adding it to skip list to unblock promotion pipeline.

Related-Bug: #1831223

Change-Id: I77a35f7092617f5ef707a869c01b215057a0eb4b
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2019-06-07 19:32:36 +05:30