Commit Graph

79 Commits

Author SHA1 Message Date
Takashi Kajinami 46a6d5fa4b Remove references to Neutron LBaaS tests
... because these tests are already removed.

Depends-on: https://review.opendev.org/c/openstack/heat-tempest-plugin/+/896184
Change-Id: I34f75971fec826032377c47bf7b4e7a380522b8f
2023-12-17 00:37:49 +00:00
Takashi Kajinami 0e51506419 Bump Fedora image used in CI
Fedora 36 is already EOLed so we should use more recent version.

Because guest enters to emergency shell when Fedora 38 (latest at
the time of writing) is used, we select Fedora 37 for now.

Change-Id: Ie0876080c771fb124d4dd36f803fbfd3b108e240
2023-09-07 21:20:31 +09:00
Matthias Runge 78244c5f0f Use f36 instead of f33 for testing
F33 is unsupported for a while. We should not use it for any testing.

Change-Id: I7d1017bcd7147329c4e187336daee1a1ae280fa9
2022-05-31 10:35:53 +02:00
Matthias Runge 6a9c35d898 Move testing to Fedora 33
Now that the gate is unblocked, we can also test F33 for gating purposes
here.

Change-Id: Ie1c9075623d85b27aaf1ac67a3063e219726bc6f
2021-01-19 16:38:43 +00:00
Matthias Runge 61e53c4eca Replace Fedora test image with F32
Fedora 31 was retired and the image is gone from mirrors.
heat-cfntools have been dropped from fedora images, disable
the test till that's resolved.

Also makes grenade job non-voting, till this is backported
to stable/victoria.

Change-Id: Id869f83a46454897c2fe7a532eebfa2863befe5e
2020-12-04 12:18:59 +05:30
Rabi Mishra f18a676792 Use Fedora 31 for tests
Change-Id: Ia45e957bb24f5596a5ef16271f71ba8b77df9e42
2020-05-12 11:28:31 +05:30
ricolin c61170e4e8 Update Fedora image ref for test jobs
Fedora-Cloud-Base-29-1.2.x86_64 is removed from openstack local mirror.
Update to use Fedora-Cloud-Base-30-1.2.x86_64 for test jobs.

Change-Id: Id3026a115e3a044b3dc00030fd6d82549dc189b6
2020-02-24 16:00:19 +00:00
ricolin fdb5e892bf Add doc for multi-clouds support
Add doc for multi-clouds support in template guide.

Also remove redundant credential information in multi-clouds
integration test.

Change-Id: I76c6427b7bbdac2af3b7f01aff1b0541e56b3653
Story: #2002126
Task: #19808
2019-06-25 07:37:27 +00:00
Rabi Mishra 46f595b462 Fix grenade regression introduced by multicloud support
Fixes grenade job regression introduced by commit
6990331639.

Change-Id: Ic2b782cd0a6e27c43d741ccf3864ecbcf543dc27
2019-04-10 09:11:40 +05:30
ricolin 6990331639 Support remote stack with another OpenStack provider
Allow OS::Heat::Stack to access remote stack from another OpenStack
provider. Also enable functional tests for multi-cloud.

Implement multi-cloud support as an extension to the existing multi-region
support. Allow operate a remote stack (from another OpenStack cloud) as a
resource in stack from local OpenStack cloud.

I propose we add multi cloud support into ``OS::Heat::Stack`` and change the
property schema for ``context``. Within context, we should adding
following properties:

* credential_secret_id: ID of Barbican Secret. Which stores authN
  information for remote cloud.

Service will use auth information from Barbican Secret to access
 Orchestration service in another OpenStack.
Must make sure you're able toget that secret from Barbican service when
provide `credential_secret_id` property.

Story: #2002126
Task: #26907
Depends-On: https://review.openstack.org/579750

Change-Id: I2f3de3e7c29cf7debb1474228c8a9a81725a72ed
2019-03-13 22:15:45 +08:00
Zane Bitter ef8d50856f Remove VolumeBackupRestoreIntegrationTest from skip list
We cannot run this test in the gate because the volume backup feature is
enabled. However, with a change to the Heat tempest plugin to allow this
feature to be automatically skipped based on the tempest config, we no
longer need this test to be explicitly included in the skip list.

Change-Id: Iaefa5c272c4322498330307ea9bd6843d276ef1b
Depends-On: https://review.openstack.org/632989
2019-03-08 02:53:19 +00:00
Rabi Mishra 84c908ca9e Add disk size to the flavors
Nova has added a default policy
os_compute_api:servers:create:zero_disk_flavor to admin-only,
that will prevent non-admins from creating image-backed servers
with a flavor that has disk=0 which is potential a security
exposure.

Add appropriate disk size to flavors we use in tests.

Change-Id: I9c0af0b40fc5b5c33de7f0c690d156ed2bac2f15
2019-02-15 20:35:29 +05:30
Rabi Mishra a2f74772e1 Add heat-agents as required project
We removed[1] these scripts from heat-templates.

[1] https://review.openstack.org/#/c/584777/

Change-Id: I6f0989a5cf4cf6253ff64a8c3c1ea023dd8b6db7
2019-01-03 18:16:52 +05:30
Rabi Mishra 8cbc8ccf6b Bump minimal_image_ref
Devstack bumped[1] the cirros image version. Changes
to source the old openrc file for grenade before configuring
tempest.

[1] https://review.openstack.org/#/c/624716/

Change-Id: I9481bbcb03609db6d2224998a4f83d3a8790e96c
2018-12-19 15:39:36 +05:30
Rabi Mishra b5333aea94 Use fedora 29 image from nodepool mirror
It seems fedora 27 cloud images are not available.

Change-Id: I199afcbaa5050226a333779ac22aea3451f94b04
2018-11-28 13:05:31 +05:30
Zane Bitter e0dc017fe6 Update comments on skipped tests
SoftwareConfigIntegrationTest has been skipped since
20f17ec25b.

test_server_signal_userdata_format_software_config has not been skipped
since e50ce9c6e2.

Change-Id: I71c70ff516d2d4cbd0aef2a3833c6f7bd4cc3984
2018-06-08 18:19:47 -04:00
rabi 4748dbc4b1 Stop testing neutron-lbaas in gate jobs
neutron-lbaas has been deprecated since long. Let's remove the
service from gate jobs and skip the relevant tests.

Change-Id: I8eede46ed2ad014522e00d28b0b7c0b194a0b996
2018-05-31 10:04:21 +05:30
Pavlo Shchelokovskyy 98d59011cb Configure hidden tag for tempest test
Change-Id: I09d4a6556d749c9d034163cdc8fb7ff24aa6a659
Partial-Bug: #1757117
2018-03-20 14:06:01 +02:00
Kien Nguyen 5b8cbd5895 Run the specified set of tests in grenade-multinode job
This patch defines the specified set of tests & runs these during
upgrade in grenade-multinode job.

Change-Id: I99fa1717f4bf46afc8dd989a3aae129e5c4ab9d7
2018-03-02 12:16:51 +07:00
Zuul 589a905ea6 Merge "Unskip StackCancelTest" 2018-02-26 12:34:12 +00:00
ricolin c6e6196e69 Unskip StackCancelTest
python-heatclient is bumped, time to resume this test.

Change-Id: Ieebe6a6cb99ece42fd06f1bb6626ffb37dec1f6d
2018-02-07 14:38:35 +08:00
ricolin da393a23cd Update test image
update test image to use `Fedora-Cloud-Base-27-1.6.x86_64`

Change-Id: I162b3a760031c5144525e96512db7b82ff02bc65
2018-01-29 21:14:55 +08:00
ricolin 76891d4a99 Remove ReloadOnSighupTest
Most jobs now run with apache+uwsgi, so the test has no significance.
Also we don't test it anymore.

Depends-On: I022077c92bc10e908c7fe549ed555ad0194e0704
Change-Id: I6d6e025f60867e5128704f54e5e793762f6c1b8a
2018-01-26 17:51:00 -05:00
ricolin aed1e6f368 Remove integration and configuration tests
This patch propose to use heat tempest plugin for Integration tests
(with no co-gating potential) and configuration tests.
Also we will remove test_autoscaling_lb from tempest plugin as well,
since it's no longer been used.
Remove senario base, since we now move all senario tests to plugin.

Change-Id: Ice6a0e1fe8ce2e1de5253c674d11949b0f8a6e31
2018-01-26 17:50:58 -05:00
ricolin ba86129965 Remove potential co-gating integration tests
This patch propose to use heat tempest plugin for potential
co-gating integration tests.
These tests are consider as potential co-gating. And we now
already maintain them in heat tempest plugin.

This also disables all except two of the gate/test jobs, to enable us to
land this series and stop the carnage. The jobs will be re-enabled once
all of the duplicated tests have been eliminated.

Change-Id: I55e204b72cd5a2876576852b10ad09f24d04beb4
2018-01-26 17:50:26 -05:00
ricolin 41cc012b34 Allow run tests for both tempest plugin and regression tests
Regression tests will be maintained in-tree. See categries list:
https://etherpad.openstack.org/p/heat-integration-test-categories

We will seperate tests to tempest plugin or in-tree base on conditions
of each tests. So we need to rework on framework for integration tests.
This patch propose following changes:
* This partially reverts commit fff6518e69
* Allow running heat tempest plugin and heat regression tests.
* iniset configs to both heat_integrationtests.conf and tempest.conf

Change-Id: Ief31dc961bc108e2863119598dfb16581a38e9cf
Depends-On: I5e9325766ce166e62c731330c462c030cb1e11fc
Co-Authored-By: Zane Bitter <zbitter@redhat.com>
2018-01-19 13:26:25 -05:00
rabi 0cbfac7a99 Use heat-tempest-plugin for integration tests
Note: We still have to change grenade jobs to use
the plugin, before removing the plugin from tree.

Change-Id: Ie63f25e724ed3fbd42adcf5bb2d625c2fec67df1
2017-11-25 10:34:53 +05:30
Zuul 48f75a2341 Merge "Fix AodhAlarmTest to use gnocchi" 2017-11-14 08:20:53 +00:00
rabi 3adca03db6 Set stack.thread_group_mgr for cancel_update
In change I84d2b34d65b3ce7d8d858de106dac531aff509b7, we changed to
call self._converge_create_or_update() in a sub-thread. However,
thread_group_mgr is not set for cancel_update (with rollback),
which in turn calls converge_stack.

This also enables test_cancel_update_server_with_port, as
bug #1607714 seems to be fixed now.

Change-Id: Ie674fd556418f6aa8e79654458cbe43648851db2
Closes-Bug: #1713952
2017-11-03 09:14:46 +05:30
rabi 92be54ca53 Fix AodhAlarmTest to use gnocchi
This changes the test to use AodhGnocchiAggregationByMetricsAlarm
and add measures using gnocchi api.

Change-Id: I0b2fe154b93d9882b703e95a0b09f139697ceb9a
Closes-Bug: #1727637
2017-10-30 11:27:37 +05:30
rabi 7151b5c949 Skip AodhAlarmTest
It seems ceilometer api has been removed[1].

As part od zuulv3 transition we are moving jobs to project repo[2]
and change to enable gnocchi devstack plugin at the gate has to wait
till the movement is complete.

We probably have no other option but to disable the test for the
time being.

[1] https://review.openstack.org/#/c/512286/
[2] https://review.openstack.org/#/c/509098/

Change-Id: I547b26ea78ad70742ae6fcf9a0eae4cd4af60100
Related-Bug: #1727637
2017-10-26 13:28:47 +05:30
Zane Bitter dfd34a00f3 Allow convergence-specific Tempest tests
Add a "convergence_engine_enabled" configuration option to the functional
tests' Tempest plugin. The option is enabled by default, but can be
disabled by setting the DISABLE_CONVERGENCE environment variable to "true"
when running prepare_test_env.sh, so that if convergence is disabled in
devstack it will also be disabled in Tempest.

This will allow us to write functional tests for convergence-specific (or
non-convergence-specific) behaviours.

Change-Id: If3a37de75467d50af10582215e16611e59a4ad06
2017-10-05 14:19:32 -04:00
rabi 9762cc6ac4 Skip test_notifications.NotificationTest.* functional tests
Change-Id: I4cb4b03adef132c11ca664676b6e03ad3efe60d2
Related-Bug: #1721202
2017-10-04 13:26:18 +05:30
rabi 4c1dac7d3a Unskip StackSnapshotRestoreTest
Bug #1694371 seems to be fixed now.

Change-Id: I80b703742c22a253f9c198680ee3d4c9be6efab9
2017-08-23 14:42:08 +05:30
Mohammed Naser a47e342f4d
Switch integration jobs to use local mirrors
The integration jobs currently download images from a third party
mirror which can be slow at times or use up a lot of bandwidth.

This patch tries to automatically detect if nodepool mirrors are
active and uses them, falling back to the global round-robin mirror
of the Fedora project instead of a specific mirror.

Change-Id: Ie111c20b6dd0efe2e1cbfcac2a46b27ce6bc20c0
2017-08-10 16:46:59 -04:00
rabi 3ae539bbf9 Fix barbicanclient and glance upload issue
It seems for py35 job barbicanclient is installed from source.

Ib91e7049de007f4d4254abcd4c125b4dc7e03c55 has made some backward
incompatible changes.

This also changes to upload images using $IMAGE_URLS, so
the images are stored locally and then uploaded.

Change-Id: I9d3d9dabdfca0442bd17f93ce69ef9753049dc23
Closes-Bug: #1704725
2017-07-18 11:30:35 +05:30
rabi 645c58b12f Revert "Revert "Enable heat to use uwsgi with devstack""
This reverts commit 73ff2f16c4.

Change-Id: I11200efe50db94d62cef474c248d78e9a3aa1673
2017-07-07 11:00:04 +05:30
Mehdi Abaakouk (sileht) 73ff2f16c4 Revert "Enable heat to use uwsgi with devstack"
It looks like heat is not ready to work inside a prefix.

Telemetry gate is broken since this change. The signal urls generated by heat are wrong and doesn't have the url prefix.

http://logs.openstack.org/44/468844/28/check/gate-telemetry-dsvm-integration-ceilometer-ubuntu-xenial/519194e/logs/screen-aodh-notifier.txt.gz#_Jun_07_08_45_46_995420

This reverts commit c74db66934.

Change-Id: I4cbff7c947defbe10777d63a975e0971732a0c6a
2017-06-07 11:36:11 +00:00
rabi c74db66934 Enable heat to use uwsgi with devstack
This change ensures that api services deployed with apache+uwsgi
by default with devstack. User can still deploy apache+mod_wsgi
by setting WSGI_MODE=mod_wsgi in local.conf.

Using HEAT_USE_APACHE=False or HEAT_USE_MOD_WSGI=False
(for backward compatibility) would deploy the services
without apache.

Change-Id: Ia5e28e2987b4aeab6c049a3bde3a956204ddc5d9
Depends-On: I3b77aafc6104119503363e5db36b0379964daba5
2017-06-05 05:49:22 +00:00
rabi f8cb5aebe0 Skip StackSnapshotRestoreTest
Change Ica5f87614f5fb98f253d65cbd4355dcc7c6714eb adds it to the
list of scenario tests to skip, whereas it's a functional test.

Related-Bug: #1694371

Change-Id: I84e806bad284cffb32e68fef6b14dfff11dba846
2017-06-01 12:04:20 +05:30
Thomas Herve c8e1e82bd6 Skip snapshot integration tests
Change-Id: Ica5f87614f5fb98f253d65cbd4355dcc7c6714eb
Related-Bug: #1694371
2017-05-31 11:25:06 +02:00
Crag Wolfe e50ce9c6e2 Bring back signal-related tests
Reverts I90e1d26a67a349f897d895f750d8e57fae98ec1f and
I116a96b20082d1c47068ddc64873200e9ae33a27 .

There have been a few changes that should enable these tests to
succeed on a regular basis, all related to edge cases around updating
a resource's atomic_key and metadata:

Corrected max secs for concurrent trans retries
e37d9fab8f

Don't set metadata for deleted resources
8d7e3e41e8

Allow retries when resource acquires lock
2ec2d5a973

Change-Id: I0fe508cf102bc1041a16c5ce1d9e384ecd591173
2017-05-04 22:53:09 -04:00
rabi eed9cf85ca Add auth_version config option
Change-Id: Iba84890437a0b7ba0fa00a9bd893fe2ef7f9b797
Closes-Bug: #1683995
2017-04-19 09:32:02 +05:30
rabi f6c1203b51 Use project_name/admin_project_name config option
This deprecates the tenant_name and admin_tenant_name config option
for integration tests.

Change-Id: Iabc56ddabeeda36d27ea3c9ce04c71e13be676d7
2017-04-11 10:29:26 +05:30
Thomas Herve 18ae017d16 Switch image mirror
The current mirror doesn't work anymore.

Change-Id: I5b05d64d3dc9365aea24cd2e94894872ce6e4f94
2017-02-28 10:41:38 +01:00
rabi efdb00d628 Change minimal_image_ref to cirros-0.3.5-x86_64-disk
Change-Id: I0dde84d2f15e3834f7cf444e1f833f8076f507cc
Closes-Bug: #1665210
2017-02-16 04:23:10 +00:00
rabi 922f51ed06 Skip test_server_signal_userdata_format_software_config
This test is failing very often with timeout, let's
skip it until the issue is resolved.

Change-Id: I116a96b20082d1c47068ddc64873200e9ae33a27
Related-Bug: #1651768
2016-12-22 11:44:41 +05:30
rabi 35c6ee5ac4 Use both domain id and name
devstack has made keystone v3 the default, it seems
the env variables for domain names are not set.

Change-Id: Ief9314b81f8b7624ceb390c432d6487fce5b4a5e
Closes-Bug: #1646343
2016-12-01 12:21:45 +05:30
rabi ea3eb60f90 Skip test_cancel_update_server_with_port
Skip test_cancel_update_server_with_port till bug 1607714 is
fixed in nova. Related tempest nova tests are skipped
currently[1].

[1] https://review.openstack.org/#/c/348955/

Change-Id: Id08866d5b428a64778423892455495c0182335af
Related-Bug: #1643268
2016-11-21 10:49:31 +05:30
Thomas Herve 5c0b9d4e45 Switch fedora mirror
Use a IPv6 enabled fedora mirror to check if your failure rate
decreases.

Change-Id: I749e2981d52b6dd67e87121bff0e08723c3052ff
2016-09-28 17:40:22 +02:00