Commit Graph

34 Commits

Author SHA1 Message Date
Balazs Gibizer 3c1d9dab85 Move live_migration test hooks under gate/
This patch resolves a TODO in the .zuul.yaml about using common
irrelevant files in our dsvm jobs. To be able to do that we need to move
the test hooks from nova/tests/live_migraton under gate/.

Change-Id: I4e5352fd1a99ff2b4134a734eac6626be772caf1
2019-08-29 14:45:48 -04:00
ZhongShengping 7ecaa3fcf8 Replace git.openstack.org URLs with opendev.org URLs
Thorough replacement of git.openstack.org URLs with their opendev.org
counterparts.

Change-Id: I3e0af55e0707f04428a422b973d016ad30c82a12
2019-04-24 13:59:57 +08:00
Ian Wienand 1623502eb1 Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I913aafeeca1569bc244347bc630762f5a6cc072e
2019-03-24 20:34:42 +00:00
melanie witt 9b2a7f9e7c Re-enable Ceph in live migration testing
Revert I05182d8fd0df5e8f3f9f4fb11feed074990cdb9f and
Add fix to enable proper OS detection.

Closes-Bug: #1819944

Co-Authored-By: Jens Harbott <j.harbott@x-ion.de>

Change-Id: Iea6288fe6d341ee92f87a35e0b0a59fe564ab96c
2019-03-14 18:48:55 +00:00
ghanshyam f8b578b2ac Skip the ceph based live migration testing
While moving the legacy jobs on Bionic[1], it is found
that ceph pckg hammer is not available to download
on bionic and it error with 404. Due to that job testing the
live migration on ceph not working:
-  nova-live-migration skip the ceph live migration testing[2]
-  nova-grenade-live-migration fail due to no ceph pckg[3]

To proceed further on Bionic migration which is blocked by these failure,
this commit temporary skip the ceph live migration testing until
bug#1819944 is fixed.

Related-Bug: 1819944
[1] https://review.openstack.org/#/c/639017
[2] http://logs.openstack.org/17/639017/8/check/nova-live-migration/87084aa/logs/devstack-gate-post_test_hook.txt.gz#_2019-03-13_14_34_20_967
[3] http://logs.openstack.org/17/639017/8/check/nova-grenade-live-migration/735242b/logs/devstack-gate-post_test_hook.txt.gz#_2019-03-13_15_00_32_310

Change-Id: I05182d8fd0df5e8f3f9f4fb11feed074990cdb9f
2019-03-13 18:05:54 +00:00
Matt Riedemann 7f16800f71 Replace ansible --sudo with --become in live_migration/hooks scripts
Ansible deprecated --sudo in 1.9 so this change replaces
it with --become.

Change-Id: I40f40766a7b84423c1dcf9d5ed58476b86d61cc4
2019-02-20 14:47:42 -05:00
Zuul 5c18dc108e Merge "Change live_migration_wait_for_vif_plug=True by default" 2019-02-14 19:24:33 +00:00
Matt Riedemann 1a42eb9ec1 Change live_migration_wait_for_vif_plug=True by default
This resolves the TODO to make the option default to True
so that the source compute service will wait for the
"network-vif-plugged" event, initiated by vif plugging during
pre_live_migration on the destination compute servie, before
initiating the guest transfer in the hypervisor. There are
certain networking backends that will not send the neutron
event for vif plugging alone (which is arguably a bug) but
OVS and linuxbridge, probably the two most widely used in
OpenStack deployments, are known to work with this config.

While in here, the Timeout message is fleshed out to give
more help with what the cause of the timeout could be and
possible recourse.

Change-Id: I8da38aec0fe4808273b8587ace3df9dbbc3ab576
2019-02-07 11:43:01 -05:00
Matt Riedemann f2db43d57a Fix legacy-grenade-dsvm-neutron-multinode-live-migration
Since change I81301eeecc7669a169deeb1e2c5d298a595aab94 in
devstack, nova-cpu.conf is a copy of nova.conf minus
database access. Grenade jobs also run nova-compute with
nova-cpu.conf anyway so we can just drop the conditional
which was otherwise messing up the config file that the
ceph script would write rbd configuration which is why
live block migration tests with ceph were failing.

While in here, the zuul job configuration is updated so
that changes to nova/tests/live_migration/ can be
self-testing.

Change-Id: I902e459093af9b82f9033d58cffcb2a628f5ec39
Closes-Bug: #1813216
2019-02-06 15:44:35 -05:00
Matt Riedemann 8327011f91 Add post-test hook for testing evacuate
This adds a post-test bash script to test evacuate
in a multinode job.

This performs two tests:

1. A negative test where we inject a fault by stopping
   libvirt prior to the evacuation and wait for the
   server to go to ERROR status.

2. A positive where we restart libvirt, wait for the
   compute service to be enabled and then evacuate
   the server and wait for it to be ACTIVE.

For now we hack this into the nova-live-migration
job, but it should probably live in a different job
long-term.

Change-Id: I9b7c9ad6b0ab167ba4583681efbbce4b18941178
2018-10-25 16:15:56 -04:00
Matt Riedemann d1859915ab Stop setting glance_api_version in cinder.conf in nova-live-migration
The glance_api_version config option was removed from cinder
in Queens [1] so we can stop setting it during the
nova-live-migration CI job.

[1] https://docs.openstack.org/releasenotes/cinder/queens.html

Change-Id: Ifbadce909393268b340b7a08c78a6faa2d7888b2
2018-07-03 09:55:26 -04:00
Matt Riedemann 73ad42afbd Wait for vif plugging during live migration job
The nova-live-migration CI job uses OVS which sends
vif plugged events to the source host during live
migration when the destination host plugs vifs
during pre_live_migration. We can set the
live_migration_wait_for_vif_plug option to True
so that the source host waits for the vif to be
plugged and get the event from neutron before
starting the actual guest transfer in the hypervisor.

This is really just about coverage of this code
in a live environment so we don't regress it.

Change-Id: I3d7770589a1526e851d5764214c26ec1a9a8fd43
2018-07-03 09:52:19 -04:00
Matt Riedemann 3e3309672f Fix live migration grenade ceph setup
Grenade runs in singleconductor mode for queens
as of change:

  If4c82ca12fe7b8b1ca7cfd8181d24dbd8dad3baa

However, the nova configuration during ceph setup
was using NOVA_CPU_CONF which is /etc/nova/nova-cpu.conf,
which is not what we want when configuring nova.conf
for the compute service in singleconductor mode.

Devstack has similar logic for stuff like this, so
we just have to handle it here since we're in a special
snowflake.

The stable/queens systemd stuff is all removed too since
we run with systemd on the old pike side and can restart
services properly with systemd on the new queens side
during grenade live migration CI job runs.

Change-Id: Iccb8eb55a5cc2a3d08e7fd6e31c89b3b5f8d0c70
Closes-Bug: #1720191
2017-10-26 17:53:15 -04:00
Matt Riedemann 1328a50e2c Revert "Enable test_iscsi_volume in live migration job"
This reverts commit 1032c79238.

This wasn't actually ready to merge, and now that it has
we're seeing a spike in failures of test_iscsi_volume.

Change-Id: I74649dd63ef82a356b829ea01b2e74640dc6f11c
Related-Bug: #1398999
2017-09-14 17:30:18 +00:00
Matt Riedemann 1032c79238 Enable test_iscsi_volume in live migration job
The block_migrate_cinder_iscsi config option in Tempest says
the libvirt driver doesn't support live migration with an attached
volume because of bug 1398999 where volumes live on a network share
like RBD. However, I8fcc3ef3cb5d9fd3a95067929c496fdb5976fd41 in
nova says that this is possible with libvirt >= 1.2.17. Since we are
using libvirt 2.5.0 from the Ubuntu Cloud Archive on Xenial nodes
now, we should be able to enable this test.

Change-Id: I7d7a708b231070468616ae852d81d2f8b01ba568
Related-Bug: #1398999
2017-09-07 16:17:14 +00:00
Matt Riedemann 85105d9d22 nfs fix for xenial images
for Xenial there is no need to restart idmapd

Closes-Bug: #1590929

Change-Id: I50b1e72a787b0fcb80ac30bdba622afcad3c47be
2017-06-07 21:04:45 +00:00
Dan Smith 8d30fbf228 Fix live migration devstack hook for multicell environment
This just fixes up the ceph live migration test hook code to use the
config that nova-compute is using if we're in a multicell environment.

Change-Id: Ibc4b21089ef86ab2430874c39d63174528c9a83e
2017-05-31 12:10:12 -07:00
Matt Riedemann 994caa464e Skip ceph in grenade live migration job due to restart failures
Chnage I914430d68f64d29932c9409d055b15e4cb384ec4 made the
live migration scripts assume everything is running under systemd,
which is fine for the non-grenade job since devstack on master (pike)
defaults to run everything under systemd.

We missed, however, that the grenade live migration job is starting
from Ocata where screen is used by default, so when we get to the ceph
part of this job in the grenade setup, trying to restart glance-api
via systemctl fails since it's running under screen, not systemd.

For now we'll just skip the ceph live migration setup in the grenade
run until either the bug is fixed or until Queens is our master branch,
at which point the old side for grenade is Pike and running under
systemd.

Change-Id: Ia0ec32dc7cfe744b21b926949c4ab046f9417bc7
Related-Bug: #1691769
2017-05-18 18:55:05 -04:00
Sean Dague 4eec543090 remove unused functions
This removes all the odd start / stop functions that should not be used

Change-Id: Idc5c0ca929b5f53bf55cbcf4297a590e7e0e2eff
2017-05-02 10:36:30 -04:00
Sean Dague e59eee6db5 Use systemctl to restart services
The restart code for the live migration configure on the fly tests was
really really fragile clippings of old bits of devstack code that
barely worked (and assumed a very specific run environment).

Given that we're going to get rid of everything other than systemd in
devstack, just jump straight to using systemd primitives here. This
dramatically simplifies the code, and will ensure things actually
restart correctly.

Closes-Bug: #1687511

Change-Id: I914430d68f64d29932c9409d055b15e4cb384ec4
2017-05-02 14:20:35 +00:00
Clark Boylan ea8463679c Fix libvirt group selection in live migration test
The custom start scripting for the nova compute service assumed that the
libvirt group is "libvirtd". Unforately libvirtd is no longer used by
debuntu as they use "libvirt". Add a simple check against /etc/group
for an existing libvirtd user otherwise use libvirt.

Change-Id: Idbda49587f3b62a0870d10817291205bde0e821e
Depends-On: If2dbc53d082fea779448998ea12b821bd037a14e
2017-04-12 15:48:43 -07:00
Timofey Durakov e83a357234 Fix for live-migration job
Commit 9293ac0 to devstack-plugin-ceph altered
CEPH_LOOPBACK_DISK_SIZE_DEFAULT variable initialization
This fix added source for setting this variable in correct way.

Closes-Bug: #1646418

Change-Id: I84c3b78c53cfa283e9bcb7cf4b70ec6c95044e9c
2016-12-01 09:54:00 +00:00
Timofey Durakov 19a52c9eb9 Remove ceph install/config functions from l-m hook
Since ceph installation and initial config is done
by devstack-ceph-plugin, duplicate functions could be
safely removed from l-m hook

Change-Id: I23a8a8d414fb43b6758485a5a6df4a771abdefce
2016-11-14 15:08:29 +03:00
Timofey Durakov b71cedadf1 Ceph bits for live-migration job
This change re-enables ceph for glance and nova
ephemeral disks.

Change-Id: I6104d22855de58241a15e23916e43ff2193e15ae
2016-11-14 15:08:00 +03:00
ghanshyam a83613946d
Use tempest tox with regex first
This commit add regex first while running tempest tox

There is changes in way tempest tox runs tests by using the tempest run
command directly instead of some bash script.

With tempest run you specify a regex with a '--regex' parameter and to
keep backwards compatibility this is added to the tempest tox
definitions.

But in Nova tests scripts it is being used after concurrency and ends up
having a call equivalent to:

  tempest run --regex --concurrency=2 $tempest_regex

which obviously is incorrect. Simply switching the arg order should work here.

Change-Id: If0064b9e8358332972ef4a1eee8f150e66f8c50f
Needed-by: I3684fce66a799579fa68af119652cafef25a9f03
2016-09-14 09:32:53 -04:00
Timofey Durakov 2f68cd3e9f Skipping test_volume_backed_live_migration for live_migration job
For non-shared storage live-migration job is unstable due to
https://bugs.launchpad.net/nova/+bug/1524898. This patch temporary
exclude this test from tests to be run.

Related-Bug: #1524898

Change-Id: I87559b8e90855837ad7b5f291bd9a8fc646421d3
2016-08-11 10:03:16 +00:00
Jenkins cc9e884106 Merge "Skip NFS and Ceph in live migration job test run" 2016-06-14 19:48:46 +00:00
Matt Riedemann 69760332f9 Skip NFS and Ceph in live migration job test run
The NFS and Ceph setup is currently broken on the Ubuntu 16.04 nodes
so until that's sorted out let's skip them.

Related-Bug: #1590929

Change-Id: I454ffb43450490503d988eff2654878670e5c35c
2016-06-14 14:11:20 +00:00
Jon Bernard 9572066490 live-migration ceph: fix typo in ruleset parsing
The rule_id line is formatted as:

"rule_id": 0,

Which means the id integer is the second column of the parsed output,
not the third.

Since a third column doesn't exist, the call to cut returns nothing,
leaving $RULE_ID invalid, which then causes the subsequent ruleset
commands to fail.

We don't see this normally because $CEPH_REPLICAS is set to 1 by
default.

Change-Id: I3255f9421119aafb7407ba7443400bd3ace0d827
Closes-Bug: #1581159
2016-05-12 14:10:16 -04:00
Timofey Durakov 4f86e277e2 Ceph for live-migration job
Added test runs for configurations:
- ceph for glance/nova
- ceph for glance/nova/cinder

Change-Id: I1753d2e42c1b53da78cc4f9e0a43d460cc89c78b
2016-01-22 16:27:58 +03:00
Timofey Durakov a51e1fff59 live-migration hook ansible 2.0 compaitability
since ansible 2.0 is released replace module need to be changed with
ini_file and '=' symbols require escaping to make hook works again

Change-Id: I51e6336a4766cb62d4bce76d30d51280f12c578a
2016-01-13 23:40:35 +03:00
Timofey Durakov e55d33500c NFS setup for live-migration job
This patch add nfs shared storage for ephemerals
and run tempest tests again.
This is used in the gate-tempest-dsvm-multinode-live-migration job
which is run on the experimental queue only right now.

Change-Id: Ief89e614dd0cb218ab816da506e627b01f2ec5c1
2015-11-20 14:54:01 +03:00
Timofey Durakov acb28963fd Multinode job for live-migration
Basic enablement and clean-up of live-migration tests.
First attempt was to configure tempest in a hook, which
wasn't good idea, this patch actually fixes this. So d-g
make all configuration, and current hook only executes tests.

This is used in the gate-tempest-dsvm-multinode-live-migration job
which is run on the experimental queue only right now.

Change-Id: Ie28823fa1e8863b24391e503d04b031c421f0cd2
2015-11-18 15:09:05 +00:00
Timofey Durakov 0624778b24 Hook for live-migration job
Live-migration multinode job should check different configurations.
To implement this new hook in nova should be used. Current patch adds
execution of live-migration specific use-cases.

Change-Id: I3ad9287b8f103a874f88100df82fa9e1f8617d6f
2015-11-11 15:41:28 +03:00