Commit Graph

310 Commits

Author SHA1 Message Date
Sean Mooney 3b25b1e94c add multinode ironic shard job
This change adds the
ironic-tempest-ipa-wholedisk-direct-tinyipa-multinode-shard
to the periodic-weekly and experimental pipelines replacing
the existing ironic-tempest-ipa-wholedisk-direct-tinyipa-multinode
job in the experimental line.

&policies-irrelevant-files is moved to the job defintions to
make workign on jobs simpler when commeting out jobs during devleopemt
yes this is unrelated but it make our lives simpler.

Change-Id: I1ee8f7f7d0cbcfb3a8cd61b5fec201b4ba4bf671
2024-03-01 00:20:40 +00:00
Sean Mooney e123055530 bump nova-lvm to use 8G of swap from 4G
nova-lvm ocationally has OOM events causing
g-api to get killed. This can result in test failures
with a 502 form glance so we bump the swap to 8G
like the ceph jobs to avoid that.

Change-Id: Ib88f9feb692ee440b8f73e9b3dca56c08dadb665
2024-02-19 16:54:04 +00:00
Zuul fed123085d Merge "Lower num_pcie_ports to 12 in the nova-next job" 2024-01-11 05:00:33 +00:00
melanie witt d3181bf202 Set UEC image vars for jobs not defined in Nova
This is another follow up for change
I1a6468fbfa51eedec0ab91d73f313784a9a618a0 which missed setting the
*uec_image_vars for jobs that are not defined in Nova. For example,
the tempest-integrated-compute job is not defined in Nova and if we
don't set *uec_image_vars for it, it will not use the UEC image and
will instead use the default full image.

This also sets *uec_image_vars for one job defined in Nova,
nova-osprofiler-redis, that was missed in the original change.

Change-Id: Ia8741d46c28277e9addadf0e2a568c3ad86fb8dc
2023-12-06 19:01:06 +00:00
melanie witt 07d4138a43 Remove redundant setting of DEFAULT_IMAGE_NAME(_FILE)
This is a follow up for change
I1a6468fbfa51eedec0ab91d73f313784a9a618a0 which had residue from an
earlier PS that set DEFAULT_IMAGE_NAME and DEFAULT_IMAGE_FILE_NAME
intended to override project.vars. The project.vars approach did not
work because we needed to set IMAGE_URLS as well and the
devstack-tempest ancestor job sets IMAGE_URLS which overrides
project.vars.

The approach was changed to use YAML anchors instead of project.vars to
reduce duplication, which made the setting of DEFAULT_IMAGE_NAME and
DEFAULT_IMAGE_FILE_NAME in nova-next redundant as the default values
from Devstack can be used.

This removes the setting of DEFAULT_IMAGE_NAME and
DEFAULT_IMAGE_FILE_NAME in nova-next.

Change-Id: I3929b6c55d77575a6c0bd205f933cc2a690db91e
2023-12-05 22:30:52 +00:00
melanie witt 326279962b Use split kernel/initramfs Cirros UEC image by default in jobs
This change is in attempt to reduce the occurrence of guest kernel
panics in the APIC timer handler that we have been seeing in job
failures more recently.

We will try using the split kernel/initramfs image by default for jobs
and use the full disk image in the nova-next job to cover testing of
the full image.

The approach follows the example of CI improvements that were made in
the Neutron project in the past:

  https://review.opendev.org/c/openstack/neutron/+/843237
  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/821067

Depends-On: https://review.opendev.org/c/openstack/tempest/+/902609

Change-Id: I1a6468fbfa51eedec0ab91d73f313784a9a618a0
2023-12-05 07:24:48 +00:00
melanie witt 283eece679 Lower num_pcie_ports to 12 in the nova-next job
This change is being proposed in response to guest kernel panics that
are happening occasionally in the nova-next CI job. In these particular
cases, we see messages like the following in the guest console log dump
[1]:

  pci 0000:00:03.6: BAR 13: no space for [io  size 0x1000]
  pci 0000:00:03.6: BAR 13: failed to assign [io  size 0x1000]

which seems to indicate the guest is running out of memory to allocate
to the pcie devices.

This lowers num_pcie_ports to 12 from 24 in an effort to use less
memory.

[1] https://pastebin.com/raw/cVDem0Xr

Change-Id: Ibfa65a00dd91e6c3f28fef837a7e172221f72f42
2023-11-29 17:14:09 +00:00
Zuul e5e5e00579 Merge "Make sqlalchemy-2x job voting again" 2023-11-14 18:24:48 +00:00
Zuul 338ee65c4c Merge "Fix unit tests broken by olso.utils" 2023-11-10 02:55:21 +00:00
Takashi Kajinami f4f056dda8 Make sqlalchemy-2x job voting again
... because the new oslo.utils version is now used in CI.

Depends-on: https://review.opendev.org/c/openstack/requirements/+/900517
Related-Bug: #2042886
Change-Id: I916a2b64d8d611f0e2bd4583bbe68fdc3bd00511
2023-11-09 15:49:10 +00:00
Takashi Kajinami e04d20a8bc Fix unit tests broken by olso.utils
Some of the object unit tests grub Mock object unintentionally, and
that results in failure during initializing an versioned object,
because the Mock object does not present its version correctly.

This fixes that problem

The sqlalchemy-2x job is made non-voting because this job requires
oslo.utils 6.3.0 which is blocked by this problem.

Closes-Bug: #2043116
Related-Bug: #2042886
Change-Id: Id1c1b77c020e2d8f0ac61c2aee86c9f37d388d53
2023-11-09 15:41:57 +00:00
Sylvain Bauza b64ecb0cc7 Adding server actions tests to grenade-multinode
We recently found a rolling-upgrade bug on rebuild so we need to make
sure that grenade-multinode can verify all our instance actions.

Given we pin the compute RPC API version to the N-1 compute one, we are
sure that all RPC calls continue to behave the previous release.

NOTE : Given the previous cycle was already supporting 6.2 RPC version,
we can't test here the previous problems hence why this is the last
patch from the series.

Change-Id: I1d8deb139922494dd74ff32965fd7dd74d1d768b
Related-Bug: #2040264
2023-10-30 10:17:57 -07:00
Zuul 16d4e1d455 Merge "disable ovn based testing of test_live_migration_with_trunk" 2023-10-29 21:06:30 +00:00
Dan Smith 82f4da91ab Compile mdev samples for nova-next
Change-Id: If44964f2b99ee0482600ec31e85ea1d4caeea1b3
2023-10-12 08:57:35 -07:00
Zuul 9246630058 Merge "Add job to test with SQLAlchemy master (2.x)" 2023-10-03 16:00:57 +00:00
Stephen Finucane ed6563b078 Add job to test with SQLAlchemy master (2.x)
Change-Id: I9ae3ddc7e57d2afcfc9dad49e3361080f8145357
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2023-09-22 11:15:56 +01:00
Sean Mooney c290a6ed75 disable ovn based testing of test_live_migration_with_trunk
due to bug #1940425 where ml2/ovn is not correctly configuring the
active status on trunk port we see test_live_migration_with_trunk
fail more often then not.

This was previously disbaled in tempest and then fixed in neutorn.
the tempest skip was then reverted and so was the neutron fix as
it broke somethign else... so this is failing in our gate again.

This change skips test_live_migration_with_trunk on all jobs that
are using ml2/ovn but keeps it enabled on the hybrid plug job
which uses ml2/ovs.

Related-Bug: #1940425
Change-Id: I0a8dd6e6e30526aa2841b4db67ed9affed166fd8
2023-09-18 13:49:59 +01:00
Amit Uniyal c486cc89dc Make our nova-ovs-hybrid-plug job omit cinder
modifies nova-ovs-hybrid-plug job to disable cinder and swift to
ensure we test for this going forward.

Change-Id: I52046e6f7acdfb20eeba67dda59cbb5169e5d17e
2023-09-13 12:23:43 -07:00
Zuul 927eeb54f2 Merge "Remove n-v ceph live migration job from gate" 2023-08-21 22:18:09 +00:00
Zuul 74a2da32c6 Merge "Add integrated job to test the Nova RBAC old defaults" 2023-08-01 21:15:52 +00:00
Zuul a612688124 Merge "Add nova-tox-functional-py310 to gate jobs" 2023-08-01 11:50:09 +00:00
Dan Smith f2a10afb64 Remove n-v ceph live migration job from gate
This job is marked as non-voting in the parent definition, which
causes us to run it in gate as non-voting, which is just a waste of
resources. Remove it from the gate queue until it is marked as voting
in the definition (or maybe consider just leaving it out).

Depends-On: https://review.opendev.org/c/openstack/devstack/+/890136
Change-Id: I2ddbafe851be2c7826d78613f12560a1713ac1b1
2023-07-31 09:12:50 -07:00
Zuul b6f4c57b43 Merge "Drop Fedora support" 2023-07-18 17:49:07 +00:00
yatinkarel 3f7cc63d94 Add config option to configure TB cache size
Qemu>=5.0.0 bumped the default tb-cache size to 1GiB(from 32MiB)
and this made it difficult to run multiple guest VMs on systems
running with lower memory. With Libvirt>=8.0.0 it's possible to
configure lower tb-cache size.

Below config option is introduced to allow configure
TB cache size as per environment needs, this only
applies to 'virt_type=qemu':-

[libvirt]tb_cache_size

Also enable this flag in nova-next job.

[1] https://github.com/qemu/qemu/commit/600e17b26
[2] https://gitlab.com/libvirt/libvirt/-/commit/58bf03f85

Closes-Bug: #1949606
Implements: blueprint libvirt-tb-cache-size
Change-Id: I49d2276ff3d3cc5d560a1bd96f13408e798b256a
2023-07-13 19:35:52 +05:30
Sean Mooney 6f56c5c9fd enable validations in nova-lvm
As of I8ca059a4702471d4d30ea5a06079859eba3f5a81 validations
are now requried for test_rebuild_volume_backed_server.
Validations are also required for any volume attach/detach based test
in general due to know qemu issues.

This patch just turns them back on to unblock the gate.

Closes-Bug: #2025813
Change-Id: Ia198f712e2ad277743aed08e27e480208f463ac7
2023-07-04 15:49:11 +00:00
jskunda 86c542c56a Drop Fedora support
We are about to drop Fedora support as the latest image in upstream
has been transitioned to EOL. Centos 9 Stream has evolved as
replacement platform for new features. Patch which removes fedora
jobs and nodeset from devstack:
https://review.opendev.org/c/openstack/devstack/+/885467

Change-Id: Ib7d3dd93602c94fd801f8fe5daa26353b04f589b
2023-06-21 23:58:44 +02:00
Ghanshyam Mann aeddcd61fd Add integrated job to test the Nova RBAC old defaults
Nova has enabled the scope checks and new defaults in
antelope release and now devstack is switching the testing
to new defaults by default (depends-on). With that all the
jobs will run the the new defaults.

As old defaults are still supported (as deprecated), we should
test those at least in a single integrated job. Adding
new job tempest-integrated-compute-rbac-old-defaults to test those
old defaults.

Keeping existing job enabling the new defaults because other services
have not switched to new defaults yet to this job enable new defaults
for those service and test Nova against that.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/883601
Change-Id: Ifc3d0abe3e4caab701b695d3781f20ab3dba267d
2023-05-23 03:30:40 +00:00
Dan Smith 6ff3237149 Bump nova-ceph-multstore timeout
The recent change(s) to enable a lot more SSHABLE checks puts the
runtime of the ceph job really close to the 2h timeout even when
things are working. Sometimes it times out before it finishes even
though things are progressing. Bump the timeout to avoid that.

Also bump us to 8G swap to match what is set on the parent ceph job
when we upgraded to jammy. We could just unset this, but better to
pin it high in case that job (defined elsewhere) changes. Our job
is the largest ceph job, so it makes sense that it keeps its own
swap level high.

Change-Id: I6cefd87671614d87d92e4675fbc989fc9453c8b9
2023-05-10 17:54:38 -07:00
Elod Illes b50bcdf2b2 Add nova-tox-functional-py310 to gate jobs
Change-Id: I1da1ed56e32a754a4e5c9aeba09b62aef3401596
2023-05-02 11:35:59 +02:00
Dan Smith 2f86a8a088 Remove focal job for 2023.2
Neutron also flipped to python>=3.9 on all their repos this morningi[1]
which means we can't install neutron on focal at all. I'm not sure if
that's going to get reverted at this point, but even if it is, it's
going to take a while to undo. As noted in the comments and the
original commit[2] that added this job, it was intended to be removed
when we dropped focal from the test interface, which we have now done.

1: https://review.opendev.org/q/topic:bug%252F2017478
2: https://review.opendev.org/c/openstack/nova/+/861111

Change-Id: I5be638a702629e07ec9c88bd67bb9b7f1212f7fc
2023-04-24 15:25:32 -07:00
Dan Smith 402b155043 Add grenade-skip-level-always to nova
This makes us test N-2->N even for non-SLURP releases. Ideally we
would continue to keep this working, even though we don't have to.
But, even if this highlights some breaking change and we have to drop
this job, the sentinel will be useful.

Depends-On: https://review.opendev.org/c/openstack/grenade/+/875990
Change-Id: I2b21e7d5f487f65ce4391f5c934046552d01a1e2
2023-03-23 07:16:43 -07:00
Dan Smith 59c85b6a28 Make nova-next reduce mysql memory
This job is known to fail due to OOM in various places, so this makes
it enable the memory footprint reduction flags for devstack that we
already use in the ceph job.

Change-Id: Ibf1bdb55018a329075e31058f83ab95331c84ebb
2023-03-03 06:53:16 -08:00
Dan Smith 84d1f25446 Use mysql memory reduction flags for ceph job
This makes the ceph-multistore job use the MYSQL_REDUCE_MEMORY
flag in devstack to try to address the frequent OOMs we see in that
job.

Change-Id: Ibc203bd10dcb530027c2c9f58eb840ccc088280d
Closes-Bug: #1961068
2023-02-21 08:44:48 -08:00
Ghanshyam Mann d97af33c06 Enable new defaults and scope checks by default
As discussed in PTG, we need to test the new RBAC in the
integrated gate and accordingly enable the new defaults
and scope check by default. A new integrated testing job
has been added and results show that the new defaults and
scope checks are working fine. During testing, we found a
few bugs in neutron policies but all are fixed now.

enforce_scope and enforce_new_defaults are oslo policy config
options but they are per service level and the default value
can be overridden. Oslo policy 3.11.0 version allows to override
the default value for these config options[1] so upgrading the
oslo policy version in requirements.txt

Depends-On: https://review.opendev.org/c/openstack/devstack/+/869781
Depends-On: https://review.opendev.org/c/openstack/placement/+/869525

[1] https://github.com/openstack/oslo.policy/blob/3.11.0/oslo_policy/opts.py#L125

Change-Id: I977b2daedf880229c8d364ca011f2ea965b86e3a
2023-01-10 23:37:13 -06:00
Zuul 3ec23d3f37 Merge "Update gate jobs as per the 2023.1 cycle testing runtime" 2022-12-20 16:24:47 +00:00
Ghanshyam Mann 2aa779016d Temporary skip some volume detach test in nova-lvm job
A few tests related to volume detach are timeout in
nova-lvm job (failing 100%[1]). Root cause of timeout is not
known and it may take time to find and fix the issue. To unblock
gate and keep runing rest of the tests in lvm job, let's skip
the failing tests until they are fixed.

Related-Bug: #1998148

[1] https://zuul.opendev.org/t/openstack/builds?job_name=nova-lvm&branch=master&skip=0

Change-Id: Id29ce352df84168d0a45512e2c59820aefc75943
2022-11-28 17:54:45 -06:00
Ghanshyam Mann 58500c9967 Update gate jobs as per the 2023.1 cycle testing runtime
As per 2023.1 testing runtime[1], we need to test on Ubuntu
Jammy (which will be taken care by tempest and devstack patches
to move base jobs to Jammy) and at least single job to run on
Ubutnu Focal (for smooth upgrade). Also, python 3.10 testing is
voting now.

This commit adds a new job to run on focal which can be removed
in future cycle when testing runtime drop the requirement of Focal
testing. Also, make python 3.10 functional and unit test job as voting
(openstack-tox-py310 is running as part of generic template so we do
not need to explicitly add that)

[1] https://governance.openstack.org/tc/reference/runtimes/2023.1.html

Change-Id: Ia43f73dba00b0b5932939bcc7d11b97a83072ee3
2022-11-22 13:44:26 -06:00
Dan Smith 010983e803 Test ceph-multistore with a real image
This inflates the cirros image to 1G for a more realistic scenario.
Technically we should have been doing something like this all along,
as the deployment guidance for ceph is to use a raw image, not a qcow2
one, so this also increases our accuracy to real-life.

We also need to up the volume size tempest uses for various tests
to make sure we will fit.

Change-Id: I5c447e630aaf1413a5eac89c2e8103506d245221
2022-11-09 11:34:02 -08:00
Dan Smith 7e960b125e Enable glance location tests on ceph-multistore
Change-Id: I5672d2e1352bd5236a92630234e1261a782bc539
Depends-On: https://review.opendev.org/c/openstack/tempest/+/861390
2022-11-02 13:26:29 -07:00
Zuul ce15e7fa68 Merge "Remove the periodic Centos 8 job" 2022-10-05 04:58:19 +00:00
afariasa 6aea9f3772 Remove the periodic Centos 8 job
Centos 9 fips tests are already merged on Nova and Centos 8 jobs were already replaced by Centos 9,
this patch will delete a Centos 8 periodic pipeline that should have been deleted on previous patcc.

Change-Id: Ib735e9b52915639006bb08424d83f8ee39113d4f
2022-10-03 11:49:45 +00:00
OpenStack Release Bot c48b75c459 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ieecbed5216c1ed47743bc2b74745c0a91bb105a3
2022-09-16 10:02:19 +00:00
Zuul 72f7e89db1 Merge "Test setting the nova job to centos-9-stream" 2022-09-14 13:26:08 +00:00
Jay Faulkner c7b865c79b nova-live-migration tests not needed for Ironic
Ironic does not support live migration, so we will skip these tests
if the only changed files are in Ironic virt driver to ensur we
don't waste resources or time trying to run unneeded tests.

Change-Id: Ieb5ac3bb93af6a950acff4d76d0276096a6a24dd
2022-08-17 11:31:39 -07:00
Balazs Gibizer bf654e3a4a Remove double mocking... again
I thought we fixed all the double mocking issues with
I3998d0d49583806ac1c3ae64f1b1fe343cefd20d but I was wrong.

While we used both mock and unittest.mock the fixtures.MockPatch
used the mock lib instead of the unittest.mock lib.
The path Ibf4f36136f2c65adad64f75d665c00cf2de4b400 (Remove the PowerVM driver)
removed the last user of mock lib from nova. So it is also
removed the mock from test-requirements. This triggered that
fixtures.MockPatch athat started using unittest.mock too.

Before Ibf4f36136f2c65adad64f75d665c00cf2de4b400 a function can be mocked
twice once with unittest.mock and once with fixtures.MockPatch (still
using mock). However after that patch both path of such double
mocking goes through unittest.mock and the second one fails.

So this patch fixes double mocking so far hidden behind
fixtures.MockPatch.

Also this patch makes the py310 and functional-py310 jobs voting at
least in the check queue to prevent future changes adding double mocks.

Change-Id: Ic1352ec31996577a5d0ad18a057339df3e49de25
2022-08-08 19:50:02 +02:00
Ade Lee 9a7028f02c Test setting the nova job to centos-9-stream
Depends-On: https://review.opendev.org/c/openstack/tempest/+/831607

Change-Id: Ic8da6ee0313a911d742190ea5b0d4362cb6aef2f
2022-07-13 14:08:03 +00:00
Sylvain Bauza 4fb2aa4682 zuul: Put Centos9 Stream job periodic-weekly and experimental
This patch is a followup on 45c0a3884b

As agreed on the Nova weekly meeting [1], we won't put back C9S job to voting
and we'll rather put it on both experimental and periodic-weekly pipelines.
In order to insure we will monitor the status of those runs, we'll check
the status of the job during every Nova meeting happening weekly.

In order to trigger potential race conditions, it was acted to provide an
experimental job for C9S too.

[1] https://meetings.opendev.org/meetings/nova/2022/nova.2022-07-05-16.00.log.html#l-52

Change-Id: I2de4d90202fd7e735026150f79409d51f2d70e0e
2022-07-12 09:58:39 +02:00
Sean Mooney cbf9b2b873 update nova-next and nova-ovs-hybrid-plug to disable linuxbridge
neutron now declares linuxbridge experimental and requires
it to be enabled by a new config option. We do not set
that in these jobs so the neutron server fails to load
since we enable the linux bridge mech driver.

we do not actully use linuxbridge in these jobs so this patch
just disables the mech driver.

Change-Id: I129a850c3327498d26d899c7709f5749622afdd8
Closes-Bug: #1980948
2022-07-07 12:46:32 +01:00
Sylvain Bauza 45c0a3884b zuul: Temporarly put Centos9 Stream job non-voting
Due to the bug below, all the nova patches are failing. I accordingly
propose to make the job non-voting as it would allow our gate to ressurect.

Of course, this is a transient solution and we need a proper fix for the
job in order to have Centos 9 Stream support back in place ASAP.

When the job is back OK, please make it voting again by reverting this patch.

Change-Id: I5c3fff65fd6d9e4f3632d1ec62ae3f1f9cfbe626
Related-Bug: #1979047
2022-06-17 12:04:13 +02:00
Lee Yarwood 512aab83c8 Revert "zuul: Skip block migration with attached volumes tests due to bug #1931702"
This reverts commit 7c478ac099.

With the resolution of bug #1945983 in devstack we should also be able
to start testing block migration with attached volumes once again.

Closes-Bug: #1931702
Depends-On: https://review.opendev.org/c/openstack/devstack/+/812391
Depends-On: https://review.opendev.org/c/openstack/devstack/+/812925
Change-Id: I1cb7a8f76c372d19227315361ecf5ff730ec6c36
2022-05-18 11:23:35 +00:00