Commit Graph

136 Commits

Author SHA1 Message Date
Brian Rosmaita 823eb77939 Update CI for Dalmatian
Updates:
- run py311 func job in gate (was py310)
- add py312 testenvs to tox.ini
- did not remove py38 testenvs from tox.ini
- removed py38 classifier from setup.cfg, but did not change
  python_requires (currently it's >=3.8)

Python 3.12 unit tests will run non-voting in the gate as part of the
openstack-python3-jobs template.  Python 3.10 coverage is being handled
by tempest running in Ubuntu 22.04.

Change-Id: I72ec22780d36ea3e56386ae2bd74bf5b9806731c
2024-04-10 09:18:58 -04:00
Zuul 1f87e45986 Merge "Run protection tests during gate check" 2024-03-15 17:36:58 +00:00
OpenStack Release Bot c0ff458b05 reno: Update master for Unmaintained branches
The stable/victoria and stable/wallaby branches have been deleted,
so reno can't find their release notes.  Use the victoria-eom and
wallaby-eom tags to indicate the end of the
Cinder project's maintenance of these series.

Also fix our override for the reno closed_branch_tag_re to include
the -eom tags. Add the changed reno.yaml file to all relevant
irrelevant-files lists.

This strategy is what we used for the yoga transition, and was
discussed at a cinder weekly meeting:
https://meetings.opendev.org/irclogs/%23openstack-meeting-alt/%23openstack-meeting-alt.2024-02-07.log.html#t2024-02-07T14:06:09

Change-Id: I505b7cc12888d2373a0550b40bb945d75bb11067
2024-03-13 12:56:42 +01:00
Douglas Mendizábal dfdf54ac7b Run protection tests during gate check
This patch adds the cinder-tempest-plugin-protection-functional test to
the gate check.  The test itself is defined in cinder-tempest-plugin.

This test enables Consistent and Secure Default RBAC (SRBAC) [1] on both
Keystone and Cinder to ensure that integration with Keystone and Cinder
functionality is working correctly when both services are enforcing
scope in RBAC.

Currently no other tests in the Cinder gate have this option enabled.

Moving forward, this job will help ensure that new changes to Cinder
will work in environments where SRBAC is enabled.  This job will also
help as we continue to implement the next phases of the SRBAC community
goal.

[1] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html

Depends-On: https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/906153
Change-Id: I590eb954203ccd2fc564117addfcf5d2dac5bd74
2024-02-16 14:57:53 -05:00
Brian Rosmaita 8a10a29d34 Stop testing cinderlib
The cinderlib project has been deprecated and is no longer being
developed, so remove cinderlib tests from cinder CI jobs.

Depends-on: Ib186ac5830e5920e264d79be946995e63e960426
Change-Id: I1143e5e5ccf8103e386fe1ce614a554e7f152d9a
2023-12-10 12:57:41 -05:00
Stephen Finucane 6616bda7e7 Migrate cinder-sqlalchemy-2x job to py311
Change-Id: Ie47b01fe9fbc2df7ccb6ae685edc989485146df8
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2023-11-15 12:23:06 +00:00
Stephen Finucane d9c21b9c7f Add job to test with SQLAlchemy master (2.x)
Change-Id: I1ec983ca09cb42bf1ffb701c1ac56f84c4deee8f
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2023-11-10 11:15:37 +00:00
Zuul 0fc4e39227 Merge "Make lvm-lio-barbican a canary job" 2023-09-28 01:30:18 +00:00
Brian Rosmaita 5a17149def Use openstack-tox-py311 job
Instead of our custom tox-py311 job, use the openstack-wide job
that was added by change I725b94bee6601a and added to the testing
template by I3b22ff95ab7b83a.

Since the openstack-tox-py311 job uses a debian bookworm nodeset,
follow change I736ecb2a18d3 in adjusting cinder's bindep.txt.

Change-Id: I3b22ff95ab7b83ae6e0e12f0d2bf645cc87424d2
2023-08-18 18:55:23 -04:00
Brian Rosmaita 9cea85ad6b Make lvm-lio-barbican a canary job
To avoid wasting resources, our gate-irrelevant-files list is a
bit aggressive.  Use a less aggressive list on one job,
cinder-tempest-plugin-lvm-lio-barbican, to act as a canary.

Change-Id: Ia70b46f4fd4caadeed6fc80fcc849d04694976b0
2023-06-05 10:29:35 -04:00
Zuul 6b1f4a2e7b Merge "zuul: Extend timeout for cinder-plugin-ceph-tempest" 2023-06-01 23:04:09 +00:00
Luigi Toscano a8fee1813b Revert "Add tempest integrated storage job to run on ubuntu focal"
Testing with focal was required as part of the testing runtime
for the 2023.1/Antelope release, which is a SLURP relase [1].
Now that Antelope is released, the development moves towards
2023.2/Bobcat where the old LTS ubuntu release is not among
the required testing runtimes[2].

Moreover, this job started failing consistenly in master.

[1] https://governance.openstack.org/tc/reference/runtimes/2023.1.html
[2] https://governance.openstack.org/tc/reference/runtimes/2023.2.html

This reverts commit b3e7d363ca.

Change-Id: I080e846c34ad91c279362f16b3e9de045776fb05
2023-05-30 11:27:39 +02:00
Eric Harney b3ddaba272 zuul: Extend timeout for cinder-plugin-ceph-tempest
This job is somewhat regularly bumping into the
2h time limit, bump it to 3 hours.

https://zuul.opendev.org/t/openstack/builds?job_name=cinder-plugin-ceph-tempest&result=TIMED_OUT&skip=0

Change-Id: If5853979f47da44cd070f030597bd4be1f63c0c7
2023-05-29 23:19:59 +00:00
Zuul 033c7e35f2 Merge "Run py311 unit tests (non-voting)" 2023-05-03 16:51:28 +00:00
Zuul 2e8aff660b Merge "Add fips check jobs" 2023-04-19 00:10:48 +00:00
Ade Lee 933a7b7e6c Add fips check jobs
This patch adds two new FIPS enabled jobs to determine if there are any
issues when FIPS is enabled.

Because the FIPS jobs currently run on centos, code is added to the
test setup script to set up the databases correctly.  Also had
to increase the swap space on the nodes; see [0] for an explanation.

[0] https://review.opendev.org/c/openstack/devstack/+/803706

Depends-On: https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/847087
Depends-On: https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/847086

Change-Id: Ib85b6ecc6f1b12eb8afa866e56afbfb13aad0cba
2023-04-18 19:45:55 +00:00
Brian Rosmaita 3febae7529 Update functional jobs for 2023.2
Based on the python runtimes for 2023.2 [0], we should be running
functional jobs on python 3.9 and python 3.10.

This patch does not remove the ability to run the functional jobs
locally on python 3.8, as it may be useful to test changes that
are intended to be backported.

[0] https://governance.openstack.org/tc/reference/runtimes/2023.2.html

Change-Id: I5e12a7555b465a5fd8510d5a9b80d5caa30ce507
2023-04-17 17:33:40 -04:00
Eric Harney 52981bbb27 Run py311 unit tests (non-voting)
Add a non-voting gate job for py311 unit tests.

Related-Bug: #2000436
Depends-On: I5c1a4cd0ba0394849987203888b942169550672e
Depends-On: I471ce2887a9884a5478a303e4b4db9cf8e55b6fb
Depends-On: I4fdf57755b25bbdd19013fd3a2fd86a7d1dd29e9
Change-Id: I06741d95050b42e1801260b1b8d1806c9d3bf6c9
2023-04-17 14:24:05 -04:00
Brian Rosmaita 513690a81c Add note about MYSQL_REDUCE_MEMORY
Added a note to the two CI jobs that increase host memory about
a recently added devstack option [0] so that we don't forget about
it.

[0] I7b223391d3de

Change-Id: Ifb52819ddc4db22507805c77c5562ca3e3600e1a
2023-03-30 10:47:31 -04:00
Zuul 764c360c19 Merge "Ceph minimum client on cinder-plugin-ceph-tempest job enable" 2023-02-17 22:12:48 +00:00
Zuul b9ff1016f1 Merge "Change functional job py39 to py310" 2023-01-27 16:01:07 +00:00
Rajat Dhasmana 23a3da73be Change functional job py39 to py310
Based on the runtimes of 2023.1[1], we are modifying the
functional jobs to test against python 3.8 and python 3.10.

[1] https://lists.openstack.org/pipermail/openstack-discuss/2022-November/031229.html

Change-Id: I12da0ed69465fce9279ee6a30b7b442aa5ba396b
2022-12-26 04:27:20 +00:00
Rajat Dhasmana b3e7d363ca Add tempest integrated storage job to run on ubuntu focal
Based on TC 2023.1 PTG discussion [1] and ML thread[2], we should run
at least one tempest job on the previosly supported Ubuntu version to
make sure that current release can work on older operating system and
that upgrade process can be as smooth as possible for operators.

[1] https://etherpad.opendev.org/p/tc-2023-1-ptg#L428
[2] https://lists.openstack.org/pipermail/openstack-discuss/2022-November/031229.html

Change-Id: I657ff088bb916a8b8085f3cc5b0a53dc493b5af7
2022-11-23 13:39:16 +00:00
Sofia Enriquez 5e2fc9a58d Ceph minimum client on cinder-plugin-ceph-tempest job enable
Since e222cc976918a331bacff150e84069fda8f4960a, it is possible to set
the minimum client version. The goal of this patch is to enable the
*mimic* client version for the current cinder-plugin-ceph-tempest job.

As a result, we will be able to ensure that snapshots can be deleted
when a volume is cloned from them.

Change-Id: I8ffb0c1130b30a19f336a98a9efef05905786af2
2022-09-19 16:27:45 +00:00
OpenStack Release Bot 9827e74218 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I444aa9cff84ef9d1e46d3d00ce034583aa8c2fb6
2022-09-19 09:42:41 +00:00
Zuul 6605f5a94e Merge "Move NFS job to voting" 2022-08-19 17:22:11 +00:00
Eric Harney 8094331183 Change cinder-mypy job to voting
Ensure new changes don't fail the cinder-mypy job.

Change-Id: Ib6c8a7a1a8eb180a1b689dc266d614c962de3193
2022-07-26 09:51:08 -04:00
Eric Harney 9509eb1c3b Move NFS job to voting
Recent Cinder and Tempest changes broke the NFS CI jobs.

We should ensure the NFS job passes to prevent this
in the future.

Change-Id: Ib96d65783607f36e115b6b80af6967d463090fdc
2022-07-12 20:20:37 +00:00
Brian Rosmaita d41abbf538 Increase swap size to 4GB
This is to address issues in the cinder-plugin-ceph-tempest* jobs
where a significant number of builds are failing.  Symptoms are a
lot of server fault errors, identity error: unexpected status
code 500, and db connection errors in the tempest log.  On these
jobs, syslog shows multiple
   oom_reaper: reaped process xxxxxxx (mysqld)
lines.  Occasionally ceph-osd or ceph-mons are also reaped, but
it's pretty consistently mysqld.

Default swap size is currently 1G.  Increase to 4GB was determined
experimentally.  (See other patches on topic: increase-swap.)

Change-Id: I3c08f363f5b74e1fe7900f4398bd2cb6df3a80d7
2022-05-13 12:20:49 -04:00
Zuul 4962183f7e Merge "Drop python3.6 support in testing runtime" 2022-04-29 19:50:34 +00:00
wanghao 42c6450527 Drop python3.6 support in testing runtime
In Zed cycle testing runtime, we are targetting to drop the
python 3.6 support, project started adding python 3.8 as minimum,
example nova:
- 56b5aed08c/setup.cfg (L13)

Change-Id: I1e0d0a43cd166e6cfd4be7ca0f426e9fc3625a28
2022-04-28 09:09:28 +08:00
Eric Harney 24cd0920fa Remove contrib/block-box from zuul config
This doesn't need to be listed in "irrelevant-files"
since it isn't in the tree as of Iaa3a7892.

Change-Id: Ibd6e67caa27201cd564a6a344946b34bd530a1da
2022-04-27 12:31:50 -04:00
Zuul 4e02f204ff Merge "Add grenade-skip-level irrelevant-files config" 2022-03-18 15:36:31 +00:00
OpenStack Release Bot 8537730c8c Add Python3 zed unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for zed.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ibb94c28c788ae26fbbc553f08c32b6bf84ac3707
2022-03-14 09:30:14 +00:00
Ghanshyam Mann 72962934a9 Add grenade-skip-level irrelevant-files config
Depends-On: https://review.opendev.org/c/openstack/tempest/+/830670
Change-Id: Ida98ac841485100bc23b68cc060b772956fe4466
2022-03-01 13:09:17 -06:00
Zuul 87b0ad701d Merge "zuul: configure irrelevant-files for the rally job" 2022-02-18 16:48:24 +00:00
Zuul f2d4d6b4ac Merge "Turn off inline comments for mypy zuul job" 2021-12-22 18:36:02 +00:00
Ghanshyam Mann c064de2992 Updating python testing as per Yoga testing runtime
Yoga testing runtime[1] has been updated to add py39
testing as voting and as we are testing py3.6 and py3.9
we do not need to test py3.7|8 explicitly. Unit tests update are
handled by the job template change in openstack-zuul-job

- https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/820286

this commit makes other required changes in zuul.yaml and
update the classifier in setup.cfg file.

[1] https://governance.openstack.org/tc/reference/runtimes/yoga.html

Change-Id: I9fe6187ea8c849812a508b48b342226e50fca831
2021-12-14 02:31:27 +00:00
Ghanshyam Mann 96384e139b Remove broken tempest-full-py3-opensuse15 job
tempest-full-py3-opensuse15 is failing all the time[1] and
opensuse is not tested/supported distro in testing runtime
or devstack anymore. So let's remove opensuse broken job from
tempest too.

Needed-By: https://review.opendev.org/c/openstack/tempest/+/816569

[1] https://zuul.opendev.org/t/openstack/builds?job_name=tempest-full-py3-opensuse15

Change-Id: Ibb089a5e8dd3ce41c4bb83d7092c435db3c8d669
2021-11-03 15:55:36 -05:00
OpenStack Release Bot ca05872075 Add Python3 yoga unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for yoga.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I690dd390ab5ffdffc339b6fa7aaa035b1faee341
2021-09-17 16:24:56 +00:00
Brian Rosmaita 028b9a6485 Turn off inline comments for mypy zuul job
The inline comments don't seem to be helpful.

Change-Id: I2198d17e8cc3e2806d2f1a99699ba2881765bfb5
2021-09-16 14:45:57 -04:00
Luigi Toscano 1c0c25babb Native multibackend-matrix Zuul v3 job
Port the legacy legacy-tempest-dsvm-multibackend-matrix job to the
native Zuul v3 syntax, and rename it following the guidelines
(cinder-multibackend-matrix-migration).

This job tests the migration between two different backends
specified through the volume.backend_names configuration
key in tempest.conf.

Now the job leverages the existing zuul code, namely the
run-tempest role, which is called multiple times with all
the possible combinations of the 3 tested backends
(lvm, ceph, nfs) where the source and the destination differ.

The final JUnitXML output summarizes the test results
for each of the tested combinations.

Change-Id: I34e7e48ee63c4c269f82ae178a7118ed402cad6d
2021-09-08 01:05:44 +02:00
Brian Rosmaita 269d21b2e3 Test glance with cinder backend optimization
Configure a gate job for glance using a cinder glance_store
with cinder configured to clone image data directly in the backend
instead of transferring data through glance.

Change-Id: I8a193b1cd6002e11db78c8eebceaa2fbc86a90bc
2021-08-27 04:19:14 +00:00
Zuul 98b49d0572 Merge "Add openstacksdk-functional-devstack job in cinder gate" 2021-08-10 17:48:43 +00:00
Zuul fcdd2067d2 Merge "Run cinder-mypy job in the check" 2021-08-04 17:25:31 +00:00
Ghanshyam Mann 6854265085 Add openstacksdk-functional-devstack job in cinder gate
With cinderv2 API removal, openstacksdk-functional-devstack
was broken(depends-on) which was running the v2 test. Having
this job running in cinder gate like Nova and other project
will help to find such issue in future especially about client side
impact on any code change.

Change-Id: I81c1e0a9dbc5b9e3d1c4e945756b268cfc562895
2021-07-22 18:18:37 +00:00
Zuul 196a58dae1 Merge "Remove Block Storage API v2" 2021-07-22 05:18:14 +00:00
Brian Rosmaita cc6b499d23 Run cinder-mypy job in the check
Promote the mypy job from experimental to a nonvoting check job.

Change-Id: I7aa9d603f69ba4424da7ae6f98192a888da1071c
2021-07-15 18:03:42 +00:00
Yandong Xuan b604a3bf66 Drop lower-constraints jobs
Change-Id: I994af226743a50f11d89373868e588d0d0313785
2021-07-07 16:30:03 -04:00
Brian Rosmaita e05b261af7 Remove Block Storage API v2
In this patch:
- adjusted VersionsController to return only v3
- removed cinder.api.v2.router
- adjustments to cinder.tests.unit.api.contrib to use /v3 only
- moved cinder.api.v2.snapshot_metadata (and tests) to cinder.api.v3
- moved cinder.api.v2.types (and view, tests) to cinder.api.v3
- updated versions response in api-ref
- removed unnecessary config option
- updated various sample config files
- removed experimental tempest-cinder-v2-api job
- updated some docs
- updated non-voting rally job config

Some cinder.api.v2 modules are left because the v3 classes depend on
them, but with the v2 router removed, these are unreachable via the
/v2 path.

Depends-on: https://review.opendev.org/c/openstack/rally-openstack/+/794891
(changes rally to use Block Storage API v3)
Depends-on: https://review.opendev.org/c/openstack/requirements/+/794894
(corrects regression in upper-constraint on Sphinx)

Change-Id: I2093d77db9beec7543c7524d2cd273e79dd5fd5d
2021-06-04 17:21:28 -04:00