Commit Graph

124 Commits

Author SHA1 Message Date
Abhishek Kekane c7cc706a15 New grenade job to upgrding cache driver
This job will verify that upgrading cache driver from sqlite to
centralized database will not have any impact.

Related blueprint  centralized-cache-db

Change-Id: Iafed7342753da73efee2c50079505d88fe8ac4d5
2024-03-06 12:43:28 +00:00
Abhishek Kekane 68c3a80291 Use centralized_db cache driver in tempest jobs
Related blueprint centralized-cache-db
Depends-On: https://review.opendev.org/c/openstack/tempest/+/901525
Change-Id: Icd6d79d563c6b5e8f2158bcad9b4f471d72def90
2024-03-01 05:23:55 +00:00
Pranali Deore 468ebdd2f0 Make openstack-tox-functional-py38-fips job non-voting
Temporarily make the openstack-tox-functional-py38-fips
job non-voting till we figure out why its failing.

Change-Id: I8b693a692fc1248c385cfa7d0808ae0283a33781
2024-02-26 08:16:13 +00:00
whoami-rajat 64e6da6fe1 Increase timeout for glance cinder multistore job
Currently the glance cinder multistore job times out from time to
time in 2 hours (and some minutes)[1].
The issue is not specific and generally points to a slow devstack
deployment or a slow tempest run[2] which exceeds the allocated time
provided for the job to complete.
Unless the job is checked thoroughly to determine the areas of
improvement, a short term fix would be to increase the timeout
of job (which might also be the ideal solution if the job is
landing on a system with inferior hardware).
This patch increases the timeout to 10800 seconds i.e. 3 hours.

[1] https://zuul.openstack.org/builds?job_name=glance-multistore-cinder-import&project=openstack%2Fglance&skip=0
[2] https://review.opendev.org/c/openstack/glance/+/899868/1#message-081c737d8747de44669acd1cdc322e347b09d390

Change-Id: I2d21d8b098355a6cc4ceb1de8f9d7fefa19be965
2023-11-30 12:10:25 +00:00
Pranali Deore db41ce6728 Revert "Make glance-tox-functional-py39-sqlalchemy-tips job non-voting"
This reverts commit caa6e5d965.

Reason for revert:
Sqlalchemy issue is fixed and upper-constraint change is also merged after oslo.utils 6.3.0 release.

Change-Id: I21e3911aaea363dfd2d46974431bf34efd72282d
2023-11-10 11:00:27 +00:00
PranaliD caa6e5d965 Make glance-tox-functional-py39-sqlalchemy-tips job non-voting
Sqlalchemy issue[1] was breaking this job which is currently fixed
but in order to unblock the gate moving this job to non voting
until the new release for oslo.utils[2]

[1]: https://bugs.launchpad.net/oslo.utils/+bug/2042886
[2]: https://review.opendev.org/c/openstack/releases/+/900382

Change-Id: Idd36655f1e495fe40138b9245c8e4f1f81c89d19
2023-11-09 11:09:11 +00:00
Zuul 03a14a9b9c Merge "Unset VENV python_interpreter in fips job" 2023-09-25 20:04:51 +00:00
Dan Smith 359f902518 Unset VENV python_interpreter in fips job
This is set in the parent job, but will be wrong if we are not using
a venv.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/896123
Change-Id: Iab82ccb68821d7e56f7cdb64a3dbafe313f1928b
2023-09-22 08:07:19 -07:00
Stephen Finucane 0b29dc9beb zuul: Replace use of deprecated regex syntax
zuul now says:

  All regular expressions must conform to RE2 syntax, but an expression
  using the deprecated Perl-style syntax has been detected. Adjust the
  configuration to conform to RE2 syntax.

Do as we're told.

Change-Id: Iffa8ae6102c547184fab4ed0f6860a5a73da150c
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2023-09-22 12:30:02 +01:00
Zuul 551b15008b Merge "Add job to test with SQLAlchemy master (2.x)" 2023-09-22 03:01:15 +00:00
Zuul 46988556ee Merge "Set GLOBAL_VENV to false for centos" 2023-09-18 20:14:08 +00:00
Abhishek Kekane 6d8f124874 Reduce concurrency for tempest jobs
Recently many jobs are failing with timeout and one of the suggestion
as per [1] is to reduce the concurrency of the jobs. Current concurrency
is 6, setting it to 3 now.

[1] https://wiki.openstack.org/wiki/CinderBobcatMidCycleSummary#Session_Two:_R-6:_23_August_2023

Change-Id: Ieb96eb6ceb6f2a9673dfee1d94397ba3c6c2a296
2023-09-07 07:57:19 +00:00
Abhishek Kekane 89fab96292 Set GLOBAL_VENV to false for centos
glance-multistore-cinder-import-fips which is using centos is
broken recently.

A temporary workaround is to set the GLOBAL_VENV to false
specifically for centos 9 stream distros where the issue
is encountered after changing the default value
of GLOBAL_VENV to True in Devstack:
https://review.opendev.org/c/openstack/devstack/+/558930

Change-Id: I5ea80c2708e5adf65129283bbf7d8826843d5c67
2023-08-31 17:04:01 +00:00
Abhishek Kekane fb3aba94cd Fix post failures causing by image conversion failure
CI jobs tempest-integrated-storage-import-standalone,
tempest-integrated-storage-import and
glance-multistore-cinder-import were failing while converting
image from qcow2 to raw. The failures were caused by changing
default behavior of Devstack and installing everything in global
virtualenv patch [1].

This fixes import conversion in the affected jobs properly by setting
the python interpreter to the one in the venv. When we spawn external
commands they actually spawn a python interpreter to use an oslo
module to do the exec, and we need to do that with our venv's python.

Finally, this bumps the swap size for the storage-import jobs to 8G
to help account for the additional overhead of running another glance
worker, which is required for that configuration. This matches other
jobs with additional overhead (i.e. the ceph ones).

[1] https://review.opendev.org/c/openstack/devstack/+/891248

Co-Authored-By: Dan Smith <dansmith@redhat.com>
Depends-On: https://review.opendev.org/c/openstack/devstack/+/892571
Change-Id: I073216d1bbddbd3bdecd2b135e4c291f7a4d9abe
2023-08-24 06:48:03 -07:00
Stephen Finucane 02440705ba Add job to test with SQLAlchemy master (2.x)
We add a wholly new job rather than modifying one of the oslo-tips jobs
since these jobs are run periodically rather than in the check queue and
we want to prevent regressions.

Change-Id: I1036b7b0d64c91f0f64b37340490a2e52ee0baea
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2023-07-25 10:10:13 +01:00
Ghanshyam Mann 43b2116adb Test glance RBAC old defaults
Glance has enabled the scope checks and new defaults in
antelope release and now devstack is switching the testing
to new defaults by default (depends-on). With that all the
jobs will run the the new defaults.

As old defaults are still supported (as deprecated), we should
test those at least in a single integrated job. Enable the old
defaults in glance-multistore-cinder-import job.

Keeping existing job enabling the new defaults because other services
have not switched to new defaults yet to this job enable new defaults
for those service and test Glance against that.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/883601/
Change-Id: I470e3b8c1106d88e85343508a8e5891c88861c98
2023-05-19 03:30:23 +00:00
Ghanshyam Mann dca70d1ca8 Run integrated test if zuul.yaml file is changed
zuul.yaml file contain many jobs definition and base class.
Any change in this file can impact other job definition. Also,
many times we want to test the full integrated gate if this
file is changed or if depends-on is changing some global setting,
for example: https://review.opendev.org/c/openstack/glance/+/883602/1

Change-Id: I14abd88944407da17ca81b77c079262565ff71c6
2023-05-18 22:27:30 -05:00
Brian Rosmaita 084c8a32f5 Update functional jobs for 2023.2
Based on the python runtimes for 2023.2 [0], we should be running
functional jobs on python 3.9 and python 3.10.  This patch adds
functional testenvs for python 3.10 and 3.11 (the latter for local
testing) to tox.ini so the appropriate zuul jobs can be defined.

The functional-py38 testenv is not removed from tox.ini, as it may
be useful locally.

Functional py39 and py310 jobs are added to the check and the gate.

The current openstack-functional-py38-fips job is not removed; a
py39 job has not yet been defined to replace it [1].

[0] https://governance.openstack.org/tc/reference/runtimes/2023.2.html
[1] b3cad4f7a3/zuul.d/jobs.yaml

Change-Id: Ibc21b107878f5ba50137da4082a7cbc6342d2aa9
2023-04-17 18:00:24 -04:00
Ghanshyam e53af9c3ce Revert "Make glance-secure-rbac-protection-functional job non-voting"
This reverts commit 1ae2ad3979.

Reason for revert:
Test are fixed in depends-on and job is passing now

Change-Id: I94bc43b3e88e284fdc1158404c3ee3ee2b0125c0
Depends-On: https://review.opendev.org/c/openstack/glance-tempest-plugin/+/876235
2023-03-03 18:38:18 +00:00
Abhishek Kekane 1ae2ad3979 Make glance-secure-rbac-protection-functional job non-voting
Tempest change [1] has broken glance srbac tempest tests, so
in order to unblock the gate we need to turn the job non-voting and
once we fix those tests we will re-enable the same.

[1] https://review.opendev.org/c/openstack/tempest/+/871018

Change-Id: Ibbfd8904b3a87b870ed8cde26245176c5b8e74aa
2023-03-02 14:47:38 +00:00
Pranali Deore 8c04d19e88 Enabled new defaults and scope checks by default
Enabling the enforce scope and new defaults by default in glance

Related blueprint secure-rbac

Change-Id: I0808dc0b1b34b527e38aa137c1dd25e1fc06409f
2023-02-16 11:11:31 +00:00
Abhishek Kekane d07187f710 Remove migration constant job and test
Since openstack release naming conventions has changed, current test
which check data migration version will not work as expected and same
is also blocking our gate. Removing this job and test to unblock the
gate.

NOTE: Going forward glance PTL/team needs to change the database
migration version without fail at the start of release cycle.

Change-Id: Idcb12a6c450d4ce4ee859e6e1f02fb71adf8c1d5
2023-01-16 14:40:29 +00:00
likui 4da0077d7b add openstack-python3-zed-jobs-arm64 job
This is a non-voting job to validate py3 unittests on ARM64

Change-Id: Ie229c57654a8827d2274f6ab812310bdd989db4b
Task: #40402
Story: 2007938
2022-10-10 09:38:19 +08:00
OpenStack Release Bot 499257d2b6 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I9c3e19cf1a2c74381395d49ee3d792bbd92b603a
2022-09-14 17:19:29 +00:00
Abhishek Kekane 1ef06ef08b Enable Image cache tempest testing
This patch will enable new cache APIs tempest tests in glance gate.

Change-Id: I01e8550aef85d333a70392be83a964267e632c2d
2022-07-27 20:06:55 +00:00
Ade Lee 05543914a7 Fix fips job
The ecdsa usage for ssh is supposed to be the default right now.
Also, a new role paramter nslookup_target is required for the fips role

Depends-On: https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/847193
Change-Id: I795c751edd1403d23aa1de5cda194aada80d05b2
2022-06-22 20:49:23 +00:00
Zuul 2e94e3dc71 Merge "Revert "Disable import workflow in glance cinder jobs"" 2022-05-23 15:05:51 +00:00
Zuul 832377b9fd Merge "Add openstack-tox-functional-py38-fips job" 2022-05-23 09:52:54 +00:00
Rajat Dhasmana 0c15169c37 Revert "Disable import workflow in glance cinder jobs"
This reverts commit d7fa7a0321.

Reason for revert: This is no longer needed as the devstack patch is merged to fix this issue https://review.opendev.org/c/openstack/devstack/+/841804

Change-Id: I214c9a6017f66d3eb6589496726e8c8f895d56aa
2022-05-23 13:55:51 +05:30
Zuul 532e52733c Merge "Revert "Override GLANCE_USE_IMPORT_WORKFLOW in cinder jobs"" 2022-05-23 07:15:32 +00:00
Ghanshyam Mann b8e6bb0277 Add openstack-tox-functional-py38-fips job
openstack-tox-functional-py36-fips is removed in
https://review.opendev.org/c/openstack/glance/+/841350/
with the plan to be move to py38.

This commit migrate the fips job to py38.

Depends-On: https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/841368
Change-Id: I0e2bca4603a34e39ffdbebaab2fcfad3a9da4241
2022-05-20 00:06:02 +00:00
Zuul 6c504b3210 Merge "Update python testing as per zed cycle teting runtime" 2022-05-19 21:47:33 +00:00
Ghanshyam Mann d55d250d33 Update python testing as per zed cycle teting runtime
In Zed cycle, we have dropped the python 3.6/3.7[1] testing
and its support. Moving the py36 job to py38 based as well as
updating the python classifier also to reflect the same.

openstack-tox-functional-py36-fips job is left which can be moved
to py38|py39 based once that job is defined in openatck-zuul-jobs
repo.

openstack-tox-functional-py36-fips job will be migrated to py38 or py39
in followup patch as that need openstack-zuul-config changes too.

[1] https://governance.openstack.org/tc/reference/runtimes/zed.html

Change-Id: Id0813d9dc553dd424732079039349b42f6f3201b
2022-05-19 12:56:56 -05:00
Rajat Dhasmana f9fad19249 Revert "Override GLANCE_USE_IMPORT_WORKFLOW in cinder jobs"
This reverts commit 025ba83c47.

Reason for revert: This is no longer needed as the devstack patch is merged to fix this issue https://review.opendev.org/c/openstack/devstack/+/841804

Change-Id: Ie72a2531172208e32626ad2060737257663eba46
2022-05-19 08:26:47 +00:00
Takashi Kajinami ce8fd56e1a Migrate CentOS Stream 8 job to CentOS Stream 9
Some projects like cinder have dropped support for Python 3.6 and are
no longer compatible with CentOS Stream 8 which uses Python 3.6 as
the default runtime.

Change-Id: I48f88c188f830f61c03ec5570cd95731636a0396
2022-05-18 08:36:10 +09:00
whoami-rajat 025ba83c47 Override GLANCE_USE_IMPORT_WORKFLOW in cinder jobs
With change[1], we moved glance cinder jobs parent from
tempest-integrated-storage-import to regular
tempest-integrated-storage job but this job also has
import workflow enabled[2].
In this patch we are overriding GLANCE_USE_IMPORT_WORKFLOW
to False in cinder jobs to ensure that import workflow
is disabled in those jobs.
Also removing -import from job names since it's not using
import plugin anymore.

[1] https://review.opendev.org/c/openstack/glance/+/841548
[2] https://opendev.org/openstack/tempest/src/branch/master/zuul.d/integrated-gate.yaml#L195

Related-Bug: #1973136
Change-Id: I2775e007f942feed8fa6ae5e385c03992859edc1
2022-05-16 16:08:07 +05:30
whoami-rajat d7fa7a0321 Disable import workflow in glance cinder jobs
Recently, glance-multistore-cinder-import job started failing.
As per the RCA done here[1], the reason is glance is using
import workflow to create images which is an async operation.
As in case of glance cinder configuration, there are a lot of
external APIs (cinder) called like volume create, attachment
create, attachment update, attachment delete etc which takes
time to process hence the image doesn't get available in the
expected time (as per devstack) hence the failure.
Disabling import workflow will cause the images to be created
synchronously which should pass the glance cinder jobs.
To disable import workflow, we are inheriting from
tempest-integrated-storage and not
tempest-integrated-storage-import (which has import plugin enabled).

[1] https://review.opendev.org/c/openstack/glance/+/841278/1#message-456096e48b28e5b866deb8bf53e9258ee08219a0

Closes-Bug: 1973136
Change-Id: I524dfeb05c078773aa77020d4a6a9991a7eb75c2
2022-05-13 11:26:52 +05:30
Zuul 2eb118905c Merge "Add grenade-skip-level irrelevant-files config" 2022-05-05 15:32:38 +00:00
afariasa 8c6a79891a Move FIPS jobs to experimental and periodic queue
Change-Id: I945f30fa7dd60e2e93bc248be4529633fb1f6bea
2022-03-14 17:03:21 +00:00
Ghanshyam Mann 80083fd0e9 Add grenade-skip-level irrelevant-files config
Depends-On: https://review.opendev.org/c/openstack/tempest/+/830670
Change-Id: I2ba1928875b75ae893e740bc1470d142d2dd73fb
2022-03-01 13:08:31 -06:00
Ade Lee 0457ab2086 Make FIPS job non-voting
Temporarily make the FIPS job non-voting till we figure out why
its failing. Restore the non-fips version of the cinder job so
we keep the coverage.

Change-Id: I1a9dbd087cca52798f0d01c62ebb47e37f52d87a
2022-02-11 11:18:24 -08:00
Ade Lee 0f13754f84 Add fips check jobs
Some jobs have been modified to run to confirm that functionality is
still working when FIPS is enabled on the nodes.

As the FIPS tests currently run on centos nodes, code is added
to the test-setup script to set up the databases correctly.  Also had
to increase the swap space on the nodes; see [0] for an explanation.

The current FIPS jobs run using python 3.6 on centos-8-stream.  We will
modify these to run on centos-9-stream and python 3.9 in a
subsequent patch.

[0] https://review.opendev.org/c/openstack/devstack/+/803706

Change-Id: I060d8247c7b09f63990ea411e6c6a056bb50410d
2022-02-03 13:19:20 -05:00
Ghanshyam Mann ed1183919a Updating python testing as per Yoga testing runtime
Yoga testing runtime[1] has been updated to add py39
testing as voting. Unit tests update are
handled by the job template change in openstack-zuul-job

- https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/820286

this commit updates the functional and tips jobs to test
on py39, also update the classifier in setup.cfg file.

[1] https://governance.openstack.org/tc/reference/runtimes/yoga.html

Change-Id: I6e1c64961f0feb920e45ef6a6ed29f2e32265768
2021-12-13 20:57:28 -06:00
Ghanshyam Mann 458e2b7b45 Remove broken tempest-full-py3-opensuse15 job
tempest-full-py3-opensuse15 is failing all the time[1] and
opensuse is not tested/supported distro in testing runtime
or devstack anymore. So let's remove opensuse broken job from
tempest too.

Needed-By: https://review.opendev.org/c/openstack/tempest/+/816569

[1] https://zuul.opendev.org/t/openstack/builds?job_name=tempest-full-py3-opensuse15

Change-Id: Iae7ec150fb51d7e9d019182223062e6462084617
2021-11-03 15:54:52 -05:00
Zuul d52abef6d3 Merge "Make glance cinder multistore job voting" 2021-09-20 18:38:37 +00:00
OpenStack Release Bot b8c55efa14 Add Python3 yoga unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for yoga.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Iab3983dfab5074d30f22122524f30cb21fe5758e
2021-09-16 11:07:22 +00:00
Zuul 91ed096ec0 Merge "Add a nonvoting functional job with RBAC defaults" 2021-07-01 15:19:36 +00:00
Dan Smith 8201f5f101 Add a nonvoting functional job with RBAC defaults
This adds a new tox target called functional-py38-rbac which enables
the new secure RBAC policy defaults for all functional tests. To do
this, the functional tests needed a little bit of extra work to
actually set those, and a new non-voting job is added to run these
in CI.

Related to blueprint policy-refactor

Change-Id: Id376193521671bdb0ebc08ea8e563578bbaa541f
2021-06-30 11:49:30 -07:00
Dan Smith fa1bc2f904 Drop lower-constraints jobs
Change-Id: Id030b56b721cb62255936d56f0409c4be9ce21d4
2021-06-21 07:19:01 -07:00
OpenStack Release Bot 6cabdf93fc Add Python3 xena unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for xena.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I5208077a9f700e8104dab697b8ac58fd85575f7a
2021-03-23 17:09:16 +00:00