Commit Graph

6323 Commits

Author SHA1 Message Date
Zuul 433e99519f Merge "Refactor mockup file load" 2024-05-08 21:22:30 +00:00
Takashi Kajinami 571d67a8d9 Refactor mockup file load
Use low-level os.path function + __file__ which are already used in
the other places.

Also consistency use os.path.join to compose file paths instead of
bare +, to avoid confusions about trailing / .

Change-Id: I1363e4befe41f3bb63b66b2589011e51828bcbbe
2024-05-08 03:16:22 +00:00
Zuul a9d0f30869 Merge "Optimize deferred deletion share instance get query" 2024-05-08 02:29:40 +00:00
Zuul 7a75af9653 Merge "Replaces qnap driver XML with defusedxml" 2024-05-07 20:02:50 +00:00
Zuul dfc334a82e Merge "Remove logic for Python 2 compatibility" 2024-05-07 17:34:08 +00:00
Takashi Kajinami 224e304e8c Remove logic for Python 2 compatibility
The collections module should/can be always used in Python 3.

Change-Id: Iccc028f15078a3e197eb2aedde8e289102bf6d74
2024-05-07 21:16:25 +09:00
Takashi Kajinami b6d7129a53 Remove fallback for Python 2
Python 2 is no longer supported, thus fallback to urllib2 is no longer
used.

Change-Id: I68d769f140d7114b12344c6d69974affdb7badaf
2024-05-07 21:14:02 +09:00
Kiran Pawar fab04b5751 Optimize deferred deletion share instance get query
The periodic database queries made by the share manager service to
process deferred deletion of shares has been fixed to consider the
host in addition to the share's state. This both improves performance
of the periodic task, as well as fixes incorrect behavior where
incorrect shares are retrieved by the query.

Partially-implements: bp/deferred-deletion
Change-Id: I813a3130ae015a6b8778bb2a288075b949313c73
2024-05-07 08:51:20 +00:00
Zuul 842fda18e5 Merge "Remove old excludes" 2024-05-06 02:25:25 +00:00
Zuul 0f5766bd0e Merge "Adds usedforsecurity=False to NetApp ONTAP MD5 hashes" 2024-05-03 20:02:10 +00:00
Takashi Kajinami cf94931d9b Remove old excludes
These are detected as errors since the clean up was done[1] in
the requirements repository. Minimum versions are bumped to avoid
installing known bad versions.

[1] 314734e938f107cbd5ebcc7af4d9167c11347406

Change-Id: I9ce84c193903b36109bc81c08bd760a50bbfd473
2024-05-01 11:20:23 +09:00
Zuul 242dc78ee5 Merge "Adds nosec comment to ZFSSA driver" 2024-05-01 00:55:07 +00:00
Elvis Acheampong 05c9446bd9 Replaces qnap driver XML with defusedxml
Replaces qnap driver's use of Python's
Standard XML library methods with defusedxml's
methods instead.The defusedXML protects the app
from XML attacks.
Instructed bandit to skip the line 86 of api.py
of qnap driver. _create_unverified_context was
intentionally used by developer which bandit
wasn't happy about.

Change-Id: I171c90a281c7b62c2601131293f9f00a926641e2
2024-04-30 17:44:59 +00:00
Zuul 57ca67ab76 Merge "Ensure password values are not logged" 2024-04-30 08:01:44 +00:00
Zuul 7250b84839 Merge "Adds usedforsecurity=False to HPE 3PAR driver" 2024-04-29 21:34:22 +00:00
Zuul 0b4673e81f Merge "Adds timeouts to Quobyte driver file" 2024-04-29 20:53:45 +00:00
Zuul 6478105f0d Merge "Replaces Huawei driver XML with defusedxml" 2024-04-29 20:53:43 +00:00
Zuul 68d3bf75fc Merge "Adds "usedforsecurity=False" to veritas drivers" 2024-04-29 20:53:41 +00:00
Zuul 6175390f18 Merge "[DOC] Add subnet metadata to user guide" 2024-04-26 18:13:12 +00:00
Zuul 2c95d47b97 Merge "Check share network for share groups before deletion" 2024-04-24 01:25:30 +00:00
Ubuntu 3a958c78c0 Adds usedforsecurity=False to NetApp ONTAP MD5 hashes
Bandit is yelling but these aren't used for security
purposes, I think, so this will sort out Bandit

Change-Id: I0e686c91ce02ea42719d00d17f6ed659e97470ac
2024-04-23 17:07:02 +00:00
Zuul d0b5bdab06 Merge "[doc] Quota paramaters have moved to the [quota] section" 2024-04-22 21:26:43 +00:00
Takashi Kajinami f8a53c037a Ensure password values are not logged
Make sure that all password options is defined with secret=True so that
the given values do not appear in debug logs.

Also remove the redundant default=None .

Change-Id: I989e825ef160a65a5a72c58d6fd4e8099044bcd5
2024-04-22 15:36:26 +09:00
Elvis Acheampong 674c9c9e19 Adds "usedforsecurity=False" to veritas drivers
The purpose of md5 was not specified.
Veritas drivers use mds hashes which pop on bandit as security issues
Putting "usedforsecurity=False" properly shows the hash function
is not use for security.

Change-Id: I78a5b708cd970dcb60f480d8e6a201d0768645fc
2024-04-18 14:38:27 +00:00
Ubuntu 32ac176053 Adds timeouts to Quobyte driver file
To appease Bandit, timeouts have to be
everywhere. So here are some timeouts
so Bandit stops crying.

Change-Id: I2a913f3b87e16554b1bd68543fcf254cc4226031
2024-04-15 22:27:20 +00:00
Ubuntu e47c6c2611 Adds usedforsecurity=False to HPE 3PAR driver
To appease Bandit since SHA1 angers
the beast, usedforsecurity=False will be
bolted to the hash function

Change-Id: I33bbb7070ada5509ca05c90d7a38077d38f54a1f
2024-04-11 20:04:58 +00:00
Zuul d8987589ae Merge "Add job to test with SQLAlchemy master (2.x)" 2024-04-11 18:54:01 +00:00
Stephen Finucane 2a9ac87cc4 Add job to test with SQLAlchemy master (2.x)
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Change-Id: Ib67538ebd0f8ebbea5a700343f52655b0f7fecd4
2024-04-10 16:41:55 -04:00
Zuul 28bb87ff77 Merge "tests: Don't (always) auto-create snapshot instances" 2024-04-09 18:56:41 +00:00
Zuul 56db40e344 Merge "db: rename_table is not a batch operation" 2024-04-09 18:49:54 +00:00
Zuul 221d4d940d Merge "Add delete CLI helper to ShareCommands" 2024-04-09 17:09:35 +00:00
Ubuntu 2da6258ddf Adds nosec comment to ZFSSA driver
Bandit yelled at this use of urlopen
but the security issue it's worried about
does not apply in this case

Change-Id: Id71c0ee4138b695ff19085a284ccced6b1a9dbba
2024-04-09 04:22:13 +00:00
Zuul 9d7bf9b1c1 Merge "db: Don't use strings to indicate relationship names" 2024-04-08 21:42:43 +00:00
Zuul fdfdb3f33d Merge "db: Remove unnecessary warning filter" 2024-04-08 03:42:31 +00:00
Stephen Finucane 16b02bc706 tests: Don't (always) auto-create snapshot instances
If we are manually creating these things, we don't want any
automatically created. This is a latent issue that was being exposed by
SQLAlchemy 2.0's tweaked session management.

Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Change-Id: I9d760ebbfcca176a39b44f20fb92e16eaf6284c5
2024-04-06 09:51:36 +01:00
Zuul 78272c7570 Merge "db: turn off autocommit" 2024-04-05 21:50:51 +00:00
Okeke Christian 23de7b4b0c Add delete CLI helper to ShareCommands
This patch adds a delete cli command to ShareCommands
The helper CLI command checks if service if up. If service
is down, it deletes the share instance

Closes-Bug: #1867030
Change-Id: I6a0575c1ed86213010e50fe1b7a733cdf7fa1736
2024-04-05 16:08:55 +01:00
Zuul e15eb1cbf4 Merge "db: update migrations to use SQLA 2.0 patterns" 2024-04-05 13:15:36 +00:00
Stephen Finucane 825ee37432 db: rename_table is not a batch operation
This is reported upstream [1] but I suspect the root cause is that we
were relying on a bug in Alembic: renaming tables doesn't really make
sense as a batch operation, which by definition works by recreating
tables with an updated schema (to support SQLite and its lack of full
'ALTER' support).

[1] https://github.com/sqlalchemy/alembic/issues/1453

Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Change-Id: I1da6d117778bbbad64b2df2dfd2f8aeef8a7084c
2024-04-05 13:00:28 +01:00
Vida Haririan ebfeee03ec [doc] Quota paramaters have moved to the [quota] section
Closes-Bug: #1942362

Change-Id: I14f56450f1bd048a0094db5c5cde0be396c3eb28
2024-04-05 06:51:55 -04:00
Zuul dd308df3d2 Merge "db: Remove final use of legacy facade" 2024-04-04 21:49:09 +00:00
Zuul ffcf694881 Merge "db: Post-migration cleanup" 2024-04-04 20:56:42 +00:00
Zuul 08758bc949 Merge "db: Remove 'get_session'" 2024-04-04 20:56:40 +00:00
Stephen Finucane 9c94a9adfc db: Don't use strings to indicate relationship names
Resolve the following RemovedIn20Warning warning:

  Using strings to indicate relationship names in Query.join() is
  deprecated and will be removed in SQLAlchemy 2.0.  Please use the
  class-bound attribute directly.

Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Change-Id: I155b4ce4b605720c8335d465124fd32cc973a737
2024-04-04 13:30:27 +01:00
Stephen Finucane 96274a077a db: Remove unnecessary warning filter
Change Ie8831c04b7b4515deea27b1ceb472d07cda91ca0 replace the only users
of 'autoload' with 'autoload_with'.

Change-Id: I37bbe45d6d9ce41a3c238e33d4469f9a362491ad
2024-04-04 13:30:24 +01:00
Ubuntu cb31307adf Replaces Huawei driver XML with defusedxml
Replaces Huawei driver's use of Python's
native XML library methods with defusedxml's
methods instead. The native library is vulnerable
to XML attacks while defusedxml isn't. This also
makes Bandit 3 issues happier.

Change-Id: I27d1204ec7dafd3b578d1261c3fd2e371ae405fb
2024-04-04 03:06:59 +00:00
Mike Bayer 505719a50a db: turn off autocommit
after testing using an assert for DML without a transaction,
we can now turn autocommit off.   enginefacade should be used
completely now

Change-Id: I2ee07c7e41ea43c2ab24a4a095550dd0b5fe47dd
2024-04-03 19:33:24 -04:00
Mike Bayer 0ce2857d0f db: update migrations to use SQLA 2.0 patterns
All tests in test_migration.py pass with either SQLAlchemy 1.4
or SQLAlchemy 2.0 installed.

Change-Id: Ie8831c04b7b4515deea27b1ceb472d07cda91ca0
2024-04-03 19:26:23 -04:00
Zuul a30697d3e7 Merge "db: Remove session arguments from AZ methods" 2024-04-03 21:11:12 +00:00
Stephen Finucane cae5ac7be1 db: Remove final use of legacy facade
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Change-Id: I1251a5c0b2f073604ae61f378992fea7df51c07d
2024-04-03 16:23:12 +01:00