Commit Graph

7385 Commits

Author SHA1 Message Date
OpenDev Sysadmins 684139c60f OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:28:43 +00:00
Kota Tsuyuzaki 112e087287 Update S3api Docs
Change-Id: I31f1dad95a2381cf355e5619810ee85bc54bf358
2018-04-11 20:06:56 +09:00
Kota Tsuyuzaki a46faca2c9 Rename s3api's response module as s3response
swift.common.middleware.s3api.response.Response class is renamed
as S3Response too.

Change-Id: I9f3f1ac7136210930aac71ec26ca63b2502b8723
2018-04-09 18:44:53 +09:00
Kota Tsuyuzaki 1457155212 Change sysmeta name from swift3 to s3api
And add a magic to translate existing swift3 sysmeta to s3api sysmeta
at swift.common.middleware.s3api.response.Response to upgrade easy from swift3
to s3api.

Change-Id: I4c11274a69863be04fd2b1ca4c1d4d9aadbff2de
2018-04-06 10:40:10 +09:00
Tim Burke c019720275 Remove auth_host, auth_port, auth_protocol, and auth_version options
... in favor of just specifying an auth_uri (which *must* include a
version).

Note that this breaks from swift3, which needed to work with old configs
where version wasn't baked into the auth_uri.

Change-Id: Ie6af5764165adf69250373cd5f131bb140de13bc
2018-03-29 16:31:57 +00:00
Kota Tsuyuzaki 527f5807c3 Fix inlines including swift3 (or Swift3) to be s3api
Change-Id: I0cdc928283a0c664eff9be9c0fdfb275dbe051c9
2018-03-29 18:27:49 +09:00
Zuul 96daa8e39d Merge "Remove zero-byte final segment hack" into feature/s3api 2018-03-29 06:22:38 +00:00
Tim Burke 72230f86be Address lingering TODO comments about copied Swift code
Change-Id: Id3daf383b8d5a2050571b266ec61bcc9ab2f4302
2018-03-29 11:48:18 +09:00
Tim Burke 0c41c91d55 Remove zero-byte final segment hack
This is no longer necessary since
https://github.com/openstack/swift/commit/37f23b0

Change-Id: Icc447bdc587c3cfdc21f9cd13b0a3005520c42cf
Related-Change: Ia37880bbb435e269ec53b2963eb1b9121696d479
2018-03-29 11:47:40 +09:00
Zuul bb6eeb84af Merge "Rename auth_details key from swift3 to s3api" into feature/s3api 2018-03-29 01:37:15 +00:00
Zuul 945285ae70 Merge "Merge remote-tracking branch 'remotes/origin/master' into feature/s3api" into feature/s3api 2018-03-29 01:37:14 +00:00
Kota Tsuyuzaki 29b085a147 Rename auth_details key from swift3 to s3api
This should NOT be an impact on upgrading because the request environ
key is prepared for each request. It's nice that s3api is in swift upstream
repo because we can resolve this issue with only ONE commit at once.

Change-Id: I87e964e2dd0c72d07f4f43b357bc7b0ee6cf4360
2018-03-28 17:18:04 +09:00
Kota Tsuyuzaki 8c17f610d4 Merge remote-tracking branch 'remotes/origin/master' into feature/s3api
Change-Id: Ib5461698a1a2f82c2248fd383de599880288f9fb
2018-03-28 16:49:15 +09:00
Kota Tsuyuzaki d2b3a263d3 Fix conflicted Request class name
This patch changes the class and module name
from swift.common.middleware.s3api.request.Request
to swift.common.middleware.s3api.s3request.S3Request

And then, fix some broken issues related to the module name and path
change.

Change-Id: I00adc53e2f0f01b712c57b4572ed3ec51877fe49
2018-03-28 11:12:41 +09:00
Zuul bbf58df129 Merge "Fix test S3Api middleware instance name from swift3" into feature/s3api 2018-03-27 18:49:20 +00:00
Zuul d45c49544e Merge "Fix default object-server.conf that doesn't include s3 support headers" into feature/s3api 2018-03-27 12:09:30 +00:00
Kota Tsuyuzaki c48430ba81 Fix test S3Api middleware instance name from swift3
Change-Id: Ic5e4c877aac5e607c197cec33c55fe1057a7385b
2018-03-27 15:39:50 +09:00
Kota Tsuyuzaki df26aa72fd Fix default object-server.conf that doesn't include s3 support headers
Change-Id: I49d1538027efdb6aaf138eed56e6bc9486bf22f2
2018-03-27 15:17:09 +09:00
Kota Tsuyuzaki 7e5ee333f8 Cleanup swift/common/middleware/s3api/test dir
The scripts in the dir was used to setup functional tests
but they will be never used in swift upstream so let's cleanup
those scripts.

The configs for ceph-s3-test would be useful to make non-voting
gate in the swift upstream, this patch moves them into doc/s3api/conf
dir that is not included source code tree, anyway.

Change-Id: I608ed3a620478bc4ab2fdd8901ea987e356298c9
2018-03-27 14:56:50 +09:00
wanghui 9b4c978f99 Use http code constant instead of int
Change-Id: I1dce94ac6192746a7b90646fe4b4460a651bced1
2018-03-26 15:24:22 +08:00
Zuul 744d6b6ab3 Merge "Use http code constant instead of int" 2018-03-26 04:28:05 +00:00
Zuul ae8f8ad5be Merge "Remove conf from s3 request" into feature/s3api 2018-03-26 03:51:41 +00:00
Zuul 70d1ea1893 Merge "Unify expirer unit test task queue" 2018-03-26 02:29:00 +00:00
melissaml 91e5cba034 Use http code constant instead of int
To keep the consistency, using HTTP_NO_CONTENT instead
of 204

Change-Id: I3d4c0ab6851ce08d1ead0f3b275cb6b41fdb65ac
2018-03-26 08:50:30 +08:00
melissaml 3bc267d10c fix a typo in documentation
Change-Id: I0492ae1d50493585ead919904d6d9502b7738266
2018-03-23 07:29:02 +08:00
Zuul 9aca9ad780 Merge "Change object_audit_location_generator() to yield for a single policy." 2018-03-22 06:18:19 +00:00
Alexandre Lécuyer 8d7e245eb5 Change object_audit_location_generator() to yield for a single policy.
auditor.py currently relies on POLICY[0] object_audit_location_generator()
to yield an AuditLocation for all policies on the object-server.

The changes in this patch are :
  - object_audit_location_generator() yields AuditLocation only for the
  requested policy
  - audit_all_objects() calls object_audit_location_generator() for each
    policy

Closes-Bug: 1534212
Change-Id: Ida92ba0a5e1e486a4f7132c6539460b38c34ec87
2018-03-22 03:02:35 +00:00
Tim Burke 06eb482778 Remove last vestiges of CONF
Change-Id: I4dfb15373c0e7d4473089f653cd6d3479a3320e5
2018-03-22 00:14:26 +00:00
Zuul 7bacb38c76 Merge "Add round_robin_iter function to common/utils" 2018-03-20 22:47:14 +00:00
Zuul 0b649d5387 Merge "Refactor tempurl functional test's try-finally" 2018-03-20 19:47:43 +00:00
Alexandre Lécuyer 9f4910f6b9 Add round_robin_iter function to common/utils
Move the existing code in db_replicator.py to utils.py

Change-Id: I04e3f30a82c89fb7e714c5eb7225374b9a5c76f9
2018-03-20 15:18:58 +01:00
Kazuhiro MIYAHARA 7e77bf34f2 Refactor tempurl functional test's try-finally
This is a following patch of [1]. In [1] comment, tim suggested
implementation for same behavior with less code.
This change implemented the suggestion. See [1] for more details.

[1]: https://review.openstack.org/#/c/547306/

Change-Id: Ifd8a0534fbdf41837977028c0c6ef99f1f6ac0f0
2018-03-20 09:02:58 +00:00
Zuul 08938eeb33 Merge "Encapsulate some general utility in utils" 2018-03-20 06:45:35 +00:00
Zuul 900bd2f0ab Merge "Use state when you have it" 2018-03-20 00:05:16 +00:00
Zuul b20893f540 Merge "Support -d <devs> and -p <partitions> in DB replicators." 2018-03-20 00:04:01 +00:00
Clay Gerrard 2c4c23defc Encapsulate some general utility in utils
... but either way works.

Change-Id: I56b7689270e528a1d2099ff96030ce660e588c94
Related-Change-Id: Ic108f5c38f700ac4c7bcf8315bf4c55306951361
2018-03-16 18:45:16 -07:00
Clay Gerrard bb3553d084 Use state when you have it
... but either way works.

Change-Id: Ib66ee035229d0718b68450587550176c91ce9ca6
Related-Change-Id: Ic108f5c38f700ac4c7bcf8315bf4c55306951361
2018-03-16 18:17:59 -07:00
Kota Tsuyuzaki b512ff0574 Remove conf from s3 request
The parent patch did just mechanical translation from global
CONF instance to local self.conf in the controller.

This patch tries to pull the conf from Request instance that
is actually needn't, just set some variable should be fine to us.

Change-Id: I006145f1d4d70bf3e0ba6a1d4698e75c08cd004b
2018-03-15 19:09:11 +09:00
Zuul f2e8565bb6 Merge "Ensure reverting test env if the env is temporarily changed" 2018-03-15 02:19:40 +00:00
Zuul 5fa1c9e8bb Merge "py3: port cli form_signature and unit tests" 2018-03-15 02:19:37 +00:00
Zuul 787c114ec4 Merge "Fix tests using O_TMPFILE" 2018-03-15 00:40:55 +00:00
Zuul 44070c0eec Merge "Add handoffs-only mode to DB replicators." 2018-03-14 20:36:31 +00:00
Kota Tsuyuzaki 4d9fbb14cb Avoid global CONF instance
Change-Id: I6ce117678cfac455c16abb15cf7e7cab199680e6
2018-03-14 19:47:36 +09:00
Samuel Merritt de38b727b4 Don't double-filter replication jobs
ObjectReplicator.collect_jobs() takes and correctly applies the
various overrides, so there's no need to check the returned jobs
against the overrides.

Change-Id: I2a59b26410d1732a5f2c8f1f32e397d77550860e
2018-03-13 11:44:10 -07:00
Thomas Goirand 22b9a4a943 Fix tests using O_TMPFILE
Unit tests using O_TMPFILE only rely on the kernel version to check
for the feature. This is wrong, as some filesystem, like tmpfs, doesn't
support O_TMPFILE.

So, instead of checking kernel version, this patch actually attempts to
open a file using O_TMPFILE and see if that's supported. If not, then
the test is skipped.

Change-Id: I5d652f1634b1ef940838573cfdd799ea17b8b572
2018-03-13 12:06:07 +00:00
Matthew Oliver e84ed57a72 py3: port cli form_signature and unit tests
This patch ports the form_signature cli `swift-form-signature`
and it's corrisponding tests to py3.

In essence in Py3 the HMAC function expects binary strings.

Change-Id: I5dded4ceb80f0cc595403775e8f9c17873e1e37b
2018-03-13 06:19:44 +00:00
Zuul 0a4d1b7e22 Merge "Capture probe test logs" 2018-03-13 03:39:03 +00:00
Zuul 2c7e12289f Merge "Optionally drop common prefixes in swift-*-info output" 2018-03-13 03:39:02 +00:00
Zuul 4fd7b0354c Merge "Apply remote metadata in _handle_sync_response" 2018-03-12 23:42:57 +00:00
Tim Burke 1b546f6b77 Capture probe test logs
Change-Id: Ib2f3aa1d70e6d28e00570fe21352031dc41325d0
2018-03-12 23:10:24 +00:00