Commit Graph

210 Commits

Author SHA1 Message Date
Monty Taylor 69e8c55a13 Retire stackforge/swiftsync 2015-10-17 16:04:59 -04:00
Jenkins ea4c2c2903 Merge "Set full_listing to True to avoid the default limit" 2014-05-05 11:29:12 +00:00
Fabien Boucher fa25f45e6c Set full_listing to True to avoid the default limit
- Swiftclient cuts to 10000 by default the
amount of objects listed with get_container. This
patch set the full_listing to True.

- This patch has no solutions to avoid the
high memory consumption when container
contains a huge amount of objects.

Closes-Bug: #1279804

Change-Id: I2d991baa14f9d4c6a827629c6b43fcc693e0262a
2014-02-13 16:54:06 +01:00
Fabien Boucher 8aed90c5ad Update README file
Adding a note on how to contribute and
report a bug.

Change-Id: Iced030f68356b7752283fbb42d6d9176c97a41bd
2014-02-13 14:50:32 +01:00
Jenkins 3793a27400 Merge "Fix spelling mistakes." 2013-12-03 23:13:14 +00:00
Chmouel Boudjnah 32c04ba1d1 Fix spelling mistakes.
Change-Id: I8ff75366e9a689102839b2a122b978d2f548c00b
2013-12-03 15:32:53 +01:00
Tristan Cacqueray 1d429ff313 Implement last-modified middleware support
Note: swsync will not sync if dest is more recent than source.
Thus if objects are deleted on dest, they won't be re-created
on next sync.

Change-Id: I56199e5f408e0341c5dcae678282c78f56b26215
2013-11-18 10:56:12 -05:00
Chmouel Boudjnah d72c24a184 Add .gitreview file
- Fix the target to pep8 instead of flake8 to get tests passing.
- Exclude H803 pep8 check.
- Correct pep8 error.

Change-Id: I90c7abafb6a23e46ff8b0210ff49e37d79730948
2013-11-15 14:56:09 +01:00
Joe H. Rahme 4523c3ae55 Merge pull request #63 from TristanCacqueray/master
Maintenance fixes
2013-11-12 02:27:49 -08:00
Tristan Cacqueray ea9fe0b71c Fix tests for new flake8 rules 2013-11-08 05:50:53 -05:00
Tristan Cacqueray b62a7ba55e Fix compatibilities issues with recent swift devel
Server does not set x-trans-id anymore
swift.common includes a more generic FileLikeIter object
2013-11-08 05:13:40 -05:00
Tristan Cacqueray 3d9e44c2b9 Adds check for swift_operator_role, else exit 2013-11-07 11:29:09 -05:00
Tristan Cacqueray 079bf57d19 Fix the configuration error handling 2013-11-07 11:28:27 -05:00
Tristan Cacqueray 4f1b2ee6cc Updates README installation procedure
Includes an installation workaround for the exception
'dist must be a Distribution instance'
2013-11-07 11:26:40 -05:00
Joe Rahme 850baa2c6a Merge pull request #62 from enovance/tenant_filter
Adds the tenant_filter_file to the config file
2013-06-11 23:54:04 -07:00
Joe H. Rahme f50cd083ed Updates README and other documentation fixes 2013-06-11 09:28:00 +02:00
Joe H. Rahme 0144024269 Adds tests for the tenant filter feature 2013-06-04 15:52:24 +02:00
Joe H. Rahme 714824efa7 Fixes tenant_name vs name confusion 2013-06-04 15:48:27 +02:00
Joe H. Rahme 445b134e9c Unit tests coverage for get_target_tenant_filter 2013-06-03 15:43:31 +02:00
Joe H. Rahme e7faae0df6 Replaces IDs with tenant_name in filter list 2013-06-03 15:42:57 +02:00
Joe H. Rahme 634a668024 Fix test failing when missing a config field 2013-06-02 03:19:28 +02:00
Joe H. Rahme e29cfb8d64 Fixes flake8 issues 2013-05-30 17:35:20 +02:00
Joe H. Rahme ee2cb04c36 Prevent catching of IOError in case tenant_filter_list is defined
This means the only way to do a full sync is to omit the field from the config
file.
2013-05-30 16:56:27 +02:00
Joe H. Rahme 0fd9a7fa43 Adds the tenant_filter_file to the config file
tenant_filter_file is the path to a file that contains a list of tenant
ids to migrate. If missing, swsync will migrate all the tenants.
2013-05-30 12:50:57 +02:00
Joe H. Rahme 2158a01ecd Fixes swsync call syntax in the README 2013-05-22 13:41:23 +02:00
Chmouel Boudjnah 2ee266fefd Merge pull request #60 from morucci/update-readme
Update readme
2013-05-13 08:55:41 -07:00
Fabien Boucher f3e4df187c Changes in README according to chmouel review 2013-05-13 17:13:54 +02:00
Fabien Boucher 2bf9db1961 Fix indent in README.md. 2013-05-10 17:59:54 +02:00
Fabien Boucher 3ad02e834e Update README file. 2013-05-10 17:58:18 +02:00
Chmouel Boudjnah f163e3b143 Merge pull request #56 from morucci/issue-52
Issue 52 Add functional test on syncer
2013-04-22 03:07:15 -07:00
Chmouel Boudjnah 2235b00628 Merge pull request #57 from morucci/issue-30
Rename config.ini add it to .gitignore
2013-04-22 02:49:18 -07:00
Fabien Boucher 7f62a47da9 Unittests now use the sample configuration file.
Fixes #30
2013-04-22 11:45:48 +02:00
Fabien Boucher 280694089b Merge pull request #58 from chmouel/flake8
Fix flake8 gating in tox.
2013-04-22 00:36:49 -07:00
Chmouel Boudjnah c3c09ad38f Fix flake8 gating in tox.
- based on https://review.openstack.org/#/c/26327/.
- fix the remaining violations.
2013-04-21 06:34:22 +02:00
Fabien Boucher 95b1dece69 Rename config.ini add it to .gitignore
Fixes #30
2013-04-19 14:29:51 +02:00
Fabien Boucher 0addff6958 Fix tox test on container syncer. 2013-04-19 14:12:01 +02:00
Fabien Boucher 08cd2c5f30 Some refactoring 2013-04-19 11:52:05 +02:00
Fabien Boucher e97c5178b3 Fix account deletion on syncer
Origin and dest can contain same amount
of container since last sync process
but for instance on origin a container
can has been added and one other removed.
So base only deletion evaluation on set
computation.
2013-04-19 11:29:06 +02:00
Fabien Boucher d73a23136a Filler now able to put metadata on account 2013-04-19 10:23:18 +02:00
Fabien Boucher 59c35d6353 Fix wrong section when retreiving concurrency 2013-04-18 18:24:34 +02:00
Fabien Boucher cfe2cd9ccc Some fixes in container syncer
- Do not assume container with the same exist on remote
  account.
- Fix object to delete set contruction.
2013-04-18 18:19:26 +02:00
Fabien Boucher 1b8ce62645 Add container and object test with two sync passes 2013-04-18 18:16:07 +02:00
Fabien Boucher 65feba9219 FIX PEP8 2013-04-18 14:26:15 +02:00
Fabien Boucher 2e620d4741 Add test two sync passes on account meta 2013-04-18 14:09:10 +02:00
Fabien Boucher 40289d1a29 Add another test to very object meta and content 2013-04-18 11:56:31 +02:00
Fabien Boucher afe6482b4f Add more tests 2013-04-17 18:46:56 +02:00
Fabien Boucher 40d33ab9bf Add first functional test for syncer 2013-04-17 16:10:18 +02:00
Chmouel Boudjnah 643d1d1e6e Merge pull request #54 from morucci/issue-39-41
Refactoring to a more clearly config file.
2013-04-11 06:43:23 -07:00
Fabien Boucher 048d7e659b Refactoring to a more clearly config file. 2013-04-11 15:21:17 +02:00
Fabien Boucher 85490fbbe5 Merge pull request #53 from chmouel/account-metadata-sync
Add account metadata sync.
2013-04-11 05:28:55 -07:00