Incremental block-based backup to object storage
Go to file
Michal Jastrzebski a9d13fc32f Create manifest and implement sqlite driver
Use class inheritance for driver in case we need something other than
sqlite as time goes on.

SQLite is only 10% larger than the custom format used with osdk. When
compressed the SQLite manifest only fractionally larger than osdk. The
time it takes to generate and process is about 2x longer. However, the
benefit we get from using common contructs (sqlite) and tracking and
changing the manifest schema is enough for me to think this is right
way to proceed.

To generate a manifest with 2^24 objects (64TB disk) run:
tools/generate_manifest.py --backupsize 64000 --manifest /pathtosave/manifest

This will generate a 809MB file

Co-Authored-By: Sam Yaple <sam@yaple.net>
Change-Id: Ic431bfa52b6fcaeb1c6a64cf270cbb36c496335e
2016-01-11 18:15:17 +00:00
doc/source Add glossary for some common terms 2016-01-11 18:15:16 +00:00
ekko Create manifest and implement sqlite driver 2016-01-11 18:15:17 +00:00
tests Initial Commit 2016-01-04 16:28:29 +00:00
tools Create manifest and implement sqlite driver 2016-01-11 18:15:17 +00:00
.gitignore Create manifest and implement sqlite driver 2016-01-11 18:15:17 +00:00
.gitreview Added .gitreview 2016-01-04 10:07:07 +00:00
.testr.conf Initial Commit 2016-01-04 16:28:29 +00:00
CONTRIBUTING.rst Initial Commit 2016-01-04 16:28:29 +00:00
HACKING.rst Initial Commit 2016-01-04 16:28:29 +00:00
LICENSE Initial Commit 2016-01-04 16:28:29 +00:00
MANIFEST.in Initial Commit 2016-01-04 16:28:29 +00:00
README.rst Initial Commit 2016-01-04 16:28:29 +00:00
babel.cfg Initial Commit 2016-01-04 16:28:29 +00:00
requirements.txt Create manifest and implement sqlite driver 2016-01-11 18:15:17 +00:00
setup.cfg Initial Commit 2016-01-04 16:28:29 +00:00
setup.py Initial Commit 2016-01-04 16:28:29 +00:00
test-requirements.txt Initial Commit 2016-01-04 16:28:29 +00:00
tox.ini Initial Commit 2016-01-04 16:28:29 +00:00

README.rst

ekko

Block-based backups stored in object-storage

Please feel here a long description which must be at least 3 lines wrapped on 80 cols, so that distribution package maintainers can use it in their packages. Note that this is a hard requirement.

Features

  • TODO