aboutsummaryrefslogtreecommitdiffstats
path: root/mediagoblin/storage/__init__.py
Commit message (Collapse)AuthorAgeFilesLines
* Make copying to/from storage systems memory efficient (#419)Sebastian Spaeth2013-03-031-4/+6
| | | | | | | | | | | | | The copy_locally and copy_local_to_storage (very inconsistent terms BTW) were simply slurping in everything in RAM and writing it out at once. (the copy_locally was actually memory efficient if the remote system was local) Use shutil.copyfileobj which does chunked reads/writes on file objects. The default buffer size is 16kb, and as each chunk means a separate HTTP request for e.g. cloudfiles, we use a chunksize of 4MB here (which has just been arbitrarily set by me without tests). This should help with the failure to upload large files issue #419.
* Make filestorage available to code that only imports storage.Brett Smith2012-07-081-0/+2
| | | | The storage-related tests were relying on this, if nothing else.
* Fix problems from pyflakes outputWill Kahn-Greene2012-06-031-2/+0
|
* It's 2012 all up in hereChristopher Allan Webber2012-02-021-1/+1
|
* Slightly clearer docs on copy_local_to_storageChristopher Allan Webber2011-11-201-0/+4
|
* copy_local_to_storage, both general and specialized-for-BasicFileStorage ↵Christopher Allan Webber2011-11-201-0/+8
| | | | | | | versions This utility should allow for easy copying from a local filesystem to the storage instance.
* Finished splitting util.py into separate files.Aaron Williamson2011-10-011-2/+2
|
* Feature #587 - Split storage.py into submodulesJoar Wandborg2011-09-121-0/+240
* Removed storage.py * Created submodules for filestorage, cloudfiles, mountstorage * Changed test_storage to reflect the changes made in the storage module structure * Added mediagoblin.storage.filestorage.BasicFileStorage as a default for both publicstore and queuestore's `storage_class`