aboutsummaryrefslogtreecommitdiffstats
path: root/mediagoblin/storage/__init__.py
Commit message (Collapse)AuthorAgeFilesLines
* Remove remaining imports/calls to six not automatically removed by pyupgrade.Ben Sturmfels2021-03-051-2/+0
|
* Apply `pyupgrade --py3-plus` to remove Python 2 compatibility code.Ben Sturmfels2021-03-051-6/+5
|
* The file() builtin has been removed in Python 3. Use open() instead.Berker Peksag2014-06-071-2/+2
|
* Use six.text_type instead of unicode().Berker Peksag2014-06-021-1/+1
| | | | I will be switch to use ``from __future__ import unicode_literals`` later.
* Use six.iteritems() instead of dict.iteritems().Berker Peksag2014-05-261-1/+3
|
* Continue to port GMG codebase.Berker Peksag2014-05-081-1/+3
|
* added user upload limitsRodney Ewing2013-08-261-0/+7
|
* Merge remote-tracking branch 'cwebber/254_delete_queue_directories'Elrond2013-04-081-3/+13
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | * cwebber/254_delete_queue_directories: Removing docstring bit about delete_file possibly deleting directories in the future Convert media processing backends to delete the queue directory (#254) Implement delete_dir in the FileStorage Conflicts: mediagoblin/media_types/image/processing.py mediagoblin/media_types/video/processing.py Conflicts, because those media_types already use the newer proc_state.delete_queue_file() method (which needs updating.
| * Removing docstring bit about delete_file possibly deleting directories in ↵Christopher Allan Webber2013-01-221-4/+0
| | | | | | | | | | | | | | | | the future I agree that delete_dir as a separate operation is a better way to do things, especially since there is a non-recursive deletion option that will politely fail if the directory is not empty.
| * Implement delete_dir in the FileStorageSebastian Spaeth2013-01-221-1/+15
| | | | | | | | | | | | | | | | plus options for deleting only empty directories and deleting them recursively. Not sure how cloudfile storage is or should be handled here. Are things such as a "directory" even a concept there?
* | Make copying to/from storage systems memory efficient (#419)Sebastian Spaeth2013-03-031-4/+6
|/ | | | | | | | | | | | | The copy_locally and copy_local_to_storage (very inconsistent terms BTW) were simply slurping in everything in RAM and writing it out at once. (the copy_locally was actually memory efficient if the remote system was local) Use shutil.copyfileobj which does chunked reads/writes on file objects. The default buffer size is 16kb, and as each chunk means a separate HTTP request for e.g. cloudfiles, we use a chunksize of 4MB here (which has just been arbitrarily set by me without tests). This should help with the failure to upload large files issue #419.
* Make filestorage available to code that only imports storage.Brett Smith2012-07-081-0/+2
| | | | The storage-related tests were relying on this, if nothing else.
* Fix problems from pyflakes outputWill Kahn-Greene2012-06-031-2/+0
|
* It's 2012 all up in hereChristopher Allan Webber2012-02-021-1/+1
|
* Slightly clearer docs on copy_local_to_storageChristopher Allan Webber2011-11-201-0/+4
|
* copy_local_to_storage, both general and specialized-for-BasicFileStorage ↵Christopher Allan Webber2011-11-201-0/+8
| | | | | | | versions This utility should allow for easy copying from a local filesystem to the storage instance.
* Finished splitting util.py into separate files.Aaron Williamson2011-10-011-2/+2
|
* Feature #587 - Split storage.py into submodulesJoar Wandborg2011-09-121-0/+240
* Removed storage.py * Created submodules for filestorage, cloudfiles, mountstorage * Changed test_storage to reflect the changes made in the storage module structure * Added mediagoblin.storage.filestorage.BasicFileStorage as a default for both publicstore and queuestore's `storage_class`