diff options
| author | Sebastian Spaeth <Sebastian@SSpaeth.de> | 2012-12-19 15:59:44 +0100 |
|---|---|---|
| committer | Joar Wandborg <joar@wandborg.se> | 2013-03-02 23:44:54 +0100 |
| commit | 8b35e7ad158f99bc7d3bb34774a6fde6d06bca67 (patch) | |
| tree | edffa49c00c2c7bd815041fe0d9ad6f8fd8ac1cc /docs/source/plugindocs | |
| parent | 77c85224b139a123e7895588af51b6cd4ecaa2b9 (diff) | |
| download | mediagoblin-8b35e7ad158f99bc7d3bb34774a6fde6d06bca67.tar.lz mediagoblin-8b35e7ad158f99bc7d3bb34774a6fde6d06bca67.tar.xz mediagoblin-8b35e7ad158f99bc7d3bb34774a6fde6d06bca67.zip | |
Make Cloudfiles copy memory efficient too (#419)
It seems that (our implementation of) cloudfiles.write() takes
all existing data and appends write(data) to it, sending the
full monty over the wire everytime. This would of course
absolutely kill chunked writes with some O(1^n) performance
and bandwidth usage. So, override this method and use the
Cloudfile's "send" interface instead.
Also make the Cloudfile file wrapper an iterator that allows us to
simply do "for data in cloudfile:" which will stream the data in a
memory-efficient way.
DO NOTE THAT THIS PATCH IS COMPLETELY UNTESTED DUE TO LACK OF SETUP
PLEASE REVIEW AND VERIFY.
Diffstat (limited to 'docs/source/plugindocs')
0 files changed, 0 insertions, 0 deletions