aboutsummaryrefslogtreecommitdiffstats
path: root/mediagoblin/init/celery
Commit message (Collapse)AuthorAgeFilesLines
* Don't disable existing loggers when initialising Celery.Ben Sturmfels2021-08-231-1/+1
| | | | | | | | | | | | | | | Prior to this change, the Celery logging did not include any of the logging calls within MediaGoblin because `disable_existing_loggers` defaulted to True. This was unhelpful and inconsistent with the logging behaviour of the web process. The MediaGoblin web process sets logging output based on the configuration in paste.ini. This is loaded by the `paster` program, rather than MediaGoblin itself. The MediaGoblin celery process manually loads its logging config from paste.ini, but previously defaulted to `disable_existing_loggers=True`, meaning that none of the application logging flowed through unless the logger was explicitly added to paste.ini.
* Remove remaining imports/calls to six not automatically removed by pyupgrade.Ben Sturmfels2021-03-051-2/+0
|
* Apply `pyupgrade --py3-plus` to remove Python 2 compatibility code.Ben Sturmfels2021-03-052-6/+6
|
* Avoid Celery/RabbitMQ "connection reset" errors [#5609].Fernando Gutierrez2020-05-121-1/+0
| | | | | | This change starts Celery only after RabbitMQ is available. It also returns the unnecessarily low BROKER_HEARTBEAT setting to default of 120.0 to help prevent connections being reset on machines under load.
* Replace print statements to loggingvijeth-aradhya2017-08-051-3/+0
| | | | Closes #5
* Celery Priority testing with debug statementsvijeth-aradhya2017-06-131-0/+3
| | | | | | Error at this line: `self.entry.set_file_metadata(self.curr_file, **file_metadata)` Otherwise, celery part should work fine.
* Add additional celery config settingsvijeth-aradhya2017-06-111-0/+8
| | | | | | Fixes older webm_video backward compatibilty issue. Add 'default' queue to be used from now. Add other necessary celery settings for priority.
* Merge branch 'merge-python3-port'Christopher Allan Webber2014-09-221-2/+4
|\ | | | | | | | | Conflicts: setup.py
| * Merge branch 'master' into merge-python3-portChristopher Allan Webber2014-09-161-1/+16
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Has some issues, will iteratively fix! Conflicts: mediagoblin/gmg_commands/__init__.py mediagoblin/gmg_commands/deletemedia.py mediagoblin/gmg_commands/users.py mediagoblin/oauth/views.py mediagoblin/plugins/api/views.py mediagoblin/tests/test_api.py mediagoblin/tests/test_edit.py mediagoblin/tests/test_oauth1.py mediagoblin/tests/test_util.py mediagoblin/tools/mail.py mediagoblin/webfinger/views.py setup.py
| * | Use six.iteritems() instead of dict.iteritems().Berker Peksag2014-05-261-2/+4
| | |
* | | The scheduled garbage collection task was not being called due to it being ↵Matt Molyneaux2014-09-161-1/+1
| |/ |/| | | | | | | | | misnamed Fix #968
* | Tidy up federation code and add tests to cover more of the APIsJessica Tallon2014-08-181-2/+4
| |
* | Add unseralize for API objectsJessica Tallon2014-07-221-1/+1
| |
* | Add garbage collection taskJessica Tallon2014-07-221-0/+13
|/
* New notificationsJoar Wandborg2013-06-091-1/+17
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Added request.notifications - Email configuration fixes - Set config_spec default SMTP port to `0` and switch to SSL/non-SSL default if `port == 0` - Added email_smtp_use_ssl configuration setting - Added migrations for notification tables - Added __repr__ to MediaComment(Mixin) - Added MediaComment.get_entry => MediaEntry - Added CommentSubscription, CommentNotification, Notification, ProcessingNotification tables - Added notifications.task to celery init - Fixed a bug in the video transcoder where pygst would hijack the --help argument. - Added notifications - views - silence - subscribe - routes - utility methods - celery task - Added half-hearted .active comment CSS style - Added quick JS to show header_dropdown - Added fragment template to show notifications in header_dropdown - Added fragment template to show subscribe/unsubscribe buttons on media/comment pages - Updated celery setup tests with notifications.task - Tried to fix test_misc tests that I broke - Added notification tests - Added and extended tests.tools fixtures - Integrated new notifications into media_home, media_post_comment views - Bumped SQLAlchemy dependency to >= 0.8.0 since we need polymorphic for the notifications to work
* Tests should no longer use the environment-variable-related-setup and set up ↵Christopher Allan Webber2013-05-121-33/+0
| | | | | | | | | in app instead This should remove a bunch of confusing cruft. I hate using that environment variable! Also that old code was fragile. This commit sponsored by Stephen Milton. Thanks!
* removing old callable utilities and porting stuff over.Christopher Allan Webber2013-04-192-4/+4
|
* Switch several functions over to using the new callable_run* tools!Christopher Allan Webber2013-04-102-7/+4
|
* Updated raven pluginJoar Wandborg2013-03-032-0/+9
| | | | | | | - Added wrap_wsgi, celery_setup, celery_logging_setup hooks - Updated raven plugin docs - Updated production considerations docs - Added raven logging setup
* You can now set the PASTE_CONFIG environment variable to control logging setupChristopher Allan Webber2013-02-251-0/+5
| | | | | | | | So this should work: PASTE_CONFIG=/path/to/paste_foo.ini ./lazycelery.sh Thanks to Laurent Fournier for sponsoring this commit!
* Use logging.config.fileConfig()Joar Wandborg2013-02-071-41/+2
| | | | Instead of the monster I had built before.
* Removed debugging stuff from masterJoar Wandborg2012-09-301-8/+0
|
* Use RawConfigParser instead of dict.viewitemsJoar Wandborg2012-09-301-3/+7
| | | | dict.viewitems breaks python 2.6 compatibility.
* Set up celery logging from paste iniJoar Wandborg2012-09-301-0/+65
|
* from_celery.setup_self() didn't pay attention to default_conf_file kwarg, fixed.Christopher Allan Webber2012-05-201-4/+5
|
* Making celeryd consistent: look for mediagoblin_local.iniChristopher Allan Webber2012-04-221-1/+6
| | | | | Use mediagoblin_local.ini as default conf file if it exists, else use mediagoblin.ini, just like everything else.
* SQL based tests and refactored Celery setup stuffChristopher Allan Webber2012-03-261-15/+40
| | | | | | - Changed config files of test configs to use SQL - Updated celery initialization tools, factored them to be able to use the "big instance" application stuff
* And fix the in-celeryd import.Elrond2012-03-211-1/+1
| | | | So that celeryd also loads the task.
* Accidentally overwrote the celery/__init__.py, fixed this and removed the ↵Luke Slater2012-02-281-1/+55
| | | | upper correctly
* Changed celery config keys to upper case and removed upper casing of keys ↵Luke Slater2012-02-281-56/+1
| | | | when initialising the config as per issue #214
* Should be all that's needed to switch celery/kombu settings to sqlalchemyChristopher Allan Webber2012-02-251-20/+3
|
* It's 2012 all up in hereChristopher Allan Webber2012-02-023-3/+3
|
* Fixes after merging video branch into masterJoar Wandborg2011-11-211-3/+1
| | | | | | | | | | | | | - Removed debug output from init/celery - Moved process_media/__init__ to processing.py - Centralized the processing.ProcessMedia task class - Updated media managers to reference the processing function instead of the ProcessMedia instance - Updated new-style image processing to previous, newer old-style image processing - Updated video transcoding - Changed method in progress output, sometimes message.structure['percent'] raises KeyError
* Merge branch 'video_gstreamer-only'Joar Wandborg2011-11-211-0/+2
|\ | | | | | | | | | | Conflicts: mediagoblin/db/migrations.py mediagoblin/submit/views.py
| * Stashing changesJoar Wandborg2011-11-211-3/+0
| |
| * Multimedia support - Commiting from a not yet finished state - Details belowJoar Wandborg2011-09-231-0/+5
| | | | | | | | | | | | | | | | | | | | | | * DONE Initially testing with arista ** DONE Video display templates *** TODO Multi-browser support ** TODO Video thumbnails ** TODO Link to original video ** TODO Video cropping Also contains a lot of "debug" print's
* | has_key is deprecated, converting uses to use "in" operator.Nathan Yergler2011-10-011-5/+5
| |
* | Whitespace and formatting cleanup.Nathan Yergler2011-10-012-2/+2
|/ | | | | | | * Removed trailing whitespace * Line length < 80 where possible * Honor conventions on number of blank lines * Honor conventions about spaces around :, =
* 508. Updates copyright/license informationWill Kahn-Greene2011-09-013-3/+3
|
* Move db_name default into config_spec.iniElrond2011-07-111-1/+1
| | | | | | | The default name of the database ("mediagoblin") was coded in db/open.py and init/celery/__init__.py. Instead use the new config system to have this as the default for the "db_name" config option.
* Move mediagoblin.celery_setup -> mediagoblin.init.celeryElrond2011-07-024-0/+182
As the first target of the new .init. submodule move celery_setup there. Quite straight forward, just a lot of places to change.