Top "Celery" questions

Celery is a distributed task queue framework for Python, used for asynchronous and parallel execution.

Daemonizing celery

Following instructions found here, I copied the script from github into /etc/init.d/celeryd, then made it executable; $ ll /…

python linux celery celeryd
InterfaceError: connection already closed (using django + celery + Scrapy)

I am getting this when using a Scrapy parsing function (that can take till 10 minutes sometimes) inside a Celery task. …

python django scrapy celery
Celery AttributeError: async error

I have RabbitMQ and Celery running locally on my Mac (OS/X 10.13.4), the following code works locally when I run …

python celery celery-task
Celery auto reload on ANY changes

I could make celery reload itself automatically when there is changes on modules in CELERY_IMPORTS in settings.py. I …

python celery django-celery
Celery worker hangs without any error

I have a production setup for running celery workers for making a POST / GET request to remote service and storing …

python celery blocking gevent
Django Celery Task Logging

I have setup Celery in a Django project on which I am working. I would like to separate the logging …

python django logging celery django-celery
Celery task schedule (Celery, Django and RabbitMQ)

I want to have a task that will execute every 5 minutes, but it will wait for last execution to finish …

rabbitmq celery django-celery
Celery: When should you choose Redis as a message broker over RabbitMQ?

My rough understanding is that Redis is better if you need the in-memory key-value store feature, however I am not …

python django redis rabbitmq celery
Pickle is refusing to serialize content with celery reporting ContentDisallowed: Refusing to deserialize untrusted content of type pickle

I am trying to put some python object mostly json serializable except datetime.datetime in rabbitmq queue and so using …

python json ssl celery pickle
Retrying tasks with Django-Celery - Django/Celery

I'm having problems retrying tasks, here is what a test task looks like from celery.decorators import task @task() def …

python django scheduled-tasks celery django-celery