How to inspect and cancel Celery tasks by task name

python redis celery
Mzzzzzz picture Mzzzzzz · Mar 22, 2013 · Viewed 24.5k times · Source

I'm using Celery (3.0.15) with Redis as a broker.

Is there a straightforward way to query the number of tasks with a given name that exist in a Celery queue?

And, as a followup, is there a way to cancel all tasks with a given name that exist in a Celery queue?

I've been through the Monitoring and Management Guide and don't see a solution there.

Answer

gioi picture gioi · Mar 26, 2013 
# Retrieve tasks
# Reference: http://docs.celeryproject.org/en/latest/reference/celery.events.state.html
query = celery.events.state.tasks_by_type(your_task_name)

# Kill tasks
# Reference: http://docs.celeryproject.org/en/latest/userguide/workers.html#revoking-tasks
for uuid, task in query:
    celery.control.revoke(uuid, terminate=True)

Related questions

Pros and cons to use Celery vs. RQ

Currently I'm working on python project that requires implement some background jobs (mostly for email sending and heavily database updates). I use Redis for task broker. So in this point I have two candidates: Celery and RQ. I had some …

Read More
Celery: When should you choose Redis as a message broker over RabbitMQ?

My rough understanding is that Redis is better if you need the in-memory key-value store feature, however I am not sure how that has anything to do with distributing tasks? Does that mean we should use Redis as a message …

Read More
Celery (Redis) results backend not working

I have a web application using Django and i am using Celery for some asynchronous tasks processing. For Celery, i am using Rabbitmq as a broker, and Redis as a result backend. Rabbitmq and Redis are running on the same …

Read More