How to debug Celery/Django tasks running locally in Eclipse

python eclipse celery
spoonboy picture spoonboy · Oct 2, 2012 · Viewed 17.9k times · Source

I need to debug Celery task from the Eclipse debugger. I'm using Eclipse, PyDev and Django.

First, I open my project in Eclipse and put a breakpoint at the beginning of the task function.

Then, I'm starting the Celery workers from Eclipse by Right Clicking on manage.py from the PyDev Package Explorer and choosing "Debug As->Python Run" and specifying "celeryd -l info" as the argument. This starts MainThread, Mediator and three more threads visible from the Eclipse debugger.

After that I return back to the PyDev view and start the main application by Right Click on the project and choosing Run As/PyDev:Django

My issues is that once the task is submitted by the mytask.delay() it doesn't stop on the breakpoint. I put some traces withing the tasks code so I can see that it was executed in one of the worker threads.

So, how to make the Eclipse debugger to stop on the breakpoint placed withing the task when it executed in the Celery workers thread?

Answer

Tommaso Barbugli picture Tommaso Barbugli · Oct 3, 2012

You should consider the option to run the celery task in the same thread as the main process (normally it runs on a separate process), this will make the debug much easier.

You can tell celery to run the task in sync by adding this setting to your settings.py module:

CELERY_TASK_ALWAYS_EAGER  = True
# use this if you are on older versions of celery
# CELERY_ALWAYS_EAGER = True

Note: this is only meant to be in use for debugging or development stages!

Related questions

SyntaxError: unexpected EOF while parsing

I have no idea why this does not work please help import random x = 0 z = input('?') int(z) def main(): while x < z: n1 = random.randrange(1,3) n2 = random.randrange(1,3) t1 = n1+n2 print('{0}+{1}={2}'.format(n1,…

Read More
Adding python modules to pydev in eclipse results in import error?

I have a problem getting PyDev on eclipse to recognize already installed modules. Here is my detailed approach. The machine is a Mac (Snow Leopard). In terminal the command python --version shows Python 2.6.6. import unidecode and from unidecode import unidecode …

Read More
Which Eclipse package should I download for PyDev?

Which Eclipse package should I choose for Python development with PyDev? Nothing on the Eclipse homepage tells me what to choose, and the PyDev documentation assumes I already have Eclipse installed. Does it matter which Eclipse package I choose?

Read More