Get the name of celery worker from inside a celery task?

python celery celery-task
imichaeldotorg picture imichaeldotorg · May 25, 2014 · Viewed 7.8k times · Source

I'd like a celery task to be able to get the name of the worker executing it, for logging purposes. I need to handle this from within the task, rather than querying the broker directly. Is there a way to do this? I'm using celery with RabbitMQ, if that matters.

Answer

Roy Iacob picture Roy Iacob · May 25, 2014

You need to utilize billiard which holds the workers:

from celery import task
from billiard import current_process

@task
def getName():
    p = current_process()
    return p.index

Then make a global dictionary that maps ids->names on process creation.

Related questions

Celery Worker Error: ImportError no module named celery

I am getting an import error when I try to start my celery worker. I am not sure what the issue is. Any help would be highly appreciated. My project: email/__init__.py /celery.py I try to run the …

Read More
How can I run a celery periodic task from the shell manually?

I'm using celery and django-celery. I have defined a periodic task that I'd like to test. Is it possible to run the periodic task from the shell manually so that I view the console output?

Read More
Airflow - Python file NOT in the same DAG folder

I am trying to use Airflow to execute a simple task python. from __future__ import print_function from airflow.operators.python_operator import PythonOperator from airflow.models import DAG from datetime import datetime, timedelta from pprint import pprint seven_days_…

Read More