Top "Airflow" questions

Apache Airflow is a workflow management platform to programmatically author, schedule, and monitor workflows as directed acyclic graphs (DAGs) of tasks.

How do I restart airflow webserver?

I am using airflow for my data pipeline project. I have configured my project in airflow and start the airflow …

python-2.7 airflow
execution_date in airflow: need to access as a variable

I am really a newbie in this forum. But I have been playing with airflow, for sometime, for our company. …

airflow
Airflow - How to pass xcom variable into Python function

I need to reference a variable that's returned by a BashOperator. In my task_archive_s3_file, I need to …

airflow
How to run Airflow on Windows

The usual instructions for running Airflow do not apply on a Windows environment: # airflow needs a home, ~/airflow is the …

python windows flask flask-admin airflow
Airflow: how to delete a DAG?

I have started the Airflow webserver and scheduled some dags. I can see the dags on web GUI. How can …

airflow
How to stop/kill Airflow tasks from the UI

How can I stop/kill a running task on Airflow UI? I am using LocalExecutor. Even if I use CeleryExecutor, …

python apache hadoop airflow apache-airflow
Airflow 1.9.0 is queuing but not launching tasks

Airflow is randomly not running queued tasks some tasks dont even get queued status. I keep seeing below in the …

airflow airflow-scheduler
How to Run a Simple Airflow DAG

I am totally new to Airflow. I would like to run a simple DAG at a specified date. I'm struggling …

python airflow
Python Airflow - Return result from PythonOperator

I have written a DAG with multiple PythonOperators task1 = af_op.PythonOperator(task_id='Data_Extraction_Environment', provide_context=True, …

python airflow
How to install airflow?

I seem to be doing sth. wrong. https://pythonhosted.org/airflow/start.html $ export AIRFLOW_HOME=~/airflow $ pip install apache-airflow …

ubuntu pip airflow