Top "Airflow" questions

Apache Airflow is a workflow management platform to programmatically author, schedule, and monitor workflows as directed acyclic graphs (DAGs) of tasks.

I am getting "bash: airflow: command not found"

I am getting -bash: airflow: command not found after installing Apache Airflow. I am using Google Cloud Compute Engine and …

debian google-compute-engine airflow
Example DAG gets stuck in "running" state indefinitely

In my first foray into airflow, I am trying to run one of the example DAGS that comes with the …

airflow
Apache Airflow scheduler does not trigger DAG at schedule time

When I schedule DAGs to run at a specific time everyday, the DAG execution does not take place at all. …

python apache cron directed-acyclic-graphs airflow
airflow trigger_dag execution_date is the next day, why?

Recently I have tested airflow so much that have one problem with execution_date when running airflow trigger_dag <…

python airflow
Airflow default on_failure_callback

In my DAG file, I have define a on_failure_callback() function to post a Slack in case of failure. …

python operators airflow apache-airflow
Debugging Broken DAGs

When the airflow webserver shows up errors like Broken DAG: [<path/to/dag>] <error>, how and …

airflow apache-airflow
How to pass parameter to PythonOperator in Airflow

I just started using Airflow, can anyone enlighten me how to pass a parameter into PythonOperator like below: t5_send_…

python airflow
Issues running airflow scheduler as a daemon process

I have an EC2 instance that is running airflow 1.8.0 using LocalExecutor. Per the docs I would have expected that one …

python amazon-ec2 ubuntu-16.04 airflow apache-airflow
While airflow initdb, ImportError: cannot import name HiveOperator

I have recently installed airflow for my workflows. While creating my project, I executed following command: airflow initdb which returned …

python-2.7 hive airflow
How to skip tasks on Airflow?

I'm trying to understand whether Airflow supports skipping tasks in a DAG for ad-hoc executions? Lets say my DAG graph …

airflow directed-acyclic-graphs airflow-scheduler