Top "Airflow-scheduler" questions

The Apache Airflow scheduler monitors all tasks and all DAGs, and triggers the task instances whose dependencies have been met, and Apache Airflow is a platform to programmatically author, schedule and monitor workflows.

Airflow scheduler is slow to schedule subsequent tasks

When I try to run a DAG in Airflow 1.8.0 I find that it takes a lot of time between the …

airflow airflow-scheduler
Which one to choose Apache Oozie or Apache Airflow? Need a comparison

I am new to job schedulers and was looking out for one to run jobs on big data cluster. I …

jobs oozie airflow airflow-scheduler
Airflow depends_on_past for whole DAG

Is there a way in airflow of using the depends_on_past for an entire DagRun, not just applied to …

airflow apache-airflow airflow-scheduler
How to restart DAG in Airflow?

One of my DAGs with many steps stopped part way through because of a DB shutdown. I'd like to get …

airflow airflow-scheduler
Airflow: Log file isn't local, Unsupported remote log location

I am not able see the logs attached to the tasks from the Airflow UI: Log related settings in airflow.…

airflow apache-airflow airflow-scheduler
Airflow Worker Configuration

I am a newbie to Airflow. I'm trying to setup Distributed Mode of Airflow Using Celery Executor by Refering this …

python python-3.x airflow airflow-scheduler
Airflow S3KeySensor - How to make it continue running

With the help of this Stackoverflow post I just made a program (the one shown in the post) where when …

boto3 airflow airflow-scheduler
How do I stop an airflow DAG?

Running Airflow 1.9.0 with python 2.7. How do I gracefully stop a DAG? In this case, I have a DAG that's running …

airflow airflow-scheduler
How to uninstall Airflow?

I am a newbie to Airflow. i have some trouble to remove Airflow v1.10.3 ,i am using pip3 version 8.1.1 on …

pip airflow airflow-scheduler
Airflow - Broken DAG - Timeout

I have a DAG that executes a function that connects to a Postgres DB, deletes the contents in the table …

airflow airflow-scheduler