Top "Airflow" questions

Apache Airflow is a workflow management platform to programmatically author, schedule, and monitor workflows as directed acyclic graphs (DAGs) of tasks.

Airflow scheduler does not appear to be running after excute a task

When there is a task running, Airflow will pop a notice saying the scheduler does not appear to be running …

airflow
Airflow depends_on_past explanation

According to the official Airflow docs, The task instances directly upstream from the task need to be in a success …

python python-3.x airflow
Airflow not loading dags in /usr/local/airflow/dags

Airflow seems to be skipping the dags I added to /usr/local/airflow/dags. When I run airflow list_dags …

airflow
How to restart a failed task on Airflow

I am using a LocalExecutor and my dag has 3 tasks where task(C) is dependant on task(A). Task(B) …

python hadoop airflow
Airflow "This DAG isnt available in the webserver DagBag object "

when I put a new DAG python script in the dags folder, I can view a new entry of DAG …

python apache workflow airflow
Airflow tasks get stuck at "queued" status and never gets running

I'm using Airflow v1.8.1 and run all components (worker, web, flower, scheduler) on kubernetes & Docker. I use Celery Executor …

airflow apache-airflow airflow-scheduler
DAG not visible in Web-UI

I am new to Airflow. I am following a tutorial and written following code. from airflow import DAG from airflow.…

python python-3.x airflow directed-acyclic-graphs
How to use AirFlow to run a folder of python files?

I have a series of Python tasks inside a folder of python files: file1.py, file2.py, ... I read the …

python airflow
Running Job On Airflow Based On Webrequest

I wanted to know if airflow tasks can be executed upon getting a request over HTTP. I am not interested …

python airflow
How to access the response from Airflow SimpleHttpOperator GET request

I'm learning Airflow and have a simple question. Below is my DAG called dog_retriever: import airflow from airflow import …

airflow data-pipeline