Top "Apache-airflow" questions

Apache Airflow is a workflow management platform to programmatically author, schedule, and monitor workflows as directed acyclic graphs (DAGs) of tasks.

How to set a SLA in Airflow?

I would like to set a SLA in a Sensor Operator. The documentation is not too clear about the use …

airflow apache-airflow airflow-scheduler
airflow pass parameter from cli

Is there a way to pass a parameter to: airflow trigger_dag dag_name {param} ? I have a script that …

airflow apache-airflow airflow-scheduler
How do I trigger Airflow -dag using TriggerDagRunOperator

I have found following link: https://www.linkedin.com/pulse/airflow-lesson-1-triggerdagrunoperator-siddharth-anand which indeed explains how to use TriggerDagRunOperator to …

python sql triggers directed-acyclic-graphs apache-airflow
How to obtain and process mysql records using Airflow?

I need to 1. run a select query on MYSQL DB and fetch the records. 2. Records are processed by python script. …

mysql python-3.x airflow apache-airflow
Airflow depends_on_past for whole DAG

Is there a way in airflow of using the depends_on_past for an entire DagRun, not just applied to …

airflow apache-airflow airflow-scheduler
Make custom Airflow macros expand other macros

Is there any way to make a user-defined macro in Airflow which is itself computed from other macros? from airflow …

airflow apache-airflow
Airflow: Log file isn't local, Unsupported remote log location

I am not able see the logs attached to the tasks from the Airflow UI: Log related settings in airflow.…

airflow apache-airflow airflow-scheduler
Airflow structure/organization of Dags and tasks

My questions : What is a good directory structure in order to organize your dags and tasks? (the dags examples show …

airflow apache-airflow
Airflow: pass {{ ds }} as param to PostgresOperator

i would like to use execution date as parameter to my sql file: i tried dt = '{{ ds }}' s3_…

python scheduler airflow apache-airflow
Passing parameters to Airflow's jobs through UI

Is it possible to pass parameters to Airflow's jobs through UI? AFAIK, 'params' argument in DAG is defined in python …

airflow apache-airflow orchestration