Apache Airflow is a workflow management platform to programmatically author, schedule, and monitor workflows as directed acyclic graphs (DAGs) of tasks.
I have a bash script that creates a file (if it does not exist) that I want to run in …
python airflowHello people of the Earth! I'm using Airflow to schedule and run Spark tasks. All I found by this time …
java python apache-spark directed-acyclic-graphs airflowthe Local Executor spawns new processes while scheduling tasks. Is there a limit to the number of processes it creates. …
airflowI'm just getting started with Airbnb's airflow, and I'm still not clear on how/when backfilling is done. Specifically, there …
airflowFollowing Airflow tutorial here. Problem: The webserver returns the following error Broken DAG: [/usr/local/airflow/dags/test_operator.py] …
airflowIs there a way to ssh to different server and run BashOperator using Airbnb's Airflow? I am trying to run …
python ssh airflowI am using docker-compose to set up a scalable airflow cluster. I based my approach off of this Dockerfile https://…
python amazon-s3 airflowAre Airflow and Nifi perform the same job on workflows? What are the pro/con for each one? I need …
python apache-nifi airflowI am a new user of Airbnb's open source workflow/datapipeline software airflow. There are dozens of default example dags …
python airflowI use Airflow to manage ETL tasks execution and schedule. A DAG has been created and it works fine. But …
airflow