Airflow

A Story by
A platform to programmaticaly author, schedule and monitor data pipelines, by Airbnb

What is Airflow?

Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.
Airflow is a tool in the Workflow Manager category of a tech stack.

Who is using it?

341 companies use Airflow in their tech stacks, including Airbnb, Slack, and Robinhood.

Airbnb

Slack

Robinhood

Walmart

Square

Trustpilot

Groww

Client Platform

technology

BlaBlaCar

Gympass

Yousign

Why developers like Airflow

Features
Task Dependency Management
Beautiful UI
Cluster of workers
Extensibility
Open source
Complex workflows
Python
Good api