Airflow

A Story by
A platform to programmaticaly author, schedule and monitor data pipelines, by Airbnb

What is Airflow?

Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.
Airflow is a tool in the Workflow Manager category of a tech stack.

Who is using it?

305 companies use Airflow in their tech stacks, including Airbnb, Robinhood, and Slack.

Airbnb

Robinhood

Slack

Client Platform

Square

technology

Walmart

Trustpilot

BlaBlaCar

9GAG

Groww

OmniPlatform

Why developers like Airflow

Features
Task Dependency Management
Cluster of workers
Beautiful UI
Extensibility
Complex workflows
Python
Open source
Good api