Airflow vs AWS Step Functions: What are the differences?
Airflow: A platform to programmaticaly author, schedule and monitor data pipelines, by Airbnb. Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed; AWS Step Functions: Build Distributed Applications Using Visual Workflows. AWS Step Functions makes it easy to coordinate the components of distributed applications and microservices using visual workflows. Building applications from individual components that each perform a discrete function lets you scale and change applications quickly.
Airflow can be classified as a tool in the "Workflow Manager" category, while AWS Step Functions is grouped under "Cloud Task Management".
Airflow is an open source tool with 13K GitHub stars and 4.72K GitHub forks. Here's a link to Airflow's open source repository on GitHub.
According to the StackShare community, Airflow has a broader approval, being mentioned in 72 company stacks & 33 developers stacks; compared to AWS Step Functions, which is listed in 19 company stacks and 7 developer stacks.