Amazon Managed Workflows for Apache Airflow

Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. It lets you define a series of tasks you want to run and then combine them into a workflow. You can then use this workflow to schedule and monitor your tasks.

Airflow was initially developed to manage workflows at Airbnb and has since become open-source. It is written in Python and uses a backend database to store the workflow definitions and states.

Some everyday use cases for Airflow include data pipelines, machine learning workflows, and ETL (extract, transform, load) processes.