Apache Airflow

1 view · 8mo ago

A platform to programmatically author, schedule, and monitor workflows. Airflow allows data engineers and developers to create complex data pipelines using Python code with a rich web UI for visualization and management. Built to solve the challenge of orchestrating complex data workflows and ETL processes at scale. Provides a reliable way to manage dependencies between tasks and handle workflow failures gracefully.