Add Dynamic Behavior and Resilience to Pipelines with Apache Airflow 3

Production pipelines must handle changing workloads, external waits, and failures without wasting worker capacity or hiding recovery decisions.
Production pipelines must handle changing workloads, external waits, and failures without wasting worker capacity or hiding recovery decisions.
In this course, Add Dynamic Behavior and Resilience to Pipelines with Apache Airflow 3, you'll gain the ability to build pipelines that adapt at runtime and recover predictably.
First, you'll explore Dynamic Task Mapping and how to process mapped results.
Next, you'll discover how sensors, deferrable tasks, and the triggerer support efficient waiting.
Finally, you'll learn how to configure retries, timeouts, Deadline Alerts, and human review decisions.
When you're finished with this course, you'll have the skills and knowledge of dynamic and resilient Airflow pipelines needed to process variable workloads with explicit waiting and recovery behavior.
Homepage

---