In this webinar, we provide an overview of the major new features and significant updates included in the newly released Airflow 2.4. Working through a variety of use cases, this high-level recap addresses new data-driven scheduling capabilities that help users avoid monolithic DAGs.
The webinar focuses on a number of specific new features in Airflow 2.4, such as:
-Datasets and data-aware scheduling, which lets DAG authors create smaller and more self-contained DAGs
-Updates to dynamic task mapping
-A consolidated schedule parameter
-New operators and decorators
-And more!
All of the sample code shown in this webinar can be found in this repo. https://github.com/astronomer/2-4-example-dags
2 Comments