Too Big for DAG Factories?

Discover how to dynamically generate thousands of DAGs (Directed Acyclic Graphs) with Airflow in this 29-minute conference talk from EuroPython 2023. Explore use cases for transforming, optimizing, and scaling data workflows. Learn valuable techniques to enhance your data processing capabilities and streamline complex operations. Gain insights into advanced Airflow functionalities and best practices for managing large-scale data pipelines.