Scalable Data Pipelines for ML - Integrating Argo Workflows and dbt
MLCon | Machine Learning Conference via YouTube
Overview
Discover how to build scalable data pipelines for machine learning by integrating Argo Workflows and dbt in this 46-minute conference talk from MLCon Munich 2024. Explore the intricacies of ELT processes and learn techniques for effectively scaling workflows to handle large datasets. Gain actionable insights on optimizing data infrastructure, improving the resilience and efficiency of ML applications, and orchestrating data jobs efficiently. Master the integration of Argo Workflows and dbt, learn best practices for managing expanding datasets in ML environments, and enhance your data infrastructure to support robust machine learning projects.
Syllabus
Scalable Data Pipelines for ML: Integrating Argo Workflows and dbt | Hauke Brammer
Taught by
MLCon | Machine Learning Conference