Learn advanced design patterns for managing complex data pipelines in Python during this 42-minute conference talk from PyBay 2023. Explore strategies that go beyond basic Extract, Transform, Load (ETL) processes, with specific applications in Django frameworks. Discover how to handle complicated transformation steps effectively through practical examples and proven architectural approaches. Gain insights from speaker Lisa Dusseault's expertise while connecting with fellow developers at this San Francisco Bay Area Python conference. Delve into essential concepts that help structure and organize data processing workflows for better maintainability and scalability. Perfect for developers looking to enhance their data pipeline development skills and stay current with modern Python practices in data engineering.
Overview
Syllabus
Sun Oct 8 2023 at Bungalo West
Taught by
SF Python
Related Courses
-
Data Engineering: Pipelines, ETL, Hadoop
-
Writing production-ready ETL pipelines in Python / Pandas
-
Craft Complex Mock Data Using Graph-Based Configuration Files
-
Engineering Data Ecosystems: Pipelines, ETL, Spark
-
Scale Data Science Using Pandas API on Spark
-
Infrastructure as a Product - Lessons in Platform Engineering
