Completed
Lessons Learned
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Code Once, Use Often - Declarative Data Pipelines
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Agenda
- 3 Food Waste
- 4 Flashfood Data
- 5 Problem Definition
- 6 Attempt 1
- 7 The Declarative Data Pipeline
- 8 Attempt 3
- 9 The right amount of automation
- 10 Why configs?
- 11 airflow-declarative
- 12 SyncTablelob
- 13 Custom Operator
- 14 Extract
- 15 Transform
- 16 Summary
- 17 Lessons Learned
- 18 Challenges ahead
- 19 Spark YAML
- 20 Keillor's Principles
- 21 Feedback