Completed
Intro
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Migrating ETL Workflows to Apache Spark at Scale - Pinterest's Experience
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 We Are on Cloud
- 3 Spark Clusters
- 4 Spark Versions and Use Cases
- 5 Migration Plan
- 6 Migration Path
- 7 Spark API
- 8 Approach
- 9 Translate Cascading
- 10 UDF Translation
- 11 Translate Scalding
- 12 Secondary Sort
- 13 Accumulators
- 14 Accumulator Continue
- 15 Accumulator Tab in Spark UI
- 16 Profiling
- 17 Automatic Migration Service (AMS)
- 18 Data Validation
- 19 Source of Uncertainty
- 20 Performance Tuning
- 21 Balancing Performance
- 22 Automatic Migration & Failure Handling
- 23 Future Plan
