Completed
Experiment manager
Class Central Classrooms beta
YouTube playlists curated by Class Central.
Classroom Contents
How to Automate Performance Tuning for Apache Spark
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 What is performance tuning?
- 3 Why automate performance tuning?
- 4 Perf tuning is an iterative process
- 5 Common issues: lack of parallelism
- 6 Common issues: shuffle spill
- 7 Improvements based on node metrics
- 8 Cost-speed trade-off
- 9 Recap: manual perf tuning
- 10 Open source tuning tools
- 11 Motivations
- 12 Architecture (tech)
- 13 Architecture (algo)
- 14 Heuristics example
- 15 Evaluator
- 16 Experiment manager
- 17 Data Mechanics platform
- 18 Common issues: data skew
- 19 Impact of automated tuning
