Completed
Hidden Stratification: Approach
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Mandoline - Model Evaluation under Distribution Shift
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Outline
- 3 The ML model development process
- 4 Model Evaluation
- 5 Motivation
- 6 Common approach: importance weighting
- 7 Motivating example
- 8 Mandoline: Slice-based reweighting framework
- 9 The theory behind using slices
- 10 More formally...
- 11 Density Ratio Estimation
- 12 Experiments: tasks
- 13 Experiments: compare to reweighting on x
- 14 Summary
- 15 Taking a step back - how do we get slices? What are sli
- 16 Measuring model performance
- 17 Hidden Stratification: Approach
- 18 ML model development process, revisited
- 19 Another angle - how else can we evaluate?
- 20 "Closing the loop" - how do we update?
