Completed
What kind of local min are connected?
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Explaining Landscape Connectivity of Low-Cost Solutions for Multilayer Nets
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Mode Connectivity[Freeman and Bruna 16, Garipov et al. 18, Draxler et al. 18]
- 3 Outline
- 4 Background: non-convex optimization
- 5 Equivalent local minima and symmetry
- 6 (Partial) short answer: overparametrization
- 7 Deep Neural Networks
- 8 What kind of local min are connected?
- 9 Dropout stability
- 10 High level steps
- 11 Direct Interpolation
- 12 Connecting a network with its dropout
- 13 An example path for 3 layer network
- 14 Example path explained (3) - (4)
- 15 Noise stability
- 16 Experiments
- 17 Conclusions
- 18 Open Problems
- 19 How can we use mode connectivity?
