Generalization in Deep Learning Through the Lens of Implicit Rank Minimization

Generalization in Deep Learning Through the Lens of Implicit Rank Minimization

Hausdorff Center for Mathematics via YouTube Direct link

Practical Application: Rank Minimization in NN Layers

20 of 24

20 of 24

Practical Application: Rank Minimization in NN Layers

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Generalization in Deep Learning Through the Lens of Implicit Rank Minimization

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Generalization via Bis-Variance Tradeoff
  3. 3 Generalization in Deep Learning
  4. 4 Linear Models: Implicit Norm Minimization Linear Regression
  5. 5 Implicit Norm Minimization In Deep Learning?
  6. 6 Perspective: Implicit Rank Minimization
  7. 7 Outline
  8. 8 Matrix Completion Two-Dimensional Prediction
  9. 9 MF Linear NN
  10. 10 Conjecture: Implicit Nuclear Norm Minimization
  11. 11 Dynamical Analysis of Implicit Regularization in MF
  12. 12 Implicit Regularization in MF Norm Minimization Does the implicit regularization in MF minimize a norm?
  13. 13 Drawbacks of Studying MF
  14. 14 Tensor Completion Multi-Dimensional Prediction
  15. 15 TF Shallow Non-Linear Convolutional NN
  16. 16 Dynamical Analysis of Implicit Regularization in TF
  17. 17 Analogy Between Implicit Regularizations
  18. 18 HTF Deep Non-Linear CNN TF does not account for depth
  19. 19 Dynamical Analysis of Implicit Regularization in HTF
  20. 20 Practical Application: Rank Minimization in NN Layers
  21. 21 Potential Explanation for Generalization on Natural Data
  22. 22 Countering Locality of CNNs via Regularization
  23. 23 Recap
  24. 24 Implicit Rank Minimization in Deep Learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.