Implicit and Explicit Regularization in Deep Neural Networks

Implicit and Explicit Regularization in Deep Neural Networks

Institute for Pure & Applied Mathematics (IPAM) via YouTube Direct link

Conventional Neural Networks

13 of 20

13 of 20

Conventional Neural Networks

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Implicit and Explicit Regularization in Deep Neural Networks

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 Why is deep learning so popular
  3. 3 Why does deep learning not work
  4. 4 Supervised learning
  5. 5 Stochastic gradient descent
  6. 6 Local optimization
  7. 7 Prediction error
  8. 8 What we converge to
  9. 9 Implicit Regularization
  10. 10 Stochastic Mirror Descent
  11. 11 Bregman Divergence
  12. 12 Stochastic Mirror Descent Algorithm
  13. 13 Conventional Neural Networks
  14. 14 SMD
  15. 15 Summary
  16. 16 Nonlinear models
  17. 17 Blessing of dimensionality
  18. 18 Distribution of weights
  19. 19 Explicit regularization
  20. 20 Blessings of dimensionality

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.