Analyzing Optimization and Generalization in Deep Learning via Dynamics of Gradient Descent

Analyzing Optimization and Generalization in Deep Learning via Dynamics of Gradient Descent

Simons Institute via YouTube Direct link

Introduction

1 of 19

1 of 19

Introduction

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Analyzing Optimization and Generalization in Deep Learning via Dynamics of Gradient Descent

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 What is Optimization Generalization
  3. 3 Classical Machine Learning
  4. 4 Deep Learning
  5. 5 Content
  6. 6 Gradient Flow
  7. 7 Endtoend Dynamics
  8. 8 Conventional Approach
  9. 9 Implicit Preconditioning
  10. 10 Gradient Descent
  11. 11 Depth
  12. 12 Matrix Completion
  13. 13 Deep Matrix Factorization
  14. 14 Experiments
  15. 15 Dynamics of Singular Values
  16. 16 Matrix Completion Problem
  17. 17 Singular Value Dynamics
  18. 18 Recap
  19. 19 Nonlinearity

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.