Descending Through a Crowded Valley - Benchmarking Deep Learning Optimizers

Descending Through a Crowded Valley - Benchmarking Deep Learning Optimizers

Yannic Kilcher via YouTube Direct link

- Introduction & Overview

1 of 9

1 of 9

- Introduction & Overview

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Descending Through a Crowded Valley - Benchmarking Deep Learning Optimizers

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Introduction & Overview
  2. 2 - The Overwhelming Amount of Optimizers
  3. 3 - Compared Optimizers
  4. 4 - Default Parameters & Tuning Distribution
  5. 5 - Deep Learning Problems Considered
  6. 6 - Tuning on Single Seeds
  7. 7 - Results & Interpretation
  8. 8 - Learning Rate Schedules & Noise
  9. 9 - Conclusions & Comments

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.