Building Makemore - Becoming a Backprop Ninja

Building Makemore - Becoming a Backprop Ninja

Andrej Karpathy via YouTube Direct link

exercise 2: cross entropy loss backward pass

5 of 8

5 of 8

exercise 2: cross entropy loss backward pass

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Building Makemore - Becoming a Backprop Ninja

Automatically move to the next video in the Classroom when playback concludes

  1. 1 intro: why you should care & fun history
  2. 2 starter code
  3. 3 exercise 1: backproping the atomic compute graph
  4. 4 brief digression: bessel’s correction in batchnorm
  5. 5 exercise 2: cross entropy loss backward pass
  6. 6 exercise 3: batch norm layer backward pass
  7. 7 exercise 4: putting it all together
  8. 8 outro

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.