Building Makemore - Building a WaveNet

Building Makemore - Building a WaveNet

Andrej Karpathy via YouTube Direct link

fixing batchnorm1d bug

10 of 18

10 of 18

fixing batchnorm1d bug

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Building Makemore - Building a WaveNet

Automatically move to the next video in the Classroom when playback concludes

  1. 1 intro
  2. 2 starter code walkthrough
  3. 3 let’s fix the learning rate plot
  4. 4 pytorchifying our code: layers, containers, torch.nn, fun bugs
  5. 5 overview: WaveNet
  6. 6 dataset bump the context size to 8
  7. 7 re-running baseline code on block_size 8
  8. 8 implementing WaveNet
  9. 9 training the WaveNet: first pass
  10. 10 fixing batchnorm1d bug
  11. 11 re-training WaveNet with bug fix
  12. 12 scaling up our WaveNet
  13. 13 experimental harness
  14. 14 WaveNet but with “dilated causal convolutions”
  15. 15 torch.nn
  16. 16 the development process of building deep neural nets
  17. 17 going forward
  18. 18 improve on my loss! how far can we improve a WaveNet on this data?

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.