Coding a ChatGPT-Like Transformer From Scratch in PyTorch

Coding a ChatGPT-Like Transformer From Scratch in PyTorch

StatQuest with Josh Starmer via YouTube Direct link

Coding a Decoder-Only Transformer

6 of 8

6 of 8

Coding a Decoder-Only Transformer

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Coding a ChatGPT-Like Transformer From Scratch in PyTorch

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Awesome song and introduction
  2. 2 Loading the modules
  3. 3 Creating the training dataset
  4. 4 Coding Position Encoding
  5. 5 Coding Attention
  6. 6 Coding a Decoder-Only Transformer
  7. 7 Running the model untrained
  8. 8 Training and using the model

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.