Completed
Preparing a dummy dataset
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Open Pretrained Transformer - ML Coding Series
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro - open pretrained transformer
- 2 Setup creating the cond env
- 3 Setup patch the code
- 4 Collecting train script arguments
- 5 Training script walk-through
- 6 Constructing a dummy task
- 7 Building the transformer model
- 8 CUDA kernels C++ code
- 9 Preparing a dummy dataset
- 10 Training loop
- 11 Zero grad loss scaling
- 12 Forward pass through a transformer
- 13 IMPORTANT loss, scaling, mixed precision, error handling
- 14 Outro
