Completed
Step by step dataset generation
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Fine-tuning LLMs - Every Step Explained for Memorization Tasks
Automatically move to the next video in the Classroom when playback concludes
- 1 Fine-tuning on a custom dataset
- 2 Video Overview
- 3 GPTs as statistical models
- 4 What is the reversal curse?
- 5 Synthetic dataset generation
- 6 Choosing the best batch size
- 7 What learning rate to use for fine-tuning?
- 8 How many epochs to train for?
- 9 Choosing the right base model
- 10 Step by step dataset generation
- 11 Fine-tuning script, step-by-step
- 12 Performance Ablation: Hyperparameters
- 13 Performance Ablation: Base Models
- 14 Final Recommendations for Fine-tuning for Memorization
