Completed
1.3: Data Preparation -
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
How to Build an LLM from Scratch - An Overview
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro -
- 2 How much does it cost? -
- 3 4 Key Steps -
- 4 Step 1: Data Curation -
- 5 1.1: Data Sources -
- 6 1.2: Data Diversity -
- 7 1.3: Data Preparation -
- 8 Step 2: Model Architecture Transformers -
- 9 2.1: 3 Types of Transformers -
- 10 2.2: Other Design Choices -
- 11 2.3: How big do I make it? -
- 12 Step 3: Training at Scale -
- 13 3.1: Training Stability -
- 14 3.2: Hyperparameters -
- 15 Step 4: Evaluation -
- 16 4.1: Multiple-choice Tasks -
- 17 4.2: Open-ended Tasks -
- 18 What's next? -
