Completed
37:15 - Context length
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
LLaMA 3 Deep Dive - Synthetic Data, Privacy, and Model Architecture
Automatically move to the next video in the Classroom when playback concludes
- 1 00:00 - Intro
- 2 00:27 - Hyperstack GPUs platform! sponsored
- 3 02:08 - What is new in new Llama?
- 4 06:40 - Synthetic data
- 5 13:30 - Privacy - training on Facebook user data?
- 6 15:35 - Scaling and distillation
- 7 19:10 - MoE, new architectures?
- 8 25:35 - Upper boundary for the quality of SX data?
- 9 37:15 - Context length
- 10 45:10 - What framework does Meta use for Llama
- 11 46:40 - Playing with smaller Llamas
- 12 51:20 - Multilingual capabilities
