Learn about large language models—what they are, what they can do, and how they work.
Overview
Syllabus
Introduction
- The impact and functionality of large language models
- What are large language models?
- How are large language models trained? Pre-training
- Making large language models follow instructions
- Transformer architecture
- What are parameters
- What are tokens?
- What are context lengths?
- BERT
- Scaling laws
- GPT-3
- Chinchilla
- PaLM and PaLM 2
- ChatGPT and GPT-4
- Open LLMs
- Comparing large language models
- Going further with large language models
Taught by
Jonathan Fernandes
