Completed
Nonlinearity
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
What Learning Algorithm is In-Context Learning? - Understanding Transformer Models and Neural Sequence Learning
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 InContext Learning
- 3 Outline
- 4 In Context Learning
- 5 Training
- 6 What is a good ICL
- 7 Not just with welldefined problems
- 8 Identifying skills
- 9 Learning French
- 10 Can Transformer Models Do Real Learning
- 11 Offline Transformations
- 12 Computing Dot Products
- 13 Nonlinearity
- 14 Generic Transformer
- 15 Read Attend Write Operator
- 16 Parameterization
- 17 Learning Setup
- 18 Quality of Predictions
- 19 Other Predictions
- 20 Nearest Neighbors
- 21 Summary
- 22 Natural Questions
- 23 Standard Transformer
- 24 Linear Selfattention
- 25 Data Diversity
- 26 Real Models
- 27 Next Direction
- 28 Credits
