Completed
Query, key, value matrices
Class Central Classrooms beta
YouTube playlists curated by Class Central.
Classroom Contents
Transformers Explained - Part 1: Generative Music AI
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Context
- 3 The intuition
- 4 Encoder
- 5 Encoder block
- 6 Self-attention
- 7 Matrices
- 8 Input matrix
- 9 Query, key, value matrices
- 10 Self-attention formula
- 11 Self-attention: Step 1
- 12 Self-attention: Step 2
- 13 Self-attention: Step 3
- 14 Self-attention: Step 4
- 15 Self-attention: Visual recap
- 16 Multi-head attention
- 17 The propblem of sequence order
- 18 Positional encoding
- 19 How to compute positional encoding
- 20 Feedforward layer
- 21 Add & norm layer
- 22 Deeper meaning of encoder components
- 23 Encoder step-by-step
- 24 Key takeaways
- 25 What next?
