Completed
Multi-head attention
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Transformers for Generative Music AI - Part 2: Decoder and Music Generation
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Decoder intuition
- 3 Decoder input
- 4 Decoder block
- 5 Training / inference discrepancy
- 6 Masked multi-head attention
- 7 Add & norm
- 8 Multi-head attention
- 9 Feedforward
- 10 Decoder block
- 11 Linear & softmax
- 12 Decoder step-by-step
- 13 Training a transformer
- 14 Music generation with transformers
- 15 Valerio's music generation transformer routine
- 16 Music data is key
- 17 Pros and cons
- 18 Most promising research
- 19 Key takeaways
- 20 What's up next?
