Transformers for Generative Music AI - Part 2: Decoder and Music Generation

Transformers for Generative Music AI - Part 2: Decoder and Music Generation

Valerio Velardo - The Sound of AI via YouTube Direct link

Decoder block

4 of 20

4 of 20

Decoder block

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Transformers for Generative Music AI - Part 2: Decoder and Music Generation

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Decoder intuition
  3. 3 Decoder input
  4. 4 Decoder block
  5. 5 Training / inference discrepancy
  6. 6 Masked multi-head attention
  7. 7 Add & norm
  8. 8 Multi-head attention
  9. 9 Feedforward
  10. 10 Decoder block
  11. 11 Linear & softmax
  12. 12 Decoder step-by-step
  13. 13 Training a transformer
  14. 14 Music generation with transformers
  15. 15 Valerio's music generation transformer routine
  16. 16 Music data is key
  17. 17 Pros and cons
  18. 18 Most promising research
  19. 19 Key takeaways
  20. 20 What's up next?

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.