Feedback Transformers - Addressing Some Limitations of Transformers with Feedback Memory

Feedback Transformers - Addressing Some Limitations of Transformers with Feedback Memory

Yannic Kilcher via YouTube Direct link

- Intro & Overview

1 of 12

1 of 12

- Intro & Overview

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Feedback Transformers - Addressing Some Limitations of Transformers with Feedback Memory

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Intro & Overview
  2. 2 - Problems of Autoregressive Processing
  3. 3 - Information Flow in Recurrent Neural Networks
  4. 4 - Information Flow in Transformers
  5. 5 - Solving Complex Computations with Neural Networks
  6. 6 - Causal Masking in Transformers
  7. 7 - Missing Higher Layer Information Flow
  8. 8 - Feedback Transformer Architecture
  9. 9 - Connection to Attention-RNNs
  10. 10 - Formal Definition
  11. 11 - Experimental Results
  12. 12 - Conclusion & Comments

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.