Advanced NLP 2022: Modeling Long Sequences

Advanced NLP 2022: Modeling Long Sequences

Graham Neubig via YouTube Direct link

Sparse Attention

13 of 19

13 of 19

Sparse Attention

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Advanced NLP 2022: Modeling Long Sequences

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 NLP Tasks
  3. 3 Modeling Long Sequences
  4. 4 Separate Encoding
  5. 5 Selfattention Transformers
  6. 6 Transformer XL
  7. 7 Compressive Transformers
  8. 8 Sparse Transformers
  9. 9 Adaptive Span Transformers
  10. 10 Sparse Span Transformers
  11. 11 Reformer Model
  12. 12 Low Rank Approximation
  13. 13 Sparse Attention
  14. 14 Evaluation
  15. 15 Other Methods
  16. 16 Questions
  17. 17 Components of Coreference Models
  18. 18 Mention Pair Models
  19. 19 Model

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.