Neural Nets for NLP 2020 - Attention

Neural Nets for NLP 2020 - Attention

Graham Neubig via YouTube Direct link

Intro

1 of 18

1 of 18

Intro

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Neural Nets for NLP 2020 - Attention

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Sentence Representations
  3. 3 Calculating Attention (1)
  4. 4 A Graphical Example
  5. 5 Attention Score Functions (1)
  6. 6 Attention Score Functions (2)
  7. 7 Input Sentence: Copy
  8. 8 Input Sentence: Bias . If you have a translation dictionary, use it to bias outputs (Arthur et al. 2016)
  9. 9 Previously Generated Things
  10. 10 Various Modalities
  11. 11 Multiple Sources
  12. 12 Coverage
  13. 13 Incorporating Markov Properties (Cohn et al. 2015)
  14. 14 Supervised Training (Mi et al. 2016)
  15. 15 Hard Attention
  16. 16 Multi-headed Attention
  17. 17 Attention Tricks
  18. 18 Training Tricks

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.