ALBERT - A Lite BERT for Self-Supervised Learning of Language Representations

ALBERT - A Lite BERT for Self-Supervised Learning of Language Representations

Launchpad via YouTube Direct link

References

20 of 20

20 of 20

References

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

ALBERT - A Lite BERT for Self-Supervised Learning of Language Representations

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 Agenda
  3. 3 Background
  4. 4 Mask Language Model
  5. 5 Next Sentence Prediction
  6. 6 Recap
  7. 7 Motivation
  8. 8 Cross Layer Parameter Sharing
  9. 9 Comparison with BirdBase
  10. 10 Eliminate NSP
  11. 11 Sentence Order Prediction
  12. 12 Factorized Embedding Parameters
  13. 13 Embedding Matrix
  14. 14 Benchmarks
  15. 15 Glue Test
  16. 16 Battle Bottom Line
  17. 17 Summary
  18. 18 Questions
  19. 19 Parameter Sharing
  20. 20 References

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.