Completed
Cross Layer Parameter Sharing
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
ALBERT - A Lite BERT for Self-Supervised Learning of Language Representations
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 Agenda
- 3 Background
- 4 Mask Language Model
- 5 Next Sentence Prediction
- 6 Recap
- 7 Motivation
- 8 Cross Layer Parameter Sharing
- 9 Comparison with BirdBase
- 10 Eliminate NSP
- 11 Sentence Order Prediction
- 12 Factorized Embedding Parameters
- 13 Embedding Matrix
- 14 Benchmarks
- 15 Glue Test
- 16 Battle Bottom Line
- 17 Summary
- 18 Questions
- 19 Parameter Sharing
- 20 References
