Completed
- How does one train such giant models?
Class Central Classrooms beta
YouTube playlists curated by Class Central.
Classroom Contents
CM3- A Causal Masked Multimodal Model of the Internet
Automatically move to the next video in the Classroom when playback concludes
- 1 - Intro & Overview
- 2 - Directly learning the structure of HTML
- 3 - Causally Masked Language Modelling
- 4 - A short look at how to use this model
- 5 - Start of interview
- 6 - Feeding language models with HTML
- 7 - How to get bi-directionality into decoder-only Transformers?
- 8 - Images are just tokens
- 9 - How does one train such giant models?
- 10 - CM3 results are amazing
- 11 - Large-scale dataset collection and content filtering
- 12 - More experimental results
- 13 - Why don't we use raw HTML?
- 14 - Does this paper contain too many things?
