Completed
Summary for green grasshoppers
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
INFINI Attention: Efficient Infinite Context Transformers with 1 Million Token Context Length
Automatically move to the next video in the Classroom when playback concludes
- 1 Infinite context length of LLM
- 2 INFINI paper by Google
- 3 Matrix Memory of limited size
- 4 Update memory simple
- 5 Retrieve memory simple
- 6 Update memory maths
- 7 Retrieve memory maths
- 8 Infini attention w/ internal RAG?
- 9 Benchmark data
- 10 Summary for green grasshoppers
- 11 TransformerFAM w/ Feedback attention
