Completed
LongLoRA repo
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
How to Code Long-Context LLMs - LongLoRA Implementation with Llama 2 100K
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 Flash Attention
- 3 What is LongLoRA
- 4 Vision Transformers
- 5 Simplest solution
- 6 LongLoRA
- 7 Why is this happening
- 8 Scientific Preprint
- 9 Transformer Architecture
- 10 Performance figures
- 11 Summary
- 12 LongLoRA repo
- 13 Rotary positional embedding
- 14 Model tokenizer
- 15 Embedded normalization layers
