How to Code Long-Context LLMs - LongLoRA Implementation with Llama 2 100K

How to Code Long-Context LLMs - LongLoRA Implementation with Llama 2 100K

Discover AI via YouTube Direct link

Summary

11 of 15

11 of 15

Summary

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

How to Code Long-Context LLMs - LongLoRA Implementation with Llama 2 100K

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 Flash Attention
  3. 3 What is LongLoRA
  4. 4 Vision Transformers
  5. 5 Simplest solution
  6. 6 LongLoRA
  7. 7 Why is this happening
  8. 8 Scientific Preprint
  9. 9 Transformer Architecture
  10. 10 Performance figures
  11. 11 Summary
  12. 12 LongLoRA repo
  13. 13 Rotary positional embedding
  14. 14 Model tokenizer
  15. 15 Embedded normalization layers

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.