Completed
What is a retrieval head?
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Understanding Retrieval Heads in Large Language Models - From Discovery to Applications
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro Green grasshoppers
- 2 What do attention heads focus on?
- 3 Long context Factuality by retrieval heads
- 4 Needle in a Haystack Benchmark
- 5 How many retrieval heads in a LLM?
- 6 What is a retrieval head?
- 7 Retrieval heatmap consistent with pre-trained base model
- 8 Retrieval heads and Chain-of-Thought Reasoning
- 9 Retrieval heads explain why LLMs hallucinate
- 10 How to generate more retrieval heads in LLMs?
