How LLMs Might Store Facts - Multilayer Perceptrons in Transformers

How LLMs Might Store Facts - Multilayer Perceptrons in Transformers

3Blue1Brown via YouTube Direct link

- Counting parameters

5 of 7

5 of 7

- Counting parameters

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

How LLMs Might Store Facts - Multilayer Perceptrons in Transformers

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Where facts in LLMs live
  2. 2 - Quick refresher on transformers
  3. 3 - Assumptions for our toy example
  4. 4 - Inside a multilayer perceptron
  5. 5 - Counting parameters
  6. 6 - Superposition
  7. 7 - Up next

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.