Extracting Training Data from Large Language Models - Paper Explained

Extracting Training Data from Large Language Models - Paper Explained

Yannic Kilcher via YouTube Direct link

- Weights for Patterns & Weights for Memorization

9 of 12

9 of 12

- Weights for Patterns & Weights for Memorization

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Extracting Training Data from Large Language Models - Paper Explained

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Intro & Overview
  2. 2 - Personal Data Example
  3. 3 - Eidetic Memorization & Language Models
  4. 4 - Adversary's Objective & Outlier Data
  5. 5 - Ethical Hedging
  6. 6 - Two-Step Method Overview
  7. 7 - Perplexity Baseline
  8. 8 - Improvement via Perplexity Ratios
  9. 9 - Weights for Patterns & Weights for Memorization
  10. 10 - Analysis of Main Results
  11. 11 - Mitigation Strategies
  12. 12 - Conclusion & Comments

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.