Supermasks in Superposition - Paper Explained

Supermasks in Superposition - Paper Explained

Yannic Kilcher via YouTube Direct link

- Binary Maximum Entropy Search

8 of 15

8 of 15

- Binary Maximum Entropy Search

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Supermasks in Superposition - Paper Explained

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Intro & Overview
  2. 2 - Catastrophic Forgetting
  3. 3 - Supermasks
  4. 4 - Lifelong Learning using Supermasks
  5. 5 - Inference Time Task Discrimination by Entropy
  6. 6 - Mask Superpositions
  7. 7 - Proof-of-Concept, Task Given at Inference
  8. 8 - Binary Maximum Entropy Search
  9. 9 - Task Not Given at Inference
  10. 10 - Task Not Given at Training
  11. 11 - Ablations
  12. 12 - Superfluous Neurons
  13. 13 - Task Selection by Detecting Outliers
  14. 14 - Encoding Masks in Hopfield Networks
  15. 15 - Conclusion

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.