Avoiding Catastrophe - Active Dendrites Enable Multi-Task Learning in Dynamic Environments

Avoiding Catastrophe - Active Dendrites Enable Multi-Task Learning in Dynamic Environments

Yannic Kilcher via YouTube Direct link

- How does this relate to attention mechanisms?

11 of 12

11 of 12

- How does this relate to attention mechanisms?

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Avoiding Catastrophe - Active Dendrites Enable Multi-Task Learning in Dynamic Environments

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Introduction
  2. 2 - Paper Overview
  3. 3 - Catastrophic forgetting in continuous and multi-task learning
  4. 4 - Dendrites in biological neurons
  5. 5 - Sparse representations in biology
  6. 6 - Active dendrites in deep learning
  7. 7 - Experiments on multi-task learning
  8. 8 - Experiments in continual learning and adaptive prototyping
  9. 9 - Analyzing the inner workings of the algorithm
  10. 10 - Is this the same as just training a larger network?
  11. 11 - How does this relate to attention mechanisms?
  12. 12 - Final thoughts and comments

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.