Towards Extreme Multi-Task Scaling for Transfer Learning

Towards Extreme Multi-Task Scaling for Transfer Learning

Yannic Kilcher via YouTube Direct link

- Intro & Overview

1 of 11

1 of 11

- Intro & Overview

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Towards Extreme Multi-Task Scaling for Transfer Learning

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Intro & Overview
  2. 2 - Recap: The T5 model
  3. 3 - The ExT5 model and task formulations
  4. 4 - ExMix dataset
  5. 5 - Do different tasks help each other?
  6. 6 - Which tasks should we include?
  7. 7 - Pre-Training vs Pre-Finetuning
  8. 8 - A few hypotheses about what's going on
  9. 9 - How much self-supervised data to use?
  10. 10 - More experimental results
  11. 11 - Conclusion & Summary

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.