Long Sequence Modeling with up to 8K Tokens - Overview, Dataset & Google Colab Code

Long Sequence Modeling with up to 8K Tokens - Overview, Dataset & Google Colab Code

Venelin Valkov via YouTube Direct link

- Evaluation Results

5 of 13

5 of 13

- Evaluation Results

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Long Sequence Modeling with up to 8K Tokens - Overview, Dataset & Google Colab Code

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Introduction
  2. 2 - XGen Model
  3. 3 - Pre-training Data
  4. 4 - Training Methods
  5. 5 - Evaluation Results
  6. 6 - HuggingFace Repository
  7. 7 - Google Colab Setup
  8. 8 - Prompting XGen
  9. 9 - Writing Jokes
  10. 10 - Investing Advice
  11. 11 - Coding
  12. 12 - QA over Text
  13. 13 - Conclusion

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.