Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Long Sequence Modeling with up to 8K Tokens - Overview, Dataset & Google Colab Code

Venelin Valkov via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the capabilities of XGen-7B, an open-source large language model with 8K token input capacity, in this comprehensive video tutorial. Learn about the model's architecture, pre-training data, and training methods. Examine its performance on NLP benchmarks, long sequence modeling tasks, and code generation. Follow along as the instructor demonstrates how to load the instruction model in Google Colab and test its abilities through various prompts, including answering questions, generating code, and comprehending documents. Gain insights into the model's strengths and limitations in areas such as joke writing, investment advice, and question-answering over text.

Syllabus

- Introduction
- XGen Model
- Pre-training Data
- Training Methods
- Evaluation Results
- HuggingFace Repository
- Google Colab Setup
- Prompting XGen
- Writing Jokes
- Investing Advice
- Coding
- QA over Text
- Conclusion

Taught by

Venelin Valkov

Reviews

Start your review of Long Sequence Modeling with up to 8K Tokens - Overview, Dataset & Google Colab Code

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.