Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Reformer - The Efficient Transformer

Yannic Kilcher via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the groundbreaking Reformer model in this informative video, which addresses the resource-intensive nature of the famous Transformer architecture. Learn how the Reformer combines Locality Sensitive Hashing and concepts from Reversible Networks to significantly reduce memory usage and enable processing of much longer input sequences. Discover how this innovative approach allows for handling up to 16K tokens with just 16GB of memory, making it a game-changer for natural language processing tasks. Delve into the technical details of the model's O(LlogL) complexity, reversible residual layers, and their impact on efficiency. Gain insights into the Reformer's performance, which rivals traditional Transformer models while offering substantial improvements in memory efficiency and processing speed for long sequences.

Syllabus

Reformer: The Efficient Transformer

Taught by

Yannic Kilcher

Reviews

Start your review of Reformer - The Efficient Transformer

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.