Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Developing a Deep Learning Project - Case Study on Transformer

Aleksa Gordić - The AI Epiphany via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the development process of a deep learning project in this 32-minute video, focusing on a case study of the transformer model. Gain insights into approaching new projects, time management strategies, and overcoming challenges in deep learning development. Learn about data preparation, task definition, training loop implementation, and optimization techniques. Discover the intricacies of beam search and BucketIterator, and understand the hardware requirements for training transformer models. Follow along as the speaker shares personal experiences, embraces failures, and demonstrates the process of translating between English and German using the implemented transformer model.

Syllabus

Open-sourcing original transformer and why
Creating great projects takes time
My time management
My story and embracing failures
Overview of the transformer project
Data and task definition
Training loop
Problems I encountered
Beam search fun
BucketIterator fun
Optimizing things to speed up the loop
Translating from English to German and vice versa
Hardware requirements
Wrapping things up

Taught by

Aleksa Gordić - The AI Epiphany

Reviews

Start your review of Developing a Deep Learning Project - Case Study on Transformer

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.