Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

VQ-VAEs - Neural Discrete Representation Learning - Paper + PyTorch Code Explained

Aleksa Gordić - The AI Epiphany via YouTube

Overview

Explore a comprehensive 35-minute video tutorial on VQ-VAEs (Vector Quantized Variational Autoencoders) and their application in neural discrete representation learning. Delve into the key concepts of autoencoders and VAEs before examining the motivation behind discrete representations. Gain a high-level understanding of the VQ-VAE framework, followed by an in-depth exploration of its components, including the VQ-VAE loss function. Study the PyTorch implementation and discuss the missing KL term. Investigate prior autoregressive models and analyze the results. Conclude with an introduction to VQ-VAE-2, highlighting its hierarchical structure of latents and priors. Access supplementary resources, including research papers and code examples, to enhance your understanding of this important concept in AI and machine learning.

Syllabus

Intro
A tangent on autoencoders and VAEs
Motivation behind discrete representations
High-level explanation of VQ-VAE framework
Diving deeper
VQ-VAE loss
PyTorch implementation
KL term missing
Prior autoregressive models
Results
VQ-VAE two

Taught by

Aleksa Gordić - The AI Epiphany

Reviews

Start your review of VQ-VAEs - Neural Discrete Representation Learning - Paper + PyTorch Code Explained

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.