Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

VQ-GAN - Taming Transformers for High-Resolution Image Synthesis - Paper Explained

Aleksa Gordić - The AI Epiphany via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a comprehensive video explanation of the VQ-GAN (Vector Quantized Generative Adversarial Network) paper, focusing on high-resolution image synthesis using transformers. Dive into key modifications of VQ-VAE, including perceptual loss and adversarial loss for crisper outputs. Learn about sequence prediction with GPT, generating high-resolution images, and in-depth loss explanations. Discover transformer training techniques, conditioning methods, and various sampling strategies. Compare results with other models, including DALL-E, and understand the effects of receptive fields on image generation.

Syllabus

Intro
A high-level VQ-GAN overview
Perceptual loss
Patch-based adversarial loss
Sequence prediction via GPT
Generating high-res images
Loss explained in depth
Training the transformer
Conditioning transformer
Comparisons and results
Sampling strategies
Comparisons and results continued
Rejection sampling with ResNet or CLIP
Receptive field effects
Comparisons with DALL-E

Taught by

Aleksa Gordić - The AI Epiphany

Reviews

Start your review of VQ-GAN - Taming Transformers for High-Resolution Image Synthesis - Paper Explained

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.