Consistent Diffusion Meets Tweedie - Training Exact Ambient Diffusion Models with Noisy Data
Valence Labs via YouTube
Overview
Watch a technical research presentation exploring a groundbreaking framework for training diffusion models using corrupted data, introducing the first provable method for sampling from uncorrupted distributions despite noisy training data. Learn about the innovative application of Tweedie's formula and consistency loss function that enables sampling at noise levels below observed data noise. Discover important findings about diffusion models' memorization capabilities, including their ability to reconstruct heavily corrupted images, and understand how this new method can help mitigate privacy and copyright concerns. Examine practical applications through a case study of fine-tuning Stable Diffusion XL, demonstrating how the framework reduces dataset memorization while maintaining high performance levels.
Syllabus
Consistent Diffusion Meets Tweedie: Training Exact Ambient Diffusion Models with Noisy Data
Taught by
Valence Labs