A Lip Sync Expert Is All You Need for Speech to Lip Generation in the Wild

Explore a groundbreaking approach to speech-to-lip generation in unconstrained environments through this 40-minute Launchpad presentation. Delve into the innovative "Lip Sync Expert" model, its architecture, and evaluation methods as outlined in the research paper. Gain insights into the Wave to Lip Model, Generator, and new evaluation metrics. Examine the resynced dataset and real-world applications of this technology, while understanding its relevance and historical context in the field of audio-visual synthesis.