Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Generative AI Models Through the Lens of Dense Associative Memory

Institute for Pure & Applied Mathematics (IPAM) via YouTube

Overview

Explore the fascinating world of Dense Associative Memories and their applications in generative AI models through this illuminating lecture by Dmitry Krotov from IBM. Delve into the mathematical framework and intuitive understanding of these modern Hopfield Networks, which boast a significantly larger memory storage capacity than their predecessors. Discover how these powerful tools are revolutionizing AI and neuroscience research. Examine the intriguing connections between Dense Associative Memories and prominent generative AI models, including transformers and diffusion models. Learn about the innovative Energy Transformer, a neural network that seamlessly integrates energy-based modeling, associative memories, and transformers. Gain insights into the emerging perspective that views diffusion models as Dense Associative Memories operating beyond critical memory storage capacity, and understand its implications for analyzing the memorization-generalization transition in these models. Uncover exciting possibilities for future research in this cutting-edge field of AI.

Syllabus

Dmitry Krotov - Generative AI models through the lens of Dense Associative Memory - IPAM at UCLA

Taught by

Institute for Pure & Applied Mathematics (IPAM)

Reviews

Start your review of Generative AI Models Through the Lens of Dense Associative Memory

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.