Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

From Associative Memories to Deep Networks and From Associative Memories to Universal Machines

MITCBMM via YouTube

Overview

Explore a comprehensive panel discussion featuring Professors Christos Papadimitriou, Tomaso A. Poggio, and Santosh Vempala, moderated by Kenneth Blum. Delve into the evolution of associative memories to deep networks and universal machines over the past 50 years. Discover how holography inspired associative memory models and how Willshaw networks, similar to modern deep nets, were implemented using threshold neurons. Gain insights into the realistic potential of deep learning in understanding human intelligence. Examine topics such as deep networks as memories, kernels, and lookup tables, their limitations, and evolutionary discoveries. Explore concepts like the grandmother myth, Jennifer Aniston cells, recurrent nets, assembly operations, and the neural basis of language. Investigate working memory, robustness, plasticity rules, and representations. Engage with thought-provoking questions from attendees and learn about relevant experiments in the field.

Syllabus

Introduction
Associative Memories
Deep Networks as Memories
Deep Networks as Kernels
Deep Networks as Lookup Tables
Limitations of Deep Networks
What could the evolution have discovered
Summary
Introductions
The main roadblock
The grandmother myth
Jennifer Aniston cells
Recurrent nets
Assembly operations
How powerful is it
Ray of English
Neural Basis of Language
Will shadow nets be equal to deep nets
How do branches learn
Robustness
plasticity rules
Perceptron and multiplicative
Representations
Conclusion
Question from Xiao
Question from Zhao
Question from DeGhani
Experiments
Working Memory

Taught by

MITCBMM

Reviews

Start your review of From Associative Memories to Deep Networks and From Associative Memories to Universal Machines

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.