Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Hopfield Networks Is All You Need - Paper Explained

Yannic Kilcher via YouTube

Overview

Explore an in-depth analysis of Hopfield Networks and their connection to modern Transformer models in this comprehensive video lecture. Delve into the evolution from binary to continuous Hopfield Networks, examining update rules and energy functions. Discover how the attention mechanism in Transformers relates to Hopfield Network update rules. Investigate Hopfield Attention Layers, conduct theoretical analysis, and explore BERT through the lens of Hopfield Networks. Learn about the application of Hopfield Networks in Immune Repertoire Classification. Gain insights into the learning process of Transformer and BERT models, and understand the potential for improving these architectures using Hopfield network concepts.

Syllabus

- Intro & Overview
- Binary Hopfield Networks
- Continuous Hopfield Networks
- Update Rules & Energy Functions
- Connection to Transformers
- Hopfield Attention Layers
- Theoretical Analysis
- Investigating BERT
- Immune Repertoire Classification

Taught by

Yannic Kilcher

Reviews

Start your review of Hopfield Networks Is All You Need - Paper Explained

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.