Explore the fascinating world of multimodal neurons in artificial neural networks through this in-depth 52-minute video lecture. Dive into OpenAI's groundbreaking investigation of their CLIP model using faceted feature visualization. Discover how certain neurons in the model's last layer respond to distinct concepts across multiple modalities, firing for photographs, drawings, and signs depicting the same concept. Follow along as the lecturer examines neurons corresponding to persons, geographical regions, religions, emotions, and more. Gain insights from the speaker's personal findings using the OpenAI Microscope, exploring unique neurons like the "Superman Neuron" and "Resting B*tchface Neuron." Learn about adversarial typographic attacks, the Stroop test, and the implications of these discoveries for artificial intelligence research.
Multimodal Neurons in Artificial Neural Networks - With OpenAI Microscope, Research Paper Explained
Overview
Syllabus
- Intro & Overview
- OpenAI Microscope
- Categories of found neurons
- Person Neurons
- Donald Trump Neuron
- Emotion Neurons
- Region Neurons
- Sparse Mixture of Emotions
- Emotion Atlas
- Adversarial Typographic Attacks
- Stroop Test
- My Findings in OpenAI Microscope
- Superman Neuron
- Resting B*tchface Neuron
- Trash Bag Neuron
- God Weightlifting Neuron
- Organ Neuron
- Film Spool Neuron
- Feather Neuron
- Spartan Neuron
- Letter E Neuron
- Cleanin Neuron
- Frown Neuron
- Lion Neuron
- Fashion Model Neuron
- Baseball Neuron
- Bride Neuron
- Navy Neuron
- Hemp Neuron
- Staircase Neuron
- Disney Neuron
- Hillary Clinton Neuron
- God Neuron
- Blurry Neuron
- Arrow Neuron
- Trophy Presentation Neuron
- Receding Hairline Neuron
- Traffic Neuron
- Raised Hand Neuron
- Google Maps Neuron
- Nervous Smile Neuron
- Elvis Neuron
- The Flash Neuron
- Beard Neuron
- Kilt Neuron
- Rainy Neuron
- Electricity Neuron
- Droplets Neuron
- Escape Neuron
- King Neuron
- Country Neuron
- Overweight Men Neuron
- Wedding
- Australia Neuron
- Yawn Neuron
- Bees & Simpsons Neuron
- Mussles Neuron
- Spice Neuron
- Conclusion
Taught by
Yannic Kilcher
