AI-Generating Algorithms - A Unique Opportunity
Association for Computing Machinery (ACM) via YouTube
Overview
Syllabus
Intro
Manual Path to AI
Clear Machine Learning Trend: Hand-designed pipelines are ultimately outperformed by learned solutions
Al-Generating Algorithms
Synthetic Petri Dish A Novel Surrogate Model for Rapid Architecture Search
Meta-learn learning algorithms
Meta-Learning Algorithms
Pillar 2: Meta-Learning
Catastrophic Forgetting
Proposal: Use meta-learning to learn to continually learn
Traditional Neuromodulation
Learned Sparsity
ANML Implications
Pillar 2: Meta-learn learning algorithm
A Paradox
Key for Science & Technological Innovation: Generating Problems, Goal Switching
Qualitatively Different
Intrinsic Motivation
Derailment
Avoids Detachment By Remembering Promising Exploration Stepping Stones
Results on Montezuma's Revenge
Pitfall
Go-Explore: Implications
What's missing?
Traditional ML
Paired Open-Ended Trailblazer (POET)
Task: Obstacle Courses
Direct Path Curriculum Fails
Enhanced POET
POET: Future Work
Overall Conclusions
Taught by
Association for Computing Machinery (ACM)