Brief Introduction to Deep Learning and the "Alchemy" Controversy - Sanjeev Arora
Institute for Advanced Study via YouTube
Overview
Explore a thought-provoking lecture on the controversial "Alchemy" debate in deep learning. Delve into the fundamental concepts of machine learning, deepnet architecture, optimization techniques, and the challenges of overfitting. Examine the interpreter problem and compare design-based systems with learned systems. Gain insights from Sanjeev Arora, a Princeton University professor and visiting scholar at the Institute for Advanced Study, as he dissects the arguments surrounding deep learning's scientific foundations. Analyze the subsequent manifesto and engage in a critical discussion about the future of artificial intelligence research.
Syllabus
Introduction
Definition of Alchemy
Alchemy analogies
Outline
Machine Learning
Deepnet
Optimization
Overfitting
Prediction error
Summary
Interpreter problem
Design vs learnt systems
Alis statement
A subsequent manifesto
Speakers
Discussion
Conclusion
Taught by
Institute for Advanced Study