Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Nonlinear Approximation by Deep ReLU Networks - Ron DeVore, Texas A&M

Alan Turing Institute via YouTube

Overview

Explore the mathematics behind deep learning in this 47-minute conference talk on nonlinear approximation using deep ReLU networks. Delve into the architecture of neural networks, focusing on ReLU activation functions and their role in approximation theory. Examine the structure of TW.L, compare it with other approaches, and analyze approximation errors and classes. Investigate more general constructions and their consequences, including extremes and manifold approximation. Learn about three key theorems and covering techniques. Gain insights into cutting-edge advances in data science, bridging gaps between computational statistics, machine learning, optimization, information theory, and learning theory.

Syllabus

Intro
Deep Neural Networks
ReLU Networks
Architecture of Neural Networks
Structure of TW.L
Comparing T, with
Approximation Error
Approximation Classes
More general construction
Consequences
Extremes
Let us be careful
Manifold Approximation
Three Theorems
Covering
Last Thoughts

Taught by

Alan Turing Institute

Reviews

Start your review of Nonlinear Approximation by Deep ReLU Networks - Ron DeVore, Texas A&M

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.