Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

On Gradient-Based Optimization - Accelerated, Distributed, Asynchronous and Stochastic

Simons Institute via YouTube

Overview

Explore gradient-based optimization techniques in this lecture by Michael Jordan from UC Berkeley. Delve into accelerated, distributed, asynchronous, and stochastic methods for machine learning optimization. Learn about variational approaches, covariant operators, discretization, gradient flow, Hamiltonian formulation, and gradient descent structures. Discover strategies for avoiding saddle points, understand the role of differential geometry in nonconvex optimization, and gain insights into stochastic gradient control. Enhance your understanding of computational challenges in machine learning through this comprehensive exploration of advanced optimization concepts.

Syllabus

Intro
What is variational
Gradientbased optimization
Covariant operator
Discretization
Summary
Gradient Flow
Hamiltonian Formulation
Gradient Descent
Diffusions
Assumptions
Gradient Descent Structure
Avoiding Saddle Points
Differential geometry
Nonconvex optimization
Stochastic gradient control

Taught by

Simons Institute

Reviews

Start your review of On Gradient-Based Optimization - Accelerated, Distributed, Asynchronous and Stochastic

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.