Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Gradient Descent: The Ultimate Optimizer - Automating Hyperparameter Optimization

AutoML Seminars via YouTube

Overview

Explore an insightful 30-minute AutoML seminar that delves into automating hyperparameter optimization in gradient-based machine learning algorithms. Learn how to automatically compute hypergradients through a straightforward modification to backpropagation, eliminating the need for manual hyperparameter tuning. Discover the recursive application of this method to optimize hyper-hyperparameters indefinitely, resulting in increasingly robust optimization processes that become less dependent on initial hyperparameter choices. Examine practical implementations and experimental results across Multiple Layer Perceptrons (MLPs), Convolutional Neural Networks (CNNs), and Recurrent Neural Networks (RNNs), complete with a PyTorch implementation demonstration. Master the concepts behind this elegant solution that streamlines the optimization of step sizes, momentum coefficients, and other crucial hyperparameters in machine learning models.

Syllabus

Kartik Chandra / Audrey Xie: "Gradient Descent: The Ultimate Optimizer"

Taught by

AutoML Seminars

Reviews

Start your review of Gradient Descent: The Ultimate Optimizer - Automating Hyperparameter Optimization

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.