Gradient Descent Courses and Certifications

Regression and Gradient Descent

Master regression algorithms from scratch, implementing linear and logistic regression using gradient descent. Build predictive models without relying on high-level libraries for deep mathematical understanding.

• CodeSignal
• On-Demand
• Free Certificate

Gradient Descent: Building Optimization Algorithms from Scratch

Master optimization algorithms by implementing Gradient Descent variants from scratch, including Stochastic, Mini-Batch, Momentum, RMSProp, and Adam methods, with hands-on Python implementation and practical applications.

• CodeSignal
• On-Demand
• Free Certificate

Gradient Boost

Explore the fundamentals and advanced concepts of Gradient Boost for regression and classification in machine learning.

• YouTube
• 1 hour 30 minutes
• On-Demand
• Free Video

Great Learning

Stochastic Gradient Descent

Explore stochastic gradient descent, its advantages, and implementation. Learn about mini-batches, momentum, and convergence in this optimization algorithm for machine learning models.

• YouTube
• 1 hour 37 minutes
• On-Demand
• Free Video

Code With Aarohi

Explained Gradient Descent Optimizer

Comprehensive explanation of gradient descent optimization, covering mathematical foundations, weight updates, and backpropagation for machine learning and deep learning applications.

• YouTube
• 26 minutes
• On-Demand
• Free Video

3Blue1Brown

Gradient Descent, How Neural Networks Learn

Explore gradient descent and neural network learning through animations, examples, and expert insights. Gain a deeper understanding of cost functions, network analysis, and cutting-edge research in machine learning.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Simons Institute

Optimization Crash Course

Explore geometric methods in optimization and sampling, covering key topics like convexity, optimality, and gradient descent with expert insights from MIT's Ashia Wilson.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Institute for Advanced Study

Geodesically Convex Optimization - Can We Prove P!=NP Using Gradient Descent - Avi Wigderson

Explore geodesically convex optimization and its potential to prove P≠NP using gradient descent in this advanced seminar by renowned mathematician Avi Wigderson.

• YouTube
• 1 hour 58 minutes
• On-Demand
• Free Video

Institute for Pure & Applied Mathematics (IPAM)

Gradient Descent, Stochastic Gradient Descent, and Acceleration - Part 2

Explore advanced gradient-based optimization methods for large-scale machine learning, including stochastic gradient descent and accelerated versions, with convergence analysis and ODE connections.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

Simons Institute

Analyzing Optimization and Generalization in Deep Learning via Trajectories of Gradient Descent

Explore deep learning optimization and generalization through gradient descent trajectories, uncovering insights into neural network behavior and performance.

• YouTube
• 46 minutes
• On-Demand
• Free Video

Nicholas Renotte

Building the Gradient Descent Algorithm - Coding Challenge

Hands-on tutorial for building a gradient descent algorithm from scratch in Python, implementing a regression machine learning model using only NumPy.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Alfredo Canziani

Gradient Descent and the Backpropagation Algorithm

Explore gradient descent and backpropagation algorithms, covering supervised learning, parametrized models, loss functions, and neural network architectures with PyTorch implementation.

• YouTube
• 1 hour 51 minutes
• On-Demand
• Free Video

International Mathematical Union

Gradient Descent on Infinitely Wide Neural Networks - Global Convergence and

Explore gradient descent on infinitely wide neural networks, examining global convergence and optimization techniques for non-convex problems in machine learning.

• YouTube
• 45 minutes
• On-Demand
• Free Video

MITCBMM

Optimization

Explore optimization techniques for machine learning, covering likelihood estimation, cost functions, gradient descent, and regularization methods for improved model performance.

• YouTube
• 56 minutes
• On-Demand
• Free Video

StatQuest with Josh Starmer

Gradient Descent, Step-by-Step

Comprehensive step-by-step explanation of Gradient Descent, covering its application in Machine Learning, optimization techniques, and variations like Stochastic Gradient Descent.

• YouTube
• 24 minutes
• On-Demand
• Free Video