Optimization Algorithms Courses and Certifications

Yannic Kilcher

Descending Through a Crowded Valley - Benchmarking Deep Learning Optimizers

Comprehensive analysis of popular deep learning optimizers, comparing performance across tasks and providing evidence-based recommendations for algorithm selection and parameter tuning.

• YouTube
• 41 minutes
• On-Demand
• Free Online Course

Yannic Kilcher

Training More Effective Learned Optimizers, and Using Them to Train Themselves - Paper Explained

Explores a novel approach to machine learning optimization using neural networks, discussing its architecture, training process, and potential to revolutionize model training through self-improvement and generalization.

• YouTube
• 54 minutes
• On-Demand
• Free Online Course

Alfredo Canziani

Optimisation

Explore optimization techniques for neural networks, including gradient descent, SGD, momentum, adaptive methods, and normalization layers, with real-world applications in MRI technology.

• YouTube
• 1 hour 29 minutes
• On-Demand
• Free Online Course

Hausdorff Center for Mathematics

Mixed Integer Optimization in High Dimensions

Explore advanced techniques for solving high-dimensional mixed integer optimization problems, focusing on cutting-edge algorithms and theoretical foundations.

• YouTube
• 1 hour 4 minutes
• On-Demand
• Free Online Course

Hausdorff Center for Mathematics

LP-Norm Multiway Cut

Explores graph partitioning with lp-norm multiway cut, unifying min-sum and min-max variants. Discusses hardness, integrality gap, and approximation algorithm for this generalized problem.

• YouTube
• 31 minutes
• On-Demand
• Free Online Course

IEEE

Towards a Theory of Non-Commutative Optimization - Geodesic First and Second Order Methods for Moment Maps

Explore geodesic methods for non-commutative optimization, focusing on moment maps and their applications in mathematical theory and algorithms.

• YouTube
• 23 minutes
• On-Demand
• Free Online Course

Society for Industrial and Applied Mathematics

Inexact Accelerated High-order Proximal-point Methods in Convex Programming

New framework for accelerated methods in convex programming using approximations of high-order proximal points. Presents second-order method with O(k^(-4)) convergence rate, surpassing traditional complexity limits.

• YouTube
• 55 minutes
• On-Demand
• Free Online Course

Alan Turing Institute

Delayed Column Generation in Large Scale Integer Optimization Problems

Explore delayed column generation for solving large-scale mixed integer programming problems, focusing on applications in data science and decision mathematics.

• YouTube
• 2 hours 41 minutes
• On-Demand
• Free Online Course

Deep Learning Intuition - Lecture 2

Explore deep learning intuition with Stanford experts, covering logistic regression, face verification, neural architectures, and advanced applications in computer vision and image processing.

• YouTube
• 1 hour 23 minutes
• On-Demand
• Free Online Course

Convex Optimization I - Lecture 13

Explore advanced convex optimization techniques with Stanford's Stephen Boyd, focusing on practical applications and theoretical foundations in electrical engineering and beyond.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Free Online Course

Convex Optimization I - Lecture 3

Explore advanced convex optimization techniques with Stanford's Stephen Boyd. Dive deep into mathematical concepts and practical applications in this comprehensive lecture series.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Online Course

Convex Optimization I - Lecture 12

Explore advanced convex optimization techniques with Stanford's Stephen Boyd. Delve into complex mathematical concepts and their practical applications in engineering and data science.

• YouTube
• 1 hour 19 minutes
• On-Demand
• Free Online Course

Convex Optimization I - Lecture 10

Explore advanced convex optimization techniques with Stanford's Stephen Boyd. Delve into complex mathematical concepts and their practical applications in engineering and data science.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Online Course

Convex Optimization I - Lecture 9

Explore advanced convex optimization techniques with Stanford's Stephen Boyd, focusing on practical applications and theoretical foundations in electrical engineering and beyond.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Online Course

Convex Optimization I - Lecture 5

Explore advanced optimization techniques with Professor Stephen Boyd, focusing on convex problems and their applications in engineering and beyond.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Online Course