Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

École Polytechnique Fédérale de Lausanne

Introduction to optimization on smooth manifolds: first order methods

École Polytechnique Fédérale de Lausanne via edX

Overview

Optimization on manifolds is the result of smooth geometry and optimization merging into one elegant modern framework.

We start the course at "What is a manifold?", and give the students a firm understanding of submanifolds embedded in real space. This covers numerous applications in engineering and the sciences.

All definitions and theorems are motivated to build time-tested optimization algorithms. The math is precise, to promote understanding and enable computation.

We build our way up to Riemannian gradient descent: the all-important first-order optimization algorithm on manifolds. This includes analysis and implementation.

The lectures follow (and complement) the textbook "An introduction to optimization on smooth manifolds" written by the instructor, also available on his webpage.

From there, students can explore more with numerical tools (such as the toolbox Manopt, which is the subject of the last week of the course). They will also be in a good position to tackle more advanced theoretical tools necessary for second-order optimization algorithms (e.g., Riemannian Hessians). Those are covered in further video lectures available on the instructor's textbook webpage.

Syllabus

1. Introduction

2. Manifolds and tangent spaces

3. Functions, differentials, retractions and vector fields

4. Riemannian manifolds and gradients

5. Riemannian gradient descent

6. Manopt (toolbox for optimization on manifolds)

Taught by

Nicolas Boumal

Reviews

Start your review of Introduction to optimization on smooth manifolds: first order methods

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.