Bellman Equations Courses and Certifications

Institute for Pure & Applied Mathematics (IPAM)

Nonconvex Homogenization for 1D Controlled Brownian Motion in a Random Potential

Explores stochastic control of Brownian motion in random potentials, analyzing optimal payoff growth and Bellman equation homogenization. Discusses effective Hamiltonians and distinct control regimes.

• YouTube
• 55 minutes
• On-Demand
• Free Video

Pascal Poupart

Distributional RL

Explore distributional reinforcement learning, covering return distribution, policy evaluation, and the C51 algorithm, with insights into its advantages and applications in Atari games.

• YouTube
• 23 minutes
• On-Demand
• Free Video

Nvidia Deep Learning Institute;  Unity Microcredential

Deep Reinforcement Learning

356 ratings at Udacity

Master deep reinforcement learning techniques to train AI agents for navigation, financial trading, and multi-agent systems. Implement classical and modern RL algorithms using PyTorch.

• Udacity
• 4 months 4 days 16 hours
• On-Demand
• Paid Course

Learn Ventures

Fundamentals of Deep Reinforcement Learning

Learn the theoretical foundations of Deep Learning through practical Python code.

• edX
• 8 weeks, 2-6 hours a week
• On-Demand
• Free Online Course (Audit)

Reinforcement Learning

Learn key concepts and algorithms in reinforcement learning, including bandit algorithms, dynamic programming, and policy gradient methods, from industry experts.

• Edureka
• On-Demand
• Paid Course

Serrano.Academy

A Friendly Introduction to Deep Reinforcement Learning, Q-Networks and Policy Gradients

Friendly exploration of deep reinforcement learning concepts, including Markov decision processes, Q-networks, and policy gradients, using examples and visuals to explain complex ideas.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Simons Institute

Reinforcement Learning via an Optimization Lens

Explore reinforcement learning through an optimization lens, covering MDPs, Bellman equations, and novel approaches to solving RL problems using linear programming and primal-dual formulations.

• YouTube
• 47 minutes
• On-Demand
• Free Video

Simons Institute

Deep Robust Reinforcement Learning and Regularization

Explore robust reinforcement learning, addressing uncertainties in deep RL through regularization techniques. Gain insights into robust MDPs, policy evaluation, and uncertainty-aware Bellman equations.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Simons Institute

Online Learning in Markov Decision Processes - Part 1

Explore online learning in Markov Decision Processes, covering theory, algorithms, and optimal strategies for reinforcement learning in dynamic environments.

• YouTube
• 1 hour 26 minutes
• On-Demand
• Free Video

Digi-Key

Introduction to Reinforcement Learning

Learn reinforcement learning fundamentals and apply them to solve control problems using Python libraries. Hands-on training with cartpole example and challenge to tackle inverted pendulum problem.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

Pascal Poupart

CS885 - Semi-Markov Decision Processes

Explore semi-Markov decision processes, reinforcement learning, and queueing theory. Learn about Bellman's equation and the option framework for advanced decision-making strategies.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Institute for Pure & Applied Mathematics (IPAM)

Solving High-Dimensional Optimal Control Problems with Empirical Tensor Train Approximation

Explore innovative approaches to solve high-dimensional optimal control problems using Tensor Train approximation, with applications to destabilized viscous Burgers and diffusion equations.

• YouTube
• 47 minutes
• On-Demand
• Free Video

Dave Churchill

Intro to Artificial Intelligence - Markov Decision Process (MDP) - Lecture 17

Explore Markov Decision Processes (MDPs) in AI, learning algorithmic techniques for modern problem-solving in uncertain environments.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Discover AI

Understanding Q* (Q-star) - From Q-Learning to Maximum Entropy Reinforcement Learning

Delve into the technical foundations of Q* (Q-star), exploring its roots in physics entropy, reinforcement learning principles, and practical applications in machine learning systems.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Yannic Kilcher

Q-Learning: From Basics to Deep Q-Networks

Explore Q-Learning fundamentals, from Markov Decision Processes to Deep Q-Networks, in this comprehensive overview of reinforcement learning concepts and applications.

• YouTube
• 46 minutes
• On-Demand
• Free Video