MPI Courses and Certifications

Scalable Parallel Computing Lab, SPCL @ ETH Zurich

The Role of MPI in Modern AI - Rusty Lusk's Legacy

Explore MPI's crucial role in modern AI and its impact on parallel computing, honoring Rusty Lusk's contributions to the field.

• YouTube
• 40 minutes
• On-Demand
• Free Video

NHR@FAU

Asynchronous MPI Communication with OpenMP Tasks - Spawning Task Dependency Graphs Across Nodes

Explore asynchronous MPI communication with OpenMP tasks to improve parallel code scalability. Learn to integrate MPI detached communication for real asynchronous execution across processes.

• YouTube
• 1 hour 4 minutes
• On-Demand
• Free Video

NHR@FAU

New Features in MPI 4.0

Explore new features in MPI 4.0, including large-count routines, persistent collectives, and the Sessions Model. Learn about hardware-based communicator splitting and improvements in error handling.

• YouTube
• 56 minutes
• On-Demand
• Free Video

High Performance Computing

This course will give you solid foundations for developing, analyzing, and implementing parallel and locality-efficient algorithms. Offered at Georgia Tech as CS6220

• Udacity
• 16 weeks
• On-Demand
• Free Online Course

Complete C++ Scientific Programming Bundle - 21 Hours!

77 ratings at Udemy

Scientific Programming with C++ Masterclass with STL, BOOST, CUDA, OpenMP and MPI Libraries: 21 Hours!

• Udemy
• 21 hours
• On-Demand
• Paid Course

High Performance Computing

1 review

Comprehensive exploration of advanced parallel computing techniques, covering MPI, OpenMP, GPU acceleration, and applications in scientific domains. Includes hands-on exercises for practical skill development.

• YouTube
• 1 day 2 hours
• On-Demand
• Free Video

Practical High-Performance Computing

Master high-performance computing through parallel programming, covering MPI, OpenMP, GPU tools, and practical applications in scientific computing. Learn optimization techniques and implement real-world HPC projects.

• Swayam
• 12 weeks
• On-Demand
• Free Online Course

IIT Bombay;  NPTEL

High Performance Scientific Computing

Master high-performance computing fundamentals, parallel programming with OpenMP and MPI, GPU computing, and scientific visualization tools for advanced computational research and simulation applications.

• Swayam
• 12 weeks
• On-Demand
• Free Online Course

Nvidia

Advanced Multi-GPU Programming with OpenACC - Lecture 2

Explore advanced multi-GPU programming techniques using OpenACC and MPI, covering domain decomposition, communication overlap, and tools for debugging and profiling MPI+OpenACC applications.

• YouTube
• 1 hour 10 minutes
• On-Demand
• Free Video

Learn Modern Fortran programming, from basics to advanced parallel computing techniques like OpenMP, OpenACC, CUDA, and MPI. Gain practical skills through hands-on exercises and explore best practices for efficient code development.

• Independent
• On-Demand
• Free Online Course

Designing High-Performance Scalable Middleware for HPC, AI, and Data Science in Exascale Systems and Clouds

Explore high-performance middleware design for exascale systems, focusing on MVAPICH2 project's features and performance in HPC, AI, and data science applications across various platforms.

• YouTube
• 47 minutes
• On-Demand
• Free Video

CNCF [Cloud Native Computing Foundation]

Bring Batch Capability Into Kubernetes, Using AI and Big Data as an Example

Explore advanced scheduling features for batch workloads in Kubernetes, focusing on AI and big data applications using frameworks like TensorFlow and Spark. Learn about fair-share scheduling and the Volcano project.

• YouTube
• 23 minutes
• On-Demand
• Conference Talk

CNCF [Cloud Native Computing Foundation]

Production Multi-node Jobs with Gang Scheduling, K8s, GPUs and RDMA

Explore distributed execution of DL/ML jobs in Kubernetes, covering gang scheduling, GPU acceleration, and high-speed networking for improved performance and scalability.

• YouTube
• 33 minutes
• On-Demand
• Conference Talk

The Julia Programming Language

Julia for High-Performance Computing - JuliaCon 2022

Explore Julia's capabilities for high-performance computing through expert talks on scalability, GPU support, MPI integration, and real-world applications in scientific and engineering domains.

• YouTube
• 2 hours 20 minutes
• On-Demand
• Free Video

QChemSoftware

PBC Development in Q-Chem - 2024 Wormit Award

Explore advancements in Q-Chem's PBC package for periodic systems, including hybrid DFT speedup and MPI parallelization. Learn about current functionality and future development directions.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video