GPU Computing Courses and Certifications

OpenInfra Foundation

Multi-Instance GPU Deployment for Machine Learning and Particle Beam Simulations at CERN

Explore CERN's implementation of Multi Instance GPU technology using NVIDIA A100s, covering deployment strategies, virtualization approaches, and practical applications in machine learning and particle physics.

• YouTube
• 28 minutes
• On-Demand
• Free Video

DPDK Project

1.2 Tb/s Packet Processing of Radio Telescope Data on GPU

Discover how to process massive radio telescope data streams at 1.2 Tb/s using NVIDIA Grace Hopper GPUs, optimizing packet handling and reducing energy consumption through innovative system architecture.

• YouTube
• 23 minutes
• On-Demand
• Free Video

DPDK Project

Getting GPUDirect to Work with Broadcom NICs

Discover how to integrate Broadcom NICs with NVIDIA GPUs for enhanced packet processing using GPUDirect RDMA, exploring necessary DPDK ecosystem modifications and implementation steps.

• YouTube
• 12 minutes
• On-Demand
• Free Video

IIIA Hub

Tensor Query Processing - Accelerating Database Analytics with AI Hardware

Discover how Microsoft's framework compiles SQL to tensor abstractions, enabling efficient database analytics on GPUs and exploring the fusion of SQL with machine learning capabilities.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video

Open Compute Project

Rethinking System Design for the New Wave of AI GPUs and CPUs

Explore innovative server design strategies for optimizing thermal management, power delivery, and performance in next-generation AI computing infrastructure with advanced GPUs and CPUs.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Optimize Your AI Cloud Infrastructure: A Hardware Perspective

Dive into hardware-level optimization techniques for AI cloud infrastructure, exploring GPU clusters, NUMA topology, and performance tuning strategies using H100 clusters and MLPerf benchmarks.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Discover AI

Running BLOOM 176B LLM Inference with AWS ML and DeepSpeed

Dive into advanced LLM inference deployment using AWS's ml.p4de.24xlarge instance, exploring BLOOM 176B implementation with DeepSpeed and DJL for optimal performance and scalability.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Krish Naik

Processing 100+ GB of Data in Seconds Using Polars GPU Engine

Master high-speed data processing with Polars GPU engine, leveraging NVIDIA GPUs to handle massive datasets up to 10x faster while using familiar Polars syntax and commands.

• YouTube
• 19 minutes
• On-Demand
• Free Video

SNIAVideo

Accelerating GPU Server Access to Network-Attached Disaggregated Storage Using DPU

Explore how DPUs optimize GPU server performance for AI workloads, focusing on network-attached storage acceleration, improved efficiency, and scalability for Large Language Models using AMD systems.

• YouTube
• 45 minutes
• On-Demand
• Free Video

CNCF [Cloud Native Computing Foundation]

Incremental GPU Slicing in Kubernetes Clusters - Dynamic Resource Management

Discover how to implement dynamic GPU slicing in Kubernetes clusters for efficient resource allocation and cost optimization in large language model deployments, using vendor-agnostic approaches.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Inside Livermore Lab

Interpolation at Arbitrary Points in High-Order Meshes on GPUs

Discover advanced techniques for arbitrary point interpolation in high-order mesh computations, focusing on GPU optimization and parallel processing for efficient scientific simulations.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Scalable Parallel Computing Lab, SPCL @ ETH Zurich

Hardware-aware Algorithms for Language Modeling - FlashAttention and Mamba Architectures

Delve into advanced hardware optimizations for language models, exploring FlashAttention-3's improvements and Mamba's efficient architecture for enhanced performance and linear scaling capabilities.

• YouTube
• 1 hour 5 minutes
• On-Demand
• Free Video

CNCF [Cloud Native Computing Foundation]

Which GPU Sharing Strategy Is Right for You? A Comprehensive Benchmark Study Using Dynamic Resource Allocation

Explore GPU sharing strategies in Kubernetes using Dynamic Resource Allocation (DRA), comparing Multi-Instance GPUs, MPS, and CUDA Time-Slicing for optimal workload performance.

• YouTube
• 37 minutes
• On-Demand
• Free Video

CNCF [Cloud Native Computing Foundation]

Building Resilience for Large-Scale AI Training: GPU Management, Failure Detection, and Beyond

Dive into GPU management strategies for large-scale AI training, covering failure detection, observability tools, and fault-tolerant distributed training principles to optimize performance and reduce costs.

• YouTube
• 37 minutes
• On-Demand
• Free Video

All Things Open

Accelerating the Next Generation of Multimedia with GPUs

Discover how to build high-performance live streaming services using the Babit Multimedia Framework (BMF), leveraging GPU acceleration and multi-language support for advanced video processing and broadcasting.

• YouTube
• 17 minutes
• On-Demand
• Free Video