Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

High Performance Networking for Distributed DL Training in Production K8s

CNCF [Cloud Native Computing Foundation] via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intricacies of high-performance networking for distributed deep learning training in production Kubernetes environments in this 25-minute conference talk. Delve into the design and architecture of an 800 GPU cluster interconnected over RoCE fabric, achieving line rate performance between communicating containers in multi-node jobs. Learn about scalable cookie-cutter POD design for data centers, low latency one-hop network design enabling NCCL rings to avoid output port congestion, and Kubernetes integration with multi-homed networks for optimal GPU utilization. Gain insights into performance numbers for training workloads from production clusters, and discover how to overcome bottlenecks at NIC and switching fabric acting as interconnects between nodes.

Syllabus

High Performance Networking for Distributed DL Training in Production K8s - Nivedita Viswanath

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of High Performance Networking for Distributed DL Training in Production K8s

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.