Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Bamboo - Making Preemptible Instances Resilient for Affordable Training of Large DNNs

USENIX via YouTube

Overview

Explore a 15-minute conference talk from USENIX NSDI '23 that introduces Bamboo, an innovative distributed system designed to significantly reduce the costs of training large Deep Neural Network (DNN) models. Learn how Bamboo leverages preemptible instances and introduces redundant computations into the training pipeline to achieve resilience and efficiency in the face of frequent preemptions. Discover how this approach outperforms traditional checkpointing techniques, resulting in 3.7× improvement in training throughput and 2.4× reduction in costs compared to using on-demand instances. Gain insights into the challenges of training increasingly large DNN models and the novel solutions proposed to make this process more affordable for organizations and research labs of all sizes.

Syllabus

NSDI '23 - Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs

Taught by

USENIX

Reviews

Start your review of Bamboo - Making Preemptible Instances Resilient for Affordable Training of Large DNNs

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.