Themis - Fair and Efficient GPU Cluster Scheduling

Explore a 22-minute conference talk from USENIX NSDI '20 that introduces Themis, a novel scheduling framework for GPU cluster management in distributed machine learning workloads. Dive into the challenges of fair and efficient GPU allocation across multiple ML jobs, and discover how Themis addresses these issues through a unique two-level scheduling architecture. Learn about the concept of finish-time fairness and how it's implemented using an auction-based resource allocation system. Examine the framework's performance compared to existing schedulers, with insights on improved fairness and cluster efficiency. Gain valuable knowledge on GPU cluster scheduling, resource allocation strategies, and the specific needs of ML training workloads in shared environments.