Explore a conference talk presenting Starburst, a cost-aware scheduler for hybrid cloud environments. Dive into the challenges of efficiently managing bursts in job demand using hybrid cloud architectures, and discover how Starburst maximizes cluster utilization to optimize the trade-off between cloud costs and job completion time. Learn about the system's dynamic approach to controlling job waiting times, its configurable waiting budget framework, and its role as a higher-level resource manager. Examine the results of simulations and real-world experiments demonstrating Starburst's ability to significantly reduce cloud costs while minimally impacting average job completion time compared to existing cluster managers.
Overview
Syllabus
USENIX ATC '24 - Starburst: A Cost-aware Scheduler for Hybrid Cloud
Taught by
USENIX