RingLeader - Efficiently Offloading Intra-Server Orchestration to NICs

Explore a cutting-edge approach to intra-server orchestration in this conference talk from NSDI '23. Dive into RingLeader, a novel system that offloads orchestration tasks to Network Interface Cards (NICs) to improve datacenter server performance. Learn how this innovative solution addresses the challenges of load balancing, request scheduling, and CPU allocation in high-performance environments. Discover the architecture of RingLeader's programmable NIC, featuring new hardware units for software-informed load balancing and scheduling, as well as a lightweight OS-NIC interface for enhanced coordination. Examine the results of experiments conducted with a 100 Gbps FPGA-based prototype, demonstrating RingLeader's superior scalability, efficiency, latency, and throughput compared to state-of-the-art software-only orchestrators like Shinjuku and Caladan.