Hermit - Low-Latency, High-Throughput, and Transparent Remote Memory via Feedback-Directed Asynchrony

Explore a conference talk from USENIX NSDI '23 that introduces Hermit, a redesigned swap system for remote memory techniques in datacenters. Learn about the novel adaptive, feedback-directed asynchrony approach that significantly improves memory utilization while reducing tail latency and increasing throughput. Discover how Hermit executes non-urgent operations asynchronously, collects runtime feedback, and uses it to optimize performance. Understand the implementation in Linux 5.14 and its impressive results, such as reducing the 99th percentile latency of Memcached by 99.7% and improving overall throughput for batch applications by 1.24× on average, all without modifying user code.