Nodens - Enabling Resource Efficient and Fast QoS Recovery of Dynamic Microservice Applications in Datacenters

Explore a conference talk from USENIX ATC '23 that introduces Nodens, a runtime system designed to enable fast Quality-of-Service (QoS) recovery for dynamic microservice applications in datacenters while maintaining efficient resource usage. Learn about the challenges posed by load and call graph dynamics in microservice applications, which can lead to inappropriate resource allocation and QoS violations. Discover how Nodens addresses these issues through its three key components: a traffic-based load monitor, a blocking-aware load updater, and a resource-efficient query drainer. Understand how these components work together to predict loads, update actual "to-be-processed" loads, and allocate just-enough excessive resources for queued queries. Gain insights into the experimental results showing Nodens' ability to reduce QoS recovery time by 12.1X with only 6.1% excessive resource usage on average, compared to state-of-the-art microservice management systems.