GMEM: Generalized OS Memory Management for Accelerators

Explore a groundbreaking approach to memory management for domain-specific accelerators in this 34-minute talk by Weixi Zhu from Huawei. Dive into GMEM (Generalized Memory Management), an innovative design change to Linux's memory management system that addresses the challenges of reinventing memory management for accelerator drivers. Learn how GMEM decouples CPU-related implementations from hardware-independent mechanisms, allowing drivers to register hardware-specific functions and leverage OS-managed memory. Discover the enhanced programmability offered by GMEM, which encapsulates accelerators and CPU within a single address space, simplifying memory management for developers. Understand how GMEM enables the use of CPU DRAM as a victim cache for accelerators without additional coding. Gain insights into GMEM's implementation on openEuler, a Linux-based OS, and explore its integration with commercial accelerator drivers through real-world case studies.