Learn about CXL-based Near Memory Compute architectures in this technical talk that explores solutions for hyperscale workload acceleration. Discover how Marvell's integrated solutions address memory capacity and bandwidth challenges for recommendation systems, big data analytics, in-memory vector databases, and KV caches. Explore the implementation of NMC accelerators featuring high-performance compute cores with SIMD vector processing and efficient engines for data movement, compression, and encryption. Understand how these technologies work together to mitigate memory wall issues and enhance AI accelerator performance in heterogeneous computing environments.
Memory Wall Mitigation and Acceleration of AI Workloads Using CXL Near Memory Computing
Open Compute Project via YouTube
Overview
Syllabus
Memory wall mitigation and acceleration of AI workloads, and in memory databases using CXL Ne
Taught by
Open Compute Project
Related Courses
-
Breaking Through the Memory Wall with CXL - Accelerating Computing Performance
-
Memory Semantics and Data Movement with CXL and SDXI - Standards and Applications
-
CXL Shared Memory Technology for Accelerating AI Cluster Performance
-
Server Fabrics and the Evolution to CXL 3.0 - Memory and Resource Management in Heterogeneous Computing
-
Optimizing AI Inferencing with CXL Memory - Memory Tiering Strategies for Enhanced Performance
-
CXL 3.0 - Expanded Capabilities for Memory Pooling and Resource Optimization
