Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

CXL Technology for AI and ML Workloads - Memory Expansion and Performance Optimization

SNIAVideo via YouTube

Overview

Explore a comprehensive 46-minute conference talk from SNIA SDC 2024 that delves into the transformative applications of CXL technology in AI/ML workloads. Learn how CXL Memory Expansion, Pooling, and Sharing can revolutionize performance by overcoming traditional memory limitations, particularly crucial in the age of large language models. Gain practical insights into the CXL Software Ecosphere, benchmarking techniques for CPU, memory, and GPUs, and effective memory placement strategies for optimizing applications. Master the implementation of Retrieval Augmented Generation (RAG) pipelines and understand the critical role of memory in AI/ML workloads. Discover how to leverage CXL technology to enhance LLM training and inference, enable supercharged ray clusters, and achieve unprecedented levels of performance efficiency. Presented by Steve Scargall from MemVerge, this session equips practitioners with essential knowledge to harness CXL's full potential in advancing AI/ML capabilities and maintaining a competitive edge in the rapidly evolving field of artificial intelligence.

Syllabus

SNIA SDC 2024 - CXL for AI/ML

Taught by

SNIAVideo

Reviews

Start your review of CXL Technology for AI and ML Workloads - Memory Expansion and Performance Optimization

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.