Storage Requirements for AI Infrastructure - From Data Preparation to Inference

Explore the crucial role of storage systems in AI infrastructure through this 19-minute technical presentation from the SNIA Compute, Memory, and Storage Summit. Gain insights into how storage impacts every phase of the AI lifecycle, from initial data preparation through pre-training, fine-tuning, checkpointing, and inference operations. Learn about performance requirements and real-world patterns through practical examples, understand the significance of Deep Learning framework data loader libraries, and evaluate the pros and cons of file-based versus object-based storage solutions. Master the fundamentals of AI storage workloads to better assess and plan infrastructure requirements for AI projects. Delivered by John Cardente, Member of Technical Staff at Dell Technologies, this talk provides essential knowledge for anyone involved in AI infrastructure planning and implementation.