Technical Trends in AI Infrastructure for Developers - 2024

Explore the evolving landscape of AI infrastructure in this 33-minute conference talk from the Storage Developer Conference in Austin. Dive into key trends observed in infrastructure development for AI applications and workloads, examining how AI's rapid evolution from research to mainstream adoption across consumer, enterprise, telco, cloud, and government sectors has shaped infrastructure requirements. Learn about critical factors influencing infrastructure design, including diverse application types, growing neural network model sizes, power consumption, and cooling needs. Understand the spectrum of accelerator solutions from GPUs and FPGAs to custom ASICs, and how their implementation varies across far-edge, near-edge, on-premise datacenter, and cloud deployments. Examine the crucial role of storage and networking components in creating effective AI infrastructure solutions, and gain insights into future deployment scenarios for AI systems. Delivered by Bhavesh Patel from Dell Technologies, this presentation offers valuable perspectives on the technical evolution of AI infrastructure development.