Energy Consumption of Datacenters: Impact of AI and GPU Computing

Explore a 37-minute conference talk from SREcon24 Europe/Middle East/Africa that examines the critical issue of datacenter resource consumption and its future implications. Dive into the current state of knowledge regarding energy, cooling, water, and other resource demands in datacenters, which have been growing exponentially for years. Learn how the AI boom has dramatically intensified resource requirements and discover why traditional GPU-based computing systems are challenging conventional datacenter design principles, particularly in terms of cooling solutions. While raising more questions than answers, gain valuable insights into making informed predictions about resource limitations and their impact on datacenter operations. Presented by Thomas Fricke, this USENIX conference session addresses one of the most pressing challenges facing modern infrastructure management.