Designing In-House Server Solutions for Modern GPU Cloud Computing

Learn how to design and implement in-house server solutions for modern GPU hosting in this technical presentation from Nebius leaders Igor Znamenskiy and Oleg Fedorov. Explore the comprehensive approach to building data centers from scratch as a GPU cloud provider, with a focus on energy efficiency and optimal thermal management. Discover the engineering principles behind servers designed to operate with inlet air temperatures up to 40°C, specifically tailored for cutting-edge GPUs like NVIDIA H100, H200, and B200. Examine the success story of achieving a remarkable PUE of 1.12 at their Finnish data center through free cooling with outdoor air, leading to the creation of ISEG - ranked among the world's top 20 supercomputers. Gain insights into maximizing TCO through innovative thermal and power consumption efficiency strategies in modern data center design.