Overview
Learn how to design and implement in-house server solutions for modern GPU hosting in this technical presentation from Nebius leaders Igor Znamenskiy and Oleg Fedorov. Explore the comprehensive approach to building data centers from scratch as a GPU cloud provider, with a focus on energy efficiency and optimal thermal management. Discover the engineering principles behind servers designed to operate with inlet air temperatures up to 40°C, specifically tailored for cutting-edge GPUs like NVIDIA H100, H200, and B200. Examine the success story of achieving a remarkable PUE of 1.12 at their Finnish data center through free cooling with outdoor air, leading to the creation of ISEG - ranked among the world's top 20 supercomputers. Gain insights into maximizing TCO through innovative thermal and power consumption efficiency strategies in modern data center design.
Syllabus
Designing in house server solution for hosting modern GPUs
Taught by
Open Compute Project