Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Learn about the evolution of YTsaurus, Yandex's primary data storage and processing platform, in this 45-minute conference talk from DevOops. Explore how the engineering team addressed scaling challenges beyond hardware limitations by implementing a hierarchical automation approach. Discover the pyramid of needs for large-scale multitenant systems, progressing from fundamental engineering requirements to user and business needs. Gain insights into managing a massive cluster of over 20,000 hosts serving 4,500 daily active users, and understand how automation tools and processes can prevent administrative bottlenecks as system scale increases. Follow the YTsaurus team's automation journey and learn practical strategies for building sustainable, large-scale Big Data solutions that balance scalability, fault tolerance, and operational efficiency.