Architecting the Snowflake Data Cloud - Multi-cluster Shared Data Architecture
DSDSD - Dutch Seminar on Data Systems Design via YouTube
Overview
Watch a technical lecture from Snowflake's lead database engineer Allison Lee as she delves into the evolution and architecture of Snowflake's data cloud platform. Learn about the innovative "multi-cluster shared data" architecture that separates compute from storage to leverage cloud elasticity, and discover how this fundamental design enables massive scalability, automatic optimizations, and global secure data collaboration. Explore the system's transformation from a cloud data warehouse to a comprehensive multi-cloud platform supporting diverse data processing workloads. Gain insights into the architectural evolution over the past decade and valuable lessons learned from building and scaling a cloud-native data platform. The lecture, presented as part of the prestigious Dijkstra Award 2024 series, draws from Lee's extensive experience as a founding engineer at Snowflake and her previous work optimizing analytical workloads at Oracle.
Syllabus
Architecting the Snowflake Data Cloud by Allison Lee (Dijkstra Award 2024)
Taught by
DSDSD - Dutch Seminar on Data Systems Design