Overview
Explore the architecture and inner workings of Google BigQuery and Dremel in this comprehensive lecture from Carnegie Mellon University's Advanced Database Systems course. Delve into the design principles, query execution strategies, and performance optimizations of these powerful distributed query engines. Learn how BigQuery leverages columnar storage and massive parallelism to process petabytes of data in seconds. Examine the innovative techniques used by Dremel to handle nested data structures efficiently. Gain insights into the scalability, fault tolerance, and resource management mechanisms employed by these systems. Analyze real-world use cases and performance benchmarks to understand the capabilities and limitations of BigQuery in modern data analytics workflows.
Syllabus
S2024 #17 - Google BigQuery / Dremel (CMU Advanced Database Systems)
Taught by
CMU Database Group