A technical conference talk exploring ByteDance's implementation of Presto Router and Alluxio Local Cache, where engineers demonstrate practical solutions for cache invalidation, dashboard development, and custom cache strategies. Learn about data consistency through Alluxio page versioning, soft affinity scheduling, and consistent hashing techniques. Discover how ByteDance's Presto team enhanced system performance and reliability through data orchestration, semantic cache implementation, and native Parquet reader integration. Gain insights into distributed cache architecture and the strategic benefits of caching in large-scale data processing environments.
Speeding Up Presto with Router and Local Cache Implementation
Overview
Syllabus
Intro
Why Caching
Alluxio Local Cache Integration
Data Consistency âž¡ Alluxio page versioning
Soft Affinity Scheduling
Consistent Hashing
Data Orchestration âž¡ Integration of Cache Strategy
Performance Improvement
Stability Improvement
Semantic Cache
Native Parquet Reader
Distributed Cache
Taught by
Presto Foundation
