Gazelle-JNI: Offloading Spark SQL to Native Engines for Execution Acceleration
Databricks via YouTube
Overview
Syllabus
DATA AI
Our Team
Basic Operator Perf Stopped Grow
CPU Is The Bottleneck
Spark Is a Proved & Great Framework to Scale Out
SQL Engine Developed Years
An Evolution Is on The Way
Gluten is
Gluten Layout
Gluten Components
Plan Conversion
Buffer Passing & Sharing
Fallback Processing
Gluten's Shuffle
Gluten Memory Management
Gluten + Velox Performance
Gluten + ClickHouse Performance
Next Step
Take Gluten for a Spin
Call to Action
Performance Metrics (Velox)
Taught by
Databricks