Adaptive Query Execution: Speeding Up Spark SQL at Runtime

Adaptive Query Execution: Speeding Up Spark SQL at Runtime

Databricks via YouTube Direct link

Dynamically collapsing shuffle partitions

9 of 14

9 of 14

Dynamically collapsing shuffle partitions

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Adaptive Query Execution: Speeding Up Spark SQL at Runtime

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Agenda
  3. 3 Adaptive Query Execution
  4. 4 Optimizations Overview
  5. 5 Partition Coalescing
  6. 6 Dynamic Join Strategy Selection
  7. 7 Importing EQE
  8. 8 Sales Table
  9. 9 Dynamically collapsing shuffle partitions
  10. 10 Demo of collapsing shuffle partitions
  11. 11 Demo of dynamically optimizing the query
  12. 12 Performance result
  13. 13 Dynamicly collapsing shuffle partitions
  14. 14 Dynamically switching joint strategies

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.