Modernizing Apache Spark 3.0 Applications - Best Practices and Optimization Techniques

Modernizing Apache Spark 3.0 Applications - Best Practices and Optimization Techniques

Databricks via YouTube Direct link

The Diderot effect in data processing systems

3 of 15

3 of 15

The Diderot effect in data processing systems

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Modernizing Apache Spark 3.0 Applications - Best Practices and Optimization Techniques

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Denis Diderot and the Diderot effect
  3. 3 The Diderot effect in data processing systems
  4. 4 The Diderot effect in Spark: Project Tungsten (2015)
  5. 5 The Diderot effect, revised for 2021
  6. 6 What's your oldest Spark application?
  7. 7 Abstractions can leak in performance tuning
  8. 8 Choosing the right partition size is difficult
  9. 9 Adaptive query execution: coalescing
  10. 10 Sidebar: some basics on joins
  11. 11 Adaptive query execution: partition pruning
  12. 12 Enabling adaptive query execution
  13. 13 Accelerating Spark with NVIDIA GPUs
  14. 14 Case study: predicting customer churn
  15. 15 What's next?

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.