Deep Dive into GPU Support in Apache Spark 3.x - Accelerator-Aware Scheduling and RAPIDS Plugin

Deep Dive into GPU Support in Apache Spark 3.x - Accelerator-Aware Scheduling and RAPIDS Plugin

Databricks via YouTube Direct link

Accelerator-Aware Scheduling

2 of 22

2 of 22

Accelerator-Aware Scheduling

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Deep Dive into GPU Support in Apache Spark 3.x - Accelerator-Aware Scheduling and RAPIDS Plugin

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Accelerator-Aware Scheduling
  3. 3 GPU Scheduling Example
  4. 4 GPU Discovery Script Example
  5. 5 GPU Assignments API
  6. 6 GPU Scheduling UI
  7. 7 Stage Level Scheduling
  8. 8 SOL Columnar Processing
  9. 9 Spark 3 with Project Hydrogen
  10. 10 Deep Learning Recommendation Machines
  11. 11 RAPIDS Accelerator for Apache Spark (Plugin)
  12. 12 Is This a Silver Bullet?
  13. 13 But It Can Be Amazing
  14. 14 Spark SOL & DataFrame Compilation Flow
  15. 15 ETL Technology Stack
  16. 16 Demo Cluster Setup
  17. 17 Databricks Demo Results
  18. 18 T4 Cluster Setup
  19. 19 RAPIDS Accelerator on AWS
  20. 20 Spark Shuffle
  21. 21 Accelerated Shuffle Results
  22. 22 What's Next

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.