Improving Apache Spark Application Processing Time - Configuration and Optimization Techniques

Improving Apache Spark Application Processing Time - Configuration and Optimization Techniques

Databricks via YouTube Direct link

Read Phase: Spark Data Source Overview

5 of 13

5 of 13

Read Phase: Spark Data Source Overview

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Improving Apache Spark Application Processing Time - Configuration and Optimization Techniques

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 About CSI Group (Cloud Security Intelligence)
  3. 3 Application Architecture and Overview
  4. 4 Input Architecture
  5. 5 Read Phase: Spark Data Source Overview
  6. 6 Spark Data Source Implementation
  7. 7 Partitioning Strategies
  8. 8 Dynamic number of tasks
  9. 9 Custom Spark Data Source - Summary
  10. 10 Optimal Number of Partitions
  11. 11 Garbage Collection - Analysis
  12. 12 Garbage First (GI) GC
  13. 13 Garbage Collection - Summary

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.