Completed
PySpark Structure?
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
PySpark Best Practices
Automatically move to the next video in the Classroom when playback concludes
- 1 cloudera
- 2 Spark Execution Model
- 3 PySpark Driver Program
- 4 How do we ship around Python functions?
- 5 Pickle!
- 6 DataFrame is just another word for...
- 7 Use DataFrames
- 8 REPLs and Notebooks
- 9 Share your code
- 10 Standard Python Project
- 11 What is the shape of a PySpark job?
- 12 PySpark Structure?
- 13 Simple Main Method
- 14 Write Testable Code
- 15 Write Serializable Code
- 16 Testing with SparkTestingBase
- 17 Testing Suggestions
- 18 Writing distributed code is the easy part...
- 19 Get Serious About Logs
- 20 Know your environment
- 21 Complex Dependencies
- 22 Many Python Environments
