Completed
Handling Massive Metadata Large tables can have millions of files in them! How do we scale the metadata? Use Spark for scaling!
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Diving into Delta Lake: Understanding the Transaction Log
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Outline
- 3 Delta On Disk
- 4 Table = result of a set of actions
- 5 Implementing Atomicity
- 6 Ensuring Serializability
- 7 Solving Conflicts Optimistically
- 8 Handling Massive Metadata Large tables can have millions of files in them! How do we scale the metadata? Use Spark for scaling!
- 9 Checkpoints
- 10 Computing Delta's State
- 11 Updating Delta's State
- 12 Time Travelling by version
- 13 Time Travelling by timestamp
- 14 Time Travel Limitations
- 15 Batch Queries on a Delta Table
- 16 Streaming Queries on a Delta Table