Diving into Delta Lake: Understanding the Transaction Log

Diving into Delta Lake: Understanding the Transaction Log

Databricks via YouTube Direct link

Outline

2 of 16

2 of 16

Outline

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Diving into Delta Lake: Understanding the Transaction Log

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Outline
  3. 3 Delta On Disk
  4. 4 Table = result of a set of actions
  5. 5 Implementing Atomicity
  6. 6 Ensuring Serializability
  7. 7 Solving Conflicts Optimistically
  8. 8 Handling Massive Metadata Large tables can have millions of files in them! How do we scale the metadata? Use Spark for scaling!
  9. 9 Checkpoints
  10. 10 Computing Delta's State
  11. 11 Updating Delta's State
  12. 12 Time Travelling by version
  13. 13 Time Travelling by timestamp
  14. 14 Time Travel Limitations
  15. 15 Batch Queries on a Delta Table
  16. 16 Streaming Queries on a Delta Table

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.