Overview
Dive deep into the inner workings of Delta Lake's DELETE, UPDATE, and MERGE operations in this technical talk. Explore how commits, snapshot isolation, and partition and file changes occur during these operations and structured streaming. Learn about the Delta Lake Transaction Log, understand the fundamentals and actions performed when executing DELETE, UPDATE, and MERGE tasks, and discover techniques for improving performance. Gain insights into extended MERGE syntax, streaming aggregates, and GDPR compliance. Examine Delta Lake releases, roadmap, and connectors, and understand how various users leverage Delta Lake in their data workflows.
Syllabus
Intro
Delta Lake - 1 slide intro
Outline
Update - Under the hood
Update - Improving Performance
Merge - Extended syntax
Merge - Under the hood
Merge - Improving Performance
Streaming aggregates
GDPR - Simple way
Apply change data with delete
Delta Lake Releases and Roadmap
Delta Lake Connectors
Users of Delta Lake
Taught by
Databricks