Overview
Join Apache Spark and Delta Lake committers for an illuminating "Ask Me Anything" session about Delta Lake 0.7.0 and Spark 3.0. Explore the history of Apache Spark, current bleeding-edge use cases, and gain insights into topics such as Delta Lake Metastore, Delete Update Merge, Automatic Manifest Generation, Table History Retention, and more. Learn about enabling Update Mode and its application in online systems. Benefit from the expertise of Burak Yavuz, Tathagata Das, and Denny Lee as they share their knowledge on simplifying data engineering, structured streaming, and the integration of Delta Lake with Apache Spark. Discover how these technologies are shaping the landscape of data management and analytics in various industries, including healthcare and life sciences.
Syllabus
Intro
Delta Lake 70
Delta Lake Metastore
Delete Update Merge
Automatic Manifest Generation
Table History Retention
Other Good Stuff
How to Enable
Update Mode
Online System
More Questions
Taught by
Databricks