Overview
Discover how Delta Lake on Azure Databricks can revolutionize big data analytics and machine learning workloads in this 26-minute conference talk. Explore the advanced features of Delta Lake, including file compaction, Z-Order partitioning, schema evolution, unified batch and streaming, and time travel. Learn about Apache Spark optimizations and how to set data quality expectations. Gain insights into architecture patterns, performance tuning, and data munging techniques. Watch a demonstration of the Delta Engine and understand how it can accelerate big data workloads by up to 100 times.
Syllabus
Introduction
Overview
What is Delta
Architecture Patterns
Performance Tuning
Demo
Data munging
Delta Engine
Taught by
Microsoft Ignite