Data Engineering with Rust and Delta Lake

Explore the future of data engineering with Rust and Delta Lake in this 33-minute conference talk by R Tyler Croy, Developer at Buoyant Data. Learn how to leverage foundational crates like Delta Lake, data fusion, and arrow to create high-performance, low-cost ingestion pipelines, transformation jobs, and data query applications. Gain insights into applying Rust to real-world data problems, including ingesting semi-structured data into Delta tables, enriching data from multiple tables, performing table management, and exporting data to external systems. No prior Rust knowledge is required, as fundamental concepts relevant to data engineering will be covered. Discover how to start your journey with Rust by applying it to familiar data challenges and enhancing your data engineering skills.