Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Growing the Delta Ecosystem - Delta-RS for Rust and Python

Databricks via YouTube

Overview

Explore the delta-rs project in this 25-minute conference talk, which introduces how Delta Lake's capabilities are being extended beyond the Spark ecosystem. Discover the foundational Delta Lake library in Rust and its potential to enable native bindings in various programming languages. Learn about the current functionality of delta-rs in Rust and Python APIs, as well as the project's future roadmap. Gain insights into the kafka-delta-ingest project, a real-world application of delta-rs that facilitates high-throughput data transfer from Kafka to Delta Lake. Delve into Delta Lake basics, understand the motivations behind delta-rs, explore Rust's power, and see practical demonstrations in both Rust and Python. Examine the current capabilities, limitations, and community aspects of delta-rs, while understanding how it addresses specific challenges in data management and integration.

Syllabus

Intro
Delta Lake basics
Why delta-rs was needed
The power of Rust
Rust in action
Python in action
What you can do right now
What you can't quite do yet
kafka-delta-ingest
Problems to solve
delta-r's community

Taught by

Databricks

Reviews

Start your review of Growing the Delta Ecosystem - Delta-RS for Rust and Python

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.