Databricks Streaming - Project Lightspeed Goes Hyperspeed

Dive into the latest advancements in next-generation streaming data processing with Spark Structured Streaming in this 36-minute conference talk by Databricks. Explore the remarkable progress made in ultra low-latency processing as part of Project Lightspeed. Discover shocking new latency benchmarks for UC-enabled serverless streaming pipelines, advanced stateful processing capabilities including transformWithState and State Reader APIs, and the newly introduced Apache Pulsar connector. Learn about the roadmap for Structured Streaming x DLT Pipelines and understand why Databricks is recognized as the worldwide leader in analytic stream processing by IDC. Gain insights into delivering real-time data for top AI use cases across various industries using the Databricks Data Intelligence Platform. Presented by Karthikeyan Ramasamy, Head of Streaming, and Ryan Nienhuis, Sr. Staff Product Manager at Databricks, this talk offers a comprehensive look at the most powerful streaming data platform available today.