Data Productivity at Scale - Improving Data Pipeline Development with SQLMesh

Explore a 20-minute conference talk on improving data pipeline development and evolution. Learn about the challenges faced by data practitioners and discover how SQLMesh, an open-source project, addresses these issues. Gain insights into novel concepts like virtual data environments, automatic data contracts, and accurate change previews. Understand how these tools can enhance development efficiency, speed up iteration, and improve data reliability. Hear from Iaroslav Zeigerman, Co-Founder & Chief Architect at Tobiko Data, as he shares experiences from companies like Airbnb, Apple, Google, and Netflix. Dive into the world of data engineering and discover resources for further learning, including the Big Book of Data Engineering and the Data Team's Guide to the Databricks Lakehouse Platform.