Introduction, Principles and Origin of Dagster

Explore the principles and origins of Dagster, a data orchestrator, in this 30-minute conference talk from the Data + AI Summit 2021. Discover how Dagster differentiates itself across the development, deployment, and monitoring stages of the data application lifecycle. Learn about building data-aware dependency graphs for local development and testing, deploying to multi-tenant cloud-native orchestration engines, and monitoring data assets. Through a demo and code snippets, gain insights into how the Dagit web UI and Dagster programming model empower data practitioners. Understand Dagster's unique features, including early error detection, structural testing, and enhanced observation capabilities. Presented by Nick Schrock, founder and CEO of Elementl and co-creator of GraphQL, this talk offers valuable knowledge for those interested in advanced data orchestration techniques.