Watch a 21-minute conference talk from OSA Con 2023 examining the limitations of the modern data stack and exploring how engineering-focused tools are poised to transform data engineering. Dive into why current data stack solutions, while initially beneficial, face scalability challenges in demanding organizations due to tool proliferation and lack of programmability. Learn how emerging engineering-centric tools like DuckDb, SDF, Iceberg, Dagster, Sling, and Polars are forming a new modern data engineering stack that addresses these limitations by prioritizing data platform and engineering needs. Discover insights from Nick Schrock on how these tools can help create more cohesive, manageable, and scalable data solutions for the future.
Overview
Syllabus
Where the Modern Data Stack has Failed and why Engineering-centric Tools will Reshape the Data World
Taught by
OSACon