Data Utility Architecture - A Lakehouse Serving the Whole Enterprise

Explore a 36-minute conference talk that introduces the Data Utility Architecture (DUA), a revolutionary approach to enterprise data management. Learn how DUA, powered by Lakehouse and streaming technologies, unifies operational and analytical data planes, treating data as a commodity and pipelines as a utility serving the entire enterprise. Discover how this architecture breaks down traditional barriers, ingesting, transforming, and delivering data on demand for any purpose. Understand how DUA simplifies enterprise data architecture by handling all data uniformly while addressing specific consumer needs with appropriate Service Level Agreements (SLAs), models, and storage. Gain insights from PwC Canada's Tax DataOps team's production experience, exploring the use of tools like Spark Structured Streaming, Delta tables, and Delta Sharing. Delve into the evolution from Zhamak Dehghani's Data Mesh concept to this innovative approach that reimagines enterprise architecture as a utility.