Explore the evolution of data architecture in this conference talk from NDC Oslo 2023. Delve into the complexities of data engineering and its growing importance in large-scale system architectures. Move beyond buzzwords to understand the fundamental reasons behind concepts like Data Warehouse, Data Lake, and Data Mesh. Learn how to approach the design of modern analytical data infrastructure, evolve existing systems, and gain insights into the future of data platforms. Discover key topics including microservices, real-time streaming, Lambda architecture, data management governance, and the emerging Data Mesh paradigm. Gain valuable knowledge to navigate the path towards optimal data architecture in today's rapidly changing technological landscape.
Overview
Syllabus
Introduction
Data Architecture
Evolution
System Architecture
Microservices
The Next Paradigm Shift
Data Lake
Data Loss
Data Latency
RealTime Streaming
Lambda Architecture
Optimize
Big enough
Modern view
Data without information
Data management governance
Data Mesh
The Future
Taught by
NDC Conferences
Related Courses
-
Fast Data Architectures for Streaming Applications
-
Data Mesh in Practice - How Europe’s Biggest Online Fashion Retailer Goes Beyond the Data Lake
-
Data Mesh and Microservices: Leveraging Trusted Data Events with GoldenGate
-
Data Mesh in Practice - From Data Lake to Distributed Architecture at Zalando
-
Understanding Big Data for Software Engineers
-
Big Data Architectures and The Data Lake - Cloud
