Mastering Data-Centric Engineering - 12 Principles for Success

Watch a 43-minute advanced technical talk from the Data Science Festival Oktoberfest 2024 where James Bowkett from OpenCredo presents essential principles for designing data-centric applications. Explore how to effectively handle increasing volumes of data through 12 fundamental principles across four key categories: Architecture & Design, Quality & Validation (Observability), Audit & Explainability, and Consumption. Drawing parallels with the 12-factor app methodology for cloud native applications, learn practical approaches to building testable, upgradeable, and efficiently deployable data platforms. Benefit from real-world examples and counter-examples gathered from extensive project experience, while discovering how to apply software engineering best practices to data-centric engineering. Gain insights into creating scalable, high-quality data applications that can be quickly moved into production, particularly valuable when dealing with petabyte-scale data operations.