Dive into the world of data contracts and their crucial role in ensuring high-quality datasets for AI systems in this 56-minute video presentation. Explore how these API-based agreements between data producers and consumers capture schema, semantics, distribution, and enforcement policies. Learn how data contracts provide a collaborative platform for data management, enable agile evolution of data models, and allow for incremental application of data governance in AI and ML systems. Discover the importance of data quality, the challenges of complex data, causes of low-quality data, and the implementation of data contracts. Gain insights into enforcement mechanisms, contract pipelines, and monitoring processes. Conclude with a Q&A session to deepen your understanding of leveraging data contracts for trustworthy and well-governed datasets in AI development.
The Gold Standard - Data Quality and Data Contracts in AI
Overview
Syllabus
– Intro
– Evangelist
– What happens if the data quality is low?
– Complex data
– Causes of low-quality data
– The data contract
– Enforcement mechanism
– Contract pipeline
– Monitoring
– QnA
Taught by
Data Science Dojo
