Data Lineage Courses and Certifications

Introduction to Data Quality

Explore the basics of data quality management. Learn the key concepts, dimensions, and techniques for monitoring and improving data quality.

• DataCamp
• 2 hours
• On-Demand
• Free Trial Available

Truly Open Lineage - Building Trust in AI Models Through Data Provenance

Explore open-source ecosystem for data lineage, combining Egeria, OpenLineage, and Marquez to enhance trust in AI models through transparent data origin and processing tracking.

• YouTube
• 32 minutes
• On-Demand
• Free Online Course

USENIX

Lineage Quality Measurement for Privacy Engineering

Exploring a framework for measuring lineage performance in data systems, aiding product teams and privacy engineers in selecting effective approaches for privacy protection.

• YouTube
• 13 minutes
• On-Demand
• Free Online Course

Exploring the Lineage of Data with Cloud Data Fusion

This is a self-paced lab that takes place in the Google Cloud console. This lab shows how to use Cloud Data Fusion to explore data lineage - the data's origins and its movement over time.

• Coursera
• 1 hour 30 minutes
• On-Demand
• Paid Course

Principles for Data Quality Measures

69 ratings at Pluralsight

This course will teach you the aspects to understand MLOps journey, end to end data quality checks and establish the mechanism of data cataloging, principles around metadata management and data governance.

• Pluralsight
• 44 minutes
• On-Demand
• Free Trial Available

Databricks

Data Lakehouse Symposium - Evolution of Data Architecture

Explore data lakehouse architecture with industry experts, covering its evolution, comparison to data warehouses, and impact on business value. Gain insights into handling diverse data types and real-world applications.

• YouTube
• 2 hours 15 minutes
• On-Demand
• Free Online Course

Databricks

Data Discovery at Databricks with Amundsen - Improving Productivity and Trust

Explore how Databricks leverages Amundsen for efficient data discovery, improving productivity by surfacing relevant datasets, SQL dashboards, and metadata programmatically.

• YouTube
• 28 minutes
• On-Demand
• Free Online Course

Microsoft Purview Data Governance

Expand your knowledge of Microsoft Purview data governance. Learn about building data catalogs, data maps, and end-to-end lineage. Explore permission management, collections, and supported data sources.

• YouTube
• 1 hour 25 minutes
• On-Demand
• Free Online Course

Open Data Science

Scaling Data Preparation for Your Data-Centric AI Development

Explore scaling data preparation for AI development, covering DataOps, versioning, labeling, and automating workflows into robust pipelines for efficient ML operationalization.

• YouTube
• 26 minutes
• On-Demand
• Free Online Course

Enable Unified Data Governance with Azure Purview - Azure Friday

Discover how Azure Purview simplifies data governance with automated discovery, classification, and lineage tracking. Learn to create a comprehensive map of your data landscape across multiple environments.

• YouTube
• 25 minutes
• On-Demand
• Free Online Course

Databricks

Re-Imagining Apache Spark Development - Tools for Productivity and Standardization

Exploring next-gen tools for Apache Spark development, focusing on productivity, code standardization, metadata, lineage, and CI/CD agility to overcome limitations of traditional ETL tools.

• YouTube
• 25 minutes
• On-Demand
• Free Online Course

Databricks

Diving into Delta Lake: Understanding the Transaction Log

Explore Delta Lake's transaction log: its structure, functionality, and role in ACID transactions, metadata handling, time travel, and concurrent operations. Gain insights into this core component.

• YouTube
• 30 minutes
• On-Demand
• Free Online Course

CNCF [Cloud Native Computing Foundation]

MetaOps - Metadata Operations for End-to-End Data and Machine Learning Platforms

Explore metadata management challenges in large-scale ML systems, best practices, and solutions for lineage, auditability, and reproducibility in heterogeneous end-to-end platforms.

• YouTube
• 37 minutes
• On-Demand
• Free Online Course

PASS Data Community Summit

Unified Data Governance with Azure Purview

Explore Azure Purview's innovative approach to unified data governance, including automated discovery, lineage extraction, and centralized access control for cloud-scale data estates across various systems.

• YouTube
• 43 minutes
• On-Demand
• Conference Talk

PASS Data Community Summit

Building Modern Data Pipelines with Spark on Azure HDInsight

Explore common patterns for building end-to-end data analytics pipelines using Apache Spark on Azure HDInsight, covering architecture, integration points, and various pipeline options.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Conference Talk