Data Lineage Courses and Certifications

Introduction to Data Quality

Explore the basics of data quality management. Learn the key concepts, dimensions, and techniques for monitoring and improving data quality.

• DataCamp
• 2 hours
• On-Demand
• Free Trial Available

USENIX

Lineage Quality Measurement for Privacy Engineering

Exploring a framework for measuring lineage performance in data systems, aiding product teams and privacy engineers in selecting effective approaches for privacy protection.

• YouTube
• 13 minutes
• On-Demand
• Free Video

Truly Open Lineage - Building Trust in AI Models Through Data Provenance

Explore open-source ecosystem for data lineage, combining Egeria, OpenLineage, and Marquez to enhance trust in AI models through transparent data origin and processing tracking.

• YouTube
• 32 minutes
• On-Demand
• Free Video

The ASF

OpenLineage: An Open Standard for Data Lineage

Explore OpenLineage, an open framework for data lineage metadata collection. Learn its purpose, data model, and integration with tools like Apache Airflow and Spark to enhance pipeline understanding and management.

• YouTube
• 40 minutes
• On-Demand
• Free Video

SK AI SUMMIT 2024

Data Lineage와 Ontology를 통한 데이터의 효과적인 관리와 활용

Discover how Accu.Dlion leverages Data Lineage and Ontology for efficient data management, tracking data flow and relationships in Snowflake DataLake environments for better decision-making.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Automate Data Pipelines

In this course, you'll build pipelines leveraging Airflow DAGs to organize your tasks along with AWS resources such as S3 and Redshift.

• Udacity
• 2 weeks, 4-5 hours a week
• On-Demand
• Paid Course

Exploring the Lineage of Data with Cloud Data Fusion

This is a self-paced lab that takes place in the Google Cloud console. This lab shows how to use Cloud Data Fusion to explore data lineage - the data's origins and its movement over time.

• Coursera
• 1 hour 30 minutes
• On-Demand
• Paid Course

Principles for Data Quality Measures

69 ratings at Pluralsight

This course will teach you the aspects to understand MLOps journey, end to end data quality checks and establish the mechanism of data cataloging, principles around metadata management and data governance.

• Pluralsight
• 44 minutes
• On-Demand
• Free Trial Available

Enable Unified Data Governance with Azure Purview - Azure Friday

Discover how Azure Purview simplifies data governance with automated discovery, classification, and lineage tracking. Learn to create a comprehensive map of your data landscape across multiple environments.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Databricks

Re-Imagining Apache Spark Development - Tools for Productivity and Standardization

Exploring next-gen tools for Apache Spark development, focusing on productivity, code standardization, metadata, lineage, and CI/CD agility to overcome limitations of traditional ETL tools.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Databricks

Diving into Delta Lake: Understanding the Transaction Log

Explore Delta Lake's transaction log: its structure, functionality, and role in ACID transactions, metadata handling, time travel, and concurrent operations. Gain insights into this core component.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Databricks

Data Discovery at Databricks with Amundsen - Improving Productivity and Trust

Explore how Databricks leverages Amundsen for efficient data discovery, improving productivity by surfacing relevant datasets, SQL dashboards, and metadata programmatically.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Databricks

Data Lakehouse Symposium - Evolution of Data Architecture

Explore data lakehouse architecture with industry experts, covering its evolution, comparison to data warehouses, and impact on business value. Gain insights into handling diverse data types and real-world applications.

• YouTube
• 2 hours 15 minutes
• On-Demand
• Free Video

Microsoft Purview Data Governance

Expand your knowledge of Microsoft Purview data governance. Learn about building data catalogs, data maps, and end-to-end lineage. Explore permission management, collections, and supported data sources.

• YouTube
• 1 hour 25 minutes
• On-Demand
• Free Video

Open Data Science

Scaling Data Preparation for Your Data-Centric AI Development

Explore scaling data preparation for AI development, covering DataOps, versioning, labeling, and automating workflows into robust pipelines for efficient ML operationalization.

• YouTube
• 26 minutes
• On-Demand
• Free Video