Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Data Quality Tools Comparison for Continuous Data Imports

Databricks via YouTube

Overview

Explore open-source solutions for ensuring data quality in continuous import scenarios in this 28-minute presentation from Databricks. Compare popular options like Apache Griffin, Deequ, DDQ, and Great Expectations across dimensions such as maturity, documentation, extensibility, and features including data profiling and anomaly detection. Learn about various data quality approaches, tools, and frameworks, including ETL processes, quality checks, code generation, and advanced uniqueness checks. Gain insights into the limitations of Apache Griffin and discover how to implement timely data quality assurance in your organization's data pipeline.

Syllabus

Intro
Data Quality
ETL Process
Quality Checks
Data Quality Approaches
Data Quality Tools
Deku
Code Generation
Great Expectations
Pandas Profiling
Apache Griffin
Apache Griffin Limitations
Examples
Uniqueness checks
Advanced checks
Timely data
Other frameworks

Taught by

Databricks

Reviews

Start your review of Data Quality Tools Comparison for Continuous Data Imports

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.