Explore change data capture (CDC) and its implementation using Debezium in this 51-minute Devoxx conference talk. Learn about CDC use cases, including updating caches, synchronizing microservices data, and maintaining CQRS read models. Discover how Debezium captures changes from MySQL, PostgreSQL, and MongoDB databases, and how to react to change events in near real-time. Understand Debezium's design for ensuring data correctness and completeness, even in failure scenarios. Dive into topics such as database logs, Apache Kafka integration, Kafka Connect, CDC message structure, initial snapshots, Debezium connectors, and message transformations. Get hands-on guidance for trying out Debezium yourself and gain insights into future developments in the field.
Overview
Syllabus
Intro
Change Data Capture
CDC Use Cases (3/3)
How to Capture Changes?
Database Logs
Using Apache Kafka as Basis
Kafka Connect
CDC Message Structure
Initial Snapshots
Debezium Connectors (2/2)
Operating a Connector
Message Transformations
Trying It Out Yourself
Outlook
Summary
Resources
Taught by
Devoxx
Related Courses
-
Streaming Database Changes with Debezium
-
Data Streaming for Microservices Using Debezium
-
Change Data Streaming for Spring Boot with Apache Kafka and Debezium
-
Realtime Change Data Capture Streaming - End-to-End Data Engineering Project
-
Debezium Snapshots Revisited - Incremental Snapshots for CDC Pipelines
-
Embracing Database Diversity with Kafka and Debezium
