Explore change data capture (CDC) for microservices using Debezium in this 42-minute conference talk from Devoxx. Learn about CDC's role in synchronizing data between microservices, maintaining CQRS-style read models, updating caches and full-text indexes, and feeding operational data to analytics tools. Discover how Debezium, an open-source CDC solution based on Apache Kafka, captures changes from datastores like MySQL, PostgreSQL, and MongoDB. Understand near real-time event reactions and Debezium's design for data correctness and completeness. Watch a live demo on setting up a change data stream from an application's database without code changes, sinking change events into other databases, and pushing data changes to clients using WebSockets. Gain insights into CDC use cases, Kafka's role in CDC, message structures, and various patterns for microservice data synchronization, extraction, and quality assurance.
Overview
Syllabus
services Using
Change Data Capture What is it about?
CDC Use Cases
How to Capture Data Changes!
Apache Kafka Perfect Fit for CDC
CDC Topology with Kafka Connect
CDC Message Structure
Debezium Connectors
Pattern: Microservice Data Synchronization Microservice Architectures
Pattern: Microservice Extraction Migrating from Monoliths to Microservices
Pattern: Materialize Aggregate Views
Pattern: Ensuring Data Quality Detecting Missing or Wrong Data
Pattern: Leverage the Powers of SMTS Single Message Transformations
Debezium Current Status
Summary
Resources
Taught by
Devoxx
Related Courses
-
Streaming Database Changes with Debezium
-
Streaming Database Changes with Debezium
-
Change Data Streaming for Spring Boot with Apache Kafka and Debezium
-
Realtime Change Data Capture Streaming - End-to-End Data Engineering Project
-
Building Scalable and Reliable Data Pipelines Using Debezium and Kafka
-
Change Data Streaming Patterns with Debezium and Apache Flink
