Building Scalable and Reliable Data Pipelines Using Debezium and Kafka

Explore the process of building scalable and reliable data pipelines using Debezium and Kafka in this 15-minute conference talk from PlatformCon 2023. Dive into the world of data integration, learning how to bring together information from multiple sources to create comprehensive datasets for business intelligence and data analysis. Discover the power of Debezium, an open-source platform for change data capture (CDC), and Apache Kafka, a distributed messaging system that forms the backbone of modern data pipelines. Gain insights into setting up Debezium to capture database changes, integrating databases with Debezium and Kafka for real-time data streaming, and implementing best practices for designing and deploying efficient data pipelines. Whether you're a data engineer, developer, or architect, acquire valuable knowledge on handling large amounts of data while ensuring pipeline reliability and scalability.