Building Data Pipelines with Apache Kafka and Confluent

Overview

Dive into the world of streaming data pipelines with Apache Kafka® and Confluent in this comprehensive tutorial. Learn essential techniques for building efficient data pipelines, including ingesting data from external systems using Kafka Connect with change data capture (CDC), transforming Kafka data in real-time using ksqlDB for stream processing, and writing data to external systems with Kafka Connect. Explore hands-on exercises covering data generation, MySQL integration, filtering and joining data streams, and streaming data to external systems. Gain valuable insights from Tim Berglund, Senior Director of Developer Experience at Confluent, as he guides you through the concepts and practical applications of streaming pipelines, enabling you to ensure more accurate data, react in real-time, and optimize resource management for large-scale data influxes.

Syllabus

Building Data Pipelines with Apache Kafka and Confluent Course Trailer | Confluent Developer.
Data Pipelines: Introduction to Streaming Data Pipelines.
Data Pipelines: Streaming Data Pipelines (Hands On).
Data Pipelines: Integrate Kafka with External Systems.
Data Pipelines: Create a Data Generator with Kafka Connect (Hands On).
Data Pipelines: Using CDC to Ingest Data into Kafka.
Data Pipelines: Ingest Data From MySQL Into Kafka with Kafka Connect (Hands On).
Data Pipelines: Filtering Streams of Data with ksqlDB.
Data Pipelines: Filtering Streams of Data with ksqlDB (Hands On).
Data Pipelines: Join Data Streams with ksqlDB.
Data Pipelines: Join Data Streams with ksqlDB (Hands On).
Data Pipelines: Streaming Data From Kafka to External Systems.
Data Pipelines: Streaming Data From Kafka to External Systems (Hands On).