Explore strategies and tools for migrating Apache Kafka clusters with minimal downtime in this informative podcast episode featuring Michael Dunn, a Solutions Architect at Confluent. Learn about the reasons for cluster migration, such as platform modernization and consolidation, and discover key tools like MirrorMaker, Confluent Replicator, and Cluster Linking. Gain insights on planning, gradual migration approaches, and handling consumer groups, Kafka Streams applications, connectors, and schemas. Understand the challenges, timeframes, and best practices for successful Kafka cluster migration to keep your system healthy and stable throughout the process.
Overview
Syllabus
- Intro
- Why would you migrate a Kafka cluster?
- Is it easy to migrate a Kafka cluster?
- MirrorMaker and MirrorMaker 2
- Confluent Replicator
- Cluster Linking
- Getting started with Kafka cluster migration
- Can you gradually migrate your Kafka cluster?
- Is there a recommended strategy for migrating your Kafka cluster?
- Do you have to migrate all your consumer groups at once?
- Migrating Kafka Streams applications
- Migrating connectors
- Migrating schemas
- How long does it take to do a Kafka cluster migration?
- What is the biggest challenge of Kafka cluster migration?
- It's a wrap!
Taught by
Confluent
Related Courses
-
Apache Kafka Series - Learn Apache Kafka for Beginners v3
-
Deploying Apache Kafka on DC/OS - Best Practices and Challenges
-
Robust Disaster Recovery with Kafka and Confluent Cloud - Data Streaming Systems
-
Apache Kafka Architecture - Kafka's Internal Components and How They Work
-
Migrating Kafka Cluster from ZooKeeper to KRaft with Strimzi
-
Cloud Kafka Resiliency and Fault Tolerance for Data Streaming Systems
