Explore strategies and tools for migrating Apache Kafka clusters with minimal downtime in this informative podcast episode featuring Michael Dunn, a Solutions Architect at Confluent. Learn about the reasons for cluster migration, such as platform modernization and consolidation, and discover key tools like MirrorMaker, Confluent Replicator, and Cluster Linking. Gain insights on planning, gradual migration approaches, and handling consumer groups, Kafka Streams applications, connectors, and schemas. Understand the challenges, timeframes, and best practices for successful Kafka cluster migration to keep your system healthy and stable throughout the process.
Overview
Syllabus
- Intro
- Why would you migrate a Kafka cluster?
- Is it easy to migrate a Kafka cluster?
- MirrorMaker and MirrorMaker 2
- Confluent Replicator
- Cluster Linking
- Getting started with Kafka cluster migration
- Can you gradually migrate your Kafka cluster?
- Is there a recommended strategy for migrating your Kafka cluster?
- Do you have to migrate all your consumer groups at once?
- Migrating Kafka Streams applications
- Migrating connectors
- Migrating schemas
- How long does it take to do a Kafka cluster migration?
- What is the biggest challenge of Kafka cluster migration?
- It's a wrap!
Taught by
Confluent
Related Courses
-
Apache Kafka Series - Learn Apache Kafka for Beginners v3
-
How to Migrate from Apache Kafka to Confluent Cloud with Limited Downtime
-
Deploying Apache Kafka on DC/OS - Best Practices and Challenges
-
Robust Disaster Recovery with Kafka and Confluent Cloud - Data Streaming Systems
-
Apache Kafka Architecture - Kafka's Internal Components and How They Work
-
Improving Scalability and Performance with Kafka Leader Election
