Kafka Migration at Scale - From Self-Hosting to Cloud

Learn how Helvetia successfully migrated thousands of Kafka topics and clients from self-hosted to cloud infrastructure in this conference talk from ElixirConf EU 2024. Discover the technical challenges faced during a year-long migration process and how the Elixir ecosystem provided effective solutions for handling billions of daily messages across hundreds of applications. Explore practical implementations of Elixir's key features including concurrent design patterns, data transformation scripts, directed dependency graphs, Excel reporting frameworks, macros, and EEx templating. Gain valuable insights into managing large-scale infrastructure transitions while maintaining uninterrupted service for enterprise-level message processing systems.