Setting Up a Multi-Node Kafka Cluster for CI Testing

Learn how to efficiently set up and manage a multi-node Apache Kafka cluster for local development and CI/CD pipelines in this 28-minute technical talk. Discover techniques for creating a lightweight, fully functional Kafka deployment using open-source GitHub Actions, with demonstrations from Canonical's experts Rob Gibbon and Enrico Deusebio. Master programmatic deployment management, including simulating broker crashes and complex test scenarios for streaming applications. Gain practical insights into streamlining development workflows and implementing robust integration testing for Kafka-based applications, essential for modern enterprise streaming use-cases.