Gain a comprehensive understanding of Apache Kafka in this detailed tutorial for beginners. Explore the core concepts of Kafka architecture, including topics, partitions, brokers, clusters, producers, consumers, and consumer groups. Learn how to scale Kafka architecture for improved throughput using topic partition keys and discover techniques for distributing topics across clusters. Dive into high availability strategies in cloud environments through the use of availability zones and rack awareness. Examine message ordering within topic partitions, delivery acknowledgements, transactions, and exact-once delivery. Perfect for architects and system designers looking to integrate Kafka into their own architectures or designs, this video covers everything from basic Kafka components to advanced scaling and fault tolerance techniques.
Overview
Syllabus
- intro
- apache kafka overview
- producers and consumers
- kafka brokers
- producers sending messages to brokers
- brokers and topics
- topic partitions
- kafka clusters
- apache zookeeper and kakfa clusters
- scaling zookeeper
- topic partitions and fault tolerance leaders and followers
- distributing topics across clusters
- achieving high availability using availability zones and rack awareness
- message ordering within topic partitions
- message delivery acknowledgements, transactions and exact once delivery
- consumers and consumer groups
Taught by
Chris Hay
