Apache Kafka Architecture - Kafka's Internal Components and How They Work

Overview

Dive deep into the internal architecture of Apache Kafka in this advanced 2.5-hour course led by Kafka experts Jun Rao and Danica Fine. Gain a comprehensive understanding of Kafka's core components, including topics, partitions, producers, consumers, brokers, and replication. Explore the evolution from ZooKeeper to KRaft, and learn about advanced features like Tiered Storage, cluster elasticity, and geo-replication. Participate in hands-on exercises to master Kafka transactions, ensuring atomicity in client failure scenarios. Discover how to configure durability, availability, and ordering guarantees, and understand the compact retention option for key-based topic data. By the end of this course, acquire the knowledge to effectively leverage Kafka's distributed event streaming capabilities for real-time, scalable applications.

Syllabus

Apache Kafka Architecture Course Trailer | Confluent Developer.
Apache Kafka Architecture: Overview of Kafka's Internal Components.
Apache Kafka Producer Client (Hands On).
Apache Kafka Brokers: Introduction to the Data Plane.
Data Plane – Apache Kafka's Replication Protocol.
The Apache Kafka Control Plane – ZooKeeper vs. KRaft.
Apache Kafka Consumers and Consumer Group Protocol.
Apache Kafka Consumers and Consumer Group Protocol (Hands On).
Configuring Apache Kafka Durability, Availability, and Ordering Guarantees.
Apache Kafka Transactions: Message Delivery and Exactly-Once Semantics.
Apache Kafka Transactions: Message Delivery and Processing (Hands On).
Apache Kafka Topic Compaction.
What Is Tiered Storage?.
Apache Kafka Cluster Scaling and Automation.
Geo-Replication with Apache Kafka and Confluent.
Cluster Linking (Hands On).