Dive deep into Apache Kafka's architecture and practical usage in this comprehensive conference talk. Explore Kafka's unique approach to publish/subscribe messaging and its role as an event streaming platform. Master key concepts like topic partitioning, consumer groups, and exactly-once semantics. Discover best practices for leveraging APIs to achieve optimal performance and reliability. Delve into advanced topics such as stream processing with Kafka Streams and integration with other services using Kafka Connect. Learn from IBM Event Streams experts Katherine Stanley and Andrew Dunnings as they share their experiences running Kafka on Kubernetes and developing enterprise Kafka applications. Cover a wide range of topics including Kafka cluster setup, Zookeeper, producers, consumers, security, monitoring, debugging, and contributing to the Kafka project.
A Deep Dive into Apache Kafka - This is Event Streaming
Overview
Syllabus
Introduction
What is Kafka
Getting started with Kafka
Kafka Cluster
Zookeeper
Zookeeper History
Topics
Kafka Producer
Kafka Producer Properties
Kafka Producer Send
Kafka Library
Spring Boot Starter
Producers
Retention Period
Compaction
Partitions
Commitment
Middleground
Retry
Idempotency
Batch Records
Compression
Consumer
Consumer Groups
Consumer Offsets
Consumer Config
Why Consumer Groups
Committing offsets
Automatic Committing
Partition Scale
Synchronous
Kafka Monitoring
Kafka Metrics
Kafka Security
Kafka Internal SSL
Kafka Broker SSL
Kafka External SSL
Security
Authorization
Debugging
Logging
Kafka Log Forge
Debugging Commands
Consult Consumer
Check Consumer Groups
Check Producers
Minimum in sync replicas
Metrics
Exception
Ensure Leaders are Preferred
Preferred Leadership Election
Partition Distribution
Partition Consumers
Four Letter Words
Zookeeper ZebCase Honey
What if you want to contribute
And this is essentially when
pull request in Kafka
start again
Taught by
Devoxx
