Kafka - One More Arsenal in a Distributed Toolbox

Explore the powerful combination of Spring and Kafka in this conference talk from Spring I/O 2018. Delve into the world of distributed commit logs and learn how Kafka addresses low latency, high throughput, scalability, fault-tolerance, and disk-based retention. Discover how to leverage Spring Kafka for building scalable event-stores and messaging platforms capable of storing billions of messages. Gain insights into essential and advanced Spring-Kafka concepts, including producers, consumers, transactions, and their Spring counterparts like KafkaMessageListenerContainer, Kafka template, and @KafkaListener annotations. Learn about Spring-Kafka-test for developing and running unit tests against embedded Kafka servers. Explore recent enhancements such as synchronizing Kafka transactions with other transactions, configuring generic MessageConverter beans, and detecting idle asynchronous consumers. Conclude with valuable tips on potential pitfalls to avoid when deploying Kafka in production environments.