Transactions in Action: The Story of Exactly Once in Apache Kafka

Explore the evolution of transactions in Apache Kafka in this 40-minute talk from Confluent. Dive into the implementation of transactions through KIP-98, examining how the protocol has adapted to address edge cases and errors over time. Learn about the upcoming KIP-890 and its potential to resolve remaining gaps in the protocol. Gain a refresher on transactions and idempotency, and discover the chronology of various KIPs that have enhanced the protocol. Investigate the challenge of hanging transactions and understand how KIP-890 aims to solve this issue while strengthening the overall transactional protocol. Gain insights into Confluent's role in pioneering data infrastructure focused on data in motion and how it enables real-time, software-driven operations across organizations.