Apache Kafka 3.5 - Core, Connect, Streams, and Client Updates

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Grab it

Explore the key updates and improvements in Apache Kafka 3.5 through this comprehensive 12-minute video. Dive into the latest enhancements for Kafka Core, Connect, Streams, and Client components. Learn about the new capability to preview migrations between ZooKeeper clusters to KRaft mode, and discover important updates such as rack-aware partition assignment for Kafka Consumers, SASL SCRAM support in KRaft, and improved error-handling capabilities in Kafka Streams. Gain insights into new features like versioned state stores, native offset management in Kafka Connect, and the use of environment variables for custom configurations. Understand how these updates streamline processes, enhance performance, and provide better monitoring capabilities for Apache Kafka deployments.

Syllabus

- Intro
- KIP-833: KRaft Timeline Update
- KIP-866: ZooKeeper to KRaft Cluster Migration
- KIP-881: Rack-aware Partition Assignment for Kafka Consumers
- KIP-900: SASL SCRAM Support in KRaft
- KIP-903: Replicas with stale broker epoch should not be allowed to join the ISR
- KIP-915: Transactions and Group Coordinator Downgrade Foundation
- KIP-641: A new java interface to replace `kafka.common.MessageReader`
- KIP-887: Add ConfigProvider to make use of environment variables
- KIP-889: Add Versioned State Stores
- KIP-914: DSL Processor Semantics for Versioned Stores
- KIP-399: Extend `ProductionExceptionHandler` to Cover Serialization Errors
- KIP-904: Improve Table Aggregation Semantics
- KIP-710: Full Support for Distributed Mode in MM2 Clusters
- KIP-875: First-class offsets support in Kafka Connect
- KIP-894: Use incrementalAlterConfigs API for syncing topic configurations
- KIP-911: Add source tag to MirrorSourceConnector metrics
- It’s a wrap!