Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the critical concept of partition sizing in Apache Kafka in this 47-minute conference talk from Strange Loop. Delve into the challenges practitioners face when determining the optimal number of partitions for a topic and understand how incorrect sizing can impact system aspects such as consistency, concurrency, durability, and overall load handling. Through a what-if presentation style, peel back the layers of the partition concept and examine the consequences of various sizing decisions on different system components. Learn about the potential for recovery from poor partition sizing choices and gain valuable insights into this fundamental aspect of Kafka architecture. Benefit from the expertise of Ricardo Ferreira, a Senior Developer Advocate at AWS with over 20 years of experience in distributed systems, messaging, and data analytics, as he breaks down complex topics into easily digestible information.