Overview
Explore event-driven applications using Apache Kafka and Python in this informative PyCon US talk. Learn about the benefits of event-driven architecture and how Kafka, a data streaming platform, enables reliable real-time data integration. Discover the types of problems Kafka excels at solving and how to implement it in your applications using Python libraries. Gain insights into upgrading existing applications with Kafka, complete with code examples and a fun discussion on pizza toppings. Delve into Kafka Connect and its pre-built connectors for routing events between systems and integrating with other tools. Ideal for engineers and architects looking to enhance their applications' data capabilities, this talk covers topics such as Kafka events, writing to and reading from Kafka, topic partitions, scaling, consumer groups, and more. Access the accompanying notebook and slides for hands-on learning and further exploration.
Syllabus
Intro
Event-Driven Applications
Why Event-Driven?
What is Kafka?
Distributed
What is a Kafka Event?
Write to Kafka
Read from Kafka
Pizza Demo!
Log Size
Topic Partitions
Selecting a Partition
Ordering
Scaling Out
Partitions Demo!
Multiple Applications
Consumer Groups Demo!
Kafka Connect
Resources
Taught by
PyCon US