Apache Kafka Essential Training: Building Scalable Applications

Introduction

• Building robust Kafka applications

1. Introduction to Kafka

• What is Kafka?
• Prerequisites for the course
• Kafka scaling and resiliency
• Setting up the exercise files

2. Kafka Scaling Concepts

• A Kafka cluster
• Kafka controllers
• Replication
• Partition leaders
• Security

3. Building a Kafka Cluster

• Kafka cluster setup
• Running the cluster
• Creating topics with replication
• Kafka clusters in action
• Kafka resiliency in action

4. Building Scalable Producers

• Producer internals
• Producer publishing options
• Acknowledgments in Kafka
• Additional producer parameters
• Java producer options example

5. Building Scalable Consumers

• How consumer works
• Batching message consumption
• Committing messages
• Java consumer example
• Multi-threaded consumers

6. Kafka Best Practices

• Managing partition counts
• Managing messages
• Managing consumer settings
• Managing resiliency

7. Use Case Project

• Kafka applications use case: Problem definition
• Setting up topics
• Producing data in Java
• Consuming data in Java

Conclusion

• How do you extend your Kafka learning journey?