Bootstrapping Microservices Using Akka, Kafka, and Spark

Explore a comprehensive approach to bootstrapping and bounded context subscription in modern data platforms through this Scala Days conference talk. Dive into the integration of Kafka, Spark Streaming, and Akka to create a unified data transfer protocol that simplifies event processing for developers. Learn how to leverage Kafka as a source of truth, implement topic formats and retention rules, and utilize distributed commit logs for durable datasets. Discover the role of log compaction in service bootstrapping, and understand message delivery guarantees using Akka actors. Examine strategies for ingesting data at scale across different formats, teams, and latencies. Gain insights into real-time analysis and transfer protocol implementation using Spark Streaming and Akka, equipping you with the knowledge to build robust, scalable microservices architectures.