Scalable Stream Processing - A Survey of Storm, Samza, Spark and Flink

Explore the world of stream processing systems in this comprehensive conference talk. Delve into the differences between batch-oriented and stream-oriented systems, understanding why stream processors are often better suited for real-world applications with continuous data flows. Compare popular stream processing frameworks including Storm, Trident, Samza, Flink, and Spark Streaming, examining their unique features, guarantees, and trade-offs. Learn about the Lambda and Kappa Architectures and how stream processing frameworks are typically employed in these contexts. Discover real-time machine learning use cases to illustrate the practical applications of these systems. Gain insights from Felix Gessert, CEO and co-founder of Baqend, as he shares his expertise in scalable database systems, cloud data management, and web technologies.