Data Stream Processing - Concepts and Implementations

Explore data stream processing concepts and implementations in this 45-minute conference talk by Matthias Niehoff at Devoxx. Gain an overview of various techniques used in data stream processing, focusing on processing time versus event time. Discover the Dataflow API introduced by Google and learn about stream and table duality. Address challenges such as data lookup and deployment of streaming applications, along with strategies to overcome them. Examine the implementation status of these strategies in popular streaming frameworks like Apache Spark Streaming, Apache Flink, and Kafka Streams. Benefit from the expertise of Matthias Niehoff, an IT consultant at codecentric AG in Germany, who specializes in big data and streaming applications using tools such as Apache Cassandra and Apache Spark.