Explore the future of data processing in this 44-minute panel discussion featuring industry experts from Treeverse, dbt Labs, Decodable, and Snowflake. Dive into the debate between batch and stream processing, examining the challenges of adopting streaming architectures, the role of micro-batching, and the potential for streaming to replace batch processing entirely. Gain insights on best practices, obstacles to widespread adoption, and the factors holding teams back from fully embracing streaming models. Discover when to use streaming versus batch processing and contemplate the future of stream processing in data architecture.
Streaming vs. Batch Processing: The Future of Data Architecture
Overview
Syllabus
- Intro
- Is the Lambda Architecture here to stay?
- What is preventing streaming adoption today?
- Is streaming a semantic model?
- Should we push for stream processing?
- When should we use streaming vs. batch processing?
- What is the future of stream processing?
- It's a wrap!
Taught by
Confluent
Related Courses
-
Applying the Lambda Architecture with Spark, Kafka, and Cassandra
-
The Present and Future of Stream Processing - Trends and Innovations
-
Embrace the Anarchy - Apache Kafka’s Role in Modern Data Architectures
-
Building a Real-Time AI Data Platform with Apache Kafka
-
Demystifying Stream Processing with Apache Kafka
-
The Future of Streaming Data - Challenges and Opportunities
