When to Move from Batch to Streaming and How to Do It Without Hiring an Entirely New Team

Explore the transition from batch to real-time stream processing in this 33-minute conference talk by Zander Matheson, founder and CEO of Bytewax. Gain insights into the timing, reasons, and methods for shifting to stream processing without the need for a complete team overhaul. Examine arguments for and against stream processing, common architectures, potential pitfalls, and popular open-source tools. Learn from Matheson's experience in data infrastructure and data science at GitHub and Heroku as he demystifies the process of moving towards real-time data pipelines and applications. Discover valuable information for data professionals looking to enhance their understanding of streaming data and its implementation in modern data architectures.