Machine Learning with Apache Beam

Explore how Apache Beam, an open source tool for building distributed data pipelines, can be utilized for common machine learning tasks in this 36-minute conference talk presented by Danny McCormick from Google at Open Source 101 2023 in Charlotte. Learn about using Beam for inference, pre and post processing with pandas-like Dataframes, and certain forms of training. Gain a high-level understanding of Beam and discover how to easily parallelize ML workloads through multiple demo examples. Leave with practical knowledge on leveraging Apache Beam to enhance machine learning processes and improve distributed data pipeline efficiency.