Scaling Data and ML with Apache Spark and Feast - Feature Engineering for Production

Explore how Gojek, Indonesia's first billion-dollar startup, leverages big data and machine learning to power decision-making across its diverse product offerings in this 38-minute talk. Discover the challenges in feature engineering for large-scale ML systems and learn how Feast, an open-source feature store built on Apache Spark and MLflow, addresses these issues. Gain insights into the impact of democratizing feature creation, sharing, and management on time-to-market and innovation. Examine the machine learning lifecycle before and after implementing Feast, understanding its role in overcoming data scaling and feature serving challenges. Delve into practical aspects of using Feast, including creating entities, ingesting data, ensuring point-in-time correctness, and validating features. Conclude with a look at the value Feast unlocks for organizations and its future roadmap.