From Spark to Ray - Data Processing Revolution with Daft

Explore a 14-minute conference talk from Ray Summit 2024 where City Storage Systems (CSS) experts Ammar Alrashed, Santosh Jha, and Garret Weaver demonstrate their revolutionary shift from Spark to Daft, a DataFrame library built on Ray. Learn how CSS modernizes its machine learning infrastructure and ETL workflows by leveraging Daft's seamless integration with Ray. Discover practical implementations from CloudKitchens showcasing how Daft's user-friendly interface matches and surpasses PySpark's functionality while enabling unified operations across local and distributed environments. Gain valuable insights into optimizing data engineering and machine learning pipelines through the powerful combination of Ray and Daft, with applications relevant across data-intensive sectors.