The Ray Dataplane: History and the Cloudsort World Record

Explore the evolution and capabilities of the Ray dataplane in this 28-minute talk from Anyscale. Gain insights into the dataplane's journey from a zero-copy object store to its current role in the Ray Data library. Discover how the Ray dataplane was instrumental in breaking the Cloudsort world record, achieving a remarkable cost reduction for sorting 100TB of data on the cloud to less than 1 dollar/TB. Learn about the design principles and technological advancements that have made Ray a powerful framework for scaling and productionizing AI workloads, including Generative AI, LLMs, and computer vision applications. Understand how Ray is revolutionizing distributed systems and empowering developers to tackle ambitious AI projects efficiently.