Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Faster Model Serving with Ray and Anyscale - Ray Summit 2024

Anyscale via YouTube

Overview

Explore how Anyscale's platform extends Ray Serve to solve key challenges in serving large-scale AI models in this Ray Summit 2024 breakout session. Delve into the complexities of building AI applications in the era of large-scale generative AI, including the increased costs of initializing and running larger models and the need for specialized techniques like tensor or pipeline parallelism across multiple GPUs. Learn about Anyscale's Ray Serve as a solution that addresses production-readiness and developer productivity challenges associated with hosting ML models. Gain insights from Edward Oakes and Akshay Malik of Anyscale as they discuss the industry-leading ML platform for distributed model serving and deployment.

Syllabus

Faster Model Serving with Ray and Anyscale | Ray Summit 2024

Taught by

Anyscale

Reviews

Start your review of Faster Model Serving with Ray and Anyscale - Ray Summit 2024

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.