Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

vLLM on Kubernetes in Production - Deployment and Cost-Saving Strategies

Kubesimplify via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the fundamentals of vLLM, a fast and user-friendly library for LLM inference and serving, in this 28-minute video tutorial. Learn how to run vLLM locally and deploy it on Kubernetes in a production environment with GPU-attached nodes using a DaemonSet. Follow along with a hands-on demonstration that guides you through the process of implementing vLLM in a production setting. Gain insights from a real-world case study on cost-effective deployment of open-source AI technologies, as detailed in the accompanying blog post. Presented by John McBride, this Kubesimplify tutorial offers practical knowledge for efficiently leveraging vLLM on Kubernetes.

Syllabus

vLLM on Kubernetes in Production

Taught by

Kubesimplify

Reviews

Start your review of vLLM on Kubernetes in Production - Deployment and Cost-Saving Strategies

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.