vLLM Courses and Certifications

Neural Magic

Deploy LLMs More Efficiently with vLLM and Neural Magic

Explore vLLM's efficiency for LLM deployment and Neural Magic's enterprise solutions for cost-effective, scalable AI model services.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Kubesimplify

vLLM on Kubernetes in Production - Deployment and Cost-Saving Strategies

Deploy vLLM on Kubernetes for efficient LLM inference and serving. Learn basics, local setup, and production deployment with GPU-attached nodes via DaemonSet. Includes hands-on demo and cost-saving strategies.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Anyscale

Fast LLM Serving with vLLM and PagedAttention

Explore vLLM, an open-source library for fast LLM inference using PagedAttention. Learn how it achieves higher throughput and its implementation for efficient AI model serving.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Anyscale

Databricks' vLLM Optimization for Cost-Effective LLM Inference - Ray Summit 2024

Discover strategies for optimizing vLLM to enhance LLM inference performance, reduce GPU idle time, and accelerate quantization, leading to cost-effective large-scale language model deployment.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Anyscale

Optimizing vLLM for Intel CPUs and XPUs - Ray Summit 2024

Dive into Intel's optimization strategies for vLLM on CPUs and XPUs, exploring technical advancements, performance data, and collaborative efforts to enhance GenAI inference efficiency.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Anyscale

Roblox's Journey to Supporting Multimodality on vLLM - Ray Summit 2024

Explore Roblox's integration of multimodal language models into vLLM, uncovering technical challenges and insights for developers seeking to enhance their LLM deployments with advanced AI capabilities.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Anyscale

Achieving vLLM Platform Portability with Triton Autotuning - Ray Summit 2024

Discover IBM Research's innovative approach to vLLM platform portability using Triton autotuning, enhancing LLM serving with improved cross-platform performance and reduced dependencies.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Anyscale

The State of vLLM - Advancements in LLM Inference and Serving

Explore the latest advancements in vLLM, the open-source LLM inference engine. Gain insights into its growing adoption, new features, performance improvements, and future roadmap for efficient LLM deployment.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Anyscale

Handshake's Approach to Content Tagging with vLLM and Anyscale

Explore Handshake's journey in implementing vLLM-based content tagging using Anyscale, enhancing job feed performance and addressing growing LLM requirements through innovative internal tools and methodologies.

• YouTube
• 24 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

vLLM Inference and LLM Server Engine for Machine Learning

Discover how to leverage vLLM for efficient large language model inference and serving, including practical implementation techniques and deployment strategies.

• YouTube
• 46 minutes
• On-Demand
• Free Video

Anyscale

Optimizing vLLM Performance Through Quantization - Model Compression Techniques

Discover practical techniques for model quantization in vLLM deployments, exploring FP8, INT8, and INT4 methods to enhance performance and reduce memory usage while maintaining efficiency.

• YouTube
• 38 minutes
• On-Demand
• Free Video

Anyscale

The Evolution of Multi-GPU Inference in vLLM

Dive into advanced parallelism strategies for distributed LLM inference, exploring tensor, pipeline, and expert parallelism techniques through vLLM's architecture and optimization approaches.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Anyscale

Dynamic Scheduling for Large Language Model Serving

Discover how Llumnix optimizes large language model serving through dynamic request scheduling, cross-instance defragmentation, and innovative KV cache migration techniques for improved performance.

• YouTube
• 32 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

vLLM - Servidor Especializado en Inferencia de LLMs

Descubre cómo implementar y optimizar servidores de inferencia LLM con vLLM, una tecnología especializada para el procesamiento eficiente de modelos de lenguaje a gran escala.

• YouTube
• 43 minutes
• On-Demand
• Free Video

LLaMa for Developers

84 ratings at LinkedIn Learning

Get an introduction to the architecture, process of fine tuning, deploying, and prompting in the popular open source LLaMa model.

• LinkedIn Learning
• 1 hour 35 minutes
• On-Demand
• Free Trial Available