Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CNCF [Cloud Native Computing Foundation]

Is Sharing GPU to Multiple Containers Feasible?

CNCF [Cloud Native Computing Foundation] via YouTube

Overview

Explore the feasibility of sharing GPUs across multiple containers in this 27-minute conference talk from the Cloud Native Computing Foundation (CNCF). Dive into cost-effective strategies for maximizing GPU utilization in ML workloads, particularly for inference tasks. Learn how to provision and attach GPUs using Kubernetes device plugins, and discover techniques for extending the NVIDIA device plugin to schedule multiple ML workloads on a single GPU. Gain insights into collecting GPU information with Prometheus and understand the native GPU sharing capabilities in Kubernetes without relying on additional technologies like VMware's vGPUs.

Syllabus

Is Sharing GPU to Multiple Containers Feasible? - Samed Güner, SAP

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Is Sharing GPU to Multiple Containers Feasible?

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.