A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes

A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes

CNCF [Cloud Native Computing Foundation] via YouTube Direct link

CHALLENGES WITH MIG PARTITIONING How do I create a MG Device in the first place?

10 of 12

10 of 12

CHALLENGES WITH MIG PARTITIONING How do I create a MG Device in the first place?

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 GPUS AND KUBERNETES Seamlessly scale up training and inference to a cluster of GPU machines
  3. 3 WHAT ARE MULTI-INSTANCE GPUs? Slices of a full GPU with dedicated memory and compute resources
  4. 4 OUTLINE
  5. 5 MULTI-INSTANCE GPUs (MIG)
  6. 6 GPUS AND CONTAINERS The NVIDIA Container Toolkit
  7. 7 GPUS AND KUBERNETES Allocate GPUs to pods in a Kubernetes Cluster
  8. 8 MIG IN CONTAINERS AND KUBERNETES
  9. 9 SYSTEM LEVEL INTERFACE FOR MIG
  10. 10 CHALLENGES WITH MIG PARTITIONING How do I create a MG Device in the first place?
  11. 11 MIG PARTITION EDITOR
  12. 12 SUMMARY AND CONCLUSION

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.