Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CNCF [Cloud Native Computing Foundation]

A Full-Scenario Colocation of Workloads Based on Kubernetes

CNCF [Cloud Native Computing Foundation] via YouTube

Overview

Explore a comprehensive conference talk on maximizing resource utilization through workload colocation based on Kubernetes. Learn how to effectively combine online services and offline jobs to improve efficiency and reduce costs. Discover techniques for resource prediction, isolation, interference detection, and offline eviction that enable optimal resource usage without compromising online service SLOs. Gain insights into using eBPF for kernel-level metric collection to detect interference when latency metrics are unavailable. Examine the implementation of these techniques on native Kubernetes, supporting various scenarios including containerized and non-containerized services, as well as Kubernetes and Hadoop ecosystem jobs. Understand the real-world impact of this approach, as demonstrated by Tencent's deployment across 40,000+ machines, resulting in a 15% average increase in utilization and significant cost savings.

Syllabus

Intro
Why colocation
Make the colocation better
Colocation on K8s — Caelus
Principles on kubernetes
Full-scenario colocation
Resource prediction
Prediction algorithms
Cgroup hierarchy
Resource isolation
Interference detection
Resource load detection
RT detection
Function detection
Interference handling
Improve resource utilization
Run more offline jobs
Results

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of A Full-Scenario Colocation of Workloads Based on Kubernetes

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.