Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Spark on Kubernetes: Building an Elastic Service - Apple's Approach

CNCF [Cloud Native Computing Foundation] via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the challenges and solutions of running Apache Spark on Kubernetes in this conference talk. Discover how to build a large-scale Spark Service on Kubernetes, focusing on autoscaling in multi-tenant environments. Learn about advanced features like physical isolation, capacity settings, bin-packing, and scale controls. Gain insights into significant CPU and memory utilization improvements for Spark on Kubernetes. Understand the elastic architecture, node group layouts, cluster autoscaling, and production status of this solution. Get key takeaways and future directions for optimizing Spark workloads in cloud-native environments.

Syllabus

Introduction
Bowen Li Apple
Outline
Why Cloud
Design Principles
Elastic Spark Architecture
Open Source
Node Groups Layout
Cluster Autoscaling
Production Status
Key takeaways
Whats next

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Spark on Kubernetes: Building an Elastic Service - Apple's Approach

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.