Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Beyond Experimental - Spark on Kubernetes

CNCF [Cloud Native Computing Foundation] via YouTube

Overview

Explore the challenges and solutions of running Apache Spark on Kubernetes at scale in this insightful conference talk. Discover how to leverage open-source technologies like Apache YuniKorn, Spark K8s operator, and Cloud primitives to evolve ML data infrastructure in the cloud. Learn about considerations for multi-tenancy, observability, scalability, and cost-effectiveness when implementing Spark on Kubernetes for large-scale production environments. Gain valuable insights on overcoming roadblocks such as dev-ops complexity, multi-cluster management, job scheduling, and autoscaling to maximize data processing capabilities on the cloud.

Syllabus

Beyond Experimental: Spark on Kubernetes - Weiwei Yang, Apple

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Beyond Experimental - Spark on Kubernetes

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.