Overview
Explore a reference architecture integrating Spark 3 and VMware Pacific in this 33-minute conference talk. Learn how to simplify and boost Spark 3 deployments using hypervisor-native Kubernetes, offering scalable deployments, improved reliability, and predictable performance. Discover the benefits of combining these two significant IT platforms, including enterprise-grade Kubernetes support and efficient container scheduling. Gain insights into VMware Pacific's Kubernetes architecture, deployment techniques, and configuration for optimal Spark 3 performance. Watch demonstrations on setting up a hypervisor-native Kubernetes cluster, deploying Spark 3, and running machine learning tasks using Spark 3 ML libraries. Understand how this integration can enhance big data analytics platforms and improve cluster availability.
Syllabus
Introduction
What is this talk about
vSphere with Kubernetes
Kubernetes Platform
Demo
Spark on Kubernetes
Conclusion
Taught by
Databricks