Overview
Watch a 31-minute video demonstrating how to deploy Scala Spark jobs onto any Kubernetes environment using Helm and Spark Operator. Learn to make deployments more scalable with less need for custom configurations, resulting in boilerplate-free, highly flexible, and stress-free deployments. Explore alternatives, data-driven solutions, and the ecosystem surrounding Kubernetes. Follow along as the presenter creates a Kubernetes cluster, sets up a release entry, and performs a Helm deployment. Gain insights into streamlining your Spark job deployments on Kubernetes for improved efficiency and scalability.
Syllabus
Introduction
Alternatives
Not ready to deploy
Datadriven solutions
The ecosystem
Kubernetes
Kubernetes Cluster
Create Kubernetes Cluster
Release Entry
Spark Operator
Helm Deployment
Conclusion
Taught by
Databricks