Explore a 21-minute conference talk introducing Delight, a free and cross-platform monitoring dashboard for Apache Spark. Learn how this tool complements the Spark UI by displaying system metrics and Spark information on a unified timeline. Discover how Delight can be installed using an open-source Spark agent and works with any Spark platform. Follow along as the co-founders of Data Mechanics demonstrate real-world performance troubleshooting sessions, showcasing how Delight and Spark UI can jointly identify application bottlenecks. Gain insights into making data engineering pipelines more cost-effective and stable. The talk covers Delight's vision, its functionality, and future developments in Apache Spark monitoring.
Overview
Syllabus
Introduction
Delight Data Mechanics
Delight Vision
How Delight Works
Whats Next
Taught by
Databricks
Related Courses
-
Distributed Computing with Spark SQL
-
Machine Learning with Apache Spark
-
Scalable Machine Learning on Big Data using Apache Spark
-
Performance Troubleshooting Using Apache Spark Metrics - Databricks Talk
-
Getting Started with Apache Spark on Kubernetes
-
How to Automate Performance Tuning for Apache Spark
