Overview
Learn how to optimize Apache Spark workloads in an Apache Mesos environment using Alluxio in this informative conference talk. Discover the challenges of processing data stored in various cloud and on-premise storage systems, and explore how Alluxio, an open-source memory speed virtual distributed storage system, can address these issues. Understand the architecture of Mesos, Spark, and Alluxio, and how their integration can create an optimal enterprise architecture. Gain insights into eliminating ETL pains, reducing data duplication, and enabling new workloads across all data sources. Explore the benefits of Alluxio's unified namespace and its ability to connect compute frameworks like Apache Spark to multiple storage systems while providing memory-speed data access.
Syllabus
Accelerating Spark Workloads in an Apache Mesos Environment with Alluxio
Taught by
Linux Foundation