Dive into a comprehensive 5-hour tutorial series on Apache Spark, exploring its advantages over Hadoop MapReduce and its powerful distributed computing capabilities. Learn to set up your environment, understand Spark's architecture, and master key concepts such as DataFrames, SQL operations, and data sources. Explore various Spark components, including Spark SQL, JDBC connectors, and Cassandra integration. Gain hands-on experience with creating, packaging, and submitting Spark applications, and compare Scala and Python implementations. Discover the benefits of Delta Lake for Apache Spark, understanding its ACID properties and practical applications. By the end of this tutorial series, acquire the skills to efficiently process massive volumes of data using Apache Spark's cutting-edge framework.
Overview
Syllabus
Apache Spark Course | Spark Programming in Scala.
Apache Spark-01- Setup your environment.
Apache Spark - 02 - Introduction.
Google Cloud Tutorial - Hadoop | Spark Multinode Cluster | DataProc.
Apache Spark - 03 - Architecture - Part 1.
Apache Spark - 04 - Architecture - Part 2.
Spark Tutorial - Introduction to Dataframes.
Spark Tutorials - Spark Dataframe | Deep dive.
Spark Tutorial - SQL over dataframes.
Spark Tutorial - What's Next in Spark Batch Processing?.
Spark Tutorial - Data Sources | How to load data in Spark.
Spark Tutorial - JDBC Source and Sink.
Spark Tutorial - Cassandra Connector.
Spark Tutorial - Spark SQL | Database and Tables.
Spark Tutorial - Zeppelin | JDBC | Other Clients.
Spark Tutorials - Spark Data Types | Metadata | Functions.
Spark Tutorial - Create | Package | Submit Spark Applications.
Spark Tutorials - Spark Language Selection | Scala vs Python.
Spark Tutorial - Scala and Python UDF in Apache Spark.
Delta Lake for Apache Spark - Why do we need Delta Lake for Spark?.
Delta Lake for apache Spark | How does it work | How to use delta lake | Delta Lake for Spark ACID.
Taught by
Learning Journal
