PySpark Courses and Certifications

Apache PySpark by Example

1259 ratings at LinkedIn Learning

Get up and running with Apache Spark quickly. This practical hands-on course shows Python users how to work with Apache PySpark to leverage the power of Spark for data science.

• LinkedIn Learning
• 1 hour 58 minutes
• On-Demand
• Free Trial Available

Set Up PySpark for Data Analysis

23 ratings at Pluralsight

In this demo, you'll learn how to get data into PySpark.

• Pluralsight
• 10 minutes
• On-Demand
• Free Trial Available

Open Data Science

PySpark Best Practices

Learn best practices for PySpark, including dependency management, code structuring, testing, and performance optimization. Gain insights on writing efficient and scalable Python applications using Spark's distributed computing model.

• YouTube
• 46 minutes
• On-Demand
• Free Video

PySpark with Python

Learn PySpark for big data processing: DataFrame operations, handling missing values, filtering, aggregations, MLlib basics, and Databricks integration. Includes linear regression implementation.

• YouTube
• 2 hours 30 minutes
• On-Demand
• Free Video

Databricks

From Python to PySpark and Back Again - Unifying Single-Host and Distributed Deep Learning with Maggy

Unifying single-host and distributed deep learning with Maggy framework, enabling seamless transition from laptop to cluster for efficient model development and training using TensorFlow and PySpark.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Databricks

PySpark in Apache Spark 3.3 and Beyond

Explore PySpark's evolution in Apache Spark 3.3, including improved Pandas API, enhanced productivity features, and future developments. Learn about new functionalities, usability improvements, and performance enhancements.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Databricks

Architecting for Data Quality in the Lakehouse with Delta Lake and PySpark

Learn techniques for ensuring data quality in lakehouses using Delta Lake and PySpark. Explore data observability, reliability lifecycle, and practical implementation of quality checks across metadata, storage, and query layers.

• YouTube
• 1 hour 1 minute
• On-Demand
• Free Video

CodeWithYu

End-to-End Data Engineering on Azure Spark Cluster: Japan Visa Analysis

Set up Spark master-worker architecture in Docker on Azure, process and visualize Japan visa data using PySpark and Plotly. Clean, transform, and gain insights into visa trends through interactive data analysis.

• YouTube
• 59 minutes
• On-Demand
• Free Video

NashKnolX

Introduction to PySpark

Learn the fundamentals of PySpark for efficient big data processing and analytics using Python in Apache Spark's distributed computing environment.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Databricks

Best Practices for Unit Testing PySpark

Learn effective techniques for unit testing PySpark code, including local and CI testing, code structuring for testability, and integration testing with clusters for enhanced reliability and easier refactoring.

• YouTube
• 19 minutes
• On-Demand
• Free Video

Databricks

Exploring UDTFs and Polymorphism in PySpark

Learn to create and enhance User-Defined Table Functions in PySpark, including polymorphic UDTFs for flexible data processing. Gain practical insights through examples and expert guidance.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Databricks

Rapid PySpark Custom Processing on Time Series Big Data in Databricks

Efficient PySpark processing for time series big data, enabling rapid custom calculations on rolling windows with constant time complexity, demonstrated using Sleep Number Smartbed sensor data.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Machine Learning with PySpark: Customer Churn Analysis

Learn to predict customer churn using PySpark. Covers data analysis, preprocessing, model training, and deployment. Gain practical skills in machine learning for telecommunications industry insights.

• Coursera
• 2 hours 33 minutes
• On-Demand
• Paid Course

Graduate Admission Prediction with Pyspark ML

31 ratings at Coursera

Learn to build a linear regression model with PySpark ML to predict graduate admission chances using Kaggle data. Gain hands-on experience with PySpark on Google Colab for data preparation and analysis.

• Coursera
• 1 hour 55 minutes
• On-Demand
• Paid Course

Diabetes Prediction With Pyspark MLLIB

21 ratings at Coursera

Build a logistic regression model using PySpark MLlib to classify patients as diabetic or non-diabetic, utilizing the Pima Indian Diabetes dataset on Google Colab.

• Coursera
• 1 hour 55 minutes
• On-Demand
• Paid Course