Dataproc Courses and Certifications

Learning Hadoop

100 ratings at LinkedIn Learning

Learn all the essentials of Hadoop, a key tool for processing and understanding big data.

• LinkedIn Learning
• 1 hour 53 minutes
• On-Demand
• Free Trial Available

Building Pipelines for Workflow Orchestration Using Google Composer

18 ratings at Pluralsight

Cloud Composer is a fully managed workflow orchestration service that allows creation, scheduling, and monitoring of pipelines. This course covers the architecture of Composer and creation of pipelines to run arbitrary shell scripts and Python code.

• Pluralsight
• 1 hour 59 minutes
• On-Demand
• Free Trial Available

Provisioning and Using a Managed Hadoop/Spark Cluster with Cloud Dataproc (Command Line)

This is a self-paced lab that takes place in the Google Cloud console. In this lab you will learn how to start a managed Spark/Hadoop cluster using Google Cloud Dataproc, submit a sample Spark job, and shut down your cluster using the command line.

• Coursera
• Finished
• Paid Course

Running a Spark Application with OpenCV on Cloud Dataproc

Learn to run Spark applications with OpenCV on Cloud Dataproc, leveraging open-source tools for efficient batch processing, querying, and machine learning in Google Cloud.

• Coursera
• Finished
• Paid Course

Learning Journal

Google Cloud Tutorials

Explore Google Cloud Platform essentials for Big Data Engineering, including free VM setup, VNC to Linux VM, and Hadoop/Spark cluster deployment with DataProc.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Building Batch Data Pipelines on Google Cloud

Data pipelines typically fall under one of the Extra-Load, Extract-Load-Transform or Extract-Transform-Load paradigms. This course describes which paradigm should be used and when for batch data.

• Pluralsight
• 2 hours 23 minutes
• On-Demand
• Free Trial Available

Building Batch Data Pipelines on Google Cloud

Learn to build efficient batch data pipelines on Google Cloud using BigQuery, Dataproc, Data Fusion, and Dataflow. Gain hands-on experience with EL, ELT, and ETL paradigms for data transformation and processing.

• Google Cloud Skills Boost
• 13 hours
• On-Demand
• Paid Course

Elastic Google Cloud Infrastructure: Scaling and Automation

Explore Google Cloud's infrastructure services through hands-on labs, covering network interconnection, load balancing, autoscaling, automation, and managed services for efficient and scalable cloud solutions.

• Google Cloud Skills Boost
• 7 hours
• On-Demand
• Paid Course

Google Cloud Computing Foundations: Data, ML, and AI in Google Cloud

Explore big data, machine learning, and AI on Google Cloud. Learn to leverage managed services, build ML models, and use pre-built APIs for data analysis and intelligent applications.

• Google Cloud Skills Boost
• 8 hours
• On-Demand
• Paid Course

Data Lake Modernization on Google Cloud: Migrate Workflows

Welcome to Migrate Workflows, where we discuss how to migrate Spark and Hadoop tasks and workflows to Google Cloud.

• Google Cloud Skills Boost
• 7 hours 15 minutes
• On-Demand
• Paid Course

Cloud Composer: Qwik Start - Console

In this lab, you create a Cloud Composer environment using the GCP Console. You then use the Airflow web interface to run a workflow that verifies a data file, creates and runs an Apache Hadoop wordcount job on a Dataproc cluster, and deletes the cluster.

• Google Cloud Skills Boost
• 1 hour
• On-Demand
• Paid Course

Bayes Classifier on Dataproc

Learn to implement a Bayes Classifier using Spark SQL on Google Cloud Dataproc, covering quantization, classification, and model evaluation techniques.

• Google Cloud Skills Boost
• 1-2 hours
• Finished
• Paid Course

Perform Foundational Data, ML, and AI Tasks in Google Cloud: Challenge Lab

This challenge lab tests your skills and knowledge from the labs in the Baseline Data, ML and AI, quest. You should be familiar with the content of the labs before attempting this lab.

• Google Cloud Skills Boost
• 1-2 hours
• On-Demand
• Paid Course

Building Batch Data Pipelines on Google Cloud

Data pipelines typically fall under one of the Extract and Load (EL), Extract, Load and Transform (ELT) or Extract, Transform and Load (ETL) paradigms.

• Pluralsight
• 2 hours 16 minutes
• On-Demand
• Free Trial Available

Google Cloud;  Google

Leveraging Unstructured Data with Cloud Dataproc on Google Cloud Platform

Learn to create and manage Hadoop clusters on Google Cloud, run analytics jobs, integrate with cloud storage, and leverage machine learning APIs for data analysis.

• Coursera
• 1 week, 5-7 hours a week
• Finished
• Paid Course