Dataproc Courses and Certifications

Building Batch Data Pipelines on Google Cloud

Developers responsible for designing pipelines and architectures for data processing.

• edX
• 1 week, 5-6 hours a week
• On-Demand
• Free Online Course (Audit)

Building Pipelines for Workflow Orchestration Using Google Composer

18 ratings at Pluralsight

Cloud Composer is a fully managed workflow orchestration service that allows creation, scheduling, and monitoring of pipelines. This course covers the architecture of Composer and creation of pipelines to run arbitrary shell scripts and Python code.

• Pluralsight
• 1 hour 59 minutes
• On-Demand
• Free Trial Available

Provisioning and Using a Managed Hadoop/Spark Cluster with Cloud Dataproc (Command Line)

This is a self-paced lab that takes place in the Google Cloud console. In this lab you will learn how to start a managed Spark/Hadoop cluster using Google Cloud Dataproc, submit a sample Spark job, and shut down your cluster using the command line.

• Coursera
• Finished
• Paid Course

Running a Spark Application with OpenCV on Cloud Dataproc

Learn to run Spark applications with OpenCV on Cloud Dataproc, leveraging open-source tools for efficient batch processing, querying, and machine learning in Google Cloud.

• Coursera
• Finished
• Paid Course

Google Cloud;  Google

Leveraging Unstructured Data with Cloud Dataproc on Google Cloud Platform

Learn to create and manage Hadoop clusters on Google Cloud, run analytics jobs, integrate with cloud storage, and leverage machine learning APIs for data analysis.

• Coursera
• 1 week, 5-7 hours a week
• Finished
• Paid Course

Leveraging Unstructured Data with Cloud Dataproc on Google Cloud Platform

You'll learn how to create and manage computing clusters to run Hadoop, Spark, Pig and/or Hive jobs on Google Cloud Platform.

• Pluralsight
• 2-3 hours
• Finished
• Free Trial Available

Learning Journal

Google Cloud Tutorials

Explore Google Cloud Platform essentials for Big Data Engineering, including free VM setup, VNC to Linux VM, and Hadoop/Spark cluster deployment with DataProc.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Building Batch Data Pipelines on Google Cloud

Data pipelines typically fall under one of the Extra-Load, Extract-Load-Transform or Extract-Transform-Load paradigms. This course describes which paradigm should be used and when for batch data.

• Pluralsight
• 2 hours 23 minutes
• On-Demand
• Free Trial Available

Building Batch Data Pipelines on Google Cloud

Learn to build efficient batch data pipelines on Google Cloud using BigQuery, Dataproc, Data Fusion, and Dataflow. Gain hands-on experience with EL, ELT, and ETL paradigms for data transformation and processing.

• Google Cloud Skills Boost
• 13 hours
• On-Demand
• Paid Course

Google Cloud Computing Foundations: Data, ML, and AI in Google Cloud

Explore big data, machine learning, and AI on Google Cloud. Learn to leverage managed services, build ML models, and use pre-built APIs for data analysis and intelligent applications.

• Google Cloud Skills Boost
• 8 hours
• On-Demand
• Paid Course

Elastic Google Cloud Infrastructure: Scaling and Automation

Explore Google Cloud's infrastructure services through hands-on labs, covering network interconnection, load balancing, autoscaling, automation, and managed services for efficient and scalable cloud solutions.

• Google Cloud Skills Boost
• 7 hours
• On-Demand
• Paid Course

Data Lake Modernization on Google Cloud: Migrate Workflows

Welcome to Migrate Workflows, where we discuss how to migrate Spark and Hadoop tasks and workflows to Google Cloud.

• Google Cloud Skills Boost
• 7 hours 15 minutes
• On-Demand
• Paid Course

Perform Foundational Data, ML, and AI Tasks in Google Cloud: Challenge Lab

This challenge lab tests your skills and knowledge from the labs in the Baseline Data, ML and AI, quest. You should be familiar with the content of the labs before attempting this lab.

• Google Cloud Skills Boost
• 1-2 hours
• On-Demand
• Paid Course

Bayes Classifier on Dataproc

Learn to implement a Bayes Classifier using Spark SQL on Google Cloud Dataproc, covering quantization, classification, and model evaluation techniques.

• Google Cloud Skills Boost
• 1-2 hours
• Finished
• Paid Course

Cloud Composer: Qwik Start - Console

In this lab, you create a Cloud Composer environment using the GCP Console. You then use the Airflow web interface to run a workflow that verifies a data file, creates and runs an Apache Hadoop wordcount job on a Dataproc cluster, and deletes the cluster.

• Google Cloud Skills Boost
• 1 hour
• On-Demand
• Paid Course