Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Google via Google Cloud Skills Boost

Go to class Write review

Overview

In this lab you will learn and implement testing concepts for Cloud Dataflow.

Syllabus

Overview
Setup and requirements
Lab part 1. Performing unit tests for DoFns and PTransforms
Task 1. Explore the main pipeline code
Task 2. Add dependencies for testing
Task 3. Write first DoFn unit test in Apache Beam
Task 4. Run first DoFn unit test
Task 5. Run second DoFn unit test and debug pipeline
Task 6. Run PTransform unit test and test end-to-end pipeline
Lab part 2. Testing stream processing logic with TestStream
Task 1. Explore the main pipeline code
Task 2. Explore TestStream usage and run first test
Task 3. Create TestStream to test late data handling
Task 4. Run test for late data handling
End your lab

Tags

united states

Reviews

Start your review of Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)