Search 6,000+ CA Community College Courses

Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

LinkedIn Learning

Azure Data Engineer Associate (DP-203) Cert Prep: 4 Monitor and Optimize Data Storage and Data Processing

via LinkedIn Learning

Go to class Write review

Overview

Learn about monitoring and optimizing data security and data processing on Azure and prepare to pass that domain of the Microsoft Azure Data Engineering (DP-203) exam.

Syllabus

Introduction
  • Course introduction
1. Monitor Data Storage and Data Processing
  • Implement logging used by Azure Monitor
  • Configure monitoring services
  • Measure performance of data movement
  • Monitor data system/pipeline/cluster performance
  • Measure query performance
  • Schedule and monitor pipeline tests
  • Interpret a Spark directed acyclic graph (DAG)
2. Optimize and Troubleshoot Data Storage and Data Processing
  • Rewrite user-defined functions (UDFs)
  • Handle skew in data and data spill
  • Tune shuffle partitions/pipelines
  • Optimize resource management
  • Tune queries by using indexers and cache
  • Troubleshoot a failed Spark job and pipeline run
Conclusion
  • Summary and next steps

Taught by

Noah Gift

Reviews

4.7 rating at LinkedIn Learning based on 23 ratings

Start your review of Azure Data Engineer Associate (DP-203) Cert Prep: 4 Monitor and Optimize Data Storage and Data Processing

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.