Azure Data Engineer Associate (DP-203) Cert Prep: 2 Design and Develop Data Processing

Introduction

• Design and develop data processing on Microsoft Azure
• Quick prerequisite technology overview

1. Ingest and Transform Data

• Transform data by using Apache Spark
• Cleanse data
• Common data transform tasks

2. Design and Develop a Batch Processing Solution

• Develop batch processing solutions
• Integrate Jupyter/Python notebooks

3. Design and Develop a Stream Processing Solution

• Develop a stream processing solution

4. Manage Batches and Pipelines

• Manage batches and pipelines

Conclusion

• Summary and next steps