In this course, you’ll learn to build, orchestrate, automate and monitor data pipelines in Azure using Azure Data Factory and pipelines in Azure Synapse Analytics. You’ll build, trigger, and monitor data pipelines on the Azure platform for analytical workloads and run data transformations, optimize data flows, and work with data pipelines in production.
Overview
Syllabus
- Introduction to Data Pipelines
- Welcome to Data Pipelines with Azure! In this lesson, you'll learn more about the course, including the prerequisites and tools you'll be using.
- Azure Data Pipeline Components
- In this lesson, you'll learn about the components of data pipelines in Azure Data Factory and Synapse Analytics.
- Transforming Data in Azure Data Pipelines
- In this lesson, you'll learn about transforming data as it moves through activities in a pipeline.
- Azure Pipeline Data Quality
- In this lesson, you’ll learn about optimizing Azure Data Factory and Synapse Analytics Pipelines for data quality and integrity.
- Azure Data Pipelines in Production
- In this lesson, you'll learn about features of Azure Data Factory and Synapse Analytics pipelines that you’ll use in production.
- Data Integration Pipelines for NYC Payroll Data Analytics
- In this project, you'll build data pipelines for an analytics platform for the City of New York.
Taught by
Vishnu (Lucky) Pamula