What you'll learn:
- Azure Data Factory
- Microsoft Fabric Data Factory
- Azure Storage Accounts
- Azure SQL Databases and Upsert Operations
- Overview and Background of Azure Big Data Analytics Solutions
- Integrating Data From Various File Formats
- Authentication and Access: Service Principals, Managed Identities and Azure Key Vault
- Data Pipelines, Copy Activity, Data Flows, Control Flow and Transformation Activities
- Implementing a Modern Data Lake
- Control Flow, Parameters and Variables
- Real World Application of Azure Data Factory
- Azure DevOps Source Control with Data Factory
- Continuous Integration and Continuous Deployment (CI/CD)
I am pleased to present this course on one of the most in demand data engineering tools around... Azure Data Factory!
As the demand for cloud-based data integration services continues to skyrocket, there is a huge demand for professionals with knowledge of services like Azure Data Factory and Microsoft Fabric. By learning these applications, users can enhance their skills and increase their job prospects in the field of data engineering and analytics.
In this course you will primarily be using Azure Data Factory on Microsoft Azure and Microsoft Fabric in addition to other services such as Azure Blob Storage, Azure Data Lake Storage Gen 2 and Azure SQL Database.
The course is packed with lectures, code-along videos and a dedicated course project. As an added benefit you will also have lifetime access to all of the lectures…
This course will cover the following topics:
Azure Storage Solutions such as Azure Blob Storage and Azure Data Lake Gen2 Storage
The basics of Azure Data Factory including the core components such as Linked Services, Datasets, Activities, Data Flows, Pipelines and Integration Runtimes
Integrating data from various file formats such as CSV, JSON and Parquet
The Copy Activity in Azure Data Factory
Data Flows, Control Flow and Transformation Activities in Azure Data Factory
Orchestrating Data Integration Workflows
How to create Schedules and Triggers to execute your pipelines
How to use Parameters and Variables with your Linked Services, Datasets and Pipelines
How to use Azure Data Factory with SQL Databases
Authentication and Access including Managed Identities, Service Principals and Azure Key Vault
The Data Factory Experience in Microsoft Fabric
Azure DevOps Source Control
Continuous Integration and Continuous Deployment
