- Module 1: Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows (Gen2) for visually creating multi-step data ingestion and transformation using Power Query Online.
In this module, you'll learn how to:
- Describe Dataflow (Gen2) capabilities in Microsoft Fabric
- Create Dataflow (Gen2) solutions to ingest and transform data
- Include a Dataflow (Gen2) in a pipeline
- Module 2: Discover how to use Apache Spark and Python for data ingestion into a Microsoft Fabric lakehouse. Fabric notebooks provide a scalable and systematic solution.
By the end of this module, you’ll be able to:
- Ingest external data to Fabric lakehouses using Spark
- Configure external source authentication and optimization
- Load data into lakehouse as files or as Delta tables
- Module 3: Use Data Factory pipelines in Microsoft Fabric
In this module, you'll learn how to:
- Describe pipeline capabilities in Microsoft Fabric
- Use the Copy Data activity in a pipeline
- Create pipelines based on predefined templates
- Run and monitor pipelines
Overview
Syllabus
- Module 1: Module 1: Ingest Data with Dataflows Gen2 in Microsoft Fabric
- Introduction
- Understand Dataflows (Gen2) in Microsoft Fabric
- Explore Dataflows (Gen2) in Microsoft Fabric
- Integrate Dataflows (Gen2) and Pipelines in Microsoft Fabric
- Exercise - Create and use a Dataflow (Gen2) in Microsoft Fabric
- Knowledge check
- Summary
- Module 2: Module 2: Ingest data with Spark and Microsoft Fabric notebooks
- Introduction
- Connect to data with Spark
- Write data into a lakehouse
- Consider uses for ingested data
- Exercise - Ingest data with Spark and Microsoft Fabric notebooks
- Knowledge check
- Summary
- Module 3: Module 3: Use Data Factory pipelines in Microsoft Fabric
- Introduction
- Understand pipelines
- Use the Copy Data activity
- Use pipeline templates
- Run and monitor pipelines
- Exercise - Ingest data with a pipeline
- Knowledge check
- Summary