Completed
System Architecture
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Building Robust Data Pipelines for Modern Data Engineering - End-to-End Project
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 System Architecture
- 3 Creating resource groups on Azure
- 4 Setting up the medallion architecture storage account
- 5 Setting up Azure Data Factory
- 6 Azure Key Vault setup for secrets
- 7 Azure database with automatic data population
- 8 Azure Data Factory pipeline orchestration
- 9 Setting up Databricks
- 10 Azure Databricks Secret Scope and Key Vault
- 11 Verifying Databricks - Key Vault - Secret Scope Integration
- 12 Azure Data Factory - Databricks Integration
- 13 DBT Setup
- 14 DBT Configuration with Azure Databricks
- 15 DBT Snapshots with Azure Databricks and ADLS Gen2
- 16 DBT Data Marts with Azure Databricks and ADLS Gen2
- 17 DBT Documentation
- 18 Outro
