Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Hands-On Introduction: Data Engineering

via LinkedIn Learning

Go to class Write review

Overview

Discover and apply the fundamentals of data engineering in this hands-on, approachable, skills-based course.

Syllabus

Introduction

Hands-on data engineering
Background knowledge
The history of data in the enterprise
Using GitHub Codespaces with this course

1. Getting Your Bearings

Data engineering and data pipelines
Orchestration: In the modern sense
Extract, transform, load (ETL)
Tasks, DAGs, and dependencies

2. Airflow Introduction

Introduction to Airflow
Installing Airflow
Running the Airflow webserver and scheduler
Adjusting Airflow configuration settings
Build a 1 Task DAG
Build a 2 Task DAG

3. Basic ETL in Airflow

ETL in Airflow
A real-world data engineering task
Extracting data manually
Extracting data with Airflow
Transforming data manually
Transforming data with Airflow
Loading data manually
Loading data with Airflow
Building an ETL DAG with Airflow
Challenge: Review ETL questions
Solution: Solutions to ETL questions

Conclusion

The future of data engineering

Taught by

Vinoo Ganesh

Reviews

4.7 rating at LinkedIn Learning based on 429 ratings

Start your review of Hands-On Introduction: Data Engineering