Discover the basics of big data with a data science expert. Learn about how to perform core data engineering tasks including staging, profiling, cleansing, and migrating data.
Overview
Syllabus
Introduction
- Welcome
- What you should know before watching this course
- Using the exercise files
- Data science system overview
- Star schema design overview
- Where does data engineering fit?
- Components of a good data pipeline
- Environment setup
- Loading and profiling data
- Data quality testing
- Adding data types
- Handling missing values
- Verifying addresses
- Performing master data lookups
- Handling inferred members
- Loading the star schema
- Loading dimension tables
- Loading fact tables
- Creating views
- Next steps
Taught by
Ben Sullins
