Designing Data Systems

Overview

In this course, students will learn about the major components in architecting an enterprise data system by actually designing a staging area, operational data store, and data warehouse. Students will learn the importance of creating business requirements and data artifacts that define the data in a "Single Version of Truth." From ingesting data into a staging database, moving the data to the operational data store where data is transformed, to ultimately accessing the data warehouse. Students will learn how the data warehouse helps eliminate data silos and bring data from across the enterprise into one central system, which can be governed and accessible by anyone in the enterprise to understand and analyze intelligent insights to address business challenges and opportunities.

Syllabus

Foundations of Designing Data Systems

In this lesson, we will take a 30000-foot view of Designing Data Systems. We will meet the instructor and hear about the components of the course, including the final project.

Data Architecture

In this lesson, we will look at the importance of, benefits of, and artifacts of Designing Data Systems using Data Architecture. We will also introduce Snowflake, the software we will be using.

Staging Data

In this lesson, we will take a look at the important step of Staging Data. We will look at the theory behind it, study the steps involved, and then actually do it in Snowflake.

Operational Data Store

In this lesson, we will look at what an ODS is and how it is an important step in building a data warehouse. We will also take a look at how to manage, cleanse, and transform the data.

Data Warehouse

In this lesson, we will take a look at the final step of building a data warehouse. We will also look at reporting, the primary reason for a data warehouse.

Project: Design a Data Warehouse for Reporting and OLAP

In a real data warehouse, students will use actual YELP and climate datasets in order to analyze the effects the weather has on customer reviews of restaurants.