In this course you will apply a variety of data warehouse engineering skills and techniques you have learned as part of the previous courses in the IBM Data Warehouse Engineer Professional Certificate. You will assume the role of a Junior Data Engineer who has recently joined the organization and be presented with a real-world use case that requires a data warehouse engineering solution.
Overview
Syllabus
- Data Platform Architecture and OLTP Database
- In this module, you will design a data platform that uses MySQL as an OLTP database. You will be using MySQL to store the OLTP data.
- Build a Data Warehouse
- In this module you will design and implement a data warehouse and you will then generate reports from the data in the data warehouse.
- Data Analytics
- In this module, you will assume the role of a data engineer at an e-commerce company. Your company has finished setting up a data warehouse. Now you are assigned the responsibility to design a reporting dashboard that reflects the key metrics of the business.
- ETL & Data Pipelines
- In this module, you will set up an ETL process using a Shell script to extract new transactional data for each day from the MySQL database and load it into the staging data warehouse in PostgreSQL. Later you will perform the transformation on the table in the staging warehouse to load the data in a dimension table and a fact table. You will then export these tables as CSV files to the production warehouse. You will set up a Cron Job to schedule these tasks.
- Final Submission and Peer Review
- In this final module, you will complete your submission of screenshots from the hands-on labs for your peers to review. Once you have completed your submission you will then review the submission of one of your peers and grade their submission.
Taught by
Rav Ahuja and Ramesh Sannareddy
