Overview
Data engineering processes have undergone an amazing transformation since the advent of Generative AI. In this course, you will explore the impact of generative AI on data engineering. You as a data engineer can use Generative AI to enhance productivity by introducing innovative ways to deliver projects.
Data engineering is responsible for building strong data pipelines, managing data infrastructure, and ensuring high-quality data evaluation.
This course is suitable for existing and aspiring data engineers, data warehousing specialists, and other data professionals such as data analysts, data scientists and BI analysts.
You will learn how to use and apply generative models for tasks such as architecture design, database querying, data warehouse schema design, data augmentation, data pipelines, ETL workflows, data analysis and mining, data lakehouse, and data repositories. You will also explore challenges and ethical considerations associated with using Generative AI.
Demonstrate your new generative AI skills in a hands-on data engineering project that you can apply in your real-life profession.
Then, complete your final quiz to earn your certificate. You can share both your project and certificate with your current or prospective employers.
Syllabus
- Data Engineering and Generative AI
- In this module, you will acquire the necessary skills to use generative AI tools for data engineering effectively. You will learn some successful implementations of generative AI tools in databases, data warehousing schema design, data generation, augmentation, and anonymization. You will also learn how to use generative AI for infrastructure design.
- Use of Generative AI for Data Engineering
- This module will give you the skills and knowledge to effectively use generative AI to prepare data pipelines and ETL workflows. In addition, you will acquire skills in querying databases, data analysis, and data mining. You will also understand the importance of ethical practices in using generative models.
- Final Project and Exam
- In this module you will work on a real-world dataset and apply the skills acquired in this course to the test. You will use Generative AI to perform multiple Data Engineering operations in terms of planning, preparing and processing the data.
Taught by
Rav Ahuja and Abhishek Gagneja