Hands-On Data Engineering in Google Cloud Platform | Python

• Extract and load data from local machine to Cloud Storage and Pub/Sub.
• Setup and use database such as Cloud SQL, BigQuery and Bigtable.
• Transform data using Google Cloud Functions, Dataflow and Dataproc.
• Implement real life end-to-end solutions by combining latest available tools in Google Cloud Platform.

You are going to learn about how we can create data engineering solutions in Google Cloud Platform (GCP) using different available tools, mainly using Python as our core programming language. We will start from basic introduction of what each component is mainly used for, then dive straight into demos with detailed explanation on the design choice and reasonings behind. I am confident that you will come out of the course with a better understanding on what each component could possibly do and drive data engineering solutions in your team!

There are the list of tech stacks that we will be covering

1. Integrating with GCP

   1. Google Cloud Platform Console, Cloud SDKand Client Libraries

2. Data Storage/ Messaging

   1. Google Cloud Storage, Google Pub/Sub

3. Databases

   1. Cloud SQL, BigQuery, Bigtable

4. Data Processing

   1. Cloud Functions, Cloud Dataflow, Cloud Dataproc

I have created a few specialised labs to integrate all the tools mentioned above instead of telling you what each component could do!It could help to accelerate your understanding so you can apply on your existing GCP workflow immediately. Detailed code and steps will also be shared in the video as well as self-written articles, so just sit back, relax and enjoy all the demos!

Let's get onboard on the cloud journey now!