Upskill as a data professional by learning how to build streaming pipelines using Snowflake, Kafka, and AWS.
Overview
Syllabus
Introduction
- Building streaming data pipelines
- What you should know
- Prerequisites
- Why AWS and Snowflake?
- Introduction to streaming ingestion pipelines
- Streaming data pipelines: A deeper dive
- Overview of streaming pipeline project
- Setting up your MSK cluster and EC2 instance
- Setting up your keys
- What is Snowpipe?
- Installing Snowpipe Kafka connector
- Set up config for provider-MSK connection and create topic
- Preparing your Snowflake environment
- Setting up your Snowpipe Kafka connect config
- Sending data to Snowflake
- Final considerations
- Course review and next steps
Taught by
Kumaran Ponnambalam