Completed
Introduction
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Smart City End-to-End Realtime Data Engineering Project - AWS Data Engineer
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 System Architecture
- 3 Project Setup
- 4 Docker containers setup and coding
- 5 IOT services producer
- 6 Vehicle information Generator
- 7 GPS Information Generator
- 8 Traffic information Generator
- 9 Weather information Generator
- 10 Emergency Incident Generator
- 11 Producing IOT Data to Kafka
- 12 AWS S3 setup with policies
- 13 AWS IAM Roles and Credentials Management
- 14 Apache Spark Realtime Streaming from Kafka
- 15 Fixing Schema Issues in Apache Spark Structured Streaming
- 16 AWS Glue Crawlers
- 17 Working with AWS Athena
- 18 Loading Data into Redshift from AWS Glue Data Catalog
- 19 Connecting and Querying Redshift DW with DBeaver
- 20 Connecting Redshift to AWS Glue Catalog
- 21 Fixing IAM Permission issues with Redshift
- 22 Outro
