Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

IoT Data Processing and Analysis on AWS - Real-Time and Ad-Hoc Approaches

ChariotSolutions via YouTube

Overview

Explore the intricacies of IoT data management on AWS in this 20-minute conference talk. Dive into two primary use cases for captured metric data: real-time analysis and ad-hoc analysis. Learn about robust streaming frameworks, with a focus on Apache Flink and a brief discussion of Apache Beam. Examine best practices for data persistence, comparing various serialization formats and their suitability for different analysis scenarios. Gain insights into fully managed solutions like AWS Data Lake, weighing their pros and cons. Cover topics such as data volumes, short-term vs. long-term storage, Avro and Parquet formats, Flink UI and API, and AWS Data Lake implementation.

Syllabus

Intro
Data volumes
Shortterm vs longterm
Why Avro
Why Parquet
Flink
UI
API
AWS Data Lake

Taught by

ChariotSolutions

Reviews

Start your review of IoT Data Processing and Analysis on AWS - Real-Time and Ad-Hoc Approaches

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.