Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

CodeWithYu via YouTube Direct link

Creating Spark Master-worker architecture with Docker

2 of 11

2 of 11

Creating Spark Master-worker architecture with Docker

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 Creating Spark Master-worker architecture with Docker
  3. 3 Setting up the TCP IP Socket Source Stream
  4. 4 Setting up Apache Spark Stream
  5. 5 Setting up Kafka Cluster on confluent cloud
  6. 6 Getting Keys for Kafka cluster and Schema Registry
  7. 7 Realtime Sentiment Analysis with OpenAI LLM ChatGPT
  8. 8 Setting up Elasticsearch deployment on Elastic cloud
  9. 9 Realtime Data Indexing on Elasticsearch
  10. 10 Testing and Results
  11. 11 Outro

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.