CodeWithYu Courses

Building Robust Data Pipelines for Modern Data Engineering - End-to-End Project

Develop robust data pipelines using Apache Spark, Azure Databricks, and DBT. Master end-to-end data engineering with Azure, covering ingestion, integration, and transformation in a modern data architecture.

• YouTube
• 1 hour 59 minutes
• On-Demand
• Free Video

Realtime Voting System - End-to-End Data Engineering Project

Build a real-time voting system using Apache Kafka, Spark, and Streamlit. Learn end-to-end data engineering, from voter accreditation to live result dashboards and winner determination.

• YouTube
• 2 hours 19 minutes
• On-Demand
• Free Video

Realtime Streaming with Apache Flink - End-to-End Data Engineering Project

Build an end-to-end data engineering project using Apache Flink, Kafka, Elasticsearch, and Docker. Learn real-time data processing, create scalable pipelines, and develop streaming dashboards for sales analytics.

• YouTube
• 2 hours 26 minutes
• On-Demand
• Free Video

Realtime Change Data Capture Streaming - End-to-End Data Engineering Project

Implement real-time Change Data Capture streaming using Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack. Create an efficient data pipeline for responsive data engineering projects.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

Apache Flink for Sales Analytics - End-to-End Data Engineering Project

Develop an end-to-end sales analytics project using Apache Flink. Learn data ingestion, processing, complex transformations, and custom output formats for big data processing.

• YouTube
• 58 minutes
• On-Demand
• Free Video

Apache Spark Processing with AWS EMR - Data Engineering Project

Master AWS EMR for data processing: set up, submit Spark jobs, visualize on Hadoop UI, and leverage cloud computing for efficient big data handling.

• YouTube
• 39 minutes
• On-Demand
• Free Video

Creating and Submitting Java Spark Jobs to Spark Clusters

Create and submit Java Spark jobs to clusters. Learn end-to-end data engineering with Airflow, Docker, Spark, Scala, Python, and Java. Build and process jobs in multiple languages for live results.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Apache Airflow with Spark for Data Engineers - Full Course

Build end-to-end data engineering projects using Apache Airflow, Docker, Spark, and multiple programming languages. Learn to create and submit jobs to Spark clusters for processing and view real-time results.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video

Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using TCP/IP Socket, Apache Spark, OpenAI LLM, Kafka, and Elasticsearch. Process 7 million records for sentiment analysis and efficient data indexing.

• YouTube
• 1 hour 42 minutes
• On-Demand
• Free Video

Reddit Data Pipeline Engineering with AWS - End-to-End Data Engineering

Build a comprehensive Reddit data pipeline using AWS services, integrating Airflow, S3, Glue, Athena, and Redshift for efficient ETL processes and analytics.

• YouTube
• 1 hour 35 minutes
• On-Demand
• Free Video

End-to-End Modern Data Engineering with DBT and BigQuery

Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.

• YouTube
• 30 minutes
• On-Demand
• Free Video

End-to-End Data Engineering on Azure Spark Cluster: Japan Visa Analysis

Set up Spark master-worker architecture in Docker on Azure, process and visualize Japan visa data using PySpark and Plotly. Clean, transform, and gain insights into visa trends through interactive data analysis.

• YouTube
• 59 minutes
• On-Demand
• Free Video

Football Data Analytics with Tableau - Azure Data Engineering Project Part 3

Explore football data engineering: Extract Wikipedia data, store in Azure, migrate with Data Factory, query with Synapse, and visualize in Tableau. Master end-to-end data processes.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Football Data Analytics: Azure End-to-End Data Engineering Project - Part 2

Extract, store, and analyze football data using Azure services and Apache Airflow. Develop end-to-end data engineering skills through hands-on implementation of a real-world project.

• YouTube
• 1 hour
• On-Demand
• Free Video

Football Data Analytics: Azure End-to-End Data Engineering Project

Extract, clean, and analyze football data using Apache Airflow, Azure services, and Tableau. Build a comprehensive data pipeline from Wikipedia to interactive visualizations.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video