Data Engineering Courses and Certifications

CodeWithYu

Building Robust Data Pipelines for Modern Data Engineering - End-to-End Project

Develop robust data pipelines using Apache Spark, Azure Databricks, and DBT. Master end-to-end data engineering with Azure, covering ingestion, integration, and transformation in a modern data architecture.

• YouTube
• 1 hour 59 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Voting System - End-to-End Data Engineering Project

Build a real-time voting system using Apache Kafka, Spark, and Streamlit. Learn end-to-end data engineering, from voter accreditation to live result dashboards and winner determination.

• YouTube
• 2 hours 19 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Change Data Capture Streaming - End-to-End Data Engineering Project

Implement real-time Change Data Capture streaming using Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack. Create an efficient data pipeline for responsive data engineering projects.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

CodeWithYu

Reddit Data Pipeline Engineering with AWS - End-to-End Data Engineering

Build a comprehensive Reddit data pipeline using AWS services, integrating Airflow, S3, Glue, Athena, and Redshift for efficient ETL processes and analytics.

• YouTube
• 1 hour 35 minutes
• On-Demand
• Free Video

CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project

Extract, clean, and analyze football data using Apache Airflow, Azure services, and Tableau. Build a comprehensive data pipeline from Wikipedia to interactive visualizations.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

CodeWithYu

Google Cloud Real-Time Streaming - End-to-End Data Engineering Project

Build an end-to-end data engineering pipeline for real-time YouTube Analytics, using Python, Google Cloud, Docker, and Kafka. Learn to fetch, process, and stream data, with instant Telegram notifications.

• YouTube
• 1 hour 28 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Data Streaming - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using Apache Airflow, Kafka, Spark, and Cassandra. Learn end-to-end data engineering, from ingestion to processing and storage, all containerized with Docker.

• YouTube
• 1 hour 28 minutes
• On-Demand
• Free Video

Confluent

Building a Winning Data Engineering Culture

Learn to build a successful data engineering team and culture, empowering engineers and partners for efficient data systems and fruitful projects. Explore critical roles and strategies for data-driven decision-making success.

• YouTube
• 33 minutes
• On-Demand
• Free Video

SQLBits

Data Testing with HEDDA.IO

Enhance data quality with HEDDA.IO: Learn to integrate this versatile tool across Azure environments for accurate, reliable data testing in lake house and event-driven architectures.

• YouTube
• 52 minutes
• On-Demand
• Free Video

SQLBits

Behind the Hype - Architecture Trends in Data

Explore data architecture trends with a seasoned engineer, separating hype from strategic value in industry buzzwords and innovations.

• YouTube
• 54 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Stock Market Anomaly Detection Using Machine Learning - End-to-End Data Engineering Project

Develop an end-to-end data engineering project for real-time stock market anomaly detection using Quix Streams, Redpanda, and Docker. Learn to build a complete data pipeline and deploy an advanced ML model.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

CodeWithYu

Building Data Lakehouse from Scratch - End-to-End Data Engineering Project

Design, implement, and maintain scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Enhance data potential through advanced analytics and machine learning.

• YouTube
• 55 minutes
• On-Demand
• Free Video

CodeWithYu

Real Estate End-to-End Data Engineering Using AI

Build a real estate data engineering pipeline using AI, WebSocket, Docker, Kafka, Spark, and Cassandra. Learn to gather, process, and store property data in real-time with advanced tools and techniques.

• YouTube
• 2 hours 8 minutes
• On-Demand
• Free Video

CodeWithYu

Smart City End-to-End Realtime Data Engineering Project - AWS Data Engineer

Build a smart city real-time data pipeline using AWS, Apache tools, and Docker. Learn end-to-end data engineering from ingestion to visualization with PowerBI, covering IoT, streaming, and cloud technologies.

• YouTube
• 2 hours 27 minutes
• On-Demand
• Free Video

EuroPython Conference

From Pandas to Production: ELT with dlt

Explore data load tool (dlt) to streamline data science workflows, overcome roadblocks, and transition smoothly from exploration to production. Learn best practices for data handling and managing failures with real-life examples.

• YouTube
• 27 minutes
• On-Demand
• Free Video