Data Engineering Courses and Certifications

Pragmatic AI Labs

Cloud Data Engineering

Master data engineering for cloud-native applications through distributed systems, big data, and serverless technologies.

• edX
• 4 weeks, 3-6 hours a week
• On-Demand
• Free Online Course (Audit)

Pragmatic AI Labs

Web Applications and Command-Line Tools for Data Engineering

Learn to build web apps, microservices, and command-line tools for efficient data engineering using Python, FastAPI, and Rust.

• edX
• 4 weeks, 3-6 hours a week
• On-Demand
• Free Online Course (Audit)

Open Data Science

How Companies Are Using Tachyon, a Memory Centric Distributed Storage

Explore Tachyon, a memory-centric distributed storage system for fast big data processing. Learn about its benefits, use cases, and integration with popular frameworks like Spark and Hadoop.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Open Data Science

Data Planning to Implementation

Explore the journey from data planning to implementation, covering data strategy, maturity, roadmaps, and best practices for turning insights into actionable solutions across businesses.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Open Data Science

Streaming Featurization with Ibis, Substrait and Apache Arrow

Explore real-time streaming data processing using Ibis, Substrait, and Apache Arrow. Learn how this software stack enhances featurization workflows for fast, accurate insights and decision-making in data science.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Microcredential

Become a Data Engineer: Mastering the Concepts

Build extensive data engineering and DevOps skills as you learn essential concepts. With this learning path, master the tools of the trade and how to apply them in real-world data project environments and platforms.

• LinkedIn Learning
• On-Demand
• Free Trial Available
• 9 courses

Open Data Science

Getting Into Data Engineering

Explore data engineering career paths, industry changes, and essential skills with Joe Reis. Gain insights on transitioning from software engineering or data analysis roles and receive valuable career advice.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Databricks

How to Build a Cloud Data Platform - Machine Learning and Business Intelligence - Part 4

Learn to leverage Delta Lake for dashboards and advanced analytics, enabling downstream teams with machine learning and business intelligence capabilities on a unified data platform.

• YouTube
• 1 hour 59 minutes
• On-Demand
• Free Video

Databricks

Modern ETL Pipelines with Change Data Capture - Building Resilient Data Streams

Discover how GetYourGuide built a resilient ETL pipeline using Debezium, Kafka, Spark, and Airflow. Learn to handle schema changes automatically, stream data from SQL databases, and refresh data lakes multiple times daily for fresher insights.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Databricks

Simplify and Scale Data Engineering Pipelines with Delta Lake

Learn to build scalable data engineering pipelines using Delta Lake's multi-hop architecture. Discover how to progress from raw data ingestion to machine learning-ready datasets efficiently and effectively.

• YouTube
• 38 minutes
• On-Demand
• Free Video

Databricks

Designing the Next Generation of Data Pipelines with Apache Spark - Zillow's Approach

Zillow's data engineering team shares their journey in redesigning data pipelines using Apache Spark, focusing on scalability, maintainability, and robustness while reducing code complexity.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Databricks

Building the Petcare Data Platform with Delta Lake and Spark ETL Pipeline

Explore Mars Petcare's data platform using Delta Lake and Spark ETL pipeline 'Kyte'. Learn about advantages over Azure Data Factory and leveraging Delta Lake for ETL configurations and data science.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Open Data Science

Beyond Monitoring - The Rise of Data Observability - Shane Murray

Explore data observability as a solution to data downtime, ensuring data trust at scale. Learn its importance in modern DataOps and gain insights for implementing a robust data quality strategy.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Data Science Dojo

What Is a Data Engineer?

Explore data engineering: goals, skills, tools, and its role in the data ecosystem. Learn how data engineers support data scientists and drive business success through effective data management.

• YouTube
• 50 minutes
• On-Demand
• Free Video

How to Avoid Overcomplicating Your Data Architecture

Explore strategies for simplifying data architectures, modernizing infrastructures, and leveraging real-time streaming for AI. Learn to navigate complexity and achieve faster results in data engineering.

• YouTube
• 50 minutes
• On-Demand
• Free Video