Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

The Data Lakehouse - A Tech Talk for Everyone Who Loves Data

Devoxx via YouTube

Overview

Explore the technical aspects of Data Lakehouses in this 45-minute tech talk from Devoxx. Delve into the combination of data lakes and data warehouses, understanding how they deliver reliability, governance, and performance while maintaining openness, flexibility, and machine learning support. Examine open-source projects like Delta Lake that transform data lakes into lakehouses, introducing ACID transactions, schema enforcement, and time travel capabilities. Focus on streaming data applications, investigating open-source table formats, data ingestion, pipelines, quality, workflows, analysis, and machine learning. Gain insights into Project Lightspeed and its impact on Apache Spark Structured Streaming. Witness live code demonstrations, including a Twitter stream sentiment analysis using Hugging Face. Ideal for data architects, engineers, and practitioners interested in open-source solutions and cloud services, with demonstrations using the Databricks Lakehouse.

Syllabus

Intro
Favorite thing about Apache Spark
Structured streaming
The Data Lakehouse
How does it work
Does it perform
Streaming
Data pipelines
Data donation project
Streaming in Kafka

Taught by

Devoxx

Reviews

Start your review of The Data Lakehouse - A Tech Talk for Everyone Who Loves Data

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.