Delta Live Tables: Modern Software Engineering for ETL Pipelines

Delta Live Tables: Modern Software Engineering for ETL Pipelines

Databricks via YouTube Direct link

Use Delta for infinite retention

17 of 18

17 of 18

Use Delta for infinite retention

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Delta Live Tables: Modern Software Engineering for ETL Pipelines

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Life as a data professional.
  3. 3 What is a Live Table?
  4. 4 Development vs Production
  5. 5 Declare LIVE Dependencies
  6. 6 Choosing pipeline boundaries
  7. 7 Pitfall: hard-code sources & destinations
  8. 8 Ensure correctness with Expectations
  9. 9 Expectations using the power of SQL
  10. 10 Using Python
  11. 11 Installing libraries with pip
  12. 12 Metaprogramming in python
  13. 13 Best Practice: Integrate using the event log
  14. 14 DLT Automates Failure Recovery
  15. 15 What is SparkTM Structured Streaming?
  16. 16 Using Spark Structured Streaming for ingestion
  17. 17 Use Delta for infinite retention
  18. 18 Partition recomputation

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.