Lessons Learned from the Migration to Apache Airflow

Lessons Learned from the Migration to Apache Airflow

Linux Foundation via YouTube Direct link

Why Airflow?

5 of 14

5 of 14

Why Airflow?

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Lessons Learned from the Migration to Apache Airflow

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Lessons learned from the migration to Apache Airflow
  3. 3 Agenda
  4. 4 Skimlinks: What we do
  5. 5 Why Airflow?
  6. 6 Data Architecture Overv
  7. 7 Airflow and Spark
  8. 8 DAG: Directed Acyclic Graph
  9. 9 Operator
  10. 10 Advanced Features
  11. 11 Sample code
  12. 12 Idempotent DAGS
  13. 13 Best practices: Docker and Kubernetes environments
  14. 14 Airflow: The Good, the Bad and the Ugly

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.