Learn the fundamentals of Apache Airflow in this comprehensive tutorial. Begin by installing and running Airflow using Docker and docker-compose. Explore core concepts and create your first Directed Acyclic Graph (DAG) using PythonOperator. Gain insights into task retries and learn how to pass metadata between tasks with XCOM. Discover the power of BranchPythonOperator for task branching and utilize sensors to detect files. Finally, master the use of hooks to connect to various file sources, equipping you with essential skills for efficient workflow management and automation.
Overview
Syllabus
[Getting started with Airflow - 1] Installing and running Airflow using docker and docker-compose.
[Getting started with Airflow - 2] Core concepts and creating your first DAG with PythonOperator.
[Getting started with Airflow - 3] Understanding task retries.
[Getting started with Airflow - 4] Passing metadata in between tasks with XCOM.
[Getting started with Airflow - 5] Using BranchPythonOperator to branch between tasks.
[Getting started with Airflow - 6] Using sensors to sense files.
[Getting started with Airflow - 7] Using hooks to connect to file sources.
Taught by
RocketMan
Related Courses
Related articles
Reviews
5.0 rating, based on 1 Class Central review
-
Ganesh DoppaniGood video it helped me to understand several unknown topics in airflow. Videos are clear. Trainer did a good job on briefing about the idea of airflow and many concepts in it along with sensors and hooks.
