Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Pluralsight

Building Data Pipelines with Luigi and Python

via Pluralsight

Overview

Other developers implement data pipelines by putting together a bunch of hacky scripts, that over time turn into liabilities and maintenance nightmares. Take this course to implement sane and smart data pipelines with Luigi in Python.

Data arrives from various sources and needs further processing. It's very tempting to re-invent the wheel and write your own library to build data pipelines for batch processing. This results in data pipelines that are difficult to maintain. In this course, Building Data Pipelines with Luigi and Python, you’ll learn how to build data pipelines with Luigi and Python. First, you’ll explore how to build your first data pipelines with Luigi. Next, you’ll discover how to configure Luigi pipelines. Finally, you’ll learn how to run Luigi pipelines. When you’re finished with this course, you’ll have the Luigi skills and knowledge for building data pipelines that are easy to maintain.

Syllabus

  • Course Overview 1min
  • Getting Started with Luigi 25mins
  • Building Luigi Pipelines 26mins
  • Configuring Luigi Pipelines 17mins
  • Running Luigi Pipelines 23mins

Taught by

Dan Tofan

Reviews

4.8 rating at Pluralsight based on 20 ratings

Start your review of Building Data Pipelines with Luigi and Python

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.