Designing Resilient Data Pipelines

Designing Resilient Data Pipelines

USENIX via YouTube Direct link

Observability

4 of 15

4 of 15

Observability

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Designing Resilient Data Pipelines

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 What are we going to cover today?
  3. 3 Data Pipelines Crash Course
  4. 4 Observability
  5. 5 Metrics Collection
  6. 6 Pipeline Latency
  7. 7 Status Monitoring
  8. 8 Immutable Inputs
  9. 9 Benefits of Idempotency and immutability
  10. 10 Declarative Pipeline Example
  11. 11 Benefits of Pipelines as Code
  12. 12 Usable Data
  13. 13 Pros and cons of Data Validation
  14. 14 Adding Validators to Data Pipelines
  15. 15 Common Concerns

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.