Completed
Scheduling your spark job
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Auditing Your Data and Answering the Question - Is It the End of the Day Yet?
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Nielsen's Architecture (AT THE TIME)
- 3 Data Lake
- 4 Data Arrival Pain Points
- 5 Recovering from failures
- 6 Is it the end of the day yet? When do we process data?
- 7 Is it the end of day yet? Legacy answers to a legacy problem
- 8 Little Fires Everywhere
- 9 Auditing window? Let's design our metadata
- 10 Auditing Header Injection
- 11 Shipping Audit Window to Collection Point
- 12 Consuming Audit Data
- 13 In Context
- 14 Storing Data and Querying to Optimum
- 15 Designing Out Output Table
- 16 Shout out to my dad....
- 17 Optimizing PostgreSQL for Audit Queries
- 18 Managing Partitions with Apache Airflow
- 19 Offloading Data to History
- 20 Scheduling your spark job
- 21 It is not the end of the day
- 22 Alerts and add-ons
- 23 Alerting system
- 24 Detecting duplications
