Coursera Cuts Jobs Despite $100M Revenue Milestone

Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

DataCamp

Monitoring Machine Learning in Python

via DataCamp

Go to class Write review

Overview

This course covers everything you need to know to build a basic machine learning monitoring system in Python

Monitoring machine learning models ensures the long-term success of your machine learning projects. Monitoring can be very complex. However, there are Python packages to help us understand how our models are performing, what data has changed that might have led to a drop in performance, and give us clues on what we need to do to get our models back on track. This course covers everything you need to know to build a basic monitoring system in Python, using the popular monitor package, nannyml.

Syllabus

  • Data Preparation and Performance Estimation
    • In this chapter, you will be introduced to the NannyML library and its fundamental functions. Initially, you will learn the process of preparing raw data to create reference and analysis sets ready for production monitoring. As a practical example, you will investigate predicting the tip amount for taxi rides in New York. Toward the end of the chapter, you will also discover how to estimate the performance of the tip prediction model using NannyML.
  • Monitoring Performance and Business Value
    • In this chapter, you will be introduced to realized performance calculators used when ground truth becomes available. You will learn about the more advanced methods for handling results, including filtering, plotting, converting them to data frames, chunking, and establishing custom thresholds. Lastly, you'll apply this knowledge to calculate the business value of a model trained on the hotel booking dataset.
  • Root Cause Analysis and Issue Resolution
    • Having detected the performance degradation in the hotel booking model, you will now learn how to identify the underlying issue causing it. In this chapter, you will be introduced to multivariate and univariate drift detection methods. You will also learn how to identify data quality issues and how to address the underlying problems you detect.

Taught by

Hakim Elakhrass and Maciej Balawejder

Reviews

Start your review of Monitoring Machine Learning in Python

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.