Monitoring Large Language Models in Production - A Scalable and Privacy-Centric Approach

Monitoring Large Language Models in Production - A Scalable and Privacy-Centric Approach

AICamp via YouTube Direct link

Options for monitoring data and ML models at production scale over time

10 of 11

10 of 11

Options for monitoring data and ML models at production scale over time

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Monitoring Large Language Models in Production - A Scalable and Privacy-Centric Approach

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 What is ML monitoring & Al Observability?
  3. 3 Large Language Model (LLMs)
  4. 4 Common Pain Points with LLMs
  5. 5 How to solve those problems
  6. 6 Solving at Scale: Langkit (Open Source)
  7. 7 Extracted Language Metrics
  8. 8 Langkit is easy to use!
  9. 9 Custom Language Metrics
  10. 10 Options for monitoring data and ML models at production scale over time
  11. 11 Resources + Quick Demo (if time)

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.