Monitoring Large Language Models in Production - A Scalable and Privacy-Centric Approach

Monitoring Large Language Models in Production - A Scalable and Privacy-Centric Approach

AICamp via YouTube Direct link

How to solve those problems

5 of 11

5 of 11

How to solve those problems

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Monitoring Large Language Models in Production - A Scalable and Privacy-Centric Approach

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 What is ML monitoring & Al Observability?
  3. 3 Large Language Model (LLMs)
  4. 4 Common Pain Points with LLMs
  5. 5 How to solve those problems
  6. 6 Solving at Scale: Langkit (Open Source)
  7. 7 Extracted Language Metrics
  8. 8 Langkit is easy to use!
  9. 9 Custom Language Metrics
  10. 10 Options for monitoring data and ML models at production scale over time
  11. 11 Resources + Quick Demo (if time)

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.