Completed
Non-Determinism and Inaccuracy in LLMs
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Testing LLM-Powered Applications - Best Practices and Evaluation Methods
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction and Welcome
- 2 The Challenges of LLM-Powered Applications
- 3 Case Study: Microsoft's Tay Bot
- 4 The Risks of LLMs in Real-World Applications
- 5 Testing LLM-Powered Applications
- 6 Security Concerns and Prompt Injection
- 7 Non-Determinism and Inaccuracy in LLMs
- 8 Building a Robust Test System
- 9 Types of Testing for LLMs
- 10 Metrics for Evaluating LLMs
- 11 Adversarial Testing and Auto Evaluation
- 12 Open Source Tools for LLM Testing
- 13 Conclusion and Final Thoughts
