The Journey of Building a Leading Open Source LLM Security Toolkit
MLOps World: Machine Learning in Production via YouTube
Overview
Explore the development journey of LLM Guard, a leading open-source toolkit for securing Large Language Model applications, in this 32-minute conference talk by Oleksandr Yaremchuk, Principal Engineer of LLMs and Open-Source Initiatives at Protect AI. Discover the urgent need that led to the creation of LLM Guard in summer 2023, its advanced suite of 14 input and 20 output scanners, and the impressive success of its prompt injection detection model. Learn about the challenges faced, solutions discovered, and real-world implementation experiences. Gain insights into lessons learned and future opportunities for enhancing LLM security. Essential viewing for anyone seeking to deploy LLM applications to production with confidence.
Syllabus
The Journey of Building a Leading Open Source LLM Security Toolkit
Taught by
MLOps World: Machine Learning in Production