Going Production Scale with Gen AI - Patterns for Your API

Explore architectural patterns and practices for building production-ready systems powered by large language models in this conference talk from NDC Sydney 2024. Dive into considerations for content filtering, learn strategies to prevent enterprise bots from leaking sensitive information, and discover how to leverage services like OpenAI ChatGPT and Azure OpenAI. Gain insights on creating secure, scalable, and monitored customer-facing systems driven by LLMs, addressing the challenges of implementing AI solutions at a production scale.