Chat With Your Data - A Practical Guide to Production RAG Apps

Discover practical insights for building production-ready Retrieval-Augmented Generation (RAG) applications in this 47-minute conference talk from Haystack US 2024. Learn from Jeff Capobianco's experience at Moody's, where they rapidly transformed a laptop prototype into a premium-subscription RAG product. Gain valuable lessons on setting up chunk embedding infrastructure, leveraging AI for response relevance measurement, balancing relevance with recency, managing costs, and organizing teams effectively. Explore strategies for developing RAG applications that deliver real business impact, including techniques to accelerate user workflows and synthesize responses to freeform questions without hallucination. Benefit from Jeff's background in data engineering and his role as Product Manager of Search for Moodys.com, as he shares insights on evolving semantic search platforms and enhancing site search experiences.