Search and Retrieval - AI's Most Successful Hack

Explore the intersection of AI and search systems in this 30-minute conference talk from Haystack US 2024. Dive deep into how search and information retrieval systems have long utilized AI and Machine Learning, and how this relationship is now being reversed with the advent of Generative AI. Examine the concept of Retrieval Augmented Generation (RAG) and its similarity to recommender systems for large language models. Learn about core concepts in building recommender systems, including retrieval, filtering, and ranking. Delve into Hybrid Search as a retrieval technique in RAG systems, and understand how combining it with metadata filtering and re-ranking algorithms creates a scalable recommender system for LLMs. Gain insights from Apoorva Joshi, a Data Scientist turned Developer Advocate with extensive experience in applying Machine Learning to Cybersecurity problems, now helping developers build AI applications at MongoDB.