Explore the application of foundation models to structured data tasks in this 13-minute conference talk from the LLMs in Prod Conference. Discover how these models can be utilized for data linkage, cleaning, and querying within the modern data stack. Learn about the challenges and solutions for production deployment, including model distillation, robust prompt engineering, and model customization with domain-specific data. Gain insights from Ines Chami, Chief Scientist and Co-Founder of Numbers Station, as she shares her expertise in building intelligent models to automate data-intensive work. Understand the potential of foundation models in revolutionizing data analytics, cleaning, and linkage processes.
Foundation Models in the Modern Data Stack - Part 2
Overview
Syllabus
Intro
What are foundation models?
The modern data analytics stock
Exemple application: Foundation Models for Data Analytics
Exemple application: Foundation Models for Data Cleaning
Exemple application: Foundation Models for Data Linkage
Solution: Model distillation
Prompt Brittleness
Caveat 2 Solution: Robust prompt engineering
Lack of domain-specific knowledge
Caveat 3 Solution: Model customization with domain specific data
Taught by
MLOps.community
