Fine-tuning LLMs to Reduce Hallucination - Leveraging Out-of-Domain Data

Overview

Explore techniques for reducing hallucinations in large language models through fine-tuning in this hour-long webinar from Weights & Biases. Learn how to leverage out-of-domain data to improve MistralAI models' ability to detect factual inconsistencies. Follow along with a hands-on demonstration that covers creating initial prompts, setting up evaluation pipelines, and implementing a two-step fine-tuning process using the Factual Inconsistency Benchmark dataset and Wikipedia summaries. Discover how Weights & Biases Weave can automate model evaluation and see examples of innovative fine-tuning applications from hackathon winning projects. Gain insights into Mistral's latest models, fine-tuning services, and conversational AI tools to enhance natural language inference in production environments.

Syllabus

Webinar agenda and overview of Mistral AI
Fine-Tuning Services: Introduction to Mistral's fine-tuning API and services
Conversational AI Interface: Introduction to LAT, Mistral's conversational AI tool
Latest Model Releases: Newest Mistral models and their features
Fine-Tuning Process: Steps and benefits of fine-tuning models
Hackathon Winning Projects: Examples of innovative uses of fine-tuning
Hands-On Demo Introduction: Introduction to the practical demo segment
Setting Up the Demo: Instructions for setting up and running the demo notebook
Creating Initial Prompt: Steps to create and test an initial prompt
Evaluation Pipeline: Setting up and running an evaluation pipeline for model performance
Improving Model Performance: Strategies and techniques to enhance model accuracy
Fine-Tuning and Results: Creating and evaluating a fine-tuned model
Two-Step Fine-Tuning: Explanation and demonstration of the two-step fine-tuning process
Conclusion and final thoughts

Taught by

Weights & Biases

Reviews

Start your review of Fine-tuning LLMs to Reduce Hallucination - Leveraging Out-of-Domain Data

Taught by

Pretraining LLMs

Advanced Fine-Tuning Techniques for Long Context Summarization

OpenAI Fine-tuning vs Distillation - Techniques and Implementation

Fine-Tuning ChatGPT 3.5 with Synthetic Data from GPT-4 - Step-by-Step Guide

Fine-Tuning LLMs: Best Practices and When to Go Small - Lecture 124

Fine-tuning AI Models for Healthcare Policy Analysis with AWS and Snorkel Flow

Never Stop Learning.