Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Author Interview - Memory-Assisted Prompt Editing to Improve GPT-3 After Deployment

Yannic Kilcher via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore an in-depth interview with authors Aman Madaan and Niket Tandon discussing their research on improving GPT-3 performance after deployment without model retraining. Learn about their innovative method of maintaining a memory of interactions to dynamically adapt new prompts, enabling non-intrusive fine-tuning and personalization. Discover insights on motivations, experimental results, cross-lingual customization, and potential applications in recommender systems. Gain valuable knowledge about interacting with large language models and the challenges faced during the project. Delve into discussions on model size implications, clarification prompts, and future directions for enhancing very large pre-trained language models.

Syllabus

- Intro
- Paper Overview
- What was your original motivation?
- There is an updated version of the paper!
- Have you studied this on real-world users?
- How does model size play into providing feedback?
- Can this be used for personalization?
- Discussing experimental results
- Can this be paired with recommender systems?
- What are obvious next steps to make the system more powerful?
- Clarifying the baseline methods
- Exploring cross-lingual customization
- Where did the idea for the clarification prompt come from?
- What did not work out during this project?
- What did you learn about interacting with large models?
- Final thoughts

Taught by

Yannic Kilcher

Reviews

Start your review of Author Interview - Memory-Assisted Prompt Editing to Improve GPT-3 After Deployment

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.