Generative AI and Large Language Models: From GPT-3 to ChatGPT with RLHF
Generative AI on AWS via YouTube
Overview
Learn about practical data science in AWS cloud through this 30-minute session that explores Amazon CodeWhisperer for Python code generation and recent innovations in natural language processing. Dive into generative AI models like GPT3, BLOOM, ChatGPT, and InstructGPT while understanding reinforcement learning for human feedback techniques. Principal AWS Solution Architect and O'Reilly author Chris Fregly demonstrates how to align NLP models with human intentions, covering topics from basic concepts to advanced implementations including prompt engineering, context handling, and model improvements. Through demonstrations and comprehensive explanations, gain insights into the evolution of AI models, their practical applications, and the role of human feedback in enhancing their performance.
Syllabus
Intro
Overview
History
Models
Chat GPT
Chat GPT Improvements
Human Feedback
Prompt Engineering
Context
Demo
Reinforcement Learning
Summary
Taught by
Generative AI on AWS