Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Learning to Act by Watching Unlabeled Online Videos - Paper Explained

Yannic Kilcher via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a comprehensive analysis of OpenAI's Video PreTraining (VPT) technique for tackling the complex challenge of creating an AI agent capable of playing Minecraft. Delve into the innovative approach of leveraging a small set of labeled contractor data to pseudo-label a vast corpus of scraped gameplay footage. Discover the model architecture, experimental results, and fine-tuning processes that led to the first Minecraft agent achieving the impressive feat of crafting a diamond pickaxe autonomously. Learn about the semi-supervised imitation learning method used to extend internet-scale pretraining to sequential decision domains, and understand how this behavioral prior demonstrates nontrivial zero-shot capabilities. Gain insights into the potential applications of this technology in robotics, video games, and computer use, as well as the hardware considerations for implementing such advanced AI systems.

Syllabus

- Intro
- How to spend money most effectively?
- Getting a large dataset with labels
- Model architecture
- Experimental results and fine-tuning
- Reinforcement Learning to the Diamond Pickaxe
- Final comments and hardware

Taught by

Yannic Kilcher

Reviews

Start your review of Learning to Act by Watching Unlabeled Online Videos - Paper Explained

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.