Modeling Conceptual Understanding in Image Reference Games - CVPR 2020 Tutorial
Bolei Zhou via YouTube
Overview
Syllabus
Intro
Outline
Learning via Explanation
Attributes as Explanations
Natural Language as Explanations for Communication
Grounding Visual Explanations
Rational Quantitative Attribution of Beliefs, Desires and Percepts in Human Mentalizing
Machine Theory of Mind
M'RL: Mind-aware Multi-agent Management Reinforcement Learning
Image Reference Games with Failure in Concept Understanding
Perceptual Modules (PM)
Agent Embedding (AE)
Policy Learning: Different Policies Implemented Here
Comparing Learned Policies vs Baselines
Showing Necessity of Agent Embeddings
Evaluating Cluster Quality
Modeling Conceptual Understanding Qualitative Results
Conclusions
Taught by
Bolei Zhou