Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

What Do Our Models Learn? - Aleksander Mądry

Institute for Advanced Study via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intricacies of machine learning models and their learning processes in this comprehensive lecture by Aleksander Mądry at the Institute for Advanced Study. Delve into the ML research pipeline, examining concerns such as classic and adaptive overfitting. Investigate the role of background bias in image classification, including studies on ImageNet-9 and adversarial backgrounds. Analyze the creation and validation of datasets, focusing on crowdsourced methods and the challenges of multi-object images. Evaluate the impact of dataset replication on model performance, using ImageNet-v2 as a case study. Gain insights into human-based evaluation techniques and the potential for statistical bias in machine learning research.

Syllabus

Intro
ML Research Pipeline
Concern #1: "Classic" Overfitting
Concern #2: Adaptive Overfitting
Simple Setting: Background bias
Do Backgrounds Contain Signal?
ImageNet-9: A Fine-Grained Study Xiao Engstrom Ilyas M 2020
Adversarial Backgrounds
Background-Robust Models?
Are Better Models Better?
Biases Can Be Subtle
How Are Datasets Created?
Dataset Creation in Practice
Crowdsourced Validation: A Closer Look
Prerequisite: Detailed Annotations
Restricting Relevant Labels
From Validation to Classification
Multi-Object Images
How Does This Affect Accuracy?
Which Object Do Models Predict?
Human-Based Evaluation
Dataset Replication
Case Study: ImageNet-v2
Replication Pipeline
Statistical Bias

Taught by

Institute for Advanced Study

Reviews

Start your review of What Do Our Models Learn? - Aleksander Mądry

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.