Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Nearest Neighbors I

Simons Institute via YouTube

Overview

Explore the fundamentals of nearest neighbors algorithms in this comprehensive lecture from the Deep Learning Boot Camp at the Simons Institute. Delve into the metric space, universal consistency, convergence rates, and statistical learning frameworks as Kamalika Chaudhuri from UC San Diego guides you through key concepts. Examine nearest neighbor regression and classification, including the Bayes optimal classifier and consistency under continuity. Investigate bias-variance decomposition, effective interiors and boundaries, and smoothness conditions. Gain insights into the convergence rate theorem and its applications in machine learning and data analysis.

Syllabus

Intro
Talk Outline
k Nearest Neighbors
The Metric Space
Tutorial Outline
NN Regression Setting
Universality
More Formally...
Intuition: Universal Consistency
Convergence Rates
k-NN Distances
From Distances to Rates
Bias-Variance Decomposition
Bounding Bias and Variance
Integrating across the space
Nearest Neighbor Classification
The Statistical Learning Framework
The Bayes Optimal Classifier
Consistency of I-NN
Consistency under Continuity
Proof Intuition
Universal Consistency in Metric Spaces
Main Idea in Prior Analysis
A Motivating Example
Effective Interiors and Boundaries
Convergence Rate Theorem
A Better Smoothness Condition
Smoothness Bounds

Taught by

Simons Institute

Reviews

Start your review of Nearest Neighbors I

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.