Statistical Learning Theory for Modern Machine Learning - John Shawe-Taylor
Institute for Advanced Study via YouTube
Overview
Syllabus
Intro
Learning is to be able to generalise
Statistical Learning Theory is about high confidence
Error distribution picture
Mathematical formalization
What to achieve from the sample?
Risk (aka error) measures
Before PAC Bayes
The PAC-Bayes framework
PAC Bayes aka Generalised Bayes
PAC Bayes bounds vs. Bayesian learning
A General PAC Bayesian Theorem
Proof of the general theorem
Linear classifiers
Form of the SVM bound
Slack variable conversion
Observations
Deep Network Training Experiments
Training and Generalisation Results
A flexible framework
Conclusions
Taught by
Institute for Advanced Study