From Information Theory to Learning via Statistical Physics - Introduction
International Centre for Theoretical Sciences via YouTube
Overview
Syllabus
US-India Advanced Studies Institute: Classical and Quantum Information
From information theory to learning via Statistical physics: Introduction: Statistical learning, Bayes rules, estimators, and statistical physics
Topics
Connecting physics and information theory
Example 1: "Classical statistics"
Prove
Solve the problem
Assume uniform prior
Prove
Fischer information
Example 2: High dimension statistics
Signal processing
Regression
Statistical physics problem
Back to abasing formulation
Claim
Statistical mechanics
3. Estimated and base optimality
Bayes risks
Discrete problem
Summary
Taught by
International Centre for Theoretical Sciences