Completed
Communication heterogeneity
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Heterogeneity-Aware Algorithms for Federated Learning and Distributed Optimization
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 Stochastic Gradient Descent SGD
- 3 Application Next Word Prediction
- 4 Federated Learning
- 5 Local Objective Functions
- 6 Basic Algorithm
- 7 Sources of Heterogeneity
- 8 Why is this a problem
- 9 Quantifying Heterogeneity
- 10 Open Question 1
- 11 Open Question 2
- 12 Communication heterogeneity
- 13 Client selection
- 14 Example
- 15 Power of Choice Selection
- 16 Summary
- 17 Questions
- 18 Local Adaptive Optimization
- 19 Key takeaway
- 20 Other interesting directions
