Heterogeneity-Aware Algorithms for Federated Learning and Distributed Optimization

Heterogeneity-Aware Algorithms for Federated Learning and Distributed Optimization

Centre for Networked Intelligence, IISc via YouTube Direct link

Local Adaptive Optimization

18 of 20

18 of 20

Local Adaptive Optimization

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Heterogeneity-Aware Algorithms for Federated Learning and Distributed Optimization

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Introduction
  2. 2 Stochastic Gradient Descent SGD
  3. 3 Application Next Word Prediction
  4. 4 Federated Learning
  5. 5 Local Objective Functions
  6. 6 Basic Algorithm
  7. 7 Sources of Heterogeneity
  8. 8 Why is this a problem
  9. 9 Quantifying Heterogeneity
  10. 10 Open Question 1
  11. 11 Open Question 2
  12. 12 Communication heterogeneity
  13. 13 Client selection
  14. 14 Example
  15. 15 Power of Choice Selection
  16. 16 Summary
  17. 17 Questions
  18. 18 Local Adaptive Optimization
  19. 19 Key takeaway
  20. 20 Other interesting directions

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.