Explore federated optimization and heterogeneity-aware algorithms in this 34-minute Google TechTalk presented by Gauri Joshi at the 2022 Workshop on Federated Learning and Analytics. Delve into the objectives and notation of federated optimization, focusing on the FedAvg algorithm. Examine various sources of heterogeneity in federated learning, including data, communication, and computational heterogeneity. Learn from Gauri Joshi, an associate professor at Carnegie Mellon University, recognized for her innovative work in distributed optimization and parallel computing, and recipient of numerous awards including MIT Technology Review's 35 Innovators under 35 and the NSF CAREER Award.
Heterogeneity-Aware Algorithms for Federated Optimization
Overview
Syllabus
Intro
Federated Optimization: Objectives and Notation
Federated Optimization: The FedAvg Algorithm
Sources of Heterogeneity in Federated Learning
Data Heterogeneity
Communication Heterogeneity
Computational Heterogeneity
Taught by
Google TechTalks
Related Courses
-
Distributed Optimization and Machine Learning
-
Online Optimization Meets Federated Learning - Tutorial
-
Federated Learning with Communication Constraints: Challenges and Recent Results
-
Privacy-Aware Compression for Federated Learning
-
The First Optimal Distributed SGD in the Presence of Data, Compute and Communication Heterogeneity
-
Hybrid Classical-Quantum Algorithms
