Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Federated Learning with Formal User-Level Differential Privacy Guarantees

TheIACR via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore federated learning with formal user-level differential privacy guarantees in this 59-minute invited talk from PPML 2022. Delve into topics such as non-convex learning, cross-device federated learning, differentially private stochastic gradient descent, and DP-Federated Averaging. Examine challenges in amplification by sampling, noise accumulation in prefix sums, and tree aggregation. Investigate DP-Follow-the-regularized leader (DP-FTRL) and its online learning properties. Analyze privacy-utility trade-offs using Stackoverflow as an example, and discover a production model with formal differential privacy. Gain insights into matrix factorization views of prefix sum estimation and DP prefix sum. Conclude with future directions and acknowledgements in this comprehensive exploration of privacy-preserving machine learning techniques.

Syllabus

Intro
(Non)-convex learning
Differential Privacy
Cross-device federated learning
Differentially private stochastic gradient descent DP
DP-SGD: Key insights
DP-Federated Averaging (DP-FedAvg)
Challenges for Amplification by Sampling in FL
Deconstructing the SGD model update
Noise Accumulation in Prefix Sums
Towards Tree Aggregation
Interlude: Follow-the-regularized-leader (FTRL)
DP-Follow-the-regularized leader (DP-FTRL)
DP-FTRL: Online learning properties
Privacy-Utility Trade-offs for Stackoverflow
Production model with formal DP
Matrix factorization view of prefix sum estimation
Matrix factorization view of DP prefix sum
Future directions
Acknowledgements

Taught by

TheIACR

Reviews

Start your review of Federated Learning with Formal User-Level Differential Privacy Guarantees

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.