Enabling Quartile-based Estimated-Mean Gradient Aggregation As Baseline for Federated Image Classifications

  • 2023-09-21 18:17:28
  • Yusen Wu, Jamie Deng, Hao Chen, Phuong Nguyen, Yelena Yesha
  • 0

Abstract

Federated Learning (FL) has revolutionized how we train deep neural networksby enabling decentralized collaboration while safeguarding sensitive data andimproving model performance. However, FL faces two crucial challenges: thediverse nature of data held by individual clients and the vulnerability of theFL system to security breaches. This paper introduces an innovative solutionnamed Estimated Mean Aggregation (EMA) that not only addresses these challengesbut also provides a fundamental reference point as a $\mathsf{baseline}$ foradvanced aggregation techniques in FL systems. EMA's significance lies in itsdual role: enhancing model security by effectively handling malicious outliersthrough trimmed means and uncovering data heterogeneity to ensure that trainedmodels are adaptable across various client datasets. Through a wealth ofexperiments, EMA consistently demonstrates high accuracy and area under thecurve (AUC) compared to alternative methods, establishing itself as a robustbaseline for evaluating the effectiveness and security of FL aggregationmethods. EMA's contributions thus offer a crucial step forward in advancing theefficiency, security, and versatility of decentralized deep learning in thecontext of FL.

 

Quick Read (beta)

loading the full paper ...