Abstract
Despite the potential of federated learning in medical applications,inconsistent imaging quality across institutions-stemming from lower-qualitydata from a minority of clients-biases federated models toward more commonhigh-quality images. This raises significant fairness concerns. Existing fairfederated learning methods have demonstrated some effectiveness in solving thisproblem by aligning a single 0th- or 1st-order state of convergence (e.g.,training loss or sharpness). However, we argue in this work that fairness basedon such a single state is still not an adequate surrogate for fairness duringtesting, as these single metrics fail to fully capture the convergencecharacteristics, making them suboptimal for guiding fair learning. To addressthis limitation, we develop a generalized framework. Specifically, we proposeassessing convergence using multiple states, defined as sharpness or perturbedloss computed at varying search distances. Building on this comprehensiveassessment, we propose promoting fairness for these states across clients toachieve our ultimate fairness objective. This is accomplished through theproposed method, FedISM+. In FedISM+, the search distance evolves over time,progressively focusing on different states. We then incorporate two componentsin local training and global aggregation to ensure cross-client fairness foreach state. This gradually makes convergence equitable for all states, therebyimproving fairness during testing. Our empirical evaluations, performed on thewell-known RSNA ICH and ISIC 2019 datasets, demonstrate the superiority ofFedISM+ over existing state-of-the-art methods for fair federated learning. Thecode is available at https://github.com/wnn2000/FFL4MIA.