Abstract
Federated learning (FL) is a promising framework for learning fromdistributed data while maintaining privacy. The development of efficient FLalgorithms encounters various challenges, including heterogeneous data andsystems, limited communication capacities, and constrained local computationalresources. Recently developed FedADMM methods show great resilience to bothdata and system heterogeneity. However, they still suffer from performancedeterioration if the hyperparameters are not carefully tuned. To address thisissue, we propose an inexact and self-adaptive FedADMM algorithm, termedFedADMM-InSa. First, we design an inexactness criterion for the clients' localupdates to eliminate the need for empirically setting the local trainingaccuracy. This inexactness criterion can be assessed by each clientindependently based on its unique condition, thereby reducing the localcomputational cost and mitigating the undesirable straggle effect. Theconvergence of the resulting inexact ADMM is proved under the assumption ofstrongly convex loss functions. Additionally, we present a self-adaptive schemethat dynamically adjusts each client's penalty parameter, enhancing algorithmrobustness by mitigating the need for empirical penalty parameter choices foreach client. Extensive numerical experiments on both synthetic and real-worlddatasets are conducted. As validated by some numerical tests, our proposedalgorithm can reduce the clients' local computational load significantly andalso accelerate the learning process compared to the vanilla FedADMM.