Abstract
Distributed optimization is fundamental in large-scale machine learning andcontrol applications. Among existing methods, the Alternating Direction Methodof Multipliers (ADMM) has gained popularity due to its strong convergenceguarantees and suitability for decentralized computation. However, ADMM oftensuffers from slow convergence and sensitivity to hyperparameter choices. Inthis work, we show that distributed ADMM iterations can be naturallyrepresented within the message-passing framework of graph neural networks(GNNs). Building on this connection, we propose to learn adaptive step sizesand communication weights by a graph neural network that predicts thehyperparameters based on the iterates. By unrolling ADMM for a fixed number ofiterations, we train the network parameters end-to-end to minimize the finaliterates error for a given problem class, while preserving the algorithm'sconvergence properties. Numerical experiments demonstrate that our learnedvariant consistently improves convergence speed and solution quality comparedto standard ADMM. The code is available athttps://github.com/paulhausner/learning-distributed-admm.