Abstract
We propose a novel Decentralized Differentially Private Power Method(D-DP-PM) for performing Principal Component Analysis (PCA) in networkedmulti-agent settings. Unlike conventional decentralized PCA approaches whereeach agent accesses the full n-dimensional sample space, we address thechallenging scenario where each agent observes only a subset of dimensionsthrough row-wise data partitioning. Our method ensures$(\epsilon,\delta)$-Differential Privacy (DP) while enabling collaborativeestimation of global eigenvectors across the network without requiring acentral aggregator. We achieve this by having agents share only localembeddings of the current eigenvector iterate, leveraging both the inherentprivacy from random initialization and carefully calibrated Gaussian noiseadditions. We prove that our algorithm satisfies the prescribed$(\epsilon,\delta)$-DP guarantee and establish convergence rates thatexplicitly characterize the impact of the network topology. Our theoreticalanalysis, based on linear dynamics and high-dimensional probability theory,provides tight bounds on both privacy and utility. Experiments on real-worlddatasets demonstrate that D-DP-PM achieves superior privacy-utility tradeoffscompared to naive local DP approaches, with particularly strong performance inmoderate privacy regimes ($\epsilon\in[2, 5]$). The method converges rapidly,allowing practitioners to trade iterations for enhanced privacy whilemaintaining competitive utility.