Abstract
Deploying federated learning (FL) over wireless networks withresource-constrained devices requires balancing between accuracy, energyefficiency, and precision. Prior art on FL often requires devices to train deepneural networks (DNNs) using a 32-bit precision level for data representationto improve accuracy. However, such algorithms are impractical forresource-constrained devices since DNNs could require execution of millions ofoperations. Thus, training DNNs with a high precision level incurs a highenergy cost for FL. In this paper, a quantized FL framework, that representsdata with a finite level of precision in both local training and uplinktransmission, is proposed. Here, the finite level of precision is capturedthrough the use of quantized neural networks (QNNs) that quantize weights andactivations in fixed-precision format. In the considered FL model, each devicetrains its QNN and transmits a quantized training result to the base station.Energy models for the local training and the transmission with the quantizationare rigorously derived. An energy minimization problem is formulated withrespect to the level of precision while ensuring convergence. To solve theproblem, we first analytically derive the FL convergence rate and use a linesearch method. Simulation results show that our FL framework can reduce energyconsumption by up to 53% compared to a standard FL model. The results also shedlight on the tradeoff between precision, energy, and accuracy in FL overwireless networks.