Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing

  • 2025-06-18 13:32:53
  • Cui Zhang, Wenjun Zhang, Qiong Wu, Pingyi Fan, Qiang Fan, Jiangzhou Wang, Khaled B. Letaief
  • 0

Abstract

Federated Learning (FL) can protect the privacy of the vehicles in vehicleedge computing (VEC) to a certain extent through sharing the gradients ofvehicles' local models instead of local data. The gradients of vehicles' localmodels are usually large for the vehicular artificial intelligence (AI)applications, thus transmitting such large gradients would cause largeper-round latency. Gradient quantization has been proposed as one effectiveapproach to reduce the per-round latency in FL enabled VEC through compressinggradients and reducing the number of bits, i.e., the quantization level, totransmit gradients. The selection of quantization level and thresholdsdetermines the quantization error, which further affects the model accuracy andtraining time. To do so, the total training time and quantization error (QE)become two key metrics for the FL enabled VEC. It is critical to jointlyoptimize the total training time and QE for the FL enabled VEC. However, thetime-varying channel condition causes more challenges to solve this problem. Inthis paper, we propose a distributed deep reinforcement learning (DRL)-basedquantization level allocation scheme to optimize the long-term reward in termsof the total training time and QE. Extensive simulations identify the optimalweighted factors between the total training time and QE, and demonstrate thefeasibility and effectiveness of the proposed scheme.

 

Quick Read (beta)

loading the full paper ...