Optimizing Age of Information in Vehicular Edge Computing with Federated Graph Neural Network Multi-Agent Reinforcement Learning

  • 2024-07-01 16:37:38
  • Wenhua Wang, Qiong Wu, Pingyi Fan, Nan Cheng, Wen Chen, Jiangzhou Wang, Khaled B. Letaief
  • 0

Abstract

With the rapid development of intelligent vehicles and Intelligent TransportSystems (ITS), the sensors such as cameras and LiDAR installed on intelligentvehicles provides higher capacity of executing computation-intensive anddelay-sensitive tasks, thereby raising deployment costs. To address this issue,Vehicular Edge Computing (VEC) has been proposed to process data through RoadSide Units (RSUs) to support real-time applications. This paper focuses on theAge of Information (AoI) as a key metric for data freshness and explores taskoffloading issues for vehicles under RSU communication resource constraints. Weadopt a Multi-agent Deep Reinforcement Learning (MADRL) approach, allowingvehicles to autonomously make optimal data offloading decisions. However, MADRLposes risks of vehicle information leakage during communication learning andcentralized training. To mitigate this, we employ a Federated Learning (FL)framework that shares model parameters instead of raw data to protect theprivacy of vehicle users. Building on this, we propose an innovativedistributed federated learning framework combining Graph Neural Networks (GNN),named Federated Graph Neural Network Multi-Agent Reinforcement Learning(FGNN-MADRL), to optimize AoI across the system. For the first time, roadscenarios are constructed as graph data structures, and a GNN-based federatedlearning framework is proposed, effectively combining distributed andcentralized federated aggregation. Furthermore, we propose a new MADRLalgorithm that simplifies decision making and enhances offloading efficiency,further reducing the decision complexity. Simulation results demonstrate thesuperiority of our proposed approach to other methods through simulations.

 

Quick Read (beta)

loading the full paper ...