CONVERGE: A Multi-Agent Vision-Radio Architecture for xApps

  • 2025-08-06 15:40:52
  • Filipe B. Teixeira, Carolina Simões, Paulo Fidalgo, Wagner Pedrosa, André Coelho, Manuel Ricardo, Luis M. Pessoa
  • 0

Abstract

Telecommunications and computer vision have evolved independently. With theemergence of high-frequency wireless links operating mostly in line-of-sight,visual data can help predict the channel dynamics by detecting obstacles andhelp overcoming them through beamforming or handover techniques. This paper proposes a novel architecture for delivering real-time radio andvideo sensing information to O-RAN xApps through a multi-agent approach, andintroduces a new video function capable of generating blockage information forxApps, enabling Integrated Sensing and Communications. Experimental resultsshow that the delay of sensing information remains under 1\,ms and that an xAppcan successfully use radio and video sensing information to control the 5G/6GRAN in real-time.

 

Quick Read (beta)

loading the full paper ...