Abstract
Three-dimensional synthetic aperture radar (3D SAR) is an advanced activemicrowave imaging technology widely utilized in remote sensing area. To achievehigh-resolution 3D imaging,3D SAR requires observations from multiple aspectsand altitude baselines surrounding the target. However, constrained flighttrajectories often lead to sparse observations, which degrade imaging quality,particularly for anisotropic man-made small targets, such as vehicles andaircraft. In the past, compressive sensing (CS) was the mainstream approach forsparse 3D SAR image reconstruction. More recently, deep learning (DL) hasemerged as a powerful alternative, markedly boosting reconstruction quality andefficiency. However, existing DL-based methods typically rely solely onhigh-quality 3D SAR images as supervisory signals to train deep neural networks(DNNs). This unimodal learning paradigm prevents the integration ofcomplementary information from other data modalities, which limitsreconstruction performance and reduces target discriminability due to theinherent constraints of electromagnetic scattering. In this paper, we introducecross-modal learning and propose a Cross-Modal 3D-SAR Reconstruction Network(CMAR-Net) for enhancing sparse 3D SAR images of vehicle targets by fusingoptical information. Leveraging cross-modal supervision from 2D optical imagesand error propagation guaranteed by differentiable rendering, CMAR-Net achievesefficient training and reconstructs sparse 3D SAR images, which are derivedfrom highly sparse-aspect observations, into visually structured 3D vehicleimages. Trained exclusively on simulated data, CMAR-Net exhibits robustgeneralization to real-world data, outperforming state-of-the-art CS and DLmethods in structural accuracy within a large-scale parking lot experimentinvolving numerous civilian vehicles, thereby demonstrating its strongpractical applicability.