Abstract
Establishing dense anatomical correspondence across distinct imagingmodalities is a foundational yet challenging procedure for numerous medicalimage analysis studies and image-guided radiotherapy. Existing multi-modalityimage registration algorithms rely on statistical-based similarity measures orlocal structural image representations. However, the former is sensitive tolocally varying noise, while the latter is not discriminative enough to copewith complex anatomical structures in multimodal scans, causing ambiguity indetermining the anatomical correspondence across scans with differentmodalities. In this paper, we propose a modality-agnostic structuralrepresentation learning method, which leverages Deep NeighbourhoodSelf-similarity (DNS) and anatomy-aware contrastive learning to learndiscriminative and contrast-invariance deep structural image representations(DSIR) without the need for anatomical delineations or pre-aligned trainingimages. We evaluate our method on multiphase CT, abdomen MR-CT, and brain MRT1w-T2w registration. Comprehensive results demonstrate that our method issuperior to the conventional local structural representation andstatistical-based similarity measures in terms of discriminability andaccuracy.