Abstract
Pansharpening is a crucial remote sensing technique that fuses low-resolutionmultispectral (LRMS) images with high-resolution panchromatic (PAN) images togenerate high-resolution multispectral (HRMS) imagery. Although deep learningtechniques have significantly advanced pansharpening, many existing methodssuffer from limited cross-sensor generalization and high computationaloverhead, restricting their real-time applications. To address thesechallenges, we propose an efficient framework that quickly adapts to a specificinput instance, completing both training and inference in a short time. Ourframework splits the input image into multiple patches, selects a subset forunsupervised CAT training, and then performs inference on all patches,stitching them into the final output. The CAT module, integrated between thefeature extraction and channel transformation stages of a pre-trained network,tailors the fused features and fixes the parameters for efficient inference,generating improved results. Our approach offers two key advantages: (1)$\textit{Improved Generalization Ability}$: by mitigating cross-sensordegradation, our model--although pre-trained on a specific dataset--achievessuperior performance on datasets captured by other sensors; (2)$\textit{Enhanced Computational Efficiency}$: the CAT-enhanced network canswiftly adapt to the test sample using the single LRMS-PAN pair input, withoutrequiring extensive large-scale data retraining. Experiments on the real-worlddata from WorldView-3 and WorldView-2 datasets demonstrate that our methodachieves state-of-the-art performance on cross-sensor real-world data, whileachieving both training and inference of $512\times512$ image within$\textit{0.4 seconds}$ and $4000\times4000$ image within $\textit{3 seconds}$at the fastest setting on a commonly used RTX 3090 GPU.