Training-free Ultra Small Model for Universal Sparse Reconstruction in Compressed Sensing

  • 2025-01-23 12:43:18
  • Chaoqing Tang, Huanze Zhuang, Guiyun Tian, Zhenli Zeng, Yi Ding, Wenzhong Liu, Xiang Bai
  • 0

Abstract

Pre-trained large models attract widespread attention in recent years, butthey face challenges in applications that require high interpretability or havelimited resources, such as physical sensing, medical imaging, andbioinformatics. Compressed Sensing (CS) is a well-proved theory that drivesmany recent breakthroughs in these applications. However, as a typicalunder-determined linear system, CS suffers from excessively long sparsereconstruction times when using traditional iterative methods, particularlywith large-scale data. Current AI methods like deep unfolding fail tosubstitute them because pre-trained models exhibit poor generality beyond theirtraining conditions and dataset distributions, or lack interpretability.Instead of following the big model fervor, this paper proposes ultra-smallartificial neural models called coefficients learning (CL), enablingtraining-free and rapid sparse reconstruction while perfectly inheriting thegenerality and interpretability of traditional iterative methods, bringing newfeature of incorporating prior knowledges. In CL, a signal of length $n$ onlyneeds a minimal of $n$ trainable parameters. A case study model called CLOMP isimplemented for evaluation. Experiments are conducted on both synthetic andreal one-dimensional and two-dimensional signals, demonstrating significantimprovements in efficiency and accuracy. Compared to representative iterativemethods, CLOMP improves efficiency by 100 to 1000 folds for large-scale data.Test results on eight diverse image datasets indicate that CLOMP improvesstructural similarity index by 292%, 98%, 45% for sampling rates of 0.1, 0.3,0.5, respectively. We believe this method can truly usher CS reconstructioninto the AI era, benefiting countless under-determined linear systems that relyon sparse solution.

 

Quick Read (beta)

loading the full paper ...