Abstract
The idea of compressed sensing is to exploit representations in suitable(overcomplete) dictionaries that allow to recover signals far beyond theNyquist rate provided that they admit a sparse representation in the respectivedictionary. The latter gives rise to the sparse recovery problem of finding thebest sparse linear approximation of given data in a given generating system. Inthis paper we analyze the iterative hard thresholding (IHT) algorithm as one ofthe most popular greedy methods for solving the sparse recovery problem, anddemonstrate that systematically perturbing the IHT algorithm by adding noise tointermediate iterates yields improved results. Further improvements can beobtained by entirely rephrasing the problem as a parametric deep-learning-typeof optimization problem. By introducing perturbations via dropout, wedemonstrate to significantly outperform the classical IHT algorithm, obtaining$3$ to $6$ times lower average objective errors.