Abstract
State-of-the-art semantic segmentation models are characterized by highparameter counts and slow inference times, making them unsuitable fordeployment in resource-constrained environments. To address this challenge, wepropose \textsc{Auto-Compressing Subset Pruning}, \acosp, as a new onlinecompression method. The core of \acosp consists of learning a channel selectionmechanism for individual channels of each convolution in the segmentation modelbased on an effective temperature annealing schedule. We show a crucialinterplay between providing a high-capacity model at the beginning of trainingand the compression pressure forcing the model to compress concepts intoretained channels. We apply \acosp to \segnet and \pspnet architectures andshow its success when trained on the \camvid, \city, \voc, and \ade datasets.The results are competitive with existing baselines for compression ofsegmentation models at low compression ratios and outperform them significantlyat high compression ratios, yielding acceptable results even when removing morethan $93\%$ of the parameters. In addition, \acosp is conceptually simple, easyto implement, and can readily be generalized to other data modalities, tasks,and architectures. Our code is available at\url{https://github.com/merantix/acosp}.