Abstract
In this paper, we study the problem of designing efficient convolutionalneural network architectures with the interest in eliminating the redundancy inconvolution kernels. In addition to structured sparse kernels, low-rank kernelsand the product of low-rank kernels, the product of structured sparse kernels,which is a framework for interpreting the recently-developed interleaved groupconvolutions (IGC) and its variants (e.g., Xception), has been attractingincreasing interests. Motivated by the observation that the convolutions contained in a groupconvolution in IGC can be further decomposed in the same manner, we present amodularized building block, {IGCV$2$:} interleaved structured sparseconvolutions. It generalizes interleaved group convolutions, which is composedof two structured sparse kernels, to the product of more structured sparsekernels, further eliminating the redundancy. We present the complementarycondition and the balance condition to guide the design of structured sparsekernels, obtaining a balance among three aspects: model size, computationcomplexity and classification accuracy. Experimental results demonstrate theadvantage on the balance among these three aspects compared to interleavedgroup convolutions and Xception, and competitive performance compared to otherstate-of-the-art architecture design methods.