Abstract
This paper challenges the prevailing view that convolutional neural network(CNN) filters become increasingly specialized in deeper layers. Motivated byrecent observations of clusterable repeating patterns in depthwise separableCNNs (DS-CNNs) trained on ImageNet, we extend this investigation across variousdomains and datasets. Our analysis of DS-CNNs reveals that deep filtersmaintain generality, contradicting the expected transition to class-specificfilters. We demonstrate the generalizability of these filters through transferlearning experiments, showing that frozen filters from models trained ondifferent datasets perform well and can be further improved when sourced fromlarger datasets. Our findings indicate that spatial features learned bydepthwise separable convolutions remain generic across all layers, domains, andarchitectures. This research provides new insights into the nature ofgeneralization in neural networks, particularly in DS-CNNs, and has significantimplications for transfer learning and model design.