Abstract
Deep neural networks have been the driving force behind the success inclassification tasks, e.g., object and audio recognition. Impressive resultsand generalization have been achieved by a variety of recently proposedarchitectures, the majority of which are seemingly disconnected. In this work,we cast the study of deep classifiers under a unifying framework. Inparticular, we express state-of-the-art architectures (e.g., residual andnon-local networks) in the form of different degree polynomials of the input.Our framework provides insights on the inductive biases of each model andenables natural extensions building upon their polynomial nature. The efficacyof the proposed models is evaluated on standard image and audio classificationbenchmarks. The expressivity of the proposed models is highlighted both interms of increased model performance as well as model compression. Lastly, theextensions allowed by this taxonomy showcase benefits in the presence oflimited data and long-tailed data distributions. We expect this taxonomy toprovide links between existing domain-specific architectures. The source codeis available at\url{https://github.com/grigorisg9gr/polynomials-for-augmenting-NNs}.