Abstract
Given a union of non-linear manifolds, non-linear subspace clustering ormanifold clustering aims to cluster data points based on manifold structuresand also learn to parameterize each manifold as a linear subspace in a featurespace. Deep neural networks have the potential to achieve this goal underhighly non-linear settings given their large capacity and flexibility. We arguethat achieving manifold clustering with neural networks requires two essentialingredients: a domain-specific constraint that ensures the identification ofthe manifolds, and a learning algorithm for embedding each manifold to a linearsubspace in the feature space. This work shows that many constraints can beimplemented by data augmentation. For subspace feature learning, Maximum CodingRate Reduction (MCR$^2$) objective can be used. Putting them together yields{\em Neural Manifold Clustering and Embedding} (NMCE), a novel method forgeneral purpose manifold clustering, which significantly outperformsautoencoder-based deep subspace clustering. Further, on more challengingnatural image datasets, NMCE can also outperform other algorithms specificallydesigned for clustering. Qualitatively, we demonstrate that NMCE learns ameaningful and interpretable feature space. As the formulation of NMCE isclosely related to several important Self-supervised learning (SSL) methods, webelieve this work can help us build a deeper understanding on SSLrepresentation learning.