Abstract
A promising direction in deep learning research consists in learningrepresentations and simultaneously discovering cluster structure in unlabeleddata by optimizing a discriminative loss function. As opposed to superviseddeep learning, this line of research is in its infancy, and how to design andoptimize suitable loss functions to train deep neural networks for clusteringis still an open question. Our contribution to this emerging field is a newdeep clustering network that leverages the discriminative power ofinformation-theoretic divergence measures, which have been shown to beeffective in traditional clustering. We propose a novel loss function thatincorporates geometric regularization constraints, thus avoiding degeneratestructures of the resulting clustering partition. Experiments on syntheticbenchmarks and real datasets show that the proposed network achievescompetitive performance with respect to other state-of-the-art methods, scaleswell to large datasets, and does not require pre-training steps.