Abstract
In the field of machine learning, it is still a critical issue to identifyand supervise the learned representation without manually intervention orintuition assistance to extract useful knowledge or serve for the latter tasksin machine learning. In this work, we focus on supervising the influentialfactors extracted by the variational autoencoder(VAE). The VAE is proposed tolearn independent low dimension representation while facing the problem thatsometimes pre-set factors are ignored. We argue that the mutual information ofthe input and each learned factor of the representation plays a necessaryindicator. We find the VAE objective inclines to induce mutual informationsparsity in factor dimension over the data intrinsic dimension and results insome non-influential factors whose function on data reconstruction could beignored. We show mutual information also influences the lower bound of VAE'sreconstruction error and latter classification task. To make such indicatorapplicable, we design an algorithm on calculating the mutual information forVAE and prove its consistency. Experimental results on Mnist, CelebA and Deapdatasets show that mutual information can help determine influential factors,of which some are interpretable and can be used to further generation andclassification tasks, and help discover the variant that connects with emotionon Deap dataset.