Abstract

We developed an adaptive structure learning method of Restricted BoltzmannMachine (RBM) which can generate/annihilate neurons by self-organizing learningmethod according to input patterns. Moreover, the adaptive Deep Belief Network(DBN) in the assemble process of pre-trained RBM layer was developed. Theproposed method presents to score a great success to the training data set forbig data benchmark test such as CIFAR-10. However, the classificationcapability of the test data set, which are included unknown patterns, is high,but does not lead perfect correct solution. We investigated the wrong specifieddata and then some characteristic patterns were found. In this paper, theknowledge related to the patterns is embedded into the classification algorithmof trained DBN. As a result, the classification capability can achieve a greatsuccess (97.1\% to unknown data set).

 

Introduction (beta)

None

 

Conclusion (beta)

None