Fine Tuning Method by using Knowledge Acquisition from Deep Belief Network

by   Shin Kamada, et al.
Prefectural University of Hiroshima

We developed an adaptive structure learning method of Restricted Boltzmann Machine (RBM) which can generate/annihilate neurons by self-organizing learning method according to input patterns. Moreover, the adaptive Deep Belief Network (DBN) in the assemble process of pre-trained RBM layer was developed. The proposed method presents to score a great success to the training data set for big data benchmark test such as CIFAR-10. However, the classification capability of the test data set, which are included unknown patterns, is high, but does not lead perfect correct solution. We investigated the wrong specified data and then some characteristic patterns were found. In this paper, the knowledge related to the patterns is embedded into the classification algorithm of trained DBN. As a result, the classification capability can achieve a great success (97.1% to unknown data set).


page 1

page 2

page 3

page 4


Adaptive Learning Method of Recurrent Temporal Deep Belief Network to Analyze Time Series Data

Deep Learning has the hierarchical network architecture to represent the...

An Adaptive Learning Method of Deep Belief Network by Layer Generation Algorithm

Deep Belief Network (DBN) has a deep architecture that represents multip...

Knowledge Extracted from Recurrent Deep Belief Network for Real Time Deterministic Control

Recently, the market on deep learning including not only software but al...

Deep Belief Network Training Improvement Using Elite Samples Minimizing Free Energy

Nowadays this is very popular to use deep architectures in machine learn...

Nucleus Neural Network: A Data-driven Self-organized Architecture

Artificial neural networks which are inspired from the learning mechanis...

Please sign up or login with your details

Forgot password? Click here to reset