Adaptive Learning Method of Recurrent Temporal Deep Belief Network to Analyze Time Series Data

by   Takumi Ichimura, et al.
Prefectural University of Hiroshima

Deep Learning has the hierarchical network architecture to represent the complicated features of input patterns. Such architecture is well known to represent higher learning capability compared with some conventional models if the best set of parameters in the optimal network structure is found. We have been developing the adaptive learning method that can discover the optimal network structure in Deep Belief Network (DBN). The learning method can construct the network structure with the optimal number of hidden neurons in each Restricted Boltzmann Machine and with the optimal number of layers in the DBN during learning phase. The network structure of the learning method can be self-organized according to given input patterns of big data set. In this paper, we embed the adaptive learning method into the recurrent temporal RBM and the self-generated layer into DBN. In order to verify the effectiveness of our proposed method, the experimental results are higher classification capability than the conventional methods in this paper.


page 1

page 2

page 3

page 4


An Adaptive Learning Method of Deep Belief Network by Layer Generation Algorithm

Deep Belief Network (DBN) has a deep architecture that represents multip...

Fine Tuning Method by using Knowledge Acquisition from Deep Belief Network

We developed an adaptive structure learning method of Restricted Boltzma...

Knowledge Extracted from Recurrent Deep Belief Network for Real Time Deterministic Control

Recently, the market on deep learning including not only software but al...

An Object Detection by using Adaptive Structural Learning of Deep Belief Network

Deep learning forms a hierarchical network structure for representation ...

Nucleus Neural Network: A Data-driven Self-organized Architecture

Artificial neural networks which are inspired from the learning mechanis...

Please sign up or login with your details

Forgot password? Click here to reset