Deep transfer learning for system identification using long short-term memory neural networks

04/06/2022
by   Kaicheng Niu, et al.
0

Recurrent neural networks (RNNs) have many advantages over more traditional system identification techniques. They may be applied to linear and nonlinear systems, and they require fewer modeling assumptions. However, these neural network models may also need larger amounts of data to learn and generalize. Furthermore, neural networks training is a time-consuming process. Hence, building upon long-short term memory neural networks (LSTM), this paper proposes using two types of deep transfer learning, namely parameter fine-tuning and freezing, to reduce the data and computation requirements for system identification. We apply these techniques to identify two dynamical systems, namely a second-order linear system and a Wiener-Hammerstein nonlinear system. Results show that compared with direct learning, our method accelerates learning by 10

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2023

Deep Long-Short Term Memory networks: Stability properties and Experimental validation

The aim of this work is to investigate the use of Incrementally Input-to...
research
01/27/2023

A critical look at deep neural network for dynamic system modeling

Neural network models become increasingly popular as dynamic modeling to...
research
04/19/2018

Real Time Emulation of Parametric Guitar Tube Amplifier With Long Short Term Memory Neural Network

Numerous audio systems for musicians are expensive and bulky. Therefore,...
research
08/10/2018

Model Reduction with Memory and the Machine Learning of Dynamical Systems

The well-known Mori-Zwanzig theory tells us that model reduction leads t...
research
09/25/2019

Single-modal and Multi-modal False Arrhythmia Alarm Reduction using Attention-based Convolutional and Recurrent Neural Networks

This study proposes a deep learning model that effectively suppresses th...
research
05/04/2022

DeepBayes – an estimator for parameter estimation in stochastic nonlinear dynamical models

Stochastic nonlinear dynamical systems are ubiquitous in modern, real-wo...
research
07/01/2019

Neural Dynamics Discovery via Gaussian Process Recurrent Neural Networks

Latent dynamics discovery is challenging in extracting complex dynamics ...

Please sign up or login with your details

Forgot password? Click here to reset