Learning stochastic differential equations using RNN with log signature features

by   Shujian Liao, et al.

This paper contributes to the challenge of learning a function on streamed multimodal data through evaluation. The core of the result of our paper is the combination of two quite different approaches to this problem. One comes from the mathematically principled technology of signatures and log-signatures as representations for streamed data, while the other draws on the techniques of recurrent neural networks (RNN). The ability of the former to manage high sample rate streams and the latter to manage large scale nonlinear interactions allows hybrid algorithms that are easy to code, quicker to train, and of lower complexity for a given accuracy. We illustrate the approach by approximating the unknown functional as a controlled differential equation. Linear functionals on solutions of controlled differential equations are the natural universal class of functions on data streams. They are mathematically very explicit and interpretable, allow quantitative arguments, and yet are able to approximate any continuous function on streams arbitrarily well. They form the basis of rough path theory. Stochastic differential equations are examples of controlled differential equations where the controlling stream is a stochastic process. Following this approach, we give a hybrid Logsig-RNN algorithm that learns functionals on streamed data with outstanding performance.


page 1

page 2

page 3

page 4


Learning the conditional law: signatures and conditional GANs in filtering and prediction of diffusion processes

We consider the filtering and prediction problem for a diffusion process...

Deep Signature FBSDE Algorithm

We propose a deep signature/log-signature FBSDE algorithm to solve forwa...

Logsig-RNN: a novel network for robust and efficient skeleton-based action recognition

This paper contributes to the challenge of skeleton-based human action r...

The iisignature library: efficient calculation of iterated-integral signatures and log signatures

Iterated-integral signatures and log signatures are vectors calculated f...

Neural CDEs for Long Time Series via the Log-ODE Method

Neural Controlled Differential Equations (Neural CDEs) are the continuou...

On the Generalization Capacities of Neural Controlled Differential Equations

We consider a supervised learning setup in which the goal is to predicts...

Theoretical Guarantees for Learning Conditional Expectation using Controlled ODE-RNN

Continuous stochastic processes are widely used to model time series tha...

Please sign up or login with your details

Forgot password? Click here to reset