Learning latent stochastic differential equations with variational auto-encoders

07/12/2020
by   Ali Hasan, et al.
0

We present a method for learning latent stochastic differential equations (SDEs) from high dimensional time series data. Given a time series generated from a lower dimensional Itô process, the proposed method uncovers the relevant parameters of the SDE through a self-supervised learning approach. Using the framework of variational autoencoders (VAEs), we consider a conditional generative model for the data based on the Euler-Maruyama approximation of SDE solutions. Furthermore, we use recent results on identifiability of semi-supervised learning to show that our model can recover not only the underlying SDE parameters, but also the original latent space, up to an isometry, in the limit of infinite data. We validate the model through a series of different simulated video processing tasks where the underlying SDE is known. Our results suggest that the proposed method effectively learns the underlying SDE, as predicted by the theory.

READ FULL TEXT

page 2

page 7

page 8

research
12/20/2014

Variational Recurrent Auto-Encoders

In this paper we propose a model that combines the strengths of RNNs and...
research
07/07/2019

A numerical approach to Kolmogorov equation in high dimension based on Gaussian analysis

For Kolmogorov equations associated to finite dimensional stochastic dif...
research
11/25/2021

Time Series Forecasting with Ensembled Stochastic Differential Equations Driven by Lévy Noise

With the fast development of modern deep learning techniques, the study ...
research
11/17/2022

Neural Langevin Dynamics: towards interpretable Neural Stochastic Differential Equations

Neural Stochastic Differential Equations (NSDE) have been trained as bot...
research
05/26/2023

On the Generalization Capacities of Neural Controlled Differential Equations

We consider a supervised learning setup in which the goal is to predicts...
research
08/06/2021

Quantum Quantile Mechanics: Solving Stochastic Differential Equations for Generating Time-Series

We propose a quantum algorithm for sampling from a solution of stochasti...
research
05/22/2022

Deep Discriminative Direct Decoders for High-dimensional Time-series Analysis

Dynamical latent variable modeling has been significantly invested over ...

Please sign up or login with your details

Forgot password? Click here to reset