Deep State-Space Gaussian Processes

08/11/2020
by   Zheng Zhao, et al.
8

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of Gaussian processes in the hierarchy. The idea of the state-space approach is to represent the DGP as a non-linear hierarchical system of linear stochastic differential equations (SDEs), where each SDE corresponds to a conditional GP. The DGP regression problem then becomes a state estimation problem, and we can estimate the state efficiently with sequential methods by using the Markov property of the state-space DGP. The computational complexity scales linearly with respect to the number of measurements. Based on this, we formulate state-space MAP as well as Bayesian filtering and smoothing solutions to the DGP regression problem. We demonstrate the performance of the proposed models and methods on synthetic non-stationary signals and apply the state-space DGP to detection of the gravitational waves from LIGO measurements.

READ FULL TEXT

page 14

page 17

page 18

page 19

research
11/24/2021

State-space deep Gaussian processes with applications

This thesis is mainly concerned with state-space approaches for solving ...
research
10/08/2018

Probabilistic Solutions To Ordinary Differential Equations As Non-Linear Bayesian Filtering: A New Perspective

We formulate probabilistic numerical approximations to solutions of ordi...
research
02/13/2018

State Space Gaussian Processes with Non-Gaussian Likelihood

We provide a comprehensive overview and tooling for GP modeling with non...
research
10/25/2016

Gaussian Process Kernels for Popular State-Space Time Series Models

In this paper we investigate a link between state- space models and Gaus...
research
01/29/2023

Sequential Estimation of Gaussian Process-based Deep State-Space Models

We consider the problem of sequential estimation of the unknowns of stat...
research
09/16/2020

Bayesian Inference for Stationary Points in Gaussian Process Regression Models for Event-Related Potentials Analysis

Stationary points embedded in the derivatives are often critical for a m...
research
12/06/2021

Traversing Time with Multi-Resolution Gaussian Process State-Space Models

Gaussian Process state-space models capture complex temporal dependencie...

Please sign up or login with your details

Forgot password? Click here to reset