Gaussian processes meet NeuralODEs: A Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

by   Mohamed Aziz Bhouri, et al.

This paper presents a machine learning framework (GP-NODE) for Bayesian systems identification from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. Moreover, the use of sparsity-promoting priors such as the Finnish Horseshoe for free model parameters enables the discovery of interpretable and parsimonious representations for the underlying latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator-prey systems, systems biology, and a 50-dimensional human motion dynamical system. Taken together, our findings put forth a novel, flexible and robust workflow for data-driven model discovery under uncertainty. All code and data accompanying this manuscript are available online at <>.


page 1

page 2

page 3

page 4


Bayesian differential programming for robust systems identification under uncertainty

This paper presents a machine learning framework for Bayesian systems id...

Double Normalizing Flows: Flexible Bayesian Gaussian Process ODEs Learning

Recently, Gaussian processes have been utilized to model the vector fiel...

Identification of Gaussian Process State-Space Models with Particle Stochastic Approximation EM

Gaussian process state-space models (GP-SSMs) are a very flexible family...

Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning

The complexity of real-world geophysical systems is often compounded by ...

Efficient treatment of model discrepancy by Gaussian Processes - Importance for imbalanced multiple constraint inversions

Mechanistic simulation models are inverted against observations in order...

Encoding nonlinear and unsteady aerodynamics of limit cycle oscillations using nonlinear sparse Bayesian learning

This paper investigates the applicability of a recently-proposed nonline...

Joint Parameter Discovery and Generative Modeling of Dynamic Systems

Given an unknown dynamic system such as a coupled harmonic oscillator wi...

Please sign up or login with your details

Forgot password? Click here to reset