Efficient Amortised Bayesian Inference for Hierarchical and Nonlinear Dynamical Systems

by   Geoffrey Roeder, et al.

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of nonlinear mixed-effects (NLME) dynamical systems, the statistical workhorse for many experimental sciences. We cast parameter inference as stochastic optimisation of an end-to-end differentiable, block-conditional variational autoencoder. We specify the dynamics of the data-generating process as an ordinary differential equation (ODE) such that both the ODE and its solver are fully differentiable. This model class is highly flexible: the ODE right-hand sides can be a mixture of user-prescribed or "white-box" sub-components and neural network or "black-box" sub-components. Using stochastic optimisation, our amortised inference algorithm could seamlessly scale up to massive data collection pipelines (common in labs with robotic automation). Finally, our framework supports interpretability with respect to the underlying dynamics, as well as predictive generalization to unseen combinations of group components (also called "zero-shot" learning). We empirically validate our method by predicting the dynamic behaviour of bacteria that were genetically engineered to function as biosensors.


NLMEModeling: A Wolfram Mathematica Package for Nonlinear Mixed Effects Modeling of Dynamical Systems

Nonlinear mixed effects modeling is a powerful tool when analyzing data ...

Learning interpretable continuous-time models of latent stochastic dynamical systems

We develop an approach to learn an interpretable semi-parametric model o...

Bayesian differential programming for robust systems identification under uncertainty

This paper presents a machine learning framework for Bayesian systems id...

Compositional Modeling of Nonlinear Dynamical Systems with ODE-based Random Features

Effectively modeling phenomena present in highly nonlinear dynamical sys...

Capturing Actionable Dynamics with Structured Latent Ordinary Differential Equations

End-to-end learning of dynamical systems with black-box models, such as ...

Multirotor Ensemble Model Predictive Control I: Simulation Experiments

Nonlinear receding horizon model predictive control is a powerful approa...

Survival Dynamical Systems for the Population-level Analysis of Epidemics

Motivated by the classical Susceptible-Infected-Recovered (SIR) epidemic...

Please sign up or login with your details

Forgot password? Click here to reset