Exact inference for a class of non-linear hidden Markov models on general state spaces

by   Guillaume Kon Kam King, et al.

Exact inference for hidden Markov models requires the evaluation of all distributions of interest - filtering, prediction, smoothing and likelihood - with a finite computational effort. This article provides sufficient conditions for exact inference for a class of hidden Markov models on general state spaces given a set of discretely collected indirect observations linked non linearly to the signal, and a set of practical algorithms for inference. The conditions we obtain are concerned with the existence of a certain type of dual process, which is an auxiliary process embedded in the time reversal of the signal, that in turn allows to represent the distributions and functions of interest as finite mixtures of elementary densities or products thereof. We describe explicitly how to update recursively the parameters involved, yielding qualitatively similar results to those obtained with Baum–Welch filters on finite state spaces. We then provide practical algorithms for implementing the recursions, as well as approximations thereof via an informed pruning of the mixtures, and we show superior performance to particle filters both in accuracy and computational efficiency. The code for optimal filtering, smoothing and parameter inference is made available in the Julia package DualOptimalFiltering.


page 1

page 2

page 3

page 4


Exact inference for a class of non-linear hidden Markov models

Exact inference for hidden Markov models requires the evaluation of all ...

Tree-based Particle Smoothing Algorithms in a Hidden Markov Model

We provide a new strategy built on the divide-and-conquer approach by Li...

Topological Hidden Markov Models

The hidden Markov model (HMM) is a classic modeling tool with a wide swa...

Temporal Parallelization of Bayesian Filters and Smoothers

This paper presents algorithms for the temporal parallelization of Bayes...

Smoothing distributions for conditional Fleming-Viot and Dawson-Watanabe diffusions

We study the distribution of the unobserved states of two measure-valued...

Unbiased inference for discretely observed hidden Markov model diffusions

We develop an importance sampling (IS) type estimator for Bayesian joint...

Exploiting locality in high-dimensional factorial hidden Markov models

We propose algorithms for approximate filtering and smoothing in high-di...

Please sign up or login with your details

Forgot password? Click here to reset