Asymptotic Properties of Recursive Maximum Likelihood Estimation in Non-Linear State-Space Models

06/25/2018
by   Vladislav Z. B. Tadic, et al.
0

Using stochastic gradient search and the optimal filter derivative, it is possible to perform recursive (i.e., online) maximum likelihood estimation in a non-linear state-space model. As the optimal filter and its derivative are analytically intractable for such a model, they need to be approximated numerically. In [Poyiadjis, Doucet and Singh, Biometrika 2018], a recursive maximum likelihood algorithm based on a particle approximation to the optimal filter derivative has been proposed and studied through numerical simulations. Here, this algorithm and its asymptotic behavior are analyzed theoretically. We show that the algorithm accurately estimates maxima to the underlying (average) log-likelihood when the number of particles is sufficiently large. We also derive (relatively) tight bounds on the estimation error. The obtained results hold under (relatively) mild conditions and cover several classes of non-linear state-space models met in practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/25/2018

Bias of Particle Approximations to Optimal Filter Derivative

In many applications, a state-space model depends on a parameter which n...
research
08/30/2017

Asymptotic Bias of Stochastic Gradient Search

The asymptotic behavior of the stochastic gradient algorithm with a bias...
research
06/25/2018

Stability of Optimal Filter Higher-Order Derivatives

In many scenarios, a state-space model depends on a parameter which need...
research
09/07/2015

Matrix Factorisation with Linear Filters

This text investigates relations between two well-known family of algori...
research
09/14/2016

Distributed Estimation of the Operating State of a Single-Bus DC MicroGrid without an External Communication Interface

We propose a decentralized Maximum Likelihood solution for estimating th...
research
03/08/2022

Neural Contextual Bandits via Reward-Biased Maximum Likelihood Estimation

Reward-biased maximum likelihood estimation (RBMLE) is a classic princip...

Please sign up or login with your details

Forgot password? Click here to reset