DeepAI AI Chat
Log In Sign Up

Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation

by   Valentin De Bortoli, et al.
Heriot-Watt University

Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric empirical Bayesian estimation. Combined with Markov chain Monte Carlo algorithms, these stochastic optimisation methods have been successfully applied to a wide range of problems in science and industry. However, this strategy scales poorly to large problems because of methodological and theoretical difficulties related to using high-dimensional Markov chain Monte Carlo algorithms within a stochastic approximation scheme. This paper proposes to address these difficulties by using unadjusted Langevin algorithms to construct the stochastic approximation. This leads to a highly efficient stochastic optimisation methodology with favourable convergence properties that can be quantified explicitly and easily checked. The proposed methodology is demonstrated with three experiments, including a challenging application to high-dimensional statistical audio analysis and a sparse Bayesian logistic regression with random effects problem.


page 1

page 2

page 3

page 4


On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems

The Stochastic Approximation EM (SAEM) algorithm, a variant stochastic a...

Efficient Bayesian computation for low-photon imaging problems

This paper studies a new and highly efficient Markov chain Monte Carlo (...

Approximating Bayes in the 21st Century

The 21st century has seen an enormous growth in the development and use ...

Deterministic Approximate EM Algorithm; Application to the Riemann Approximation EM and the Tempered EM

The Expectation Maximisation (EM) algorithm is widely used to optimise n...

ergm 4: Computational Improvements

The ergm package supports the statistical analysis and simulation of net...