Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist

03/29/2018
by   Daniel J. Eck, et al.
0

In a regular full exponential family, the maximum likelihood estimator (MLE) need not exist, in the traditional sense, but the MLE may exist in the Barndorff-Nielsen completion of the family. Existing algorithms for finding the MLE in the Barndorff-Nielsen completion solve many linear programs; they are slow in small problems and too slow for large problems. We provide new, fast, and scalable methodology for finding the MLE in the Barndorff-Nielsen completion based on approximate null eigenvectors of the Fisher information matrix. Convergence of Fisher information follows from cumulant generating function convergence, conditions for which are given.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/29/2019

Maximum likelihood estimation for discrete exponential families and random graphs

We characterize the existence of maximum likelihood estimators for discr...
research
10/28/2021

A Computationally Efficient Method for Learning Exponential Family Distributions

We consider the question of learning the natural parameters of a k param...
research
09/12/2023

On Computationally Efficient Learning of Exponential Family Distributions

We consider the classical problem of learning, with arbitrary accuracy, ...
research
07/09/2021

Relative Performance of Fisher Information in Interval Estimation

Maximum likelihood estimates and corresponding confidence regions of the...
research
05/19/2013

Horizon-Independent Optimal Prediction with Log-Loss in Exponential Families

We study online learning under logarithmic loss with regular parametric ...
research
07/15/2020

Quantifying and Reducing Bias in Maximum Likelihood Estimation of Structured Anomalies

Anomaly estimation, or the problem of finding a subset of a dataset that...
research
11/30/2017

A simple and efficient profile likelihood for semiparametric exponential family

Semiparametric exponential family proposed by Ning et al. (2017) is an e...

Please sign up or login with your details

Forgot password? Click here to reset