Fast MLE Computation for the Dirichlet Multinomial

05/01/2014
by   Max Sklar, et al.
0

Given a collection of categorical data, we want to find the parameters of a Dirichlet distribution which maximizes the likelihood of that data. Newton's method is typically used for this purpose but current implementations require reading through the entire dataset on each iteration. In this paper, we propose a modification which requires only a single pass through the dataset and substantially decreases running time. Furthermore we analyze both theoretically and empirically the performance of the proposed algorithm, and provide an open source implementation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2013

Dirichlet draws are sparse with high probability

This note provides an elementary proof of the folklore fact that draws f...
research
03/02/2020

Fast Predictive Uncertainty for Classification with Bayesian Deep Networks

In Bayesian Deep Learning, distributions over the output of classificati...
research
02/14/2017

Gaussian-Dirichlet Posterior Dominance in Sequential Learning

We consider the problem of sequential learning from categorical observat...
research
06/12/2020

Fast Maximum Likelihood Estimation and Supervised Classification for the Beta-Liouville Multinomial

The multinomial and related distributions have long been used to model c...
research
12/05/2019

A Fast Implementation for the Canonical Polyadic Decomposition

A new implementation of the canonical polyadic decomposition (CPD) is pr...
research
04/01/2022

A Robin-Neumann Scheme with Quasi-Newton Acceleration for Partitioned Fluid-Structure Interaction

The Dirichlet-Neumann scheme is the most common partitioned algorithm fo...
research
08/26/2021

An efficient unconditionally stable method for Dirichlet partitions in arbitrary domains

A Dirichlet k-partition of a domain is a collection of k pairwise disjoi...

Please sign up or login with your details

Forgot password? Click here to reset