Variational Learning for the Inverted Beta-Liouville Mixture Model and Its Application to Text Categorization

12/29/2021
by   Yongfa Ling, et al.
0

The finite invert Beta-Liouville mixture model (IBLMM) has recently gained some attention due to its positive data modeling capability. Under the conventional variational inference (VI) framework, the analytically tractable solution to the optimization of the variational posterior distribution cannot be obtained, since the variational object function involves evaluation of intractable moments. With the recently proposed extended variational inference (EVI) framework, a new function is proposed to replace the original variational object function in order to avoid intractable moment computation, so that the analytically tractable solution of the IBLMM can be derived in an elegant way. The good performance of the proposed approach is demonstrated by experiments with both synthesized data and a real-world application namely text categorization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/27/2018

Infinite Mixture of Inverted Dirichlet Distributions

In this work, we develop a novel Bayesian estimation method for the Diri...
research
05/23/2019

Variational Inference with Mixture Model Approximation: Robotic Applications

We propose a method to approximate the distribution of robot configurati...
research
10/27/2016

Operator Variational Inference

Variational inference is an umbrella term for algorithms which cast Baye...
research
02/13/2019

On the Convergence of Extended Variational Inference for Non-Gaussian Statistical Models

Variational inference (VI) is a widely used framework in Bayesian estima...
research
05/02/2018

Alpha-Beta Divergence For Variational Inference

This paper introduces a variational approximation framework using direct...
research
10/18/2017

Variational Inference based on Robust Divergences

Robustness to outliers is a central issue in real-world machine learning...
research
10/30/2015

Streaming, Distributed Variational Inference for Bayesian Nonparametrics

This paper presents a methodology for creating streaming, distributed in...

Please sign up or login with your details

Forgot password? Click here to reset