SDGM: Sparse Bayesian Classifier Based on a Discriminative Gaussian Mixture Model

by   Hideaki Hayashi, et al.

In probabilistic classification, a discriminative model based on Gaussian mixture exhibits flexible fitting capability. Nevertheless, it is difficult to determine the number of components. We propose a sparse classifier based on a discriminative Gaussian mixture model (GMM), which is named sparse discriminative Gaussian mixture (SDGM). In the SDGM, a GMM-based discriminative model is trained by sparse Bayesian learning. This learning algorithm improves the generalization capability by obtaining a sparse solution and automatically determines the number of components by removing redundant components. The SDGM can be embedded into neural networks (NNs) such as convolutional NNs and can be trained in an end-to-end manner. Experimental results indicated that the proposed method prevented overfitting by obtaining sparsity. Furthermore, we demonstrated that the proposed method outperformed a fully connected layer with the softmax function in certain cases when it was used as the last layer of a deep NN.


page 1

page 2

page 5

page 6

page 7

page 8

page 9


Convergence of neural networks to Gaussian mixture distribution

We give a proof that, under relatively mild conditions, fully-connected ...

A Hybrid of Generative and Discriminative Models Based on the Gaussian-coupled Softmax Layer

Generative models have advantageous characteristics for classification t...

Similarity Learning-Based Device Attribution

Methods and systems for attributing browsing activity from two or more d...

Variational Inference for Background Subtraction in Infrared Imagery

We propose a Gaussian mixture model for background subtraction in infrar...

EMG Pattern Recognition via Bayesian Inference with Scale Mixture-Based Stochastic Generative Models

Electromyogram (EMG) has been utilized to interface signals for prosthet...

A new perspective on probabilistic image modeling

We present the Deep Convolutional Gaussian Mixture Model (DCGMM), a new ...

Probabilistic Discriminative Models Address the Tactile Perceptual Aliasing Problem

In this paper, our aim is to highlight Tactile Perceptual Aliasing as a ...

Please sign up or login with your details

Forgot password? Click here to reset