Generalized Dirichlet-process-means for f-separable distortion measures

01/31/2019
by   Masahiro Kobayashi, et al.
0

DP-means clustering was obtained as an extension of K-means clustering. While it is implemented with a simple and efficient algorithm, it can estimate the number of clusters simultaneously. However, DP-means is specifically designed for the average distortion measure. Therefore, it is vulnerable to outliers in data, and it can cause large maximum distortion in clusters. In this work, we extend the objective function of the DP-means to f-separable distortion measures and propose a unified learning algorithm to overcome the above problems by the selection of the function f. Furthermore, the influence function of the estimated cluster center is analyzed to evaluate the robustness against outliers. We show the effectiveness of the generalized method by numerical experiments using real datasets.

READ FULL TEXT

page 19

page 20

research
04/24/2013

The K-modes algorithm for clustering

Many clustering algorithms exist that estimate a cluster centroid, such ...
research
03/15/2019

Tackling Initial Centroid of K-Means with Distance Part (DP-KMeans)

The initial centroid is a fairly challenging problem in the k-means meth...
research
01/05/2018

Clustering with Outlier Removal

Cluster analysis and outlier detection are strongly coupled tasks in dat...
research
05/17/2023

Indirect Rate Distortion Functions with f-Separable Distortion Criterion

We consider a remote source coding problem subject to a distortion funct...
research
07/17/2019

t-k-means: A k-means Variant with Robustness and Stability

Lloyd's k-means algorithm is one of the most classical clustering method...
research
02/22/2023

Cluster Purging: Efficient Outlier Detection based on Rate-Distortion Theory

Rate-distortion theory-based outlier detection builds upon the rationale...
research
11/22/2022

Algorithm for detection of illegal discounting in North Carolina Education Lottery

The lottery is a very lucrative industry. Popular fascination often focu...

Please sign up or login with your details

Forgot password? Click here to reset