Clustering with missing data: which imputation model for which cluster analysis method?

06/08/2021
by   Vincent Audigier, et al.
0

Multiple imputation (MI) is a popular method for dealing with missing values. One main advantage of MI is to separate the imputation phase and the analysis one. However, both are related since they are based on distribution assumptions that have to be consistent. This point is well known as congeniality. In this paper, we discuss congeniality for clustering on continuous data. First, we theoretically highlight how two joint modeling (JM) MI methods (JM-GL and JM-DP) are congenial with various clustering methods. Then, we propose a new fully conditional specification (FCS) MI method with the same theoretical properties as JM-GL. Finally, we extend this FCS MI method to account for more complex distributions. Based on an extensive simulation study, all MI methods are compared for various cluster analysis methods (k-means, k-medoids, mixture model, hierarchical clustering). This study highlights the partition accuracy is improved when the imputation model accounts for clustered individuals. From this point of view, standard MI methods ignoring such a structure should be avoided. JM-GL and JM-DP should be recommended when data are distributed according to a gaussian mixture model, while FCS methods outperform JM ones on more complex data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2021

Imputation of Missing Data Using Linear Gaussian Cluster-Weighted Modeling

Missing data theory deals with the statistical methods in the occurrence...
research
10/05/2022

Dimensional Data KNN-Based Imputation

Data Warehouses (DWs) are core components of Business Intelligence (BI)....
research
03/30/2021

Model-based clustering of partial records

Partially recorded data are frequently encountered in many applications ...
research
09/14/2019

Semiparametric Imputation Using Conditional Gaussian Mixture Models under Item Nonresponse

Imputation is a popular technique for handling item nonresponse in surve...
research
11/27/2020

Clustering with missing data: which equivalent for Rubin's rules?

Multiple imputation (MI) is a popular method for dealing with missing va...
research
05/17/2020

Model-Based Longitudinal Clustering with Varying Cluster Assignments

It is often of interest to perform clustering on longitudinal data, yet ...
research
11/10/2017

Robust Clustering with Subpopulation-specific Deviations

The National Birth Defects Prevention Study (NBDPS) was a case-control s...

Please sign up or login with your details

Forgot password? Click here to reset