DeepAI AI Chat
Log In Sign Up

CNN-Based Joint Clustering and Representation Learning with Feature Drift Compensation for Large-Scale Image Data

by   Chih-Chung Hsu, et al.

Given a large unlabeled set of images, how to efficiently and effectively group them into clusters based on extracted visual representations remains a challenging problem. To address this problem, we propose a convolutional neural network (CNN) to jointly solve clustering and representation learning in an iterative manner. In the proposed method, given an input image set, we first randomly pick k samples and extract their features as initial cluster centroids using the proposed CNN with an initial model pre-trained from the ImageNet dataset. Mini-batch k-means is then performed to assign cluster labels to individual input samples for a mini-batch of images randomly sampled from the input image set until all images are processed. Subsequently, the proposed CNN simultaneously updates the parameters of the proposed CNN and the centroids of image clusters iteratively based on stochastic gradient descent. We also proposed a feature drift compensation scheme to mitigate the drift error caused by feature mismatch in representation learning. Experimental results demonstrate the proposed method outperforms start-of-the-art clustering schemes in terms of accuracy and storage complexity on large-scale image sets containing millions of images.


page 2

page 7


Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models

The advent of large pre-trained models has brought about a paradigm shif...

Joint Unsupervised Learning of Deep Representations and Image Clusters

In this paper, we propose a recurrent framework for Joint Unsupervised L...

A Transfer Learning based Feature-Weak-Relevant Method for Image Clustering

Image clustering is to group a set of images into disjoint clusters in a...

Unsupervised Segmentation of 3D Medical Images Based on Clustering and Deep Representation Learning

This paper presents a novel unsupervised segmentation method for 3D medi...

Learning Compact Features via In-Training Representation Alignment

Deep neural networks (DNNs) for supervised learning can be viewed as a p...

What do CNN neurons learn: Visualization Clustering

In recent years convolutional neural networks (CNN) have shown striking ...

Improving Image Clustering With Multiple Pretrained CNN Feature Extractors

For many image clustering problems, replacing raw image data with featur...