Scalable Image Retrieval by Sparse Product Quantization

03/15/2016
by   Qingqun Ning, et al.
0

Fast Approximate Nearest Neighbor (ANN) search technique for high-dimensional feature indexing and retrieval is the crux of large-scale image retrieval. A recent promising technique is Product Quantization, which attempts to index high-dimensional image features by decomposing the feature space into a Cartesian product of low dimensional subspaces and quantizing each of them separately. Despite the promising results reported, their quantization approach follows the typical hard assignment of traditional quantization methods, which may result in large quantization errors and thus inferior search performance. Unlike the existing approaches, in this paper, we propose a novel approach called Sparse Product Quantization (SPQ) to encoding the high-dimensional feature vectors into sparse representation. We optimize the sparse representations of the feature vectors by minimizing their quantization errors, making the resulting representation is essentially close to the original data in practice. Experiments show that the proposed SPQ technique is not only able to compress data, but also an effective encoding technique. We obtain state-of-the-art results for ANN search on four public image datasets and the promising results of content-based image retrieval further validate the efficacy of our proposed method.

READ FULL TEXT

page 11

page 12

research
05/09/2021

Joint Learning of Deep Retrieval Model and Product Quantization based Embedding Index

Embedding index that enables fast approximate nearest neighbor(ANN) sear...
research
04/14/2022

Composite Code Sparse Autoencoders for first stage retrieval

We propose a Composite Code Sparse Autoencoder (CCSA) approach for Appro...
research
07/30/2021

Compression Network with Transformer for Approximate Nearest Neighbor Search

We propose a generic feature compression method for Approximate Nearest ...
research
11/18/2017

A Color Quantization Optimization Approach for Image Representation Learning

Over the last two decades, hand-crafted feature extractors have been use...
research
02/18/2011

Searching in one billion vectors: re-rank with source coding

Recent indexing techniques inspired by source coding have been shown suc...
research
05/23/2016

Embedding based on function approximation for large scale image search

The objective of this paper is to design an embedding method that maps l...
research
06/16/2019

Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval

Product Quantization (PQ) has long been a mainstream for generating an e...

Please sign up or login with your details

Forgot password? Click here to reset