HyP^2 Loss: Beyond Hypersphere Metric Space for Multi-label Image Retrieval

by   Chengyin Xu, et al.

Image retrieval has become an increasingly appealing technique with broad multimedia application prospects, where deep hashing serves as the dominant branch towards low storage and efficient retrieval. In this paper, we carried out in-depth investigations on metric learning in deep hashing for establishing a powerful metric space in multi-label scenarios, where the pair loss suffers high computational overhead and converge difficulty, while the proxy loss is theoretically incapable of expressing the profound label dependencies and exhibits conflicts in the constructed hypersphere space. To address the problems, we propose a novel metric learning framework with Hybrid Proxy-Pair Loss (HyP^2 Loss) that constructs an expressive metric space with efficient training complexity w.r.t. the whole dataset. The proposed HyP^2 Loss focuses on optimizing the hypersphere space by learnable proxies and excavating data-to-data correlations of irrelevant pairs, which integrates sufficient data correspondence of pair-based methods and high-efficiency of proxy-based methods. Extensive experiments on four standard multi-label benchmarks justify the proposed method outperforms the state-of-the-art, is robust among different hash bits and achieves significant performance gains with a faster, more stable convergence speed. Our code is available at https://github.com/JerryXu0129/HyP2-Loss.


page 1

page 4


Multimorbidity Content-Based Medical Image Retrieval Using Proxies

Content-based medical image retrieval is an important diagnostic tool th...

Instance Similarity Deep Hashing for Multi-Label Image Retrieval

Hash coding has been widely used in the approximate nearest neighbor sea...

Multi-Similarity Loss with General Pair Weighting for Deep Metric Learning

A family of loss functions built on pair-based computation have been pro...

Rank-Consistency Deep Hashing for Scalable Multi-Label Image Search

As hashing becomes an increasingly appealing technique for large-scale i...

Deep Metric Learning with Chance Constraints

Deep metric learning (DML) aims to minimize empirical expected loss of t...

Combining Metric Learning and Attention Heads For Accurate and Efficient Multilabel Image Classification

Multi-label image classification allows predicting a set of labels from ...

Deep Metric Learning with Soft Orthogonal Proxies

Deep Metric Learning (DML) models rely on strong representations and sim...

Please sign up or login with your details

Forgot password? Click here to reset