Dual-level Semantic Transfer Deep Hashing for Efficient Social Image Retrieval

by   Lei Zhu, et al.

Social network stores and disseminates a tremendous amount of user shared images. Deep hashing is an efficient indexing technique to support large-scale social image retrieval, due to its deep representation capability, fast retrieval speed and low storage cost. Particularly, unsupervised deep hashing has well scalability as it does not require any manually labelled data for training. However, owing to the lacking of label guidance, existing methods suffer from severe semantic shortage when optimizing a large amount of deep neural network parameters. Differently, in this paper, we propose a Dual-level Semantic Transfer Deep Hashing (DSTDH) method to alleviate this problem with a unified deep hash learning framework. Our model targets at learning the semantically enhanced deep hash codes by specially exploiting the user-generated tags associated with the social images. Specifically, we design a complementary dual-level semantic transfer mechanism to efficiently discover the potential semantics of tags and seamlessly transfer them into binary hash codes. On the one hand, instance-level semantics are directly preserved into hash codes from the associated tags with adverse noise removing. Besides, an image-concept hypergraph is constructed for indirectly transferring the latent high-order semantic correlations of images and tags into hash codes. Moreover, the hash codes are obtained simultaneously with the deep representation learning by the discrete hash optimization strategy. Extensive experiments on two public social image retrieval datasets validate the superior performance of our method compared with state-of-the-art hashing methods. The source codes of our method can be obtained at https://github.com/research2020-1/DSTDH


page 4

page 5

page 6

page 7

page 9

page 10

page 11

page 12


Unsupervised Deep Image Hashing through Tag Embeddings

Many approaches to semantic image hashing have been formulated as superv...

Exploring Auxiliary Context: Discrete Semantic Transfer Hashing for Scalable Image Retrieval

Unsupervised hashing can desirably support scalable content-based image ...

Weakly-Supervised Online Hashing

With the rapid development of social websites, recent years have witness...

Two-pronged Strategy: Lightweight Augmented Graph Network Hashing for Scalable Image Retrieval

Hashing learns compact binary codes to store and retrieve massive data e...

Optimal Projection Guided Transfer Hashing for Image Retrieval

Recently, learning to hash has been widely studied for image retrieval t...

Learning Robust Hash Codes for Multiple Instance Image Retrieval

In this paper, for the first time, we introduce a multiple instance (MI)...

One Network for Multi-Domains: Domain Adaptive Hashing with Intersectant Generative Adversarial Network

With the recent explosive increase of digital data, image recognition an...

Please sign up or login with your details

Forgot password? Click here to reset