A Novel Triplet Sampling Method for Multi-Label Remote Sensing Image Search and Retrieval

by   Tristan Kreuziger, et al.

Learning the similarity between remote sensing (RS) images forms the foundation for content based RS image retrieval (CBIR). Recently, deep metric learning approaches that map the semantic similarity of images into an embedding space have been found very popular in RS. A common approach for learning the metric space relies on the selection of triplets of similar (positive) and dissimilar (negative) images to a reference image called as an anchor. Choosing triplets is a difficult task particularly for multi-label RS CBIR, where each training image is annotated by multiple class labels. To address this problem, in this paper we propose a novel triplet sampling method in the framework of deep neural networks (DNNs) defined for multi-label RS CBIR problems. The proposed method selects a small set of the most representative and informative triplets based on two main steps. In the first step, a set of anchors that are diverse to each other in the embedding space is selected from the current mini-batch using an iterative algorithm. In the second step, different sets of positive and negative images are chosen for each anchor by evaluating relevancy, hardness, and diversity of the images among each other based on a novel ranking strategy. Experimental results obtained on two multi-label benchmark achieves show that the selection of the most informative and representative triplets in the context of DNNs results in: i) reducing the computational complexity of the training phase of the DNNs without any significant loss on the performance; and ii) an increase in learning speed since informative triplets allow fast convergence. The code of the proposed method is publicly available at https://git.tu-berlin.de/rsim/image-retrieval-from-triplets.


page 1

page 3

page 6

page 10


Deep Active Learning for Multi-Label Classification of Remote Sensing Images

The use of deep neural networks (DNNs) has recently attracted great atte...

A Novel Graph-Theoretic Deep Representation Learning Method for Multi-Label Remote Sensing Image Retrieval

This paper presents a novel graph-theoretic deep representation learning...

Annotation Cost Efficient Active Learning for Content Based Image Retrieval

Deep metric learning (DML) based methods have been found very effective ...

AdaTriplet: Adaptive Gradient Triplet Loss with Automatic Margin Learning for Forensic Medical Image Matching

This paper tackles the challenge of forensic medical image matching (FMI...

Reconstruction Regularized Deep Metric Learning for Multi-label Image Classification

In this paper, we present a novel deep metric learning method to tackle ...

Rotation Invariant Aerial Image Retrieval with Group Convolutional Metric Learning

Remote sensing image retrieval (RSIR) is the process of ranking database...

Improving Collaborative Metric Learning with Efficient Negative Sampling

Distance metric learning based on triplet loss has been applied with suc...

Please sign up or login with your details

Forgot password? Click here to reset