Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360° Omnidirectional Image

by   Runmin Cong, et al.

Salient object detection (SOD) aims to determine the most visually attractive objects in an image. With the development of virtual reality technology, 360 omnidirectional image has been widely used, but the SOD task in 360 omnidirectional image is seldom studied due to its severe distortions and complex scenes. In this paper, we propose a Multi-Projection Fusion and Refinement Network (MPFR-Net) to detect the salient objects in 360 omnidirectional image. Different from the existing methods, the equirectangular projection image and four corresponding cube-unfolding images are embedded into the network simultaneously as inputs, where the cube-unfolding images not only provide supplementary information for equirectangular projection image, but also ensure the object integrity of the cube-map projection. In order to make full use of these two projection modes, a Dynamic Weighting Fusion (DWF) module is designed to adaptively integrate the features of different projections in a complementary and dynamic manner from the perspective of inter and intra features. Furthermore, in order to fully explore the way of interaction between encoder and decoder features, a Filtration and Refinement (FR) module is designed to suppress the redundant information between the feature itself and the feature. Experimental results on two omnidirectional datasets demonstrate that the proposed approach outperforms the state-of-the-art methods both qualitatively and quantitatively.


page 1

page 2

page 3

page 4

page 8

page 10

page 11


Progressive Multi-scale Fusion Network for RGB-D Salient Object Detection

Salient object detection(SOD) aims at locating the most significant obje...

Multi-interactive Encoder-decoder Network for RGBT Salient Object Detection

RGBT salient object detection (SOD) aims to segment the common prominent...

EGNet:Edge Guidance Network for Salient Object Detection

Fully convolutional neural networks (FCNs) have shown their advantages i...

Adaptive Graph Convolution Module for Salient Object Detection

Salient object detection (SOD) is a task that involves identifying and s...

Global-and-Local Collaborative Learning for Co-Salient Object Detection

The goal of co-salient object detection (CoSOD) is to discover salient o...

Object Detection in Equirectangular Panorama

We introduced a high-resolution equirectangular panorama (360-degree, vi...

CT-Net: Complementary Transfering Network for Garment Transfer with Arbitrary Geometric Changes

Garment transfer shows great potential in realistic applications with th...

Please sign up or login with your details

Forgot password? Click here to reset