Multi-Attention-Network for Semantic Segmentation of High-Resolution Remote Sensing Images

09/03/2020
by   Rui Li, et al.
5

Semantic segmentation of remote sensing images plays an important role in land resource management, yield estimation, and economic assessment. Even though the semantic segmentation of remote sensing images has been prominently improved by convolutional neural networks, there are still several limitations contained in standard models. First, for encoder-decoder architectures like U-Net, the utilization of multi-scale features causes overuse of information, where similar low-level features are exploited at multiple scales for multiple times. Second, long-range dependencies of feature maps are not sufficiently explored, leading to feature representations associated with each semantic class are not optimal. Third, despite the dot-product attention mechanism has been introduced and harnessed widely in semantic segmentation to model long-range dependencies, the high time and space complexities of attention impede the usage of attention in application scenarios with large input. In this paper, we proposed a Multi-Attention-Network (MANet) to remedy these drawbacks, which extracts contextual dependencies by multi efficient attention mechanisms. A novel attention mechanism named kernel attention with linear complexity is proposed to alleviate the high computational demand of attention. Based on kernel attention and channel attention, we integrate local feature maps extracted by ResNeXt-101 with their corresponding global dependencies, and adaptively signalize interdependent channel maps. Experiments conducted on two remote sensing image datasets captured by variant satellites demonstrate that the performance of our MANet transcends the DeepLab V3+, PSPNet, FastFCN, and other baseline algorithms.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

research
07/26/2020

MACU-Net Semantic Segmentation from High-Resolution Remote Sensing Images

Semantic segmentation of remote sensing images plays an important role i...
research
01/09/2020

HMANet: Hybrid Multiple Attention Network for Semantic Segmentation in Aerial Images

Semantic segmentation in very high resolution (VHR) aerial images is one...
research
09/08/2023

Long-Range Correlation Supervision for Land-Cover Classification from Remote Sensing Images

Long-range dependency modeling has been widely considered in modern deep...
research
09/15/2020

Multi-scale Attention U-Net (MsAUNet): A Modified U-Net Architecture for Scene Segmentation

Despite the growing success of Convolution neural networks (CNN) in the ...
research
11/29/2020

Multi-stage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images

The attention mechanism can refine the extracted feature maps and boost ...
research
06/29/2021

Looking Outside the Window: Wider-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images

Long-range context information is crucial for the semantic segmentation ...

Please sign up or login with your details

Forgot password? Click here to reset