PC-GANs: Progressive Compensation Generative Adversarial Networks for Pan-sharpening

by   Yinghui Xing, et al.

The fusion of multispectral and panchromatic images is always dubbed pansharpening. Most of the available deep learning-based pan-sharpening methods sharpen the multispectral images through a one-step scheme, which strongly depends on the reconstruction ability of the network. However, remote sensing images always have large variations, as a result, these one-step methods are vulnerable to the error accumulation and thus incapable of preserving spatial details as well as the spectral information. In this paper, we propose a novel two-step model for pan-sharpening that sharpens the MS image through the progressive compensation of the spatial and spectral information. Firstly, a deep multiscale guided generative adversarial network is used to preliminarily enhance the spatial resolution of the MS image. Starting from the pre-sharpened MS image in the coarse domain, our approach then progressively refines the spatial and spectral residuals over a couple of generative adversarial networks (GANs) that have reverse architectures. The whole model is composed of triple GANs, and based on the specific architecture, a joint compensation loss function is designed to enable the triple GANs to be trained simultaneously. Moreover, the spatial-spectral residual compensation structure proposed in this paper can be extended to other pan-sharpening methods to further enhance their fusion results. Extensive experiments are performed on different datasets and the results demonstrate the effectiveness and efficiency of our proposed method.


page 6

page 15

page 32

page 33

page 34

page 35


PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening

Remote sensing image fusion (also known as pan-sharpening) aims to gener...

PGMAN: An Unsupervised Generative Multi-adversarial Network for Pan-sharpening

Pan-sharpening aims at fusing a low-resolution (LR) multi-spectral (MS) ...

Unsupervised Cycle-consistent Generative Adversarial Networks for Pan-sharpening

Deep learning based pan-sharpening has received significant research int...

Remote sensing image fusion based on Bayesian GAN

Remote sensing image fusion technology (pan-sharpening) is an important ...

Generative Adversarial Networks for Spatio-Spectral Compression of Hyperspectral Images

Deep learning-based image compression methods have led to high rate-dist...

Synthesis and Edition of Ultrasound Images via Sketch Guided Progressive Growing GANs

Ultrasound (US) is widely accepted in clinic for anatomical structure in...

Please sign up or login with your details

Forgot password? Click here to reset