Optimal Transport for Unsupervised Restoration Learning

by   Wei Wang, et al.

Recently, much progress has been made in unsupervised restoration learning. However, existing methods more or less rely on some assumptions on the signal and/or degradation model, which limits their practical performance. How to construct an optimal criterion for unsupervised restoration learning without any prior knowledge on the degradation model is still an open question. Toward answering this question, this work proposes a criterion for unsupervised restoration learning based on the optimal transport theory. This criterion has favorable properties, e.g., approximately maximal preservation of the information of the signal, whilst achieving perceptual reconstruction. Furthermore, though a relaxed unconstrained formulation is used in practical implementation, we show that the relaxed formulation in theory has the same solution as the original constrained formulation. Experiments on synthetic and real-world data, including realistic photographic, microscopy, depth, and raw depth images, demonstrate that the proposed method even compares favorably with supervised methods, e.g., approaching the PSNR of supervised methods while having better perceptual quality. Particularly, for spatially correlated noise and realistic microscopy images, the proposed method not only achieves better perceptual quality but also has higher PSNR than supervised methods. Besides, it shows remarkable superiority in harsh practical conditions with complex noise, e.g., raw depth images.


page 17

page 18

page 20

page 28

page 29

page 30

page 31

page 33


Sparsity-Aware Optimal Transport for Unsupervised Restoration Learning

Recent studies show that, without any prior model, the unsupervised rest...

HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration

Robust vision restoration for an underwater image remains a challenging ...

Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restoration

We propose an image restoration algorithm that can control the perceptua...

Learning Invariant Representation for Unsupervised Image Restoration

Recently, cross domain transfer has been applied for unsupervised image ...

Perceptual Image Restoration with High-Quality Priori and Degradation Learning

Perceptual image restoration seeks for high-fidelity images that most li...

Robust Unsupervised StyleGAN Image Restoration

GAN-based image restoration inverts the generative process to repair ima...

Efficient Unpaired Image Dehazing with Cyclic Perceptual-Depth Supervision

Image dehazing without paired haze-free images is of immense importance,...

Please sign up or login with your details

Forgot password? Click here to reset