FS-NCSR: Increasing Diversity of the Super-Resolution Space via Frequency Separation and Noise-Conditioned Normalizing Flow

04/20/2022
by   Ki-Ung Song, et al.
0

Super-resolution suffers from an innate ill-posed problem that a single low-resolution (LR) image can be from multiple high-resolution (HR) images. Recent studies on the flow-based algorithm solve this ill-posedness by learning the super-resolution space and predicting diverse HR outputs. Unfortunately, the diversity of the super-resolution outputs is still unsatisfactory, and the outputs from the flow-based model usually suffer from undesired artifacts which causes low-quality outputs. In this paper, we propose FS-NCSR which produces diverse and high-quality super-resolution outputs using frequency separation and noise conditioning compared to the existing flow-based approaches. As the sharpness and high-quality detail of the image rely on its high-frequency information, FS-NCSR only estimates the high-frequency information of the high-resolution outputs without redundant low-frequency components. Through this, FS-NCSR significantly improves the diversity score without significant image quality degradation compared to the NCSR, the winner of the previous NTIRE 2021 challenge.

READ FULL TEXT

page 3

page 4

page 6

page 7

research
06/06/2021

Noise Conditional Flow Model for Learning the Super-Resolution Space

Fundamentally, super-resolution is ill-posed problem because a low-resol...
research
06/09/2022

A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Maps

To support the application scenarios where high-resolution (HR) images a...
research
06/03/2018

Patch-Based Image Hallucination for Super Resolution with Detail Reconstruction from Similar Sample Images

Image hallucination and super-resolution have been studied for decades, ...
research
05/03/2017

Super-Resolution of Wavelet-Encoded Images

Multiview super-resolution image reconstruction (SRIR) is often cast as ...
research
09/20/2021

DEM Super-Resolution with EfficientNetV2

Efficient climate change monitoring and modeling rely on high-quality ge...
research
03/25/2021

Multi-frame Super-resolution from Noisy Data

Obtaining high resolution images from low resolution data with clipped n...
research
11/04/2019

Single-Frame Super-Resolution of Solar Magnetograms: Investigating Physics-Based Metrics & Losses

Breakthroughs in our understanding of physical phenomena have traditiona...

Please sign up or login with your details

Forgot password? Click here to reset