Polarized Color Image Denoising using Pocoformer

07/01/2022
by   Zhuoxiao Li, et al.
0

Polarized color photography provides both visual textures and object surficial information in one single snapshot. However, the use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging. Thus, the feature essentially leads to unpleasant noisy images and destroys polarization analysis performance. It is a challenge for traditional image processing pipelines owing to the fact that the physical constraints exerted implicitly in the channels are excessively complicated. To address this issue, we propose a learning-based approach to simultaneously restore clean signals and precise polarization information. A real-world polarized color image dataset of paired raw short-exposed noisy and long-exposed reference images are captured to support the learning-based pipeline. Moreover, we embrace the development of vision Transformer and propose a hybrid transformer model for the Polarized Color image denoising, namely PoCoformer, for a better restoration performance. Abundant experiments demonstrate the effectiveness of proposed method and key factors that affect results are analyzed.

READ FULL TEXT

page 2

page 5

page 6

page 11

page 12

page 14

page 15

research
04/04/2019

Noise-Level Estimation from Single Color Image Using Correlations Between Textures in RGB Channels

We propose a simple method for estimating noise level from a single colo...
research
05/08/2023

Real-World Denoising via Diffusion Model

Real-world image denoising is an extremely important image processing pr...
research
04/24/2020

A Review of an Old Dilemma: Demosaicking First, or Denoising First?

Image denoising and demosaicking are the most important early stages in ...
research
09/09/2020

NTGAN: Learning Blind Image Denoising without Clean Reference

Recent studies on learning-based image denoising have achieved promising...
research
01/25/2021

Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Images

Denoising and demosaicking are essential yet correlated steps to reconst...
research
03/20/2022

CRISPnet: Color Rendition ISP Net

Image signal processors (ISPs) are historically grown legacy software sy...
research
08/31/2022

ELMformer: Efficient Raw Image Restoration with a Locally Multiplicative Transformer

In order to get raw images of high quality for downstream Image Signal P...

Please sign up or login with your details

Forgot password? Click here to reset