Breaking Through the Haze: An Advanced Non-Homogeneous Dehazing Method based on Fast Fourier Convolution and ConvNeXt

05/08/2023
by   Han Zhou, et al.
0

Haze usually leads to deteriorated images with low contrast, color shift and structural distortion. We observe that many deep learning based models exhibit exceptional performance on removing homogeneous haze, but they usually fail to address the challenge of non-homogeneous dehazing. Two main factors account for this situation. Firstly, due to the intricate and non uniform distribution of dense haze, the recovery of structural and chromatic features with high fidelity is challenging, particularly in regions with heavy haze. Secondly, the existing small scale datasets for non-homogeneous dehazing are inadequate to support reliable learning of feature mappings between hazy images and their corresponding haze-free counterparts by convolutional neural network (CNN)-based models. To tackle these two challenges, we propose a novel two branch network that leverages 2D discrete wavelete transform (DWT), fast Fourier convolution (FFC) residual block and a pretrained ConvNeXt model. Specifically, in the DWT-FFC frequency branch, our model exploits DWT to capture more high-frequency features. Moreover, by taking advantage of the large receptive field provided by FFC residual blocks, our model is able to effectively explore global contextual information and produce images with better perceptual quality. In the prior knowledge branch, an ImageNet pretrained ConvNeXt as opposed to Res2Net is adopted. This enables our model to learn more supplementary information and acquire a stronger generalization ability. The feasibility and effectiveness of the proposed method is demonstrated via extensive experiments and ablation studies. The code is available at https://github.com/zhouh115/DWT-FFC.

READ FULL TEXT

page 6

page 8

research
04/17/2023

SCANet: Self-Paced Semi-Curricular Attention Network for Non-Homogeneous Image Dehazing

The presence of non-homogeneous haze can cause scene blurring, color dis...
research
03/21/2023

ALOFT: A Lightweight MLP-like Architecture with Dynamic Low-frequency Transform for Domain Generalization

Domain generalization (DG) aims to learn a model that generalizes well t...
research
08/27/2022

LAB-Net: LAB Color-Space Oriented Lightweight Network for Shadow Removal

This paper focuses on the limitations of current over-parameterized shad...
research
12/12/2018

Tree-structured Kronecker Convolutional Network for Semantic Segmentation

Most existing semantic segmentation methods employ atrous convolution to...
research
12/12/2018

Tree-structured Kronecker Convolutional Networks for Semantic Segmentation

Most existing semantic segmentation methods employ atrous convolution to...
research
04/10/2023

FreConv: Frequency Branch-and-Integration Convolutional Networks

Recent researches indicate that utilizing the frequency information of i...
research
12/30/2021

A Novel Generator with Auxiliary Branch for Improving GAN Performance

The generator in the generative adversarial network (GAN) learns image g...

Please sign up or login with your details

Forgot password? Click here to reset