Filtering In Neural Implicit Functions

01/31/2022
by   Yixin Zhuang, et al.
8

Neural implicit functions are highly effective for representing many kinds of data, including images and 3D shapes. However, the implicit functions learned by neural networks usually include over-smoothed patches or noisy artifacts into the results if the data has many scales of details or a wide range of frequencies. Adapting the result containing both noise and over-smoothed regions usually suffers from either over smoothing or noisy issues. To overcome this challenge, we propose a new framework, coined FINN, that integrates a filtering module into the neural network to perform data generation while filtering artifacts. The filtering module has a smoothing operator that acts on the intermediate results of the network and a recovering operator that brings distinct details from the input back to the regions overly smoothed. The proposed method significantly alleviates over smoothing or noisy issues. We demonstrate the advantage of the FINN on the image regression task, considering both real-world and synthetic images, and showcases significant improvement on both quantitative and qualitative results compared to state-of-the-art methods. Moreover, FINN yields better performance in both convergence speed and network stability. Source code is available at https://github.com/yixin26/FINN.

READ FULL TEXT

page 2

page 5

page 6

page 7

page 8

research
03/17/2020

Real-time Image Smoothing via Iterative Least Squares

Edge-preserving image smoothing is a fundamental procedure for many comp...
research
05/09/2023

Restormer-Plus for Real World Image Deraining: One State-of-the-Art Solution to the GT-RAIN Challenge (CVPR 2023 UG^2+ Track 3)

This technical report presents our Restormer-Plus approach, which was su...
research
04/04/2023

IterativePFN: True Iterative Point Cloud Filtering

The quality of point clouds is often limited by noise introduced during ...
research
09/04/2023

Implicit Neural Image Stitching With Enhanced and Blended Feature Reconstruction

Existing frameworks for image stitching often provide visually reasonabl...
research
12/14/2022

Mitigating Artifacts in Real-World Video Super-Resolution Models

The recurrent structure is a prevalent framework for the task of video s...
research
10/16/2021

SAGAN: Adversarial Spatial-asymmetric Attention for Noisy Nona-Bayer Reconstruction

Nona-Bayer colour filter array (CFA) pattern is considered one of the mo...
research
04/02/2019

A Benchmark for Edge-Preserving Image Smoothing

Edge-preserving image smoothing is an important step for many low-level ...

Please sign up or login with your details

Forgot password? Click here to reset