Volume Rendering of Neural Implicit Surfaces

06/22/2021
by   Lior Yariv, et al.
6

Neural volume rendering became increasingly popular recently due to its success in synthesizing novel views of a scene from a sparse set of input images. So far, the geometry learned by neural volume rendering techniques was modeled using a generic density function. Furthermore, the geometry itself was extracted using an arbitrary level set of the density function leading to a noisy, often low fidelity reconstruction. The goal of this paper is to improve geometry representation and reconstruction in neural volume rendering. We achieve that by modeling the volume density as a function of the geometry. This is in contrast to previous work modeling the geometry as a function of the volume density. In more detail, we define the volume density function as Laplace's cumulative distribution function (CDF) applied to a signed distance function (SDF) representation. This simple density representation has three benefits: (i) it provides a useful inductive bias to the geometry learned in the neural volume rendering process; (ii) it facilitates a bound on the opacity approximation error, leading to an accurate sampling of the viewing ray. Accurate sampling is important to provide a precise coupling of geometry and radiance; and (iii) it allows efficient unsupervised disentanglement of shape and appearance in volume rendering. Applying this new density representation to challenging scene multiview datasets produced high quality geometry reconstructions, outperforming relevant baselines. Furthermore, switching shape and appearance between scenes is possible due to the disentanglement of the two.

READ FULL TEXT

page 2

page 4

page 6

page 7

page 8

page 9

page 12

page 13

research
06/20/2021

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction

We present a novel neural surface reconstruction method, called NeuS, fo...
research
11/25/2022

NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies

We present a novel method, called NeuralUDF, for reconstructing surfaces...
research
08/29/2022

Volume Rendering Digest (for NeRF)

Neural Radiance Fields employ simple volume rendering as a way to overco...
research
03/26/2023

Clean-NeRF: Reformulating NeRF to account for View-Dependent Observations

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel vi...
research
12/17/2020

Neural Volume Rendering: NeRF And Beyond

Besides the COVID-19 pandemic and political upheaval in the US, 2020 was...
research
07/27/2021

Differentiable Direct Volume Rendering

We present a differentiable volume rendering solution that provides diff...
research
12/17/2021

Improving neural implicit surfaces geometry with patch warping

Neural implicit surfaces have become an important technique for multi-vi...

Please sign up or login with your details

Forgot password? Click here to reset