ShadowNeuS: Neural SDF Reconstruction by Shadow Ray Supervision

by   Jingwang Ling, et al.

By supervising camera rays between a scene and multi-view image planes, NeRF reconstructs a neural scene representation for the task of novel view synthesis. On the other hand, shadow rays between the light source and the scene have yet to be considered. Therefore, we propose a novel shadow ray supervision scheme that optimizes both the samples along the ray and the ray location. By supervising shadow rays, we successfully reconstruct a neural SDF of the scene from single-view pure shadow or RGB images under multiple lighting conditions. Given single-view binary shadows, we train a neural network to reconstruct a complete scene not limited by the camera's line of sight. By further modeling the correlation between the image colors and the shadow rays, our technique can also be effectively extended to RGB inputs. We compare our method with previous works on challenging tasks of shape reconstruction from single-view binary shadow or RGB images and observe significant improvements. The code and data will be released.


page 7

page 8

page 12

page 15

page 16

page 17

page 18

page 19


MixNeRF: Modeling a Ray with Mixture Density for Novel View Synthesis from Sparse Inputs

Neural Radiance Field (NeRF) has broken new ground in the novel view syn...

Ray-ONet: Efficient 3D Reconstruction From A Single RGB Image

We propose Ray-ONet to reconstruct detailed 3D models from monocular ima...

3D Reconstruction of Simple Objects from A Single View Silhouette Image

While recent deep neural networks have achieved promising results for 3D...

Occupancy Planes for Single-view RGB-D Human Reconstruction

Single-view RGB-D human reconstruction with implicit functions is often ...

Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields

Existing 3D scene stylization methods employ an arbitrary style referenc...

OmniVoxel: A Fast and Precise Reconstruction Method of Omnidirectional Neural Radiance Field

This paper proposes a method to reconstruct the neural radiance field wi...

Seeing the World in a Bag of Chips

We address the dual problems of novel view synthesis and environment rec...

Please sign up or login with your details

Forgot password? Click here to reset