Photometric Stereo by Hemispherical Metric Embedding

06/25/2017
by   Ofer Bartal, et al.
0

Photometric Stereo methods seek to reconstruct the 3d shape of an object from motionless images obtained with varying illumination. Most existing methods solve a restricted problem where the physical reflectance model, such as Lambertian reflectance, is known in advance. In contrast, we do not restrict ourselves to a specific reflectance model. Instead, we offer a method that works on a wide variety of reflectances. Our approach uses a simple yet uncommonly used property of the problem - the sought after normals are points on a unit hemisphere. We present a novel embedding method that maps pixels to normals on the unit hemisphere. Our experiments demonstrate that this approach outperforms existing manifold learning methods for the task of hemisphere embedding. We further show successful reconstructions of objects from a wide variety of reflectances including smooth, rough, diffuse and specular surfaces, even in the presence of significant attached shadows. Finally, we empirically prove that under these challenging settings we obtain more accurate shape reconstructions than existing methods.

READ FULL TEXT
research
10/18/2019

Toward 3D Object Reconstruction from Stereo Images

Inferring the 3D shape of an object from an RGB image has shown impressi...
research
04/22/2019

DirectShape: Photometric Alignment of Shape Priors for Visual Vehicle Pose and Shape Estimation

3D scene understanding from images is a challenging problem which is enc...
research
03/22/2021

Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo

The problem of estimating a surface shape from its observed reflectance ...
research
03/23/2018

Learning Shape-from-Shading for Deformable Surfaces

Recent years have seen the development of mature solutions for reconstru...
research
12/19/2020

No Shadow Left Behind: Removing Objects and their Shadows using Approximate Lighting and Geometry

Removing objects from images is a challenging problem that is important ...
research
01/17/2021

S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modeling

Constructing and animating humans is an important component for building...
research
05/25/2022

Neural 3D Reconstruction in the Wild

We are witnessing an explosion of neural implicit representations in com...

Please sign up or login with your details

Forgot password? Click here to reset