A CNN Based Approach for the Near-Field Photometric Stereo Problem

by   Fotios Logothetis, et al.

Reconstructing the 3D shape of an object using several images under different light sources is a very challenging task, especially when realistic assumptions such as light propagation and attenuation, perspective viewing geometry and specular light reflection are considered. Many of works tackling Photometric Stereo (PS) problems often relax most of the aforementioned assumptions. Especially they ignore specular reflection and global illumination effects. In this work, we propose the first CNN based approach capable of handling these realistic assumptions in Photometric Stereo. We leverage recent improvements of deep neural networks for far-field Photometric Stereo and adapt them to near field setup. We achieve this by employing an iterative procedure for shape estimation which has two main steps. Firstly we train a per-pixel CNN to predict surface normals from reflectance samples. Secondly, we compute the depth by integrating the normal field in order to iteratively estimate light directions and attenuation which is used to compensate the input images to compute reflectance samples for the next iteration. To the best of our knowledge this is the first near-field framework which is able to accurately predict 3D shape from highly specular objects. Our method outperforms competing state-of-the-art near-field Photometric Stereo approaches on both synthetic and real experiments.


page 2

page 4

page 6

page 8

page 9


A CNN Based Approach for the Point-Light Photometric Stereo Problem

Reconstructing the 3D shape of an object using several images under diff...

Fast Light-Weight Near-Field Photometric Stereo

We introduce the first end-to-end learning-based solution to near-field ...

LUCES: A Dataset for Near-Field Point Light Source Photometric Stereo

Three-dimensional reconstruction of objects from shading information is ...

CNN-PS: CNN-based Photometric Stereo for General Non-Convex Surfaces

Most conventional photometric stereo algorithms inversely solve a BRDF-b...

PX-NET: Simple, Efficient Pixel-Wise Training of Photometric Stereo Networks

Retrieving accurate 3D reconstructions of objects from the way they refl...

On the Regularising Levenberg-Marquardt Method for Blinn-Phong Photometric Stereo

Photometric stereo refers to the process to compute the 3D shape of an o...

Self-calibrating Photometric Stereo by Neural Inverse Rendering

This paper tackles the task of uncalibrated photometric stereo for 3D ob...

Please sign up or login with your details

Forgot password? Click here to reset