Self-calibrating Deep Photometric Stereo Networks

03/18/2019
by   Guanying Chen, et al.
26

This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of specific reflectances and light source distributions, our method is able to determine both shape and light directions of a scene with unknown arbitrary reflectances observed under unknown varying light directions. To achieve this goal, we propose a two-stage deep learning architecture, called SDPS-Net, which can effectively take advantage of intermediate supervision, resulting in reduced learning difficulty compared to a single-stage model. Experiments on both synthetic and real datasets show that our proposed approach significantly outperforms previous uncalibrated photometric stereo methods.

READ FULL TEXT

page 3

page 5

page 7

page 8

research
07/26/2020

Deep Photometric Stereo for Non-Lambertian Surfaces

This paper addresses the problem of photometric stereo, in both calibrat...
research
08/30/2018

CNN-PS: CNN-based Photometric Stereo for General Non-Convex Surfaces

Most conventional photometric stereo algorithms inversely solve a BRDF-b...
research
07/11/2022

Edge-preserving Near-light Photometric Stereo with Neural Surfaces

This paper presents a near-light photometric stereo method that faithful...
research
07/16/2022

Self-calibrating Photometric Stereo by Neural Inverse Rendering

This paper tackles the task of uncalibrated photometric stereo for 3D ob...
research
11/28/2022

NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition

Multispectral photometric stereo(MPS) aims at recovering the surface nor...
research
07/23/2018

PS-FCN: A Flexible Learning Framework for Photometric Stereo

This paper addresses the problem of photometric stereo for non-Lambertia...
research
03/26/2018

Semantic See-Through Rendering on Light Fields

We present a novel semantic light field (LF) refocusing technique that c...

Please sign up or login with your details

Forgot password? Click here to reset