Polarimetric Inverse Rendering for Transparent Shapes Reconstruction

by   Mingqi Shao, et al.
Tsinghua University

In this work, we propose a novel method for the detailed reconstruction of transparent objects by exploiting polarimetric cues. Most of the existing methods usually lack sufficient constraints and suffer from the over-smooth problem. Hence, we introduce polarization information as a complementary cue. We implicitly represent the object's geometry as a neural network, while the polarization render is capable of rendering the object's polarization images from the given shape and illumination configuration. Direct comparison of the rendered polarization images to the real-world captured images will have additional errors due to the transmission in the transparent object. To address this issue, the concept of reflection percentage which represents the proportion of the reflection component is introduced. The reflection percentage is calculated by a ray tracer and then used for weighting the polarization loss. We build a polarization dataset for multi-view transparent shapes reconstruction to verify our method. The experimental results show that our method is capable of recovering detailed shapes and improving the reconstruction quality of transparent objects. Our dataset and code will be publicly available at https://github.com/shaomq2187/TransPIR.


page 1

page 3

page 5

page 6

page 7


Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Container

In this paper, we define a new problem of recovering the 3D geometry of ...

Through the Looking Glass: Neural 3D Reconstruction of Transparent Shapes

Recovering the 3D shape of transparent objects using a small number of u...

Transparent Shape from Single Polarization Images

This paper presents a data-driven approach for transparent shape from po...

A4T: Hierarchical Affordance Detection for Transparent Objects Depth Reconstruction and Manipulation

Transparent objects are widely used in our daily lives and therefore rob...

NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images

We present a neural rendering-based method called NeRO for reconstructin...

3D shape reconstruction of semi-transparent worms

3D shape reconstruction typically requires identifying object features o...

NeAT: Neural Adaptive Tomography

In this paper, we present Neural Adaptive Tomography (NeAT), the first a...

Please sign up or login with your details

Forgot password? Click here to reset