Dense Reconstruction of Transparent Objects by Altering Incident Light Paths Through Refraction

05/20/2021
by   Kai Han, et al.
0

This paper addresses the problem of reconstructing the surface shape of transparent objects. The difficulty of this problem originates from the viewpoint dependent appearance of a transparent object, which quickly makes reconstruction methods tailored for diffuse surfaces fail disgracefully. In this paper, we introduce a fixed viewpoint approach to dense surface reconstruction of transparent objects based on refraction of light. We present a simple setup that allows us to alter the incident light paths before light rays enter the object by immersing the object partially in a liquid, and develop a method for recovering the object surface through reconstructing and triangulating such incident light paths. Our proposed approach does not need to model the complex interactions of light as it travels through the object, neither does it assume any parametric form for the object shape nor the exact number of refractions and reflections taken place along the light paths. It can therefore handle transparent objects with a relatively complex shape and structure, with unknown and inhomogeneous refractive index. We also show that for thin transparent objects, our proposed acquisition setup can be further simplified by adopting a single refraction approximation. Experimental results on both synthetic and real data demonstrate the feasibility and accuracy of our proposed approach.

READ FULL TEXT

page 2

page 7

page 8

page 9

page 10

page 11

page 14

page 16

research
05/09/2018

Full 3D Reconstruction of Transparent Objects

Numerous techniques have been proposed for reconstructing 3D models for ...
research
12/13/2021

N-SfC: Robust and Fast Shape Estimation from Caustic Images

This paper deals with the highly challenging problem of reconstructing t...
research
03/24/2023

Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Container

In this paper, we define a new problem of recovering the 3D geometry of ...
research
09/19/2020

Differentiable Refraction-Tracing for Mesh Reconstruction of Transparent Objects

Capturing the 3D geometry of transparent objects is a challenging task, ...
research
11/16/2021

Active Vapor-Based Robotic Wiper

This paper presents a method of normal estimation for mirrors and transp...
research
03/07/2019

Locating Transparent Objects to Millimetre Accuracy

Transparent surfaces, such as glass, transmit most of the visible light ...
research
04/13/2022

Transparent Shape from Single Polarization Images

This paper presents a data-driven approach for transparent shape from po...

Please sign up or login with your details

Forgot password? Click here to reset