Depth360: Monocular Depth Estimation using Learnable Axisymmetric Camera Model for Spherical Camera Image

10/20/2021
by   Noriaki Hirose, et al.
0

Self-supervised monocular depth estimation has been widely investigated to estimate depth images and relative poses from RGB images. This framework is attractive for researchers because the depth and pose networks can be trained from just time sequence images without the need for the ground truth depth and poses. In this work, we estimate the depth around a robot (360 degree view) using time sequence spherical camera images, from a camera whose parameters are unknown. We propose a learnable axisymmetric camera model which accepts distorted spherical camera images with two fisheye camera images. In addition, we trained our models with a photo-realistic simulator to generate ground truth depth images to provide supervision. Moreover, we introduced loss functions to provide floor constraints to reduce artifacts that can result from reflective floor surfaces. We demonstrate the efficacy of our method using the spherical camera images from the GO Stanford dataset and pinhole camera images from the KITTI dataset to compare our method's performance with that of baseline method in learning the camera parameters.

READ FULL TEXT

page 1

page 2

page 5

page 6

research
08/22/2023

WS-SfMLearner: Self-supervised Monocular Depth and Ego-motion Estimation on Surgical Videos with Unknown Camera Parameters

Depth estimation in surgical video plays a crucial role in many image-gu...
research
01/16/2019

Lightweight Markerless Monocular Face Capture with 3D Spatial Priors

We present a simple lightweight markerless facial performance capture fr...
research
05/23/2019

Depth Estimation on Underwater Omni-directional Images Using a Deep Neural Network

In this work, we exploit a depth estimation Fully Convolutional Residual...
research
09/16/2019

360^o Surface Regression with a Hyper-Sphere Loss

Omnidirectional vision is becoming increasingly relevant as more efficie...
research
07/27/2023

GET3D–: Learning GET3D from Unconstrained Image Collections

The demand for efficient 3D model generation techniques has grown expone...
research
12/27/2021

Depth estimation of endoscopy using sim-to-real transfer

In order to use the navigation system effectively, distance information ...
research
03/14/2023

One scalar is all you need – absolute depth estimation using monocular self-supervision

Self-supervised monocular depth estimators can be trained or fine-tuned ...

Please sign up or login with your details

Forgot password? Click here to reset