Self-Supervised Monocular Depth Estimation with Internal Feature Fusion

10/18/2021
by   Hang Zhou, et al.
6

Self-supervised learning for depth estimation uses geometry in image sequences for supervision and shows promising results. Like many computer vision tasks, depth network performance is determined by the capability to learn accurate spatial and semantic representations from images. Therefore, it is natural to exploit semantic segmentation networks for depth estimation. In this work, based on a well-developed semantic segmentation network HRNet, we propose a novel depth estimation networkDIFFNet, which can make use of semantic information in down and upsampling procedures. By applying feature fusion and an attention mechanism, our proposed method outperforms the state-of-the-art monocular depth estimation methods on the KITTI benchmark. Our method also demonstrates greater potential on higher resolution training data. We propose an additional extended evaluation strategy by establishing a test set of challenging cases, empirically derived from the standard benchmark.

READ FULL TEXT

page 1

page 6

page 9

page 10

research
04/01/2020

The Edge of Depth: Explicit Constraints between Segmentation and Depth

In this work we study the mutual benefits of two common computer vision ...
research
10/24/2021

X-Distill: Improving Self-Supervised Monocular Depth via Cross-Task Distillation

In this paper, we propose a novel method, X-Distill, to improve the self...
research
12/12/2022

ROIFormer: Semantic-Aware Region of Interest Transformer for Efficient Self-Supervised Monocular Depth Estimation

The exploration of mutual-benefit cross-domains has shown great potentia...
research
04/14/2023

Self-Supervised Learning based Depth Estimation from Monocular Images

Depth Estimation has wide reaching applications in the field of Computer...
research
07/15/2020

P2D: a self-supervised method for depth estimation from polarimetry

Monocular depth estimation is a recurring subject in the field of comput...
research
03/14/2018

Self-Supervised Monocular Image Depth Learning and Confidence Estimation

Convolutional Neural Networks (CNNs) need large amounts of data with gro...
research
08/10/2023

Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Network

Monocular depth estimation is known as an ill-posed task in which object...

Please sign up or login with your details

Forgot password? Click here to reset