Exploring Convolutional Networks for End-to-End Visual Servoing

06/10/2017
by   Aseem Saxena, et al.
0

Present image based visual servoing approaches rely on extracting hand crafted visual features from an image. Choosing the right set of features is important as it directly affects the performance of any approach. Motivated by recent breakthroughs in performance of data driven methods on recognition and localization tasks, we aim to learn visual feature representations suitable for servoing tasks in unstructured and unknown environments. In this paper, we present an end-to-end learning based approach for visual servoing in diverse scenes where the knowledge of camera parameters and scene geometry is not available a priori. This is achieved by training a convolutional neural network over color images with synchronised camera poses. Through experiments performed in simulation and on a quadrotor, we demonstrate the efficacy and robustness of our approach for a wide range of camera poses in both indoor as well as outdoor environments.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

research
03/16/2021

Back to the Feature: Learning Robust Camera Localization from Pixels to Pose

Camera pose estimation in known scenes is a 3D geometry task recently ta...
research
07/31/2017

Camera Relocalization by Computing Pairwise Relative Poses Using Convolutional Neural Network

We propose a new deep learning based approach for camera relocalization....
research
08/19/2019

UprightNet: Geometry-Aware Camera Orientation Estimation from Single Images

We introduce UprightNet, a learning-based approach for estimating 2DoF c...
research
02/18/2019

A Generative Map for Image-based Camera Localization

In image-based camera localization systems, information about the enviro...
research
03/21/2019

Levelling the Playing Field: A Comprehensive Comparison of Visual Place Recognition Approaches under Changing Conditions

In recent years there has been significant improvement in the capability...
research
01/29/2019

Visual Rhythm Prediction with Feature-Aligning Network

In this paper, we propose a data-driven visual rhythm prediction method,...
research
05/10/2021

Validation of image systems simulation technology using a Cornell Box

We describe and experimentally validate an end-to-end simulation of a di...

Please sign up or login with your details

Forgot password? Click here to reset