Improving Robotic Grasping on Monocular Images Via Multi-Task Learning and Positional Loss

11/05/2020
by   William Prew, et al.
13

In this paper, we introduce two methods of improving real-time object grasping performance from monocular colour images in an end-to-end CNN architecture. The first is the addition of an auxiliary task during model training (multi-task learning). Our multi-task CNN model improves grasping performance from a baseline average of 72.04 grasping dataset when performing a supplementary depth reconstruction task. The second is introducing a positional loss function that emphasises loss per pixel for secondary parameters (gripper angle and width) only on points of an object where a successful grasp can take place. This increases performance from a baseline average of 72.04 epochs required. These methods can be also performed in tandem resulting in a further performance increase to 79.12 speed to afford real-time grasp processing.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
07/06/2017

End-to-End Learning of Semantic Grasping

We consider the task of semantic robotic grasping, in which a robot pick...
research
10/17/2017

Multi-task Domain Adaptation for Deep Learning of Instance Grasping from Simulation

Learning-based approaches to robotic manipulation are limited by the sca...
research
03/01/2019

Improving Data Efficiency of Self-supervised Learning for Robotic Grasping

Given the task of learning robotic grasping solely based on a depth came...
research
09/28/2016

Learning to Push by Grasping: Using multiple tasks for effective learning

Recently, end-to-end learning frameworks are gaining prevalence in the f...
research
03/12/2020

A Multi-task Learning Framework for Grasping-Position Detection and Few-Shot Classification

It is a big problem that a model of deep learning for a picking robot ne...
research
05/25/2020

LyRN (Lyapunov Reaching Network): A Real-Time Closed Loop approach from Monocular Vision

We propose a closed-loop, multi-instance control algorithm for visually ...

Please sign up or login with your details

Forgot password? Click here to reset