REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter

04/29/2021
by   Hanbo Zhang, et al.
0

Despite the impressive progress achieved in robust grasp detection, robots are not skilled in sophisticated grasping tasks (e.g. search and grasp a specific object in clutter). Such tasks involve not only grasping, but comprehensive perception of the visual world (e.g. the relationship between objects). Recently, the advanced deep learning techniques provide a promising way for understanding the high-level visual concepts. It encourages robotic researchers to explore solutions for such hard and complicated fields. However, deep learning usually means data-hungry. The lack of data severely limits the performance of deep-learning-based algorithms. In this paper, we present a new dataset named to sustain the modeling of relationships among objects and grasps. We collect the annotations of object poses, segmentations, grasps, and relationships in each image for comprehensive perception of grasping. Our dataset is collected in both forms of 2D images and 3D point clouds. Moreover, since all the data are generated automatically, users are free to import their own object models for the generation of as many data as they want. We have released our dataset and codes. A video that demonstrates the process of data generation is also available.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 7

research
03/21/2020

PointNet++ Grasping: Learning An End-to-end Spatial Grasp Generation Algorithm from Sparse Point Clouds

Grasping for novel objects is important for robot manipulation in unstru...
research
01/11/2017

Modeling Grasp Motor Imagery through Deep Conditional Generative Models

Grasping is a complex process involving knowledge of the object, the sur...
research
11/13/2022

PaintNet: 3D Learning of Pose Paths Generators for Robotic Spray Painting

Optimization and planning methods for tasks involving 3D objects often r...
research
12/29/2021

MetaGraspNet: A Large-Scale Benchmark Dataset for Vision-driven Robotic Grasping via Physics-based Metaverse Synthesis

There has been increasing interest in smart factories powered by robotic...
research
12/31/2018

A dataset of 40K naturalistic 6-degree-of-freedom robotic grasp demonstrations

Modern approaches to grasp planning often involve deep learning. However...
research
02/21/2023

Constrained Generative Sampling of 6-DoF Grasps

Most state-of-the-art data-driven grasp sampling methods propose stable ...
research
04/28/2020

Event-based Robotic Grasping Detection with Neuromorphic Vision Sensor and Event-Stream Dataset

Robotic grasping plays an important role in the field of robotics. The c...

Please sign up or login with your details

Forgot password? Click here to reset