Semantic State Estimation in Cloth Manipulation Tasks

03/22/2022
by   Georgies Tzelepis, et al.
Universitat Politècnica de Catalunya
Högskolan i Halmstad
4

Understanding of deformable object manipulations such as textiles is a challenge due to the complexity and high dimensionality of the problem. Particularly, the lack of a generic representation of semantic states (e.g., crumpled, diagonally folded) during a continuous manipulation process introduces an obstacle to identify the manipulation type. In this paper, we aim to solve the problem of semantic state estimation in cloth manipulation tasks. For this purpose, we introduce a new large-scale fully-annotated RGB image dataset showing various human demonstrations of different complicated cloth manipulations. We provide a set of baseline deep networks and benchmark them on the problem of semantic state estimation using our proposed dataset. Furthermore, we investigate the scalability of our semantic state estimation framework in robot monitoring tasks of long and complex cloth manipulations.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

07/20/2022

Learning Deformable Object Manipulation from Expert Demonstrations

We present a novel Learning from Demonstration (LfD) method, Deformable ...
09/26/2018

Robust Shape Estimation for 3D Deformable Object Manipulation

Existing shape estimation methods for deformable object manipulation suf...
09/28/2017

Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrations

Dexterous multi-fingered hands are extremely versatile and provide a gen...
09/14/2022

The dGLI Cloth Coordinates: A Topological Representation for Semantic Classification of Cloth States

Robotic manipulation of cloth is a highly complex task because of its in...
07/16/2022

Scene Graph for Embodied Exploration in Cluttered Scenario

The ability to handle objects in cluttered environment has been long ant...
10/06/2022

Embodied Referring Expression for Manipulation Question Answering in Interactive Environment

Embodied agents are expected to perform more complicated tasks in an int...
10/18/2016

Semantic Decomposition and Recognition of Long and Complex Manipulation Action Sequences

Understanding continuous human actions is a non-trivial but important pr...

Code Repositories

state-estimation-for-continuous-cloth-manipulation

A fully labelled dataset for Scemantic States of cloth manipulation tasks


view repo

Please sign up or login with your details

Forgot password? Click here to reset