Interactive Open-Ended Object, Affordance and Grasp Learning for Robotic Manipulation

by   S. Hamidreza Kasaei, et al.

Service robots are expected to autonomously and efficiently work in human-centric environments. For this type of robots, object perception and manipulation are challenging tasks due to need for accurate and real-time response. This paper presents an interactive open-ended learning approach to recognize multiple objects and their grasp affordances concurrently. This is an important contribution in the field of service robots since no matter how extensive the training data used for batch learning, a robot might always be confronted with an unknown object when operating in human-centric environments. The paper describes the system architecture and the learning and recognition capabilities. Grasp learning associates grasp configurations (i.e., end-effector positions and orientations) to grasp affordance categories. The grasp affordance category and the grasp configuration are taught through verbal and kinesthetic teaching, respectively. A Bayesian approach is adopted for learning and recognition of object categories and an instance-based approach is used for learning and recognition of affordance categories. An extensive set of experiments has been performed to assess the performance of the proposed approach regarding recognition accuracy, scalability and grasp success rate on challenging datasets and real-world scenarios.


page 1

page 2

page 4

page 5

page 6


OrthographicNet: A Deep Learning Approach for 3D Object Recognition in Open-Ended Domains

Service robots are expected to be more autonomous and efficiently work i...

The State of Service Robots: Current Bottlenecks in Object Perception and Manipulation

Service robots are appearing more and more in our daily life. The develo...

ADAMANT: A Pipeline for Adaptable Manipulation Tasks

This paper presents ADAMANT, a set of software modules that provides gra...

Object Perception and Grasping in Open-Ended Domains

Nowadays service robots are leaving the structured and completely known ...

Interactive Open-Ended Learning for 3D Object Recognition

The thesis contributes in several important ways to the research area of...

On Neuromechanical Approaches for the Study of Biological Grasp and Manipulation

Biological and robotic grasp and manipulation are undeniably similar at ...

AI Meets Physical World -- Exploring Robot Cooking

This paper describes our recent research effort to bring the computer in...

Please sign up or login with your details

Forgot password? Click here to reset