Tell me what this is: Few-Shot Incremental Object Learning by a Robot

by   Ali Ayub, et al.
Penn State University

For many applications, robots will need to be incrementally trained to recognize the specific objects needed for an application. This paper presents a practical system for incrementally training a robot to recognize different object categories using only a small set of visual examples provided by a human. The paper uses a recently developed state-of-the-art method for few-shot incremental learning of objects. After learning the object classes incrementally, the robot performs a table cleaning task organizing objects into categories specified by the human. We also demonstrate the system's ability to learn arrangements of objects and predict missing or incorrectly placed objects. Experimental evaluations demonstrate that our approach achieves nearly the same performance as a system trained with all examples at one time (batch training), which constitutes a theoretical upper bound.


F-SIOL-310: A Robotic Dataset and Benchmark for Few-Shot Incremental Object Learning

Deep learning has achieved remarkable success in object recognition task...

Interactive and Incremental Learning of Spatial Object Relations from Human Demonstrations

Humans use semantic concepts such as spatial relations between objects t...

CBCL-PR: A Cognitively Inspired Model for Class-Incremental Learning in Robotics

For most real-world applications, robots need to adapt and learn continu...

Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and System

Text classification is usually studied by labeling natural language text...

Incremental Robot Learning of New Objects with Fixed Update Time

We consider object recognition in the context of lifelong learning, wher...

Contrastive Learning for Cross-Domain Open World Recognition

The ability to evolve is fundamental for any valuable autonomous agent w...

Active Class Selection for Few-Shot Class-Incremental Learning

For real-world applications, robots will need to continually learn in th...

Please sign up or login with your details

Forgot password? Click here to reset