Uncertainty-Aware Self-Supervised Target-Mass Grasping of Granular Foods

by   Kuniyuki Takahashi, et al.

Food packing industry workers typically pick a target amount of food by hand from a food tray and place them in containers. Since menus are diverse and change frequently, robots must adapt and learn to handle new foods in a short time-span. Learning to grasp a specific amount of granular food requires a large training dataset, which is challenging to collect reasonably quickly. In this study, we propose ways to reduce the necessary amount of training data by augmenting a deep neural network with models that estimate its uncertainty through self-supervised learning. To further reduce human effort, we devise a data collection system that automatically generates labels. We build on the idea that we can grasp sufficiently well if there is at least one low-uncertainty (high-confidence) grasp point among the various grasp point candidates. We evaluate the methods we propose in this work on a variety of granular foods – coffee beans, rice, oatmeal and peanuts – each of which has a different size, shape and material properties such as volumetric mass density or friction. For these foods, we show significantly improved grasp accuracy of user-specified target masses using smaller datasets by incorporating uncertainty.


page 1

page 4


Target-mass Grasping of Entangled Food using Pre-grasping Post-grasping

Food packing industries typically use seasonal ingredients with immense ...

Self-Supervised Visual Representation Learning on Food Images

Food image analysis is the groundwork for image-based dietary assessment...

Cluttered Food Grasping with Adaptive Fingers and Synthetic-Data Trained Object Detection

The food packaging industry handles an immense variety of food products ...

A self-supervised learning-based 6-DOF grasp planning method for manipulator

To realize a robust robotic grasping system for unknown objects in an un...

Improving Data Efficiency of Self-supervised Learning for Robotic Grasping

Given the task of learning robotic grasping solely based on a depth came...

Deep Differentiable Grasp Planner for High-DOF Grippers

We present an end-to-end algorithm for training deep neural networks to ...

Please sign up or login with your details

Forgot password? Click here to reset