A Food Package Recognition and Sorting System Based on Structured Light and Deep Learning

by   Xuanzhi Liu, et al.

Vision algorithm-based robotic arm grasping system is one of the robotic arm systems that can be applied to a wide range of scenarios. It uses algorithms to automatically identify the location of the target and guide the robotic arm to grasp it, which has more flexible features than the teachable robotic arm grasping system. However, for some food packages, their transparent packages or reflective materials bring challenges to the recognition of vision algorithms, and traditional vision algorithms cannot achieve high accuracy for these packages. In addition, in the process of robotic arm grasping, the positioning on the z-axis height still requires manual setting of parameters, which may cause errors. Based on the above two problems, we designed a sorting system for food packaging using deep learning algorithms and structured light 3D reconstruction technology. Using a pre-trained MASK R-CNN model to recognize the class of the object in the image and get its 2D coordinates, then using structured light 3D reconstruction technique to calculate its 3D coordinates, and finally after the coordinate system conversion to guide the robotic arm for grasping. After testing, it is shown that the method can fully automate the recognition and grasping of different kinds of food packages with high accuracy. Using this method, it can help food manufacturers to reduce production costs and improve production efficiency.


page 2

page 4

page 5

page 8

page 9


A Secure and Efficient Multi-Object Grasping Detection Approach for Robotic Arms

Robotic arms are widely used in automatic industries. However, with wide...

Learning to Remove Multipath Distortions in Time-of-Flight Range Images for a Robotic Arm Setup

Range images captured by Time-of-Flight (ToF) cameras are corrupted with...

Domestic waste detection and grasping points for robotic picking up

This paper presents an AI system applied to location and robotic graspin...

Target-mass Grasping of Entangled Food using Pre-grasping Post-grasping

Food packing industries typically use seasonal ingredients with immense ...

Robotic Perception in Agri-food Manipulation: A Review

To better optimise the global food supply chain, robotic solutions are n...

An experimental mechatronic design and control of a 5 DOF Robotic arm for identification and sorting of different sized objects

The purpose of this paper is to present the construction and programming...

Phoneme-based speech recognition for commanding the robotic Arm

Controlling a robot still requires traditional user interfaces. A more i...

Please sign up or login with your details

Forgot password? Click here to reset