An Improved Deep Learning Approach For Product Recognition on Racks in Retail Stores

02/26/2022
by   Ankit Sinha, et al.
14

Automated product recognition in retail stores is an important real-world application in the domain of Computer Vision and Pattern Recognition. In this paper, we consider the problem of automatically identifying the classes of the products placed on racks in retail stores from an image of the rack and information about the query/product images. We improve upon the existing approaches in terms of effectiveness and memory requirement by developing a two-stage object detection and recognition pipeline comprising of a Faster-RCNN-based object localizer that detects the object regions in the rack image and a ResNet-18-based image encoder that classifies the detected regions into the appropriate classes. Each of the models is fine-tuned using appropriate data sets for better prediction and data augmentation is performed on each query image to prepare an extensive gallery set for fine-tuning the ResNet-18-based product recognition model. This encoder is trained using a triplet loss function following the strategy of online-hard-negative-mining for improved prediction. The proposed models are lightweight and can be connected in an end-to-end manner during deployment for automatically identifying each product object placed in a rack image. Extensive experiments using Grozi-32k and GP-180 data sets verify the effectiveness of the proposed model.

READ FULL TEXT

page 2

page 6

page 9

page 10

research
11/14/2022

Supervised Fine-tuning Evaluation for Long-term Visual Place Recognition

In this paper, we present a comprehensive study on the utility of deep c...
research
09/24/2019

Synthetic dataset generation for object-to-model deep learning in industrial applications

The availability of large image data sets has been a crucial factor in t...
research
11/19/2018

Scalable Logo Recognition using Proxies

Logo recognition is the task of identifying and classifying logos. Logo ...
research
10/03/2018

A deep learning pipeline for product recognition in store shelves

Recognition of grocery products in store shelves poses peculiar challeng...
research
05/17/2018

Identifying Object States in Cooking-Related Images

Understanding object states is as important as object recognition for ro...
research
10/03/2018

A deep learning pipeline for product recognition on store shelves

Recognition of grocery products in store shelves poses peculiar challeng...
research
06/04/2021

Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators

This paper presents a novel pre-trained language models (PLM) compressio...

Please sign up or login with your details

Forgot password? Click here to reset