Supermarket Commodity Recognition Method Based on Deep Learning

A deep learning and commodity technology, applied in the field of image processing, can solve the problems of information loss, inability to meet, and reduce the recognition accuracy, and achieve the effect of improving the accuracy and improving the recognition accuracy.

Active Publication Date: 2022-03-04
XIDIAN UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method still cannot be applied to the identification of supermarket shelf products. The reasons are: 1. When this method performs ROI pooling on the feature vector of the candidate region, it will cause more target information loss. When the shelf product size is small, The recognition accuracy will be reduced; 2. This method is based on statistical recognition methods. There will often be new products in the supermarket and old products will be eliminated. Therefore, the classifier needs to be continuously retrained, which cannot meet the needs of real scenarios.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Supermarket Commodity Recognition Method Based on Deep Learning
  • Supermarket Commodity Recognition Method Based on Deep Learning
  • Supermarket Commodity Recognition Method Based on Deep Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] ginseng figure 1 , to further describe in detail the implementation steps of the present invention.

[0028] Step 1. Product target area detection.

[0029] 1.1) Collect 3,000 pictures of shelves containing different commodities through mobile devices in major supermarkets;

[0030] 1.2) By manually labeling all commodity target windows and categories in the shelf picture, the commodity target area is expressed as (x 1 ,y 1 ,x 2 ,y 2 ), and then classify the products according to their shape and purpose. In this example, the products are divided into 31 categories: miscellaneous tools, bottled cleaning supplies, bottled beverages, bottled seasonings, bottled wine, bottled toiletries, bottled snacks, bagged seasonings, Snacks in bags, ingredients in bags, paper towels in bags, cleaning supplies in bags, daily necessities in bags, canned food, canned drinks, canned milk powder, canned wine, boxed snacks, boxed toys, boxed drinks, boxed Daily necessities, boxed toile...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention proposes a deep learning-based supermarket product target recognition method, which solves the problem of low recognition rate in real supermarket scenes in the prior art. The implementation plan is: 1) Make a supermarket shelf product training set; 2) Build a product detection network and perform training on the produced training set; 3) Input the shelf picture into the trained network model to get all the product targets in the picture 4) Use the output of the last convolutional layer in the network model as the feature of the commodity target; 5) Encode the commodity feature to obtain the commodity descriptor; 6) Calculate the commodity descriptor and the commodity model descriptor in the existing model library 7) Take the most similar product model as the recognition result. The invention can accurately detect the product target area in the shelf picture, and can correctly identify the product target, and can be used for supermarket shelf product management.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a method for recognizing a shelf commodity target, which can be applied to supermarket shelf commodity management. Background technique [0002] In supermarkets, merchants and consumers need to obtain information about commodities on the shelves in real time. At present, the relevant information of these commodities is obtained manually, but the number of commodities in the supermarket is huge, and the way of manually obtaining commodity information is high in cost and low in efficiency. Therefore, the method of commodity recognition based on vision has important research significance and commercial value. [0003] The core of supermarket commodity recognition is target detection and recognition. Shaoqing Ren et al. published the paper "Faster R-CNN: Towards Real-Time Object Detection with Region ProposalNetworks" (IEEE Transactions on Pattern Analysis&Machin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06V20/10G06V10/764G06V10/772G06V10/74G06V10/82G06K9/62
CPCG06F18/28G06F18/22G06F18/2413
Inventor 董伟生蒋剑锋石光明袁鹏
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products