Supermarket commodity identification method based on deep learning

A deep learning, commodity technology, applied in the field of image processing, can solve problems such as information loss, inability to meet, and reduce recognition accuracy, and achieve the effect of improving accuracy and accuracy.

Active Publication Date: 2018-11-06
XIDIAN UNIV
View PDF6 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method still cannot be applied to the identification of supermarket shelf products. The reasons are: 1. When this method performs ROI pooling on the feature vector of the candidate region, it will cause more target information loss. When the shelf product size is small, The recognition accuracy will be reduced; 2. This method is based on statistical recognition methods. There will often be new products in the supermarket and old products will be eliminated. Therefore, the classifier needs to be continuously retrained, which cannot meet the needs of real scenarios.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Supermarket commodity identification method based on deep learning
  • Supermarket commodity identification method based on deep learning
  • Supermarket commodity identification method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] ginseng figure 1 , to further describe in detail the implementation steps of the present invention.

[0028] Step 1. Product target area detection.

[0029] 1.1) Collect 3,000 pictures of shelves containing different commodities through mobile devices in major supermarkets;

[0030] 1.2) By manually labeling all commodity target windows and categories in the shelf picture, the commodity target area is expressed as (x 1 ,y 1 ,x 2 ,y 2 ), and then classify the products according to their shape and purpose. In this example, the products are divided into 31 categories: miscellaneous tools, bottled cleaning supplies, bottled beverages, bottled seasonings, bottled wine, bottled toiletries, bottled snacks, bagged seasonings, Snacks in bags, ingredients in bags, paper towels in bags, cleaning supplies in bags, daily necessities in bags, canned food, canned drinks, canned milk powder, canned wine, boxed snacks, boxed toys, boxed drinks, boxed Daily necessities, boxed toile...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention puts forward a supermarket commodity identification method based on deep learning, and solves the problem in the prior art that an identification rate is low in a real supermarket scene.The implementation scheme of the method comprises the following steps that: 1) manufacturing a supermarket goods shelf commodity training set; 2) constructing a commodity detection network, and carrying out training on the manufactured training set; 3) inputting a goods shelf picture into a trained network model to obtain all commodity target areas in a picture; 4) taking the output of a last convolutional layer in the network model as the characteristics of a commodity target; 5) coding the commodity characteristic to obtain a commodity descriptor; 6) calculating a similarity of the commodity model descriptor in an existing model library and the commodity descriptor; and 7) taking the most similar commodity model as an identification result. By use of the method, a commodity target areain the goods shelf picture can be accurately detected, in addition, the commodity target can be correctly identified, and the method can be used for managing supermarket goods shelf commodities.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a method for recognizing a shelf commodity target, which can be applied to supermarket shelf commodity management. Background technique [0002] In supermarkets, merchants and consumers need to obtain information about commodities on the shelves in real time. At present, the relevant information of these commodities is obtained manually, but the number of commodities in the supermarket is huge, and the way of manually obtaining commodity information is high in cost and low in efficiency. Therefore, the method of commodity recognition based on vision has important research significance and commercial value. [0003] The core of supermarket commodity recognition is target detection and recognition. Shaoqing Ren et al. published the paper "Faster R-CNN: Towards Real-Time Object Detection with Region ProposalNetworks" (IEEE Transactions on Pattern Analysis&Machin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62
CPCG06F18/28G06F18/22G06F18/2413
Inventor 董伟生蒋剑锋石光明袁鹏
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products