Binocular vision technology adopted commodity identification algorithm for unmanned vending counter

A technology of binocular vision and recognition algorithm, applied in the field of commodity recognition algorithm, can solve the problems such as occlusion and perspective cannot be solved, commodity recognition accuracy is not high, commodity recognition is difficult, etc., to reduce commodity occlusion or perspective, improve recognition effect, save money The effect of settlement time

Inactive Publication Date: 2018-12-07
武汉市哈哈便利科技有限公司
View PDF9 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage of this patent is that a single camera is used to take pictures of the product, and the product recognition accuracy is not high
[0004] Most of the existing unmanned vending containers are small containers. One camera can capture all the goods in the container, and it is not easy to cause perspective distortion. However, when the container is larger, one camera will make it easier to The captured image is severely distorted, which will bring great difficulties to subsequent product identification
To solve this problem, most of the existing technologies use cameras with a wider field of view, which can solve the problem of too large container scenes to a certain extent, but problems such as occlusion and perspective cannot be solved
[0005] In order to solve the problem that the monocular camera is easy to cause image distortion when taking pictures of the goods in the large container, this invention proposes a solution that uses the binocular camera to take pictures and jointly identify the goods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binocular vision technology adopted commodity identification algorithm for unmanned vending counter
  • Binocular vision technology adopted commodity identification algorithm for unmanned vending counter
  • Binocular vision technology adopted commodity identification algorithm for unmanned vending counter

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0035]As shown in the figure, a commodity recognition algorithm using binocular vision technology for unmanned vending cabinets is provided. The unmanned vending cabinet includes multi-layer shelves, and two cameras are arranged on each shelf, that is, the left camera and the right camera. Position, the shooting field of view of the two cameras covers the entire shelf, which can take a more complete picture of the products in the shelf, and reduce the occurrence of product occlusion and perspective phenomena. Each shelf is provided with a product maximum line (ie, a product Max line), and the height of the products in the shelf cannot exceed the product maximum line. The unmanned vending cabinet also includes a controller and a communication module, and the communication module is used for communication connection between the unmanned vending cabinet and a remote server, and the remote server includes a storage module and a processing module, and the storage module Commodity ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A binocular vision technology adopted commodity identification algorithm for an unmanned vending counter comprises the following steps: preparing data; building a training model, wherein the trainingmodel adopts a yolo v3 model based on a TensorFlow framework; verifying the above model. and determining whether a training result meets expectation; if the expectation is not met, adjusting parameters to perform optimization, and repeatedly executing training process to perform retraining; if the expectation is achieved, deploying the trained yolo v3 model to perform identification of a target commodity; and obtaining images of the target commodity to be identified by utilizing binocular cameras on the unmanned vending counter, and inputting the images to the trained yolo v3 model to identifythe target commodity out. Image acquisition is performed by the binocular cameras, and commodity occlusion or perspective conditions are reduced; target detection is performed by the yolo v3 model, the difficulty and the calculation amount of the identification algorithm are reduced; and the identification accuracy is improved by adding different scales for the target detection, and the good effect of identification on small target commodities is achieved.

Description

technical field [0001] The invention relates to the technical field of unmanned vending cabinets and image recognition, in particular to a product recognition algorithm using binocular vision technology for unmanned vending cabinets. Background technique [0002] At present, many smart vending or self-service settlement systems simply identify individual commodities. This method is very simple, but it also brings a lot of inconvenience to users. For example, users need to send commodities one by one to the camera for shooting. area, the wait time is too long. Multi-commodity identification will greatly facilitate users. Users do not need to send products to fixed areas for identification in sequence. They only need to take away the products and the system will automatically settle the payment. However, the current method of using a single camera (monocular) to take pictures and identify multiple commodities usually limits the size of the container where the commodities are ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G07F11/00
CPCG07F9/002G06F18/214
Inventor 张运辉方无迪唐开蔡丁丁刘钰涛
Owner 武汉市哈哈便利科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products