Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Dinner plate motion state recognition method based on deep learning

A technology of motion state and recognition method, which is applied in the field of computer vision, can solve the problems of sensor impact recognition, maintenance and update inconvenience, impact, etc., and achieve the effect of reducing development and maintenance costs, facilitating hardware updates, and reducing dependence

Pending Publication Date: 2019-07-30
ZHEJIANG NORMAL UNIVERSITY
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the appeal method will increase the cost because of the use of sensors. At the same time, it will bring great inconvenience to later maintenance and updates. Secondly, the dependence of sensors on the environment will directly affect subsequent recognition.
[0003] Secondly, there are some problems in the existing methods for judging the motion state of objects based on traditional image processing, such as the inter-frame difference method. There is no suitable range to choose. If the interval is too large or too small, it will affect its detection accuracy. The second most important thing is that it cannot detect stationary objects.
The background difference method is difficult to obtain a unified background in the actual restaurant. Therefore, it is necessary to continuously update the background dynamically, which will greatly reduce the speed of detection, and at the same time, some subtle jitters will interfere with its detection results.
Edge detection method, it is more sensitive to color, so the color of the plate and dishes will have a great impact on it, and at the same time, changes in lighting and shooting angles will interfere with it
[0004] Generally speaking, the reliability of the traditional image processing method for detecting the motion state of objects is relatively poor, and there are problems such as illumination, image shadow and noise, object occlusion and slow detection speed, etc., and are easily affected by the environment, resulting in inaccurate detection results And misjudgment, in practical applications, it is difficult to determine the motion state of the plate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dinner plate motion state recognition method based on deep learning
  • Dinner plate motion state recognition method based on deep learning
  • Dinner plate motion state recognition method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The purpose, technical solutions and advantages of the present invention will be described in detail below through specific embodiments and accompanying drawings.

[0039] figure 1 The schematic diagram of the entire process of the embodiment of the present application shown, the specific implementation is as follows:

[0040] Step S110, collect samples of dinner plates in actual restaurants, and use convolutional neural network to train a dinner plate detection model;

[0041] Step S120, using the camera device to detect the image of the dinner plate in real time;

[0042] Step S130, input the acquired plate image into the trained model, detect the plate image according to the key frame, and obtain the position information of the plate;

[0043] Step S140, judge the position information of the dinner plate in two consecutive frames before and after, determine the movement state of the dinner plate, and activate the subsequent dinner plate or dish detection model when...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a dinner plate motion state recognition method based on deep learning. The motion state of a dinner plate is determined through a convolutional neural network. The method comprises the following steps: training a dinner plate position detection model by utilizing a convolutional neural network; detecting the dinner plate according to the key frame to obtain position information of the dinner plate; and judging the dinner plate position information of the front frame and the rear frame in the key frames, and determining the motion state of the dinner plate. According tothe method, the motion state of the dinner plate can be determined through the camera, the dinner plate needing to be detected does not need to be determined through an additional sensor when the dinner plate is detected, and cost can be reduced while the detection speed is not affected.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to a deep learning-based recognition method for the motion state of a dinner plate. Background technique [0002] With the rapid development of artificial intelligence, more and more fields have applied artificial intelligence in real life. Recently, more and more attention has been paid to smart restaurants, and how to conveniently and quickly checkout payment has become a research hotspot. The existing intelligent payment methods based on deep learning generally use some sensors such as infrared and ultrasonic to judge the movement state of the dinner plate. Result checkout billing. However, the appeal method will increase the cost because of the use of sensors. At the same time, it will bring great inconvenience to the later maintenance and update. Secondly, the dependence of the sensor on the environment will directly affect the subsequent recognition. [0003] Secondly, there ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06T7/70G06N3/04
CPCG06T7/70G06V20/10G06N3/045
Inventor 熊继平叶灵枫朱凌云
Owner ZHEJIANG NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products