Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Gesture Recognition Method Based on Deep Learning

A technology of deep learning and gesture recognition, which is applied in the field of gesture recognition based on deep learning, can solve the problems of complex algorithms for computing gesture depth information, time-consuming, low recognition rate, etc., to improve system recognition accuracy, save image training time, The effect of improving gesture detection efficiency

Active Publication Date: 2017-10-24
DALIAN UNIV OF TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the usual gesture recognition system, before recognition and classification, gesture feature extraction is required. Since the gesture feature extraction must satisfy the characteristics of rotation, translation and scale invariance, the selected features are very limited, which also limits The recognition accuracy of the gesture recognition system
At the same time, due to the classifiers used in traditional gesture recognition, such as support vector machine (SVM), Boosting, Logistic regression, etc., the structure of these models can basically be regarded as containing only one hidden layer, or there is no hidden layer. These models It belongs to the shallow learning model, which has limited learning ability and cognitive ability to data.
[0003] Dong Lifeng proposed in the document "Static Gesture Recognition and Application Based on Hu Moment and Support Vector Machine" that the Hu moment is selected as the feature of the gesture to be recognized. The Hu moment has the characteristic that it does not change with the image rotation, translation and scale change; In the recognition stage, the support vector machine is used to classify gestures, and 10 different static gestures are recognized, and the recognition accuracy rate can reach 93%. However, this method has the following defects: 1. It is necessary to extract gesture features as the input of the classifier, There are great limitations when selecting features; 2. The selected features are relatively single, which affects the gesture classification and recognition effect; 3. The support vector machine belongs to the shallow learning machine. Compared with the deep classifier of deep learning, its The classification effect is relatively poor; 4. For 10 different gestures, the recognition rate is not high and needs to be improved
This method has the following defects: 1. Use a special video input device to obtain the gesture image and its depth information. This kind of equipment is relatively expensive and the cost is high; high, time-consuming

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Gesture Recognition Method Based on Deep Learning
  • A Gesture Recognition Method Based on Deep Learning
  • A Gesture Recognition Method Based on Deep Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the technical solutions and advantages of the present invention more clear, the technical solutions in the embodiments of the present invention are clearly and completely described below in conjunction with the drawings in the embodiments of the present invention:

[0023] Such as figure 1 As shown, a gesture recognition method based on deep learning specifically includes the following steps:

[0024] S1: The median filter method is used to denoise the collected gesture images, and the gray-scale world color balance method is used to eliminate the color shift phenomenon in the gesture images;

[0025] When the median filter method is used to denoise the gesture image, the median filter is used to filter the image, and the red, green, and blue components of the pixel at the midpoint (i, j) of the image are respectively R(i, j) , G(i,j), B(i,j), the window size of the median filter is W 1 ×W 1 , the total number of pixels in this area is W 1 ×W 1 , p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a gesture recognition method based on deep learning, which comprises the following steps: performing noise reduction processing on the collected gesture images, eliminating the color shift phenomenon in the gesture images; adopting an inter-frame difference method and a color feature detection method to lock Use the CamShift algorithm to track the gesture in the area where the gesture is located in the image to obtain the gesture target; conduct deep learning on the gesture target image; input the acquired gesture image to be recognized into the trained deep belief network model to complete gesture recognition and classification .

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a gesture recognition method based on deep learning. Background technique [0002] Gesture is a natural, intuitive and concise way of human-computer interaction. Gesture recognition is based on the video images captured by the computer, using image processing, pattern recognition and other technologies to recognize and understand specific gestures and their meanings in the image, and complete the operation and control of computers and household appliances. Gesture recognition technology has a wide range of applications in human-computer interaction, mobile terminals, information appliances, entertainment games and other fields. In the usual gesture recognition system, before recognition and classification, gesture feature extraction is required. Since the gesture feature extraction must satisfy the characteristics of rotation, translation and scale invariance, t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/66
Inventor 陈喆殷福亮刘奇琴
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products