Dynamic gesture recognition method based on Kinect depth information

A dynamic gesture and recognition method technology, applied in character and pattern recognition, instruments, computer components, etc., can solve the problem of insufficient recognition rate, achieve strong scalability, improve readiness rate, and improve accuracy rate

Active Publication Date: 2018-01-09
NANJING UNIV OF POSTS & TELECOMM
View PDF2 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, vision-based dynamic gesture recognition technology has achieved some remarkable results, and many gesture recognition systems have been developed, but there are still many problems and deficiencies in

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic gesture recognition method based on Kinect depth information
  • Dynamic gesture recognition method based on Kinect depth information
  • Dynamic gesture recognition method based on Kinect depth information

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0046] The technical scheme of the present invention will be further described in detail below in conjunction with the accompanying drawings:

[0047] The present invention is a dynamic gesture recognition method based on Kinect depth information, such as figure 1 As shown, the video information containing the gesture is obtained through the Kinect sensor, the gesture is separated from the background using the depth threshold method, the gesture contour is segmented according to the feature of the pixel depth mutation point as the gesture contour, and the obtained gesture contour is similar to the starting gesture Calculate, if it is similar, it means that the dynamic gesture starts and is tracked. The end point of the dynamic gesture is found in the same way to obtain the gesture trajectory. Extract the features of the gesture trajectory, and encode the features of the gesture trajectory with 8 reference direction vectors, and finally use the DTW method to recognize dynamic gestu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic gesture recognition method based on Kinect depth information. Two static gestures for determining the start and end of a dynamic gesture are recognized through a depth image sequence obtained by a Kinect sensor. After the start gesture is detected, the position of a hand in a depth image is found through a depth threshold method, and then, the coordinates of the palm are found according to the palm features to carry out tracking. After the end gesture is recognized, tracking is stopped, and the track of the dynamic gesture is obtained. The gesture track is encoded using eight reference direction vectors, and the dynamic gesture is compared with reference dynamic gestures through an accelerated DTW (Dynamic Time Warping) method to get a recognition result quickly. By using Kinect depth information, the influence of external environments such as complex background, skin color and illumination can be eliminated. By adding the static gestures for determining the start and end and optimizing the DTW method, the efficiency and accuracy of dynamic gesture recognition are improved.

Description

technical field [0001] The invention relates to a computer image processing and pattern recognition technology, in particular to a dynamic gesture recognition method based on Kinect depth information. Background technique [0002] As an important body language of human beings, gestures have a strong ideographic function. They can express people's thoughts and emotions through changes in fingers and hands, and play an important role in communication between people. It is a common method of communication. Gestures can be classified into static gestures and dynamic gestures. Among them, the recognition of static gestures refers to the recognition of hand shape changes and hand orientations in a certain period of time; while the recognition of dynamic gestures focuses on the process of analyzing hand movements, that is, within a period of time, the recognition is performed by the hands. The meaning of the trajectory sequence formed by the movement. [0003] In the existing te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
Inventor 戎舟王健
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products