A dynamic gesture recognition method based on kinect depth information

A technology of dynamic gestures and recognition methods, applied in character and pattern recognition, instruments, calculations, etc., can solve the problem of insufficient recognition rate, and achieve the effect of strong scalability and improved accuracy.

Active Publication Date: 2020-06-23
NANJING UNIV OF POSTS & TELECOMM
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, vision-based dynamic gesture recognition technology has achieved some remarkable results, and many gesture recognition systems have been developed, but there are still many problems and deficiencies in the existing gesture recognition systems, such as the influence of illumination changes and background ; Determination of the start and end of gestures; extraction of gesture trajectories, etc., resulting in insufficient recognition rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A dynamic gesture recognition method based on kinect depth information
  • A dynamic gesture recognition method based on kinect depth information
  • A dynamic gesture recognition method based on kinect depth information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] Below in conjunction with accompanying drawing, technical scheme of the present invention is described in further detail:

[0047] The present invention is based on the dynamic gesture recognition method of Kinect depth information, as figure 1 As shown, the video information containing gestures is obtained through the Kinect sensor, and the gesture is separated from the background by using the depth threshold method. The gesture contour is segmented according to the feature of the gesture contour according to the pixel depth mutation point, and the similarity between the obtained gesture contour and the starting gesture is calculated. If the calculation is similar, it means that the dynamic gesture starts and is tracked, and the end point of the dynamic gesture is found in the same way to obtain the gesture trajectory. The features of the gesture trajectory are extracted, and eight reference direction vectors are used to encode the characteristics of the gesture trajec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic gesture recognition method based on Kinect depth information. Two static gestures for determining the start and end of a dynamic gesture are recognized through a depth image sequence obtained by a Kinect sensor. After the start gesture is detected, the position of a hand in a depth image is found through a depth threshold method, and then, the coordinates of the palm are found according to the palm features to carry out tracking. After the end gesture is recognized, tracking is stopped, and the track of the dynamic gesture is obtained. The gesture track is encoded using eight reference direction vectors, and the dynamic gesture is compared with reference dynamic gestures through an accelerated DTW (Dynamic Time Warping) method to get a recognition result quickly. By using Kinect depth information, the influence of external environments such as complex background, skin color and illumination can be eliminated. By adding the static gestures for determining the start and end and optimizing the DTW method, the efficiency and accuracy of dynamic gesture recognition are improved.

Description

technical field [0001] The invention relates to a computer image processing and pattern recognition technology, in particular to a dynamic gesture recognition method based on Kinect depth information. Background technique [0002] As an important body language of human beings, gestures have a strong ideographic function. They can express people's thoughts and emotions through changes in fingers and hands, and play an important role in communication between people. It is a common method of communication. Gestures can be classified into static gestures and dynamic gestures. Among them, the recognition of static gestures refers to the recognition of hand shape changes and hand orientations in a certain period of time; while the recognition of dynamic gestures focuses on the process of analyzing hand movements, that is, within a period of time, the recognition is performed by the hands. The meaning of the trajectory sequence formed by the movement. [0003] In the existing te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
Inventor 戎舟王健
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap