Characteristic covariance matrix-based dynamic gesture recognition method

A technology of covariance matrix and dynamic gestures, applied in character and pattern recognition, instruments, computer components, etc., can solve problems such as tracking, model training template matching efficiency, etc., achieve easy implementation, improve training efficiency and reduce the overall gesture Tracking the effect of the request

Active Publication Date: 2018-06-15
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, so far, few studies have been done on dynamic gesture recognition based on hand joint features.
[0006] It can be seen that the existing algorithms in the field of dynami

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Characteristic covariance matrix-based dynamic gesture recognition method
  • Characteristic covariance matrix-based dynamic gesture recognition method
  • Characteristic covariance matrix-based dynamic gesture recognition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0064] Such as Figure 1 to Figure 4 As shown, this embodiment provides a dynamic gesture recognition method based on a feature covariance matrix, which solves the problem of hand tracking and matching efficiency in two-dimensional dynamic gesture recognition, uses the joint characteristics of the hand to realize three-dimensional dynamic gesture recognition, and is a two-dimensional dynamic gesture recognition method. Gesture recognition and 3D dynamic gesture recognition provide a unified framework, including the following four steps:

[0065] S1. Use the skin color information and the pyramid LK optical flow algorithm to track the two-dimensional gestures in the RGB video sequence to obtain the FAST corner points of the hand area in each frame; or use Intel's RealSense F200 camera to capture 3D dynamic gestures to obtain each frame The three-dimensional position of the joint points of the human hand in the camera coordinate system;

[0066] Wherein, in step S1, the skin co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a characteristic covariance matrix-based dynamic gesture recognition method. According to the method, a uniform framework is provided for two-dimensional dynamic gestures and three-dimensional dynamic gestures; for recognition of the two-dimensional dynamic gestures, only FAST angular points of hand areas in three continuous frames are accurately tracked, and the whole hands do not need to be accurately tracked, so that the tracking requirement is greatly reduced and the realization is easier; for recognition of the three-dimensional dynamic gestures, three-dimensionalskeleton information of hands is obtained in real time by using an SDK of a RealSense F200, and obtaining a three-dimensional coordinate of hand joint points in each frame so as to robustly track thegestures; and through logarithmic covariance matrix descriptors, compact expressions are provided for the whole gesture sequences, so that the SVM model training efficiency and efficiencies of gesturerecognition systems are greatly improved.

Description

technical field [0001] The invention relates to the technical field of image processing and analysis, in particular to a dynamic gesture recognition method based on a feature covariance matrix. Background technique [0002] Vision-based gesture recognition plays an extremely important role in human-computer interaction, robot control, virtual reality and other fields, so it has received extensive attention in the field of computer vision. Generally speaking, gestures can be divided into two types: static gestures and dynamic gestures. Static gesture recognition mainly recognizes hand gestures from a single image, so it is largely limited to practical application scenarios. Compared with static gestures, dynamic gestures include the movement process of the hand and can convey more information. In addition, dynamic gestures are generally collected in a moving environment, making dynamic gesture recognition more widely used in application scenarios. [0003] Dynamic gestures...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/28G06F18/2411G06F18/214
Inventor 康文雄方林普吴桂乐
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap