Dynamic gesture sequence real-time recognition method, system and device

A technology of dynamic gestures and recognition methods, applied in the fields of artificial intelligence and computer vision, can solve the problems that the recognition effect needs to be further improved, and the robustness is not strong, and achieves the improvement of robustness, good recognition effect, and improved robustness. Effect

Inactive Publication Date: 2018-07-06
盈盛资讯科技有限公司
View PDF4 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the current gesture recognition method does not overcome the defect that skin color is easily

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic gesture sequence real-time recognition method, system and device
  • Dynamic gesture sequence real-time recognition method, system and device
  • Dynamic gesture sequence real-time recognition method, system and device

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0123] like figure 2 As shown, taking the Color Stream (RGB color information flow) and Depth Stream (depth information flow) that the object to be identified is collected by an RGB-D camera as an example, a specific implementation of the gesture dynamic recognition scheme of the present invention includes the following steps:

[0124] S1: Extract Color Stream and Depth Stream through RGB-D camera;

[0125] S2: Based on Color Stream, Depth Stream, head template, region growth algorithm, distance matching algorithm and other technologies to realize the detection and segmentation of human body regions;

[0126] S3: Based on the human body area segmented in step S2, use Depth Stream, hand template, edge detection algorithm, chamfering distance matching and other technologies to realize the detection and segmentation of the hand area;

[0127] S4: Based on the hand area detected in step S3, after feature extraction using the skin color model, the ellipse boundary model of Gaussi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic gesture sequence real-time recognition method, a dynamic gesture sequence real-time recognition system and a dynamic gesture sequence real-time recognition device. The dynamic gesture sequence real-time recognition method comprises the steps of: separately acquiring a color image and a depth image containing an object to be recognized; performing human body regiondetection and segmentation according to the acquired color image and depth image, so as to obtain a human body region; detecting and segmenting hand regions in the human body region so as to obtain the hand regions; adopting a skin color mode with illumination invariance and an elliptical boundary model based on Gaussian distribution for tracking hands dynamically according to the hand regions; adopting a method based on gesture trajectory and static attitude matching for performing space-time gesture sequence detection according to dynamic tracking results of the hands, so as to obtain a dynamic gesture sequence; and modeling and classifying the dynamic gesture sequence. The dynamic gesture sequence real-time recognition method, the dynamic gesture sequence real-time recognition system and the dynamic gesture sequence real-time recognition device improve the robustness of gesture recognition through utilizing the depth information and adopting the skin color mode with illumination invariance and the elliptical boundary model based on Gaussian distribution, have good recognition effect, and can be widely applied in the fields of artificial intelligence and computer vision.

Description

technical field [0001] The invention relates to the fields of artificial intelligence and computer vision, in particular to a method, system and device for real-time recognition of dynamic gesture sequences. Background technique [0002] Human-computer interaction (HRI) is a research field in computer vision. Vision-based gesture recognition has been studied by many researchers for many years. However, dynamic gesture recognition remains a challenge due to the difficulties of gesture recognition in practical applications, such as complex background and lighting conditions. [0003] A dynamic gesture recognition system generally includes a gesture detection / tracking module, a gesture recognition module, a gesture modeling module and a classification module. Skin color segmentation and 2D / 3D template matching based on color information are widely used to detect hand regions in color space. However, illumination has a strong influence on the skin color distribution, making i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/34G06K9/62G06K9/46G06T7/246
CPCG06T7/251G06T2207/10028G06T2207/10024G06T2207/30196G06V40/107G06V40/113G06V40/28G06V40/103G06V10/267G06V10/44G06F18/24
Inventor 黄劲朱德明
Owner 盈盛资讯科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap