Gesture recognition system and method adopting action segmentation

Abstract

The invention provides a gesture recognition system and method adopting action segmentation and relates to the field of machine vision and man-machine interaction.The gesture recognition method comprises the following steps that firstly, head movements are detected, and head posture changes are calculated; then, a segmentation signal is sent according to posture estimation information, gesture segmentation beginning and end points are judged, if the signal indicates initiative gesture action segmentation, gesture video frame sequences are captured within a time interval of gesture execution, and preprocessing and characteristic extraction are conducted on gesture frame images; if the signal indicates automatic action segmentation, the video frame sequences are acquired in real time, segmentation points are automatically analyzed by analyzing the movement change rule of adjacent gestures for action segmentation, then vision-unrelated characteristics are extracted from segmented effective element gesture sequences, and a type result is obtained by adopting a gesture recognition algorithm for eliminating spatial and temporal disparities.The gesture recognition method greatly reduces redundant information of continuous gestures and the calculation expenditures of the recognition algorithm and improves the gesture recognition accuracy and real-timeliness.

Description

technical field [0001] The invention belongs to the field of digital images and human-computer interaction, and in particular relates to a gesture recognition system and method using motion segmentation. Background technique [0002] With the development of mobile phone touch operation and human body tracking and recognition, people have realized that gesture interaction has the advantages of human-centered naturalness, simplicity, and directness. The interactive interface based on human intelligent input is becoming a new technology trend, especially With the rise of new immersive virtual reality devices, various interactive solutions are used to improve the immersive experience, among which gesture interaction is the most concise, direct and natural. [0003] Gesture recognition, as a means of human-computer interaction, has been widely used in scenarios such as augmented reality, virtual reality, and somatosensory games. For these application scenarios, operating gestures...

AI Technical Summary

Problems solved by technology

[0006] To sum up, the existing gesture recognition interaction methods have the following disadvantages: (1) It is difficult to locate the start and end key points of gestures with operational significance in the complex gesture flow under actual application conditions; Different speeds and different motion ranges inevitably have temporal and spatial differences, which will have a great impact on the accuracy and robustness of recognition.

Images