High-precision gesture interaction system and method combined with somatosensory equipment

Abstract

The embodiment of the invention discloses a high-precision gesture interaction method combined with somatosensory equipment, and the method comprises the steps: collecting a preset gesture through thesomatosensory equipment, carrying out the algorithm recognition, giving a corresponding instruction according to a recognition result to achieve the movement of display equipment, and achieving the ideal interaction between somatosensory equipment and the display equipment. The somatosensory device obtains a color image collected by a general sensor, can obtain depth information of a target object, and uses a pixel value in a gray level image to represent a distance between the object and a camera. The somatosensory equipment can separate a hand region, threshold segmentation is carried out on the separated region through gray scale distribution of a depth image, a complete gesture is separated from a background for subsequent processing, and static algorithm recognition is carried out onthe gesture; and finally, dynamic time warping algorithm detection is performed according to the vector description of the gesture features in combination with the start point and the end point of the dynamic gesture, and finally gesture interaction recognition is completed.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a high-precision gesture interaction system and method combined with somatosensory devices. Background technique [0002] The advent of the era of artificial intelligence has enabled the advancement and development of human-computer interaction technology. Among them, gesture interaction, as an important branch of human-computer interaction, has been widely studied and applied. However, the current gesture interaction system still has certain shortcomings and deficiencies: at the level of data acquisition, data acquisition is mainly based on two aspects of depth information and color information, which may easily cause the omission of details of hand information; at the level of feature extraction and gesture recognition, it is urgent to optimize Algorithms to improve the gesture recognition effect; there are problems such as scene configuration and low intera...

AI Technical Summary

Problems solved by technology

However, the current gesture interaction system still has certain shortcomings and deficiencies: at the data acquisition level, data acquisition is mainly based on depth information and color information, which may easily cause the omission of hand information details; at the level of feature extraction and gesture recognition, it is urgent to optimize Algorithms to improve the effect of gesture recognition; there are problems such as scene configuration and low interaction experience at the level of virtual interaction

Images