Real-time three-dimensional double-hand gesture recognition method and system based on binocular vision

Abstract

The invention provides a real-time three-dimensional double-hand gesture recognition method and system based on binocular vision. The real-time three-dimensional double-hand gesture recognition method based on binocular vision comprises the steps that initial calibration and correction are conducted on an image firstly, the outline of a gesture is extracted, two-dimension gesture recognition is conducted on the extracted gesture outline, the mass center of the gesture outline is calculated, stereo matching is conducted on the mass center obtained through calculation, three-dimensional hand gesture recognition is achieved, and corresponding gestures are displayed in a human-computer interaction module based on the three-dimensional hand gesture recognition. According to the real-time three-dimensional double-hand gesture recognition method and system based on binocular vision, binocular vision information can be utilized, and human-computer interaction, based on the three-dimensional space, of double-hand gesture change of a computer is achieved; meanwhile, extremely high real-time performance and extremely high effectiveness can be achieved, and requirements for hardware are lowered; in addition, the man-machine interaction effect is achieved, and the requirements for real-time performance and effectiveness are well met.

Description

technical field [0001] The invention relates to a human-computer interaction system and method thereof, in particular to a human-computer interaction system and method for gesture recognition. Background technique [0002] Gesture language is a special language that relies on actions and vision for communication, and it is the body language that contains the most information. As far as human-computer interaction is concerned, gesture recognition is an important research field, and its essence is to recognize the expressed meaning according to the user's gestures. It uses the image of the human hand as the direct input device of the computer, and the user can simply define a variety of gestures to interact with the computer. However, the current gesture recognition system focuses on two-dimensional gesture recognition, which has relatively large limitations, while three-dimensional gesture recognition can judge gesture changes in three-dimensional space, and has attracted wi...

AI Technical Summary

Problems solved by technology

[0003] In order to overcome the problem that the existing gesture interaction technology focuses on the gesture recognition using two-dimensional images and is often limited to two-dimensional and one-handed problems, the present invention designs and builds a real-time three-dimensional two-handed gesture recognition system based on binocular vision. The invention can calculate the three-dimensional information of all people's hands gestures based on the binocular vision information, and can realize the three-dimensional gesture recognition of all people's hands gestures based on the two-dimensional gesture recognition, and can realize the change of hands gestures in three-dimensional space to operate the computer , complete the human-computer interaction problem in real time

Images