Isomerous data fusion based coordinated gesture recognition method and system of sensor

Abstract

The invention discloses an isomerous data fusion based coordinated gesture recognition method and a system of a sensor. The method comprises the steps of 1, training a gesture motion recognition model based on isomerous data collected by a camera and a sensor; 2, constructing a threshold model by the gesture motion recognition model; and 3, segmentally recognizing input continuous motion sequences based on the gesture motion recognition model and the threshold model. The method and the system overcome the problem that commonly, vision based technology is of strong dependency on surrounding environment and position, and insensitive to overturn. Meanwhile, the method and the system solve the problem that the gesture recognition precision and efficiency are not high in sensor based gesture recognition and erroneous judgment and lost judgment occur. The invention provides the gesture recognition method which is high in recognition accuracy, strong in robustness and reliable in recognition of gesture motion and the system thereof.

Description

technical field [0001] The invention relates to the field of human-computer interaction, in particular to a sensor cooperative gesture recognition method and system based on heterogeneous data fusion. Background technique [0002] Human-computer interaction is an interdisciplinary subject involving many professional backgrounds such as computer science, behavioral psychology, social ethics, graphic interface design, and industrial design. It takes user experience as the ultimate goal and serves as a bridge connecting humans and computers. With the improvement of computer technology and the continuous expansion of production needs in different fields of society and people's living needs, new intelligent human-computer interaction methods have become inevitable. Among the various ways of human-computer interaction, gestures are one of the most natural, intuitive and easy-to-learn ways. Gesture interaction technology with intelligent perception of action semantics is an inevit...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is: to overcome the shortcomings of using a single gesture recognition method, and carry forward the respective advantages based on vision and sensor gesture recognition, and propose a gesture recognition method combining vision and multi-sensors, so that its recognition accuracy is high and robust Strong, reliable gesture recognition to achieve better recognition results

Images