Isomerous data fusion based coordinated gesture recognition method and system of sensor

A gesture recognition, heterogeneous data technology, applied in the field of human-computer interaction, to ensure robustness, strong robustness, and reduce the phenomenon of gesture misjudgment and missed judgment.

Active Publication Date: 2013-02-27
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF3 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is: to overcome the shortcomings of using a single gesture recognition method, and carry forward the respective advantages based on vision and sensor gesture recognition, and propose a gesture recognition method combining vision and multi-sensors, so that its recognition accuracy is high and robust Strong, reliable gesture recognition to achieve better recognition results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Isomerous data fusion based coordinated gesture recognition method and system of sensor
  • Isomerous data fusion based coordinated gesture recognition method and system of sensor
  • Isomerous data fusion based coordinated gesture recognition method and system of sensor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] The gesture data set recognized by the present invention is limited to dynamic gestures, including simple command gestures, such as gestures for controlling TV channels and volume addition and subtraction, and digital gestures for switching TV channels. By using a stereo camera and a motion sensor to collect the user's motion data sequence in real time and extract effective gesture features, the present invention uses a hidden Markov model to realize simultaneous segmentation and segmentation of gestures composed of heterogeneous data on the basis of feature level fusion. identify.

[0054] Embodiments of the present invention are as follows, Figure 4 It is a flow chart of the sensor cooperative gesture recognition method of the present invention, as Figure 4 As shown, the sensor cooperative gesture recognition method of the present invention includes:

[0055] Step 1, training gesture recognition model based on heterogeneous data collected by cameras and sensors; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an isomerous data fusion based coordinated gesture recognition method and a system of a sensor. The method comprises the steps of 1, training a gesture motion recognition model based on isomerous data collected by a camera and a sensor; 2, constructing a threshold model by the gesture motion recognition model; and 3, segmentally recognizing input continuous motion sequences based on the gesture motion recognition model and the threshold model. The method and the system overcome the problem that commonly, vision based technology is of strong dependency on surrounding environment and position, and insensitive to overturn. Meanwhile, the method and the system solve the problem that the gesture recognition precision and efficiency are not high in sensor based gesture recognition and erroneous judgment and lost judgment occur. The invention provides the gesture recognition method which is high in recognition accuracy, strong in robustness and reliable in recognition of gesture motion and the system thereof.

Description

technical field [0001] The invention relates to the field of human-computer interaction, in particular to a sensor cooperative gesture recognition method and system based on heterogeneous data fusion. Background technique [0002] Human-computer interaction is an interdisciplinary subject involving many professional backgrounds such as computer science, behavioral psychology, social ethics, graphic interface design, and industrial design. It takes user experience as the ultimate goal and serves as a bridge connecting humans and computers. With the improvement of computer technology and the continuous expansion of production needs in different fields of society and people's living needs, new intelligent human-computer interaction methods have become inevitable. Among the various ways of human-computer interaction, gestures are one of the most natural, intuitive and easy-to-learn ways. Gesture interaction technology with intelligent perception of action semantics is an inevit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
Inventor 黄美玉陈益强纪雯
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products