A method and device for configuring the mapping relationship between somatosensory actions and virtual operations

Abstract

The present invention provides a method and device for configuring the mapping relationship between somatosensory actions and virtual operations. The method includes: S1, using Kinect equipment to collect various sample somatosensory action data required by target applications, and generate corresponding action data files; S2 , train the action data file, obtain the action recognition file, and load the somatosensory action corresponding to the action recognition file to generate an action library; S3, according to the somatosensory interaction requirements of the target application, construct each action in the action library The mapping relationship between individual sensory actions and virtual operation messages generates a mapping set of somatosensory actions and virtual operations. The invention can customize the design of somatosensory actions, realize real-time mapping between user's somatosensory actions and traditional keyboard and mouse events, and support the recognition of continuous actions, and can conveniently realize somatosensory operations of traditional interactive applications and improve development efficiency.

Description

technical field [0001] The present invention relates to the technical field of human-computer interaction, and more specifically, to a method and device for configuring a mapping relationship between somatosensory actions and virtual operations. Background technique [0002] At present, the interaction between human and computer is still limited to mouse and keyboard, which has restricted the further development of human-computer interaction for a long time. With the rapid development of science and technology, the concept of higher-level human-computer interaction has put forward a huge demand for interactive methods, and many researchers have begun to study the multi-channel interface of new interactive technologies. The emergence of Kinect has opened a new chapter in the new generation of human-computer interaction. This kind of somatosensory interaction based on computer vision has become the most promising method because it is more intuitive and natural than wearable in...

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problems in the development process of converting the application from the traditional interactive mode to the somatosensory interactive way, the development threshold is high, the development cycle is long, and it is difficult to recognize continuous somatosensory actions, and the customization and use of somatosensory actions cannot be realized. The present invention Provide a method and device for configuring the mapping relationship between somatosensory actions and virtual operations

Images