Multi-modal gesture recognition and visual feedback mechanism combined method

Abstract

The invention provides a multi-modal gesture recognition and visual feedback mechanism combined method, which comprises the following steps of: by virtue of a visual sensor high-definition visible light camera worn on the head, a myoelectricity electrode worn on the upper arm of a user and a motion gesture data glove worn on the hand, carrying out multi-modal gesture recognition on the user; multi-source data such as visual images/videos, instantaneous high-density electromyographic signals and motion signals are collected, and then a multi-mode gesture fusion recognition method is used for conducting comprehensive recognition on gesture actions of a user. Besides, a three-dimensional interaction feedback control model and a gesture interaction visual feedback mechanism model in the interaction field are designed, visual feedback of gesture interaction is achieved, a design principle, a model specification form and principle guidance application of visual feedback mode application are provided, and it is ensured that the visual feedback can play the maximum advantage.

Description

technical field [0001] The invention belongs to the field of human-computer interaction and artificial intelligence, and relates to a method combining multi-modal gesture recognition and visual feedback mechanism. Background technique [0002] In recent years, with the continuous development of computer technology, human-computer interaction technology has also played an increasingly important role in daily life. How to establish a harmonious and natural human-computer interaction environment so that users can conveniently use it in a way familiar to humans Computers are the hard problems we need to solve. The traditional human-computer interaction method has changed from the original keyboard input to the current mouse, joystick, wireless device input, etc., which greatly facilitate the interaction between people and computers, making it easier for people to operate computers, so that they can quickly However, these interaction methods not only rely on additional input dev...

AI Technical Summary

Problems solved by technology

The traditional human-computer interaction method has changed from the original keyboard input to the current mouse, joystick, wireless device input, etc., which greatly facilitate the interaction between people and computers, making it easier for people to operate computers, so that they can quickly to complete certain tasks, but these interaction methods not only rely on additional input devices, but also do not conform to people's interaction habits

Images