Multidimensional sense man-machine interaction system and method

Abstract

The invention discloses a multidimensional sense man-machine interaction system and a multidimensional sense man-machine interaction method, which are based on combine interaction modes of head posture control, voice control, keyboard and mouse operation, etc. The system is composed of the following 8 modules: a user information collecting module, a user information identifying and analyzing module, a head posture control functional module, a voice control functional module, a storage module, an interface interaction module, a self-customizing module and a program control module. The method is realized by the following four processes: collecting user information, identifying and analyzing the user information, realizing head posture control or voice control and outputting a user interface. The system and the method disclosed by the invention have the advantages of large application range, good maintainability, good expandability and the like. In addition, the system provides a novel man-machine interaction process method for a computer user, so that the operation efficiency of a common user can be improved, and great help on neck fitness and learning of old people on computers can be realized.

Description

technical field [0001] The present invention relates to a multi-dimensional sensory human-computer interaction system and an interaction method for interaction between users and computers, to be more precise, it relates to a human-computer interaction combined with interactive modes such as head posture control, voice control and keyboard and mouse operation. The system belongs to the field of human-computer interaction technology. Background technique [0002] With the gradual expansion of people's use of computers, the human-computer interaction method based on a single traditional mouse and keyboard can no longer meet people's growing needs. For example: office workers often suffer from the inflexibility of switching between multiple programs, but are limited by using both hands to operate the computer and cannot significantly improve work efficiency. In addition, for some special user groups, such as the elderly and the disabled, the operation of the mouse and keyboard ...

AI Technical Summary

Problems solved by technology

[0005] For the multi-channel human-computer interaction method, most of the research results obtained by domestic and foreign researchers are theoretical research results, and there are few applications developed for daily life scenarios.

At the same time, human-computer interaction methods are mainly limited to gestures, voice, etc., and head movement tracking has not yet been seen in multi-channel human-computer interaction methods.

Images