Multidimensional sense man-machine interaction system and method

A human-computer interaction and sensory technology, applied in the field of human-computer interaction, can solve the problems of head motion tracking that has not been seen yet and has few applications, and achieves the effect of enriching simple and fast interactive operations, reducing search, and saving time.

Inactive Publication Date: 2012-08-01
BEIHANG UNIV
View PDF4 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] For the multi-channel human-computer interaction method, most of the research results obtained by domestic and foreign researchers are theoretical research results, and there are few applications developed fo...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multidimensional sense man-machine interaction system and method
  • Multidimensional sense man-machine interaction system and method
  • Multidimensional sense man-machine interaction system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be described in detail below in conjunction with the accompanying drawings.

[0042] Such as figure 1 As shown, the multi-dimensional perception human-computer interaction system of the present invention is composed of 8 modules: user information collection module, user information identification and analysis module, head posture control function module, voice control function module, storage module, interface interaction module, self-customization module and program control modules.

[0043] The overall implementation process is as follows:

[0044] (1) Collect user information. The user information collection module obtains the video stream and the audio stream from the default video input device and audio input device of the operating system. If the operating system does not have a default video input device or audio input device, the user information collection module automatically turns off the head posture control or voice control.

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multidimensional sense man-machine interaction system and a multidimensional sense man-machine interaction method, which are based on combine interaction modes of head posture control, voice control, keyboard and mouse operation, etc. The system is composed of the following 8 modules: a user information collecting module, a user information identifying and analyzing module, a head posture control functional module, a voice control functional module, a storage module, an interface interaction module, a self-customizing module and a program control module. The method is realized by the following four processes: collecting user information, identifying and analyzing the user information, realizing head posture control or voice control and outputting a user interface. The system and the method disclosed by the invention have the advantages of large application range, good maintainability, good expandability and the like. In addition, the system provides a novel man-machine interaction process method for a computer user, so that the operation efficiency of a common user can be improved, and great help on neck fitness and learning of old people on computers can be realized.

Description

technical field [0001] The present invention relates to a multi-dimensional sensory human-computer interaction system and an interaction method for interaction between users and computers, to be more precise, it relates to a human-computer interaction combined with interactive modes such as head posture control, voice control and keyboard and mouse operation. The system belongs to the field of human-computer interaction technology. Background technique [0002] With the gradual expansion of people's use of computers, the human-computer interaction method based on a single traditional mouse and keyboard can no longer meet people's growing needs. For example: office workers often suffer from the inflexibility of switching between multiple programs, but are limited by using both hands to operate the computer and cannot significantly improve work efficiency. In addition, for some special user groups, such as the elderly and the disabled, the operation of the mouse and keyboard ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F3/048G06F17/30
Inventor 宋友张野王泽强王洪磊钦恩强罗云峰
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap