Multichannel human-computer interaction method based on voice and gestures

A human-computer interaction and voice channel technology, applied in the field of human-computer interaction, can solve problems such as lack and ambiguity of pointing, and achieve the effect of improving reliability

Active Publication Date: 2012-02-01
BEIHANG UNIV
View PDF1 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method still lacks corresponding treatment for under-constrained situations and pointing ambiguity.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multichannel human-computer interaction method based on voice and gestures
  • Multichannel human-computer interaction method based on voice and gestures
  • Multichannel human-computer interaction method based on voice and gestures

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention will be further described in detail below in conjunction with the accompanying drawings, so that those skilled in the art can implement it with reference to the description.

[0040] Such as figure 1 , figure 2 and image 3 As shown, the present invention provides a multi-channel human-computer interaction method based on voice and gesture, comprising the following steps:

[0041] Step 1. Build a voice channel and a gesture channel, and input voice information and gesture information to the referent of the human-computer interaction through the voice channel and the gesture channel respectively;

[0042] Step 2. Extract the speech reference object constraint information from the above voice information, and extract the gesture reference object constraint information from the above gesture information, wherein the gesture reference object constraint information includes the arrival of any point in the pointing area defined by the current pointing...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multichannel human-computer interaction method based on voice and gestures, comprising the following steps of: extracting voice referent constraint information from voice information and extracting gesture referent constraint information from gesture information, wherein the gesture referent constraint information comprises a statistical value of distance from any point in a referring point region limited by the current referring point gesture to a referring center of the referring point gesture and the statistical value of time maintained by the referring point gesture; when the gesture referent constraint information is analyzed, acquiring the statistical value of the distance and the statistical value of the time maintained by the referring point gesture so as to lower the fuzziness of a referring point in three-dimensional interaction; and in the referent determining process, dividing a model object in a virtual environment into four types, and comparing the referent with a certain type of model object according to the possibility of the referent appearing in a certain type so as to be beneficial to the reduction of a finding range of the referent and the influence of the fuzziness of the referring point.

Description

technical field [0001] The invention relates to the field of human-computer interaction, in particular to a multi-channel human-computer interaction method based on voice and gesture. Background technique [0002] Multi-channel human-computer interaction can effectively expand the bandwidth of information exchange between human and computer, so as to achieve the purpose of improving interaction efficiency; it can also exert the different cognitive potentials between human and computer, and reduce the cognitive load of users. Users can complete interactive tasks through various interaction channels and their mutual combination and cooperation, which just makes up for the limitations and burdens brought to users by a single interaction mode. In multi-channel human-computer interaction, referential resolution is defined as finding out the common referent of input information from multiple channels. Among them, reference mainly includes pronouns, positioning adverbs, demonstrat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
Inventor 赵沁平陈小武蒋恺许楠
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap