Multi-modal man-machine interaction system and control method thereof

A technology of human-computer interaction and control method, applied in the direction of input/output of user/computer interaction, computer parts, mechanical mode conversion, etc., can solve the problems of freedom and naturalness constraints, inability to select and adjust, etc., to improve effect of naturalness

Inactive Publication Date: 2017-04-19
THE 28TH RES INST OF CHINA ELECTRONICS TECH GROUP CORP
View PDF4 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

See Document 8: S.Carrino, A.Péclat, E.Mugellini. Humans and smart environments: a novel multimodal interaction approach [A]. Proceedings of International Conference on Multimodal Interaction [C]. Alicante, Spain: Association for Computing Machinery, 2011 , 105-112. At present, the multimo

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal man-machine interaction system and control method thereof
  • Multi-modal man-machine interaction system and control method thereof
  • Multi-modal man-machine interaction system and control method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention will be further explained below in conjunction with the accompanying drawings.

[0030] Such as Figure 1~2 As shown, the present invention provides a multimodal human-computer interaction system, including a physical device layer, an interactive lexical layer, an interactive grammar layer, an interactive semantic layer, and an application interface layer. The physical device layer is used for the collection of interactive information, through various The information collector of the interactive channel obtains the original signal; in the interactive lexical layer, different recognition algorithms are used to recognize the interactive actions of each channel, and the recognition results of voice, somatosensory / touch gestures are obtained; in the interactive grammar layer, by defining somatosensory / touch Interactive mapping instructions for gesture control, mapping somatosensory gestures and touch gestures into interactive instructions that users ca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-modal man-machine interaction system and a control method thereof. The main interaction process comprises: interaction information collection, interaction motion identification, interaction instruction mapping, logic processing unit, and interaction motion response. The interactive identification algorithm of voice, touch gesture and body feeling and gesture is broken through. The method comprises contact dynamic tracking and movement track coupling algorithm, physical parameter model coupling method, multi-user interaction queue mechanism. Touch control / body feeling gesture interaction mapping instruction and logic processing, cooperation /mutual exclusion access mechanism are set; the user control instruction is converted into service instruction of application system scheduling execution; multi-user interaction is supported; the system has strong anti-interference capability and identification efficiency.

Description

technical field [0001] The invention belongs to the technical field of artificial intelligence, and in particular relates to a multimodal human-computer interaction system and a control method thereof. Background technique [0002] With the development of emerging technologies such as sensor technology, intelligent computing technology, cloud computing, and big data, human-computer interaction continues to develop in the direction of people-oriented, enhanced perception, and user-friendly. Traditional mouse, keyboard and other interactive methods can no longer meet the needs of human-computer interaction. A new, efficient and convenient human-computer interaction environment needs to be established urgently to achieve natural and efficient interaction between humans and systems and accurate understanding of user intentions. [0003] At present, the relatively mature interaction methods are as follows: (1) voice interaction. The user sends instructions to the target program ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F3/16
CPCG06F3/011G06F3/017G06F3/167G06F2203/0381
Inventor 陈玥同陈杰朱双华赵海峰王峻科
Owner THE 28TH RES INST OF CHINA ELECTRONICS TECH GROUP CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap