Multi-mode man-machine intelligent interaction framework, method and device for intelligent combat

An intelligent interactive, multimodal technology, applied in the input/output of user/computer interaction, computer parts, mechanical mode conversion, etc. problems, to achieve the effect of improving operational efficiency, solving information overload, and reducing workload

Inactive Publication Date: 2019-05-03
XIAN AVIATION COMPUTING TECH RES INST OF AVIATION IND CORP OF CHINA
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The formation process of the traditional human-computer interaction control command is complicated, and the control interface is cumbersome. The pilot

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-mode man-machine intelligent interaction framework, method and device for intelligent combat
  • Multi-mode man-machine intelligent interaction framework, method and device for intelligent combat
  • Multi-mode man-machine intelligent interaction framework, method and device for intelligent combat

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Taking the reconnaissance strike mission as an example, the present invention will be described in further detail.

[0042] Embodiments of the present invention provide a multi-modal human-computer intelligent interaction framework for intelligent combat, such as figure 1 As shown, the framework includes:

[0043] Multi-modal human-computer interaction subsystem, intelligent auxiliary decision-making subsystem, human-computer intelligent interaction task management subsystem, comprehensive display subsystem;

[0044] The specific process is:

[0045]Based on multi-modal human-computer interaction technology, the results of EEG recognition, speech recognition, gesture recognition, eye tracking and other interactive methods are converted into unified interactive instructions, and the combat objectives and constraints issued by the pilots are determined and transmitted. Provide the human-machine intelligent interactive task management subsystem; the human-computer intell...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-mode man-machine intelligent interaction framework, method and device for intelligent combat. The framework comprises an intelligent assistant decision-making subsystem,a man-machine intelligent interaction task management subsystem, a comprehensive display subsystem and a multi-mode man-machine interaction subsystem. According to the multi-modal man-machine intelligent interaction framework provided by the invention, a multi-modal man-machine interaction technology and an intelligent auxiliary decision-making technology are combined; based on a natural man-machine interface and high-efficiency interaction capability provided by a multi-mode man-machine interaction technology, a pilot can realize multi-platform and multi-task random switching and accurate control under multi-dimensional and three-dimensional combat conditions in the future by virtue of technologies such as electroencephalogram recognition, voice recognition, gesture recognition and eye movement tracking; based on the situation awareness and task planning capability provided by the intelligent auxiliary decision-making technology, a pilot does not need to directly contact a large amount of original information, and only needs to confirm advanced description given by the intelligent auxiliary decision-making subsystem or put forward modification suggestions.

Description

technical field [0001] The invention belongs to the field of airborne intelligent computing, and proposes a multi-mode human-computer intelligent interaction framework, method and device for intelligent combat. Background technique [0002] Multimodal human-computer interaction technology refers to the use of advanced sensor technology to capture and perceive rich multi-channel interaction data of human beings, and then use computing technology to understand human interaction, control intentions, and provide cognitive feedback presentation. There is a complementary and redundant relationship between multi-modal information, which can complement and confirm each other, making the expression efficiency and information expressed better than a single mode, and it is easier to realize natural and harmonious human-computer interaction and control. According to the task characteristics of multi-modal human-computer interaction, it mainly includes three levels of acquisition, percep...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G10L15/22
Inventor 程陶然文鹏程白林亭高泽刘飞阳邹昌昊
Owner XIAN AVIATION COMPUTING TECH RES INST OF AVIATION IND CORP OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products