Data processing method for realizing multi-modal interaction and multi-modal interaction system

A data processing, multi-modal technology, applied in the field of intelligent robots, can solve the problems of rigid robot interaction system, weak intelligence, unable to grow and lack of humanization, etc., to improve the human-computer interaction experience and enhance the effect of intelligence

Active Publication Date: 2016-08-10
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF5 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Existing robot interaction systems are generally very rigid, with very weak intelligence, and may not even have intelligence
This type of robot system can usually only complete actions according to pre-set instructions. When interacting with users, the robot relies on the interactive comp

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method for realizing multi-modal interaction and multi-modal interaction system
  • Data processing method for realizing multi-modal interaction and multi-modal interaction system
  • Data processing method for realizing multi-modal interaction and multi-modal interaction system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] The implementation of the present invention will be described in detail below with reference to the accompanying drawings and embodiments, so as to fully understand how the present invention applies technical means to solve technical problems and achieve corresponding technical effects and implement them accordingly. The embodiments of the application and the features in the embodiments can be combined with each other under the premise of no conflict, and the technical solutions formed are all within the protection scope of the present invention.

[0025] Emotions, emotions, and thinking are the behaviors shown by humans in the daily interaction process, making the robot more intelligent in the interaction process with the user, that is, enabling the robot to simulate the interaction behavior between people, and it can accurately Recognize the user's emotions and thinking expressions, and at the same time convey information to users with certain emotions and thinking behavi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method for realizing multi-modal interaction and a multi-modal interaction system. The method comprises the following steps: receiving multi-modal input data and pre-processing the multi-modal input data; respectively analyzing the pre-processed multi-modal input data by utilizing an emotion engine, a thought engine and a self-learning engine; carrying out comprehensive decision on the basis of the analysis results so as to obtain decision data; outputting a multi-modal interaction result according to the decision data. According to the method, the intelligence of robot systems can be enhanced, the robot systems are enabled to have growth and humanization, and the man-machine interaction experience is greatly improved.

Description

technical field [0001] The invention relates to the field of intelligent robots, in particular to a data processing method and a multimodal interaction system for realizing multimodal interaction. Background technique [0002] With the development of robot technology, intelligent robot products have increasingly penetrated into all aspects of people's lives. Robots are not only used to help users complete specified tasks efficiently, but are also required to be designed as partners that can interact with users in multimodal languages, actions, and emotions. [0003] Existing robot interaction systems are generally very rigid, with very weak intelligence, and may not even have intelligence. This type of robot system can usually only complete actions according to preset instructions. When interacting with users, the robot relies on the interactive components of the system to trigger instructions. The interaction mode is single, or it cannot perform multi-modal interaction. A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01
CPCG06F3/011
Inventor 韦克礼
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products