Data processing method and multimodal interaction system for realizing multimodal interaction
A multi-modal, data-based technology, applied in the field of intelligent robots, can solve problems such as the rigidity of the robot interaction system, weak intelligence, and the inability of the robot system to acquire new knowledge, and achieve the effect of improving the human-computer interaction experience and enhancing intelligence
Active Publication Date: 2020-07-28
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] Existing robot interaction systems are generally very rigid, with very weak intelligence, and may not even have intelligence
This type of robot system can usually only complete actions according to pre-set instructions. When interacting with users, the robot relies on the interactive components of the system to trigger instructions. The interaction mode is single, or it cannot perform multi-modal interaction.
At the same time, this type of robot system cannot acquire new knowledge through the interaction process with the user, cannot rely on itself to grow and lacks humanization
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0024] The implementation of the present invention will be described in detail below in conjunction with the accompanying drawings and examples, so as to fully understand and implement the implementation process of how to apply technical means to solve technical problems and achieve corresponding technical effects in the present invention. The embodiments of the present application and the various features in the embodiments can be combined with each other under the premise of no conflict, and the formed technical solutions are all within the protection scope of the present invention.
[0025] Emotions, emotions, and thinking are the behaviors that humans show in the daily interaction process. To make robots more intelligent in the interaction process with users is to enable robots to simulate the interaction between humans. Identify the user's emotional and thinking expressions, and at the same time convey information to the user with certain emotional and thinking behaviors. ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a data processing method for realizing multi-modal interaction and a multi-modal interaction system. The method comprises the following steps: receiving multi-modal input data and pre-processing the multi-modal input data; respectively analyzing the pre-processed multi-modal input data by utilizing an emotion engine, a thought engine and a self-learning engine; carrying out comprehensive decision on the basis of the analysis results so as to obtain decision data; outputting a multi-modal interaction result according to the decision data. According to the method, the intelligence of robot systems can be enhanced, the robot systems are enabled to have growth and humanization, and the man-machine interaction experience is greatly improved.
Description
technical field [0001] The invention relates to the field of intelligent robots, in particular to a data processing method and a multimodal interaction system for realizing multimodal interaction. Background technique [0002] With the development of robot technology, intelligent robot products have increasingly penetrated into all aspects of people's lives. Robots are not only used to help users complete specified tasks efficiently, but are also required to be designed as partners that can interact with users in multimodal languages, actions, and emotions. [0003] Existing robot interaction systems are generally very rigid, with very weak intelligence, and may not even have intelligence. This type of robot system can usually only complete actions according to preset instructions. When interacting with users, the robot relies on the interactive components of the system to trigger instructions. The interaction mode is single, or it cannot perform multi-modal interaction. A...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01
CPCG06F3/011
Inventor 韦克礼
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH