Robot emotion cognition method based on depth learning

A deep learning and robotics technology, applied in the field of information, can solve problems such as unfavorable social behavior between robots and humans, not considering human-computer interaction, and inability to interact with different objects, so as to improve cognitive ability, expand the scope of application, and improve human-computer interaction. Effect

Active Publication Date: 2019-01-01
XIAMEN UNIV
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing methods have the following defects: 1. Most of the robots on the market belong to the category of industrial robots, and further human-computer interaction based on human emotion is not considered in the interaction process; 2. All robots have decision-making modules, but none of them are based on emotion And making behavioral decisions is not conducive to the development of social behavior between robots and humans; 3. Existing research rarely has an emotional cognition framework based on deep learning, and cannot interact with different objects, nor can it perform better self-awareness renew

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot emotion cognition method based on depth learning
  • Robot emotion cognition method based on depth learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] see figure 1 and figure 2 , the present invention a kind of method based on the robot emotion cognition of deep learning, comprises the following steps:

[0027] Step 1. Obtain multi-modal information, and obtain the emotional state through the multi-modal information fusion algorithm;

[0028] Step 2. Input the emotional state into the interactive decision-making model for processing to obtain decision-making information, and output the decision-making information into the satisfaction model;

[0029] Step 3. Use the satisfaction model to detect whether the decision-making information output by the interactive decision-making model conforms to the preferences of the current user. If so, enter the long-term memory and update the data, including the update of users, emotional changes and preferences, etc., and enter step 3. 5; otherwise, go to step 4;

[0030] Step 4. Obtain recorded fragments and corresponding user's emotional changes from short-term memory, extract...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for robot emotion cognition based on depth learning, which comprises the following steps: obtaining multimodal information, and obtaining emotional state through a multimodal information fusion algorithm; obtaining emotional state through the multimodal information fusion algorithm; inputting emotional state into an interactive decision model for processing to obtain decision information, and outputting the decision information to a satisfaction degree model; satisfaction degree model being used to detect whether the decision information outputted from interactive decision model accords with the current user's preference. If so, it enters into long-term memory, updates the data, and outputs the obtained decision information to behavior selector to obtain robot behavior output. Otherwise, the recorded fragments and the corresponding emotional changes of the user are retrieved from the short-term memory, the user characteristics are extracted from the long-term memory, the decision information is calculated by using the LSTM depth learning model, and the obtained decision information is output to the behavior selector to obtain the robot behavior output. The invention improves the cognitive ability of the robot and better performs human-computer interaction through an interactive decision model.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a method for robot emotion cognition based on deep learning. Background technique [0002] Judging from the current achievements in robot emotional cognition, calculations are mainly based on physical behavior, and there is no progress in emotional cognition. The existing methods have the following defects: 1. Most of the robots on the market belong to the category of industrial robots, and further human-computer interaction based on human emotion is not considered in the interaction process; 2. All robots have decision-making modules, but none of them are based on emotion And making behavioral decisions is not conducive to the development of social behavior between robots and humans; 3. Existing research rarely has an emotional cognition framework based on deep learning, and cannot interact with different objects, nor can it perform better self-awareness renew. Contents ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08
CPCG06N3/08
Inventor 佘莹莹陈锦汪亚东
Owner XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products