Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method of robot emotion cognition based on deep learning

A deep learning and robotics technology, applied in the field of information, can solve problems such as unfavorable social behavior between robots and people, not considering human-computer interaction, and inability to interact with different objects, so as to improve cognitive ability, expand the scope of application, and improve human-computer interaction. Effect

Active Publication Date: 2021-12-14
XIAMEN UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing methods have the following defects: 1. Most of the robots on the market belong to the category of industrial robots, and further human-computer interaction based on human emotion is not considered in the interaction process; 2. All robots have decision-making modules, but none of them are based on emotion And making behavioral decisions is not conducive to the development of social behavior between robots and humans; 3. Existing research rarely has an emotional cognition framework based on deep learning, and cannot interact with different objects, nor can it perform better self-awareness renew

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of robot emotion cognition based on deep learning
  • A method of robot emotion cognition based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] see figure 1 and figure 2 , the present invention a kind of method based on the robot emotion cognition of deep learning, comprises the following steps:

[0027] Step 1. Obtain multi-modal information, and obtain the emotional state through the multi-modal information fusion algorithm;

[0028] Step 2. Input the emotional state into the interactive decision-making model for processing to obtain decision-making information, and output the decision-making information into the satisfaction model;

[0029] Step 3. Use the satisfaction model to detect whether the decision-making information output by the interactive decision-making model conforms to the preferences of the current user. If so, enter the long-term memory and update the data, including the update of users, emotional changes and preferences, etc., and enter step 3. 5; otherwise, go to step 4;

[0030] Step 4. Obtain recorded fragments and corresponding user's emotional changes from short-term memory, extract...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method for emotional cognition of robots based on deep learning, including: obtaining multi-modal information, obtaining emotional states through multi-modal information fusion algorithms; inputting emotional states into interactive decision-making models for processing to obtain decision-making information, Output the decision information to the satisfaction model; use the satisfaction model to detect whether the decision information output by the interactive decision model conforms to the preferences of the current user, if so, enter the long-term memory, update the data, and update the obtained decision information The information is output to the behavior selector to obtain the robot behavior output; otherwise, the recorded fragments and the corresponding user's emotional changes are obtained from the short-term memory, and the user characteristics are extracted from the long-term memory, and the decision information is calculated by using the LSTM deep learning model. The obtained decision information is output to the behavior selector to obtain the robot behavior output. The invention improves the cognitive ability of the robot through the interactive decision-making model, and better performs human-computer interaction.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a method for robot emotion cognition based on deep learning. Background technique [0002] Judging from the current achievements in robot emotional cognition, calculations are mainly based on physical behavior, and there is no progress in emotional cognition. The existing methods have the following defects: 1. Most of the robots on the market belong to the category of industrial robots, and further human-computer interaction based on human emotion is not considered in the interaction process; 2. All robots have decision-making modules, but none of them are based on emotion And making behavioral decisions is not conducive to the development of social behavior between robots and humans; 3. Existing research rarely has an emotional cognition framework based on deep learning, and cannot interact with different objects, nor can it perform better self-awareness renew. Contents ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/08
CPCG06N3/08
Inventor 佘莹莹陈锦汪亚东
Owner XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products