Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Emotion recognition method based on multi-source information fusion and man-machine interaction system

A technology for emotion recognition and human-computer interaction, which is applied in the field of service robots and can solve problems such as the lack of effective emotion recognition technology.

Active Publication Date: 2021-07-20
DANYANG HUICHUANG MEDICAL EQUIP CO LTD
View PDF11 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

There is currently no technology that effectively recognizes emotions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion recognition method based on multi-source information fusion and man-machine interaction system
  • Emotion recognition method based on multi-source information fusion and man-machine interaction system
  • Emotion recognition method based on multi-source information fusion and man-machine interaction system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] Attached below Figure 1-3 Specific embodiments of the present invention will be described in detail.

[0059] In the following, only some exemplary embodiments are described. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature and not restrictive.

[0060] like figure 1 As shown, the emotion recognition and human-computer interaction system based on multi-source information fusion of the present invention includes: information collection module, signal preprocessing module, signal analysis module, feature fusion module, emotion recognition module, feedback module, emotion escort module, human computer interaction module.

[0061] The information collection module is used to collect user's facial image information, voice information and semantic inf...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an emotion recognition and man-machine interaction system based on multi-source information fusion, which comprises an information acquisition module, a signal preprocessing module, a signal analysis module, a feature fusion module, an emotion recognition module, a feedback module, an emotion accompanying module and a man-machine interaction module, wherein the information acquisition module is used for acquiring facial image information, voice information and semantic information of a user; the signal preprocessing module is used for preprocessing the signals acquired by the information acquisition module; the signal analysis module is used for analyzing and processing the signal obtained by the signal preprocessing module; the feature fusion module is used for performing feature fusion on the emotion features obtained by the signal processing module; the emotion recognition module is used for performing emotion recognition according to the fused emotion features obtained by the feature fusion module; the emotion feedback module is used for feeding back the user emotion state recognized by the emotion recognition module to the emotion accompanying module; the emotion accompanying module is used for generating an emotion accompanying mode according to the emotion state fed back by the emotion feedback module; and the man-machine interaction module is used for performing man-machine interaction according to the emotion accompanying scheme generated by the emotion accompanying module.

Description

technical field [0001] The invention relates to the field of service robots, in particular to an emotion recognition method and a human-computer interaction system based on multi-source information fusion. Background technique [0002] my country has become the country with the largest elderly population in the world, and the situation of population aging is very serious. According to statistics, the proportion of empty-nesters and elderly people living alone has psychological problems as high as 60%. Therefore, it has become a problem that the whole society pays more attention to and urgently needs to be solved by what means to recognize their emotions and then intervene to reduce their loneliness and other mental illnesses. In order to truly meet the functional requirements of emotional support for the elderly and better integrate into the lives of the elderly, we must first fully understand and distinguish the emotional changes of the elderly, and conduct various human-c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/40G06K9/62G10L15/02G06F40/30G06N3/04
CPCG10L15/02G06F40/30G06V40/168G06V40/174G06V10/30G06N3/044G06N3/045G06F18/253
Inventor 张静莎张腾宇李增勇李慧媛
Owner DANYANG HUICHUANG MEDICAL EQUIP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products