Emotion recognition method based on multi-source information fusion and man-machine interaction system

Abstract

The invention discloses an emotion recognition and man-machine interaction system based on multi-source information fusion, which comprises an information acquisition module, a signal preprocessing module, a signal analysis module, a feature fusion module, an emotion recognition module, a feedback module, an emotion accompanying module and a man-machine interaction module, wherein the information acquisition module is used for acquiring facial image information, voice information and semantic information of a user; the signal preprocessing module is used for preprocessing the signals acquired by the information acquisition module; the signal analysis module is used for analyzing and processing the signal obtained by the signal preprocessing module; the feature fusion module is used for performing feature fusion on the emotion features obtained by the signal processing module; the emotion recognition module is used for performing emotion recognition according to the fused emotion features obtained by the feature fusion module; the emotion feedback module is used for feeding back the user emotion state recognized by the emotion recognition module to the emotion accompanying module; the emotion accompanying module is used for generating an emotion accompanying mode according to the emotion state fed back by the emotion feedback module; and the man-machine interaction module is used for performing man-machine interaction according to the emotion accompanying scheme generated by the emotion accompanying module.

Description

technical field [0001] The invention relates to the field of service robots, in particular to an emotion recognition method and a human-computer interaction system based on multi-source information fusion. Background technique [0002] my country has become the country with the largest elderly population in the world, and the situation of population aging is very serious. According to statistics, the proportion of empty-nesters and elderly people living alone has psychological problems as high as 60%. Therefore, it has become a problem that the whole society pays more attention to and urgently needs to be solved by what means to recognize their emotions and then intervene to reduce their loneliness and other mental illnesses. In order to truly meet the functional requirements of emotional support for the elderly and better integrate into the lives of the elderly, we must first fully understand and distinguish the emotional changes of the elderly, and conduct various human-c...

AI Technical Summary

Problems solved by technology

There is currently no technology that effectively recognizes emotions

Images