An emotion recognition method and human-computer interaction system based on multi-source information fusion

Abstract

The invention discloses an emotion recognition and human-computer interaction system based on multi-source information fusion, including an information collection module, a signal preprocessing module, a signal analysis module, a feature fusion module, an emotion recognition module, a feedback module, an emotion escort module and human computer interaction module, wherein: the information collection module is used to collect user's facial image information, voice information and semantic information; the signal preprocessing module is used to preprocess the signal collected by the information collection module; the signal analysis module is used to analyze The signal obtained by the signal preprocessing module is analyzed and processed; the feature fusion module is used to perform feature fusion on the emotional features obtained by the signal processing module; the emotional recognition module is used to perform emotional recognition according to the fused emotional features obtained by the feature fusion module; emotional feedback The module is used to feed back the emotional state of the user identified by the emotion recognition module to the emotional escort module; the emotional escort module is used to generate an emotional escort model according to the emotional state fed back by the emotional feedback module; the human-computer interaction module is used to Generated emotional care programs for human-computer interaction.

Description

technical field [0001] The invention relates to the field of service robots, in particular to an emotion recognition method and a human-computer interaction system based on multi-source information fusion. Background technique [0002] my country has become the country with the largest elderly population in the world, and the problem of population aging is very serious. According to statistics, the proportion of empty-nesters and elderly people living alone has psychological problems as high as 60%. Therefore, it has become a problem that the whole society pays more attention to and urgently needs to solve by what means to use to recognize their emotions and then intervene to reduce their loneliness and other mental illnesses. In order to truly meet the functional requirements of emotional support for the elderly and better integrate into the lives of the elderly, we must first fully understand and distinguish the emotional changes of the elderly, and conduct various human-...

AI Technical Summary

Problems solved by technology

There is currently no technology that effectively recognizes emotions

Images