Multi-source monitoring combined emotion calculation system and method

Abstract

The system comprises an acquisition layer, a processing layer, an inner end application layer and a data layer, a video acquisition module, a voice acquisition module and a questionnaire statistics module are arranged in the acquisition layer, and a video feature extraction unit, an audio feature extraction unit and a questionnaire extraction unit are arranged in the processing layer. A model analysis and calculation module, a data fusion module and a man-machine interaction module are arranged in the inner-end application layer, and the method comprises the steps that video data, voice data and questionnaire survey in the man-machine interaction process of a user are collected, and the video data, the voice data and the data of the questionnaire survey are processed respectively; performing analysis and calculation through a model analysis and calculation module; through cooperation of the video acquisition module, the voice acquisition module and the questionnaire statistics module, video, voice and questionnaire modes are adopted as data sources of emotion calculation, and multi-source monitoring is combined to improve the accuracy of emotion calculation.

Description

technical field [0001] The invention relates to the technical field of emotional computing, in particular to an emotional computing system and method combining multi-source monitoring. Background technique [0002] The concept of affective computing was proposed by Professor Picard of the MIT Media Lab in 1997. She pointed out that affective computing is related to emotions, derived from emotions or can affect emotions. Hu Baogang and others from the Institute of Automation, Chinese Academy of Sciences also Through his own research, he puts forward the definition of affective computing: "The purpose of affective computing is to establish a harmonious human-computer environment by giving computers the ability to recognize, understand, express and adapt to human emotions, and to enable computers to have a higher, comprehensive Affective computing research is trying to create a computing system that can perceive, recognize and understand human emotions, and make intelligent, se...

AI Technical Summary

Problems solved by technology

[0004] In the process of human-computer interaction, the blunt interaction method makes the distance between human and computer far, and then creates the ability to perceive, recognize and understand human emotions, and can make intelligent, sensitive and friendly responses to user emotions Personal computi...

Images