Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-source monitoring combined emotion calculation system and method

A technology of emotional computing and output terminal, applied in the field of emotional computing, can solve the problems of long distance between man and machine and low accuracy, and achieve the effects of avoiding data omission, convenient switching, and improving accuracy

Pending Publication Date: 2022-05-27
金华高等研究院(金华理工学院筹建工作领导小组办公室)
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the process of human-computer interaction, the blunt interaction method makes the distance between human and computer far, and then creates the ability to perceive, recognize and understand human emotions, and can make intelligent, sensitive and friendly responses to user emotions Personal computing system is used to shorten the distance between man and machine and create a truly harmonious environment between man and machine. The accuracy is low, so the present invention proposes an emotional computing system and method combined with multi-source monitoring to solve the problems existing in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-source monitoring combined emotion calculation system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] according to figure 1 As shown, this embodiment proposes an emotional computing system and method combining multi-source monitoring, an emotional computing system and method combining multi-source monitoring, including a collection layer, a processing layer, an internal application layer and a data layer. The output end of the collection layer is connected to the input end of the processing layer, and the collection layer is provided with a video collection module for collecting user video data, a voice collection module for collecting user voice data, and a questionnaire statistics module for collecting user fill-in questionnaire data. The output end of the processing layer is connected with the input end of the inner end application layer, and the processing layer is provided with a video feature extraction unit, an audio feature extraction unit and a questionnaire extraction unit, and the output end of the inner end application layer is connected with the data layer. ...

Embodiment 2

[0036] The difference between this embodiment and the first embodiment is that the processing layer is further provided with a text conversion module and an emotional word recognition module, the input end of the text conversion module is connected to the output end of the audio feature extraction module, and is used to convert The acquired audio data is converted into text information data, and the input end of the emotional word recognition module is connected with the output end of the text conversion module, and is used to automatically identify and extract words with emotional tendencies in the text information data. For example, the tone and pitch of its speech will be different, that is, it is converted into text data, and the emotional words in the text data are captured by the emotional word recognition module, and the emotional words are analyzed and compared with the sentiment analysis corpus. The results are sent to the data fusion module and combined to improve the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The system comprises an acquisition layer, a processing layer, an inner end application layer and a data layer, a video acquisition module, a voice acquisition module and a questionnaire statistics module are arranged in the acquisition layer, and a video feature extraction unit, an audio feature extraction unit and a questionnaire extraction unit are arranged in the processing layer. A model analysis and calculation module, a data fusion module and a man-machine interaction module are arranged in the inner-end application layer, and the method comprises the steps that video data, voice data and questionnaire survey in the man-machine interaction process of a user are collected, and the video data, the voice data and the data of the questionnaire survey are processed respectively; performing analysis and calculation through a model analysis and calculation module; through cooperation of the video acquisition module, the voice acquisition module and the questionnaire statistics module, video, voice and questionnaire modes are adopted as data sources of emotion calculation, and multi-source monitoring is combined to improve the accuracy of emotion calculation.

Description

technical field [0001] The invention relates to the technical field of emotional computing, in particular to an emotional computing system and method combining multi-source monitoring. Background technique [0002] The concept of affective computing was proposed by Professor Picard of the MIT Media Lab in 1997. She pointed out that affective computing is related to emotions, derived from emotions or can affect emotions. Hu Baogang and others from the Institute of Automation, Chinese Academy of Sciences also Through his own research, he puts forward the definition of affective computing: "The purpose of affective computing is to establish a harmonious human-computer environment by giving computers the ability to recognize, understand, express and adapt to human emotions, and to enable computers to have a higher, comprehensive Affective computing research is trying to create a computing system that can perceive, recognize and understand human emotions, and make intelligent, se...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): A61B5/16A61B5/00A61B5/11G16H10/20
CPCA61B5/165A61B5/16A61B5/0059A61B5/11A61B5/4803G16H10/20Y02D10/00
Inventor 韩天张竹江晓林任明远董长春
Owner 金华高等研究院(金华理工学院筹建工作领导小组办公室)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products