Emotion visualization method facing voice and facial expression signal

A facial expression and voice signal technology, applied in speech analysis, instruments, etc., can solve the problems of unintuitive display and difficult signal acquisition, and achieve the effect of accurate visualization results, good robustness, and improved recognition rate.

Inactive Publication Date: 2016-05-04
BOHAI UNIV
View PDF7 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the measurement of physiological signals must be in contact with the body, it is difficult to obtain the signal of this channel. Therefore, speech and facial expressions, as the two most important ways to represent emotions, have been widely studied in emotion recognition, but their The recognition results can only be expressed in words, and the display is not intuitive

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion visualization method facing voice and facial expression signal
  • Emotion visualization method facing voice and facial expression signal
  • Emotion visualization method facing voice and facial expression signal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] Below in conjunction with accompanying drawing and embodiment, the technical solution of the present invention is described in detail:

[0057] Such as figure 1 As shown, the method includes emotional signal acquisition, emotional signal preprocessing, emotional feature parameter extraction, neural network design and image generation. The specific process is as follows:

[0058] Step 1, emotional signal acquisition;

[0059] Firstly, people's emotions are induced by noise stimulation or watching video clips, etc., and then the voice signal and facial expression signal in the corresponding emotional state are acquired synchronously, and the two are bound and stored. The present embodiment utilizes microphone input voice data, then utilizes computer, single-chip microcomputer or DSP chip processing unit to carry out sampling and quantization with the sampling frequency of 11.025kHz, the quantization precision of 16bit, obtains corresponding voice signal; The facial expre...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to an emotion visualization method facing voice and a facial expression signal. The method mainly comprises emotional signal acquisition, emotional signal preprocessing, emotional feature parameter extraction, neural network design and image generation. Firstly, the obtained emotional signal is subjected to feature extraction, then the obtained emotion feature is used as the input of a neural network, the output of the neural network is corresponding pattern information, then a visualization image is generated through an image generation module, and the visualization of six types of human basic emotions which are neutral, joy, anger, surprise, sadness and fear is realized. Through combining different modes of emotional features into an image, the reading mode of emotion is created for people, the display is visual, and the robustness is high.

Description

technical field [0001] The invention relates to a multi-mode emotion visualization method, in particular to an emotion visualization method oriented to speech and facial expression signals. Background technique [0002] In recent years, the research work of emotion information has become a hot issue in the field of human-computer interaction. With the advancement of social informatization and the increasingly widespread application of the Internet, the source of information is becoming larger and larger. Efforts to explore the complex relationship between massive information have prompted the emergence of a new science and technology called information visualization. The research task of emotional information visualization is to convert large-scale complex data information into intuitive graphics or images, give full play to people's image thinking advantages of visual models, and achieve observation, browsing, research, exploration, and discovery of hidden features in larg...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/10G10L25/63
CPCG10L21/10G10L25/63
Inventor 韩志艳王健王东尹作友魏洪峰郭兆正
Owner BOHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap