Voice and micro-expression recognition suicide emotion perception method based on knowledge graph

A knowledge map and emotion perception technology, applied in the field of knowledge map-based voice and micro-expression recognition suicide emotion perception, can solve the problems of improving the recognition accuracy rate, and achieve the effects of improved accuracy, high performance, and convenient operation

Active Publication Date: 2020-12-11
SOUTH CHINA UNIV OF TECH
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

And changing a prediction method and considering a variety of characteristic factors may greatly improve the recognition accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Voice and micro-expression recognition suicide emotion perception method based on knowledge graph
  • Voice and micro-expression recognition suicide emotion perception method based on knowledge graph
  • Voice and micro-expression recognition suicide emotion perception method based on knowledge graph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0044] Suicide emotion perception method based on speech and micro-expression recognition based on knowledge graph, such as figure 1 shown, including the following steps:

[0045] S1, use Kinect with infrared camera to collect voice and video;

[0046] S2, analyzing image frames and speech in the video and converting them into corresponding feature texts;

[0047] For the collected speech, it is converted into three groups of feature description texts according to the content, intonation and speed of the speech; for the collected image frames, after capturing facial expressions, feature extraction and dimensionality reduction are performed, and the neural network classification is converted into corresponding texts. Emoticon text description.

[0048] Step S2 specifically includes the following steps:

[0049] S2.1. First apply Wiener-based noise filtering to the collected speech signal for noise reduction processing, and then convert the speech into three corresponding fea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a voice and micro-expression recognition suicide emotion perception method based on a knowledge graph. The method comprises the following steps of: acquiring voice and video byusing Kinect with an infrared camera; analyzing image frames and voices in the video and converting the image frames and voices into corresponding feature texts; and analyzing the feature text basedon the knowledge graph, generating a final target emotion text, and judging whether the target emotion text belongs to suicide emotions or not. The Kinect is used for data acquisition, and the methodhas the characteristics of high performance and convenience in operation.

Description

technical field [0001] The invention belongs to the field of emotion perception, and in particular relates to a method for recognizing suicide emotions based on knowledge graphs for voice and micro-expression recognition. Background technique [0002] Suicide refers to the behavior of a person who intentionally or voluntarily adopts various means to end his own life under the influence of complex psychology. Nowadays, people's living standards are improving day by day, and they have basically bid farewell to the era of starvation and nakedness. It seems that he has no worries about food and clothing, but he often hears news reports of someone committing suicide. It seems that the suicide rate has not improved significantly due to the improvement of living standards. So, how to reduce the suicide rate has become a hot issue. [0003] At present, with the help of technology, the behavior and activities under the camera are real, and the facial micro-expression and voice are c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06F16/35G06F16/36G06N3/04G10L25/63
CPCG06F16/355G06F16/367G10L25/63G06V40/174G06V40/172G06V40/161G06V20/41G06V20/10G06N3/044G06N3/045Y02D10/00
Inventor 杜广龙
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products