Depression tendency recognition method based on multi-modal characteristics of limbs and micro-expressions

A recognition method and micro-expression technology, applied in the field of emotion recognition, can solve problems such as low recognition accuracy

Active Publication Date: 2020-11-20
SOUTH CHINA UNIV OF TECH
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

So non-intrusive methods are better, but in non-contact methods, objects can mask their emotions, so a single detection of facial expressions or detection of human limb movements will lead to lower recognition accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Depression tendency recognition method based on multi-modal characteristics of limbs and micro-expressions
  • Depression tendency recognition method based on multi-modal characteristics of limbs and micro-expressions
  • Depression tendency recognition method based on multi-modal characteristics of limbs and micro-expressions

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0048] Depression tendency identification method based on multimodal features of body and micro-expression, such as figure 1 shown, including the following steps:

[0049] S1. Use the non-contact measurement sensor Kinect to detect human motion, and use convolutional neural network (CNN) and bidirectional long-short-term memory conditional random field (Bi-LSTM-CRF) to analyze the static motion and dynamic motion of the human body, and generate motion text describe;

[0050] The human body movement is divided into static movement and dynamic movement;

[0051] For static motion, selected frames from the captured video are input into the convolutional neural network; the convolutional layer of the convolutional neural network uses partial filters to calculate the convolution, that is, the local submatrix of the input item and the local filter are internally Product operation, the output is a convolution matrix; in order to get better data representation, various local filters...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a depression tendency recognition method based on multi-modal characteristics of limbs and micro-expressions. The method comprises the following steps: detecting human motion by means of a non-contact measurement sensor Kinect, and generating motion text description; capturing a face image frame by adopting a non-contact measurement sensor Kinect, performing Gabor wavelet and linear discriminant analysis on a face region of interest, performing feature extraction and dimensionality reduction, and then realizing face expression classification by adopting a three-layer neural network to generate expression text description; performing fusion through text description extracted by a fusion neural network with a self-organizing mapping layer and generating information with emotion features; and S4, using a Softmax classifier to classify the feature information generated in the S3 in emotion categories, wherein a classification result is used for evaluating whether the patient has a depression tendency or not. Static body movement and dynamic body movement are considered, and higher efficiency is achieved. Body movement is helpful for identifying the emotion of adepression patient.

Description

technical field [0001] The invention belongs to the field of emotion recognition, in particular to a depression tendency recognition method based on multimodal features of body and micro-expression. Background technique [0002] In order to detect patients prone to depression early, it is useful to monitor their mood. Human emotions can be recognized in various ways, such as electrocardiogram (ECG) (K. Takahashi, "Remarks on emotion recognition from multi-modal bio-potential signals", Proc.IEEE Int.Conf.Ind.Technol.(ICIT), vol .3, pp.1138-1143, Jun.2004.), electroencephalogram (EEG), speech, facial expressions, etc. Among various emotional signals, physiological signals are widely used in emotion recognition. In recent years, the movement of limbs has also become a new feature. [0003] There are two traditional detection methods, one is to measure the physiological indicators of objects by contact (J.Kim, and E.André, "Emotion recognition based on physiological changes i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/32G06K9/62G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06V40/174G06V40/172G06V40/20G06V20/41G06V10/25G06N3/044G06N3/045G06F18/2415Y02A90/10
Inventor 杜广龙
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap