Unlock instant, AI-driven research and patent intelligence for your innovation.

Semi-supervised face emotion recognition method

An emotion recognition and semi-supervised technology, applied in the computer field, can solve the problems of difficult training, limited data, and labor and material resources, and achieve the effects of accurate and efficient recognition, alleviating performance loss, and improving recognition rate

Pending Publication Date: 2022-05-24
CENTRAL SOUTH UNIVERSITY OF FORESTRY AND TECHNOLOGY
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Deep learning technology requires a large amount of labeled data to train the neural network, which will consume a lot of manpower and material resources in the training process
Common datasets currently include discrete domain datasets and continuous domain datasets. Among them, discrete domain datasets contain limited data and are difficult to express rich human emotions, while continuous domain dataset labels are expensive and difficult to train.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semi-supervised face emotion recognition method
  • Semi-supervised face emotion recognition method
  • Semi-supervised face emotion recognition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] like figure 1 A schematic flowchart of the method of the present invention: this semi-supervised facial emotion recognition method provided by the present invention includes the following steps:

[0072] S1. Obtain basic image data samples, including labeled data and unlabeled data;

[0073] S2. Use a CNN-LSTM regressor (convolutional neural network-long short-term memory network) to predict the label data, and calculate the distance between the predicted value and the label value as a supervision loss;

[0074] Through a CNN-LSTM regressor, using fine-tuning Mixup and temporal integration to generate smooth pseudo-labels for unlabeled data, and using the distance between the smoothed pseudo-labels and predicted values ​​as a semi-supervised loss;

[0075] S3. Constructing a triplet loss based on similarity learning, including clustering the deep features of the image data, constructing a triplet based on the clustering results, and calculating the similarity triplet l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a semi-supervised face emotion recognition method. The method comprises the following steps: acquiring a basic image data sample; predicting the label data, and calculating the distance between a predicted value and a label value as supervision loss; generating a smooth pseudo label from the label-free data, and taking the distance between the smooth pseudo label and the predicted value as semi-supervised loss; constructing triple loss based on similarity learning, including clustering depth features of image data, constructing triads, calculating similarity triple loss, constructing a complete loss function, and updating network parameters according to gradient descent; and obtaining a semi-supervised face emotion recognition model, and performing emotion analysis on the current face image data. According to the method, the recognition in the continuous domain data set is accurate and efficient, and meanwhile, the excellent recognition rate in the discrete domain data set is obtained by adjusting the tail end; according to the invention, through the triple loss function based on similarity learning, the similarity between face images can be learned, and the recognition rate of emotion changes is improved.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a semi-supervised facial emotion recognition method. Background technique [0002] Accurate recognition of human emotions can help artificial intelligence achieve human-computer interaction. At present, the mainstream methods of emotion recognition include feature-based methods and deep learning-based methods. The method of feature extraction is mainly based on the oriented gradient histogram and the local binary pattern, but these features are not suitable for the nonlinear structure of the data, and the accuracy is not high. Using deep learning techniques, emotion recognition based on facial expressions has been significantly improved. Deep learning technology requires a large amount of labeled data to train neural networks, which will result in a lot of manpower and material resources during the training process. At present, common datasets include discrete do...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/16G06V10/74G06V10/762G06V10/766G06V10/774G06V10/82G06N3/04G06N3/08G06K9/62
CPCG06N3/08G06N3/044G06N3/045G06F18/2155G06F18/23G06F18/22
Inventor 潘丽丽邵伟志马俊勇熊思宇
Owner CENTRAL SOUTH UNIVERSITY OF FORESTRY AND TECHNOLOGY