A facial expression recognition method based on multi-scale feature extraction and global feature fusion is proposed

A facial expression recognition and multi-scale feature technology, applied in the field of facial expression recognition, can solve the problems that cannot truly and objectively reflect the real distribution of data, low accuracy of expression recognition, slow recognition speed, etc., and achieve fast and stable recognition speed Recognition effects, effects that meet the requirements of practical applications

Inactive Publication Date: 2019-03-19
CHINA UNIV OF MINING & TECH +1
View PDF3 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, traditional computational vision methods also have deficiencies: 1. Man-made design rules for feature extraction, so that the final extracted features contain some subjective factors, which cannot truly and objectively reflect the true distribution of data; 2. Feature extraction methods with excellent performance often have a larg

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A facial expression recognition method based on multi-scale feature extraction and global feature fusion is proposed
  • A facial expression recognition method based on multi-scale feature extraction and global feature fusion is proposed
  • A facial expression recognition method based on multi-scale feature extraction and global feature fusion is proposed

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The present invention will be further described below.

[0039] As shown in the figure, the concrete steps of the present invention are:

[0040] A. Select the FER2013 facial expression data set as the original data. The image data file is in .csv format. Through the Usage attribute, the data set is divided into three parts: Training, PrivateTest and PublicTest. The training data set is used as the training set data, and the PrivateTest data set As the test set data; the TensorFlow artificial intelligence learning system is used to convert both the training set data and the test set data into TFrecord format files for storage. This format can improve the efficiency of reading data during training and facilitate image processing and storage; The training of the network relies on a large number of data sets, so the amount and diversity of training data greatly affect the performance of the neural network;

[0041] B. Using the TensorFlow artificial intelligence learning ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face expression recognition method of multi-scale feature extraction and global feature fusion. A human face expression data set is selected as raw data, and the raw data isdivided into training set data and test set data. A TensorFlow artificial intelligence learning system is used to construct a convolution neural network with multi-scale feature extraction and globalfeature fusion. The convolution neural network reads the training set data, pretreats the training set data and performs model training, then reads the test set data, recognizes the expression types of each expression in the test set data in turn, and calculates the average accuracy rate and average F1 of all expressions after completing the recognition of all expressions. Score indicators, the final completion of the process of facial expression recognition. The invention has the advantages of high recognition speed under the condition of ensuring high recognition accuracy, and can be adaptedto multiple illumination environments with strong robustness, so as to effectively meet the practical application requirements.

Description

technical field [0001] The invention relates to a facial expression recognition method, in particular to a facial expression recognition method of multi-scale feature extraction and global feature fusion. Background technique [0002] In people's ordinary communication, facial expression is one of the most important ways. As a carrier of information, it contains a lot of information that cannot be expressed in language, which we call non-verbal information. Since faces can be directly observed in communication, facial expressions can convey emotional information in a more intuitive way. In recent years, emotion analysis has gradually attracted the attention of many researchers, and facial expression recognition is an important part of emotion analysis, and it has also been developed rapidly, especially in intelligent human-computer interaction. To infer people's emotional information and perform emotional imitation. [0003] The steps of the current facial expression recog...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/084G06V40/169G06V40/175G06N3/045
Inventor 王海波叶宾李会军张家铭
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products