Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A microexpression recognition method based on sparse projection learning

A technology of sparse projection and recognition method, which is applied in the field of pattern recognition, can solve problems such as the fusion of spatial and temporal features without objective consideration, and achieve the effect of simple implementation, low computational complexity, and good recognition accuracy

Active Publication Date: 2018-12-18
JIANGSU UNIV
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, in the literature: Zhao G, Pietikainen M. Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2007, 29(6):915-928, extract three orthogonal The features of the plane represent micro-expressions, but it does not objectively consider the feature fusion problem in the spatial and temporal domains

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A microexpression recognition method based on sparse projection learning
  • A microexpression recognition method based on sparse projection learning
  • A microexpression recognition method based on sparse projection learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0023] (1) Collect M micro-expression samples, and extract LBP (Local Binary Patterns) features from the image frame sequence in each sample on three orthogonal planes (XY plane, XT plane and YT plane), denoted as where d is the dimension of LBP features. If there are K types of emotions, the emotion label matrix can be defined:

[0024]

[0025] in Represents the sentiment category label vector of the i-th sample. If the emotion of the i-th sample belongs to the k-th category, then l i is a K-dimensional vector whose k-th element is 1 and the rest are 0. Construct an optimization model:

[0026]

[0027] in C, D, E are feature optimization variables, ||·|| F is the Frobenius norm of the matrix, ||·|| 2,1 represents the sum of the binorms of all columns of the matrix, λ, μ are the parameters to control the sparsity of the m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a micro expression recognition method based on sparse projection learning. The method comprises the steps of: Step 1, collecting a micro expression sample, extracting LBP features P, Q, R of three orthogonal planes of the micro expression, and defining C, D, E as feature optimization variables of three orthogonal planes of XY, XT, YT respectively; constructing an optimization model; 2, setting the initial value and maximum value of iterative counting variable t and n and initializing the regularization parameter kappa, kappa max, and the scale parameter ruho; step 3, initializing the expression (shown in the description), calculating C, and updating T1 and Kappa; If the expression (shown in the description) converges or n> nmax, proceeding to step 4; step 4, initializing the expression (shown in the description), calculating D, and updating T2 and Kappa; and if the expression (shown in the description) converges or n>nmax, proceeding to step 5; step 5, initializing the expression (shown in the description), calculating E, and updating T3 and Kappa; and if the expression (shown in the description) converges or n> nmax, proceeding to step 6; step 6, makingt=t+1, if t <= tmax, returning to step 3, otherwise, outputting C, D, E; step 7, optimizing the LBP features of the three orthogonal plane by optimizing the variables C, D and E to obtain a new fusionfeature Ftest, and predicting the emotion category of the test sample through the trained SVM classifier for the fusion feature Ftest.

Description

technical field [0001] The invention belongs to the field of pattern recognition, and relates to a micro-expression recognition method for LBP-TOP (Local Binary Patterns from Three Orthogonal Planes) feature optimization, specifically a micro-expression recognition method based on sparse projection learning. Background technique [0002] In recent years, micro-expression recognition has been very active in the field of computer pattern recognition. Unlike normal expressions, micro-expressions are very short-lived, so most people tend to ignore their existence. At present, many teams at home and abroad are actively carrying out research on micro-expression recognition, and have achieved certain results. From the latest research results at home and abroad at this stage, it is found that the currently known methods still have their own limitations. Both data collection, database establishment, feature extraction and theoretical analysis need to be further improved and develop...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62
CPCG06V40/174G06V10/44G06V10/467G06V10/513G06F18/2411G06F18/214G06F18/253
Inventor 汤明皓戴继生
Owner JIANGSU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products