Optical flow gradient amplitude characteristic-based subtle facial expression detection method

A gradient amplitude, micro-expression technology, applied in the acquisition/recognition of facial features, instruments, characters and pattern recognition, etc., can solve problems such as susceptible to head offset

A gradient amplitude, micro-expression technology, applied in the acquisition/recognition of facial features, instruments, characters and pattern recognition, etc., can solve problems such as susceptible to head offset

CN110991348AActive Publication Date: 2020-04-10HEBEI UNIV OF TECH

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Optical flow gradient amplitude characteristic-based subtle facial expression detection method
  • Optical flow gradient amplitude characteristic-based subtle facial expression detection method
  • Optical flow gradient amplitude characteristic-based subtle facial expression detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0125] The facial micro-expression detection method based on the optical flow gradient amplitude feature firstly extracts the region of interest by fitting the face edge according to the key points of the face, and uses the FlowNet2 network to extract the optical flow field between the frames of the face image in the video sequence, and then extracts The optical flow gradient amplitude feature of the face area of ​​interest, and then calculate and process the feature distance and perform noise elimination, and complete the face micro-expression detection based on the optical flow gradient amplitude feature. The specific steps are as follows:

[0126] The first step is to extract the region of interest of the face:

[0127] Input the face image video sequence, and extract the region of interest by fitting the face edge according to the key points of the face, that is, using the Dlib detector to detect 81 labeled face key points in the face image, including in the classic Dlib fa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an optical flow gradient amplitude characteristic-based subtle facial expression detection method and relates to processing for identifying a graphic recording carrier. According to the method, face edges are obtained by means of fitting according to face key points, and a face region of interest is extracted; an optical flow field between face image frames in a video sequence is extracted by using a FlowNet2 network; the optical flow gradient amplitude characteristics of the face region of interest are extracted; characteristic distances are calculated and processed, and noise elimination is carried out; and therefore, subtle facial expression detection based on the optical flow gradient amplitude characteristics is completed. According to subtle facial expressiondetection in the prior art, subtle facial expression motion cannot be captured in extracted face image motion features; the features contain excessive interference information, and as a result, the subtle facial expression detection is susceptible to the influence of head deviation, blinking motion, accumulated noise and single-frame noise in feature distance analysis. However, with the method adopted, the above defects in the prior art can be eliminated.

Description

technical field [0001] The technical solution of the present invention relates to the processing for identifying graphic record carriers, in particular to the detection method of human face micro-expression based on the characteristic of optical flow gradient amplitude. Background technique [0002] Facial micro-expression detection is widely used in many fields of national security, clinical medicine and judicial system, such as identifying dangerous persons such as terrorists through facial micro-expression detection, and using facial micro-expression detection training software to treat patients with schizophrenia. Adjuvant treatment, analysis of the criminal's criminal psychology through facial micro-expression detection to help the investigation and interrogation, etc. At present, most of the research work on facial micro-expressions focuses on the recognition of facial micro-expressions. However, the video sequence frames used to recognize facial micro-expressions need...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
10 Apr 2020
Publication
CN110991348A
IPC
G06K9/00; G06K9/32; G06K9/40; G06K9/62
CPC
G06V40/174; G06V10/25; G06V10/30; G06F18/241
Inventors
于明; 郜斌