Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Lie-telling detection method based on micro-expressions in interview

A detection method and micro-expression technology, applied in neural learning methods, acquisition/recognition of facial features, biological neural network models, etc., can solve the problems of robot face recognition micro-expression optimization, unconscious exposure, accuracy discount, etc.

Pending Publication Date: 2020-03-17
中科南京人工智能创新研究院 +1
View PDF9 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although lying is a common phenomenon, people's micro-expressions when lying are different from those in normal conversations. Some small changes in expressions and subtle muscle twitches on the face can easily reveal the true thoughts unconsciously. of micro-expression experts can capture these micro-expressions, and then judge whether there is lying and deceit in the interview process
[0003] However, because the interview process is easily interfered by various factors, the accuracy of relying on manual detection of lying is often greatly reduced, and traditional robot face recognition is prone to interference from other facial features because it does not specifically optimize micro-expressions , cannot be directly applied to micro-expression judgment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lie-telling detection method based on micro-expressions in interview
  • Lie-telling detection method based on micro-expressions in interview
  • Lie-telling detection method based on micro-expressions in interview

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] The technical solutions of the present invention will be further specifically described below through the embodiments and in conjunction with the accompanying drawings.

[0078] Such as figure 1 As shown, the present invention discloses a lie detection method based on micro-expressions in interviews, including five steps of making data labels, feature extraction, evaluating boundaries, regenerating boundaries, and result classification. The above five steps are described in detail below:

[0079] Step 1. Make data labels:

[0080] First, the model is trained with five expressions of frowning, raising eyebrows, pursing lips, pouting, and tilting the head, and labels each type of expression data. The model extracts the feature vectors of five types of face images: frowning, eyebrow raising, pursing mouth, pouting mouth, and tilting head. For each ground truth in the face image, find the a priori frame with the largest IOU, and the a priori frame matches it. For the rem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a lie-telling detection method based on micro-expressions in an interview, which comprises the following steps: firstly, training five expressions, namely eyebrow wrinkling, eyebrow lifting, mouth closing, pouting and head tilting, by a model, and labeling each type of expression data; secondly, inputting an image of the facial micro-expression into a pre-trained SSD network taking VGG16 as a backbone, enabling the image to pass through a convolutional neural network to extract features, and generating a feature map; performing convolution operation on each feature mapto evaluate a default bounding box, and predicting an offset and a classification probability for each bounding box; combining bounding boxes obtained by different feature maps, executing a non-maximum suppression method to filter a part of overlapped or incorrect borders, and generating a final bounding box set; and finally, classifying detection results by using a classifier. According to the method, high-level and low-level visual features are used at the same time, and compared with human beings, the method is obviously better in cheating prediction; and compared with naked eye judgment of human beings, the speed is higher, and the technical accuracy is higher.

Description

technical field [0001] The invention relates to a method for detecting lying based on micro-expressions in interviews, and belongs to the technical field of image information processing. Background technique [0002] Lying and deception often occur during interviews, and how to effectively identify lies is very important. Although lying is a common phenomenon, the micro-expressions of people when lying are different from those in normal conversation. Some small changes in expressions and subtle muscle twitches on the face can easily reveal the true thoughts unconsciously. Micro-expression experts can capture these micro-expressions, and then judge whether there is lying and deceit in the interview process. [0003] However, because the interview process is susceptible to interference from various factors, the accuracy of relying on manual detection of lying is often greatly reduced, and traditional robot face recognition is prone to interference from other facial features b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08G06Q10/10
CPCG06N3/084G06Q10/1053G06V40/168G06V40/172G06V40/174G06N3/045G06F18/2411
Inventor 胡庆浩吴其蔓
Owner 中科南京人工智能创新研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products