Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Micro-expression Sequence Feature Extraction Method Based on Optical Flow Field

A feature extraction and optical flow field technology, applied in the field of computer vision, can solve the problems of high requirements for fine face alignment and inability to process well.

Active Publication Date: 2018-11-02
FUDAN UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, micro-expression analysis has high requirements for fine alignment of faces, and this method cannot handle this problem well.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Micro-expression Sequence Feature Extraction Method Based on Optical Flow Field
  • Micro-expression Sequence Feature Extraction Method Based on Optical Flow Field
  • Micro-expression Sequence Feature Extraction Method Based on Optical Flow Field

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0088] The present invention provides a method for describing the characteristics of micro-expressions, which is used for the identification and classification of micro-expressions. The following examples illustrate the application of the present invention.

[0089] In practical applications, it is necessary to perform sequence segmentation from long-term video sequences in advance. The segmentation can use a fixed-length time window, or it can be matched to a specific pattern for segmentation. The present invention does not involve segmentation technology, therefore, the following only takes a simple time window technology as an example.

[0090] A high-speed camera (50-200fps) is used to capture video of human faces, in which micro-expression sequences are detected and classified. Regular 25fps cameras can also capture micro-expressions, however some extremely short micro-expressions may be missed. Additionally, even for captured microexpressions, temporally similar infor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of computer vision, and specifically relates to a micro-expression sequence feature extraction method based on an optical flow field. The present invention first extracts the dense optical flow field between adjacent frames under the premise of a certain number of micro-expression frames; then eliminates the influence of face translation on micro-expression recognition through fine alignment; then, the aligned light The flow field is divided into a series of space-time blocks, and the main direction is extracted in each space-time block to characterize the motion mode of most points in the block; the main directions in all blocks are quantified, spliced, and expressed Reach the form of vector, that is, get the designed micro-expression sequence features. The above-mentioned novel feature based on motion description proposed by the present invention can be used for micro-expression recognition. The method of the invention is superior to other existing methods in the comprehensive index of accuracy rate, precision and recall rate, and promotes the further development of micro-expression recognition technology. At the same time, the method can characterize the dynamic patterns of micro-expressions, which provides a deeper understanding for the analysis of micro-expressions.

Description

technical field [0001] The invention belongs to the technical field of computer vision, in particular to a method for extracting micro-expression sequence features based on an optical flow field. Background technique [0002] At present, there are many difficulties in micro-expression recognition, and a practical method and theoretical framework have not yet been formed at this stage. The difficulty is mainly manifested in feature extraction. The features currently used are often general video feature representations, which are not optimized for the application of micro-expressions, and cannot provide a deep understanding of micro-expressions. [0003] Microexpressions were first discovered in 1969 by psychologists by observing videotaped conversations with depressed patients [1]. The patient in the video often displayed a normal smile, however a few frames of unusually distressed expressions could be seen. Psychologists call it microexpressions. [0004] Different from ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
CPCG06V40/174G06V40/168
Inventor 徐峰张军平
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com