Method and apparatus for micro-expression recognition based on hybrid spatio-temporal convolution model

A convolution model and recognition method technology, applied in character and pattern recognition, acquisition/recognition of facial features, instruments, etc., can solve problems such as difficulty in landing, slow calculation efficiency, high requirements, etc., to reduce computational complexity and benefit Effect of productization, reduced requirements

Active Publication Date: 2019-02-26
GCI SCI & TECH +1
View PDF10 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, a 3D convolutional neural network algorithm is pointed out in this study, which uses 3*3*3 convolution for expression recognition. However, the 3D algorithm adds floating point numbers and parameters compared to 2D CNN, and has higher requirements for hardware. Calculation efficiency is slow, and it is difficult to implement in actual projects and products

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for micro-expression recognition based on hybrid spatio-temporal convolution model
  • Method and apparatus for micro-expression recognition based on hybrid spatio-temporal convolution model
  • Method and apparatus for micro-expression recognition based on hybrid spatio-temporal convolution model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] see figure 1 , which is a schematic flowchart of a micro-expression recognition method based on a hybrid spatio-temporal convolution model provided by an embodiment of the present invention. The methods include:

[0053] S100: Train the pre-established hybrid spatio-temporal convolution network according to the pre-acquired image training samples to obtain a hybrid spatio-temporal convolution model; wherein, the hybrid spatio-temporal convolution network includes a plurality of cyclic alternately connected 3D residual modules, each The 3D residual modules each include a 1*3*3 convolutional layer and a 3*1*1 convolutional layer;

[0054] S200: Input the image to be recognized into the hybrid spatiotemporal convolution model to obtain a micro-expression classification result.

[0055] In step S100, a hybrid spatio-temporal convolution model consisting of a plurality of alternately connected 3D residual modules including 1*3*3 convolutional layers and 3*1*1 convolutional...

Embodiment 2

[0133] see Figure 5, which is a schematic block diagram of a micro-expression recognition device based on a hybrid spatio-temporal convolution model provided by an embodiment of the present invention, the device includes:

[0134] The model construction module 1 is used to train the pre-established hybrid spatiotemporal convolutional network according to pre-acquired image training samples to obtain a hybrid spatiotemporal convolutional model; Difference module, each 3D residual module includes 1*3*3 convolutional layer and 3*1*1 convolutional layer;

[0135] The micro-expression recognition module 2 is configured to input the image to be recognized into the mixed spatio-temporal convolution model to obtain a micro-expression classification result.

[0136] In an optional embodiment, the model building module 1 includes:

[0137] The data classification unit is used to classify the pre-collected expression image data according to several predefined micro-expressions;

[01...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a micro-expression recognition method and a device based on a mixed spatio-temporal convolution model. The method comprises the following steps: training a mixed spatio-temporalconvolution network established in advance according to a pre-acquired image training sample to obtain a mixed spatio-temporal convolution model; Wherein the hybrid spatio-temporal convolution network comprises a plurality of cyclically alternately connected 3D residual modules, each 3D residual module comprising a 1*3*3 convolution layer and a 3*1*1 convolution layer; An image to be recognized is input to the mixed spatio-temporal convolution model to obtain a microexpression classification result. The mixed 1*3*3 convolution (2D) +3*1*1 convolution (1D) is used for convolution calculation,on the one hand, the invention guarantees the precision requirement of 3D CNN in micro expression recognition; on the other hand, the invention adopts the mixed 1*3*3 convolution (2D) +3*1*1 convolution (1D) to perform convolution calculation. On the other hand, it greatly reduces the computational complexity, and reduces the requirement of computer hardware, which is more conducive to the production.

Description

technical field [0001] The invention relates to the technical field of micro-expression recognition, in particular to a micro-expression recognition method and device based on a mixed spatiotemporal convolution model. Background technique [0002] Microexpressions are very fleeting, involuntary facial expressions that humans reveal when they try to suppress or hide their true emotions. The difference between it and ordinary expressions is that the duration of micro-expressions is very short, only 1 / 25 second to 1 / 5 second. Therefore, most people are often unaware of its existence. This rapid and subtle facial expression is thought to be associated with an ego defense mechanism, expressing repressed emotions. However, the psychological and neural mechanisms of the generation and recognition of micro-expressions are still being studied, and the frequency of micro-expressions is relatively low, and ordinary people's ability to recognize micro-expressions is not high. A micro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/174G06V40/161G06V40/168G06V40/172
Inventor 温云龙杜翠凤杨旭周善明张添翔叶绍恩梁晓文
Owner GCI SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap