Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Micro-expression recognition method and device based on hybrid spatio-temporal convolution model

A convolution model and recognition method technology, applied in character and pattern recognition, acquisition/recognition of facial features, instruments, etc., can solve the problems of high requirements, difficult to implement, slow calculation efficiency, etc. Conducive to productization, the effect of reduced requirements

Active Publication Date: 2021-03-02
GCI SCI & TECH +1
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, a 3D convolutional neural network algorithm is pointed out in this study, which uses 3*3*3 convolution for expression recognition. However, the 3D algorithm adds floating point numbers and parameters compared to 2D CNN, and has higher requirements for hardware. Calculation efficiency is slow, and it is difficult to implement in actual projects and products

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Micro-expression recognition method and device based on hybrid spatio-temporal convolution model
  • Micro-expression recognition method and device based on hybrid spatio-temporal convolution model
  • Micro-expression recognition method and device based on hybrid spatio-temporal convolution model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] see figure 1 , which is a schematic flowchart of a micro-expression recognition method based on a hybrid spatio-temporal convolution model provided by an embodiment of the present invention. The methods include:

[0053] S100: Train the pre-established hybrid spatio-temporal convolution network according to the pre-acquired image training samples to obtain a hybrid spatio-temporal convolution model; wherein, the hybrid spatio-temporal convolution network includes a plurality of cyclic alternately connected 3D residual modules, each The 3D residual modules each include a 1*3*3 convolutional layer and a 3*1*1 convolutional layer;

[0054] S200: Input the image to be recognized into the hybrid spatiotemporal convolution model to obtain a micro-expression classification result.

[0055] In step S100, a hybrid spatio-temporal convolution model consisting of a plurality of alternately connected 3D residual modules including 1*3*3 convolutional layers and 3*1*1 convolutional...

Embodiment 2

[0133] see Figure 5, which is a schematic block diagram of a micro-expression recognition device based on a hybrid spatio-temporal convolution model provided by an embodiment of the present invention, the device includes:

[0134] The model construction module 1 is used to train the pre-established hybrid spatiotemporal convolutional network according to pre-acquired image training samples to obtain a hybrid spatiotemporal convolutional model; Difference module, each 3D residual module includes 1*3*3 convolutional layer and 3*1*1 convolutional layer;

[0135] The micro-expression recognition module 2 is configured to input the image to be recognized into the hybrid spatio-temporal convolution model to obtain a micro-expression classification result.

[0136] In an optional embodiment, the model building module 1 includes:

[0137] The data classification unit is used to classify the pre-collected expression image data according to several predefined micro-expressions;

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a micro-expression recognition method and device based on a hybrid spatiotemporal convolution model. The method includes: training a pre-established hybrid spatiotemporal convolution network according to pre-acquired image training samples to obtain a hybrid spatiotemporal convolution model; Wherein, the hybrid spatio-temporal convolutional network includes a plurality of cyclically connected 3D residual modules alternately, each 3D residual module includes a 1*3*3 convolutional layer and a 3*1*1 convolutional layer; the image to be identified is input to the hybrid spatiotemporal convolution model to obtain micro-expression classification results. Using mixed 1*3*3 convolution (2-dimensional) + 3*1*1 convolution (1-dimensional) for convolution calculation, on the one hand, it ensures that the present invention has the accuracy requirements of 3D CNN in micro-expression recognition; on the other hand On the one hand, it greatly reduces the computational complexity, thereby reducing the requirements for computer hardware, and is more conducive to productization.

Description

technical field [0001] The invention relates to the technical field of micro-expression recognition, in particular to a micro-expression recognition method and device based on a mixed spatiotemporal convolution model. Background technique [0002] Microexpressions are very fleeting, involuntary facial expressions that humans reveal when they try to suppress or hide their true emotions. The difference between it and ordinary expressions is that the duration of micro-expressions is very short, only 1 / 25 second to 1 / 5 second. Therefore, most people are often unaware of its existence. This rapid and subtle facial expression is thought to be associated with an ego defense mechanism, expressing repressed emotions. However, the psychological and neural mechanisms of the generation and recognition of micro-expressions are still being studied, and the frequency of micro-expressions is relatively low, and ordinary people's ability to recognize micro-expressions is not high. A micro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
CPCG06V40/174G06V40/161G06V40/168G06V40/172
Inventor 温云龙杜翠凤杨旭周善明张添翔叶绍恩梁晓文
Owner GCI SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com