Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Dynamic expression recognition method and system based on space-time multi-feature fusion

A technology of multi-feature fusion and expression recognition, applied in the field of image processing

Active Publication Date: 2021-05-07
SHANDONG UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the deficiencies of the prior art, this application provides a dynamic expression recognition method and system based on spatio-temporal multi-feature fusion; Combining features, using the relative majority voting method of ensemble learning, the features are fused at the decision-making level to solve the problem of limitations of single feature descriptors, thereby improving the accuracy of expression recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic expression recognition method and system based on space-time multi-feature fusion
  • Dynamic expression recognition method and system based on space-time multi-feature fusion
  • Dynamic expression recognition method and system based on space-time multi-feature fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] This embodiment provides a dynamic expression recognition method based on spatio-temporal multi-feature fusion;

[0046] Such as figure 1 As shown, the dynamic expression recognition method based on spatio-temporal multi-feature fusion includes:

[0047] S101: Obtain a sequence of facial expression images to be recognized;

[0048] S102: Preprocessing the facial expression image sequence to be recognized;

[0049] S103: Extract spatio-temporal features from the preprocessed facial expression image sequence; respectively collect texture features and geometric features from the expression peak key frame images;

[0050] S104: Perform facial expression recognition on spatio-temporal features to obtain a first recognition result, perform facial expression recognition on texture features to obtain a second recognition result; perform recognition on geometric features to obtain a third recognition result;

[0051] S105: Perform a majority vote on the first, second and thir...

Embodiment 2

[0134] This embodiment provides a dynamic expression recognition system based on spatio-temporal multi-feature fusion;

[0135] A dynamic expression recognition system based on spatio-temporal multi-feature fusion, including:

[0136] An acquisition module configured to: acquire a sequence of facial expression images to be recognized;

[0137] A preprocessing module, which is configured to: preprocess the facial expression image sequence to be recognized;

[0138] The feature extraction module is configured to: extract spatio-temporal features from the preprocessed facial expression image sequence; collect texture features and geometric features respectively for the expression peak key frame images;

[0139] The identification module is configured to: perform expression recognition on spatio-temporal features to obtain a first recognition result, perform expression recognition on texture features to obtain a second recognition result; perform recognition on geometric features...

Embodiment 3

[0145] This embodiment also provides an electronic device, including: one or more processors, one or more memories, and one or more computer programs; wherein, the processor is connected to the memory, and the one or more computer programs are programmed Stored in the memory, when the electronic device is running, the processor executes one or more computer programs stored in the memory, so that the electronic device executes the method described in Embodiment 1 above.

[0146] It should be understood that in this embodiment, the processor can be a central processing unit CPU, and the processor can also be other general-purpose processors, digital signal processors DSP, application specific integrated circuits ASIC, off-the-shelf programmable gate array FPGA or other programmable logic devices , discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a dynamic expression recognition method and system based on space-time multi-feature fusion. The method comprises the steps of obtaining a to-be-recognized facial expression image sequence; preprocessing a to-be-recognized facial expression image sequence; extracting spatio-temporal features of the preprocessed facial expression image sequence; respectively collecting texture features and geometric features of the expression peak key frame image; performing expression recognition on the spatial-temporal features to obtain a first recognition result, and performing expression recognition on the texture features to obtain a second recognition result; recognizing the geometric features to obtain a third recognition result; and performing majority voting on the first recognition result, the second recognition result and the third recognition result to obtain a final expression recognition result. According to the method, the LBP-TOP operator is improved, and the feature expression ability and the feature extraction rate are enhanced. The invention provides a new geometric feature expression mode, and the normalized face key points are directly used as geometric features, so that the feature dimension is effectively reduced.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to a dynamic expression recognition method and system based on spatio-temporal multi-feature fusion. Background technique [0002] The statements in this section merely mention the background art related to this application, and do not necessarily constitute the prior art. [0003] With the continuous development of artificial intelligence and computer technology, facial expression recognition has become a research hotspot. Machines can better serve humans and promote the further development of artificial intelligence by recognizing the changes in human facial expressions and analyzing the inner psychological activities of humans. Emotion recognition from facial expressions is one of the most effective and straightforward methods in affective computing. Facial expression reflects the human emotional state in a non-verbal form, and is an indispensable part of the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/176G06V40/168G06F18/259G06F18/256G06F18/25
Inventor 杨明强闫汝玉
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com