Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Natural occlusion expression recognition method and system with accurate attention

An expression recognition and attention technology, applied in the field of expression recognition, can solve problems such as inaccuracy, inaccurate learning attention weights, and insufficient adaptation of expressions, and achieve good accuracy and efficiency.

Pending Publication Date: 2022-04-15
SHANDONG UNIV
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, such researches either allow the network to learn attention weights without any occlusion information, and the learned attention weights are not accurate enough, or use occlusion information to directly weight deep features, and the attention composed only of occlusion information does not Not suitable for the attention of facial expression recognition tasks, so it is not accurate enough
For example, the attention map learned without any occlusion information may still contain part of the occlusion area; another example, the key expression information of an occluded disgust expression image is in the nose and mouth area, and an occlusion The key information of the surprised expression image is in the eyes and mouth area, and the occlusion information can only indicate which area is occluded, and the key areas such as eyes, nose, and mouth without occlusion are treated equally, and it is not suitable for specific expressions.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural occlusion expression recognition method and system with accurate attention
  • Natural occlusion expression recognition method and system with accurate attention
  • Natural occlusion expression recognition method and system with accurate attention

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0055] It should be noted that the following detailed description is exemplary and intended to provide further explanation of the present invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0056] It should be noted that the terminology used here is only for describing specific embodiments, and is not intended to limit exemplary embodiments according to the present invention. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural, and it should also be understood that when the terms "comprising" and / or "comprising" are used in this specification, they mean There are features, steps, operations, means, components and / or combinations thereof.

[0057] Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a natural occlusion expression recognition method and system with accurate attention, and the method comprises the steps: obtaining a to-be-recognized image, and carrying out the preprocessing of the image; processing the preprocessed to-be-recognized image by using a pre-trained natural occlusion expression recognition network to obtain an expression recognition result; the construction and training process of the natural occlusion expression recognition network comprises the steps of performing face key point detection on an occlusion expression image after preprocessing of a known expression, screening a plurality of interest points in key points, generating a Gaussian graph based on each interest point, and obtaining an occlusion indication graph of the corresponding image; an attention descriptor is calculated according to a neuron activation value of the depth feature of the occlusion expression image, the attention descriptor of the depth feature is forced to approach the occlusion indication graph by constructing attention loss, and attention of the depth feature is forced to adapt to different expressions by constructing expression classification loss. The method is high in recognition accuracy.

Description

technical field [0001] The invention belongs to the technical field of expression recognition, and in particular relates to a method and system for recognizing natural occlusion expressions with accurate attention. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] In recent years, since facial expression recognition plays an important role in many applications such as emotional computing, behavior prediction, human-computer interaction, and mental health services, its research has received widespread attention and achieved great success. When recognizing expressions in the real world, it is common for faces to be occluded by sunglasses, facial accessories such as scarves, or other random objects such as hands, hair, and mugs. The existing facial expression recognition methods are good for the recognition of ideal unoccluded facial expressio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/16G06V10/82G06N3/04G06N3/08
Inventor 马昕姜美娟李贻斌
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products