Supercharge Your Innovation With Domain-Expert AI Agents!

Facial action recognition and model training method and device, equipment and storage medium

A facial action and recognition model technology, applied in the field of facial expression recognition, can solve the problem of difficulty in accurately identifying facial expressions and facial expressions in facial images.

Pending Publication Date: 2022-04-12
IFLYTEK CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the subjectivity of emotions and the similarity between different emotions, it is difficult to accurately identify facial expressions in human face images.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial action recognition and model training method and device, equipment and storage medium
  • Facial action recognition and model training method and device, equipment and storage medium
  • Facial action recognition and model training method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0045] In order to be able to train a facial action recognition model that can accurately identify facial action features, the inventors of the present application have found through research that: due to the lack of labeled data of human face and facial actions, if a supervised training method is used to train the facial action recognition model , which may lead to low accuracy of the trained action recognition model. However, it will be particularly time-consuming and labor-intensiv...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a facial action recognition and model training method and device, equipment and a storage medium. The model training method comprises the steps of obtaining a plurality of video segment samples; constructing at least one homologous positive sample pair and at least one homologous negative sample pair of each video segment sample; constructing at least one non-homologous positive sample pair and at least one non-homologous negative sample pair for the plurality of video segment samples; based on the face image samples, the homologous positive sample pairs, the homologous negative sample pairs, the non-homologous positive sample pairs and the non-homologous negative sample pairs in the plurality of video segment samples, training a facial action feature model by adopting a self-supervised learning method to obtain an initially trained facial action feature model; and training the facial action feature model and the facial action classifier by using a plurality of facial image samples marked with facial action categories to obtain a facial action recognition model. According to the scheme, the face action recognition model capable of accurately recognizing the face action can be trained.

Description

technical field [0001] This application relates to the technical field of facial expression recognition, and more specifically, to a method, device, device and storage medium for facial action recognition and model training. Background technique [0002] With the continuous development of computer technology and artificial intelligence technology, the application fields of facial expression recognition technology are increasing. [0003] Facial expression recognition technology can analyze the expression state of the face from the face image. However, due to the subjectivity of emotions and the similarity between different emotions, it is difficult to accurately identify facial expressions in human face images. In order to improve the accuracy of facial expression recognition, facial movements of facial images can be combined to assist facial expression recognition. [0004] It can be seen that accurately recognizing facial movements of human face images is the key to impr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V20/40G06V40/16G06V40/20G06N3/08G06V10/82
Inventor 奚昌凤吴子扬
Owner IFLYTEK CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More