Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Expression editing method and device based on face analysis

A technology of facial expressions and facial expressions, which is applied in instruments, calculations, image data processing, etc., can solve the problems of low computing efficiency, poor editing effect, difficult to deal with facial expression changes, etc.

Active Publication Date: 2021-01-08
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The method of image reordering is to use images or image blocks in the database to reorder to approach the target expression. This method is difficult to deal with facial expression editing with large expression changes.
The flow-based method first calculates the difference between the source domain image and the target domain image on the flow map, and uses the difference information to guide the synthesis of target facial expressions, but its editing effect is not good
Facial expression editing based on 3D reconstruction has good editing effect and performance, but its editing complexity is high and calculation efficiency is low, so it is difficult to popularize and apply

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expression editing method and device based on face analysis
  • Expression editing method and device based on face analysis
  • Expression editing method and device based on face analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0099] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

[0100] In order to ensure the realistic effect of the edited facial expression and maintain the identity of the edited object, the present invention is based on face analysis and designs an end-to-end model to perform the facial expression editing task. The present invention proposes two generative adversarial network models, which are respectively the face analysis prediction network and the facial expression editing network. Linear relationship, and the identity preservation constraint and expression preservation constraint are added at the feature level, which can well preserve the identity information and expression information of the edit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of computer graphics, and particularly relates to an expression editing method and device based on face analysis. The purpose of the invention is to solvethe problem of how to keep figure identity and carryin out expression editing on the expression-free face. In order to achieve the purpose, the expression editing method based on face analysis provided by the invention comprises the following steps: obtaining an expression-containing face analysis image corresponding to an expression-free face image and an expression intensity control code based on a preset face analysis prediction network and according to the expression-free face image and the expression intensity control code which are obtained in advance; And obtaining a target expression image based on a preset face expression editing network and according to the expression-containing face analysis image and the expression-free face image. Based on the above steps, editing of differentintensities and different expressions can be carried out on the face without expressions on the premise of keeping the identity information of the character.

Description

technical field [0001] The invention relates to the technical field of computer graphics, in particular to an expression editing method and device based on face analysis. Background technique [0002] Expression editing is a typical graphics processing technology. Its main task is to convert human facial expressions from source expressions to target expressions while maintaining the character's identity. However, there are still some challenging problems in facial expression editing technology due to the variety of face categories, intensity changes, and texture deformations. [0003] At present, the methods of facial expression editing mainly include image reordering, flow-based methods and 3D reconstruction, etc. The method of image reordering is to use images or image blocks in the database to reorder to approach the target expression. This method is difficult to deal with facial expression editing with large expression changes. The flow-based method first calculates th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T13/40
Inventor 赫然张兆翔卢治合胡坦浩
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products