Three-dimensional face model edge optimization method and system based on micro rendering

A 3D face and optimization method technology, applied in the computer field, can solve problems such as poor effect, low similarity of target face images, inconsistent expressions of target face images in 3D face models, etc.

Pending Publication Date: 2022-01-07
ZHEJIANG VERSATILE MEDIA
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the 3D face model established according to the existing method has the problem of poor effect in the specific area of ​​the edge and low similarity with the acquired target face image when driven by a super-realistic real-life model because there is no specific model index at the edge. , especially the inner lips of the 3D face model, when a super-realistic real-life model is driven, if a fixed model index is selected, there will be a problem that the expression of the 3D face model is inconsistent with the expression of the target face image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional face model edge optimization method and system based on micro rendering
  • Three-dimensional face model edge optimization method and system based on micro rendering
  • Three-dimensional face model edge optimization method and system based on micro rendering

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044]In order to facilitate the understanding of those skilled in the art, the present invention will be further described in detail below in conjunction with specific embodiments.

[0045] Please refer to figure 1 , the embodiment of the present invention provides a method for optimizing the edge of a three-dimensional human face model based on differentiable rendering, comprising the following steps:

[0046] Step S10, acquire the target human face image; in this embodiment, in the process of collecting the target human face image by the camera, it also includes extracting key points in the target human face image and or obtaining the camera position corresponding to the target human face image The step of pose parameters, specifically, the key points can be extracted or the camera pose parameters can be obtained through existing semi-automatic software and manual fine-tuning. In other embodiments, it may also only include the step of acquiring the target face image.

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a three-dimensional face model edge optimization method and system based on micro rendering, and relates to the technical field of computers. The method comprises the steps that: edge feature information is extracted from depth information in a derivable step; then, barycentric coordinate interpolation is carried out according to the edge feature information to obtain edge feature points of a three-dimensional face model; a total loss function Iall composed of a distribution loss function ldis, a chamfering distance loss function lchamfer and a regularization loss function lreg is constructed, and iteration is carried out on the total loss function Iall to obtain an optimal expression weight; and finally, an optimal three-dimensional face model is generated according to the optimal expression weight. The optimal three-dimensional face model has the advantages of high matching degree with the target face image and good authenticity.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to a method and system for optimizing the edge of a three-dimensional human face model based on differentiable rendering. Background technique [0002] In the prior art, the common method for image-driven expression is to extract the key points of the face on the image, find the index corresponding to the back-projection of the key points of the face on the 3D face model, and use the least squares algorithm to solve the 3D face model. The value of the weight corresponding to the feature vector makes it possible for the key points of the face to be similar to the coordinate points of the 3D face model. [0003] However, the 3D face model established according to the existing method has the problem of poor effect in the specific area of ​​the edge and low similarity with the acquired target face image when driven by a super-realistic real-life model because there is no specific mode...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/13G06T7/181G06T7/80G06K9/00
CPCG06T7/13G06T7/181G06T7/80G06T2207/10012
Inventor 俞庭李炼
Owner ZHEJIANG VERSATILE MEDIA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap