Unlock instant, AI-driven research and patent intelligence for your innovation.

Virtual face image reconstruction method and related device

A face image and face technology, applied in the field of face image processing, can solve the problems of non-differentiable rendering of face reconstruction technology, rendering engine cannot be optimized, etc., to achieve the effect of improving reliability and accuracy and optimizing rendering performance

Pending Publication Date: 2022-01-28
GUANGDONG ELECTRIC POWER SCI RES INST ENERGY TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] This application provides a virtual face image reconstruction method and related devices, which are used to solve the technical problem that the rendering engine cannot be optimized due to the non-differentiable rendering in the existing face reconstruction technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual face image reconstruction method and related device
  • Virtual face image reconstruction method and related device
  • Virtual face image reconstruction method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0051] For ease of understanding, see figure 1 , an embodiment of a method for reconstructing a virtual human face image provided by the application, including:

[0052] Step 101. Obtain a target two-dimensional face image and corresponding initialized three-dimensional face parameters.

[0053]Input the target 2D face image into 3DMM (3D Morphable Model) for pro...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a virtual face image reconstruction method and a related device. The method comprises the following steps: acquiring a target two-dimensional face image and a corresponding initialized three-dimensional face parameter; inputting the initialized three-dimensional face parameters into a preset face simulation engine for rendering to obtain a virtual face image; performing identity verification according to the target two-dimensional face image and the virtual face image based on a preset face recognition model to obtain a first loss value; performing face feature verification according to the target two-dimensional face image and the virtual face image based on a preset face semantic segmentation model to obtain a second loss value; and optimizing the initialized three-dimensional face parameter according to the first loss value and the second loss value to obtain an updated three-dimensional face parameter, and returning to the rendering step until iterative convergence to obtain an optimized virtual face image. According to the invention, the technical problem that a rendering engine cannot be optimized due to non-differentiable rendering in an existing face reconstruction technology can be solved.

Description

technical field [0001] The present application relates to the technical field of face image processing, in particular to a virtual face image reconstruction method and related devices. Background technique [0002] In recent years, with the increasingly complex dynamic characteristics of smart grids, digital twin technology has been widely used. Among them, the real-time description of personnel status is also an important link. As the face is the most representative biological feature of an individual, how to perform a high-precision virtual reconstruction of the user's face is also a hot research issue in the digital twin of the smart grid. [0003] At present, a general-purpose engine is used for rendering and reconstruction of 3D faces, but the rendering process of the engine is non-differentiable, and the 3D faces generated by the engine cannot be optimized. Contents of the invention [0004] The present application provides a virtual face image reconstruction metho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T15/00G06V40/16G06V10/82G06N3/04G06N3/08
CPCG06T17/00G06T15/005G06N3/08G06N3/045
Inventor 张晓晔梁俊韬陈禹明郑培文杨英仪吴勇赖嘉骏
Owner GUANGDONG ELECTRIC POWER SCI RES INST ENERGY TECH CO LTD