Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A 3D face reconstruction method based on a single image

A single image, three-dimensional face technology, applied in the field of three-dimensional face reconstruction based on a single image, can solve the problem of insufficient integrity of face reconstruction work, reduce the loss of details, improve the details of the face, and avoid data overload. big effect

Active Publication Date: 2021-03-30
SOUTH CHINA UNIV OF TECH
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the problem of insufficient completeness of current face reconstruction work, the present invention proposes a three-dimensional face reconstruction method based on a single picture, which can reconstruct a relatively good face model according to the face image, with better face details , and the number of grid points is small, which is conducive to the application in real-time environment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D face reconstruction method based on a single image
  • A 3D face reconstruction method based on a single image
  • A 3D face reconstruction method based on a single image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0085] The present invention will be further described below in conjunction with specific examples.

[0086] The three-dimensional face reconstruction method based on a single picture provided by this embodiment is as follows: for an input single face image, first use the feature points to solve the FLAME parameters to obtain the face shape, and then use the image high-frequency information to guide The vertices are moved, the details of the face are reconstructed, and finally the face map is completed using the constructed albedo parameterized model, and the illumination information is removed to obtain a complete albedo map. Based on this, the present invention proposes a face reconstruction framework, such as figure 1 shown.

[0087] The 3D face reconstruction method based on a single picture described in this embodiment, the algorithm flow is as follows figure 1 shown, including the following steps:

[0088] 1) Facial reconstruction

[0089] First, 68 feature points ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a three-dimensional human face reconstruction method based on a single picture. The method comprises the steps of 1) performing human face reconstruction (face reconstruction)based on a FLAME model; 2) performing FLAME grid face detail enhancement (detail enhancement); and 3) performing FLAME grid chartlet complementation (chartlet complementation). According to the main processes, an input human face image is given; based on an algorithm, firstly, by using human face feature points extracted from the image and in combination with three-dimensional feature points of aFLAME grid, feature point matching energy is established, and the shape of a human face is obtained; secondly, grid vertexes of a human face height field are guided to move by means of high-frequencyinformation of a human face area in the image, and fine face details are reconstructed; and finally, a human face chartlet is complemented through a built FLAME albedo parameterization model, and illumination information is removed. The method solves the problem of three-dimensional human face reconstruction for the single picture, and can be applied to the human face reconstruction and the humanface animation production.

Description

technical field [0001] The invention relates to the technical field of computer graphics and three-dimensional animation production, in particular to a method for reconstructing a three-dimensional human face based on a single picture. Background technique [0002] Human beings are not only the subject of various activities, but also the object of many applications, so most virtual reality applications are inevitably human-centered. The reconstruction of human surface shape and its motion plays a key role in such applications. From daily life, game animation, education and training to industrial design, it is increasingly important to construct highly realistic personalized virtual human static models and dynamic geometry. sex. For example, in a virtual fitting, in addition to body shape and motion information, the fitting person's facial expressions, fluttering hair, etc. will have an impact on the experience. In many virtual reality applications, the realistic appearance...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00G06T15/04G06T13/40
CPCG06T13/40G06T15/04G06T17/00
Inventor 李桂清何华赟
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products