Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

3D face model reconstruction method and device

A 3D face and model technology, applied in the field of image processing, can solve the problems of low 3D reconstruction accuracy, time-consuming, light sensitivity, etc., and achieve the effect of avoiding complex time-consuming, avoiding optimization process, and improving accuracy and speed.

Pending Publication Date: 2018-12-18
合肥的卢深视科技有限公司
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods have some problems: the optimization based on key point information only uses sparse key point information, and the accuracy of 3D reconstruction is low; the color-based optimization requires time-consuming calculations and is more sensitive to lighting

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D face model reconstruction method and device
  • 3D face model reconstruction method and device
  • 3D face model reconstruction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the Some, but not all, embodiments are invented. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the embodiments of the present invention.

[0022] see figure 1 , the present embodiment discloses a method for reconstructing a three-dimensional face model, comprising:

[0023] S1. Obtain the face depth map and face color map to be processed, input the pre-trained rough learning network to obtain the parameterized three-dimensional face model coefficients, according to The parameterized th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a 3D face model reconstruction method and device, which can improve the accuracy and the speed of reconstructing the three-dimensional human face model. The method comprises the following steps: S1, acquiring a face depth map and a face color map to be processed, inputting the face depth map and the face color map to be processed into a pre-trained rough learning network to obtain parameterized three-dimensional face model coefficients, and determining an initial three-dimensional face model according to the parameterized three-dimensional face model coefficients; S2, converting the initial three-dimensional face model and the brightness value on the face color map into a four-channel UV picture, inputting the UV picture into a pre-trained fine learning network, and obtaining the offset of each mesh point of the three-dimensional face model to be reconstructed in the respective normal direction; S3, reconstructing a three-dimensional face modelaccording to the parameterized three-dimensional face model coefficients and the offset of each mesh point in the respective normal direction.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image processing, and in particular to a method and device for reconstructing a three-dimensional face model. Background technique [0002] There are mainly three methods for 3D face reconstruction: manual modeling, instrumental acquisition, and image-based modeling with little interaction or fully automatic modeling. As the earliest 3D modeling method, manual modeling is still widely used. Manual modeling generally requires experienced professionals to complete it with the help of Autodesk Maya, 3DMax and other software. Since manual modeling requires a lot of manpower and time, 3D face modeling equipment has been researched and developed for a long time as a more convenient method. Typical representatives include precision three-dimensional acquisition instruments and depth cameras based on structured light and laser scanning technology. The 3D model collected based on precision...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T17/00G06T15/04
CPCG06T15/04G06T17/00G06T2207/10028G06T2207/10024G06T2207/30201Y02T10/40
Inventor 户磊
Owner 合肥的卢深视科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products