Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A three-dimensional face reconstruction method and system

A 3D face and target face technology, applied in 3D modeling, image analysis, image enhancement, etc., can solve problems such as lack of authenticity, achieve the effect of improving texture details and increasing accuracy

Active Publication Date: 2022-07-01
新拓三维技术(深圳)有限公司
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the existing technology, face templates are established through machine learning, which lacks authenticity

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A three-dimensional face reconstruction method and system
  • A three-dimensional face reconstruction method and system
  • A three-dimensional face reconstruction method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] like figure 1 As shown, the present invention provides a three-dimensional face reconstruction method, comprising the following steps:

[0038] S1: Acquire a color image and a depth image of a target face from at least two viewing angles, and determine whether the color image and the depth image are aligned;

[0039] S2: Under the condition that the color image and the depth image are aligned, extract the two-dimensional coordinates of the landmark points of the target face in the color image through deep learning, The corresponding relationship obtains the three-dimensional coordinates of the landmark points of the target face;

[0040] S3: Estimate the position of the target face according to the three-dimensional coordinates of the landmark points of the target face and set the threshold of the depth value, so as to screen out the target face from the original target face three-dimensional point cloud model of the target face The point cloud model, wherein, the ori...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a three-dimensional face reconstruction method and system. The method includes: acquiring a color image and a depth image of a target face from at least two viewing angles, and judging whether the color image and the depth image are aligned; acquiring the target The three-dimensional coordinates of the landmark points of the face and the original target face three-dimensional point cloud model of the target face; screen out the point cloud model of the target face; perform rough matching of the point cloud to obtain the rough registered three-dimensional point cloud model of the target face ; Perform accurate registration to obtain a precisely registered 3D point cloud model of the target face; perform fusion deduplication, meshing and grid smoothing, and then perform texture enhancement to obtain an optimized target face mesh model; make textures Figure, the optimized target face mesh model is textured to obtain the final target face mesh model. The reconstructed face model is of higher quality and closer to the real face effect.

Description

technical field [0001] The present invention relates to the technical field of image processing, and in particular, to a three-dimensional face reconstruction method and system. Background technique [0002] With the rapid development and popularization of depth cameras, the 3D data of objects can be obtained more and more quickly and accurately, which makes depth cameras rapidly applied in the fields of 3D space mapping, 3D reconstruction of objects, intelligent human-computer interaction, and VR. Reconstructing a 3D face model based on the depth data of the face is a hot research direction at present. [0003] However, in the prior art, face templates are established through machine learning, which lacks authenticity. SUMMARY OF THE INVENTION [0004] In order to solve the problems in the prior art, the present invention provides a three-dimensional face reconstruction method and system. [0005] The technical scheme adopted in the present invention is as follows: [...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/20G06T15/04G06T7/33
CPCG06T17/20G06T15/04G06T7/33G06T2207/10024G06T2207/10028G06T2207/30201G06T2207/20081
Inventor 任茂栋温自明周烨陆旺乔根魏小康赵建博张一驰鲁雷雷
Owner 新拓三维技术(深圳)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products