Three-dimensional face reconstruction method, device and storage medium thereof

A three-dimensional face and target face technology, applied in the field of devices and their storage media, and three-dimensional face reconstruction methods, can solve the problems of local depth data distortion, affecting the accuracy of the three-dimensional face model, and not having real-time feedback logic, etc.

Active Publication Date: 2019-02-22
BEIJING KUANGSHI TECH
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, when the existing 3D face modeling method performs point cloud matching on the depth data and the face plane image, local depth data distortions often occur due to calculation errors, data collection errors, etc., and the local depth data distortions will be extremely The Earth Affects the Accuracy of 3D Models of Faces
However, the existing technology requires a single scan of the depth data of the complete face at different angles before performing point cloud registration. It does not have real-time feedback logic and is prone to local depth data distortions, so it is difficult to effectively control the quality of depth data collection.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional face reconstruction method, device and storage medium thereof
  • Three-dimensional face reconstruction method, device and storage medium thereof
  • Three-dimensional face reconstruction method, device and storage medium thereof

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0037] The applicant found that 3D face reconstruction is to reconstruct a 3D model of the face from one or more photos. The traditional solution to the 3D reconstruction problem is model fitting, that is, by identifying multiple faces. The key points in the 2D plane picture of the face, based on these key points for model matching, the three-dimensional coordinate shape feature points on the 3D model are adjusted to match the corresponding feature points on all 2D plane pictures, and the 3D reconstructed face model is obtained. Among them, the three-dimensional coordinate shape can also be obtained according to the depth data of the face collected by the depth camera, thereby improving the accuracy of 3D reconstruction of the face. However, due to the acquisition of depth data or the matching of depth data and plane 2D images, there are often local depth data distortions in face data matched by point clouds, and because 3D reconstruction of faces requires a single scan to comp...

no. 2 example

[0085] In order to cooperate with the 3D face reconstruction method provided in the first embodiment of the present invention, the second embodiment of the present invention further provides a 3D face reconstruction apparatus 100 .

[0086] Please refer to Figure 7 , Figure 7 It is a block diagram of a three-dimensional face reconstruction device provided by the second embodiment of the present invention.

[0087] The 3D face reconstruction device 100 includes a depth data acquisition module 110 , a distortion point judgment module 120 , a supplementary acquisition module 130 and a model acquisition module 140 .

[0088] The depth data acquisition module 110 is configured to acquire depth data of the target face under multiple viewing angles.

[0089] The distortion judging module 120 is configured to judge whether there are local depth data distortions in the depth data under each viewing angle.

[0090] The supplementary acquisition module 130 is configured to re-acquir...

no. 3 example

[0095] Please refer to Figure 8 , Figure 8 The third embodiment of the present invention provides a structural block diagram of an electronic device applicable to the embodiments of the present application. The electronic device 200 provided in this embodiment may include a three-dimensional face reconstruction apparatus 100 , an adjustable camera device 201 and a processor 202 . Optionally, the electronic device 200 may further include a memory 203 , a storage controller 204 and a display 205 .

[0096] Wherein, the adjustable camera device 201 includes a camera component and a processor, and the camera component includes a depth camera and a plane camera, and the depth camera and the plane camera can be rotated and translated based on the control signal of the processor of the adjustable camera device 201 . It should be understood that the processor of the adjustable camera device 201 may also be the same processor as the processor 202 .

[0097] The components of the a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a three-dimensional face reconstruction method, a device and a storage medium thereof, which relate to the technical field of image processing. The three-dimensional face reconstruction method comprises the following steps: acquiring depth data of a target face under a plurality of viewing angles; judging whether the depth data under each view has a local depth data anomalyor not; if yes, re-acquiring the depth data under the perspective corresponding to the local depth data deformity point to update the depth data under the plurality of perspectives; obtaining a three-dimensional model of the target face according to the depth data in the plurality of views. This method collects depth data by depth camera when there are local depth data distortion points, which improves the error correction ability of face modeling and obtains more accurate three-dimensional face model.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a three-dimensional face reconstruction method, device and storage medium thereof. Background technique [0002] With the rapid development of computer equipment, network and image processing technology, the traditional naked eye image recognition method has been gradually replaced by the computer-automatic image recognition method, which greatly improves the efficiency and accuracy of image recognition. Based on the depth data of the face, automatic 3D face modeling by computer is a common task in the field of computer vision, and there are many applications. [0003] However, when the existing 3D face modeling method performs point cloud matching on the depth data and the face plane image, local depth data distortions often occur due to calculation errors, data collection errors, etc., and the local depth data distortions will be extremely The ground affects t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/593G06T7/33
CPCG06T7/33G06T7/593G06T17/00G06T2207/30201G06T2207/10028G06T2207/10016G06T2200/08
Inventor 廖声洋
Owner BEIJING KUANGSHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products