Method and device for reconstructing three-dimensional face based on single face image

A face image, three-dimensional face technology, applied in the field of three-dimensional face reconstruction, can solve the problems of affecting the accuracy of three-dimensional modeling, not considering the acquisition of faces, and long time, so as to reduce the cost of three-dimensional modeling and shorten the three-dimensional modeling. time, the effect of improving accuracy

Inactive Publication Date: 2011-05-11
XIAMEN MEIYA PICO INFORMATION
View PDF1 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method uses 200 scanned 3D face models, through linear combination, combined with 22 parameters such as rotation angle and illumination, and iterative optimization algorithm to obtain the target model, which takes too long
[0005] Moreover, these metho

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for reconstructing three-dimensional face based on single face image
  • Method and device for reconstructing three-dimensional face based on single face image
  • Method and device for reconstructing three-dimensional face based on single face image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] see figure 1 As shown, a method for realizing three-dimensional face reconstruction based on a single face image of the present invention includes:

[0052] Steps for inputting a single face image; such as figure 1 shown in box 101;

[0053] The steps of performing attitude estimation processing; this step is to use the coordinates of the two inner corners of the eyes and the two nose points in the face attitude as four feature points to achieve attitude angle estimation; use double vanishing points to estimate the face in X, Y, The angle of rotation on the Z axis; e.g. figure 1 shown in box 102 in;

[0054] The step of performing feature point depth estimation processing; this step is to train its neural network based on the distance and texture information of a large number of existing face feature points, and then use this neural network to estimate the feature point depth value present in the face image, and combine the known two-dimensional coordinates with the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for reconstructing a three-dimensional face based on a single face image. The method comprises the following steps of: performing posture recognition on a face image by utilizing face structure priori knowledge, and estimating rotating direction and angle of a face plane by combining face measurement and projective geometry so as to set a rotating angle of the three-dimensional face; estimating the depth of two-dimensional characteristic points on the face image by adopting an artificial neural network, and acquiring three-dimensional coordinates of the characteristic points; converting a common three-dimensional face model into a specific model by adopting a Dirichlet free deformation algorithm; and mapping the three-dimensional face model by adopting characteristic points extracted from the two-dimensional image. Therefore, the true three-dimensional model is constructed through the single face image, the three-dimensional modeling accuracy is effectively improved, the three-dimensional modeling time is shortened and the three-dimensional modeling cost is reduced.

Description

technical field [0001] The present invention relates to the technical fields of digital image processing, machine vision and artificial intelligence, in particular to a method and device for realizing three-dimensional face reconstruction based on a single face image. Background technique [0002] The current image-based face modeling methods are mainly divided into two types: one is a reconstruction method based on the shape of multiple pictures or orthogonal pictures, and the other is a three-dimensional face modeling method based on a single image. [0003] The traditional shape reconstruction method based on multiple photos generally uses hardware (such as special equipment such as 3D scanner) to obtain the 3D information of the face. Although the theoretical basis is relatively mature, its realization cost and implementation method are relatively difficult; Orthogonal image reconstruction method, since the frontal image is orthogonal to the side image, the three-dimensi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06N3/08
Inventor 林志扬刘祥南吴鸿伟赵庸
Owner XIAMEN MEIYA PICO INFORMATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap