Method for carrying out face three-dimensional reconstruction at any viewing angle on basis of self-adaptive deformable model

A deformation model and 3D reconstruction technology, which is applied in the field of 3D reconstruction of faces from any viewing angle, can solve the problem that the viewing angle changes greatly, the 3D face reconstruction method is difficult to meet the demand, and it is difficult to meet the 3D face reconstruction from any view angle, etc. question

Active Publication Date: 2014-09-10
TSINGHUA UNIV
View PDF5 Cites 67 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the environment of video surveillance, face images are acquired without the target being conscious, and there may be situations where the viewing angle changes greatly. Therefore, it is difficult for existing research to meet the requirements of 3D face recon

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for carrying out face three-dimensional reconstruction at any viewing angle on basis of self-adaptive deformable model
  • Method for carrying out face three-dimensional reconstruction at any viewing angle on basis of self-adaptive deformable model
  • Method for carrying out face three-dimensional reconstruction at any viewing angle on basis of self-adaptive deformable model

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0096] Example: Using the AXIS1011W web camera to capture the three-dimensional reconstruction results of the face images of 6 people, input the face images from different perspectives, and the face can be reconstructed by the present invention based on the adaptive deformation model of the arbitrary perspective face three-dimensional reconstruction method The three-dimensional model is projected to the image with a viewing angle of 0°, ±45°, and ±60°.

[0097] In order to quantitatively analyze the effect of reconstruction, you can directly compare the average point-to-point error between the feature points in the front projection image of the reconstructed face 3D model and the feature points of the real face front image captured by the CCD sensor, and the average nearest point line distance .

[0098] The average point-to-point error is defined as:

[0099] D pt · pt = 1 N X i = 1 N ( x i - x gt , i ) 2 + ( ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for carrying out face three-dimensional reconstruction at any viewing angle on the basis of a self-adaptive deformable model. The method includes the steps of (1) obtaining face image data and screening a face image with high definition as original data, (2) positioning feature points, (3) coarsely estimating the angle of a face according to the positioning result of the feature points, (4) building a face three-dimensional deformable model, adjusting the feature points of the face to be at the same dimension as the face three-dimensional deformable model through translation and scaling and extracting coordinate information of the points corresponding to the feature points of the face to form a sparse face three-dimensional deformable model, (5) iterating face three-dimensional reconstruction by means of the particle swarm optimization algorithm according to the coarsely estimation value of the angle of the face and the sparse face three-dimensional deformable model to obtain a face three-dimensional geometric model, (6)mapping input face texture information in a two-dimensional image to the face three-dimensional geometric model in a texture pasting method after the face three-dimensional geometric model is obtained, so that a complete face three-dimensional model is obtained. The method can be widely used in the field of identity identification.

Description

technical field [0001] The invention relates to computer vision and computer graphics, in particular to a method for three-dimensional reconstruction of a human face at any viewing angle based on an adaptive deformation model. Background technique [0002] The large-scale coverage video surveillance system widely used in public security, intelligent security and other fields has put forward new requirements for pedestrian identification technology based on surveillance images. In recent years, in many vicious criminal cases in public areas, the face images of criminal suspects are obtained through video surveillance systems. , Reducing economic losses and reducing social adverse effects are of great significance. [0003] The current common multi-view face recognition technology can be divided into knowledge-based methods and statistical learning-based methods. The knowledge-based method uses local features of the face, such as eyes, nose, eyebrows, lips, and chin, etc., a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00
Inventor 王雪林奎成
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap