Stereo vision three-dimensional human face modelling approach based on dummy image

A virtual image and three-dimensional face technology, applied in the field of image processing and computer vision, can solve the problems of increasing the complexity of modeling work, high computational complexity, a large number of three-dimensional face data, etc., to overcome the orthogonality of the input image. Requirements, matching and calculating the effect of accurate and reliable disparity information

Inactive Publication Date: 2008-01-09
UNIV OF SCI & TECH OF CHINA
View PDF2 Cites 58 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Chinese Patent Application No. 200610088857.9 proposed "Fast Face Modeling Method and System Based on Single Photo" and 200610024720.7 proposed "A Method for Realizing Fast Face Model Reconstruction from a Frontal Image" to simplify this method, only Use the frontal image for 3D face modeling, but because it does not obtain the real depth information of the specific face, the generated 3D model of the specific face is not very accurate
However, there are many redundant information in the video sequence, and the computational complexity is high.
The Morphable Model proposed in "IEEE Transaction on Pattern Analysis and Machine Intelligence", Volume 25, Issue 9, Page 1063-1074 in 200

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stereo vision three-dimensional human face modelling approach based on dummy image
  • Stereo vision three-dimensional human face modelling approach based on dummy image
  • Stereo vision three-dimensional human face modelling approach based on dummy image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030]FIG. 1 shows the specific flow of the stereoscopic three-dimensional face modeling method based on virtual image correspondence in the present invention. First, calibrate a1 and a2 respectively for the left and right cameras used, then take the left and right images of the tested face, and use the camera calibration results to correct the images b1 and b2 respectively, and then carry out the correspondence between the left and right images of the stereogram pair Relational Computing c. The specific steps for calculating c of the corresponding relationship are as follows: firstly, using a reference three-dimensional face model, estimate the pose, size and position of the tested face in the input left and right images, so as to generate a face similar to the pose of the tested face in the input stereo image pair Refer to the virtual image pair c1 of the face; then, calculate the correspondence c2 between the input stereogram pair and the virtual image pair; finally, use th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

It uses a 3D model of reference human face (HF) to estimate the HF gesture parameters in the input stereo image (ISI) pair to generate the virtual image (VI) pair of reference HF (RHF) under the same gesture. Due to the corresponding between VIs is known, the corresponding is extended from VI to ISI via calculating the correspondence between the input HF and RHF under the same gesture. This greatly improves the matching effect of HF stereo image pair and ensures the HF point-cloud (PC) data more accurate obtained from calculating stereovision difference. This method converts 3D PD optimizing problem into a 1D curve optimizing one to greatly raise processing speed. It finally builds HF 3D surface from the optimized PC, then texture-mapping it to gain a HF 3D model (H3M) with a high true sense. This invention can meet various requirements against H3M under various practical application situations. It is practical, fast, accurate and has a extensive application foreground.

Description

Technical field: [0001] The invention belongs to the technical field of image processing and computer vision, and in particular relates to a method for establishing a three-dimensional model of a human face by applying stereo vision. Background technique: [0002] Currently, image-based 3D face modeling methods have been extensively and deeply researched. "Computer Application" magazine, 2000, Vol. 20, No. 7, pages 41-45 and 255-257, proposed a method for generating a three-dimensional model of a human face using two orthogonal face images of the front and side. The disadvantage of this method is that the input The orthogonality of the image has strict requirements. Chinese Patent Application No. 200610088857.9 proposed "Fast Face Modeling Method and System Based on Single Photo" and 200610024720.7 proposed "A Method for Realizing Fast Face Model Reconstruction from a Frontal Image" to simplify this method, only The frontal image is used for 3D face modeling, but because t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T15/00
Inventor 汪增福郑颖
Owner UNIV OF SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products