Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional human face reconstruction method based on stereoscopic vision

A 3D face and stereo vision technology, applied in the field of obtaining 3D point clouds of faces, can solve the problems of unfavorable real-time acquisition and calculation, unsatisfactory reconstruction results of 3D face reconstruction algorithms, and large amount of calculations

Inactive Publication Date: 2010-01-13
海安江理工技术转移中心有限公司 +1
View PDF0 Cites 49 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The accuracy of global optimal algorithm matching is high, but the algorithm is complex and the amount of calculation is large, which is not conducive to the realization of real-time acquisition and calculation
[0004] The existing 3D face reconstruction algorithms based on binocular stereo vision have obvious shortcomings: they either use a purely local optimal algorithm or a purely global optimal algorithm, so the algorithm cannot guarantee both the accuracy of the reconstruction and the accuracy of the reconstruction. Speed; and the prior model knowledge of the face is relatively rich. The face is mainly composed of major organs such as eyes, nose, and mouth. The common feature of them is that the contour line is relatively obvious.
However, the existing algorithms do not make full use of this rich prior knowledge, or even use it, but too many human intervention factors are added to the algorithm, and human assistance is needed to extract some feature points or feature lines, which reduces the The degree of automation of the reconstruction algorithm is not conducive to building a complete reconstruction system
[0005] Due to the above shortcomings, the existing 3D face reconstruction algorithms cannot obtain satisfactory reconstruction results in practical applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional human face reconstruction method based on stereoscopic vision
  • Three-dimensional human face reconstruction method based on stereoscopic vision
  • Three-dimensional human face reconstruction method based on stereoscopic vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] Referring to the accompanying drawings, specific embodiments of the present invention will be described in more detail below. The programming implementation tool uses VC++6.0, and two face images taken in the indoor environment are used as images to be reconstructed.

[0071] figure 1 It is a complete flow chart of the present invention.

[0072] figure 2 It is a system model and a schematic diagram of the principle of the present invention. Use two CCDs to take a face image from two different angles at the same time, O L , O R are the optical centers of the two cameras, I L , I R are the imaging planes of the two cameras, P is a spatial object point on the face to be reconstructed, P L , P R are the image points formed by the object point P on the imaging planes of the two cameras. The image points formed by the same spatial object point on different camera imaging planes are a pair of matching points. One of them is randomly selected as the reference image,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a three-dimensional human face reconstruction method based on stereoscopic vision of two eyes. Steps for implementing the method are as follows: (1) using two cameras to respectively take a picture of a human face from two different angles; (2) respectively determining an internal parameter matrix and an external parameter matrix of each camera; (3) carrying out extreme line correction and picture conversion according to the determined data; (4) utilizing a Harris corner detection operator to extract characteristics of the human face, and carrying out initial matching by utilizing a local template window method and extreme line restriction; (5) starting from an initial matching assemblage, and obtaining a sparse matching assemblage by utilizing a seed point growing algorithm; (6) taking the sparse matching assemblage as a guiding point and carrying out a dynamic planning algorithm so as to finish dense matching; and (7) calculating three-dimensional coordinates of actual physical points on the human face according to the determined data and the matching relationship, thereby reconstructing a three-dimensional point cloud of the human face.

Description

Technical field: [0001] The invention belongs to the technical field of binocular stereo vision, relates to the problem of three-dimensional face reconstruction based on stereo vision, and in particular relates to a method for obtaining a three-dimensional face cloud using a seed point growth algorithm and a dynamic programming algorithm based on guide point constraints . Background technique: [0002] Binocular stereo vision technology is a passive three-dimensional measurement technology, which includes camera calibration, image pair matching, three-dimensional information restoration and other main processes. The 3D face reconstruction technology based on binocular stereo vision takes two face images with two calibrated CCDs placed at different angles, and then establishes the correspondence between the pixels of the two images to restore the 3D face coordinate information. Stereo vision technology can obtain dense 3D point cloud coordinates of the face without projecti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/00
Inventor 达飞鹏隋宜桓
Owner 海安江理工技术转移中心有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products