Method and system for three-dimensional face reconstruction based on binocular stereo and photometric stereo

A photometric three-dimensional, three-dimensional reconstruction technology, applied in the field of computer vision, can solve the problems of inaccurate results, three-dimensional model deformation, and low robustness, and achieve the effect of accurate and deformation-free three-dimensional reconstruction of human faces

Inactive Publication Date: 2019-01-04
CHENGDU TOPPLUSVISION TECH CO LTD
View PDF13 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of algorithm is greatly affected by image quality, so the robustness is not very high, and the results are not very accurate
At present, photometric stereo vision can be used for 3D reconstruct

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for three-dimensional face reconstruction based on binocular stereo and photometric stereo
  • Method and system for three-dimensional face reconstruction based on binocular stereo and photometric stereo
  • Method and system for three-dimensional face reconstruction based on binocular stereo and photometric stereo

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] In order to enable those skilled in the art to better understand the technical solutions of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0056] like figure 1 As shown, the embodiment of the present invention provides a method for three-dimensional face reconstruction based on binocular stereo and photometric stereo. means, the method comprising:

[0057] S01: Obtain a first image of the target face through the first camera device, and obtain a second image of the target face through the second camera device;

[0058] S02: Perform binocular stereo matching on the first image and the second image to obtain an initial depth image of the target face;

[0059] S03: Turn on the first light source, acquire the third image of the target face through the first camera device, and acquire the fourth image of the target face through the second camera device;

[006...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of computer vision. The embodiment specifically discloses a method and a system for three-dimensional reconstruction of a human face based on binocular stereo and photometric stereo. The initial depth image of a target human face is obtained by binocular stereo matching. Four images of the target face collected by two light sources and two camera devices are represented by photometric stereo as constraint terms and combined with the initial depth image to construct the energy function of the depth image to be solved. The optimized depth image is obtained by minimizing the energy function, and the optimized depth image is transformed into a three-dimensional point cloud to obtain the three-dimensional point cloud of the target face. It solves theproblem that the existing photometric stereo vision needs at least three light sources for 3D reconstruction, and the scale-free feature has deformation, and realizes the accurate 3D reconstruction of human face without deformation.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a method and system for three-dimensional face reconstruction based on binocular stereo and photometric stereo. Background technique [0002] At present, the 3D reconstruction methods of human face mainly include four kinds: parametric model, physical muscle model, multi-image visual model and 3D deformation. The face parameter model and physical muscle model are complex, computationally intensive, and lack realism; multi-image visual modeling uses multiple face images or video sequences to restore the 3D information of the face through a certain visual algorithm. Here Including monocular vision, binocular vision and multi-eye vision. Monocular vision generally obtains feature points through a single face photo, and then performs global and local fine deformation on a general-purpose 3D face mesh model; binocular vision generally uses two face images from different persp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/33G06T7/55G06T17/20
CPCG06T17/20G06T2207/10028G06T2207/30201G06T7/33G06T7/55
Inventor 晁志超龙学军
Owner CHENGDU TOPPLUSVISION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap