A speckle-based 3D face reconstruction method and device

Abstract

The invention discloses a speckle-based three-dimensional human face reconstruction method and equipment, which can increase the richness of image features and at the same time reduce the amount of matching calculations, and achieve synchronous improvement in three-dimensional human face reconstruction efficiency and reconstruction accuracy. The method includes: inputting a plurality of speckle image pairs conforming to binocular stereo vision; performing epipolar correction on the input speckle image pairs so that corresponding matching points are on the same horizontal line; Face detection, extracting the image pair of the area of ​​interest of the face to be reconstructed; performing the first matching process on the image pair of the area of ​​interest to obtain the first disparity map; setting the matching point search range according to the disparity in the first disparity map, The region image is subjected to a second matching process to obtain a second disparity map; corresponding 3D point cloud data is generated according to the second disparity map and camera calibration parameters to obtain a reconstructed 3D face.

Description

technical field [0001] The invention relates to the technical field of multi-eye stereo vision, and in particular, to a speckle-based three-dimensional face reconstruction method and device. Background technique [0002] At present, 3D data is widely used in aerospace, 3D printing, geographic mapping, face detection and many other fields. Accurately acquiring spatiotemporal data in real time has always been the core issue of 3D information acquisition and 3D scene reconstruction, and is also a hot research direction in the field of computer geometry. [0003] 3D face modeling stems from Parke's pioneering research, which aims to generate realistic 3D human faces by computer. Obtaining 3D face depth information is the basic premise of reconstructing a high-precision 3D face model, and the collection of 3D face data can be carried out by monocular or multi-eye cameras. [0004] Among them, the main application scenario of multi-eye stereo vision is to restore a two-dimension...

AI Technical Summary

Problems solved by technology

The Chinese patent application with the application number 200910093767.2 discloses another 3D face reconstruction method, which uses the texture component of the face deformation model to fit the face texture, but the accuracy of the speckle image is still not high, and the generated model is different from the real one. There is a certain gap in the face

Existing 3D reconstruction technologies all have the technical problems of large amount of calculation and computational efficiency, slow reconstruction speed and low precision

Images