Three-dimensional reconstruction method and device, electronic equipment and storage medium

Abstract

The invention relates to a three-dimensional reconstruction method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a depth image and a segmentation image of each frame of to-be-reconstructed image estimated based on a position prediction network, obtaining the pose information of image collection equipment for collecting the to-be-reconstructed image, according to the pose information and the depth map of each frame of the to-be-reconstructed image, projecting pixel points of the to-be-reconstructed image to a three-dimensional space subjected to space voxel block division to obtain a plurality of voxel blocks of each frame of the to-be-reconstructed image, obtaining a voxel feature value of each voxel block in each frame of the to-be-reconstructed image, then performing surface element extraction, and obtaining a three-dimensional reconstruction image corresponding to each frame of to-be-reconstructed image. In the three-dimensional reconstruction process, the depth map and the segmentation map of each frame of image to be reconstructed are estimated through the position prediction network, so that the method does not depend on a depth sensor, surface element extraction is carried out through space voxel division, and high-quality curved surface modeling can be realized.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular to a three-dimensional reconstruction method, device, electronic equipment and storage medium. Background technique [0002] Three-dimensional reconstruction (3D Reconstruction) refers to the establishment of a mathematical model suitable for computer representation and processing of three-dimensional objects. key technologies. [0003] With the popularization of applications such as manufacturing and augmented virtual reality, games and robotics, the demand for large-scale real-time 3D reconstruction has greatly increased. In these tasks, a user or robot scans the space in real-time, and the accumulated 3D information is integrated into the desired application in real-time and continuously, providing immediate user feedback during the mapping of the physical object into the virtual world. Although there are many existing 3D reconstruction systems, most of the 3D re...

AI Technical Summary

Problems solved by technology

[0004] The present disclosure provides a three-dimensional reconstruction method, device, electronic equipment, and storage medium, so as to at least solve the problem of limited development of three-dimensional reconstruction technology on the mobile terminal in the related art

Images