Three-dimensional model reconstruction method, device and equipment

Abstract

The invention provides a three-dimensional model reconstruction method, device and equipment, and relates to the technical field of VR / AR, and the method comprises the steps: obtaining a collected two-dimensional image, inputting the two-dimensional image into a feature extraction module, inputting a sample image into a feature extraction layer, carrying out the feature extraction of the sample image, and obtaining a feature extraction result; performing three-dimensional model reconstruction by using a reconstruction layer according to the extracted image feature parameters, outputting the three-dimensional model, adjusting parameters of the feature extraction layer and the reconstruction layer by taking output of a sample three-dimensional model as a target, and taking the feature extraction layer as a feature extraction module when adjustment is finished; extracting image feature parameters of the two-dimensional image by using the feature extraction module, wherein the image feature parameters comprise a shape parameter, an expression parameter and a posture parameter; and transmitting the image feature parameters to a cloud. According to the invention, the data volume can be greatly reduced, the problem of massive calculation at the acquisition end and the problem of large data pressure at the transmission end are effectively solved, and better rendering quality is ensured.

Description

technical field [0001] The present invention relates to the field of AR / VR technology, in particular to a three-dimensional model reconstruction method, device and equipment. Background technique [0002] The remote three-dimensional communication interactive system can generally be divided into three ends: the acquisition end, the cloud, and the display end. The acquisition end is responsible for collecting data remotely, the cloud is responsible for reconstructing the 3D model data, and the display end obtains data from the cloud for rendering. [0003] At present, the demand for high-precision models is more and more extensive. High-precision 3D reconstruction of human body models mainly includes the following types: [0004] The 3D reconstruction of data collected by an optical scanner requires the subject to remain still for several seconds or even minutes during the entire scanning process. By splicing high-precision 3D scanning information from multiple angles, a hig...

AI Technical Summary

Problems solved by technology

[0006] The above-mentioned high-precision 3D human body model reconstruction method is to transmit the 3D data of the reconstructed high-precision human body model to the display terminal after the 3D reconstruction is completed in the cloud. The refinement of real-time 3D reconstruction will cause an increase in the amount of 3D geometric data. This will cause cloud transmission pressure and cause visual delay on the rendering application side

Images