Three-dimensional reconstruction method, device and system

Abstract

The invention relates to the technical field of remote three-dimensional communication, and provides a three-dimensional reconstruction method, device and system. The data volume and rendering time delay of three-dimensional model reconstruction are balanced by utilizing human eye visual characteristics and the characteristic that human eyes do not need high-resolution views in an out-of-focus state, position information of a human eye fixation point is obtained through an eyeball tracking device, when the fixation point does not move, a human eye visual state is detected by a rendering display terminal according to acquired human eye visual parameters, when the defocus state is detected, the rendering parameters used for determining the three-dimensional reconstruction parameters are adaptively adjusted in real time, the adjusted rendering parameters are transmitted to the acquisition terminal through the control instruction, the acquisition terminal reduces the data volume required by three-dimensional model reconstruction in real time according to the determined three-dimensional reconstruction parameters, thus the cloud transmission pressure is reduced, the rendering delay is reduced, and the rendering efficiency is improved.

Description

Technical field [0001] The present application relates to a three-dimensional distance communication technology, and particularly relates to a three-dimensional reconstruction method, apparatus and system. Background technique [0002] Remote communication dimensional interactive system for three-dimensional reconstruction of a human body model, you first need to collect data obtained from the various sensors reconstructed model and three-dimensional reconstruction method for processing the collected data, thereby reconstructing a three-dimensional model of the human body. Wherein the reconstruction of three-dimensional model is directed to the human body shape, posture and material data. [0003] Immersive virtual reality rendering (Virtual Reality, VR) and Augmented Reality (Augmented Reality, AR) and other terminals often require highly accurate three-dimensional model. Currently, high accuracy static three-dimensional reconstruction method still using an optical scanner (e.g....

AI Technical Summary

Problems solved by technology

While a single RGBD camera can only acquire the color information (RGB image) or depth information (RGBD image) of a certain viewing angle of the current scene, the multi-viewpoint (camera) acquisition system can collect two-dimensional color information or depth information of each viewing angle of the object. In addition, a multi-view stereo matching (Multi-View Stereo, MVS) algorithm or depth information fusion method is used to dynamically reconstruct a high-precision 3D model, but at the same time, multi-view construction is relatively complicated, requiring multi-camera calibration and data fusion, which is difficult to achieve higher

Images