The invention discloses a three-dimensional
reconstruction method fusing multi-dimensional
physical space information, and belongs to the technical field of three-dimensional reconstruction in
computer vision. According to the method, through
cooperative work of six modules including a multi-view data preprocessing module, a semantic
mask denoising module, a multi-
modal feature extraction and coding module, a
physical space matching module, a
finite element stress analysis module and a
visual interaction module, the process from multi-view data preprocessing to multi-dimensional
physical space information reconstruction and
visualization in three-
dimensional modeling is achieved. The method comprises the following steps: firstly, generating an
initial point cloud by using a multi-angle image, and extracting semantic masks of a main body and an accessory component through semantic segmentation and
mask denoising; then, features such as materials and pH values extracted by a visual
language model (VLM) and stress information obtained through finite
element analysis are fused, a 32-dimensional
feature vector with multi-dimensional physical space information is constructed and embedded into a
Gaussian point set, and finally a three-dimensional reconstruction model with the multi-dimensional physical space information is achieved. According to the method, unified coding and visual display of multi-dimensional physical space attributes are realized in the 3D-GS model for the first time, and the method has high efficiency, expandability and good
visual interaction capability and is suitable for the fields of digital twinning, smart industry and the like.