This application provides a method, apparatus, device, and storage medium for reconstructing a 3D
Gaussian scene based on the geometric constraints of a mesh tangent plane, relating to the field of
computer vision technology. The method includes: acquiring an
image sequence of a target scene and reconstructing the initial geometric topology of the target scene; constructing a local tangent plane coordinate
system attached to a triangular mesh, and parameterizing the center of the 3D
Gaussian primitives as coordinates in the local tangent plane coordinate
system; rendering and iteratively optimizing the parameterized 3D
Gaussian primitives to update their attributes; during the iterative optimization process, adaptively controlling the density of the 3D Gaussian primitives attached to the mesh surface based on the geometric curvature information of the triangular mesh; and generating a 3D scene model with a triangular mesh as the geometric skeleton and optimized 3D Gaussian primitives as the appearance representation. This application achieves high-fidelity reconstruction of both
visual appearance and
physical geometry, and improves the resolution capability of complex textures while maintaining real-time rendering speed.