Three-dimensional reconstruction method, device, equipment, medium and product

By using 2D Gaussian sputtering technology and semantic mask supervision, adjusting 2D Gaussian primitives, and combining them with the TSDF algorithm, the problem of feature point matching difficulties on weak textures and reflective surfaces in traditional 3D reconstruction methods is solved, achieving efficient and accurate 3D mesh reconstruction. The generated model has clear edges and smooth textures.

CN122415947APending Publication Date: 2026-07-17ZHEJIANG GEELY HLDG GRP CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202610773968.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-06-01
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing 3D reconstruction methods face difficulties in feature point matching when dealing with weakly textured regions, reflective surfaces, and fine structures, leading to holes or geometric noise and poor reconstruction results. Furthermore, traditional methods are cumbersome and difficult to optimize through end-to-end error backpropagation.

Method used

A two-dimensional Gaussian sputtering technique is used to degenerate a three-dimensional ellipsoid into a two-dimensional flat disk that fits the surface of the object. The loss value is calculated by semantic masking and cumulative opacity. The two-dimensional Gaussian elements are adjusted until the iteration stopping condition is met. The three-dimensional mesh model is extracted by combining the TSDF algorithm.

Benefits of technology

It improves the 3D reconstruction effect, and the generated mesh model has clean and sharp edges, requiring no subsequent trimming or Laplacian smoothing. The texture is clear and the edges are smooth and continuous, making it suitable for industrial-grade modeling.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122415947A_ABST
    Figure CN122415947A_ABST
Patent Text Reader

Abstract

本申请公开了一种三维重建方法、装置、设备、介质及产品,所述方法包括:获取目标对象的多张视角图像;根据多张视角图像生成稀疏点云;对稀疏点云进行基元转化,得到第一基元集合;从多张视角图像中选择一张视角图像作为目标图像,并按照目标图像对应的视角将第一基元集合中的二维高斯基元投影至二维平面空间,得到投影图像;根据二维高斯基元计算投影图像中每个投影像素的累积不透明度;根据每个投影像素的累积不透明度以及语义掩码,计算得到第一损失值;根据第一损失值,对二维高斯基元进行调整,得到第二基元集合,重复上述过程,直到满足迭代停止条件;根据最后一次迭代得到的第二基元集合进行三维重建,得到目标对象的三维网格模型。
Need to check novelty before this filing date? Find Prior Art