Digital twinning method and system based on 3D model matching

Abstract

The invention discloses a digital twinning method and system based on 3D model matching. The method comprises four steps of model and texture training, model matching, texture fusion and scene placement. The model and texture training is an offline preprocessing step, and the model matching, the texture fusion and the scene placement are real-time processing steps. In the model training, a multi-viewpoint silhouette image is used to learn a three-dimensional structure, and polygon mesh three-dimensional reconstruction is realized. In the texture training, a texture flow is obtained through fixed UV mapping, and reasoning from 2D images to 3D textures is achieved. In the model matching, a reconstructed model and a model of a database are used for performing IOU iterative calculation, and the model with an IOU value closest to 1 is obtained as a matched specified model. In the texture fusion, the matched specified model is fused with the 3D texture flow subjected to texture reasoning to form a standard 3D model. In the scene placement, the 3D model is accurately placed in a 3D scene. According to the digital twinning method, the 3D model scene is automatically generated, and the digital twinning efficiency is improved.

Description

technical field [0001] The invention relates to the field of digital twins, in particular to a digital twin method and system based on 3D model matching. Background technique [0002] At present, most methods for automatic generation of 3D models only match simple data such as coordinates or model types with existing models, and do not use the latest deep neural network machine learning methods. For example, patent CN202010701243.3 discloses an automatic generation of tunnel 3D models The method includes: S1, establishing a graphic database, storing objects including two-dimensional design drawings and entity objects of three-dimensional models; S2, creating an external database for storing multiple design parameters input by users; S3, based on user input parameters to generate 2D design drawings and 3D models of tunnels. Patent CN202011386970.1 discloses a method for automatically generating a 3D model of a road intersection, including: obtaining the basic parameters of t...

AI Technical Summary

Problems solved by technology

[0004] Patent CN 201310343131.5 discloses a realization method of automatic generation and online interaction of a three-dimensional digital model of a plane space structure. It is relatively rare to use the method of server and client, but the model generation is relatively rough, and only a simple background model such as a wall is generated. Body, windows, a

Images