The invention discloses a PC component BIM twinborn collaborative exchange method based on
deep learning, and aims to solve the problems that unstructured multi-
modal data of
a site or a factory is difficult to automatically identify the identity, the state and the quality of a PC component and accurately map the unstructured multi-
modal data with BIM twinborn objects one by one, and increment updating capable of realizing multi-party collaborative exchange is difficult to form. According to the method,
time synchronization and coordinate calibration preprocessing is carried out on image data, video data and
point cloud data, component instance recognition and
feature extraction are carried out by using a
deep learning model, and component state information and component
quality information are generated; analyzing a BIM twinborn model to obtain priori features such as a
unique identifier of a component, a
component type, a
size parameter, a spatial position and component geometry, performing cross-
modal feature fusion under priori guidance, generating a candidate matching relationship, and constructing an optimal transmission
cost matrix containing feature difference and constraint penalty to obtain a soft matching matrix; one-to-one mapping is obtained by adopting matching confidence rejection and assignment solution, an identification result and an evidence data index are written into a twinborn object, component-level difference is carried out on the twinborn object and a previous version to generate evidence increment exchange data, and the technical effects of high-reliability automatic updating and traceable cooperative exchange of the component-level twinborn model are achieved.