Processor for constructing three-dimensional model and three-dimensional model connection early warning system

Abstract

The invention relates to a processor for constructing a three-dimensional model and a three-dimensional model connection early warning system. The processor is configured to: identify coordinate information of a specific component of a physical object having pointing information in a two-dimensional drawing; physical relevance of the three-dimensional models is determined according to the pointing information and the coordinate information; according to the physical relevance of the three-dimensional models, analyzing mutually paired specific parts with physical relevance of the plurality of three-dimensional models; and establishing data intercommunication according to the physical relationship between the entities corresponding to the three-dimensional model, so that the physical relevance of the three-dimensional model is consistent with the relevance of the entity equipment. According to the three-dimensional model generated automatically, the attribute data of the three-dimensional model are consistent with the attribute data of the entity of the three-dimensional model, and the association relationship is also consistent with the physical association of the entity, so that a worker does not need to adjust the attribute data and the association relationship of the three-dimensional model in the later period, and only needs to check the data to be confirmed.

Description

[0001] The original basis of this divisional application is a patent application with application number (202311702676.0), application date December 12, 2023, and invention name “A digital twin method, system and storage medium for an engineering object”. Technical Field

[0002] The present invention relates to the technical field of digital twin data processing and construction, and in particular to a processor for building a three-dimensional model and a three-dimensional model connection early warning system. Background Art

[0003] In the process of establishing a three-dimensional model of a digital twin factory, it is necessary to construct a large amount of equipment data in two-dimensional drawings into three-dimensional equipment data, and the equipment in the three-dimensional model is required to be consistent with the equipment in the real three-dimensional space. However, the existing three-dimensional model generation software has the following defects: the connection relationship between the three-dimensional models of equipment and pipelines appears to be correct, but during the connection process of the physical equipment, it will cause deviations in the physical connection of the physical equipment. For example, the physical equipment needs to be sealed in the physical connection to avoid leakage of the fluid medium. After the sealed connection, the physical height of the pipeline is inconsistent with that in the three-dimensional model; or the angle of the physical connection of the physical equipment deviates from that of the three-dimensional model. This phenomenon is caused by the failure of the three-dimensional model to achieve data interoperability in the real space.

[0004] For example, the patent application document with publication number CN113919022A discloses a processing method for generating three-dimensional pipeline data based on the Yizhirui platform, including the following steps: S1. Check the original data of pipeline surveying and mapping, delete the empty data therein, and ensure the correctness of the data coordinate system; S2. Generate two-dimensional pipeline data and two-dimensional pipe fitting data with z values ​​according to the attribute table of the original data of pipeline surveying and mapping; S3. Generate three-dimensional pipelines and three-dimensional pipe fittings according to the two-dimensional pipeline data and two-dimensional pipe fitting data with z values. This technical solution can only generate three-dimensional pipelines and pipe fittings based on the two-dimensional data obtained from surveying and mapping, but it is limited to reproducing related entity objects in three-dimensional graphics modeling software, and does not involve the reproduction of attribute data of three-dimensional models. The attribute data of three-dimensional models include connectivity, pressure, material, and the medium contained therein. This technical solution is suitable for the rapid generation of isolated three-dimensional components, but has no practical application value for the digital twin of the factory. Because there are already a lot of existing technologies for the rapid generation of isolated three-dimensional models, for example, PDMS can quickly generate three-dimensional models with attribute data based on DB files. These three-dimensional models can also be generated in a certain three-dimensional space in a way with accurate coordinates.

[0005] Rapidly generating 3D models does not mean that factory digital twins can be automated, because a large number of 3D models need to be digitally connected to each other to achieve a true physical twin, that is, to reproduce the physical connection relationship between pipelines, the pressure data association between valves and flanges, and the control relationship between control units and controlled objects. For example, when PDMS is used to generate two 3D models whose entities are associated with each other, although the two 3D models have interfaces that are consistent with each other in coordinates, they do not achieve data intercommunication in the 3D space. For example, the inlet coordinates of the storage tank as the first 3D model are E389650N 320100U 854490, and the outlet coordinates of the pipeline as the second 3D model connected to the first 3D model are E 391210N 320100U 855244.5, but the unprocessed first 3D model and the second 3D model are still separate independent objects in the 3D space, and their physical properties still need to be set manually. For example, in PDMS, you need to manually set the physical correlation between the two three-dimensional models, such as the connection relationship and directionality of the medium flow and data flow. Here, for example, it is the starting and ending points of the pipeline of the second three-dimensional model; by selecting the starting point of the medium flow of the storage tank (i.e., the outlet) and the starting point of the pipeline (i.e., the inlet), and specifying them as the medium starting points respectively, the data of the two three-dimensional models can be interconnected, and then the digital twin of the physical correlation of the related three-dimensional models can be realized. For the digital twin work of the factory, the above work means a huge investment of manual work, which is not efficient and has a high error rate, and requires the addition of complex post-review work.

[0006] Based on the above-mentioned problems in the process of building a digital twin factory, the present invention hopes to provide a digital twin method for engineering objects, so that the generated three-dimensional model is a three-dimensional model that can have physical properties and digital connectivity and can be applied, thereby reducing the workload of staff in setting the physical property data of the three-dimensional model and also reducing the workload of subsequent model review work.

[0007] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the applicant studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the invention

[0008] In order to quickly complete the digital twin of the engineering object from a large number of two-dimensional drawings, a new digital twin method is needed, which can at least semi-automatically generate engineering objects in a three-dimensional scene to improve the efficiency of the digital twin and reduce the error rate. Preferably, the digital twin method can pre-audit the physical association between the three-dimensional models generated based on the two-dimensional drawings according to preset rules. Preferably, the pre-audit is implemented in the form of a form for manual secondary review. In the digital twin process in the prior art, the main focus is on the association mapping relationship between physical objects and virtual objects to build a high-fidelity model consistent with the physical world in the virtual space. For example, the patent document with the publication number CN115601514A discloses a method for automatic association mapping of digital twin data, including obtaining the building information of each physical building, standardizing the building information based on the Beidou grid location code and storing it in the building information record table; constructing a virtual space, and generating the virtual space position code of each virtual building model based on the Beidou grid location code; generating a building model information data table based on each virtual space position code and the model ID of the virtual building model; automatically fusing and mapping the building information record table and the building model information data table based on the Beidou grid location code to generate a spatial association index table; optimizing the spatial association index table; and interacting between the physical space and the virtual space based on the spatial association index table. This technical solution mainly uses a unified Beidou grid location code to build a connection bridge between the building information of each physical building and each virtual building model, and then automatically fusing and mapping the spatial distance of the virtual space position code of the physical building and the virtual building model, so as to associate and bind to obtain an associated data record, and then generate a spatial association index table, so that the physical entity can directly establish an association relationship with the virtual model. However, the relationship between the physical buildings and the relationship between the virtual building models in this technical solution can only be reflected through spatial position coding similar to coordinate information. The relationship between the physical objects cannot be synchronously established and reflected in the virtual model. This technical solution cannot solve the digital twin problem of engineering objects with a large number of process connection relationships in a factory environment.

[0009] In view of the deficiencies of the prior art, the present invention provides a digital twin method for an engineering object from a first aspect, the method comprising: identifying two-dimensional drawings of physical objects involving entity association relationships and generating three-dimensional model information corresponding to the physical objects, and generating a three-dimensional model reconstruction data file corresponding to the two-dimensional drawings based on the three-dimensional model information. Based on the three-dimensional model reconstruction data file, the three-dimensional model information of physical objects that are physically related to each other is imported into the three-dimensional modeling software, thereby automatically generating a three-dimensional model corresponding to the three-dimensional model information. Compared with the prior art method of generating a single three-dimensional model based on a single two-dimensional drawing, the present invention can batch process a large number of two-dimensional drawings to form a preliminary three-dimensional presentation of engineering objects.

[0010] In the prior art, there have been technical solutions for digital twinning of many process procedures involved in the process of process manufacturing industry production. For example, the patent document with publication number CN115495880A discloses a method for constructing a digital twin model of a process manufacturing workshop. First, the geometric and physical properties of each element of the process manufacturing physical workshop are modeled by industrial modeling software to construct a static physical model SPM, and then a dynamic data relationship model DDRM is constructed based on the association relationship between the dynamic data of the process manufacturing physical workshop. Subsequently, a data communication interface is established to fuse the SPM and the DDRM models to complete the construction of the digital twin model. This technical solution transforms the coupling relationship between the processes in the process manufacturing production process into the coupling relationship between the parameters of each twin model, thereby clarifying the association relationship between each twin model. However, in this technical solution, the geometric and physical properties of each element of the process manufacturing physical workshop are still modeled by industrial modeling software to construct a static physical model of each element of the physical workshop. The static physical model construction process cannot directly reflect the physical association between each other, and it is even more impossible to construct the pointing information connection relationship between different entity mapping objects in the above manner. This technical solution essentially separates static physical relationship modeling from dynamic data relationship modeling, making it impossible to synchronously construct corresponding dynamic pointing information between static physical objects, significantly reducing the efficiency of digital twins of engineering objects.

[0011] Compared with the above-mentioned prior art, the present invention can generate corresponding three-dimensional models for reflecting physical objects that are interrelated in entities based on two-dimensional drawing information involving entity association relationships. Based on the above-mentioned distinguishing technical features, the problems to be solved by the present invention may include: how to quickly realize the three-dimensional presentation of engineering objects with directional information. Specifically, as in the above-mentioned prior art, the three-dimensional model building process of the digital twin factory usually separates the generation of physical entity models from the connection between different virtual models. Various independent entity equipment in the factory can be quickly generated through various dimensional parameters of the equipment, but the generated three-dimensional virtual model needs to be connected through a dynamic data relationship model established manually or in addition to construct a complete three-dimensional model with directional information. On the contrary, the present invention can generate a three-dimensional model reconstruction data file involving both physical association and directional information based on two-dimensional drawing information with entity association relationships, thereby only needing to directly generate a three-dimensional model that can simultaneously reflect the physical association and directional information of the entity mapping object through the three-dimensional model reconstruction data file, significantly reducing the workload of setting and generating the three-dimensional model.

[0012] Furthermore, the three-dimensional models in the three-dimensional model reconstruction data file are analyzed and determined, and the entity mapping objects of the three-dimensional models are physically related to each other. By determining the three-dimensional models whose entity mapping objects are physically related to each other, abnormal three-dimensional model parts can be quickly selected to remind the staff to review the physical correlation.

[0013] The starting point and end point of the specific components that are physically related to each other are specified according to the respective pointing information of the corresponding specific components of the three-dimensional models that are associated with the entity mapping objects. The three-dimensional models that are physically related to each other are connected in a data communication manner according to the physical relationship between their entities. In this way, the physical attributes are associated between the three-dimensional models, reducing the steps of manually adding and checking the physical attribute information.

[0014] According to a preferred embodiment, the method further includes: when identifying a two-dimensional drawing involving an entity association relationship of a physical object through text, identifying the coordinate information of a specific component of the physical object with directional information in the two-dimensional drawing. Compared with the above-mentioned prior art, the present invention is capable of identifying the coordinate information of a physical object contained in a two-dimensional drawing. Based on the above-mentioned distinguishing technical features, the problems to be solved by the present invention may include: how to achieve preliminary positioning of specific components of different physical objects based on the two-dimensional drawing information. Specifically, by identifying the coordinate information, the positional relationship and physical association between different specific components can be preliminarily determined, avoiding the defect that the physical association between specific components needs to be manually set due to the loss of directional information.

[0015] According to a preferred embodiment, the method for automatically generating a three-dimensional model corresponding to the three-dimensional model information includes: determining the coordinate information of a specific component of a physical object with pointing information; determining the physical association of several three-dimensional models respectively according to the pointing information and the coordinate information; analyzing the specific components of several three-dimensional models that are physically associated with each other and are paired according to the physical association of the three-dimensional models. Compared with the above-mentioned prior art, the present invention can determine whether there is a matching anomaly in the physical association between the three-dimensional model components according to the pointing information and the coordinate information. Based on the above-mentioned distinguishing technical features, the problems to be solved by the present invention may include: how to improve the pairing accuracy of the three-dimensional model components and the review efficiency of the abnormal three-dimensional model components. Specifically, on the one hand, the present invention can respond to the determination of the abnormal three-dimensional model components and load the various two-dimensional drawings related to the abnormal three-dimensional model components for manual review, so as to avoid the phenomenon that the staff search for the two-dimensional drawings from the massive data and consume a lot of time. On the other hand, the present invention only loads the corresponding two-dimensional drawings after determining the abnormal three-dimensional model components, without taking the two-dimensional drawings of all components as the analysis object, thereby significantly reducing the data analysis processing volume.

[0016] According to a preferred embodiment, a method for analyzing specific paired components of several three-dimensional models that are physically associated with each other according to the physical association of the three-dimensional model includes: comparing the first physical association between the three-dimensional models determined according to the coordinate information with the second physical association between the three-dimensional models determined according to the pointing information, determining the specific components that are inconsistent between the first physical association and the second physical association, and determining the specific components that are inconsistent with the first physical association and the second physical association as abnormal three-dimensional model components. Compared with the above-mentioned prior art, the present invention can take into account the matching of physical properties through two steps to extract the information to be confirmed that needs to be manually reviewed. Based on the above-mentioned distinguishing technical features, the problems to be solved by the present invention may include: how to determine specific abnormal three-dimensional model components according to different physical associations between different information and three-dimensional models to reduce the probability of error in the process of generating three-dimensional models. Specifically, there are many possibilities for inconsistency. It may be that the coordinate information is wrong, or it may be that the pointing information is wrong. Therefore, by comparing the first physical association with the second physical association, it is easier to find the inconsistency problem of coordinate information or pointing information, which is convenient for prompting subsequent manual review.

[0017] According to a preferred embodiment, the method further includes: when identifying a two-dimensional drawing of a physical object involving an entity association relationship through text, storing the coordinate information and orientation information of a specific component related to the physical association in an associated manner. In subsequent manual review, such a method is conducive to reviewing the coordinate information and orientation information of the specific component at the same time, avoiding a unilateral review of the coordinate information or orientation information.

[0018] According to a preferred embodiment, the method further includes: establishing a data intercommunication relationship consistent with the physical relationship of the entity mapping object through the interfaces of at least two specific components whose coordinate information of the three-dimensional models associated with the entity mapping object is consistent with each other in a manner adapted to the pointing information. In the present invention, the connection method of the three-dimensional models in which the entity mapping objects are physically associated with each other is to establish data intercommunication by virtue of the physical relationship between the entities. The advantage of such a setting is that the physical association of the three-dimensional model can be made consistent with the association of the physical device, thus avoiding the cumbersome work of subsequent manual review of each interface.

[0019] According to a preferred embodiment, the method further comprises: in the case of determining an abnormal 3D model component, generating a reminder message for prompting manual review and indicating the location of the abnormal 3D model component. The advantage of such a setting is that the workload of manual review is simplified, so that the reviewer can directly find the abnormal 3D model component based on the reminder message.

[0020] The present invention also provides a storage medium of a digital twin method of an engineering object from a second aspect, which is used to store a coding program of the digital twin method of an engineering object. The digital twin method of an engineering object includes: identifying a two-dimensional drawing of a physical object involving an entity association relationship and generating three-dimensional model information corresponding to the physical object, generating a three-dimensional model reconstruction data file corresponding to the two-dimensional drawing based on the three-dimensional model information; importing the three-dimensional model information of the physical objects that are physically associated with each other into a three-dimensional model modeling software based on the three-dimensional model reconstruction data file, thereby automatically generating a three-dimensional model corresponding to the three-dimensional model information; analyzing and determining a number of three-dimensional models in the three-dimensional model reconstruction data file, and the entity mapping objects of the three-dimensional models are physically associated with each other; specifying the starting point and end point of the specific components that are physically associated with each other according to the respective pointing information of the corresponding specific components of the three-dimensional models that are associated with the entity mapping objects.

[0021] The storage medium of the present invention can run the digital twin method of the engineering object of the present invention, so that various terminals can quickly and automatically generate a three-dimensional model with physical association of its entities from a two-dimensional drawing through the storage medium.

[0022] From a third aspect, the present invention also provides a digital twin system of an engineering object, which may include a processor, which is configured to: identify two-dimensional drawings of physical objects involving entity association relationships and generate three-dimensional model information corresponding to the physical objects, and generate a three-dimensional model reconstruction data file corresponding to the two-dimensional drawings based on the three-dimensional model information; import the three-dimensional model information of physical objects that are physically related to each other into three-dimensional model building software based on the three-dimensional model reconstruction data file, thereby automatically generating a three-dimensional model corresponding to the three-dimensional model information; analyze and determine several three-dimensional models in the three-dimensional model reconstruction data file, and the entity mapping objects of the three-dimensional models are physically related to each other; specify the starting point and end point of the specific components that are physically related to each other according to the respective pointing information of the corresponding specific components of the three-dimensional models that are associated with the entity mapping objects.

[0023] The system of the present invention has less hardware and fast operation speed. The system of the present invention can pre-check the physical association between three-dimensional models generated based on two-dimensional drawings according to preset rules.

[0024] According to a preferred embodiment, the processor is also configured to: determine the coordinate information of specific components of a physical object having pointing information; determine the physical association of several three-dimensional models respectively based on the pointing information and the coordinate information; and analyze specific components of several three-dimensional models that are paired and physically associated with each other based on the physical association of the three-dimensional models.

[0025] The system of the present invention can respond to the determination of abnormal three-dimensional model components and load various two-dimensional drawings related to the abnormal three-dimensional model components for manual review, thereby avoiding the phenomenon that staff members search for two-dimensional drawings from massive data and waste a lot of time. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is a schematic diagram of a three-dimensional model provided by the present invention;

[0027] Figure 2 It is a two-dimensional pipeline design diagram of the prior art;

[0028] Figure 3 It is a schematic diagram of the steps of the digital twin method of the engineering object of the present invention.

[0029] Reference numerals list

[0030] 100: first physical object; 110: first interface; 200: second physical object; 220: second interface; 300: flow direction. DETAILED DESCRIPTION

[0031] The following is a detailed description with reference to the accompanying drawings.

[0032] The present invention provides a digital twin method, system and storage medium for an engineering object. The present invention may also be a physical correlation inspection system and method based on a three-dimensional model of a digital twin factory. The present invention may also be an early warning system and method based on the physical connection relationship of a three-dimensional model of a digital twin factory. The present invention may also be a three-dimensional model generation system and method in which entity mapping objects are physically correlated with each other.

[0033] The present invention explains some of the noun terms.

[0034] The physical relevance of the 3D model: including the connection relationship and directionality of the medium flow and data flow. For example, the starting and ending points of the pipeline in the 3D model, the medium flow starting point (i.e., outlet) of the storage tank and the starting point (i.e., inlet) of the pipeline are designated as the medium starting point.

[0035] Directional information: refers to the directionality of the connection relationship between specific components.

[0036] Coordinate information: refers to the coordinate data of each specific component.

[0037] 3D model reconstruction data file: refers to the 3D model data file of a specific component containing coordinate information and orientation information. It is different from ordinary 3D model information. Ordinary 3D model information is a 3D model directly extracted and generated from a 2D drawing, which only contains coordinate information that is unrelated to physical association information and does not include orientation information.

[0038] Example 1

[0039] In order to quickly complete the digital twin of an engineering object from a large number of two-dimensional drawings, a new digital twin method is needed, which can at least semi-automatically generate engineering objects in a three-dimensional scene to improve the efficiency of digital twins and reduce the error rate. Preferably, the digital twin method can pre-audit the physical association between three-dimensional models generated based on two-dimensional drawings according to preset rules. Preferably, the pre-audit is implemented in the form of a form for manual secondary review.

[0040] In view of the shortcomings of the prior art, the digital twin method of the engineering object of the present invention is as follows: Figure 3 As shown, the method includes steps S1 to S2. The digital twin method of the engineering object is run by the digital twin system of the engineering object. The digital twin system of the engineering object includes at least one processor. The processor may be provided with a display component, or may be connected to at least one terminal with a display component to display the digital twin process of the engineering object. Preferably, the processor is capable of running a coding program of the digital twin method of the engineering object. The processor may be a processor in a computer, a dedicated integrated chip, and a combination thereof, or may be an independently arranged processor, a dedicated integrated chip, and a combination thereof.

[0041] S1: Identify a two-dimensional drawing of a physical object involving an entity association relationship and generate three-dimensional model information corresponding to the physical object, and generate a three-dimensional model reconstruction data file corresponding to the two-dimensional drawing based on the three-dimensional model information.

[0042] A physical object may be composed of multiple specific parts. Figure 2 As shown, the coordinate information of the specific components of each physical object is marked on the two-dimensional drawing, which can reflect the position and connection relationship between each specific component. At this time, the connection relationship is not directional. The mutual relationship information of each physical object is read from the two-dimensional drawing by text recognition. For example, the mutual relationship information is that the first interface 110 of the first physical object 100 is connected to the second interface 220 of the second physical object 200. It should be noted that the connection relationship at this time also represents the entity connection relationship between the physical objects.

[0043] After identifying the interrelated information of the physical objects on the two-dimensional drawing, the three-dimensional model information corresponding to the physical objects is generated. At this time, the three-dimensional model information can only include coordinate information, and the pointing information between the physical objects is not included. Therefore, a three-dimensional model reconstruction data file is generated based on the three-dimensional model information and the interrelated information of the physical objects.

[0044] S11: When identifying a two-dimensional drawing of a physical object involving an entity association relationship through text, identify the coordinate information of a specific component of the physical object with directional information in the two-dimensional drawing. By identifying the coordinate information, the positional relationship and physical association between different specific components can be preliminarily determined, avoiding the defect that the physical association between specific components needs to be manually set due to the loss of directional information.

[0045] The present invention uses intelligent drawing recognition technology in the ISO drawing intelligent recognition stage, including end-to-end recognition technology, which has been successfully applied in actual projects. Steps S111 to S113 are as follows:

[0046] S111: extracting pipeline numbers and instrument position numbers from drawings using a text recognition network;

[0047] S112: Extract symbols and pipelines from drawings using detection and segmentation networks;

[0048] S113: Use graph neural networks to establish upstream and downstream logical pipelines of symbols and pipelines.

[0049] For example, from Figure 2 It can be identified from the two-dimensional drawing in that the position number of the first physical object 100 is T01. The position number of the second physical object 200 is E01. The text label "Connect to T01 N1" in the lower left corner, the text label "Connect to E01N1" in the upper right corner, and the arrow line indicate that the connection relationship is: the first interface 110 and the second interface 220 are connected through a pipeline. The text prompt information "Connect 50-OG-004-6.3A1" recorded in the upper left corner is directional information. The flow direction 300 of the medium flow is in the direction indicated by the arrow. Obviously, from Figure 2 The information identified in the figure is that the flow direction 300 of the medium flow points from the first interface 110 of the first physical object 100 to the second interface 220 of the second physical object 200 .

[0050] according to Figure 2 The connection information of the two-dimensional drawing is generated Figure 1 In the 3D model. Figure 1 In the example, the connection relationship between different physical objects includes not only the physical connection relationship (for example, the first interface 110 is connected to the second interface 220 via a pipe), but also the directional information of the medium flow. Figure 1 In the figure, the flow direction 300 of the medium flow is the directional information.

[0051] Preferably, when identifying a two-dimensional drawing of a physical object involving an entity association relationship through text, the coordinate information and orientation information of specific components related to the physical association are stored in an associated manner. For example, the inlet and outlet coordinates of a medium flow or a data flow and the flow direction of the medium flow, the flow direction of the data flow, and other data information are stored. By associating the coordinate information and orientation information with each other, the coordinate information and orientation information of the subsequently generated three-dimensional model information will not be missed, and the data can be retrieved and checked at any time.

[0052] During subsequent manual review, this method is conducive to simultaneously reviewing the coordinate information and orientation information of specific components, avoiding unilateral review of coordinate information or orientation information.

[0053] Preferably, when the directional information is not recorded in the two-dimensional drawing, the directional information of a specific component is predicted based on the physical properties and usage functions of the physical object, so as to avoid the defect of unclear directional information generated by the subsequent three-dimensional model due to the absence of directional information. The predicted directional information is displayed in a color and display mode that can be distinguished from the read directional information, so that it can be quickly discovered, supplemented and reviewed by humans in the subsequent viewing process. The display mode is, for example, flashing and other ways that can attract attention.

[0054] Preferably, when identifying a two-dimensional drawing of a physical object involving an entity association relationship through text, the correctness of the pointing information is preliminarily determined based on the physical properties and usage functions of the physical object. When it is determined that a certain pointing information may be incorrect, the three-dimensional model and the three-dimensional model reconstruction data file related to the pointing information are associated and marked with a manual review warning mark to facilitate manual review of the pointing information at a later time.

[0055] For example, when the three interfaces of a fixed tank are all identified as medium inlets and there is no medium outlet, the directional information of a certain interface of the tank may be wrong. However, since a three-dimensional model with physical association has not yet been generated, the correctness of each associated data cannot be confirmed temporarily. At this time, all three associations of the three interfaces of the tank are marked with manual review warning signs so that the physical association of the three-dimensional model generated later can be focused on matching and judging.

[0056] S2: Based on the 3D model reconstruction data file, the 3D model information of the physical objects that are physically related to each other is imported into the 3D model building software, thereby automatically generating a 3D model corresponding to the 3D model information. Compared with the prior art method of generating a single 3D model based on a single 2D drawing, the present invention can batch process a large number of 2D drawings to form a preliminary 3D presentation of the engineering object.

[0057] The three-dimensional modeling software includes, for example, PDMS, SP3D, Autodesk AutoCAD, and the like.

[0058] Preferably, the step of automatically generating a three-dimensional pipeline model comprises:

[0059] S3: Analyze and determine a number of three-dimensional models in the three-dimensional model reconstruction data file whose entity mapping objects are physically associated with each other.

[0060] S31: Determine the coordinate information of the specific component with the pointing information.

[0061] Preferably, a specific component whose coordinate information and its pointing information are associated with each other is extracted, the specific component is selected based on the identification of the pointing information, and the coordinate information of the specific component is used as the selection object.

[0062] S32: According to the direction information (such as Figure 2 The physical relationship between several three-dimensional models is determined by both the textual hint "Connect 50-OG-004-6.3A1" recorded in the upper left corner and the coordinate information.

[0063] For example, the connection relationship between two physical objects can be determined based on the coordinate information. The starting point and end point of the medium flow of the connection relationship can be determined based on the directional information. Then, the physical association between the two physical objects is: one physical object transmits the medium flow to another physical object through a pipeline, and the pipeline interface is a sealed connection. If the medium flow is a flammable and explosive fluid, then the physical properties of the pipeline are property parameters that can be applied to flammable and explosive fluids.

[0064] S33: Analyze specific components of the three-dimensional models that are paired and physically associated with each other according to the determined physical association.

[0065] The first physical association between the three-dimensional models determined according to the coordinate information is compared with the second physical association between the three-dimensional models determined according to the orientation information to determine the specific component with inconsistency between the two. The specific component with inconsistency is determined as an abnormal three-dimensional model component.

[0066] There are many possibilities for inconsistency. For example, (1) incorrect coordinate information or orientation information appears during recognition; (2) contradictory orientation information appears in several 2D drawings; (3) corresponding information is missing due to failure to collect orientation information or coordinate information during recognition, etc.

[0067] Based on the above multiple possibilities, preferably, in response to the determination of the abnormal three-dimensional model component, the various two-dimensional drawings related to the abnormal three-dimensional model component are loaded, and the two-dimensional drawings and the three-dimensional model are displayed in parallel to facilitate manual review. This is because the review sometimes requires checking the two-dimensional drawings again, which means a lot of time consumption for massive data. The present invention retrieves the various two-dimensional drawings related to the abnormal three-dimensional model component, reducing the time for staff to re-search files and trace back information. The use of parallel display is conducive to the staff comparing the two-dimensional drawings with the three-dimensional model, which can facilitate the search for the cause of the inconsistency.

[0068] Preferably, when displaying, specific components with inconsistent physical associations due to different reasons are represented in different display modes, such as by color difference, flashing difference, identification difference, etc., so that the staff can quickly review based on the reasons.

[0069] Preferably, the step of determining the first physical association between the three-dimensional models according to the coordinate information comprises:

[0070] The association relationship between specific components of physical objects that have physical association is preliminarily determined based on the coordinate information.

[0071] When a physical object has at least two physical objects associated with it, check whether the association relationship and the physical properties of the corresponding physical objects are related. When the association relationship and the physical properties of the corresponding physical objects are related, determine the association relationship between the specific components of the physical objects as the first physical association. When the association relationship and the physical properties of the corresponding physical objects are not related (or violate the association sample law), mark the association relationship as the first physical association to be confirmed and mark the manual review warning mark.

[0072] For example, when the physical property of the medium flow between the tanks is high temperature gas, can the material category parameter in the physical property of the connecting pipe be applicable to the high temperature gas? If applicable, the first physical correlation is judged to be normal. If not applicable, the first physical correlation is judged to be the first physical correlation to be confirmed.

[0073] The step of determining the second physical association between the three-dimensional models according to the directional information includes: preliminarily determining the association relationship between specific components of the physical objects having the physical association based on the directional information.

[0074] When a physical object has at least two physical objects associated with it, check whether the pointing direction and the physical properties of the corresponding physical object are related. When the pointing direction and the physical properties of the corresponding physical object are related, determine the association relationship between the specific parts of the physical object as the second physical association. When the pointing direction and the physical properties of the corresponding physical object are not related (or violate the association sample rule), mark the association relationship as the second physical association to be confirmed and mark the manual review warning mark.

[0075] For example, when the physical property of the medium flow between the two tanks is high-temperature gas, can the physical properties of the first tank for conveying the high-temperature gas and the second tank for receiving the high-temperature gas meet the needs of storing the high-temperature gas? For example, if the materials of the first tank and the second tank are high-temperature resistant metal tanks, then their physical properties meet the needs of storing high-temperature gas. In this case, the pointing direction is related to the physical properties of the physical object. The physical correlation obtained at this time is the second physical correlation. Otherwise, the obtained physical correlation is marked as the second physical correlation to be confirmed and marked with a manual review warning mark.

[0076] The present invention takes physical properties into additional consideration through two steps, and can extract information to be confirmed for the staff, so as to reduce the error probability in the process of generating the three-dimensional model.

[0077] S4: specifying the start and end points of the paired specific components that are physically associated with each other according to the respective directional information of the paired corresponding specific components of the three-dimensional model that is associated with the entity mapping object.

[0078] The interfaces of at least two specific components whose coordinate information of the three-dimensional models associated with the entity mapping object is consistent with each other are established with a data intercommunication relationship consistent with the physical relationship of the entity mapping object in a manner adapted to the pointing information.

[0079] In the present invention, the connection method of the three-dimensional models in which the entity mapping objects are physically related to each other is to establish data intercommunication by virtue of the physical relationship between the entities. The advantage of such a setting is that the physical correlation of the three-dimensional model can be consistent with the correlation of the physical device, avoiding the cumbersome work of subsequent manual review of each interface.

[0080] For example, Figure 2 As shown, the first physical object 100 has a bit number of T01, and has a first interface 110. The second physical object 200 has a bit number of E01, and has a second interface 220. The first interface 110 and the second interface 220 are connected via a pipeline.

[0081] The flow direction 300 of the medium flow in the pipe between the first interface 110 and the second interface 220 is the first interface 110→the second interface 220. After the three-dimensional model is generated, the data of the medium flow of the first interface 110 of the first physical object 100 automatically changes to output data, and the data of the medium flow of the second interface 220 of the second physical object 200 automatically changes to input data.

[0082] The three-dimensional model automatically generated by the present invention has attribute data consistent with the attribute data of its entity, and the association relationship is also consistent with the physical association of the entity. Therefore, there is no need for the staff to adjust the attribute data and the association relationship of the three-dimensional model at a later stage, and they only need to check the data to be confirmed.

[0083] The present invention utilizes the automatic recognition of ISO drawings and the reconstruction of pipeline 3D models, and uses a unified framework of end-to-end deep learning to minimize manual recognition and intervention in the recognition and reconstruction process of drawings. The system requires a large amount of drawing data for the annotation of symbols, relationships, and pipelines, and learns through supervised methods to achieve the current optimal accuracy of each network, so that they can be connected in series and cooperate with each other for fully automatic recognition and reconstruction.

[0084] Preferably, by determining the three-dimensional model in which the entity mapping objects are physically associated with each other, abnormal three-dimensional model components can be quickly selected to remind the staff to review the physical association.

[0085] When an abnormal 3D model component is determined, a reminder message is generated to remind manual review and indicate the location of the abnormal 3D model component. The advantage of this arrangement is that it simplifies the workload of manual review, so that the reviewer can directly find the abnormal 3D model component based on the reminder message.

[0086] Example 2

[0087] This embodiment is a further improvement on Embodiment 1, and the repeated contents will not be repeated here.

[0088] The present invention also provides a storage medium of a digital twin method of an engineering object from a second aspect, which is used to store a coding program of the digital twin method of an engineering object. The digital twin method of an engineering object includes: identifying a two-dimensional drawing of a physical object involving an entity association relationship and generating three-dimensional model information corresponding to the physical object, generating a three-dimensional model reconstruction data file corresponding to the two-dimensional drawing based on the three-dimensional model information; importing the three-dimensional model information of the physical objects that are physically associated with each other into a three-dimensional model modeling software based on the three-dimensional model reconstruction data file, thereby automatically generating a three-dimensional model corresponding to the three-dimensional model information; analyzing and determining a number of three-dimensional models in the three-dimensional model reconstruction data file, and the entity mapping objects of the three-dimensional models are physically associated with each other; specifying the starting point and end point of the specific components that are physically associated with each other according to the respective pointing information of the corresponding specific components of the three-dimensional models that are associated with the entity mapping objects.

[0089] The storage medium of the present invention can run the digital twin method of the engineering object of the present invention, so that various terminals can quickly and automatically generate a three-dimensional model with physical association of its entities from a two-dimensional drawing through the storage medium.

[0090] The present invention further provides a digital twin system of an engineering object from a third aspect, which may include a processor, wherein the processor is configured to:

[0091] S1: Identify a two-dimensional drawing of a physical object involving an entity association relationship and generate three-dimensional model information corresponding to the physical object, and generate a three-dimensional model reconstruction data file corresponding to the two-dimensional drawing based on the three-dimensional model information.

[0092] S2: Based on the three-dimensional model reconstruction data file, the three-dimensional model information of the physical objects that are physically related to each other is imported into the three-dimensional model building software, thereby automatically generating a three-dimensional model corresponding to the three-dimensional model information.

[0093] The method for automatically generating a three-dimensional model corresponding to the three-dimensional model information includes:

[0094] S3: Analyze and determine a number of three-dimensional models in the three-dimensional model reconstruction data file, where entity mapping objects of the three-dimensional models are physically associated with each other.

[0095] S31: Determine the coordinate information of the specific component with the pointing information.

[0096] Preferably, a specific component whose coordinate information and its pointing information are associated with each other is extracted, the specific component is selected based on the identification of the pointing information, and the coordinate information of the specific component is used as the selection object.

[0097] S32: According to the direction information (such as Figure 2The physical relationship between several three-dimensional models is determined by both the textual hint "Connect 50-OG-004-6.3A1" recorded in the upper left corner and the coordinate information.

[0098] For example, the connection relationship between two physical objects can be determined based on the coordinate information. The starting point and end point of the medium flow of the connection relationship can be determined based on the directional information. Then, the physical association between the two physical objects is: one physical object transmits the medium flow to another physical object through a pipeline, and the pipeline interface is a sealed connection. If the medium flow is a flammable and explosive fluid, then the physical properties of the pipeline are property parameters that can be applied to flammable and explosive fluids.

[0099] S33: Analyze specific components of the three-dimensional models that are paired and physically associated with each other according to the determined physical association.

[0100] S4: specifying the start and end points of the paired specific components that are physically associated with each other according to the respective directional information of the paired corresponding specific components of the three-dimensional model that is associated with the entity mapping object.

[0101] The system of the present invention has less hardware and fast operation speed. The system of the present invention can pre-check the physical association between three-dimensional models generated based on two-dimensional drawings according to preset rules.

[0102] The system of the present invention can respond to the determination of abnormal three-dimensional model components and load various two-dimensional drawings related to the abnormal three-dimensional model components for manual review, thereby avoiding the phenomenon that staff members search for two-dimensional drawings from massive data and waste a lot of time.

[0103] It should be noted that the above-mentioned specific embodiments are exemplary, and those skilled in the art can come up with various solutions inspired by the disclosure of the present invention, and these solutions also belong to the disclosure scope of the present invention and fall within the protection scope of the present invention. Those skilled in the art should understand that the present invention specification and its drawings are illustrative and do not constitute a limitation on the claims. The scope of protection of the present invention is defined by the claims and their equivalents. The present invention specification contains multiple inventive concepts, such as "preferably", "according to a preferred embodiment" or "optionally", which means that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application based on each inventive concept.

Claims

1. A processor for constructing a three-dimensional model, characterized in that: The processor is configured to: Identify coordinate information of specific parts of a physical object with orientation information in a two-dimensional drawing; Determining physical associations of a plurality of three-dimensional models respectively according to the orientation information and the coordinate information; Analyzing specific components of the three-dimensional models that are physically related to each other and are paired with each other according to the physical relationship of the three-dimensional models; Data intercommunication is established based on the physical relationship between entities corresponding to the three-dimensional model, so that the physical relevance of the three-dimensional model is consistent with the relevance of the physical device.

2. The processor for constructing a three-dimensional model according to claim 1, characterized in that: The processor is further configured to: The starting point and the end point of the paired specific components that are physically associated with each other are specified according to the respective directional information of the paired corresponding specific components of the three-dimensional model that is associated with the entity mapping object.

3. The processor for constructing a three-dimensional model according to claim 2, characterized in that: The processor is further configured to: The interfaces of at least two specific components whose coordinate information of the three-dimensional models associated with the entity mapping object is consistent with each other are established with a data intercommunication relationship consistent with the physical relationship of the entity mapping object in a manner adapted to the pointing information.

4. The processor for constructing a three-dimensional model according to any one of claims 1 to 3, characterized in that: The processor is further configured to: Compare the first physical association between the three-dimensional models determined according to the coordinate information with the second physical association between the three-dimensional models determined according to the pointing information, determine the specific components that are inconsistent between the first physical association and the second physical association, and determine the specific components that are inconsistent between the first physical association and the second physical association as abnormal three-dimensional model components.

5. The processor for constructing a three-dimensional model according to any one of claims 1 to 4, characterized in that: The processor is further configured to: When a physical object has at least two physical objects associated with it, checking whether the associated relationship and the physical properties of the corresponding physical objects are related; In the case where the association relationship and the physical properties of the corresponding physical objects are related, the association relationship between the specific components of the physical objects is determined to be the first physical association.

6. The processor for constructing a three-dimensional model according to any one of claims 1 to 5, characterized in that: The processor is further configured to: In the case where a physical object has at least two physical objects associated with it, checking whether the pointing direction and the physical properties of the corresponding physical objects are related; In the case where the pointing direction and the physical properties of the corresponding physical object are related, the association relationship between the specific components of the physical object is determined as the second physical association.

7. A three-dimensional model connection warning system, comprising a processor, characterized in that: The processor is configured to: Identify coordinate information of specific parts of a physical object with orientation information in a two-dimensional drawing; Determining physical associations of a plurality of three-dimensional models respectively according to the orientation information and the coordinate information; Analyzing specific components of the three-dimensional models that are physically related to each other and are paired with each other according to the physical relationship of the three-dimensional models; Comparing the first physical association between the three-dimensional models determined according to the coordinate information with the second physical association between the three-dimensional models determined according to the orientation information, and determining specific components where there is inconsistency between the two; The specific parts with inconsistencies are determined as abnormal three-dimensional model parts and marked with manual review warning signs.

8. The three-dimensional model connection warning system according to claim 7, characterized in that: Also included is a terminal having a display assembly, In response to the determination of the abnormal three-dimensional model component, the processor loads various two-dimensional drawings related to the abnormal three-dimensional model component, and displays the two-dimensional drawings and the three-dimensional model in parallel on the terminal to facilitate manual review.

9. The three-dimensional model connection warning system according to claim 7 or 8, characterized in that: The processor is configured to: When the orientation information is not recorded in the 2D drawings, the orientation information of the specific components is predicted based on the physical properties and usage functions of the physical objects to avoid ambiguous orientation information generated by the 3D model.

10. The three-dimensional model connection warning system according to claim 7 or 8, characterized in that: The processor is configured to: When identifying a two-dimensional drawing of a physical object involving an entity association relationship through text, the correctness of the pointing information is preliminarily judged based on the physical properties and usage functions of the physical object; When it is determined that the pointing information is incorrect, the three-dimensional model and the three-dimensional model reconstruction data file related to the pointing information are associated and marked with a manual review warning mark.

Images