Engineering drawing, three-dimensional model, real scene picture linkage and integrated consultation method and device

Abstract

The application discloses a kind of engineering drawing, three-dimensional model, real scene picture linkage and integrated consultation method and device, method includes: based on the bottom database generation to be linked two-dimensional engineering drawing, three-dimensional model, based on the elevation of two-dimensional engineering drawing to be linked and the z-axis section corresponding to the height of three-dimensional model is carried out first alignment matching;Second alignment matching is carried out to two-dimensional engineering drawing to be linked and three-dimensional model, i.e. shaft network direction matching;Two-dimensional engineering drawing after adjustment and three-dimensional model after adjustment are scaled to same standard size;Obtain the real scene picture to be linked, determine the coordinate conversion relationship between two-dimensional engineering drawing after scaling, three-dimensional model after scaling;Determine the orthoview angle of the real scene picture to be linked, establish the mapping relationship of the real scene picture to be linked and two-dimensional engineering drawing after scaling;Based on the coordinate conversion relationship and the mapping relationship, the real scene picture to be linked is mapped to the three-dimensional model after scaling.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent construction, and particularly relates to a method and device for linkage and integration of engineering drawings, three-dimensional models and real scene pictures. BACKGROUND

[0002] In the field of intelligent construction, the sources of data are very diverse, including but not limited to CAD drawings, three-dimensional models, texts, images, videos, etc. First of all, these data are often stored in different encoding ways and structures, so format conversion and standardization are needed in the processing process in order to effectively integrate and analyze. Secondly, due to the diversity of data sources, there may be complex association and dependency relationships between data. For example, engineering design drawings are associated with three-dimensional models generated by engineering design software, and three-dimensional models generated by engineering design software are associated with video data captured by monitoring cameras. Therefore, intelligent association and linkage of these data are needed so that users can easily obtain associated data information.

[0003] In addition, current technical solutions usually perform fusion processing when multiple source data need to be applied, which leads to manual association of terminal users when they consult data, resulting in low efficiency and errors. Therefore, advanced technical means such as artificial intelligence and big data analysis technology are needed to automatically associate and analyze data, thereby improving the efficiency and accuracy of data processing.

[0004] To sum up, in traditional engineering operations, engineering drawings serve as the carrier of design and undertake the important mission of conveying design intent. Designers draw complex ideas and precise parameters into drawings, and construction teams execute the construction process according to these drawings. However, as the complexity of projects increases, a single drawing is increasingly difficult to meet the real-time consultation needs of site construction personnel.

[0005] In the prior art, there is a technical problem of insufficient structured storage of two-dimensional drawings and three-dimensional models. In the construction industry, there is a key technical problem in the structured storage of drawing models, i.e., the lack of effective management of geometric association relationships. Two-dimensional drawings and three-dimensional models are core data in the design, construction and maintenance process, which describe the geometric shape, structural composition and spatial layout of buildings. However, current structured storage methods often only focus on the attributes and parameters of individual components, ignoring the geometric association relationships between components. Geometric association relationships refer to the spatial position, interaction and dependency relationships between components in a building. In traditional structured storage of two-dimensional drawings and three-dimensional models, although each component can be described and managed independently, there is a lack of explicit expression and recording of geometric relationships between components.

[0006] There is also a computer-aided matching of geometric spatial positions of two-dimensional drawings, three-dimensional models and real scene pictures that is not accurate enough, and the workload of manual matching is large. The key to this problem is how to accurately match and align the geometric spatial positions in different data sources to realize the integration and analysis of data. Currently, computer-aided matching mainly relies on user clicks to generate corresponding relationships, and there will be a large error in user clicks and associated scale calculation.

[0007] In addition, the operation after the association of two-dimensional drawings, three-dimensional models and real scene pictures cannot be linked. The core of this problem is that although drawings, models and real scene pictures can be associated, when performing operations such as rotation, displacement modification, editing or adding content, these operations cannot be reflected in real time or automatically synchronized in other associated data sources. SUMMARY

[0008] Therefore, the present application provides an engineering drawing, three-dimensional model, real scene picture linkage and integrated viewing method and device, which can solve the technical problems of insufficient structured storage of two-dimensional drawings and three-dimensional models, difficulty in accurate matching of two-dimensional drawings, three-dimensional models and real scene pictures, and difficulty in accurate operation of two-dimensional drawings, three-dimensional models and real scene pictures.

[0009] In order to solve the above technical problems, the present application is implemented as follows.

[0010] An engineering drawing, three-dimensional model, real scene picture linkage and integrated viewing method, the method comprising the following steps:

[0011] Step S1: setting a bottom-layer database for constructing two-dimensional engineering drawings and three-dimensional models;

[0012] Step S2: generating two-dimensional engineering drawings and three-dimensional models to be linked based on the bottom-layer database, and performing a first alignment matching on the elevation of the two-dimensional engineering drawings to be linked and the z-axis profile corresponding to the height of the three-dimensional model;

[0013] Step S3: based on the first alignment matching result, performing a second alignment matching, i.e. axis network direction matching, on the two-dimensional engineering drawings and three-dimensional models to be linked, to realize the adjustment of the two-dimensional engineering drawings and three-dimensional models;

[0014] Step S4: scaling the adjusted two-dimensional engineering drawings and the adjusted three-dimensional models to the same standard size; obtaining a real scene picture to be linked, determining the coordinate conversion relationship between the scaled two-dimensional engineering drawings and the scaled three-dimensional models; determining the front view angle of the real scene picture to be linked, establishing the mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawings; and based on the coordinate conversion relationship and the mapping relationship, mapping the real scene picture to be linked onto the scaled three-dimensional model.

[0015] Preferably, in the underlying database, the graphic primitives, graphic primitive identifiers, graphic primitive attributes for constructing two-dimensional engineering drawings are stored, the graphic primitive attributes including graphic primitive types, layer information, position information, parameterized geometric information, custom attributes, and graphic primitive general attributes; the layer information is used to represent the hierarchy of the graphic primitives in the two-dimensional engineering drawings, and the position information is used to represent the position of the graphic primitives in the two-dimensional engineering drawings; in the underlying database, the components, component identifiers, and component attributes for constructing three-dimensional models are stored, the component attributes including geometric attributes, general attributes, and custom attributes.

[0016] Preferably, the step S4 of generating the two-dimensional engineering drawings and the three-dimensional models to be linked comprises:

[0017] According to the actual information of the construction project, the required graphic primitives are selected from the underlying database, each graphic primitive is instantiated, and a plurality of two-dimensional engineering drawings are generated; the required components are selected from the underlying database, each component is instantiated, and a plurality of three-dimensional models are generated; for each two-dimensional engineering drawing, an axis net and axis net information corresponding to the two-dimensional engineering drawing are generated, the axis net has an x-axis and a y-axis, the x-axis represents the horizontal direction of the two-dimensional engineering drawing, and the y-axis represents the vertical direction of the two-dimensional engineering drawing, the axis net information represents the design direction and design size of the two-dimensional engineering drawing; for each three-dimensional model, an axis net and axis net information corresponding to the three-dimensional model are generated, the axis net has an x-axis, a y-axis, and a z-axis, the x-axis represents the horizontal direction of the cross section of the three-dimensional model, the y-axis represents the vertical direction of the cross section of the three-dimensional model, the z-axis represents the vertical direction of the longitudinal section of the three-dimensional model, the z-axis profile of the three-dimensional model corresponds to the height of the three-dimensional model, and the axis net information represents the design direction and design size of the three-dimensional model.

[0018] From the two-dimensional engineering drawings and the three-dimensional models, the two-dimensional engineering drawings and the three-dimensional models to be linked are determined.

[0019] The axis net information of the two-dimensional engineering drawings to be linked, the graphic primitive identifiers, the graphic primitive attributes, the connection relationships, and the dependency relationships of the instantiated graphic primitives, the axis net information of the three-dimensional models to be linked, the component identifiers, the component attributes, the connection relationships, and the dependency relationships of the instantiated components are stored in the business database.

[0020] Preferably, the step S4 of scaling the adjusted two-dimensional engineering drawings and the adjusted three-dimensional models to the same standard size comprises:

[0021] The step S41 of extracting a plurality of first feature points of the instantiated graphic primitives from the adjusted two-dimensional engineering drawings and a plurality of second feature points corresponding to the first feature points from the adjusted three-dimensional models is performed.

[0022] Step S42: for each first feature point P(x, y), where x and y are the horizontal coordinate and vertical coordinate of the first feature point respectively, the following operations are performed:

[0023] determine the horizontal number i and vertical number j of the axis net in which the first feature point P(x, y) is located in the adjusted two-dimensional engineering drawing:

[0024]

[0025] wherein x n is the nth x-axis axis net of the adjusted two-dimensional engineering drawing, y m is the mth y-axis axis net of the adjusted two-dimensional engineering drawing, x i is the ith x-axis axis net of the adjusted two-dimensional engineering drawing, and y j is the jth y-axis axis net of the adjusted two-dimensional engineering drawing.

[0026] Step S43: determine the horizontal number x' and vertical number y' of the axis net in which each second feature point is located in the adjusted three-dimensional model:

[0027]

[0028] wherein x' i and y' i are the horizontal coordinate and vertical coordinate of the second feature point respectively.

[0029] Step S44: based on the horizontal number and vertical number of the axis net in which each first feature point is located, and the horizontal number and vertical number of the axis net in which the second feature point corresponding to each first feature point is located, scale the adjusted two-dimensional engineering drawing and the adjusted three-dimensional model to the same standard size.

[0030] Preferably, in the step S4, the coordinate conversion relationship between the scaled two-dimensional engineering drawing and the scaled three-dimensional model is determined based on the real scene picture to be linked; the front view angle of the real scene picture to be linked is determined, and the mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawing is established; and the real scene picture to be linked is mapped onto the scaled three-dimensional model based on the coordinate conversion relationship and the mapping relationship, which comprises:

[0031] The real scene picture to be linked is obtained, and the real scene picture is a real scene picture of a construction site.

[0032] The coordinate conversion relationship between the two-dimensional engineering drawing and the three-dimensional model scaled to the same standard size is determined; the front view angle of the real scene picture to be linked is determined as the front view angle of the initial view angle panorama, and a point pair is selected by matching points in the scaled two-dimensional engineering drawing and the real scene picture to be linked; and the vector expression of the front view angle of the real scene picture to be linked on the scaled two-dimensional engineering drawing is established according to the coordinates of the points in the point pair.

[0033]

[0034] a represents the coordinates of a point on the real scene picture to be linked in a point pair on the scaled two-dimensional engineering drawing paper, and a' represents the coordinates of a point on the scaled two-dimensional engineering drawing paper in a point pair on the real scene picture to be linked;

[0035] Based on the vector expression, the mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawing paper is determined;

[0036] Based on the mapping relationship, the coordinates and elevation of the feature points in the real scene picture to be linked on the scaled two-dimensional drawing paper are determined, and then the real scene picture to be linked is mapped to the scaled three-dimensional model based on the coordinate conversion relationship.

[0037] The engineering drawing paper, three-dimensional model and real scene picture linkage and integrated inquiry device provided by the application comprises:

[0038] A bottom construction module is configured to set a bottom database for constructing a two-dimensional engineering drawing paper and a three-dimensional model;

[0039] A first alignment module is configured to generate a two-dimensional engineering drawing paper and a three-dimensional model to be linked based on the bottom database, and to perform a first alignment matching based on the elevation of the two-dimensional engineering drawing paper to be linked and the z-axis profile corresponding to the height of the three-dimensional model;

[0040] A second alignment module is configured to perform a second alignment matching, i.e., a grid direction matching, based on the first alignment matching result, so as to realize the adjustment of the two-dimensional engineering drawing paper and the three-dimensional model;

[0041] A linkage module is configured to scale the adjusted two-dimensional engineering drawing paper and the adjusted three-dimensional model to the same standard size, to obtain a real scene picture to be linked, to determine the coordinate conversion relationship between the scaled two-dimensional engineering drawing paper and the scaled three-dimensional model, to determine the front view angle of the real scene picture to be linked, to establish the mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawing paper, and to map the real scene picture to be linked to the scaled three-dimensional model based on the coordinate conversion relationship and the mapping relationship.

[0042] The computer readable storage medium provided by the application stores a plurality of instructions; the plurality of instructions are used for loading and executing the method as described above by a processor.

[0043] The electronic device provided by the application comprises:

[0044] A processor is used for executing a plurality of instructions.

[0045] a memory for storing a plurality of instructions;

[0046] The plurality of instructions are stored by the memory and loaded and executed by the processor to implement the method as described above.

[0047] The implementation of the engineering drawing, model and real scene linkage and integrated consultation is the result of deep integration of information technology and engineering practice. It breaks the traditional working mode, and makes the design, construction, management and other links more closely linked, and improves the overall efficiency and quality of the engineering project.

[0048] The beneficial technical effects brought by the present application are:

[0049] (1) The present application defines the two-dimensional drawing, three-dimensional model, real scene picture and other multi-source heterogeneous fusion storage database of the engineering, which lays a foundation for subsequent linkage and integrated consultation of the two-dimensional drawing, three-dimensional model and real scene picture of the engineering.

[0050] (2) The present application realizes linkage and integrated consultation of the engineering drawing, three-dimensional model and real scene picture, and solves the accurate matching and one-step matching of the spatial geometric coordinates of the engineering drawing, three-dimensional model and real scene picture based on the geometric accurate matching method of the two-dimensional drawing, three-dimensional model and real scene picture based on the axis network.

[0051] (3) The present application realizes accurate linkage of the engineering drawing, three-dimensional model and real scene picture. BRIEF DESCRIPTION OF DRAWINGS

[0052] Figure 1 The present application provides an engineering drawing, three-dimensional model and real scene picture linkage and integrated consultation method process schematic diagram.

[0053] Figure 2 The present application provides an engineering drawing, three-dimensional model and real scene picture linkage and integrated consultation device structure schematic diagram. DETAILED DESCRIPTION

[0054] The present application will be described in detail below in combination with the drawings and examples.

[0055] As shown in the drawings, Figure 1 The present application provides an engineering drawing, three-dimensional model and real scene picture linkage and integrated consultation method, which comprises the following steps:

[0056] Step S1: setting a bottom database for constructing two-dimensional engineering drawing and three-dimensional model;

[0057] Step S2: based on the underlying database, generate the two-dimensional engineering drawing to be linked, three-dimensional model, based on the elevation of the two-dimensional engineering drawing to be linked and the z-axis section corresponding to the height of the three-dimensional model, perform first alignment matching;

[0058] Step S3: based on the first alignment matching result, perform second alignment matching on the two-dimensional engineering drawing to be linked and the three-dimensional model, i.e., axis network direction matching, to realize the adjustment of the two-dimensional engineering drawing and the three-dimensional model;

[0059] Step S4: scale the adjusted two-dimensional engineering drawing and the adjusted three-dimensional model to the same standard size; obtain the real scene picture to be linked, determine the coordinate conversion relationship between the scaled two-dimensional engineering drawing and the scaled three-dimensional model; determine the front view angle of the real scene picture to be linked, and establish the mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawing; based on the coordinate conversion relationship and the mapping relationship, map the real scene picture to be linked to the scaled three-dimensional model.

[0060] In the present application, data sources in the field of intelligent construction are different, and there are three-dimensional model data, two-dimensional drawing data, panoramic real scene data, etc. The present application uses object-oriented deconstruction storage method to deeply deconstruct the three-dimensional model and the two-dimensional drawing underlying database. The present application designs a unified business database when applying multi-source heterogeneous data, and centrally stores the component-level fusion association relationship on the upper layer of the three-dimensional model and the two-dimensional drawing underlying object-oriented database.

[0061] Further, in the underlying database, the primitives, primitive identifiers, and primitive attributes used to construct two-dimensional engineering drawings are stored, the primitive attributes include primitive types, layer information, position information, parameterized geometric information, custom attributes, and primitive general attributes; wherein the layer information is used to represent the hierarchy of the primitive in the two-dimensional engineering drawing, and the position information is used to represent the position of the primitive in the two-dimensional engineering drawing. In the underlying database, the components, component identifiers, and component attributes used to construct three-dimensional models are stored, and the component attributes include geometric attributes, general attributes, and custom attributes.

[0062] In the present application, the three-dimensional model RVT, NWD, IFC, etc. data structure is parsed, stored in the library according to the component as the smallest unit, indexed by the component uid, and the geometry, attributes, custom attributes, etc. of the component are saved in the library.

[0063] The two-dimensional drawing DWG, PDF, etc. data structure is parsed, stored in the library according to the primitive as the smallest unit, indexed by the primitive id, and the primitive type, layer information, position information, parameterized geometric information, attributes, custom attributes, and axis network information are saved in the library.

[0064] The step S2, the two-dimensional engineering drawing and the three-dimensional model to be linked are generated based on the underlying database, including:

[0065] According to the actual information of the building project, the required primitives are selected from the underlying database, each primitive is instantiated, and a plurality of two-dimensional engineering drawings are generated; the required components are selected from the underlying database, each component is instantiated, and a plurality of three-dimensional models are generated; wherein, for each two-dimensional engineering drawing, its corresponding axis network and axis network information are generated, the axis network has an x-axis and a y-axis, the x-axis represents the horizontal direction of the two-dimensional engineering drawing, and the y-axis represents the vertical direction of the two-dimensional engineering drawing, and the axis network information represents the design direction and design size of the two-dimensional engineering drawing; for each three-dimensional model, its corresponding axis network and axis network information are generated, the axis network has an x-axis, a y-axis and a z-axis, the x-axis represents the horizontal direction of the cross section of the three-dimensional model, the y-axis represents the vertical direction of the cross section of the three-dimensional model, and the z-axis represents the vertical direction of the longitudinal section of the three-dimensional model, the z-axis section of the three-dimensional model corresponds to the height of the three-dimensional model, and the axis network information represents the design direction and design size of the three-dimensional model;

[0066] From the two-dimensional engineering drawings and the three-dimensional models, the two-dimensional engineering drawings and the three-dimensional models to be linked are determined;

[0067] The axis network information of the two-dimensional engineering drawings to be linked, the primitive identifiers, the primitive attributes, the connection relationships and the dependency relationships of each instantiated primitive, the axis network information of the three-dimensional models to be linked, the component identifiers, the component attributes, the connection relationships and the dependency relationships of each instantiated component are stored in the business database.

[0068] In the application, the business database stores the three-dimensional model component id, the three-dimensional space position information, the two-dimensional drawing primitive id, the two-dimensional space information and the panoramic real scene picture id by taking the association relationship unique identifier as an index, so that the parameterized storage of the linkage association relationship, the business connection of the engineering drawings, the models and the real scene is realized.

[0069] In the step S2, the two-dimensional engineering drawings and the three-dimensional models to be linked are generated based on the underlying database, and the first alignment matching is performed on the elevations of the two-dimensional engineering drawings to be linked and the z-axis sections corresponding to the heights of the three-dimensional models, which is to align the instantiated primitives of the two-dimensional engineering drawings to be linked with the three-dimensional models in the height direction.

[0070] After the first alignment matching is performed on the elevations of the two-dimensional engineering drawings to be linked and the z-axis sections corresponding to the heights of the three-dimensional models, the axis network of the three-dimensional model is reduced to two dimensions.

[0071] Step S3: based on the first alignment matching result, the second alignment matching is performed on the two-dimensional engineering drawings to be linked and the three-dimensional models in the axis network direction, so that the two-dimensional engineering drawings and the three-dimensional models are adjusted, including:

[0072] On the basis of the first alignment matching, the alignment of the two-dimensional engineering drawing and the three-dimensional model to be linked in the axial network direction is realized by rotating the two-dimensional engineering drawing to be linked or rotating the three-dimensional model to be linked, so that the two-dimensional engineering drawing and the three-dimensional model are adjusted.

[0073] The step S4: scaling the adjusted two-dimensional engineering drawing and the adjusted three-dimensional model to the same standard size, comprising:

[0074] Step S41: extracting a plurality of first feature points of the instantiated graphic elements from the adjusted two-dimensional engineering drawing; extracting a plurality of second feature points corresponding to each first feature point from the adjusted three-dimensional model;

[0075] In the present application, the original feature point P1(x1, y1, z1) extracted from the adjusted two-dimensional engineering drawing is simplified to a first feature point P(x, y), wherein x=x1, y=y1, and the value of x1 and y1 is only considered at this time because z1 has been aligned with the three-dimensional model in the first alignment matching.

[0076] Step S42: performing the following operations on each first feature point P(x, y), wherein x and y are the horizontal coordinate and the vertical coordinate of the first feature point, respectively:

[0077] Determine the horizontal number i and the vertical number j of the axial network in which the first feature point P(x, y) is located in the adjusted two-dimensional engineering drawing:

[0078]

[0079] Wherein, x n is the nth x-axis axial network of the adjusted two-dimensional engineering drawing, y m is the mth y-axis axial network of the adjusted two-dimensional engineering drawing, x i is the ith x-axis axial network of the adjusted two-dimensional engineering drawing, and y j is the jth y-axis axial network of the adjusted two-dimensional engineering drawing.

[0080] Step S43: determining the horizontal number x' and the vertical number y' of the axial network in which each second feature point is located in the adjusted three-dimensional model:

[0081]

[0082] Wherein, x′ i , y′ i are the horizontal coordinate and the vertical coordinate of the second feature point, respectively.

[0083] Step S44: based on the horizontal number and the vertical number of the axis network where each first feature point is located, the horizontal number and the vertical number of the axis network where the second feature point corresponding to each first feature point is located, the adjusted two-dimensional engineering drawing and the adjusted three-dimensional model are scaled to the same standard size.

[0084] The drawings and the model are scaled to the same standard size, and accurate alignment is achieved.

[0085] The traditional two-dimensional and three-dimensional linkage of drawings and models relies on the user to provide a reference system and a space coordinate conversion ratio. Through A(x1, y1) and B(x2, y2) on the three-dimensional unified z-axis plane provided by the user, and A'(x'1, y'1) and B'(x'2, y'2) corresponding to the A and B points on the two-dimensional drawing, the spatial coordinate correlation from three-dimensional to two-dimensional is obtained through computer-aided calculation, and the coordinates (x', y') are converted from three-dimensional (x, y)

[0086]

[0087] However, the above conversion method is not accurate in business practice. The present application provides a new ratio conversion method.

[0088] The drawing-model-real geometric accurate matching method based on the axis network can automatically correspond the standardized axis network data in the design stage to provide a reference for space coordinate conversion. This method is more accurate and more convenient than the traditional manual space reference. In the space coordinate conversion, finding the nearest axis network corresponding relationship can reduce the calculation error caused by the computer space coordinate conversion calculation truncation. The above two parts solve the problem of accurate space matching coordinate conversion of drawings and models. On this basis, the space coordinates obtained by manually associating the real scene picture with the drawing can be automatically converted between two-dimensional and three-dimensional spaces to realize one-time association and accurate matching of drawings, models and real scenes.

[0089] In the step S4, the real scene picture to be linked is obtained, and the coordinate conversion relationship between the scaled two-dimensional engineering drawing and the scaled three-dimensional model is determined. The front view angle of the real scene picture to be linked is determined, and the mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawing is established. Based on the coordinate conversion relationship and the mapping relationship, the real scene picture to be linked is mapped onto the scaled three-dimensional model, including:

[0090] The real scene picture to be linked is obtained, and the real scene picture is a real scene picture of a construction site.

[0091] determining a coordinate conversion relationship between the two-dimensional engineering drawing paper and the three-dimensional model scaled to the same standard size; taking a normal view angle of the real scene picture to be linked as a normal view angle, selecting a matching point pair composed of the normal view angle of the real scene picture to be linked and the scaled two-dimensional engineering drawing paper, and establishing a vector expression of the normal view angle of the real scene picture to be linked on the scaled two-dimensional engineering drawing paper according to the coordinates of each point in the point pair:

[0092]

[0093] a represents the coordinate of the point on the real scene picture to be linked in the point pair on the scaled two-dimensional engineering drawing paper, and a' represents the coordinate of the point on the scaled two-dimensional engineering drawing paper in the point pair on the real scene picture to be linked;

[0094] based on the vector expression, determining a mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawing paper;

[0095] based on the mapping relationship, determining the coordinates and elevations of feature points in the real scene picture to be linked on the scaled two-dimensional drawing paper, and then based on the coordinate conversion relationship, mapping the real scene picture to be linked to the scaled three-dimensional model.

[0096] In the present application, based on the third alignment matching result, the coordinate conversion relationship between the adjusted two-dimensional engineering drawing paper and the adjusted three-dimensional model is established, and in the display interface of a specific software system, the view of the corresponding point in the three-dimensional model or the two-dimensional engineering drawing paper corresponding to any point in the two-dimensional engineering drawing paper or the three-dimensional model can be displayed simultaneously. On the basis of being able to determine the mapping relationship between the real scene picture to be linked and the adjusted two-dimensional engineering drawing paper to be linked, the coordinate and view angle linkage between the real scene picture to be linked and the two-dimensional engineering drawing paper is established, that is, by clicking the real scene picture associated coordinate point on the two-dimensional drawing paper, the two-dimensional engineering drawing paper and the real scene picture can be automatically displayed on the same screen, the two-dimensional engineering drawing paper is automatically zoomed in to the real scene picture associated point and the current panorama view angle direction is displayed on the two-dimensional engineering drawing paper. Based on the coordinate conversion relationship, the established coordinate and view angle relationship linkage between the real scene picture and the two-dimensional engineering drawing paper is automatically mapped to the three-dimensional model.

[0097] Through the coordinate conversion relationship between the two-dimensional engineering drawing paper and the three-dimensional model created before, the coordinate of the real scene picture on the two-dimensional drawing paper is converted into the camera position coordinate in the three-dimensional model, and an identifier is automatically added. The vector expression of the normal view angle of the real scene picture on the two-dimensional drawing paper is converted into a three-dimensional vector of the camera observation direction. The upward direction of the corresponding camera of the real scene picture in the three-dimensional model is the z axis.

[0098] The three-dimensional coordinate table of the linked three-dimensional model is used to express the camera position, camera observation direction and camera upward direction of the real scene picture, that is, the corresponding relationship between the view angle of the real scene picture to be linked and the observation camera view port of the linked three-dimensional model is determined, and according to the corresponding relationship, the linkage of the view angle between the real scene picture to be linked and the linked three-dimensional model is established, and in the display interface of a specific software system, the operation rotation of any point in the real scene picture to be linked or the three-dimensional model can be simultaneously reproduced.

[0099] Further, the linked two-dimensional engineering drawing and the three-dimensional model are established in the same scaling, that is, when the linked two-dimensional engineering drawing and the three-dimensional model are displayed on the same screen, the linked two-dimensional engineering drawing and the three-dimensional model are scaled to the same scale, so that when any one of the linked two-dimensional engineering drawing and the three-dimensional model is moved, the other one is synchronously moved in the same direction and relative displacement.

[0100] In the present application, the axis network matching of the drawing and the model has been realized in the graph-model-real accurate data matching of the second part, which makes the x and y axis positive directions of the drawing and the model be associated and matched. When the two-dimensional and three-dimensional drawings are displayed on the same screen, the two-dimensional and three-dimensional drawings are automatically scaled to the same scale according to the axis network, and when one of the drawing and the model is moved, the other one is synchronously moved in the same way. When the three-dimensional drawing is moved by Δx and Δy, the proportional relationship between the two-dimensional drawing moved by Δx' and Δy' is:

[0101]

[0102] When the drawing-real scene linkage operation is performed, the alignment of the z axis positive direction and the vector coordinate expression of the initial view angle positive direction set by the user when the drawing and the real scene are associated is used to realize the association of the z axis view angle turning of the drawing and the z axis turning of the panorama. When the drawing-real scene linkage operation is performed, the association relationship of the x axis turning and the y axis turning is ignored.

[0103] When the model-real scene linkage operation is performed, the vector coordinate expression of the z axis positive direction alignment and the initial view angle positive direction obtained by the drawing-real scene linkage operation, and the x and y axis network alignment obtained by the drawing-model linkage operation are used to realize the association relationship of the x, y and z three-axis turning angles of the model drawing.

[0104] Further, the method comprises the step S5 of checking the linked two-dimensional engineering drawing, the three-dimensional model and the real scene picture.

[0105] As Figure 2 shown, the present application further provides an engineering drawing, three-dimensional model and real scene picture linkage and integrated checking device, which comprises:

[0106] A bottom layer construction module configured to set a bottom layer database for setting up a two-dimensional engineering drawing and a three-dimensional model;

[0107] A first alignment module configured to generate the two-dimensional engineering drawing and the three-dimensional model to be linked based on the bottom layer database, and perform a first alignment matching based on the elevation of the two-dimensional engineering drawing to be linked and the z-axis profile corresponding to the height of the three-dimensional model;

[0108] A second alignment module configured to perform a second alignment matching, i.e. a grid direction matching, on the two-dimensional engineering drawing and the three-dimensional model to be linked based on the first alignment matching result, so as to realize the adjustment of the two-dimensional engineering drawing and the three-dimensional model;

[0109] A linkage module configured to scale the adjusted two-dimensional engineering drawing and the adjusted three-dimensional model to the same standard size, acquire a real scene picture to be linked, determine the coordinate conversion relationship between the scaled two-dimensional engineering drawing and the scaled three-dimensional model, determine the front view angle of the real scene picture to be linked, establish the mapping relationship between the real scene picture to be linked and the scaled two-dimensional engineering drawing, and map the real scene picture to be linked to the scaled three-dimensional model based on the coordinate conversion relationship and the mapping relationship.

[0110] The specific embodiments above only describe the design principles of the present application, and the shapes and names of the components in the description can be different and are not limited. Therefore, the skilled in the art of the present application can modify or equivalently replace the technical solutions described in the foregoing embodiments; and these modifications and replacements do not deviate from the purpose and technical solutions of the present application, and should all belong to the protection scope of the present application.

Claims

1. A method for linking and integrating engineering drawings, 3D models, and real-scene images for viewing, characterized in that, include: Step S1: Set up the underlying database for building 2D engineering drawings and 3D models; Step S2: Generate the two-dimensional engineering drawings and three-dimensional models to be linked based on the underlying database, and perform the first alignment and matching based on the elevation of the two-dimensional engineering drawings and the z-axis section of the three-dimensional model corresponding to the height. Step S3: Based on the first alignment and matching result, perform a second alignment and matching on the two-dimensional engineering drawings and three-dimensional models to be linked, namely, axis grid direction matching, to achieve the adjustment of the two-dimensional engineering drawings and three-dimensional models; Step S4: Scale the adjusted 2D engineering drawings and the adjusted 3D model to the same standard scale; obtain the real-world image to be linked, and determine the coordinate transformation relationship between the scaled 2D engineering drawings and the scaled 3D model; Determine the frontal view of the real-world image to be linked, and establish the mapping relationship between the real-world image to be linked and the scaled-up two-dimensional engineering drawing; Based on the coordinate transformation relationship and the mapping relationship, the real-world image to be linked is mapped onto the scaled 3D model; Step S4: Scaling the adjusted 2D engineering drawings and the adjusted 3D model to the same standard scale includes: Step S41: Extract first feature points of several instantiated primitives from the adjusted 2D engineering drawing; Extract second feature points corresponding to each first feature point from the adjusted 3D model; Step S42: Perform the following operation for each first feature point P(x,y), where x and y are the x-coordinate and y-coordinate of the first feature point, respectively: Determine the horizontal grid number i and vertical grid number j of the first feature point P(x,y) in the adjusted 2D engineering drawing: Where, x n For the nth x-axis grid in the adjusted 2D engineering drawing, y m To determine the m-th y-axis grid in the adjusted 2D engineering drawing, x i For the i-th x-axis grid in the adjusted 2D engineering drawing, y j This refers to the j-th y-axis grid in the adjusted 2D engineering drawing; Step S43: Determine the horizontal grid number x' and vertical grid number y' of each second feature point in the adjusted 3D model: in, , These are the x and y coordinates of the second feature point, respectively. Step S44: Based on the horizontal and vertical numbers of the grid where each first feature point is located, and the horizontal and vertical numbers of the grid where the second feature point corresponding to each first feature point is located, scale the adjusted two-dimensional engineering drawing and the adjusted three-dimensional model to the same standard scale.

2. The method as described in claim 1, characterized in that, The underlying database stores primitives, primitive identifiers, and primitive attributes used to construct two-dimensional engineering drawings. The primitive attributes include primitive type, layer information, location information, parametric geometric information, custom attributes, and general primitive attributes. Layer information indicates the hierarchy of the primitive in the two-dimensional engineering drawing, and location information indicates the position of the primitive in the two-dimensional engineering drawing. The underlying database also stores components, component identifiers, and component attributes used to construct three-dimensional models. The component attributes include geometric attributes, general attributes, and custom attributes.

3. The method as described in claim 2, characterized in that, The generation of 2D engineering drawings and 3D models to be linked based on the underlying database includes: Based on the actual information of the construction project, the required graphic elements are selected from the underlying database, and each graphic element is instantiated to generate several two-dimensional engineering drawings; the required components are selected from the underlying database, and each component is instantiated to generate several three-dimensional models; wherein, for each two-dimensional engineering drawing, a corresponding grid and grid information are generated, the grid has an x-axis and a y-axis, the x-axis represents the horizontal direction of the two-dimensional engineering drawing, the y-axis represents the vertical direction of the two-dimensional engineering drawing, and the grid information represents the design direction and design dimensions of the two-dimensional engineering drawing; for each three-dimensional model, a corresponding grid and grid information are generated, the grid has an x-axis, a y-axis, and a z-axis, the x-axis represents the horizontal direction of the cross section of the three-dimensional model, the y-axis represents the vertical direction of the cross section of the three-dimensional model, the z-axis section of the three-dimensional model corresponds to the height of the three-dimensional model, and the grid information represents the design direction and design dimensions of the three-dimensional model; From the aforementioned two-dimensional engineering drawings and three-dimensional models, determine the two-dimensional engineering drawings and three-dimensional models to be linked. The grid information of the two-dimensional engineering drawing to be linked, the element identifier, element attribute, connection relationship and dependency relationship of each instantiated element, and the grid information of the three-dimensional model to be linked, the component identifier, component attribute, connection relationship and dependency relationship of each instantiated component are stored in the business database.

4. The method as described in claim 3, characterized in that, In step S4, the real-world image to be linked is obtained, and the coordinate transformation relationship between the scaled-up 2D engineering drawing and the scaled-up 3D model is determined; the orthogonal view of the real-world image to be linked is determined, and the mapping relationship between the real-world image to be linked and the scaled-up 2D engineering drawing is established. Based on the coordinate transformation relationship and the mapping relationship, the real-world image to be linked is mapped onto the scaled 3D model, including: Obtain the real-scene image to be linked, wherein the real-scene image is a real-scene image of the construction site; Determine the coordinate transformation relationship between 2D engineering drawings and 3D models scaled to the same standard scale; take the initial positive direction of the panoramic view of the real-scene image to be linked as the positive viewpoint, select matching points in the scaled 2D engineering drawings and the real-scene image to be linked to form point pairs, and establish the vector representation of the positive viewpoint of the real-scene image to be linked on the scaled 2D engineering drawings based on the coordinates of each point in the point pair: a represents the coordinates of a point on the real-world image to be linked in the point-to-point pair on the scaled-up 2D engineering drawing, and a' represents the coordinates of a point on the scaled-up 2D engineering drawing on the real-world image to be linked. Based on this vector representation, the mapping relationship between the real-world image to be linked and the scaled-up two-dimensional engineering drawing is determined; Based on the mapping relationship, the coordinates and elevations of the feature points in the real-world image to be linked are determined on the scaled 2D drawing. Then, based on the coordinate transformation relationship, the real-world image to be linked is mapped onto the scaled 3D model.

5. A device for linking and integrating engineering drawings, 3D models, and real-scene images for executing the method described in any one of claims 1-4, characterized in that, include: Underlying building blocks: Configured to set up the underlying database for building 2D engineering drawings and 3D models; The first alignment module is configured to generate two-dimensional engineering drawings and three-dimensional models to be linked based on the underlying database, and perform the first alignment matching based on the elevation of the two-dimensional engineering drawings to be linked and the z-axis section of the three-dimensional model corresponding to the height. The second alignment module is configured to perform a second alignment match on the two-dimensional engineering drawings and three-dimensional models to be linked, based on the results of the first alignment match, namely, axis grid direction matching, so as to realize the adjustment of the two-dimensional engineering drawings and three-dimensional models. Linkage module: Configured to scale the adjusted 2D engineering drawings and the adjusted 3D model to the same standard scale; acquire the real-world image to be linked, and determine the coordinate transformation relationship between the scaled 2D engineering drawings and the scaled 3D model; Determine the frontal view of the real-world image to be linked, and establish the mapping relationship between the real-world image to be linked and the scaled-up two-dimensional engineering drawing; Based on the coordinate transformation relationship and the mapping relationship, the real-world image to be linked is mapped onto the scaled 3D model.

6. A computer-readable storage medium storing a plurality of instructions; the plurality of instructions being loaded by a processor and executing the method as claimed in any one of claims 1-4.

7. An electronic device, characterized in that, The electronic device includes: A processor is used to execute multiple instructions; Memory, used to store multiple instructions; The plurality of instructions are to be stored in the memory and loaded by the processor and executed as described in any one of claims 1-4.

Images