Building visualization method and device based on BIM and AR, and medium

Abstract

The invention provides a building visualization method and device based on BIM and AR, and a medium, and relates to the technical field of constructions.The method comprises the steps that a real scene image, collected by a mobile device, in a target building is obtained, a target two-dimensional code in the real scene image is obtained, the storage position of a target BIM model in a preset BIM model database is obtained, and the storage position of the target BIM model in the preset BIM model database is obtained; obtaining the target BIM model and the position of the mobile terminal based on the storage position of the target BIM model in the preset BIM model database, and obtaining a relative adjustment factor list of the target two-dimensional code and the mobile device based on the position information of the mobile terminal and the target two-dimensional code in the real scene; and loading the target BIM model to the mobile terminal based on the relative adjustment factor list, the target two-dimensional code position and the relative position relationship of the target BIM model, so that the target BIM model is more accurately matched with the real scene of the target building.

Description

Technical Field

[0001] The present invention relates to the field of building technology, and in particular to a building visualization method, equipment and medium based on BIM and AR. Background Art

[0002] As construction projects continue to expand in scale and become more complex, traditional two-dimensional drawings and management tools can no longer meet the needs of modern engineering. Although the application of BIM technology has brought significant advantages to project management, its visualization capabilities and real-time interactivity in actual construction are limited. AR technology provides a more intuitive and interactive display method by superimposing virtual information on the real environment, which helps to solve the shortcomings of traditional BIM technology in practical applications. However, there is currently no system on the market that integrates BIM and AR technology to meet the efficient management needs of large and complex engineering projects.

[0003] Although existing BIM technology can provide a three-dimensional model of a project, this visualization effect is limited to display on a computer screen and cannot achieve a realistic display at the construction site. Summary of the invention

[0004] In view of the above technical problems, the technical solution adopted by the present invention is: a building visualization method based on BIM and AR, the method comprising the following steps:

[0005] Acquire a real scene image of a target building captured by a mobile device, identify the real scene image, and acquire a target QR code in the real scene image; wherein the target QR code is a QR code set at a key position of the target building and the information corresponding to the target QR code at least includes the position information of the target QR code in the real scene, the storage position of the target BIM model in a preset BIM model database, and the relative position relationship between the position of the target QR code in the real scene and the target BIM model;

[0006] Using the AR application engine of the mobile terminal to identify the target QR code, obtain the storage location of the target BIM model in the preset BIM model database, and obtain the target BIM model based on the storage location of the target BIM model in the preset BIM model database;

[0007] Obtaining the position of the mobile terminal, and based on the position of the mobile terminal and the position information of the target two-dimensional code in the real scene, obtaining a relative adjustment factor list of the target two-dimensional code and the mobile device, wherein the relative adjustment factor list includes: the conversion ratio of the position of the target two-dimensional code in the real scene relative to the position of the mobile terminal in the X-axis, Y-axis, and Z-axis of the preset three-dimensional space coordinate system;

[0008] Based on the relative adjustment factor list, the position of the target QR code in the real scene and the relative position relationship of the target BIM model, the target BIM model is loaded into the mobile terminal;

[0009] Obtaining an input instruction from a user, parsing the input instruction, obtaining a target component and a target operation to be performed on the target component, and performing the target operation on the target component of the target BIM model if the target operation belongs to a preset operation list, wherein the preset operation list includes a plurality of specified operations to be performed on the components of the BIM model;

[0010] If the target operation does not belong to the preset operation list, obtain the preset response statement and return the preset response statement to the user.

[0011] According to another aspect of the present invention, a non-transitory computer-readable storage medium is provided, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the aforementioned method.

[0012] According to yet another aspect of the present invention, an electronic device is provided, comprising a processor and the aforementioned non-transitory computer-readable storage medium.

[0013] The present invention has at least the following beneficial effects: In summary, a real scene image in a target building captured by a mobile device is obtained, the real scene image is recognized, a target QR code in the real scene image is obtained, the target QR code is recognized using an AR application engine of a mobile terminal, a storage location of a target BIM model in a preset BIM model database is obtained, and based on the storage location of the target BIM model in the preset BIM model database, the target BIM model is obtained, the location of the mobile terminal is obtained, and based on the location information of the mobile terminal location and the target QR code in the real scene, a relative adjustment factor list of the target QR code and the mobile device is obtained, and based on the relative adjustment factor list, the target The relative position relationship between the QR code position and the target BIM model, the target BIM model is loaded into the mobile terminal, the user's input command is obtained, the input command is parsed, the target component and the target operation performed on the target component are obtained, if the target operation belongs to the preset operation list, the target operation is performed on the target component of the target BIM model, if the target operation does not belong to the preset operation list, a preset reply statement is obtained, and the preset reply statement is returned to the user. The present invention obtains the relative adjustment factor to make the target BIM model more accurately matched with the real scene of the target building. The present invention combines BIM and AR technology to enable construction personnel to view the BIM model more realistically in a real environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0015] Figure 1 A flowchart of a building visualization method based on BIM and AR provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0016] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0017] The embodiment of the present invention provides a building visualization method based on BIM and AR, such as Figure 1 As shown, the method comprises the following steps:

[0018] S100, obtaining a real scene image in a target building captured by a mobile device, identifying the real scene image, and obtaining a target QR code in the real scene image.

[0019] Among them, the target QR code is a QR code set at a key position of the target building and the information corresponding to the target QR code at least includes the position information of the target QR code in the real scene, the storage position of the target BIM model in the preset BIM model database, and the relative position relationship between the position of the target QR code in the real scene and the target BIM model.

[0020] Specifically, the location information of the target two-dimensional code in the real scene can be represented by longitude and latitude.

[0021] Specifically, according to the target BIM model of the project, a target QR code corresponding to each key position or node is generated through the background management system. The target QR code can be printed or displayed on the site sign for on-site use.

[0022] S200, using the AR application engine of the mobile terminal to identify the target QR code, obtain the storage location of the target BIM model in the preset BIM model database, and obtain the target BIM model based on the storage location of the target BIM model in the preset BIM model database.

[0023] S300, obtain the position of the mobile terminal, and based on the position information of the mobile terminal and the target QR code in the real scene, obtain a relative adjustment factor list of the target QR code and the mobile device, wherein the relative adjustment factor list includes: the conversion ratio of the position of the target QR code in the real scene relative to the position of the mobile terminal in the X-axis, Y-axis, and Z-axis of the preset three-dimensional space coordinate system.

[0024] It can be understood that the target BIM model obtained by the AR application engine by scanning the target QR code is stored based on the position of the target QR code. When the mobile device is used as the base point, a coordinate conversion is required. The relative adjustment factor can be understood as the relative position relationship between the target QR code and the mobile device.

[0025] Specifically, those skilled in the art know that any method for obtaining a relative adjustment factor based on position information in the prior art falls within the protection scope of the present invention. In one embodiment of the present invention, an image containing a QR code is captured by a camera of a mobile device, and feature points of the QR code in the image and feature points of the surrounding environment are extracted and matched with the known position information of the QR code in the world coordinate system. The matching relationship of these feature points is combined with a posture estimation algorithm in computer vision, such as the PnP (Perspective-n-Point) algorithm, to calculate the posture of the mobile device relative to the QR code, including the rotation angle and the translation vector, so as to determine the relative position relationship between the two.

[0026] S400, based on the relative adjustment factor list, the position of the target QR code in the real scene and the relative position relationship of the target BIM model, the target BIM model is loaded into the mobile terminal.

[0027] Specifically, based on the relative adjustment factor list, the relative position relationship between the target QR code position and the target BIM model, the relative position relationship between the mobile device and the target BIM model is obtained, the coordinate points of the target BIM model are adjusted, and the target BIM model with adjusted coordinate points is loaded into the mobile terminal to achieve alignment of the target BIM model with the real scene in the target building at the coordinate points.

[0028] S500, obtaining the user's input instruction, parsing the input instruction, obtaining the target component and the target operation to be performed on the target component, and if the target operation belongs to a preset operation list, performing the target operation on the target component of the target BIM model, wherein the preset operation list includes several specified operations to be performed on the components of the BIM model.

[0029] S600: If the target operation does not belong to the preset operation list, obtain a preset reply statement and return the preset reply statement to the user. Specifically, the preset reply statement is: Your input instruction does not meet the requirements, please re-enter!

[0030] In summary, a real scene image of a target building captured by a mobile device is obtained, the real scene image is recognized, a target QR code in the real scene image is obtained, the target QR code is recognized by using an AR application engine of a mobile terminal, the storage location of a target BIM model in a preset BIM model database is obtained, and based on the storage location of the target BIM model in the preset BIM model database, the target BIM model is obtained, the location of the mobile terminal is obtained, and based on the location information of the mobile terminal location and the target QR code in the real scene, a relative adjustment factor list of the target QR code and the mobile device is obtained, and based on the relative adjustment factor list, the location of the target QR code and the target The relative position relationship of the target BIM model is obtained, the target BIM model is loaded into the mobile terminal, the user's input command is obtained, the input command is parsed, the target component and the target operation performed on the target component are obtained, if the target operation belongs to the preset operation list, the target operation is performed on the target component of the target BIM model, if the target operation does not belong to the preset operation list, a preset reply statement is obtained, and the preset reply statement is returned to the user. The present invention obtains the relative adjustment factor to make the target BIM model more accurately matched with the real scene of the target building. The present invention combines BIM and AR technology to enable construction personnel to view the BIM model more realistically in a real environment.

[0031] Specifically, the specified operation includes: scaling, transparency adjustment. Further, the transparency is adjusted by means of a slider. The user can scale the model in equal proportion or adjust the scale by a custom ratio so as to highlight the key areas in the display. At the same time, by adjusting the transparency of the model, the user can choose to view the structural details inside the model. The present invention also includes: the user can adjust the viewing angle and the scaling ratio through touch operation to view the details of the model.

[0032] Furthermore, after the target BIM model is loaded into the mobile terminal, the method further includes:

[0033] When receiving a command from a user to click on a component of the target BIM model, the relevant data of the component corresponding to the target BIM model is displayed. Specifically, the relevant data includes: component name, construction image corresponding to the component. When a user clicks on a component in the target BIM model, the on-site photos or videos associated with the component will be displayed to help the user more intuitively understand the actual status and location of the component. This function is achieved by pre-binding the model and on-site picture data in the background management system.

[0034] Furthermore, after loading the target BIM model into the mobile terminal, the user can use the gyroscope and positioning system of the mobile device to merge the target BIM model with the real scene in the target building. Specifically, the user can walk on the construction site through the device and view the effect of the virtual model superimposed on the real scene in real time. The scale and position of the model are completely consistent with the actual situation on site.

[0035] Furthermore, after the target BIM model is loaded into the mobile terminal, the method further includes:

[0036] When receiving a user click on a designated part of the target BIM model, the virtual exhibition hall information of the target building is displayed to the user, and the virtual exhibition hall information at least includes: construction process video. The construction process video includes conventional construction process videos such as template support and dismantling, steel bar binding, and concrete pouring. Specifically, the user can scale the model and adjust the transparency through touch operation to view different stages of the construction process.

[0037] Furthermore, before obtaining the target BIM model, it also includes:

[0038] Import the construction plan of the target building into the preset BIM model database and associate it with the target BIM model. Users can dynamically display the model status at each stage of the construction process by dragging the progress axis, and users can view the comparison between the plan and the actual progress in real time. Users scan the QR code on site with their mobile devices, and the system will load the AR model in the current construction state and compare it with the actual construction entity, helping users to promptly discover progress deviations and record feedback to the backend management system.

[0039] Compared with the prior art, the invention enhances visualization and progress control: by integrating BIM and AR technology, the invention can realize real-time three-dimensional model display at the construction site, and dynamically associate the construction plan with the actual progress, ensuring that managers can timely discover and correct progress deviations, effectively improving construction accuracy and efficiency. Optimize construction disclosure and resource allocation: the invention simplifies the construction disclosure process of complex nodes, uses AR technology to intuitively display construction steps, and reduces construction errors. At the same time, the system can dynamically adjust resource allocation according to real-time progress, optimize resource utilization, and reduce project costs. Improve system integration and data sharing: through the integration of the background management system, the invention realizes data sharing and collaborative work among various functional modules, eliminates the phenomenon of information islands, enhances the collaboration efficiency among multi-professional teams, and improves the overall project management efficiency. Improve safety and user experience: through real-time AR display and construction disclosure, the invention improves the safety management level of the construction site, and through intuitive and easy-to-use user interface design, enhances user experience and system operability, greatly improving the convenience and safety of project management. Through the innovative integrated application of BIM and AR technology, the present invention comprehensively improves the visualization, accuracy, efficiency and safety of engineering project management, and provides a solid technical guarantee for the successful implementation of complex projects.

[0040] An embodiment of the present invention also provides a non-transitory computer-readable storage medium, which can be set in an electronic device to store at least one instruction or at least one program related to implementing a method in a method embodiment. The at least one instruction or the at least one program is loaded and executed by the processor to implement the method provided in the above embodiment.

[0041] An embodiment of the present invention further provides an electronic device, comprising a processor and the aforementioned non-transitory computer-readable storage medium.

[0042] Although some specific embodiments of the present invention have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are only for illustration, not for limiting the scope of the present invention. It should also be understood by those skilled in the art that various modifications may be made to the embodiments without departing from the scope and spirit of the present invention.

Claims

1. A building visualization method based on BIM and AR, characterized in that: The method comprises the following steps: Acquire a real scene image of a target building captured by a mobile device, identify the real scene image, and acquire a target QR code in the real scene image; wherein the target QR code is a QR code set at a key position of the target building and the information corresponding to the target QR code at least includes the position information of the target QR code in the real scene, the storage position of the target BIM model in a preset BIM model database, and the relative position relationship between the position of the target QR code in the real scene and the target BIM model; Using the AR application engine of the mobile terminal to identify the target QR code, obtain the storage location of the target BIM model in the preset BIM model database, and obtain the target BIM model based on the storage location of the target BIM model in the preset BIM model database; Obtaining the position of the mobile terminal, and based on the position of the mobile terminal and the position information of the target two-dimensional code in the real scene, obtaining a relative adjustment factor list of the target two-dimensional code and the mobile device, wherein the relative adjustment factor list includes: the conversion ratio of the position of the target two-dimensional code in the real scene relative to the position of the mobile terminal in the X-axis, Y-axis, and Z-axis of the preset three-dimensional space coordinate system; Based on the relative adjustment factor list, the position of the target QR code in the real scene and the relative position relationship of the target BIM model, the target BIM model is loaded into the mobile terminal; Obtaining an input instruction from a user, parsing the input instruction, obtaining a target component and a target operation to be performed on the target component, and performing the target operation on the target component of the target BIM model if the target operation belongs to a preset operation list, wherein the preset operation list includes a plurality of specified operations to be performed on the components of the BIM model; If the target operation does not belong to the preset operation list, obtain the preset response statement and return the preset response statement to the user.

2. The architectural visualization method based on BIM and AR according to claim 1, characterized in that: The specified operation includes: scaling and transparency adjustment.

3. The architectural visualization method based on BIM and AR according to claim 2, characterized in that: Adjust the transparency using the slider.

4. The architectural visualization method based on BIM and AR according to claim 1, characterized in that: After the target BIM model is loaded into the mobile terminal, it also includes: When receiving a user's instruction to click on a component of a target BIM model, relevant data of the component corresponding to the target BIM model is displayed.

5. The architectural visualization method based on BIM and AR according to claim 4, characterized in that: The relevant data include: component name and construction image corresponding to the component.

6. The architectural visualization method based on BIM and AR according to claim 1, characterized in that: Loading the target BIM model into the mobile terminal also includes: the user integrates the target BIM model with the real scene in the target building through the gyroscope and positioning system of the mobile device.

7. The architectural visualization method based on BIM and AR according to claim 1, characterized in that: After the target BIM model is loaded into the mobile terminal, it also includes: When receiving a signal from a user that a designated part of the target BIM model is clicked, the virtual exhibition hall information of the target building is displayed to the user, and the virtual exhibition hall information at least includes: a construction process video.

8. The architectural visualization method based on BIM and AR according to claim 1, characterized in that: Before obtaining the target BIM model, it also includes: Import the construction plan of the target building into the preset BIM model database and associate it with the target BIM model.

9. A non-transitory computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium, characterized in that: The at least one instruction or the at least one program is loaded and executed by the processor to implement the BIM and AR-based architectural visualization method as described in any one of claims 1 to 8.

10. An electronic device, characterized in that: The invention comprises a processor and the non-transitory computer-readable storage medium as claimed in claim 9.

Images