Mixed reality-based building construction method, system, and storage medium

Abstract

A mixed reality-based building construction method, a system, and a storage medium. The method comprises the steps of: establishing a virtual three-dimensional digital model corresponding to a real building site, wherein the three-dimensional digital model comprises engineering construction information; performing real-time mapping and synchronization on a real state of the real building site and the three-dimensional digital model to form a digital twin model; converting the digital twin model into a three-dimensional scene, wherein the three-dimensional scene is used in a mixed reality environment; and visually presenting the three-dimensional scene in the real building site by means of a mixed reality device.

Description

A mixed reality building construction method, system, and storage medium Technical Field

[0001] This application relates to the field of building engineering technology, and in particular to a mixed reality building construction method, system and storage medium. Background Technology

[0002] Intelligent construction technology involves the entire lifecycle of building projects, mainly including four modules: intelligent planning and design, intelligent production, intelligent construction, and intelligent operation and maintenance services. With the development of intelligent technologies, intelligent construction is gradually taking shape in the construction field. However, the existing level of intelligent building technology is relatively backward, lacking independent core technologies, with an incomplete technical system, high dependence on imported advanced equipment, and a shortage of industry talent.

[0003] Current construction technologies often rely on 2D or 3D floor plans for architectural design, making it difficult to fully showcase the building's details and performance. This can lead to discrepancies between the design and the actual construction, causing delays and cost overruns. Furthermore, the lack of effective monitoring during construction results in errors and delays in information transmission. This makes it difficult to guarantee construction quality and to promptly identify and resolve problems.

[0004] Therefore, existing technologies still need to be improved and developed.

[0005] Summary of the Invention

[0006] In view of the shortcomings of the prior art, the purpose of this application is to provide a mixed reality building construction method, system and storage medium, which solves the problems of large gap between design and actual construction, and error and delay in the transmission of construction information in the prior art.

[0007] On the one hand, this application provides a mixed reality building construction method, wherein the method includes the following steps:

[0008] Establish a virtual three-dimensional digital model corresponding to the real construction site, wherein the three-dimensional digital model includes engineering construction information;

[0009] The real-world state of a construction site is mapped and synchronized with a 3D digital model in real time to form a digital twin model;

[0010] The digital twin model is converted into a 3D scene, which is then used in a mixed reality environment.

[0011] Mixed reality devices are used to visually represent 3D scenes on real construction sites.

[0012] Optionally, in the step of real-time mapping and synchronization between the actual state of the construction site and the 3D digital model:

[0013] Real-time monitoring of environmental data at real-world construction sites using sensor networks;

[0014] Obtain the location information of construction equipment and personnel within a real construction site;

[0015] Environmental data and location information are transmitted to a three-dimensional digital model in real time to obtain a digital twin model that provides real-time perception of the actual construction site status.

[0016] Optionally, in the step of mapping and synchronizing the actual state of the real construction site with the three-dimensional digital model in real time to form a digital twin model:

[0017] The virtual-real registration algorithm aligns the 3D digital model with the real construction site.

[0018] Optionally, in the step of visually representing a 3D scene using a mixed reality device:

[0019] By using simultaneous localization and mapping algorithms, autonomous navigation and positioning of mixed reality devices can be achieved within real construction sites.

[0020] Visual recognition algorithms are used to integrate 3D scenes with real-world construction sites.

[0021] Optionally, in the step of converting the digital twin model into a 3D scene:

[0022] Data exchange protocols enable real-time synchronization of data between 3D digital models, digital twin models, and 3D scenes.

[0023] Optionally, after the step of visually representing the 3D scene in a real construction site using mixed reality devices, the following steps are included:

[0024] Based on the process information in the 3D digital model and the actual conditions of the construction site, a construction process guidance plan is generated.

[0025] Optionally, in the step of generating a construction process guidance plan based on the process information in the 3D digital model and the actual conditions of the real construction site:

[0026] By using cloud computing and big data technologies, data on the actual state of real construction sites is stored, analyzed, and mined to generate construction process guidance data.

[0027] Optionally, after the step of generating a construction process guidance scheme based on the process information in the 3D digital model and data on the actual state of the real construction site, the following may also be included:

[0028] The interactive features of mixed reality devices enable the visualization and real-time adjustment of construction process guidance plans.

[0029] On the other hand, this application also proposes a mixed reality building construction system, which includes mixed reality devices, a sensor network, and a processor;

[0030] Real-time data on the actual state of a real construction site is acquired through sensor networks;

[0031] The processor uses real-time data and performs mixed reality building construction as described above, and then uses mixed reality devices to present the visuals.

[0032] Thirdly, this application also proposes a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, which can be executed by one or more processors to realize the mixed reality building construction method as described above.

[0033] Beneficial Effects: This application discloses a mixed reality construction method, system, and storage medium that simulates the building's performance under different conditions by constructing a detailed 3D digital model of the construction site (building). This allows designers to gain a more comprehensive understanding of the construction site's condition, enabling more accurate design decisions, reducing the gap between design and actual construction, and thus improving the consistency between design and construction. Real-time mapping and synchronization of the actual construction site's state with the 3D digital model, combined with mixed reality technology, creates a digital twin that allows for real-time updates of the 3D digital model, facilitating collaborative design and construction. This helps reduce unnecessary communication costs, promptly identify and resolve problems, and improve the precision and efficiency of construction management. Using a digital twin model combined with mixed reality for visual presentation provides scientific data support and decision-making basis for operation and maintenance. By monitoring and analyzing the building's performance and condition in real time, potential problems can be predicted in advance, allowing for preventative maintenance and reducing operation and maintenance costs. The digital twin model can monitor and analyze the building's energy consumption data in real time, helping managers understand the building's energy consumption and take corresponding energy-saving measures. This helps reduce energy costs and environmental impact. Therefore, using digital twin models combined with mixed reality for visual presentation can overcome the shortcomings of existing technologies, improve the efficiency and quality of building construction, reduce costs and energy consumption, and bring more intelligent and sustainable solutions to the construction industry. Attached Figure Description

[0034] Figure 1 is a flowchart of the main steps of a mixed reality building construction method according to an embodiment of this application;

[0035] Figure 2 is a flowchart illustrating the detailed steps of a mixed reality building construction method according to an embodiment of this application. Detailed Implementation

[0036] To make the objectives, technical solutions, and advantages of this application clearer and more explicit, the following detailed description of this application is provided with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0037] In existing technologies, not only are construction sites difficult to supervise, leading to significant discrepancies between design and actual construction, and imprecise construction management, but building operation and management also lack scientific data support and decision-making basis. This results in low operation and maintenance efficiency, making it difficult to monitor and predict building performance and status in real time, thus causing difficulties in building construction, operation, and maintenance. In addition, building energy consumption is difficult to monitor and control, causing energy waste and environmental pressure. The lack of effective energy consumption management means that buildings may face significant energy costs during long-term use, thus leading to uncontrollable energy consumption problems.

[0038] To address the aforementioned issues in the construction process, this embodiment combines digital twin technology based on three-dimensional digital model (BIM) with mixed reality technology to construct a comprehensive model and technical framework for complex process guidance driven by digital twins. It proposes a mixed reality construction method based on BIM-Unity3D-HoloLens to improve construction site environment perception, data information interaction, virtual-real registration fusion, and construction process guidance, thereby solving the problems mentioned above in the existing technology.

[0039] The technologies involved in a mixed reality building construction method in this embodiment are described below:

[0040] Digital twin technology: Digital twin technology is a technology that connects a physical entity (such as a building or equipment) with its digital model. Through real-time data exchange and simulation, information such as the actual operating status, performance, and behavior patterns are reflected in the digital model, thereby enabling the monitoring, analysis, optimization, and prediction of the physical entity.

[0041] Mixed Reality (MRT) technology is a technology that merges the real and virtual worlds. It can present virtual information in physical space, providing users with a more intuitive and vivid interactive experience. In the field of architectural construction, MRT technology can be combined with digital twin technology to build a digital twin-driven mixed reality architectural construction guidance system.

[0042] As shown in Figure 1, this embodiment proposes a mixed reality building construction method, including the following steps:

[0043] Step S100: Establish a virtual three-dimensional digital model corresponding to the real construction site, wherein the three-dimensional digital model includes engineering construction information.

[0044] In the specific process, BIM (Building Information Modeling) technology is used to create a 3D digital model of the construction site and integrate engineering construction information. This engineering construction information includes: building engineering information and construction information. Building engineering information specifically includes: building structural geometry information, building electromechanical distribution information, and building decoration information. Construction information specifically includes: building material information, construction technology information, and construction progress information. By integrating this engineering construction information, the 3D digital model contains rich architectural and construction data. This 3D digital model of the construction site not only includes the buildings under construction but also environmental information about the surrounding construction area.

[0045] As shown in Figures 1 and 2, step S200 involves mapping and synchronizing the actual state of the real construction site with the three-dimensional digital model in real time to form a digital twin model.

[0046] Based on a 3D digital model (BIM model), digital twin technology is applied to map and synchronize the physical construction site with the virtual 3D digital model (BIM model) in real time. The resulting digital twin model can reflect changes in the site's status in real time and predict future development trends. For example, the real-time status of construction is detected and updated in the 3D digital model (BIM model), while the construction guidance information in the 3D digital model can be reflected in the actual construction process in real time, enabling prediction and guidance of the construction process.

[0047] As shown in Figures 1 and 2, to achieve the above process, step S200 specifically includes the following steps:

[0048] Step S210: Monitor the environmental data of the actual construction site in real time through a sensor network.

[0049] Step S220: Obtain the location information of construction equipment and construction personnel in the actual construction site.

[0050] Step S230: Transmit environmental data and location information to the three-dimensional digital model in real time to obtain a digital twin model that provides real-time perception of the actual construction site status.

[0051] In practice, sensors with different functions, such as temperature sensors, humidity sensors, light sensors, noise sensors, and vision sensors, are installed at various predetermined locations on the construction site to monitor the actual state of the site in real time, thus forming a sensor network. This sensor network is used to monitor the site's environmental data in real time. Precise location information of construction equipment and personnel within the site is obtained through GPS, RTK, and other positioning devices, enabling real-time monitoring of the construction progress. The detected environmental data and location information are transmitted in real time to a 3D digital model, achieving real-time perception of the site environment and forming a digital twin model. This digital twin model reflects the actual operating status, performance, and behavioral patterns of the construction site in the 3D digital model, facilitating the monitoring, analysis, optimization, and prediction of the construction site.

[0052] In addition, to achieve a more accurate visual match between the digital twin model and the real construction site, the following measures are also included:

[0053] Step S240: Align the 3D digital model with the real construction site using a virtual-real registration algorithm.

[0054] By employing a virtual-real registration algorithm, precise alignment between the 3D digital model (BIM model) and the real environment is achieved. This enables accurate matching between the digital twin model and the actual construction site, resulting in a better visual presentation.

[0055] Step S300: Convert the digital twin model into a 3D scene for use in a mixed reality environment.

[0056] In practice, the Unity3D engine is used to import and convert 3D digital models (BIM models) into 3D scenes that can be used in mixed reality environments. Unity3D offers rich interactive features and efficient rendering performance, making it suitable for building complex mixed reality applications.

[0057] During the model conversion process, a data exchange protocol is used to synchronize data between the 3D digital model, digital twin model, and 3D scene in real time. Employing an efficient data interaction protocol ensures real-time synchronization of data between the 3D digital model, digital twin model, and 3D scene, improving system response speed.

[0058] As shown in Figures 1 and 2, in step S400, the three-dimensional scene is visually presented in the real construction site using mixed reality equipment.

[0059] In practice, HoloLens mixed reality devices can be used to present 3D scenes developed in Unity3D to users. HoloLens can achieve virtual-real fusion, allowing users to see virtual digital twin models in a real environment and providing various interaction methods such as gestures and voice.

[0060] As shown in Figures 1 and 2, the specific steps for visual presentation include:

[0061] Step S410: Using a simultaneous localization and mapping (SMR) algorithm, perform autonomous navigation and positioning of the mixed reality device within the real construction site.

[0062] Step S420: Using a visual recognition algorithm, the 3D scene is seamlessly integrated with the real construction site to provide a more accurate mixed reality experience.

[0063] By adopting the above steps, virtual and real registration fusion is achieved, seamlessly integrating the 3D scene with the real environment to provide an immersive mixed reality experience.

[0064] In addition to the steps of visually representing the 3D scene on a real construction site, the following are also included:

[0065] Step S500: Based on the process information in the three-dimensional digital model and the actual state of the construction site, generate a construction process guidance plan.

[0066] In the specific process, cloud computing and big data technologies are used to store, analyze, and mine data on the actual state of real construction sites, generating construction process guidance data. Based on the engineering construction information in the 3D digital model (BIM model), detailed construction process guidance plans are formulated to guide construction on-site.

[0067] For example, construction process identification and matching: identify the construction process under construction, and then match it with the preset process in the engineering construction information in the 3D digital model (BIM model). After matching the corresponding process, information such as the subsequent steps of the process, the current construction progress, the estimated time to complete the process, and the cost can be obtained.

[0068] Work object data processing: When viewing work objects at the construction site, the system can identify the current construction progress, required material costs, and completed scene images, and present them visually.

[0069] Construction / Maintenance Guidance: By identifying the construction process, corresponding guidance information for the current construction can be obtained and visually presented, thereby providing guidance for the construction.

[0070] Virtual Construction Environment: A virtual construction environment can be created using mixed reality equipment. A construction robot model is built within a 3D digital model, and construction guidance processes are planned within this 3D scene. This guides the matching of process segments with process IDs and directs the construction robot model to simulate construction within the virtual environment. This allows for prediction of real-world construction and provides simulation-based early warnings. Furthermore, it enables monitoring and guidance of key components of real-world construction equipment in the real-world environment, including pose calibration, equipment operating status, and mechanical, electrical, and hydraulic data monitoring.

[0071] Step S510: Visualize and adjust the construction process guidance plan in real time through the interactive functions of the mixed reality device.

[0072] By leveraging Unity3D's interactive features, the process guidance can be visualized and adjusted in real time. Using HoloLens devices, the process guidance plan is presented to construction workers in real time, offering multiple interaction methods such as gestures and voice, thereby improving construction efficiency and quality.

[0073] The mixed reality building construction method of this embodiment has the following advantages: (1) Real-time performance and visualization: By using digital twin technology and exchanging data in real time, the digital model of the building can be updated in real time, ensuring that the simulation results are consistent with the actual construction status. Using mixed reality technology, the simulation results of the digital twin model can be presented on the construction site in real time, in the form of three-dimensional stereoscopic, holographic projection, etc., providing construction personnel with an intuitive and vivid visual experience. (2) Comprehensiveness and accuracy: Digital twin technology can simulate the performance of the building under different conditions, including data on lighting, ventilation, energy consumption, etc., to achieve multi-dimensional simulation; helping designers and construction personnel to fully understand the performance and status of the building. Through the mixed reality building construction guidance system driven by digital twin, various situations in the construction process can be accurately simulated, providing construction personnel with accurate guidance and suggestions, avoiding errors and mistakes in construction. (3) Collaboration and intelligence: Digital twin technology can realize collaborative design and construction, reduce unnecessary communication costs, and improve construction efficiency. By updating the digital model of the building in real time, different teams can share data and information to achieve collaborative work. Based on big data and artificial intelligence technologies, the digital twin-driven mixed reality building construction guidance system can automatically analyze construction data and provide intelligent decision support. For example, the system can adjust construction parameters in real time based on sensor data to optimize the construction process. (4) Safety and prevention: Through digital twin technology and IoT devices, the safety status of the construction site, such as temperature, humidity, and soil moisture content, can be monitored in real time to promptly identify potential safety hazards and ensure construction safety through real-time safety monitoring. Based on the predictive maintenance function of digital twin technology, the maintenance needs of equipment can be predicted in advance, and maintenance can be carried out in a timely manner to reduce equipment failure rate and ensure smooth construction. (5) Improve efficiency and reduce costs: Through the digital twin-driven mixed reality building construction guidance system, construction personnel can understand and grasp the construction process more intuitively and accurately, reduce unnecessary time waste, shorten the construction cycle, and improve construction efficiency. By optimizing the construction progress, improving the quality of the project, and reducing safety risks, construction costs can be reduced and the economic benefits of the project can be improved.

[0074] Example 2

[0075] This application also proposes a mixed reality building construction system, comprising mixed reality devices, a sensor network, and a processor. The processor can be located remotely and exchanges data with the mixed reality devices wirelessly. The mixed reality devices are used for visual presentation, merging the real and virtual worlds. The sensor network is deployed throughout the real construction site and includes various sensors with different functions. The sensor network is used to monitor site environmental data in real time, reflecting information such as actual operating status, performance, and behavior patterns in a three-dimensional digital model. The processor uses real-time data and executes the mixed reality building construction method described above, and provides visual presentation through the mixed reality devices.

[0076] This embodiment of the mixed reality construction system includes key technologies such as construction site environment perception, data information interaction, virtual-real registration fusion, and construction process guidance. It can improve upon issues such as the lack of intuitive access to knowledge for various typical and complex construction processes, and the untimely maintenance or operation. This mixed reality construction system combines BIM's digital twin technology with mixed reality technology to construct a digital twin-driven overall model and technical framework for complex process guidance, proposing a construction auxiliary guidance system based on BIM-Unity3D-HoloLens.

[0077] Example 3

[0078] This application also proposes a computer-readable storage medium storing one or more programs that can be executed by one or more processors to implement the mixed reality building construction method described above.

[0079] This application discloses a mixed reality construction method, system, and storage medium that uses a digital twin model combined with mixed reality for visual presentation. This overcomes the shortcomings of existing technologies, improves construction efficiency and quality, reduces costs and energy consumption, and provides a more intelligent and sustainable solution for the construction industry. The research focuses on key technologies such as construction site environmental perception, data information interaction, virtual-real registration fusion, and construction process guidance to ensure the system's stability and practicality. By combining BIM technology, digital twin technology, and mixed reality technology, a comprehensive model and technical framework for complex process guidance driven by a digital twin are constructed. Through the development of a construction assistance guidance system based on BIM-Unity3D-HoloLens, breakthroughs have been achieved in key technologies such as construction site environmental perception, data information interaction, virtual-real registration fusion, and construction process guidance. This system can improve construction efficiency and quality, reduce construction costs and safety risks, and provide strong support for the development of smart construction.

[0080] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A mixed reality building construction method, characterized in that, The method includes the following steps: Establish a virtual three-dimensional digital model corresponding to the real construction site, wherein the three-dimensional digital model includes engineering construction information; The actual state of the real construction site is mapped and synchronized with the three-dimensional digital model in real time to form a digital twin model; The digital twin model is converted into a three-dimensional scene for use in a mixed reality environment; The three-dimensional scene is visually presented on the real construction site using mixed reality devices.

2. The mixed reality building construction method according to claim 1, characterized in that, In the step of real-time mapping and synchronization between the actual state of the construction site and the three-dimensional digital model: Real-time monitoring of environmental data at real-world construction sites using sensor networks; Obtain the location information of construction equipment and personnel within a real construction site; The environmental data and location information are transmitted to the three-dimensional digital model in real time to obtain a digital twin model that provides real-time perception of the actual construction site status.

3. The mixed reality building construction method according to claim 2, characterized in that, In the step of mapping and synchronizing the actual state of the real construction site with the three-dimensional digital model in real time to form a digital twin model: The three-dimensional digital model is aligned with the real construction site using a virtual-real registration algorithm.

4. The mixed reality building construction method according to claim 3, characterized in that, In the step of visually presenting the three-dimensional scene using a mixed reality device: By using simultaneous localization and mapping algorithms, autonomous navigation and positioning of mixed reality devices can be achieved within real construction sites. Visual recognition algorithms are used to integrate 3D scenes with real-world construction sites.

5. The mixed reality building construction method according to claim 1, characterized in that, In the step of converting the digital twin model into a three-dimensional scene: Data exchange protocols enable real-time synchronization of data between 3D digital models, digital twin models, and 3D scenes.

6. The mixed reality building construction method according to claim 1, characterized in that, Following the step of visually representing the 3D scene at the real construction site using a mixed reality device, the process includes: Based on the process information in the three-dimensional digital model and the actual conditions of the real construction site, a construction process guidance plan is generated.

7. The mixed reality building construction method according to claim 6, characterized in that, In the step of generating a construction process guidance plan based on the process information in the three-dimensional digital model and the actual conditions of the real construction site: By using cloud computing and big data technologies, data on the actual state of real construction sites is stored, analyzed, and mined to generate construction process guidance data.

8. The mixed reality building construction method according to claim 7, characterized in that, After the step of generating a construction process guidance scheme based on the process information in the three-dimensional digital model and the actual conditions of the real construction site, the following steps are also included: The interactive features of mixed reality devices enable the visualization and real-time adjustment of construction process guidance plans.

9. A mixed reality building construction system, characterized in that, This includes mixed reality devices, sensor networks, and processors; Real-time data on the actual state of a real construction site is acquired through sensor networks; The processor uses the real-time data to implement the mixed reality building construction method as described in any one of claims 1-8, and performs visual presentation through the mixed reality device.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more programs, which can be executed by one or more processors to implement the mixed reality building construction method as described in any one of claims 1-8.

Images