Fabricated building construction in-situ simulation method based on mixed reality

Abstract

The invention discloses a fabricated building construction in-situ simulation method based on mixed reality. The method comprises the following steps: carrying out lightweight processing on a BIM model; configuring an MR environment and importing a model; construction procedures are determined and hierarchically divided; development of an assembly type building construction in-situ simulation function; the Visual Studio compiles a project and is connected with the Hololens2 to be published; hololens 2 equipment is worn on site, and prefabricated building in-situ construction simulation is carried out. According to the method, the mixed reality technology is creatively fused and applied to prefabricated building construction simulation, and in-situ simulation of prefabricated building construction is achieved. By means of the MR equipment, constructors can visually observe the construction sequence of the fabricated components and the spatial positions of the fabricated components in the actual environment in the real physical space, and the pre-judgment precision of the construction result is remarkably improved. On-site management personnel can adjust construction strategies, detect problems and optimize resource allocation according to guidance of the simulation system, so that management efficiency is improved, and resource waste caused by a traditional management mode is reduced.

Description

Technical Field

[0001] This invention relates to the fields of civil engineering and intelligent construction, and in particular to an in-situ simulation method for prefabricated building construction based on mixed reality. Background Technology

[0002] In recent years, with the transformation and upgrading of the traditional construction industry, prefabricated buildings have gradually become the mainstream of construction due to their advantages of being green, environmentally friendly, and efficient. However, because the prefabricated building industry is still in its development stage, construction technology is not yet perfect, and coordination between various links is required. Although conceptually, prefabricated buildings, due to the factory production of construction components, can reduce on-site construction content, construction steps, and costs, in reality, prefabricated building construction may suffer from poor construction quality, extended construction period, and increased costs due to improper construction processes and methods, insufficient experience of construction personnel, and difficulty in controlling assembly process errors. Although current construction simulation can identify and solve some potential problems before the actual project begins, there are still areas for improvement. Traditional prefabricated building construction simulation systems suffer from a disconnect from the real environment, especially on the construction site, lacking real-time interaction and on-site guidance functions, and failing to effectively feed virtual information back to actual operation, resulting in a disconnect between virtual and reality, thus affecting the real-time performance and accuracy of the construction process.

[0003] The introduction of Mixed Reality (MR) technology offers a new solution to overcome these challenges. As an emerging technology in the field of physical and digital interaction, MR provides a way to combine the real and virtual worlds, creating a mixed reality space that integrates a person, computer, and environment. This space allows people to enhance their understanding of the real environment with the help of computer digital information. In this space, engineers and construction workers can intuitively see the fusion of digital models and the actual built environment. Combining prefabricated building construction simulation with MR technology can achieve the integration of the construction site environment with the simulation process, fully considering the actual site conditions, identifying problems in advance, and improving construction quality and efficiency. Summary of the Invention

[0004] To address the above problems, this invention aims to provide an in-situ simulation method for prefabricated building construction based on mixed reality. This method includes the following steps: Step 1, lightweight processing of the BIM model; Step 2, MR environment configuration and model import; Step 3: Determining the construction sequence and dividing the work into levels; Step 4: Development of simulation function for in-situ construction of prefabricated buildings; Step 5: Compile the project in Visual Studio and connect to HoloLens2 for deployment; Step 6: Wear the HoloLens2 device on site to conduct in-situ construction simulation of prefabricated buildings.

[0005] Furthermore, in step 1, the following steps can be performed sequentially: Step 1.1: Using Autodesk Revit as the primary BIM software, export the BIM model in Revit as FBX format; Step 1.2: Lighten the model exported from Revit by reducing the number of triangular meshes to make the model meet the hardware requirements of subsequent development. Step 1.3: Convert the preprocessed lightweight model into a model format suitable for MR function development.

[0006] Furthermore, in step 2, the following steps can be performed sequentially: Step 2.1: Configure the mixed reality development environment in Unity and add gesture operation functionality; Step 2.2: Import the converted architectural model from Step 1.3 into Unity, and modify the model's materials and refraction methods; Step 2.3: Based on the "Unpick Completely" function, completely ungroup the model; Step 2.4: Based on the MRTK toolkit, attach "NearInteractionGrabbable.cs", "ManipulationHandler.cs", "BoundingBox.cs", and "Interactable.cs" to the BIM model in sequence to realize the functions of grabbing, moving, rotating, and scaling the BIM model.

[0007] Furthermore, in step 3, the following steps can be performed sequentially: Step 3.1: Based on the field survey and analysis of the construction characteristics of prefabricated buildings, clarify the construction procedures for each component of the prefabricated building; Step 3.2: In the Unity platform, divide the prefabricated components into layers according to the construction sequence and represent them with different colors; Step 3.3: Write a C# script in Visual Studio to simulate the assembly process of the model according to the actual construction procedures.

[0008] Furthermore, in step 4, the following steps can be performed sequentially: Step 4.1: Based on the MRTK toolkit, set up the operation panel and divide the slider buttons into stages according to the construction process, with each slider node corresponding to a different construction process; Step 4.2: Assign the script written in Step 3.3 to the slider button, and drag the slider to the corresponding node to trigger the corresponding construction procedure; Step 4.3: Attach “HighlightObjects.cs”, “LockObjects.cs”, and “ResetScene.cs” to the model in sequence to implement the model’s highlight, lock, and reset functions; Further, in step 5, the project is packaged into a Visual Studio Solution file, compiled into ARM64 format using Visual Studio, and published as an APPX format installation package. The project is then deployed to HoloLens 2 via Wi-Fi connection.

[0009] Furthermore, in step 6, by wearing the HoloLens 2 device, users can simulate the in-situ full-scale construction process of prefabricated buildings at the construction site. By combining the simulation process with the construction site, problems that may occur during construction can be identified in advance, thereby improving construction quality and efficiency.

[0010] The advantages and positive effects of this invention are as follows: (1) Innovation in the application of mixed reality in civil engineering. This invention combines the MRTK toolkit with self-developed algorithms to perform in-situ construction simulation of prefabricated buildings using MR in-situ visualization functions. This innovative application combines mixed reality technology with civil engineering, opening up a new field of in-situ simulation of prefabricated building construction and interaction with building models, and improving the efficiency and accuracy of prefabricated building construction.

[0011] (2) In-situ simulation of prefabricated building construction. This invention realizes in-situ full-size construction simulation of prefabricated buildings through MR technology. Construction personnel can simulate the construction process in a real environment, identify and solve problems in advance, thereby improving construction quality and reducing construction costs. In addition, MR technology can also provide real-time construction guidance to relevant personnel during the construction process, guiding them to carry out accurate and efficient construction operations, reducing human error and delays.

[0012] In summary, this invention innovatively integrates mixed reality technology into the simulation of prefabricated building construction, achieving in-situ simulation of prefabricated building construction. With the help of MR equipment, construction personnel can intuitively observe the construction sequence of prefabricated components and their spatial positions in the actual environment within a real physical space, significantly improving the accuracy of predicting construction results. On-site managers can adjust construction strategies, detect problems, and optimize resource allocation based on the guidance of the simulation system, thereby improving management efficiency and reducing resource waste caused by traditional management methods. Attached Figure Description

[0013] The above and / or other aspects and advantages of the present invention will become clearer and more readily understood from the following detailed description taken in conjunction with the accompanying drawings, which are merely illustrative and do not limit the invention, wherein: Figure 1 This is a flowchart of a mixed reality-based in-situ simulation method for prefabricated building construction.

[0014] Figure 2 These are example images of material correction and model ungrouping in MR models.

[0015] Figure 3 This is a classification example diagram of prefabricated components.

[0016] Figure 4 This is an example diagram showing the color coding of prefabricated components.

[0017] Figure 5 This is an example image of a C# script written in Visual Studio.

[0018] Figure 6 This is an example image showing slider button settings.

[0019] Figure 7 Example diagram of prefabricated building construction simulation in Unity Figure 8 This is an example diagram of an in-situ construction method for prefabricated buildings based on HoloLens2. Detailed Implementation

[0020] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0021] like Figure 1 As shown, this invention provides an in-situ simulation method for prefabricated building construction based on mixed reality. The method includes the following steps: Step 1, lightweight processing of the BIM model; Step 2, MR environment configuration and model import; Step 3: Determining the construction sequence and dividing the work into levels; Step 4: Development of simulation function for in-situ construction of prefabricated buildings; Step 5: Compile the project in Visual Studio and connect to HoloLens2 for deployment; Step 6: Wear the HoloLens2 device on site to conduct in-situ construction simulation of prefabricated buildings.

[0022] Furthermore, in step 1, the following steps can be performed sequentially: Step 1.1: Using Autodesk Revit as the primary BIM modeling software, export the BIM model in Revit as an FBX format; Step 1.2: Lightweight processing is performed on the model exported from Revit. Techniques such as mesh simplification, vertex aggregation, and triangle reconstruction are used to reduce the number of triangular meshes in the model, so that the model meets the hardware requirements for subsequent development. Step 1.3: Convert the preprocessed lightweight model into a model format suitable for MR function development.

[0023] Furthermore, in step 2, the following steps can be performed sequentially: Step 2.1: Configure the mixed reality development environment in Unity, import MRTK 3.0, and check the "HandTracking" module to add gesture operation functionality; Step 2.2: Import the converted building model from Step 1.3 into Unity, and correct the model's materials, refraction methods, and transparency; Step 2.3: Based on the "Unpick Completely" function, completely ungroup the model to ensure that each component can be operated independently, such as... Figure 2 As shown; Step 2.4: Based on the MRTK toolkit, attach "NearInteractionGrabbable.cs", "ManipulationHandler.cs", "BoundingBox.cs", and "Interactable.cs" to the BIM model in sequence to realize the functions of grabbing, moving, rotating, and scaling the BIM model.

[0024] Furthermore, in step 3, the following steps can be performed sequentially: Step 3.1: Based on on-site research and analysis of the characteristics of prefabricated building construction, clarify the construction procedures for each component of the prefabricated building, such as... Figure 3 As shown; Step 3.2: In the Unity platform, divide the prefabricated components into layers according to the construction sequence and represent them with different colors. For example... Figure 4 As shown; Step 3.3: Write a C# script in Visual Studio to simulate the assembly process of the model according to the actual construction procedures, such as... Figure 5 As shown.

[0025] Furthermore, in step 4, the following steps can be performed sequentially: Step 4.1: Import the MRTK "Slider" control, configure the operation panel, and divide the slider buttons into stages according to the construction sequence. Each slider node corresponds to a different construction process, such as... Figure 6 As shown; Step 4.2: Assign the script written in Step 3.3 to the slider button, and drag the slider to the corresponding node to trigger the corresponding construction procedure, such as... Figure 7 As shown; Step 4.3: Attach “HighlightObjects.cs”, “LockObjects.cs”, and “ResetScene.cs” to the model in sequence to implement the model’s highlight, lock, and reset functions; Further, in step 5, the project is packaged into a Visual Studio Solution file, compiled into ARM64 format using Visual Studio, and published as an APPX format installation package. The project is then deployed to HoloLens 2 via Wi-Fi connection.

[0026] Furthermore, in step 6, by wearing the HoloLens 2 device, users can simulate the in-situ, full-scale construction process of prefabricated buildings at the construction site. Combining the simulation with the actual construction site allows for the early detection of problems during construction, improving construction quality and efficiency. Figure 8 As shown.

[0027] This invention provides a mixed reality-based in-situ simulation method for prefabricated building construction. By innovatively integrating mixed reality technology into the simulation of prefabricated building construction, it achieves in-situ simulation of prefabricated building construction. With the help of MR equipment, construction personnel can intuitively observe the construction sequence of prefabricated components and their spatial position in the actual environment within a real physical space, significantly improving the accuracy of predicting construction results. On-site managers can adjust construction strategies, detect problems, and optimize resource allocation based on the guidance of the simulation system, thereby improving management efficiency and reducing resource waste caused by traditional management methods.

[0028] This invention is not limited to the above-described embodiments. Anyone can derive other products in various forms under the guidance of this invention. However, regardless of any changes in shape or structure, any technical solution that is the same as or similar to this application falls within the protection scope of this invention.

Claims

1. A method for in-situ simulation of prefabricated building construction based on mixed reality, characterized in that, The method includes the following steps: Step 1, lightweight processing of the BIM model; Step 2, MR environment configuration and model import; Step 3: Determining the construction sequence and dividing the work into levels; Step 4: Development of simulation function for in-situ construction of prefabricated buildings; Step 5: Compile the project in Visual Studio and connect to HoloLens2 for deployment; Step 6: Wear the HoloLens2 device on site to conduct in-situ construction simulation of prefabricated buildings.

2. The in-situ simulation method for prefabricated building construction based on mixed reality as described in claim 1, characterized in that, In step 1, the following steps can be performed sequentially: Step 1.1: Using Autodesk Revit as the BIM software, export the BIM model in Revit as FBX format; Step 1.2: Lighten the model exported from Revit by reducing the number of triangular meshes to make the model meet the hardware requirements of subsequent development. Step 1.3: Convert the preprocessed lightweight model into a model format suitable for MR function development.

3. The in-situ simulation method for prefabricated building construction based on mixed reality as described in claim 1, characterized in that, In step 2, the following steps are performed sequentially: Step 2.1: Configure the mixed reality development environment in Unity and add gesture operation functionality; Step 2.2: Import the converted architectural model from Step 1.3 into Unity, and modify the model's materials and refraction methods; Step 2.3: Based on the "Unpick Completely" function, completely ungroup the model; Step 2.4: Based on the MRTK toolkit, attach "NearInteractionGrabbable.cs", "ManipulationHandler.cs", "BoundingBox.cs", and "Interactable.cs" to the BIM model in sequence to realize the functions of grabbing, moving, rotating, and scaling the BIM model.

4. The in-situ simulation method for prefabricated building construction based on mixed reality as described in claim 1, characterized in that, In step 3, the following steps are performed in sequence: Step 3.1: Based on the field survey and analysis of the construction characteristics of prefabricated buildings, clarify the construction procedures for each component of the prefabricated building; Step 3.2: In the Unity platform, divide the prefabricated components into layers according to the construction sequence and represent them with different colors; Step 3.3: Write a C# script in Visual Studio to simulate the assembly process of the model according to the actual construction procedures.

5. The in-situ simulation method for prefabricated building construction based on mixed reality as described in claim 1, characterized in that, In step 4, the following steps can be performed sequentially: Step 4.1: Based on the MRTK toolkit, set up the operation panel and divide the slider buttons into stages according to the construction process, with each slider node corresponding to a different construction process; Step 4.2: Assign the script written in Step 3.3 to the slider button, and drag the slider to the corresponding node to trigger the corresponding construction procedure; Step 4.3: Attach "HighlightObjects.cs", "LockObjects.cs", and "ResetScene.cs" to the model in sequence to implement the functions of highlighting, locking, and resetting the model.

6. The in-situ simulation method for prefabricated building construction based on mixed reality as described in claim 1, characterized in that, In step 5, the project is packaged into a Visual Studio Solution file, compiled into ARM64 format using Visual Studio, and published as an APPX format installation package; Deploy the project to HoloLens 2 via Wi-Fi connection.

7. The in-situ simulation method for prefabricated building construction based on mixed reality as described in claim 1, characterized in that, In step 6, by wearing the HoloLens 2 device, the user can simulate the in-situ full-scale construction process of the prefabricated building at the construction site, realizing the integration of the simulation process with the construction site, which can identify problems in the construction process in advance and improve construction quality and efficiency.

Images