A method for quickly producing construction simulation applications combining real scenes and BIM models

Abstract

The present invention provides a method for quickly producing a construction simulation application combining a real scene with a BIM model, which belongs to the field of BIM construction simulation applications, and includes the following steps: collecting project-related drawings, determining the current construction plan, and establishing a construction animation script; using a drone to shoot the construction site and obtain photos or videos; importing the video shot by the drone into the PFtrack software to extract video lens parameters, and at the same time performing BIM modeling on the drawings; importing the BIM model into the 3dsMax software for sorting, and producing a construction animation according to the construction animation script; importing the lens extracted by the PFtrack software into the 3dsMax file to render an animation; using editing software, editing and merging the rendered animation with the photos or videos shot by the drone, and outputting a finished video. The present invention can not only shorten the construction period, but also visualize the construction conditions of the site, so that the construction plan and design drawings can be adjusted in time, and the design and construction quality can be improved.

Description

Technical Field

[0001] The present invention relates to the field of BIM construction simulation applications, and in particular to a method for rapidly producing a construction simulation application combining a real scene with a BIM model. Background Art

[0002] In the previous process, it was necessary to first model the scene around the construction site, and then combine the modeling with the BIM model to render the animation and produce a video. At present, it takes several days just to model the scene around the construction site, which is time-consuming, resulting in high construction costs and even affecting the subsequent decision-making timeliness due to the long time. At present, the traditional modeling method is human modeling, which requires personnel to take photos on the spot (usually using cameras), and then manually modeling by personnel. This process usually takes several days, which is not only time-consuming but also costly. In addition, for manual modeling, manual modeling is mainly based on human judgment, and errors are inevitable (such as the distance between buildings, road width, and building height); the newer modeling method is to use drone aerial photography (oblique photography modeling technology), and then use graphics processing software to generate models, which saves labor and part of the time cost compared to the traditional mode, but the software still takes 1-2 days to generate models, which is time-consuming. In addition, for drone oblique photography modeling technology, although the precision and accuracy are improved compared to manual modeling, due to technical limitations, errors will also occur (for example, the deformation of plants or buildings caused by the problem of precision during generation, the error caused by the regeneration of equipment precision and the rough model, and the omission of some models). Therefore, the two commonly used modeling methods are relatively expensive, and the long time will have an adverse impact on the subsequent work nodes and cannot meet the needs of project decision-making. Summary of the invention

[0003] In view of this, the present invention aims to propose a method for quickly producing a construction simulation application that combines real scenes with BIM models, which can not only greatly shorten the production cycle, but also enable the project BIM model to be displayed in the real-shot scene, so that the construction party and the design party can timely understand the situation after the site is combined with the plan, visualize the construction conditions of the site, and facilitate the discovery of conflicts between the construction plan and the site conditions, so that the construction plan and design drawings can be adjusted in time to improve the design and construction quality.

[0004] To achieve the above object, the technical solution of the present invention is implemented as follows: a method for quickly producing a construction simulation application combining a real scene with a BIM model, comprising the following steps:

[0005] Step 1: Understand the project information, collect relevant drawings of the project, including the building drawings, construction site layout drawings and foundation pit support drawings, determine the current construction plan, and establish a construction animation script;

[0006] Step 2: Use a drone to shoot the construction site, obtain photos or videos, and determine the drone shooting range and the best shooting angle according to the construction plan and construction animation script determined in step 1;

[0007] Step 3: Import the video shot by the drone in step 2 into the PFtrack software to extract the video lens parameters, and at the same time organize personnel to perform BIM modeling on the drawings;

[0008] Step 4: Import the BIM model into 3dsMax construction animation software for organization, and make construction animation according to the construction animation script;

[0009] Step 5, import the shots extracted by PFtrack software in step 3 into the 3dsMax construction animation file and render the animation;

[0010] Step 6: Use editing software to edit and merge the rendered animation in step 5 with the photos or videos taken by the drone in step 2 to output the finished video.

[0011] Furthermore, in step 2, when using a drone to photograph the construction site, choose sunny or cloudy weather to ensure the quality of the photography; the drone uses the DJI Mini3 Free Flight Kit, which is easy to carry, and the remote control with a screen allows the operator to determine the shooting angle, automatically shoot according to the set route, or manually shoot and record videos.

[0012] Furthermore, in step 3, BIM modeling of the drawings includes:

[0013] Camera inverse analysis: By analyzing video data, the parameters of the real camera can be inversely analyzed, including focal length, distortion, moving distance and speed, and steering angle;

[0014] Distortion correction: Identify and correct distortion in the video to ensure tracking accuracy;

[0015] Object tracking and camera calculation: Track objects in the video and calculate the camera's motion parameters;

[0016] Scene reconstruction: Reconstruct 3D scenes based on tracking data to achieve the combination of virtual and reality;

[0017] Export lens: export the calculated and reconstructed lens data into a format that can be used by 3dsMax software;

[0018] Use modeling software for BIM modeling.

[0019] Furthermore, step 4 includes:

[0020] Delete the model components that will not be seen in the picture according to the front and back covering relationship of the scene;

[0021] Adjust the mutual subtraction relationship of the models and delete the overlapping faces of the models to avoid flickering of the model textures in the animation;

[0022] Arrange the texture materials of the model components and adjust the textures of the model components to make them closer to the real effect;

[0023] Use the animation functions in 3dsMax to create key frames for the organized model according to the construction animation script established in step 1, so that the component construction simulation sequence is consistent with the time nodes in the construction plan.

[0024] Furthermore, step 5 specifically includes importing the lens file exported from the PFtrack software into the prepared 3dsMax model file with animation, and using the imported lens to render the construction simulation animation.

[0025] Furthermore, V-Vray renderer was used for rendering, and renderer parameters were adjusted to render the animation into animation frames. The rendering resolution was consistent with the drone aerial photography material, and the rendering frame file was set to .png format.

[0026] Furthermore, in step 6, use Premiere video editing software to process the material, import the drone material and rendered animation sequence frames into Premiere, render the animation sequence in the upper layer, and place the drone shooting material on the bottom layer. Add corresponding subtitles or add audio material according to the needs of the construction plan, and output the video after completing the editing.

[0027] Compared with the prior art, the method for quickly producing a construction simulation application combining a real scene with a BIM model described in the present invention has the following advantages: the present invention eliminates the modeling work and directly generates a video by combining the drone footage with the BIM model. The production cycle is short, the timeliness is fast, and the cost is low. By improving the response speed, the timeliness of the decision is improved, and the project construction period is shortened.

[0028] (1) The method of the present invention directly omits the step of modeling the surrounding scene of the construction site in the traditional method, which greatly saves production time and production cost, quickly forms results, improves the timeliness of decision-making by decision-makers, and is conducive to saving project costs and shortening project construction period;

[0029] (2) The method described in the present invention combines BIM construction simulation production with film and television special effects editing technology (PFtrack, Premiere), which improves the display effect of project design and construction plan to a certain extent, so that the project BIM model can be displayed in the real scene, avoiding the model errors generated in the surrounding scene modeling process in other methods, improving accuracy and realism, and making the display of the construction plan more realistic. The relationship between the original building and the new building is clear at a glance, which is convenient for the construction party and the design party to timely understand the situation after the site is combined with the plan, and to make timely adjustments to the construction plan and design drawings, thereby improving the design and construction quality;

[0030] (3) The present invention greatly reduces the modeling workload in the old working mode. In the previous process, when it was necessary to model the scenes around the construction site, it took several days. Now, drone photography has replaced modeling. Depending on the size of the project, a small project takes 1-2 hours, and a large project can be completed in a maximum of 1 day, which greatly shortens the production cycle and also reduces labor costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The accompanying drawings constituting a part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the accompanying drawings:

[0032] Figure 1 A flowchart of a method for quickly producing a construction simulation application combining a real scene and a BIM model according to an embodiment of the present invention;

[0033] Figure 2 This is the interface diagram for extracting video lens parameters using PFtrack software;

[0034] Figure 3 This is the interface diagram before importing the footage extracted by PFtrack software into 3dsMax for rendering animation;

[0035] Figure 4 The simulation effect diagram of the construction rendering model integrated with the real scene (effect one);

[0036] Figure 5 This is a simulation rendering of the real-scene fusion construction rendering model (effect 2). DETAILED DESCRIPTION

[0037] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0038] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0039] The present invention provides a method for quickly producing a construction simulation application combining a real scene with a BIM model. The present invention is mainly used in the time stage when the construction plan of the construction project is basically determined but the construction site layout has not yet been carried out on site. It mainly helps the designer and the constructor to understand the integration of the actual project site and the construction plan in advance, visualizes the construction conditions of the site, facilitates the discovery of conflicts between the construction plan and the site conditions, and helps the designer and the constructor to adjust the design drawings and construction plans in a timely manner.

[0040] The main difference between the present invention and other methods is that the step of modeling the surrounding scenes of the construction site is completely omitted, and this step, which is relatively time-consuming and cost-consuming, is omitted, which greatly reduces the production cost and saves labor and time. The present invention uses PFtrack software to extract the lens parameters in the video shot by the drone, completely regenerates the lens movement process during the shooting process, and merges the video shot by the drone with the BIM model animation to replace the modeling of the surrounding scenes of the construction site, realizing that while not reducing the video performance effect, labor costs and time costs are saved. The advantages of using video instead of modeling are: for manual modeling, manual modeling is mainly based on human judgment, and errors are inevitable (such as the distance between buildings, road width, building height); for drone oblique photography modeling technology, the precision and accuracy are greatly improved, but due to technical limitations, errors may also occur (for example, due to the problem of precision during generation, the deformation of plants or buildings, the error caused by the regeneration of equipment precision and the rough model, and the omission of the ungenerated part of the model); the present invention uses the original video screen to replace the modeling, and what you see is reality, avoiding the above errors.

[0041] like Figure 1 As shown, the present invention is a method for quickly producing a construction simulation application combining a real scene with a BIM model, comprising the following steps:

[0042] Step 1: Understand the project information, collect relevant drawings of the project, including the building drawings, construction site layout drawings and foundation pit support drawings, determine the current construction plan, and establish a construction animation script;

[0043] Step 2: Use a drone to shoot the construction site, obtain photos or videos, and determine the drone shooting range and the best shooting angle according to the construction plan and construction animation script determined in step 1;

[0044] If the construction animation script determines that the lens of the construction animation is static, then the photos obtained by the drone can be used for combination. If the lens determined in the script is dynamic, the lens parameters are extracted using PFtrack software. The shooting range of the drone is defined according to the size of the surrounding scene range in the construction plan. The main buildings, roads and facilities related to the construction measures of the construction site must be included in the drone shooting range. The best angle for drone shooting is determined by the construction animation script. According to the requirements of the script, which working surfaces of the construction need to be displayed to determine the angle and route of the drone shooting.

[0045] When using a drone to shoot a construction site, choose sunny or cloudy weather to ensure the quality of the shooting. The advantage of sunny and cloudy weather is that the sunlight is relatively uniform and does not change much. Cloudy days are more advantageous than sunny weather, as the sunlight on cloudy days is softer and will not be overexposed. The drone uses the DJI Mini3 Free Flight Kit (with screen remote control version), which is easy to carry. The remote control with screen allows the operator to determine the shooting angle and automatically shoot according to the set route. It can also be manually operated to shoot and record videos.

[0046] Step 3: Import the video shot by the drone in step 2 into the PFtrack software to extract the video lens parameters (see PFtrack interface for details). Figure 2 ), and at the same time organize personnel to carry out BIM modeling of the drawings; give priority to the use of modeling software or plug-ins, the model can show the size and basic shape of the building, which is mainly used to verify the plan, so it does not need to be particularly sophisticated.

[0047] PFtrack software lens extraction includes: PFtrack is an imaging object tracking software developed by Pixel Farm, which is mainly used for camera inversion. By analyzing the actual video data, the parameters of the real camera are obtained, so that the 3D object can be perfectly combined with the actual shot object. PFtrack is widely used in TV and film post-production synthesis.

[0048] The working principle of PFtrack mainly includes the following steps:

[0049] 1) Camera inversion: By analyzing video data, the parameters of the real camera can be inverted, including focal length, distortion, moving distance and speed, and steering angle;

[0050] 2) Distortion correction: Identify and correct distortion in the video to ensure tracking accuracy;

[0051] 3) Object tracking and camera calculation: Track objects in the video and calculate the camera's motion parameters;

[0052] 4) Scene reconstruction: Reconstruct 3D scenes based on tracking data to achieve the combination of virtual and reality;

[0053] 5) Export lens: export the calculated and reconstructed lens data into a format (.ms) that can be used by 3dsMax software;

[0054] Using the remodeling software for BIM modeling includes: As a preferred solution of the present invention, the remodeling software based on Revit that is currently common in the market is selected, such as the remodeling software developed by Hongwa, Hongye, Glodon and other companies. For the specific operation of the software, please refer to the user manual provided by the software company.

[0055] Step 4: Import the BIM model into 3dsMax construction animation software for organization, and make construction animation according to the construction animation script;

[0056] The main function of 3dsMax model organization is to adjust the BIM model (revit) produced in the imported step three to a model state suitable for rendering animation through relevant operations of 3dsMax software.

[0057] The model arrangement method is:

[0058] 1) Delete the model components that will not be seen in the picture according to the front and back covering relationship of the scene;

[0059] 2) Adjust the mutual subtraction relationship of the models and delete the overlapping surfaces of the models to avoid flickering of the model textures in the animation;

[0060] 3) Arrange the texture materials of the model components and adjust the textures of the model components to make them closer to the real effect.

[0061] The method for making construction animation is:

[0062] Use the animation functions in 3dsMax to create key frames for the organized model according to the construction animation script established in step 1. Make the component construction simulation sequence consistent with the time nodes in the construction plan. The action time should not be too fast. The main actions (changes in the construction steps of the building body) are generally set to 2-3 seconds, and the secondary actions (changes in the layout of construction machinery or construction site) are generally set to 1 second, so that viewers can understand the construction process.

[0063] Step 5: Import the lens extracted by PFtrack software in step 3 into the 3dsMax construction animation file and render the animation; see the interface after importing the lens. Figure 3 .

[0064] Import the lens file (.ms) exported from the PFtrack software into the prepared 3dsMax model file with animation, and use the imported lens to render the construction simulation animation.

[0065] As a preferred solution of the present invention, V-Vray renderer is used for rendering, renderer parameters are adjusted, the animation is rendered into animation frames, the rendering resolution is consistent with the drone aerial photography material, and the rendering frame file is set to .png format (background transparent).

[0066] Step 6: Use editing software to edit and merge the rendered animation in step 5 with the photos or videos taken by the drone in step 2, and output the finished video. See the effect diagram. Figure 4 and Figure 5 .

[0067] As a preferred solution of the present invention, the Premiere video editing software developed by Adobe is used to process the materials, the drone materials and rendered animation sequence frames are imported into Premiere, the rendered animation sequence is placed on the upper layer, and the drone shooting materials are placed on the bottom layer. According to the needs of the construction plan, corresponding subtitles are added, or audio materials are added, and the video is output after editing is completed.

[0068] The implementers of the present invention need to be proficient in operating PFtrack, Revit, 3dsMax, and Premiere editing software.

[0069] The present invention replaces the surrounding scene modeling with steps 3, 5, and 6, directly omits the time-consuming and cost-consuming modeling steps, and uses photos or videos taken by drones to replace the model and the building plan (the BIM model and animation in step 4) to merge into a construction animation, which not only improves the precision and accuracy of the construction animation, but also saves labor costs and time costs without reducing the video performance effect.

[0070] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for rapidly producing a construction simulation application combining a real scene with a BIM model, characterized in that: The following steps are involved: Step 1: Understand the project information, collect relevant drawings of the project, including the building drawings, construction site layout drawings and foundation pit support drawings, determine the current construction plan, and establish a construction animation script; Step 2: Use a drone to shoot the construction site, obtain photos or videos, and determine the drone shooting range and the best shooting angle according to the construction plan and construction animation script determined in step 1; Step 3: Import the video shot by the drone in step 2 into the PFtrack software to extract the video lens parameters, and at the same time organize personnel to perform BIM modeling on the drawings; Step 4: Import the BIM model into 3dsMax construction animation software for organization, and make construction animation according to the construction animation script; Step 5, import the shots extracted by PFtrack software in step 3 into the 3dsMax construction animation file and render the animation; Step 6: Use editing software to edit and merge the rendered animation in step 5 with the photos or videos taken by the drone in step 2 to output the finished video.

2. The method for rapidly producing a construction simulation application combining a real scene with a BIM model according to claim 1, characterized in that: In step 2, when using a drone to shoot the construction site, choose sunny or cloudy weather to ensure the shooting quality; The drone uses the DJI Mini3 Free Flight Kit, which is easy to carry. The remote control with a screen allows the operator to determine the shooting angle, automatically shoot according to the set route, or manually shoot and record videos.

3. The method for rapidly producing a construction simulation application combining a real scene with a BIM model according to claim 1, characterized in that: In step 3, BIM modeling of drawings includes: Camera inverse analysis: By analyzing video data, the parameters of the real camera can be inversely analyzed, including focal length, distortion, moving distance and speed, and steering angle; Distortion correction: Identify and correct distortion in the video to ensure tracking accuracy; Object tracking and camera calculation: Track objects in the video and calculate the camera's motion parameters; Scene reconstruction: Reconstruct 3D scenes based on tracking data to achieve the combination of virtual and reality; Export lens: export the calculated and reconstructed lens data into a format that can be used by 3dsMax software; Use modeling software for BIM modeling.

4. A method for rapidly producing a construction simulation application combining a real scene with a BIM model according to claim 3, characterized in that: Step 4 includes: Delete the model components that will not be seen in the picture according to the front and back covering relationship of the scene; Adjust the mutual subtraction relationship of the models and delete the overlapping faces of the models to avoid flickering of the model textures in the animation; Arrange the texture materials of the model components and adjust the textures of the model components to make them closer to the real effect; Use the animation functions in 3dsMax to create key frames for the organized model according to the construction animation script established in step 1, so that the component construction simulation sequence is consistent with the time nodes in the construction plan.

5. The method for rapidly producing a construction simulation application combining a real scene with a BIM model according to claim 1, characterized in that: Step 5 specifically involves importing the lens file exported from the PFtrack software into the prepared 3dsMax model file with animation, and using the imported lens to render the construction simulation animation.

6. The method for rapidly producing a construction simulation application combining a real scene with a BIM model according to claim 5, characterized in that: Use V-Vray renderer for rendering, adjust the renderer parameters, render the animation into animation frames, the rendering resolution is consistent with the drone aerial photography material, and the rendering frame file is set to .png format.

7. The method for rapidly producing a construction simulation application combining a real scene with a BIM model according to claim 1, characterized in that: In step 6, use Premiere video editing software to process the material, import the drone material and rendered animation sequence frames into Premiere, render the animation sequence on the upper layer, and place the drone shooting material on the bottom layer. Add corresponding subtitles or add audio material according to the needs of the construction plan, and output the video after completing the editing.

Images