Modeling system and method based on unmanned aerial vehicle oblique photography and BIM + AR technology

Through the modeling system of drone tilt photography and BIM+AR technology, the problem of insufficient modeling accuracy and untimely information feedback caused by remote construction sites in linear engineering construction is solved, and high-precision construction guidance and management are achieved, improving the Construction efficiency and accuracy.

CN119091038APending Publication Date: 2024-12-06CHINA CONSTR FIRST BUILDING (GRP) CORP LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411085317.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-08
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

During the construction of linear engineering, most of the construction sites are remote areas, resulting in insufficient accuracy of drone tilt photography modeling, unable to achieve high-precision guidance, and BIM and AR technologies cannot provide timely and accurately feedback on construction adjustments, and lose management and guidance functions.

Method used

Design a modeling system based on drone tilt photography and BIM+AR technology, including aerial survey device, AR enhancement device, aerial survey and tilt photography modeling submodule, BIM modeling linkage submodule and reality augmentation feedback submodule. UAV aerial test generates imaging control points, combines AI rapid identification technology to adjust the design line position, and conducts multi-party linkage management through AR equipment.

Benefits of technology

It realizes the generation of high-precision tilt photography models and linkage between BIM models, provides high-precision construction guidance and management, conducts on-site comparison and analysis through AR equipment, and quickly feedbacks detailed information, improving the efficiency and accuracy of construction management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119091038A_ABST
    Figure CN119091038A_ABST
Patent Text Reader

Abstract

The invention provides a modeling system and method based on unmanned aerial vehicle oblique photography and a BIM + AR technology. The system comprises an aerial survey device, an AR augmentation device, an aerial survey and oblique photography modeling sub-module, a BIM modeling linkage sub-module and a reality augmentation feedback sub-module. The aerial survey device carries out aerial survey on the engineering site and generates image control points; the AR enhancement pair and the engineering field are subjected to detailed comparison, inspection and verification; the aerial survey and oblique photography modeling sub-module is used for performing high-precision modeling based on the image control points to generate an oblique photography model; the BIM modeling linkage sub-module is used for integrating the oblique photography model and the BIM model and realizing design line position adjustment based on an AI rapid identification technology; and the augmented feedback sub-module is used for carrying out augmented reality projection based on the BIM model, and carrying out part labeling through an AR augmentation device to realize multi-party linkage. According to the technical scheme provided by the invention, the problems of unmanned aerial vehicle oblique photography precision modeling and engineering construction guidance by BIM and AR technologies are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This document relates to the technical field of modeling systems, and in particular to a modeling system and method based on drone oblique photography and BIM+AR technology. Background Art

[0002] In the current engineering construction field, the application of drone oblique photography, BIM and AR technology has been increasing, but in most linear engineering construction, the above technologies are only used as auxiliary comparison reference or display function. The reasons are as follows:

[0003] In the construction and repair of linear projects, the construction sites are mostly in remote areas. It is impossible to extract accurate image control points during the oblique photography modeling process, resulting in insufficient modeling accuracy and inability to provide high-precision guidance for the proposed project.

[0004] Linear projects often need to be adjusted according to actual site conditions, but the adjustment content cannot be fed back in a timely and accurate manner on BIM and AR technology, thus losing the management and guidance functions.

[0005] Therefore, it is urgent to design a high-precision modeling method and linkage management method and supporting equipment based on drone oblique photography and BIM+AR technology to solve the problems existing in existing construction technology. Summary of the invention

[0006] The present invention provides a modeling system and method based on UAV oblique photography and BIM+AR technology, aiming to solve the above problems.

[0007] The present invention provides a modeling system based on unmanned aerial vehicle oblique photography and BIM+AR technology, comprising: an aerial survey device, an AR enhancement device, an aerial survey and oblique photography modeling submodule, a BIM modeling linkage submodule and a reality enhancement feedback submodule;

[0008] The aerial survey device is used to conduct aerial survey of the engineering site and generate image control points;

[0009] The AR enhancement device is used for detailed comparison, inspection and verification with the engineering site;

[0010] The aerial survey and oblique photography modeling submodule is used to perform high-precision modeling based on the image control points to generate an oblique photography model;

[0011] The BIM modeling linkage submodule is used to integrate the oblique photography model with the BIM model and realize the design line position adjustment based on AI rapid recognition technology;

[0012] The enhanced feedback submodule is used to perform reality augmented projection based on the BIM model, and to implement multi-party linkage management by performing part marking through an AR enhanced device.

[0013] The present invention provides a modeling method based on drone oblique photography and BIM+AR technology, and based on the above-mentioned modeling system based on drone oblique photography and BIM+AR technology, the steps include:

[0014] S1, the oblique photography UAV and the auxiliary positioning UAV perform aerial survey based on the pre-planned horizontal aerial survey route and aerial survey height difference, obtain aerial survey data, and correct the aerial survey data to obtain the oblique photography model;

[0015] S2. Obtaining the discrepancy between the proposed project and the actual situation based on the oblique photography model and the BIM model, and adjusting the design line position after locating the discrepancy, and,

[0016] S3. Linking the location information obtained by the oblique photography model to an AR enhancement device through a BIM model and an AR model.

[0017] The embodiment of the present invention utilizes a fleet of drone aerial survey machines, and the machines alternately advance and hover to form multiple spatial triangles for aerial survey, and generate a high-precision oblique photography model by providing precise image control points. The oblique photography model and the BIM model are linked by importing positioning points, and the planned line position and real-life information of the project are matched with high precision, and linkage feedback management is performed. Furthermore, based on the high-precision geographic information of the oblique photography model, AR equipment is used in conjunction with BIM management to conduct comparative analysis of the detailed structure reality enhancement at the construction site, and the detailed information is linked to achieve rapid information feedback management. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate one or more embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0019] Figure 1 is a schematic diagram of a modeling system based on drone oblique photography and BIM+AR technology according to an embodiment of the present invention;

[0020] Figure 2 is a top schematic diagram of a conventional oblique photography drone according to an embodiment of the present invention;

[0021] Figure 3 is a schematic diagram of the bottom of an auxiliary positioning drone according to an embodiment of the present invention;

[0022] Figure 4 is a UAV aerial survey route map according to an embodiment of the present invention;

[0023] Figure 5 This is a schematic diagram of the hovering sequence of a drone group flying in a staggered forward manner according to an embodiment of the present invention;

[0024] Figure 6 is a schematic diagram of a space triangle formed by alternating positions of drones according to an embodiment of the present invention;

[0025] Figure 7 2. It is a schematic diagram of anti-distortion of height difference control for aerial survey of a fleet of aircrafts according to an embodiment of the present invention;

[0026] Figure 8 is a schematic diagram of assisting UAV point position correction according to an embodiment of the present invention;

[0027] Fig. 9 is a flow chart of an aerial survey and oblique photography modeling system according to an embodiment of the present invention;

[0028] Fig.10 is a flow chart of a BIM modeling linkage system according to an embodiment of the present invention;

[0029] Fig.11 is a flow chart of an augmented reality (AR) feedback system according to an embodiment of the present invention;

[0030] Fig.12 3 is a schematic diagram of a modeling system based on drone oblique photography and BIM+AR technology according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the following will be combined with the drawings in one or more embodiments of this specification to clearly and completely describe the technical solutions in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this document.

[0032] Glossary:

[0033] 1. Oblique photography technology acquires rich high-resolution textures of building tops and side views by synchronously collecting images from one vertical, four oblique, and five different perspectives. It can not only truly reflect the ground conditions and obtain object texture information with high precision, but also generate a real 3D city model through advanced positioning, fusion, modeling and other technologies.

[0034] 2. BIM Model

[0035] Building Information Modeling (BIM) is a new tool for architecture, engineering and civil engineering. It is used to describe computer-aided designs that are mainly based on three-dimensional graphics, object-oriented, and related to architecture. The core of BIM is to establish a virtual three-dimensional model of the construction project and use digital technology to provide this model with a complete and actual construction project information database. This information database not only contains geometric information, professional attributes and status information describing the building components, but also contains status information of non-component objects (such as space and motion behavior). With the help of this three-dimensional model containing construction project information, the degree of information integration of construction projects has been greatly improved, thereby providing a platform for engineering information exchange and sharing for stakeholders in construction projects.

[0036] 3. Image control points

[0037] Image control points are the basis of photogrammetry control encryption and mapping. Image control points are mainly used to improve the accuracy and robustness of two-dimensional or three-dimensional reconstruction. Through image control points, the aerial triangulation results can be converted to a specified coordinate system, thereby improving the accuracy of the reconstruction results. Image control points include image plane control points with only plane coordinates, image elevation control points with only elevation, and image plane height control points with both plane coordinates and elevation. When performing a point-puncture operation, it is necessary to first find the predicted position of the image control point on the image, and then mark the point to determine the actual position of the image control point on the image. The accuracy of the point-puncture will directly affect the accuracy of the reconstruction result.

[0038] 4. Image control point puncture point

[0039] It refers to the process of accurately calibrating the position of image control points on the film in aerial photogrammetry. The process of pricking points usually requires the use of high-precision measuring instruments and techniques to ensure the accuracy and reliability of the pricking points. The location of the pricking points is usually selected on obvious feature points of the objects on the film, such as road intersections, building corners, telephone poles, etc. The purpose of pricking points is to accurately determine the position and posture of the film in the subsequent photogrammetry processing, thereby improving the accuracy and reliability of photogrammetry. The quality of the pricking points directly affects the results of photogrammetry, so it is necessary to strictly follow the operating procedures for pricking points and conduct quality inspection and control.

[0040] System Example

[0041] According to an embodiment of the present invention, a modeling system based on drone oblique photography and BIM+AR technology is provided. Figure 1 is a schematic diagram of a modeling system based on drone oblique photography and BIM+AR technology according to an embodiment of the present invention. Figure 1 It can be seen that the modeling system based on drone oblique photography and BIM+AR technology in the embodiment of the present invention specifically includes:

[0042] Aerial survey device, AR enhancement device, aerial survey and oblique photography modeling submodule, BIM modeling linkage submodule and reality augmented feedback submodule;

[0043] The aerial survey device is used to conduct aerial survey of the engineering site and generate image control points;

[0044] In the embodiment of the present invention, the aerial survey device includes a conventional oblique photography drone and two auxiliary positioning drone subsystems, wherein the auxiliary positioning drone subsystem is used to provide the spatial coordinates of the image control points. Figure 2 The top schematic diagram of a conventional oblique photography drone according to an embodiment of the present invention is shown. Figure 2 It can be seen that the conventional oblique photography drone 1 in the embodiment of the present invention is equipped with an oblique photography camera 2.

[0045] like Figure 3 The figure shows a schematic diagram of the bottom of the auxiliary positioning UAV in an embodiment of the present invention, wherein the auxiliary positioning UAV subsystem is composed of four parts: an auxiliary positioning UAV 3, an RTK measurement module 4, a laser ranging module 5 and a data processing module 6.

[0046] The RTK measurement module 4 is used to provide X, Y, and Z axis coordinates for assisting in positioning the position of the drone;

[0047] The laser ranging module 5 is used to provide the vertical distance of the ground corresponding to the position of the auxiliary positioning drone;

[0048] The data processing module 6 is used to calculate the X, Y, and Z axis coordinates of the ground position corresponding to the position of the auxiliary positioning drone, and store the data information.

[0049] The AR enhancement device is used for detailed comparison, inspection and verification with the engineering site;

[0050] The AR enhancement device in the embodiment of the present invention is composed of two parts: a display and management device and a GPS positioning module, which is used for linkage management of the model and the details of the on-site real scene. The display and management device is an electronic device with a display unit, including a touch function, for displaying and feedback management operations, and the GPS positioning module is integrated with the display and management device to locate the spatial coordinates of the device.

[0051] The aerial survey and oblique photography modeling submodule is used to perform high-precision modeling based on the image control points to generate an oblique photography model;

[0052] Fig. 9 is a flowchart of an aerial survey and oblique photography modeling system according to an embodiment of the present invention. Fig. 9 The specific implementation steps of the aerial survey and oblique photography modeling submodule in the embodiment of the present invention include:

[0053] S1. Planning of horizontal aerial survey route: Before the aerial survey operation, a route including aerial survey is planned first, with the oblique photography drone aerial survey route as the aerial survey centerline. Two auxiliary drones fly and hover along the aerial survey centerline in a staggered forward manner, and a spatial triangle is formed by alternating the positions of the drones. Figure 4 is a drone aerial survey route map according to an embodiment of the present invention, Figure 5 This is a schematic diagram of the hovering sequence of a drone group flying in a staggered forward manner according to an embodiment of the present invention;

[0054] S2. Control of height difference of aerial survey of fleet: The flying height of the oblique photography UAV in aerial survey should be higher than that of the two auxiliary positioning UAVs. At the same time, the aerial survey team needs to control the relative position relationship according to the aerial survey angle to avoid the position distortion of the auxiliary UAV photos caused by the distortion of the image edge or the shooting angle difference. The height difference should be greater than the horizontal distance between the two auxiliary positioning UAVs, preferably at an acute angle. Figure 7 It is a schematic diagram of anti-distortion of height difference control in aerial survey of a fleet of aircraft according to an embodiment of the present invention.

[0055] S3. Aerial survey data export: After completing the aerial survey, export POS data in the oblique photography drone

[0056] S4. Aerial survey data processing: Export the coordinate data of the hovering point corresponding to the ground in the auxiliary positioning drone and organize the data.

[0057] S5. Positioning data optimization: The auxiliary drone exports data as ground point coordinates. Its imaging point is in the air. After the imaging plane position is magnified by the photography angle, there is a deviation between the photo point and the data point, which needs to be corrected. Taking the oblique photography drone aerial survey point as the benchmark, the two positions formed by each hovering point after a position change of another drone and the distance between the hovering position and the ground are corrected. And generate the corrected virtual point on the image. Figure 8 Shown is a schematic diagram of assisting UAV point position correction according to an embodiment of the present invention.

[0058] S6. Rough modeling of aerial triangulation: Filter and integrate the POS data exported by the oblique photography drone, and generate a rough 3D view through the first spatial triangulation calculation. Figure 6 It is a schematic diagram of the alternate position transformation of the drones in an embodiment of the present invention to form a spatial triangle.

[0059] S7. Auxiliary UAV point correction modeling: Use the virtual points corrected by the auxiliary UAV as image control points, optimize the image and perform a second spatial triangulation calculation to reconstruct the three-dimensional model, define the model space framework and generate an oblique photography model (CC modeling).

[0060] The BIM modeling linkage submodule is used to integrate the oblique photography model with the BIM model and realize the design line position adjustment based on AI rapid recognition technology;

[0061] Fig.10 is a flow chart of the BIM modeling linkage system of an embodiment of the present invention, according to Fig.10 As shown, the specific implementation steps of the BIM modeling linkage submodule of the embodiment of the present invention include:

[0062] S1. Convert the generated oblique photography model (CC modeling) geographic coordinates into engineering coordinates.

[0063] S2. Verify the image control points, so that the BIM modeling information can be adapted at the software level.

[0064] S3. Import the proposed project modeling into CC modeling through the project coordinates and form a new modeling layer. Automatically analyze and identify the overlap of the two modeling layers to prompt any discrepancies between the proposed project design and the actual situation.

[0065] S4. In engineering projects, AI training, analysis and recognition are used to identify mountains, existing buildings, structures, buildings under construction, structures, cultivated land, forest land, etc., to avoid conflicts between incorrect identification and planned projects, which may lead to multiple errors.

[0066] S5. Export the model conflict problem to the corresponding CAD design drawing for positioning, combine the oblique photography model (CC modeling) and the BIM model for verification, adjust the design line position, and ensure the feasibility of the design drawing.

[0067] The enhanced feedback submodule is used to perform reality augmented projection based on the BIM model, and to implement multi-party linkage management by performing part marking through an AR enhanced device.

[0068] Fig.11 is a flowchart of an augmented reality (AR) feedback system according to an embodiment of the present invention. Fig.11 As shown, the specific implementation steps of the enhanced feedback submodule in the embodiment of the present invention include:

[0069] S1. Map the location information of the real-life viewpoint of the oblique photography model (CC modeling) into the BIM model.

[0070] S2. Convert the BIM model with positioning mapping points into augmented reality (AR) modeling and link it to the augmented reality (AR) device.

[0071] S3. By connecting the device to the BIM project management software, wearable devices or portable display devices can be used to compare, inspect and verify details between the augmented reality (AR) model and the on-site conditions at the project construction site.

[0072] S4. When the detailed nodes of the actual project structure do not match the natural environment, the part can be marked directly in the equipment.

[0073] S5. Feedback information to the models of all parties and export it to CAD drawings to form a rapid linkage management of engineering detail information.

[0074] The application system involved in the modeling system based on drone oblique photography and BIM+AR technology in the embodiment of the present invention includes three parts: aerial survey and oblique photography modeling system, BIM modeling linkage system, and augmented reality (AR) feedback system.

[0075] The aerial survey and oblique photography modeling system: through the horizontal aerial survey route planning, before the aerial survey operation, the aerial survey route is planned first, and the oblique photography drone aerial survey route is used as the aerial survey centerline. Two auxiliary drones fly and hover in a staggered forward manner along the aerial survey centerline direction, and the space triangle is formed by the alternating position of the drones. Please refer to Figures 4 to 6 . And through the control of the height difference of the aerial survey of the fleet, the position distortion of the auxiliary drone photos caused by the distortion of the image edge or the difference in shooting angle can be avoided. Please refer to Figure 7 ;

[0076] After completing the aerial survey, the POS data is exported from the oblique photography drone, and the aerial survey data is processed, that is, the coordinate data of the hovering point corresponding to the ground is exported from the auxiliary positioning drone and the data is sorted.

[0077] The data exported by the auxiliary drone is the coordinates of the ground point. Its imaging point is in the air. After the imaging plane position is magnified by the photography angle, there is a deviation between the photo point and the data point, which needs to be corrected. Based on the oblique photography drone aerial survey point, the two positions formed by each hovering point after the position change of another drone and the distance between the hovering position and the ground are corrected. And the corrected virtual point is generated on the image, please refer to Figure 8 ;

[0078] Aerial triangulation rough modeling: Filter and integrate the POS data exported by the oblique photography drone, calculate and generate a rough 3D view through the first spatial triangulation, use the virtual points corrected by the drone as image control points, optimize the image and perform the second spatial triangulation calculation, reconstruct the 3D model, define the model space framework and generate the oblique photography model (CC modeling);

[0079] Among them, the BIM modeling linkage system will convert the geographic coordinates of the generated model (CC modeling) into engineering coordinates, and verify it through image control points, and adapt the BIM modeling information through the software level.

[0080] The modeling of the proposed project is imported into CC modeling through the project coordinates and a new modeling layer is formed. The overlap of the two modeling layers is used for automatic analysis and identification to prompt the discrepancy between the design of the proposed project and the actual situation. In the water damage repair project, the AI ​​training analysis and recognition system is used to identify mountains, existing buildings, structures, buildings under construction, structures, cultivated land, forest land, etc., to avoid misidentification of conflicts between siltation and proposed projects, which leads to multiple errors.

[0081] The model conflict problem is further exported to the corresponding CAD design drawing for positioning, and verified by combining the oblique photography model (CC modeling) with the BIM model to adjust the design line position to ensure the feasibility of the design drawing;

[0082] The augmented reality (AR) feedback system uses the location information of the real-life viewpoints of the oblique photography model (CC modeling) to map the location to the BIM model, and converts the BIM model with the location mapping points into an augmented reality (AR) modeling and links it to the augmented reality (AR) device, and connects the device to the BIM project management software through wearable devices or portable display devices;

[0083] Then, at the project construction site, the augmented reality (AR) model is used to compare, inspect and verify the details with the on-site conditions. When the component type of the water damage repair project does not conform to the on-site conditions after dredging, such as the retaining wall form, retaining wall height, whether the retaining wall adds or removes the front ridge, etc., the part can be directly marked in the equipment, and the information can be fed back to the models of all parties and exported to CAD drawings, forming a fast linkage management of project detail information.

[0084] When a clear positioning mapping point cannot be found in the wilderness, the present invention additionally provides a positioning method through GPS, which gives engineering geographic information to the BIM model through an oblique photography model (CC modeling), and directly locates the real space model through a GPS locator of a wearable or portable display device, and locks it for use after fine-tuning.

[0085] The use of the embodiments of the present invention has the following beneficial effects: using a fleet of drone aerial survey machines, the machines alternately advance and hover to form multiple spatial triangles for aerial survey, and generate a high-precision oblique photography model by providing precise image control points. The oblique photography model and the BIM model are linked by importing positioning points, and the planned line position and real-life information of the project are matched with high precision, and linkage feedback management is performed. Based on the high-precision geographic information of the oblique photography model, AR equipment is used in conjunction with BIM management to conduct comparative analysis of detailed structure augmented reality (AR) on the construction site, and detailed information is linked to achieve rapid information feedback management.

[0086] Method Embodiment

[0087] According to an embodiment of the present invention, a modeling method based on drone oblique photography and BIM+AR technology is provided. Fig.12 is a flow chart of a modeling method based on drone oblique photography and BIM+AR technology according to an embodiment of the present invention. Fig.12 It can be seen that the modeling method based on drone oblique photography and BIM+AR technology in the embodiment of the present invention specifically includes:

[0088] S121, the oblique photography UAV and the auxiliary positioning UAV perform aerial survey based on the pre-planned horizontal aerial survey route and aerial survey height difference, obtain aerial survey data, and correct the aerial survey data to obtain the oblique photography model;

[0089] S121 specifically includes:

[0090] S1211. Planning of horizontal aerial survey routes: Before the aerial survey operation, a route including aerial survey shall be planned first, with the oblique photography drone aerial survey route as the aerial survey centerline. Two auxiliary drones will fly and hover in a staggered manner along the aerial survey centerline, and a spatial triangle will be formed by alternating the positions of the drones.

[0091] The assisted positioning drone integrates an RTK measurement system, a laser ranging and a data processing system, which can directly convert coordinate data and derive the geographic coordinates of the vertical position corresponding to the flight position. The RTK measurement terminal is integrated on the top of the drone, and a vertical laser rangefinder is carried on the bottom.

[0092] S1212. Altitude difference control of fleet aerial survey: During aerial survey, the flying altitude of the oblique photography UAV should be higher than that of the two auxiliary positioning UAVs. At the same time, the aerial survey team needs to control the relative position relationship according to the aerial survey angle to avoid position distortion of the auxiliary UAV photos caused by image edge distortion or shooting angle difference. The altitude difference should be greater than the horizontal distance between the two auxiliary positioning UAVs, preferably at an acute angle.

[0093] S1213, Aerial survey data export: After completing the aerial survey, export POS data in the oblique photography drone

[0094] S1214, aerial survey data processing: export the coordinate data of the hovering point corresponding to the ground in the auxiliary positioning UAV and organize the data.

[0095] S1215, Positioning data optimization: The auxiliary drone exports data as ground point coordinates. Its imaging point is in the air. After the imaging plane position is magnified by the photography angle, there is a deviation between the photo point and the data point, which needs to be corrected. Based on the oblique photography drone aerial survey point, the two positions formed by each hovering point after a position change of another drone and the distance between the hovering position and the ground are corrected. The corrected virtual point is generated on the image.

[0096] S1216, rough modeling of aerial triangulation: Filter and integrate the POS data exported by the oblique photography drone, and generate a rough 3D view through the first spatial triangulation calculation.

[0097] S1217, auxiliary drone point correction modeling: using the virtual points corrected by the auxiliary drone as image control points, optimize the image and perform a second spatial triangulation calculation to reconstruct the three-dimensional model, define the model space framework and generate an oblique photography model (CC modeling).

[0098] S122, obtaining the discrepancy between the proposed project and the actual situation based on the oblique photography model and the BIM model, and adjusting the design line position after locating the discrepancy;

[0099] S122 specifically includes:

[0100] S1221. Convert the generated geographic coordinates of the oblique photography model (CC modeling) into engineering coordinates.

[0101] S1222. Verify the image control points and adapt the BIM modeling information at the software level.

[0102] S1223. The modeling of the proposed project is imported into CC modeling through the project coordinates and a new modeling layer is formed. Automatic analysis and identification are performed through the overlap of the two modeling layers to prompt the discrepancy between the design of the proposed project and the actual situation.

[0103] S1224. In engineering projects, AI training, analysis and recognition are used to identify mountains, existing buildings, structures, buildings under construction, structures, cultivated land, forest land, etc., to avoid conflicts between incorrect identification and planned projects, which would lead to multiple errors.

[0104] S1225. Export the model conflict problem to the corresponding CAD design drawing for positioning, combine the oblique photography model (CC modeling) and the BIM model for verification, adjust the design line position, and ensure the feasibility of the design drawing.

[0105] S123, linking the location information obtained by the oblique photography model to the AR enhancement device through the BIM model and the AR model.

[0106] S123 specifically includes:

[0107] S1231. Map the location information of the real-life viewpoint of the oblique photography model (CC modeling) into the BIM model.

[0108] S1232. Convert the BIM model with the positioning mapping points into augmented reality (AR) modeling and link it to the augmented reality (AR) device.

[0109] S1233. By connecting the device to BIM project management software, wearable devices or portable display devices can be used to compare, inspect and verify details between the augmented reality (AR) model and the on-site conditions at the project construction site.

[0110] S1234. When the detailed nodes of the actual project structure do not match the natural environment, the part can be marked directly in the equipment.

[0111] S1235. Feedback information to the models of all parties and export it to CAD drawings to form rapid linkage management of engineering detail information.

[0112] The use of the embodiments of the present invention has the following beneficial effects: using a fleet of drone aerial survey machines, the machines alternately advance and hover to form multiple spatial triangles for aerial survey, and generate a high-precision oblique photography model by providing precise image control points. The oblique photography model and the BIM model are linked by importing positioning points, and the planned line position and real-life information of the project are matched with high precision, and linkage feedback management is performed. Based on the high-precision geographic information of the oblique photography model, AR equipment is used in conjunction with BIM management to conduct comparative analysis of detailed structure augmented reality (AR) on the construction site, and detailed information is linked to achieve rapid information feedback management.

[0113] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A modeling system based on drone oblique photography and BIM+AR technology, Features include: Aerial survey device, AR enhancement device, aerial survey and oblique photography modeling submodule, BIM modeling linkage submodule and reality augmented feedback submodule; The aerial survey device is used to conduct aerial survey of the engineering site and generate image control points; The AR enhancement device is used for detailed comparison, inspection and verification with the engineering site; The aerial survey and oblique photography modeling submodule is used to perform high-precision modeling based on the image control points to generate an oblique photography model; The BIM modeling linkage submodule is used to integrate the oblique photography model with the BIM model and realize the design line position adjustment based on AI rapid recognition technology; The enhanced feedback submodule is used to perform reality augmented projection based on the BIM model, and to implement multi-party linkage management by performing part marking through an AR enhanced device.

2. The system according to claim 1, It is characterized in that The aerial survey device specifically includes: a conventional oblique photography drone and an auxiliary positioning drone subsystem; The conventional oblique photography drone and the auxiliary positioning drone subsystem form multiple spatial triangles for aerial survey by alternately moving forward and hovering.

3. The system according to claim 2, It is characterized in that The auxiliary positioning UAV subsystem specifically includes: Assisted positioning of drones, RTK measurement module, laser ranging module and data processing module.

4. The system according to claim 3, It is characterized in that The RTK measurement module is used to provide X, Y, and Z axis coordinates for assisting in positioning the drone; The laser ranging module is used to provide a vertical distance from the ground to the location of the auxiliary positioning drone; The data processing module is used to calculate the X, Y, and Z axis coordinates of the ground position corresponding to the position of the auxiliary positioning drone, and store the data information.

5. The system according to claim 1, It is characterized in that The AR enhancement device specifically includes: a display management device and a GPS positioning module; The display management device is used to display and provide feedback on management operations; The GPS positioning module is used to locate the spatial coordinates of the location of the device.

6. A modeling method based on drone oblique photography and BIM+AR technology, It is characterized in that The method is based on the modeling system based on drone oblique photography and BIM+AR technology as described in any one of claims 1 to 5, and the steps include: S1, the oblique photography UAV and the auxiliary positioning UAV perform aerial survey based on the pre-planned horizontal aerial survey route and aerial survey height difference, obtain aerial survey data, and correct the aerial survey data to obtain the oblique photography model; S2. Obtaining the discrepancy between the proposed project and the actual situation based on the oblique photography model and the BIM model, and adjusting the design line position after locating the discrepancy, and, S3. Linking the location information obtained by the oblique photography model to an AR enhancement device through a BIM model and an AR model.

7. The method according to claim 6, It is characterized in that The oblique photography drone and the auxiliary positioning drone perform aerial survey based on the pre-planned horizontal aerial survey route and aerial survey height difference, and obtain aerial survey data specifically including: The horizontal aerial survey route is planned in advance, specifically including: using the oblique photography drone aerial survey route as the aerial survey centerline, two auxiliary drones fly and hover in a staggered forward manner along the aerial survey centerline, and forming a spatial triangle through the alternating positions of the drones; The aerial survey height difference control is performed on the oblique photography UAV and the auxiliary positioning UAV, specifically including: making the oblique photography UAV fly at a higher altitude than the two auxiliary positioning UAVs, and controlling the relative position relationship between the oblique photography UAV and the auxiliary positioning UAV according to the aerial survey angle.

8. The method according to claim 6, It is characterized in that The step of correcting the aerial survey data to obtain the oblique photography model specifically includes: After the oblique photography drone completes the aerial survey, export the POS data from the oblique photography drone; Exporting coordinate data of the hovering point of the auxiliary positioning drone corresponding to the ground, and sorting the coordinate data; The coordinate data is optimized, specifically including: taking the oblique photography drone aerial survey point as a reference, correcting the two positions formed by each hovering point after a position change of another drone and the distance between the hovering position and the ground, and generating a corrected virtual point on the image; The POS data is screened and integrated, and a rough 3D view is calculated and generated through a first spatial triangulation; The virtual points are used as image control points to optimize the rough 3D view and perform a second spatial triangulation calculation to reconstruct the three-dimensional model, define the model space framework and generate an oblique photography model.

9. The method according to claim 6, It is characterized in that The S2 specifically includes: Converting the geographic coordinates of the oblique photography model into engineering coordinates; Adapt the BIM modeling information by checking the image control points; The proposed project modeling is imported into the oblique photography model through the project coordinates to form a new modeling layer. The two modeling layers are overlapped to automatically analyze and identify the discrepancies between the proposed project and the actual situation. The inconsistencies are verified by combining the oblique photography model with the BIM model, and the design line positions are adjusted.

10. The method according to claim 6, It is characterized in that The S3 specifically includes: Mapping the oblique photography model position information into the BIM model; Link the BIM model with location information to the AR enhancement device; A detailed comparison is performed between the AR enhancement device and the on-site situation to obtain the suspicious location; marking the suspicious location; The suspicious locations are fed back to the models of all parties and exported to the CAD drawings.