A panoramic image processing method for underground engineering inspection matching working condition time series

Abstract

The present invention relates to the technical field of underground engineering risk inspection, and specifically to a method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, comprising the following steps: (1) creating a deep foundation pit BIM basic model with working condition information; (2) deploying the BIM basic model and setting up a backend server; (3) on-site inspection and uploading panoramic image data; (4) automatically converting the panoramic image to the BIM model coordinate system; (5) using the matching relationship established in step (3) through system software, querying the corresponding panoramic image data through the model working condition information and the shooting point, and providing a BIM and panoramic image analysis function that supports working condition changes. The present invention solves the problem of risk management judgment based on the angle and text description of the inspector's photo shooting by the acquisition of panoramic image data and the linkage application of the BIM model, increases the amount of information carried by the image, and makes engineering working condition deduction and risk development trend analysis more convenient and intuitive.

Description

Technical Field

[0001] The present invention relates to the technical field of underground engineering risk inspection, and in particular to a method for processing panoramic images of underground engineering inspections that matches working condition time sequence. Background Art

[0002] With the rapid development of urban construction, the development of underground space is accelerating. Underground projects, as key structures involved in the construction of super-high-rise buildings, rail transit, and urban underground road excavation, are the foundation and key to urban underground space development. These projects face extremely complex soil and water environments and surrounding environments, resulting in high project risks and significant construction challenges. To reduce project risks and improve project safety, all parties involved in the project generally conduct regular risk inspections to assess the safety status of underground projects. This work is of great significance in guiding construction.

[0003] Through research, it was found that at present, manual inspection technology is generally carried out in a regular manner, and the on-site situation is reflected through paper records, photos, etc. However, the traditional inspection model has certain disadvantages: (1) The photos taken during the inspection carry less information and cannot accurately and intuitively reflect the shooting location, which is not convenient for quickly understanding the risk situation and locating the location where the risk occurs; (2) The risk description and image acquisition method are more dependent on the experience and operational ability of the inspectors; (3) Risk information, occurrence location information, construction time and other information are not effectively used in comprehensive analysis, and their related factors have a great impact on engineering construction. Therefore, improving the risk inspection information collection, information expression and post-analysis capabilities is an important development direction in this technical field. Summary of the Invention

[0004] In order to overcome the defects of the above-mentioned prior art, the present invention provides a panoramic image processing method for underground engineering inspection that matches the working condition time sequence. The present invention adopts panoramic imaging means to increase the information carrying capacity while reducing the dependence on the photographer's engineering experience, and uses BIM technology for secondary development to form a multi-dimensional factor analysis method that is linked with working condition time information and engineering information model, thereby improving the level of refined management of risk inspections.

[0005] The technical solutions of the present invention are as follows:

[0006] A method for processing panoramic images of underground engineering inspections that matches working condition time sequence includes the following steps:

[0007] (1) Create a BIM foundation model of a deep foundation pit with working condition information;

[0008] (2) BIM basic model deployment and backend server construction;

[0009] (3) On-site inspection and panoramic image data upload;

[0010] (4) Automatic conversion of panoramic image and BIM model coordinate systems;

[0011] (5) By using the matching relationship established in step (3) through the system software, the corresponding panoramic image data is queried through the model working condition information and the shooting point, and a BIM and panoramic image analysis function that supports working condition changes is provided.

[0012] Furthermore, in the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, the step (1) of creating a deep foundation pit BIM basic model with working condition information specifically includes the following steps:

[0013] Use Revit to create a foundation pit engineering model with a unique identification code, configure the planned working condition information in the "Phasing" function, and specify a corresponding construction working condition for each engineering component; prepare an inspection route and shooting point plan, and add and place the shooting location model in the model according to the plan.

[0014] Furthermore, the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, the step (2) BIM basic model deployment and backend server construction, specifically further includes the following steps:

[0015] Import the model results of step (1) into the BIM visualization engine software.

[0016] Furthermore, in the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, when the model result of step (1) is imported into the BIM visualization engine software, the engine extracts the three-dimensional spatial parameter position parameter corresponding to the recorded shooting point, which is the x, y, and z coordinate values ​​in the Cartesian coordinate system.

[0017] Furthermore, the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, wherein the step (3) of on-site inspection and uploading of panoramic image data, specifically includes the following steps:

[0018] During the inspection, panoramic imaging camera equipment is used to quickly scan and shoot 720-degree panoramic photos of the site, and GPS is used to locate each shooting point on the construction site; panoramic photos are collected one by one through mobile modules and uploaded to the system's designated server. The working condition time sequence mapping relationship is established through the unique matching relationship between the stage information ID and the photo address.

[0019] Furthermore, in the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, the panoramic image camera device is a panoramic camera with image shooting and file exporting functions.

[0020] Furthermore, in the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, the mobile module is a Pano-on platform.

[0021] Furthermore, the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, wherein the (4) automatic conversion between the panoramic image and the BIM model coordinate system specifically includes the following steps:

[0022] The panoramic image ellipsoid coordinates and Cartesian coordinate conversion algorithm are used for conversion, and the angle information of the initial viewing angle is saved; in the model rendered by the BIM visualization engine, the center of the bounding box of the shooting position model in step (1) is used as the base point to obtain the engine lens camera parameters, and the Cartesian coordinate components in the visualization engine three-dimensional space are converted into panoramic image ellipsoid coordinate rotation components, and the components are used to control the angle of the panoramic image through the panoramic image engine interface, thereby realizing the use of BIM to synchronize and dynamically control the panoramic image rotation.

[0023] Furthermore, the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence uses a conversion algorithm between panoramic image ellipsoidal coordinates and Cartesian coordinates for conversion, and the conversion formula is shown as follows:

[0024]

[0025] Furthermore, in the above-mentioned method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, the step (5) further includes the following steps:

[0026] The corresponding panoramic image data is queried through the model working condition information and shooting points. According to the working condition ID recorded by the system, the panoramic image data associated with the working condition ID under the selected working condition is provided. The BIM engine zoom command is called to quickly locate the rotation center position, providing BIM and panoramic image analysis functions that support working condition changes, thereby realizing rapid query of panoramic information under different working conditions, and through the linkage control method of combining virtual and real three-dimensional models and panoramic images, the differences in working conditions and deduction situations can be quickly understood and analyzed.

[0027] Compared with the prior art, the present invention has the following beneficial effects:

[0028] (1) It solves the problem that risk management assessment work relies on the quality of information collected by inspectors (photo angles and text descriptions, etc.).

[0029] (2) Increase the amount of information carried by the pictures, and reduce the difficulty and time of patrol photography.

[0030] (3) Compared with ordinary panoramic image viewing, the present invention uses the BIM model to carry working condition information to enhance the time characteristics of the on-site panoramic image, making the engineering working condition deduction and risk development trend analysis more convenient and intuitive.

[0031] Furthermore, this invention utilizes a technical approach based on "operating condition information as the primary focus, panoramic imaging as the basis, and information models as the carrier" to enhance underground engineering inspection technology. Underground engineering differs from more common surface and underground projects. Underground engineering is constrained by water and soil environmental factors and the widespread variability of geotechnical structures in concealed areas. The structural state and safety risk level of underground projects fluctuate rapidly at different stages. The continuous changes in operating conditions and the time factor are of paramount concern in project risk management.

[0032] However, current similar technological inventions that only apply BIM or risk management technologies that combine BIM with monitoring and other means all evaluate the current safety status. On the one hand, the model does not carry time dimension information that reflects the timing of working conditions. On the other hand, in the later retrospective application of the construction process based on the model, it is impossible to restore the original construction status under specific time and specified working conditions simply through monitoring data or two-dimensional photos. The present invention utilizes the BIM model to carry the working condition time sequence information, and uses the panoramic image that is easy to operate during the inspection process as the construction original status data recording method. Through the implementation and collection of the inspection path, three-dimensional image data covering the underground project can be finally formed as the basis for reflecting the working condition. The mutual mapping relationship of the three dimensions of "panoramic image-working condition time sequence-information model" is realized through step 3, and the three-dimensional interactive control of the information model (covering design information, reflecting the construction status of the working condition model under ideal conditions, and providing accurate geographical location information) and the panoramic image (actual situation, reflecting the underground project diseases and progress) in the same system environment is realized through step 4, which improves the information model to carry the actual construction panoramic information corresponding to the working condition time sequence. At the same time, it also provides a new information collection method and an intuitive and detailed engineering working condition deduction and risk development trend analysis method for engineering inspection. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is a technical flow chart of the present invention;

[0034] Figure 2 This is a screenshot of the UIque ID field information provided in the foundation pit Revit in the embodiment;

[0035] Figure 3 This is a screenshot of the Revit "Phased" working condition data entry in the embodiment;

[0036] Figure 4 This is a screenshot of the BIMV engine model deployment and three-dimensional spatial parameter extraction of the shooting point in the embodiment;

[0037] Figure 5 Screenshots of quick query of panoramic information under different working conditions in the embodiment;

[0038] Figure 6 This is a screenshot of the linkage control method that combines the virtual and real aspects of the three-dimensional model and panoramic image in the embodiment. DETAILED DESCRIPTION

[0039] The following describes embodiments of the present invention in detail, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and are not to be construed as limiting the present invention.

[0040] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "clockwise", "counterclockwise" and the like to indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0041] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features being referred to. Thus, a feature specified as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "plurality" means two or more, unless otherwise explicitly specified.

[0042] In the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," "connect," "fixed," etc. should be understood broadly. For example, they may refer to fixed, detachable, or integral connections; mechanical or electrical connections; direct or indirect connections through an intermediary; or internal communication between two components. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on specific circumstances.

[0043] In the present invention, unless otherwise expressly specified or limited, a first feature being "above" or "below" a second feature may include the first and second features being in direct contact, or may include the first and second features being in contact not directly but through another feature between them. Furthermore, a first feature being "above," "above," and "above" a second feature may include the first feature being directly above or obliquely above the second feature, or may simply mean that the first feature is higher in level than the second feature. A first feature being "below," "below," and "below" a second feature may include the first feature being directly below or obliquely below the second feature, or may simply mean that the first feature is lower in level than the second feature.

[0044] Example

[0045] References Figure 1 The technical flow chart of the present invention is shown.

[0046] (1) According to the design / construction plan, create a foundation pit engineering model in Revit software with a unique identification code (the Uique ID field information provided in Revit), such as Figure 2 ;

[0047] (2) In the “Phasing” function of Revit software, according to the construction plan and schedule, the planned working condition information is configured for each component in the model, and a corresponding planned working condition is assigned to each engineering component as the basis for the time information association of the subsequent panoramic image data, such as Figure 3 ;

[0048] (3) Develop a risk inspection plan based on the characteristics of the deep foundation pit project, determine the inspection path and shooting point plan, and add and place shooting location family components in the model according to the plan as the basis for spatial information association of subsequent panoramic image data;

[0049] (4) Using a lightweight 3D rendering engine, the model results of steps 1 to 3 are imported into the BIM engine platform software, and the position parameters of the recorded shooting points are extracted in the 3D engine (the x, y, and z coordinate values ​​in the Cartesian coordinate system), such as Figure 4 ;

[0050] (5) GPS is used to locate each shooting point at the project site, and a fixed shooting base is placed to facilitate quick locating of the shooting location during subsequent regular inspection tasks. A MADV panoramic camera is used to shoot panoramic images at the designated location.

[0051] (6) Build the system backend and panoramic image database, use the Pano-on platform to extract the panoramic photos collected from the panoramic camera and upload them to the server one by one, record the URL address of the uploaded panoramic image file location, and configure WeChat and time series information for each image. Specific operations: create a database form, use the panoramic image ID as the primary key, associate the working condition ID, shooting location GUID and panoramic image upload location URL, and establish the working condition time series mapping relationship through the unique matching relationship between the stage information ID and the photo address;

[0052] (7) The system background builds a linkage control algorithm between the BIM model and the panoramic image, uses the BIM engine platform display interface to call the model rendered in step 4, and uses the iframe architecture to call the panoramic image window interface to access the panoramic image URL; uses the panoramic image ellipsoid coordinate and Cartesian coordinate conversion algorithm to convert,

[0053] The conversion formula is as follows:

[0054]

[0055] And save the angle information of the initial viewing angle; through BIMV screen mouse operation, take the center of the bounding box of the shooting position model as the base point, obtain the camera parameters of the engine camera, convert the Cartesian coordinate components in the visualization engine's three-dimensional space into panoramic image ellipsoid coordinate rotation components, and control the angle of the panoramic image through the Pano-on panoramic image engine interface, thereby realizing the synchronous dynamic control of the panoramic image rotation using BIM;

[0056] (9) Using the matching relationship established in step 6, the corresponding panoramic image data is queried through the model working condition information and the shooting point. According to the working condition ID recorded by the system, the panoramic image data associated with the working condition ID under the selected working condition is provided, and the BIM engine zoom command is called to quickly locate the rotation center position, providing BIM and panoramic image analysis functions that support working condition changes, thereby realizing rapid query of panoramic information under different working conditions (such as Figure 5 ), and through the linkage control method of combining the virtual and real of the three-dimensional model and the panoramic image (such as Figure 6 ) to quickly understand the differences in analysis conditions and deductions.

[0057] It can be seen from the above embodiments that the present invention solves the problem of risk management evaluation based on the acquisition of panoramic image data and the linkage application of BIM models, which requires the inspection personnel to take photos with angles and text descriptions, increases the amount of information carried by pictures, reduces the difficulty and shooting time of inspection photos, and uses the model to carry working condition information to enhance the time characteristics of on-site panoramic images, making engineering working condition deduction and risk development trend analysis more convenient and intuitive.

[0058] The above are only preferred embodiments of the present invention and cannot be used to limit the scope of protection of the present invention. That is, any simple equivalent changes and modifications made according to the claims and content of the present invention still fall within the scope of protection of the patent application of the present invention.

Claims

1. A method for processing panoramic images of underground engineering inspections that matches the working condition time sequence, characterized in that: The following steps are involved: (1) Create a BIM foundation model of a deep foundation pit with working condition information; (2) BIM basic model deployment and backend server construction; (3) On-site inspection and panoramic image data upload; (4) Automatic conversion of panoramic image and BIM model coordinate systems; (5) Using the matching relationship established in step (3), the system software queries the corresponding panoramic image data through the model working condition information and the shooting point, and provides a BIM and panoramic image analysis function that supports working condition changes; The step (1) creates a deep foundation pit BIM basic model with working condition information, specifically comprising the following steps: Use Revit to create a foundation pit engineering model with a unique identification code. Configure planned working condition information in the "Phasing" function, assigning a corresponding construction condition to each engineering component. Prepare an inspection route and photography point plan, and add and place photography location models in the model according to the plan. The step (2) of deploying the BIM basic model and setting up the backend server specifically includes the following steps: Import the model results of step (1) into the BIM visualization engine software; When the model result of step (1) is imported into the BIM visualization engine software, the engine extracts the three-dimensional space parameter position parameter corresponding to the recorded shooting point, which is the x, y, and z coordinate value in the Cartesian coordinate system; The step (3) of on-site inspection and uploading of panoramic image data specifically includes the following steps: During the inspection, panoramic imaging cameras are used to quickly scan and capture 720-degree panoramic photos of the site. GPS is used on-site to locate each shooting point. Mobile modules collect panoramic photos one by one and upload them to the system's designated server. A time-series mapping of working conditions is established through the unique matching relationship between the stage information ID and the photo address. The panoramic imaging camera device is a panoramic camera with image shooting and file exporting functions; The mobile module is the Pano-on platform; The automatic conversion of the panoramic image and the BIM model coordinate system (4) further includes the following steps: The panoramic image ellipsoid coordinates and Cartesian coordinates are converted using a conversion algorithm, and the angle information of the initial viewing angle is saved; in the model rendered by the BIM visualization engine, the center of the bounding box of the shooting position model in step (1) is used as the base point to obtain the engine lens camera parameters, and the Cartesian coordinate components in the visualization engine three-dimensional space are converted into panoramic image ellipsoid coordinate rotation components, and the components are used to control the angle of the panoramic image through the panoramic image engine interface, thereby realizing the use of BIM synchronous dynamic control of the panoramic image rotation; The conversion algorithm between panoramic image ellipsoidal coordinates and Cartesian coordinates is used for conversion. The conversion formula is shown below: The step (5) further comprises the following steps: The corresponding panoramic image data is queried through the model working condition information and shooting points. According to the working condition ID recorded by the system, the panoramic image data associated with the working condition ID under the selected working condition is provided. The BIM engine zoom command is called to quickly locate the rotation center position, providing BIM and panoramic image analysis functions that support working condition changes, thereby realizing rapid query of panoramic information under different working conditions, and through the linkage control method of combining virtual and real three-dimensional models and panoramic images, the differences in working conditions and deduction situations can be quickly understood and analyzed.

Images