Deformation information automatic recording system of concrete structure, and deformation information automatic recording method for concrete structure

Abstract

To reduce mobile work of a worker by remote measurement, to automatically calculate and record a deformation position and a deformation area.SOLUTION: A deformation information automatic recording system of a concrete structure comprises: position information data input means for inputting a 3D mesh model (3DM model) generated from point cloud data of 3D position information data of a concrete structure including a deformed area acquired by remote measurement; deformed area recognition means for rendering the input 3DM model onto a 2D image, and recognizing the deformed area on the 2D image after area division by performing area division on the 2D image; 3D meshing means for adding the deformed area on the recognized 2D image to a 3D mesh to create a 3DM model with area division; deformed area alignment means for selecting multiple corresponding points between a position of the created 3DM model and a position of a 3D design model of the concrete structure corresponding to a pre-stored 3DM model, and aligning them so as to minimize error; deformed area extraction means; and deformed area recording means.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an automatic recording system and a method for automatically recording deformation information of a concrete structure, and in particular to an automatic recording system and an automatic recording method suitable for automatically recording deformation position information and deformation area information of a concrete structure. [Background technology]

[0002] Conventionally, concrete structures such as bridges (bridge girders, piers, abutments), roads, tunnels, caissons, and buildings are subject to various types of deformation that progress over time, and therefore, in order to ensure the safety of the concrete structures, it is necessary to carry out repairs according to the state of deformation. The area in which the deformation part of the concrete structure is enclosed by a frame is called the deformation area. Types of deformation in the case of concrete members include bulging, cracking, swelling, peeling, spalling, deformation of members, discoloration (blackening, whitening), rust, occurrence of spring water (traces), and wetting. When repairing the deformation area, the area including the deformation part is enclosed by a square frame, and the surrounding area of ​​the deformation part is also repaired. An example of this deformation area is shown in FIG. 12. In the example of FIG. 12, a deformation part 122 is included in the deformation area 121, and the deformation area is located on the side of the superstructure of a road bridge. Traditionally, inspection of abnormalities has been carried out by workers through visual inspection or inspection using tools, but due to issues such as work time and cost, and the work site environment, electronic processing has recently begun to be used using imaging devices and / or image processing devices.

[0003] For concrete structures, for example road bridges, the Ministry of Land, Infrastructure, Transport and Tourism's Road Bureau's Guidelines for Periodic Inspection of Road Bridges stipulate the frequency of periodic inspections, the system for periodic inspections, understanding of the condition, diagnosis of soundness, and recording.

[0004] Conventionally, inspections of deformed areas of concrete structures were carried out as follows. First, a worker moves to the location of the concrete structure to be inspected, and manually measures the area of ​​the deformed area (deformed portion) with a tape measure (measuring device). Next, the worker manually calculates the area of ​​the deformed area from the manual measurements, and the measurements are manually entered and recorded in the inspection report. Next, the position of the deformed area is manually measured. In other words, the distance from a landmark point on the concrete structure to the deformed portion is measured with a tape measure (measuring device). Next, the position of the deformed area is calculated and recorded. The calculated measurement value of the position of the deformed area is manually recorded on a 2D drawing.

[0005] BIM / CIM, which was promoted by the Ministry of Land, Infrastructure, Transport and Tourism, will be applied to the construction and civil engineering industries and will become mandatory from 2023, and the introduction and use of 3D models is expected. BIM (Building / Construction Information Modeling) refers to the introduction of 3D models from the planning, investigation and design stages, and the utilization of these models while enriching information at each subsequent construction and maintenance stage, and the sharing of information among the parties involved throughout the entire project, thereby improving the efficiency and sophistication of work for both buyers and sellers in a series of construction production and management systems. Linking information on materials (parts) and other items to 3D models not only improves productivity but also quality. Linking various information (attribute information, etc.) to these 3D models and utilizing them is called BIM / CIM.

[0006] An example of such a technology related to CIM is a concrete structure management device that provides a technology that makes it easier for a manager to understand the inspection results and repair details of a concrete structure (Patent Document 1).

[0007] Also, an example of a method for detecting a deformed area on a concrete surface is disclosed in Patent Document 2. Patent Document 2 describes a technology for processing original image data obtained by capturing an image of a concrete surface such as a tunnel lining surface, and displaying a water leakage point from a crack or the like that has occurred on the concrete surface as a water leakage image of a predetermined shape and size. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2020-154465 A [Patent Document 2] JP 2012-202859 A Summary of the Invention [Problem to be solved by the invention]

[0009] However, conventional inspections of damaged areas of concrete structures required workers to travel to the site where the object to be inspected was located, manually measure the area of ​​damage, and manually record the measurements in the inspection report, or manually measure the location of the damage with a tape measure and manually record the measurements on a 2D drawing, which required a lot of worker movement and required a lot of labor.

[0010] However, the technology disclosed in Patent Document 1 displayed on a screen two-dimensional or three-dimensional images of the inspection results and repair details of a selected part of a concrete structure, associated with the selected part, but did not take into consideration the automatic recording of the position or area of ​​deformation.

[0011] The above-mentioned Patent Document 2 is capable of detecting water leakage points on the concrete surface of a tunnel lining or the like, but is unable to detect defects on the concrete surface.

[0012] Therefore, the present invention has been devised in consideration of the above-mentioned problems, and its object is to provide an automatic recording system and a method for automatically recording information on deformation of a concrete structure that can reduce the amount of movement required by workers through remote measurement, automate the calculation and recording of the position and area of ​​deformation, and thereby shorten working hours and reduce labor. [Means for solving the problem]

[0013] The automatic recording system for deformation information of a concrete structure according to the first invention is characterized in that it comprises: a position information data input means for inputting a 3D mesh model generated from point cloud data of three-dimensional position information data of a concrete structure including a deformation area obtained by remote measurement; a deformation area recognition means for rendering the 3D mesh model input by the position information data input means into a 2D image and recognizing a deformation area on the 2D image after area division by performing area division; a 3D meshing means for adding the deformation area on the 2D image recognized by the deformation area recognition means to a 3D mesh to create a 3D mesh model with area division; a deformation area alignment means for selecting a plurality of corresponding points between the position of the 3D mesh model created by the 3D meshing means and the position of a 3D design model of the concrete structure corresponding to the 3D mesh model stored in advance, and aligning them so as to minimize an error; a deformation area extraction means for extracting the area of ​​the deformation area of ​​the 3D design model in which the error has been minimized by the deformation area alignment means; and a deformation area recording means for recording the area of ​​the deformation area extracted by the deformation area area extraction means.

[0014] The automatic recording system for deformation information of concrete structures according to the second invention is characterized in that, in the first invention, the deformation area extraction means encloses the deformation area of ​​the 3D design model in which the error has been minimized in a convex hull, and extracts the area of ​​the portion of the 3D design model inside the convex hull.

[0015] The automatic recording system for deformation information of concrete structures according to the third invention is characterized in that, in the first or second invention, the deformation area recognition means further has artificial intelligence (AI) that assists the user in the area division, and the area division is performed while assisting the user with the artificial intelligence (AI).

[0016] The automatic recording system for deformation information of concrete structures according to the fourth invention is characterized in that, in the first invention, the 3D meshing means projects the deformation area on the divided 2D image onto a 3D mesh to generate a 3D mesh model with division.

[0017] The automatic recording system for deformation information of a concrete structure according to the fifth invention is characterized in that, in the first invention, the deformation area alignment means selects approximately three corresponding points between the position of the 3D mesh model and the position of the 3D design model, and minimizes the error between the selected corresponding points.

[0018] The method for automatically recording information on deformation of a concrete structure according to the sixth aspect of the present invention includes a position information data input step of inputting a 3D mesh model generated from point cloud data of three-dimensional position information data of a concrete structure including a deformation area obtained by remote measurement; a deformation area recognition step of rendering a 2D image from the 3D mesh model input by the position information data input step and recognizing a deformation area on the 2D image after area division by performing area division; a 3D meshing step of adding a 3D mesh to the deformation area on the 2D image recognized by the deformation area recognition step to create a 3D mesh model with area division; a deformation area alignment step of selecting a plurality of corresponding points between the position of the 3D mesh model created by the 3D meshing step and the position of a 3D design model of the concrete structure corresponding to the 3D mesh model stored in advance, and aligning them so as to minimize an error; a deformation area extraction step of extracting the area of ​​the deformation area of ​​the 3D design model in which the error has been minimized by the deformation area alignment step; and a deformation area recording step of recording the area of ​​the deformation area extracted by the deformation area area extraction step. Effect of the Invention

[0019] According to the first to sixth inventions, remote measurement reduces the amount of movement required by workers and makes it possible to automate the calculation and recording of the deformation location and deformation area, thereby shortening work time and reducing labor. [Brief description of the drawings]

[0020] [Figure 1]FIG. 1 is a block diagram showing the overall configuration of a concrete structure deformation information automatic recording system according to this embodiment. [Diagram 2] FIG. 2 is a schematic diagram of a concrete structure management device storing 3D design model data in this embodiment. [Diagram 3] FIG. 3 is a flowchart showing the processing operations of the concrete structure deformation information automatic recording system in this embodiment. [Figure 4] FIG. 4 is a diagram showing an example of the hardware configuration of the automatic recording system for deformation information of a concrete structure in the present embodiment shown in FIG. [Diagram 5] FIG. 5 is a diagram showing the overall processing flow of the concrete structure deformation information automatic recording system in this embodiment. [Figure 6] FIG. 6 is a diagram showing the flow of the process of recognizing a modified region. [Figure 7] FIG. 7 is a diagram showing an example of a deformation region including a recognized deformation portion. [Figure 8] FIG. 8 is a diagram showing a process flow of the 3D mesh generation unit. [Figure 9] FIG. 9 is a diagram showing a flow of processing by the abnormality area alignment unit. [Figure 10] Fig. 10(a) is a diagram showing the flow of convex hull processing in the deformed area extracting unit, and Fig. 10(b) is a diagram showing the flow of area extraction processing in the deformed area extracting unit. [Figure 11] FIG. 11 is a diagram showing an example of the extracted affected area. [Figure 12] FIG. 12 is a diagram showing an example of a deformed region including a deformed portion. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, a system for automatically recording information on deformation of a concrete structure to which the present invention is applied will be described in detail with reference to the drawings.

[0022] <Present embodiment> FIG. 1 is a diagram showing the overall configuration of an automatic deformation information recording system to which the present invention is applied.

[0023] <Configuration of this embodiment> In the automatic deformation information recording system 3 of this embodiment, as shown in FIG. 1, a measuring device 1 as a remote measuring device and a concrete structure management device 2 are connected via a communication network 4. The measuring device 1 can use various measuring devices such as a digital camera for taking multi-viewpoint images, a three-dimensional laser measuring device, a total station, a digital camera or laser measuring instrument mounted on a drone, and a camera mounted on a robot. Still images taken by video shooting with a digital video camera, still images in video shooting mode of a digital camera, images taken by workers with a digital camera, etc. may also be used. In the case of multi-viewpoint images taken with a digital camera, multiple multi-viewpoint images are integrated to create three-dimensional position information, or position information is obtained separately and a 3D mesh model is created from the three-dimensional position information. The concrete structure management device 2 stores a 3D design model (for example, 3D CAD data) of a concrete structure, and is managed in association with inspection data and repair data. These 3D design models can be used to construct a BIM / CIM system and utilize data, and can be deployed to improve efficiency and sophistication by model linkage between surveying, investigation processes, planning and design processes, maintenance and management processes, and construction processes as necessary. The concrete structure management device 2 may be provided on a cloud server to construct a system accessible from anywhere, or the automatic deformation information recording system 3 and the concrete structure management device may be integrated. Here, the concrete structure is, for example, a bridge or building made of concrete, or a part of these. In this embodiment, an example will be described in which there is a deformation area on the side of the superstructure of a road bridge as shown in FIG. 12, and there is a deformation area therein. Specifically, an example will be described in which the deformation part of the concrete is missing (chipped).

[0024] In detail, as shown in Figure 1, the automatic deformation information recording system 3 of this embodiment has a location information data input unit 31, a deformation area recognition unit 32, a 3D meshing unit 33, a deformation area alignment unit 34, a deformation area extraction unit 35, a deformation area recording unit 36, and a deformation area output unit 37.

[0025] <Description of the configuration of this embodiment> The position information data input unit 31 inputs a 3D mesh model generated from point cloud data of three-dimensional position information data of a concrete structure including a deformation area obtained by remote sensing.

[0026] The deformed area recognition unit 32 renders a 2D image from the 3D mesh model input by the position information data input unit 31, and recognizes the deformed area on the 2D image after area division by dividing the area. The deformed area recognition unit 32 further has an artificial intelligence (AI) that assists the user in the area division, and performs area division while assisting the user with the artificial intelligence (AI).

[0027] The 3D mesh generation unit 33 creates a 3D mesh model with area division by adding the deformed area on the 2D image recognized by the deformed area recognition unit 32 to a 3D mesh. The 3D mesh generation unit 33 projects the deformed area on the 2D image that has been divided into areas onto the 3D mesh, and generates a 3D mesh model with area division.

[0028] The deformed area alignment unit 34 selects multiple corresponding points between the position of the 3D mesh model created by the 3D meshing unit 33 and the position of a 3D design model of a concrete structure corresponding to the 3D mesh model stored in advance, and performs alignment so as to minimize error. The deformed area alignment unit 34 selects about three corresponding points between the position of the 3D mesh model and the position of the 3D design model, and minimizes the error between the selected corresponding points.

[0029] The deformed area extraction unit 35 extracts the area of ​​the deformed area of ​​the 3D design model in which the error has been minimized by the deformed area alignment unit 34. For example, the deformed area extraction unit 35 may enclose the deformed area of ​​the 3D design model in which the error has been minimized by the deformed area alignment unit 34 in a convex hull, and extract the area of ​​the 3D design model portion inside the convex hull.

[0030] The deformed area recording unit 36 ​​records the area of ​​the deformed area extracted by the deformed area area extracting unit 35 .

[0031] The deformation area output unit 37 stores the area of ​​the deformation area extracted by the deformation area area extraction unit 35 via the communication network 4 in a storage unit of the concrete structure management device or the like.

[0032] <Concrete structure management device of this embodiment> FIG. 2 is a block diagram of the concrete structure management device of FIG.

[0033] 2, the concrete structure management device 2 includes a control unit 21, a reception unit 22, a display processing unit 23, a storage unit 24, a storage unit 25, and a communication unit 26. Here, the concrete structure management device 2 may be configured on a cloud server.

[0034] The control unit 21 controls the entire system.

[0035] The reception unit 22 receives a selection operation by a user of a concrete structure displayed on the screen. Here, the user includes a site supervisor, a data manager, a system engineer, a construction worker, a maintenance inspector, a maintenance manager, and the like.

[0036] The display processing unit 23 displays an image of a 3D design model (for example, 3D CAD data) showing a concrete structure stored in the storage device 24 on a screen.

[0037] The display processing unit 23 includes at least a 3D design model (e.g., 3D CAD data) showing a concrete structure stored in the storage device 24. In addition, it has a database in which various data for planning, design, construction, and maintenance are accumulated. Repair data and the like are also stored in association with the design data.

[0038] The storage unit 25 stores the deformed area (information) output from the deformed area output unit 37 of the deformation information automatic recording system 3 in the storage device 24.

[0039] The communication unit 26 transmits the 3D design model (3D CAD data) and the like stored in the storage device 24 to the deformation information automatic recording system 3 under the control of the control unit 21.

[0040] <This embodiment of the method for automatically recording deformation information> FIG. 3 is a process flow chart of the method for automatically recording deformation information according to this embodiment. The process flow will be described below according to the flowchart in FIG. 3. The following series of processes are performed by executing the software for automatically recording deformation information. The overall flow is shown in FIG. 5. That is, in the example of FIG. 5, position information data (multiple-viewpoint images or 3D mesh model from laser measurement) acquired by remote measurement is input. The 3D mesh model is rendered into a 2D image, the deformation area is recognized on the software, 2D->3D conversion is performed, and a 3D mesh model with area division of the concrete structure is generated. A 3D design model of the corresponding concrete structure (a structure without a deformation area) stored in a concrete structure management device or the like is input, and the area of ​​the deformation area is automatically extracted from the 3D design model with area division, and automatic recording can be performed. An example of the output result is shown. When the deformation ID is "001", the deformation area is 0.5 m 2 When the deformation ID is "002", the deformation area is 1m 2 , Deformation ID "003, 0.3m 2 , When the deformation ID is "004", 0.4m 2 It is as follows.

[0041] First, a position information data input step is executed to input a 3D mesh model generated from point cloud data of three-dimensional position information data of a concrete structure including a deformation area obtained by remote sensing (step 301).

[0042] Next, as shown in Fig. 6, a 2D image is rendered from the 3D mesh model input in the position information data input step 301, and a deformed area recognition step is executed in which area division is performed on the 2D image to recognize the deformed area on the divided 2D image (step 302). The recognition result is shown in Fig. 7. In the example of Fig. 7, the area of ​​the deformed area 72 containing a deformed portion 71 (defect) can be automatically calculated using a 3D design model without the defect, making it possible to reduce the number of work steps.

[0043] Next, as shown in FIG. 8, a 3D meshing step is executed in which the affected area on the 2D image recognized in the affected area recognition step is assigned to a 3D mesh to create a 3D mesh model with area division (step 303).

[0044] Next, as shown in FIG. 9, a step of selecting multiple corresponding points between the position of the 3D mesh model created by the 3D meshing step 303 and the position of a 3D design model of a concrete structure corresponding to the 3D mesh model stored in advance, and performing a deformed area alignment step to minimize the error (step 304).

[0045] Next, as shown in Fig. 10(a), the deformed area of ​​the 3D design model in which the error has been minimized by the deformed area alignment step 304 is wrapped in a convex hull, and as shown in Fig. 10(b), a deformed area extraction step is executed to extract the area of ​​the 3D design model portion inside the convex hull (step 304). The result of this deformed area extraction is shown in Fig. 11. In the deformed area extraction step 304, the deformed area of ​​the 3D design model in which the error has been minimized is wrapped in a convex hull, and the area of ​​the 3D design model portion inside the convex hull is extracted, but the area of ​​the deformed area of ​​the 3D design model in which the error has been minimized may be automatically extracted.

[0046] Next, a modified area recording step is executed to record the area of ​​the modified area extracted in the modified area area extracting step 305 (step 306).

[0047] Furthermore, a step of outputting a deformation area may be executed (step 307) to output the area of ​​the deformation area extracted by the step of extracting the area of ​​the deformation area 305. The result obtained by this can be stored in the concrete structure management device.

[0048] As shown in Fig. 4, the automatic deformation information recording system 3 includes a housing 40, a CPU (Central Processing Unit) 41, a ROM (Read Only Memory) 42, a RAM (Random Access Memory) 43, a storage unit 44, and interface I / Fs 45 to 47. The CPU 41, the ROM 42, the RAM 43, the storage unit 44, and the interface I / Fs 45 to 47 are connected by an internal bus 50. The example in Fig. 4 shows an example in which the automatic deformation information recording system 3 is realized by hardware such as a personal computer (PC), a tablet PC, or a desktop PC.

[0049] The CPU 41 controls the entire automatic deformation information recording system 3. The ROM 42 stores the operation code of the CPU 41. The RAM 43 is a working area used when the CPU 41 is operating. The storage unit 44 stores data of 3D mesh models and 3D design models (3D CAD data) and various information. The storage unit 44 may be, for example, a data storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), an SD card, or a miniSD card. For example, the automatic deformation information recording system 3 may have a GPU (Graphics Processing Unit) (not shown).

[0050] The interface I / F 45 is an interface for transmitting and receiving various information to and from the measuring device 1, etc. The I / F 46 is an interface for transmitting and receiving information to and from the input unit 48. For example, a keyboard is used as the input unit 48, and a user using the automatic deformation information recording system 3 inputs various information or control commands for the automatic deformation information recording system 3 via the input unit 48. The I / F 47 is an interface for transmitting and receiving various information to and from the display unit 49. The display unit 49 outputs various information such as the judgment results stored in the storage unit 44, or various processing statuses of the automatic deformation information recording system 3. A display is used as the display unit 49, and may be, for example, a touch panel type.

[0051] The storage unit 44 stores, for example, three-dimensional position information and a 3D design model acquired from the measurement device 1, as well as algorithms used to calculate the position of deformation and the area of ​​deformation.

[0052] The display unit 49 displays various information, such as the calculation results of the deformation position and the deformation area.

[0053] <Effects of the embodiment> According to this embodiment, remote measurement reduces the amount of movement required by workers, and calculation and recording of the deformation location and deformation area can be automated, shortening work time and reducing labor. In addition, since most of the work is done on the software, it is possible to perform the work by one person. [Explanation of symbols]

[0054] 1. Measurement equipment 2. Concrete structure management device 3. Automatic Deformation Information Recording System 4. Communication Network 21 Control section 22 Reception 23 Display processing section 24 Storage device 25 Storage Department 26 Communications Department 31 Location information data input section 32 Deformed area recognition unit 33 3D Meshing Section 34 Deformed area alignment section 35 Deformation area extraction part 36 Deformation Area Recording Section 37 Deformation area output section 40 Case 41 CPU 42 ROM 43 RAM 44 Preservation Department 45, 46, 47 Interfaces 48 Input section 49 Display section 50 Internal Bus 71 Deformed area 72 Deformed area 121 Deformed area 122 Deformed area

Claims

1. A position information data input means for inputting a 3D mesh model generated from point cloud data of three-dimensional position information data of a concrete structure including a deformation area obtained by remote measurement; A deformed area recognition means for rendering a 2D image from the 3D mesh model input by the position information data input means and recognizing a deformed area on the 2D image after the area division by performing area division on the 2D image; A 3D meshing means for creating a 3D mesh model with area division by assigning the deformation area on the 2D image recognized by the deformation area recognition means to a 3D mesh; A deformation area alignment means for selecting a plurality of corresponding points between the position of the 3D mesh model created by the 3D meshing means and the position of a 3D design model of a concrete structure corresponding to the 3D mesh model stored in advance, and aligning the positions so as to minimize an error; A deformation area extraction means for extracting the area of ​​the deformation area of ​​the 3D design model in which the error has been minimized by the deformation area alignment means; A deformed area recording means for recording the area of ​​the deformed area extracted by the deformed area extraction means; An automatic recording system for deformation information of a concrete structure, comprising:

2. The automatic recording system for deformation information of concrete structures according to claim 1, characterized in that the deformation area extraction means encloses the deformation area of ​​the 3D design model in which the error has been minimized in a convex hull and extracts the area of ​​the 3D design model portion inside the convex hull.

3. The deformation area recognition means further has an artificial intelligence (AI) that assists a user in the area division, and performs area division while assisting a user with the artificial intelligence (AI).

3. The automatic recording system for information on deformation of a concrete structure according to claim 1 or 2.

4. The 3D mesh generation means projects the affected area on the divided 2D image onto a 3D mesh to generate a 3D mesh model with area division.

2. The system for automatically recording information on deformation of a concrete structure according to claim 1 .

5. The deformation region alignment means selects approximately three corresponding points between the position of the 3D mesh model and the position of the 3D design model, and minimizes an error between the selected corresponding points.

2. The system for automatically recording information on deformation of a concrete structure according to claim 1 .

6. A position information data input step of inputting a 3D mesh model generated from point cloud data of three-dimensional position information data of a concrete structure including a deformation area obtained by remote measurement; A deformation area recognition step of rendering a 2D image from the 3D mesh model input by the position information data input step and recognizing a deformation area on the 2D image after area division by performing area division on the 2D image; A 3D meshing step of assigning the deformation area on the 2D image recognized by the deformation area recognition step to a 3D mesh to create a 3D mesh model with area division; A deformation area alignment step of selecting a plurality of corresponding points between the position of the 3D mesh model created by the 3D meshing step and the position of a 3D design model of a concrete structure corresponding to the 3D mesh model stored in advance, and aligning the positions so as to minimize an error; A deformation area extraction step of extracting an area of ​​the deformation area of ​​the 3D design model in which the error has been minimized by the deformation area alignment step; A deformed area recording step of recording the area of ​​the deformed area extracted by the deformed area extraction step; A method for automatically recording information on deformation of a concrete structure, comprising:

Images