Repair drawing generation device, repair drawing generation method, and program

The repair drawing generation device automates the creation of repair diagrams and cost estimates by analyzing damage and specifying repair methods, addressing the inefficiencies of manual processes.

JP7595730B2Active Publication Date: 2024-12-06FUJIFILM CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023184779
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-07-25
Filing Date
2023-10-27
Publication Date
2024-12-06
Estimated Expiration
2040-06-03

AI Technical Summary

Technical Problem

Existing methods fail to accurately generate repair drawings indicating the actual repair area and method based on detected damage, requiring manual intervention and lacking efficiency.

Method used

A repair drawing generation device and method that includes image acquisition, damage detection, and repair diagram generation, utilizing image processing to identify damage extent and repair methods, and automatically creating repair diagrams and cost calculations.

Benefits of technology

Accurately and efficiently generates repair diagrams and cost estimates by detecting damage and specifying repair methods, reducing manual effort and improving precision.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007595730000001
    Figure 0007595730000001
  • Figure 0007595730000002
    Figure 0007595730000002
  • Figure 0007595730000003
    Figure 0007595730000003
Patent Text Reader

Abstract

To provide a repair diagram generation device for accurately and efficiently generating a repair diagram showing a repair area and a repairing method for performing repair from a photographed image of a structure, a repair diagram generation method, and a program.SOLUTION: A repair diagram generation device (10) includes: an image acquiring unit (12) for acquiring a photographed image of a structure; a damage detecting unit (20A) for detecting damage from the photographed image by image processing to specify a degree of the damage; a method specifying unit (20B) for specifying a repairing method for the damage based the damage and the degree of the damage; and a repair diagram generation unit (20C) for generating a repair diagram showing a repair area for repairing the damage and the repairing method based on the damage and the repairing method.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a repair drawing generating device, a repair drawing generating method, and a program, and in particular to a repair drawing generating device, a repair drawing generating method, and a program for generating a repair drawing from an image of a structure. [Background technology]

[0002] Conventionally, a technique has been used in which images of a structure to be inspected are acquired and damage such as cracks is detected based on the images.

[0003] For example, Patent Document 1 describes a technique for photographing a structure, detecting defects from the photographed image, and simply and accurately calculating the cost of repairing the defects. In the technique described in Patent Document 1, a photographed image of an evaluation target is acquired, and the number, type, and size of damage present in the photographed image are detected by a method such as pattern extraction. Then, the repair cost is calculated based on the number, type, and size of the detected damage. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2002-222281 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology described in Patent Document 1, the repair cost is calculated based on the size of the detected damage, but the size of the damage that is actually repaired may differ from the size of the detected damage. For example, when repairing a peeled part of a concrete wall, the surrounding area of ​​the peeled part may also be repaired.

[0006] In addition, repair plans and pre-repair survey reports may be prepared using repair drawings that indicate the actual repair area and repair method, and in such cases, repair drawings must be generated. However, the technology described in Patent Document 1 does not generate repair drawings that indicate the repair area and repair method, and the user must manually generate the repair drawings, for example.

[0007] The present invention has been made in consideration of the above circumstances, and its object is to provide a repair drawing generation device, a repair drawing generation method, and a program that accurately and efficiently generate repair drawings indicating the repair areas and repair methods to be performed from photographed images of a structure. [Means for solving the problem]

[0008] To achieve the above-mentioned objective, one aspect of the present invention, a repair drawing generation device, comprises an image acquisition unit that acquires a photographed image of a structure, a damage detection unit that detects damage from the photographed image by image processing and identifies the extent of the damage, a method identification unit that identifies a repair method for the damage based on the damage and its extent, and a repair drawing generation unit that generates a repair drawing indicating the repair area and repair method for repairing the damage based on the damage and the repair method.

[0009] According to this aspect, the damage detection unit detects damage and identifies the extent of the damage. Then, this aspect identifies a repair method for the damage based on the damage and the extent of the damage, and accurately and efficiently generates a repair drawing showing a repair area and a repair method for repairing the damage based on the damage and the repair method.

[0010] Preferably, when the damage is a plurality of cracks in the captured image and the plurality of cracks are close to each other within a threshold value, the repair diagram generating unit generates a repair diagram by connecting the close cracks to each other.

[0011] Preferably, the repair drawing generating unit generates the repair drawing by setting an area larger than the shape of the damage as the repair area.

[0012] Preferably, the repair drawing generating device includes a repair calculation unit that calculates a size of a repair area based on the repair drawing, and a repair quantity table generating unit that generates a repair quantity table including the size of the repair area.

[0013] Preferably, the repair diagram generating device includes a repair cost calculation unit that calculates the repair cost of the damage based on the size of the repair area and the repair method.

[0014] Preferably, the repair drawing generating device includes a first display control unit configured to display at least one of a repair drawing, a repair quantity table, and a repair cost on the display unit as the first detection result.

[0015] Preferably, the repair diagram generating device includes a damage diagram generating unit configured to generate a damage diagram representing the damage based on the damage.

[0016] Preferably, the repair diagram generating device includes a damage quantity table generating unit for generating a damage quantity table including the degree of damage.

[0017] Preferably, the repair drawing generating device includes a second display control unit configured to display at least one of the damage drawing and the damage quantity table on the display unit as the second detection result.

[0018] Preferably, the first display control unit and the second display control unit switch between displaying the first detection result and the second detection result.

[0019] Preferably, the first display control unit and the second display control unit simultaneously display the first detection result and the second detection result side by side.

[0020] Preferably, the repair drawing generating device includes a first edit receiving unit configured to receive an instruction to edit the first detection result.

[0021] Preferably, the repair drawing generating device includes a second edit receiving unit configured to receive an instruction to edit the second detection result.

[0022] Preferably, the repair drawing generating device includes a panorama synthesis unit that synthesizes the plurality of photographed images acquired by the image acquisition unit into a panorama.

[0023] Another aspect of the present invention, a repair drawing generation method, includes an image acquisition step of acquiring a photographed image of a structure, a damage detection step of detecting damage from the photographed image by image processing and identifying the extent of the damage, a method identification step of identifying a repair method for the damage based on the damage and its extent, and a repair drawing generation step of generating a repair drawing indicating the repair area and repair method for repairing the damage based on the damage and the repair method.

[0024] Another aspect of the present invention is a program that causes a computer to execute a repair drawing generation process, including an image acquisition step of acquiring a photographed image of a structure, a damage detection step of detecting damage from the photographed image by image processing and identifying the extent of the damage, a method identification step of identifying a repair method for the damage based on the damage and its extent, and a repair drawing generation step of generating a repair drawing indicating the repair area and repair method for repairing the damage based on the damage and the repair method. Effect of the Invention

[0025] The present invention uses a damage detection unit to detect damage and identify the extent of the damage, identify a repair method for the damage based on the damage and its extent, and accurately and efficiently generate a repair drawing showing the repair area and repair method for repairing the damage based on the damage and the repair method. [Brief description of the drawings]

[0026] [Figure 1] FIG. 1 is a conceptual diagram showing a computer on which a repair drawing generating device is installed. [Diagram 2] FIG. 2 is a block diagram showing an example of a hardware configuration of a computer. [Diagram 3] FIG. 3 is a diagram showing a schematic diagram of a captured image. [Figure 4] FIG. 4 is a block diagram showing an example of the main configuration of a repair drawing generating device. [Diagram 5]FIG. 5 is a flowchart showing an example of the repair method selection process. [Figure 6] FIG. 6 is a diagram for explaining an example of creating a crack repair diagram. [Figure 7] FIG. 7 is a diagram for explaining an example of creating a repair diagram for peeling. [Figure 8] FIG. 8 is a diagram showing an example of a repair drawing. [Figure 9] FIG. 9 is a flowchart illustrating the repair drawing generating method. [Figure 10] FIG. 10 is a block diagram showing an example of the main configuration of a repair drawing generating device. [Figure 11] FIG. 11 is a chart showing an example of a repair quantity table. [Figure 12] FIG. 12 is a diagram illustrating an example of the storage configuration of the repair cost database. [Figure 13] FIG. 13 is a diagram showing a modified example of the repair quantity table. [Figure 14] FIG. 14 is a block diagram illustrating an example of a main functional configuration of a repair drawing generating device. [Figure 15] FIG. 15 is a diagram showing a damage diagram. [Figure 16] FIG. 16 is a diagram showing a damage quantity table. [Figure 17] FIG. 17 shows an example of a display in which a repair diagram is superimposed on a photographed image. [Figure 18] FIG. 18 shows an example of a display in which a damage diagram is superimposed on a photographed image. [Figure 19] FIG. 19 is a diagram conceptually showing the alternating display of the first detection result and the second detection result. [Figure 20] FIG. 20 is a diagram showing a case where the first detection result and the second detection result are displayed side by side at the same time. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of a repair drawing generating device, a repair drawing generating method, and a program according to the present invention will be described with reference to the accompanying drawings.

[0028] 1 is a conceptual diagram showing a computer 1 on which a repair drawing generating device 10 (see FIG. 4) according to an embodiment of the present invention is installed. The computer 1 includes a computer main body 1a, a display unit 3, and an operation unit 5.

[0029] The display unit 3 is composed of various monitors such as a liquid crystal monitor that can be connected to the computer 1. The display unit 3 displays a photographed image of the structure. The display unit 3 also displays at least one of the first detection results, which are a repair drawing, a repair quantity table, and repair costs. The display unit 3 also displays at least one of the second detection results, which are a damage drawing and a damage quantity table.

[0030] The operation unit 5 is composed of a keyboard, a mouse, etc., which are connected by wire or wirelessly to the computer 1. The user can check the first and second detection results displayed on the display unit 3 and input corrections, etc., via the operation unit (first edit receiving unit, second edit receiving unit) 5 to correct or change the first and second detection results.

[0031] FIG. 2 is a block diagram showing an example of a hardware configuration of the computer 1. As shown in FIG.

[0032] The hardware configuration of the computer 1 mainly comprises an image acquisition unit 12, a memory unit 16, an operation unit 5, a CPU (Central Processing Unit) 20, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 24, and a display unit 3.

[0033] The image acquisition unit 12 corresponds to an input / output interface, and in this example, acquires images captured by a camera (not shown) wirelessly or via a wired connection. The camera acquires images of a structure to be inspected. The image acquisition unit 12 may acquire images that are divided images obtained by dividing and photographing the structure to be inspected, or may acquire images in which the structure is captured in a single image. Structures to be inspected are, for example, buildings, bridges, and tunnels.

[0034] 3 is a diagram showing a schematic image of a part of a bridge, which is a structure to be inspected, captured by the image capture unit 12. In the captured image P, cracks J1 to J5 and peeling K1 are captured.

[0035] The storage unit 16 is a storage unit 16 composed of a hard disk device, a flash memory, etc., and stores programs that cause the repair drawing generation device 10 to function, such as an operating system, a damage detection program, a repair drawing generation program, a repair method selection program, a repair quantity table generation program, a database for calculating repair costs, a damage drawing generation program, a damage quantity table generation program, etc. Note that the various programs may be recorded and distributed on an external recording medium (not shown) and installed by the CPU 20 from the recording medium. Alternatively, the various programs may be stored in a server or the like connected to a network in an externally accessible state, downloaded to the storage unit 16 by the CPU 20 upon request, and installed and executed.

[0036] The CPU 20 reads various programs stored in the storage unit 16 or the ROM 24, etc., and controls each unit. The CPU 20 also executes various processes for generating a first detection result (repair drawing, repair quantity table, or repair cost) and a second detection result (damage drawing or damage quantity table), which will be described later.

[0037] The RAM 22 is used as a working area for the CPU 20, and is used as a storage unit for temporarily storing read programs and various data.

[0038] <First embodiment> Next, the repair drawing generating device 10 according to the first embodiment of the present invention will be described.

[0039] FIG. 4 is a block diagram showing an example of the main configuration of the repair drawing generating device 10 of this embodiment.

[0040] The repair drawing generating device 10 mainly includes an image acquiring unit 12 and a CPU 20. The CPU 20 of this embodiment executes various programs stored in the storage unit 16 or the ROM 24, etc., so that the CPU 20 functions as a damage detecting unit 20A, a construction method identifying unit 20B, a repair drawing generating unit 20C, and a first display control unit 20D.

[0041] The damage detection unit 20A detects damage from the captured image by image processing and identifies the degree of the detected damage. The damage detection unit 20A is constructed according to the type of damage to be detected. For example, the damage detection unit 20A is constructed by an AI (artificial intelligence) detector that has been subjected to machine learning to detect various types of damage. Specific examples of detectors include a peeling detector, a rebar exposure detector, a water leakage detector, and a free lime detector, and the damage detection unit 20A is constructed by one or more detectors.

[0042] The damage detection unit 20A detects damage and identifies the degree of the detected damage. Here, the degree of damage includes information such as the actual length, width, area, and depth of the damage, the presence or absence of rebar corrosion, and the presence or absence of rust fluid, and includes items used for selecting a repair method to be described later.

[0043] The damage detection unit 20A is constructed with a crack detector and a peeling detector, and detects cracks J1 to J5 and peeling K1 from the captured image P. For example, the damage detection unit 20A detects cracks J1 to J5 with the crack detector, and detects peeling K1 with the peeling detector. Then, the damage detection unit 20A identifies the extent of the cracks J1 to J5 with the crack detector, and the extent of the peeling K1 with the peeling detector.

[0044] The damage detection unit 20A outputs the type and extent of the damage to the construction method specification unit 20B.

[0045] The method specifying unit 20B specifies a repair method for the damage based on the detected damage. Specifically, the method specifying unit 20B selects a repair method for the damage based on the damage and the extent of the damage, using a repair method selection program stored in the storage unit 16.

[0046] FIG. 5 is a flowchart showing an example of a repair method selection process. Note that FIG. 5 is a flowchart cited from the Bridge Repair and Strengthening Manual (Civil Engineering Department of Nagasaki Prefecture).

[0047] First, when the damage detected by the damage detection unit 20A is "crack", "floor slab crack", or "leakage / free lime", the method identification unit 20B determines whether the presence or absence of steel bar corrosion and rust juice has been detected by the damage detection unit 20A (step S10). And when there is no steel bar corrosion and rust juice, the method identification unit 20B selects that the repair will be performed by the crack repair method (step S11). Next, the method identification unit 20B determines the width of the crack (step S12). When the width t of the crack detected by the damage detection unit 20A is t ≤ 0.2 mm, the method identification unit 20B basically selects not to perform the repair (step S13). Also, when the crack width t is 0.2 mm < t < 0.5 mm, the method identification unit 20B selects the crack injection method (step S14). Also, when the crack width t is 0.5 mm ≤ t, the method identification unit 20B selects the crack filling method (step S15).

[0048] Here, the crack injection method is a method of cutting the concrete along the crack and injecting the repair material at a predetermined injection pressure using a dedicated jig. Also, the crack filling method is a method of cutting the concrete along the crack and filling the repair material into that part.

[0049] On the other hand, when the type of damage detected by the damage detection unit 20A is "peeling / rebar exposure" or "lifting", and also when the type of damage is "crack", "floor slab crack", or "leakage / free lime" and there is steel bar corrosion and rust juice, the method identification unit 20B selects the cross-section repair method (step S16). Next, the method identification unit 20B determines the depth and area of the defective part detected by the damage detection unit 20A (step S17). When the area of the defective part is 0.5 m 2 or less, the plastering method is selected (step S18). Also, when the depth of the defective part is 3 - 5 cm and the area of the defective part is 0.5 m2 If the depth of the missing part is 5 cm or more and the area of ​​the missing part is 0.5 m or less, the formwork injection method is selected (step S19). 2 If so, the prepacked concrete method is selected (step S20).

[0050] Here, the plastering method is a method of applying a cross-section repair material, the formwork injection method is a method of installing a formwork and injecting an injection material, and the prepacked concrete method is a method of repair using concrete made by first pouring coarse aggregate into a formwork and then injecting and filling it with mortar.

[0051] 5 is one specific example, and the selection of the repair method is not limited to this, and various repair methods can be used. Information required for selecting the repair method is acquired from the damage detection unit 20A or the input by the user via the operation unit 5.

[0052] Returning to FIG. 4, the repair drawing generating unit 20C generates a repair drawing showing a repair area and a repair method for repairing the damage based on the detected damage and the repair method. The repair drawing generating unit 20C generates a repair drawing by various methods. For example, the repair drawing generating unit 20C generates a repair drawing for each damage from the photographed image P by a repair drawing generator that has been subjected to machine learning. That is, in this case, the repair drawing generating unit 20C generates a repair drawing directly from the photographed image P. In addition, the repair drawing generating unit 20C generates a repair drawing for the detected damage by performing a predetermined process on the damage detected from the photographed image P. A specific example of repair drawing generation will be described below. Note that the repair drawing generating unit 20C does not generate a repair drawing for damage that is selected not to be repaired by the work method specifying unit 20B, for example, as in step S13 described in FIG. 5.

[0053] Fig. 6 is a diagram for explaining an example of creating a crack repair drawing. Fig. 6(A) shows cracks J3 and J4, and Fig. 6(B) shows repair drawing A2. Repair drawing A2 is generated in repair drawing generating unit 20C based on cracks J3 and J4.

[0054] As shown in FIG. 6, the end 31 of the crack J3 and the end 33 of the crack J4 are close to each other, so that the repair drawing A2 is generated in which the crack J3 and the crack J4 are joined. In this way, when the cracks are close to each other, even if they are not connected on the surface (on the photographed image), the cracks are connected inside, and in this case, extra filler or the like is required. Therefore, when the damage detected by the damage detection unit 20A is a plurality of cracks in the photographed image and the plurality of cracks are close to each other below the threshold, the repair drawing generation unit 20C connects the close cracks to generate a repair drawing. This allows the user to obtain an accurate repair area and appropriately prepare filler or the like. The threshold value is determined by the user based on the structure to be inspected and the material of the structure. When the cracks are joined to each other, the directionality near the crack ends may also be taken into consideration. Specifically, when the angle difference between the directional vectors near the crack ends is equal to or less than a threshold value, the repair drawing generating unit 20C joins the cracks to generate a repair drawing.

[0055] Repair diagram A2 shows that cracks J3 and J4 are to be repaired by the crack repair work. For example, repair diagram A2 is shown by a red line, which indicates that the area of ​​repair diagram A2 is to be repaired by the crack repair work.

[0056] Fig. 7 is a diagram for explaining an example of creating a repair diagram for the peeling K1. Note that Fig. 7 shows only the area of ​​the peeling K1.

[0057] FIG. 7 shows the damaged area of ​​the peeling K1, and the circumscribed rectangular area 35 of the shown damaged area is shown by a dotted line. When the peeling K1 is repaired, it is repaired by one of the cross-section repair methods, but the area to be repaired (concrete is chipped) is larger than the actual area of ​​the peeling K1. Therefore, the repair drawing generating unit 20C generates a repair drawing D1 that is an area expanded up, down, left, and right to the outside of the circumscribed rectangular area 35 by +α mm. Note that α for expanding the circumscribed rectangular area 35 is a predetermined value and can be adjusted by the user. Also, α for expanding the circumscribed rectangular area 35 may be automatically determined according to the area of ​​the damaged area, etc. In this case, for example, the larger the area of ​​the damaged area, the larger the value of α is set. Note that the repair drawing D1 is represented by, for example, a blue line, which indicates that the area of ​​the repair drawing D1 is repaired by the cross-section repair work.

[0058] Returning to Fig. 4, the first display control unit 20D displays the first detection result (at least one of the repair drawing, the repair quantity table, and the repair cost) on the display unit 3. For example, the first display control unit 20D displays the repair drawing on the display unit 3. The repair quantity table and the repair cost will be described later.

[0059] 8 is a diagram showing an example of a repair drawing Q corresponding to a photographed image P. The repair drawing Q includes a repair drawing A1, a repair drawing A2, and a repair drawing D1.

[0060] The repair drawing generation unit 20C generates a repair drawing A1 based on cracks J1 and J2. Since cracks J1 and J2 are adjacent to each other at a distance equal to or less than the threshold value, a single repair drawing A1 is generated. Furthermore, the repair drawing generation unit 20C generates a repair drawing A2 based on cracks J3 and J4. Since cracks J3 and J4 are adjacent to each other at a distance equal to or less than the threshold value, a single repair drawing A2 is generated. Furthermore, the repair drawing A1 and the repair drawing A2 are represented by, for example, red lines, indicating that they will be repaired by crack repair work.

[0061] In addition, the repair drawing generating unit 20C does not generate a repair drawing corresponding to the crack J5. This is because the width of the crack J5 is equal to or smaller than the threshold value, and no repair drawing is performed (for example, step S13 in FIG. 5), so no repair drawing is created.

[0062] The repair drawing generating unit 20C generates a repair drawing D1 based on the peeling K1. The area shown by the repair drawing D1 is an area extending α mm outward from the circumscribing rectangle of the peeling K1 in all directions. The repair drawing D1 is shown, for example, in blue lines, indicating that the area will be repaired by cross-section repair work.

[0063] FIG. 9 is a flowchart illustrating a repair drawing generating method (repair drawing generating step) using the repair drawing generating device 10.

[0064] First, the image acquisition unit 12 acquires a photographed image of the structure (image acquisition step: step S10). Then, the damage detection unit 20A detects damage from the photographed image by image processing and identifies the degree of the detected damage (damage detection step: step S11). Next, the method identification unit 20B identifies a repair method for the damage (method identification step: step S12). Then, the repair drawing generation unit 20C generates a repair drawing showing a repair area for repairing the damage (repair drawing generation step: step S13).

[0065] In the above embodiment, the hardware structure of the processing units (e.g., the damage detection unit 20A, the construction method identification unit 20B, the repair drawing generation unit 20C, and the first display control unit 20D) that execute various processes is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processes such as an ASIC (Application Specific Integrated Circuit).

[0066] One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be composed of one processor. As an example of multiple processing units being composed of one processor, first, as represented by a computer such as a client or a server, one processor is composed of a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units in one IC (Integrated Circuit) chip. In this way, the various processing units are composed of one or more of the above various processors as a hardware structure. Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit (circuitry) that combines circuit elements such as semiconductor elements.

[0067] The above-mentioned configurations and functions can be realized by any hardware, software, or a combination of both. For example, the present invention can be applied to a program that causes a computer to execute the above-mentioned processing steps (processing procedures), a computer-readable recording medium (non-transitory recording medium) on which such a program is recorded, or a computer on which such a program can be installed.

[0068] As described above, the damage detection unit 20A detects cracks J1 to J5 and peeling K1 from the captured image P and identifies a repair method for repairing the cracks J1 to J5 and peeling K1, and the repair drawing generation unit 20C can accurately and efficiently generate repair drawings A1, A2, and D1.

[0069] <Second embodiment> Next, a description will be given of a second embodiment of the repair drawing generating device 10. In this embodiment, a repair quantity table, which is the first detection result, and repair costs are generated.

[0070] FIG. 10 is a block diagram showing an example of the main configuration of a repair drawing generating device 10 according to this embodiment.

[0071] The same reference numerals are used for the parts already described in FIG. 4, and the description thereof will be omitted.

[0072] The repair drawing generating device 10 mainly includes an image acquisition unit 12 and a CPU 20. The CPU 20 of this embodiment executes various programs stored in the storage unit 16 or the ROM 24, etc., so that the CPU 20 functions as a damage detection unit 20A, a construction method specification unit 20B, a repair drawing generating unit 20C, a first display control unit 20D, a repair calculation unit 20E, a repair quantity table generating unit 20F, and a repair cost calculation unit 20G.

[0073] The repair calculation unit 20E calculates the size of the repair area based on the repair drawing. The repair calculation unit 20E calculates the size of the actual repair based on the repair drawing. For example, the repair calculation unit 20E calculates the width, length and area of ​​the area to be actually repaired from the width, length and area of ​​the damage drawing. For example, the repair calculation unit 20E has a relational expression between the length of the repair drawing and the length on the actual structure, and calculates the width, length and area of ​​the area to be actually repaired from the repair drawing using the relational expression. The relational expression is acquired by various methods. For example, the relational expression can be acquired by acquiring actual size information per pixel of the photographed image P (or the panoramic composite image in the case of panoramic synthesis), or by acquiring size information of a part or the whole of the structure shown in the photographed image P (or the panoramic composite image) and converting it into actual size information per pixel.

[0074] The repair quantity table generating unit 20F generates a repair quantity table including the repair method of the damage and the size of the repair area. Specifically, the repair quantity table generating unit 20F converts the information contained in each repair drawing into text information and creates a table.

[0075] FIG. 11 is a chart showing an example of a repair quantity table corresponding to the repair drawing Q.

[0076] The repair quantity table shown in FIG. 11 has items such as repair ID, repair method type, and size of the repair area (width, length, and area), and information corresponding to each item is recorded for each repair location (repair drawing). The repair ID is an individual ID assigned to each repair drawing. The repair method type indicates the repair method of each repair drawing identified by the method identification unit 20B. The size (width, length, and area) indicates the size of the repair area calculated by the repair calculation unit 20E.

[0077] 10, the repair cost calculation unit 20G calculates the repair cost of the damage based on the size of the repair area and the repair method. The repair cost calculation unit 20G calculates the repair cost by referring to the repair cost database stored in the storage unit 16 based on the size of the repair area and the repair method.

[0078] FIG. 12 is a diagram illustrating an example of the storage configuration of the repair cost database.

[0079] In the example shown in FIG. 12, major repair method categories, minor repair method categories, and unit repair costs are stored in association with each other.

[0080] If the repair method category is crack repair and the subcategory is crack injection, the repair cost is calculated at 10,000 yen / m. If the repair method category is crack repair and the subcategory is crack filling, the repair cost is calculated at 25,000 yen / m. If the repair method category is cross-section repair and the subcategory is plastering, the repair cost is calculated at 50,000 yen / m. 2 , and if the repair method subcategory is formwork injection method, the cost is 150,000 yen / m 2 , and if the repair method subcategory is prepacked concrete method, it is 300,000 yen / m 2 Repair costs will be incurred.

[0081] It should be noted that the above-mentioned repair cost database is merely an example, and other repair cost databases can also be used in the present invention.

[0082] FIG. 13 is a diagram showing a modification of the repair quantity table shown in FIG.

[0083] The modified example of the repair quantity table shown in Fig. 13 has items of repair ID, repair method type, size of the repair area (width, length and area), and repair cost, and information corresponding to each item is described for each repair location (repair drawing). The repair cost item shows the repair cost corresponding to each repair drawing calculated by the repair cost calculation unit 20G. In this way, the repair quantity table generation unit 20F generates a repair quantity table including the repair cost calculated by the repair cost calculation unit 20G, so that the user can check the repair cost corresponding to each repair drawing.

[0084] As described above, the repair quantity table is generated and displayed on the display unit 3, allowing the user to check the repair drawings as text information. In addition, the repair cost of each repair drawing is calculated and displayed on the display unit 3, allowing the user to check the repair cost of each repair drawing.

[0085] <Third embodiment> Next, a description will be given of a third embodiment of the repair diagram generating device 10. In this embodiment, a damage diagram and a damage quantity table, which are the second detection results, are generated.

[0086] Fig. 14 is a block diagram showing an example of the main functional configuration of the repair drawing generating device 10. Note that the same reference numerals are used for the parts that have already been explained in Fig. 4 and Fig. 10, and the explanation thereof will be omitted.

[0087] The repair drawing generating device 10 mainly includes an image acquisition unit 12 and a CPU 20. The CPU 20 of this embodiment executes various programs stored in the storage unit 16 or the ROM 24, etc., so that the CPU 20 functions as a damage detection unit 20A, a construction method specification unit 20B, a repair drawing generating unit 20C, a first display control unit 20D, a repair calculation unit 20E, a repair quantity table generating unit 20F, a repair cost calculation unit 20G, a damage drawing generating unit 20H, a damage quantity table generating unit 20I, and a second display control unit 20J.

[0088] Damage diagram generation unit 20H generates a damage diagram representing damage based on the damage detected by damage detection unit 20A. Damage diagram generation unit 20H generates a damage diagram corresponding to the damage detected by damage detection unit 20A by a known method. For example, if the damage is a crack, damage diagram generation unit 20H generates a damage diagram showing the damage with a line, and if the damage is peeling, damage diagram generation unit 20H generates a damage diagram showing the periphery of the peeling area with a line. Specific examples of damage diagrams generated by damage diagram generation unit 20H are described below.

[0089] FIG. 15 is a diagram showing a damage diagram S generated by the damage diagram generating unit 20H based on the photographed image P.

[0090] Damage diagram S corresponds to photographed image P, and has damage diagrams C1-C5 corresponding to cracks J1-J5, and damage diagram H1 corresponding to peeling K1. Damage diagrams C1-C5 are indicated by red lines, for example, and are shown to be damage diagrams of cracks. Damage diagram H1 is indicated by blue lines, for example, and is shown to be damage diagram of peeling.

[0091] Returning to FIG. 14, the damage quantity table generating unit 20I generates a damage quantity table including damage and the degree of damage.

[0092] FIG. 16 is a diagram showing a damage quantity table corresponding to the damage diagram S.

[0093] The damage quantity table shown in FIG. 16 has items such as damage ID, damage type, and damage extent (size) (width, length, and area), and information corresponding to each item is recorded for each damaged location (damage diagram).

[0094] Returning to FIG. 14, the second display control unit 20J displays at least one of the damage diagram and the damage quantity table on the display unit 3 as the second detection result.

[0095] As described above, in this embodiment, a damage diagram and / or a damage quantity table are generated and displayed on the display unit 3. With the damage diagram displayed on the display unit 3, the user can more clearly confirm the damage, and can use the damage diagram to create reports, etc. Furthermore, with the damage quantity table displayed on the display unit 3, the user can confirm the damage as text information.

[0096] <First application example> In this example, the repair diagram Q or damage diagram S is displayed superimposed on the photographed image P. A specific example will be described below.

[0097] FIG. 17 shows a display example in which a repair diagram Q is displayed superimposed on a photographed image P. The first display control unit 20D displays the repair diagram Q on the display unit 3 superimposed on the photographed image P. The first display control unit 20D displays the repair diagram A1 (shown by dotted lines) superimposed on the cracks J1 and J2. The first display control unit 20D also displays the repair diagram A2 (shown by dotted lines) superimposed on the cracks J3 and J4. The first display control unit 20D also displays the repair diagram D1 (shown by solid lines) superimposed on the peeling K1. Note that no repair diagram is generated for crack J5 since no repair is performed. In this way, by displaying the repair diagram generated by the repair diagram generation unit 20C superimposed on the photographed image P, the user can more clearly grasp the relationship between the damage and the repair diagram.

[0098] FIG. 18 shows a display example in which a damage diagram S is displayed superimposed on a photographed image P. The second display control unit 20J displays the damage diagram S on the display unit 3 superimposed on the photographed image P. The second display control unit 20J displays a damage diagram C1 (shown by dotted line) on the crack J1 and a damage diagram C2 (shown by dotted line) on the crack J2. The second display control unit 20J also displays a damage diagram C3 (shown by dotted line) on the crack J3 and a damage diagram C4 (shown by dotted line) on the crack J4. The second display control unit 20J also displays a damage diagram C5 (shown by dotted line) on the crack J5. The first display control unit 20D also displays a damage diagram H1 (shown by dotted line) on the peeling K1. In this manner, by displaying the damage diagram generated by the damage diagram generating unit 20H superimposed on the photographed image P, the user can clearly grasp the relationship between the damage and the damage diagram.

[0099] Here, the photographed image P to be displayed in a superimposed manner as described above may be one photographed image, or a plurality of photographed images may be panoramic-combined and a repair diagram or damage diagram may be superimposed on the panoramic image. The panorama composition unit (not shown) is realized by the CPU 20, and performs panoramic composition of the plurality of photographed images acquired by the image acquisition unit 12.

[0100] <Second application example> In this example, the first detection result and the second detection result are displayed alternately or simultaneously. For example, the repair diagram Q is displayed alternately or simultaneously as the first detection result, and the damage diagram S is displayed alternately or simultaneously as the second detection result. The repair diagram shows the repair area and the repair method for repairing the damage, and the damage diagram shows the damage, so that they are used for different purposes. For example, the repair diagram is used for repair design and pre-repair investigation. Therefore, the repair diagram converts the result of the damage detection into information on the repair location or area according to the repair method and outputs it so that the length or area of ​​the repair target can be grasped. On the other hand, the damage diagram is used for inspection, diagnosis, repair design, and pre-repair investigation. Therefore, the repair diagram outputs the result of faithfully detecting the damage (crack lines, damage area) so that the extent to which the damage has progressed compared to the past can be grasped. In this example, the repair diagram and the damage diagram, which have different properties, are displayed alternately or simultaneously in this way, thereby improving convenience for the user. The alternate display of the first detection result and the second detection result, and the simultaneous display of the first detection result and the second detection result side by side will be described below.

[0101] FIG. 19 is a diagram conceptually showing the alternating display of the first detection result and the second detection result.

[0102] As shown in Fig. 19, the first display control unit 20D and the second display control unit 20J switch between displaying the first detection result and displaying the second detection result. The timing of the switching can be adjusted as appropriate. For example, the display is switched by the user instructing the timing of the switching via the operation unit 5.

[0103] FIG. 20 is a diagram showing a case where the first detection result and the second detection result are displayed side by side at the same time.

[0104] As shown in Fig. 20, the first display control unit 20D and the second display control unit 20J display the first detection result and the second detection result side by side at the same time. Note that in Fig. 20, the first detection result and the second detection result are side by side in the horizontal direction, but this example is not limited to this. The first detection result and the second detection result may be side by side in the vertical direction.

[0105] Although the present invention has been described above with reference to examples, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present invention.

[0106] From the above description, it is possible to understand the repair drawing generation device described in the following supplementary items 1 to 14. [Additional note 1] A camera for acquiring an image of the structure; A processor, The processor Damage is detected from the captured images through image processing, and the extent of the damage is identified. Identifying repair methods for the damage based on the damage and the extent of the damage; A repair diagram generating device that generates a repair diagram indicating a repair area and a repair method for repairing the damage based on the damage and the repair method. [Additional note 2] The processor is a repair drawing generation device described in appendix 1, which, when the damage is multiple cracks in the captured image and the multiple cracks are close to each other within a threshold value, connects the close cracks to generate a repair drawing. [Additional note 3] The repair diagram generating device according to claim 1 or 2, wherein the processor generates a repair diagram by treating an area larger than the shape of the damage as a repair area. [Additional note 4] The processor Calculate the size of the repair area based on the repair diagram; A repair drawing generation device according to any one of claims 1 to 3, which generates a repair quantity table including the size of the repair area. [Additional note 5] The processor calculates the repair cost of the damage based on the size of the repair area and the repair method. [Additional note 6] A repair drawing generating device according to claim 5, wherein the processor displays at least one of a repair drawing, a repair quantity table, and a repair cost on a monitor as a first detection result. [Additional note 7] A repair diagram generating device as described in claim 6, wherein the processor generates a damage diagram representing the damage based on the damage. [Additional note 8] The processor generates a damage quantity table including the degree of damage. [Additional note 9] A repair diagram generating device as described in appended claim 8, wherein the processor displays at least one of a damage diagram and a damage quantity table on a monitor as a second detection result. [Additional Note 10] 10. The repair diagram generating device according to claim 9, wherein the processor switches between the first detection result and the second detection result and displays them on the monitor. [Additional Note 11] A repair drawing generating device according to claim 9, wherein the processor simultaneously displays the first detection result and the second detection result side by side on the monitor. [Additional Note 12] 12. The repair drawing generating device according to claim 6, wherein the processor receives an instruction to edit the first detection result. [Additional Note 13] 12. The repair drawing generating device according to claim 9, wherein the processor receives an instruction to edit the second detection result. [Additional Note 14] A repair drawing generation device according to any one of claims 1 to 13, wherein the processor synthesizes a plurality of images captured by a camera into a panorama. [Explanation of symbols]

[0107] 1: Computer 1a: Computer main unit 3: Display section 5:Operation section 10: Repair drawing generator 12: Image acquisition section 16: Storage section 20: CPU 20A: Damage detection section 20B: Construction method specification department 20C: Repair drawing generation section 20D: First display control unit 20E: Repair calculation section 20F: Repair quantity table generation section 20G: Repair cost calculation section 20H: Damage map generation section 20I: Damage quantity table generator 20J: Second display control unit 22: RAM 24 :ROM 31: End 33: End 35: Circumscribed rectangular area A1: Repair drawing A2: Repair drawing C1: Damage diagram C2: Damage diagram C3: Damage diagram C4: Damage diagram C5: Damage diagram D1: Repair drawing H1: Damage diagram K1: Peeling P: Photographed image Q: Repair drawing S: Damage diagram

Claims

1. An image acquisition unit for acquiring a photographed image of a structure; a damage detection unit that detects damage from the captured image by image processing and identifies the extent of the damage; A method for repairing the damage based on the damage and the degree of the damage; and A repair drawing generation unit that generates a repair drawing indicating a repair area and the repair method for repairing the damage based on the damage and the repair method; A repair calculation unit that calculates a size of the repair area based on the repair diagram; A repair quantity table generating unit that generates a repair quantity table including the size of the repair area; A repair drawing generating device comprising:

2. The repair drawing generating device according to claim 1 , wherein the repair drawing generating unit generates the repair drawing by setting an area larger than the shape of the damage as the repair area.

3. The repair diagram generating device according to claim 1 , further comprising a repair cost calculation unit that calculates a repair cost for the damage based on the size of the repair area and the repair method.

4. The repair drawing generating device according to claim 3 , further comprising a first display control unit configured to display at least one of the repair drawing, the repair quantity table, and the repair cost on a display unit as a first detection result.

5. The repair diagram generating device according to claim 4 , further comprising a damage diagram generating unit configured to generate a damage diagram representing the damage based on the damage.

6. a damage quantity table generating unit for generating a damage quantity table including the degree of the damage; The repair diagram generating device according to claim 5 .

7. The repair diagram generating device according to claim 6 , further comprising a second display control unit configured to display at least one of the damage diagram and the damage quantity table on the display unit as a second detection result.

8. The repair drawing generating device according to claim 7 , wherein the first display control unit and the second display control unit switch between displaying the first detection result and the second detection result.

9. The repair drawing generating device according to claim 7 , wherein the first display control unit and the second display control unit simultaneously display the first detection result and the second detection result side by side.

10. The repair drawing generating device according to claim 4 , further comprising a first edit receiving unit that receives an instruction to edit the first detection result.

11. The repair drawing generating device according to claim 7 , further comprising a second edit receiving unit that receives an instruction to edit the second detection result.

12. The repair drawing generating device according to claim 1 , further comprising a panorama synthesis unit that synthesizes a panorama of the plurality of photographed images acquired by the image acquisition unit.

13. An image acquisition step of acquiring a photographed image of a structure, the image acquisition step being performed by a computer; a damage detection step of detecting damage from the captured image by image processing and specifying the extent of the damage, the damage detection step being performed by a computer; A method identification step of identifying a repair method for the damage based on the damage and the degree of the damage, the method being performed by a computer; A repair drawing generation step, which is performed by a computer, of generating a repair drawing indicating a repair area and the repair method for repairing the damage based on the damage and the repair method; A repair calculation step of calculating the size of the repair area based on the repair diagram, the repair calculation step being performed by a computer; A repair quantity table generation step performed by a computer to generate a repair quantity table including the size of the repair area; A repair diagram generating method comprising:

14. An image acquisition step of acquiring a photographed image of a structure; a damage detection step of detecting damage from the captured image by image processing and identifying the extent of the damage; A method for repairing the damage based on the damage and the degree of the damage. A repair drawing generation step of generating a repair drawing indicating a repair area and the repair method for repairing the damage based on the damage and the repair method; A repair calculation step of calculating a size of the repair area based on the repair diagram; A repair quantity table generation step of generating a repair quantity table including the size of the repair area; A program for causing a computer to execute a repair drawing generation process including the steps of:

Citation Information

Patent Citations

  • Repairing cost calculating system, program for realizing repairing cost calculating system by computer, and computer readable record medium recording program

    JP2002222281A

  • Renewal support system, renewal support method, program, and record medium

    JP2004340590A

  • Maintenance method selection method of concrete surface and device thereof

    JP2014095565A

  • Damage extraction system

    JP2017167969A

  • Structure management device, structure management method, and structure management program

    JP2019049951A