Patch Map Generation Device, Patch Map Generation Method, and Computer-Readable Recording Medium

Abstract

The present invention provides a repair map generation device, a repair map generation method, and a program for accurately and efficiently generating a repair map representing a repair area and a repair method for repair from a photographed image of a structure. The repair map generation device (10) includes: an image acquisition unit (12) that acquires a photographed image of a structure; a damage detection unit (20A) that detects damage from the photographed image by image processing and determines the degree of damage; a method determination unit (20B) that determines a repair method for the damage based on the damage and the degree of damage; and a repair map generation unit (20C) that generates a repair map representing a repair area and a repair method for repairing the damage based on the damage and the repair method.

Description

Technical Field

[0001] The present invention relates to a repair map generation device, a repair map generation method, and a computer-readable recording medium, and more particularly to a repair map generation device, a repair map generation method, and a computer-readable recording medium for generating a repair map from a photographed image of a structure. Background Art

[0002] Conventionally, there has been a technique of obtaining a photographed image of a structure to be inspected and detecting damages such as cracks based on the photographed image.

[0003] For example, Patent Document 1 describes a technique for photographing a structure, detecting defects from the photographed image, and simply and accurately calculating the cost for repairing the defects. In the technique described in Patent Document 1, a photographed image of an object to be evaluated is obtained, and the number, type, and size of damages existing in the photographed image are detected by methods such as pattern extraction. Then, the repair cost is calculated based on the detected number, type, and size of the damages.

[0004] Prior Art Documents

[0005] Patent Documents

[0006] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2002-222281 Summary of the Invention

[0007] Technical Problem to be Solved by the Invention

[0008] However, in the technique described in Patent Document 1, the repair cost is calculated based on the detected size of the damage, but sometimes the actual size of the repair and the detected size of the damage are different. For example, when repairing a peeled part of a concrete wall, sometimes the peripheral part of the peeled part is also included in the repair.

[0009] In addition, in practice, a repair map showing the repair area and the repair method is sometimes used to prepare a repair work plan and a report of pre-repair investigation, and at this time, it is necessary to generate a repair map. However, in the technique described in Patent Document 1, a repair map showing the repair area and the repair method is not generated, and for example, it is necessary for the user to generate the repair map manually.

[0010] The present invention has been made in view of such circumstances, and an object thereof is to provide a repair map generation device, a repair map generation method, and a program that accurately and efficiently generate a repair map showing a repair area and a repair method for repair from a photographed image of a structure.

[0011] Means for Solving the Technical Problem

[0012] As a repair drawing generation device according to one embodiment of the present invention for achieving the above object, it includes: an image acquisition unit that acquires a photographed image of a structure; a damage detection unit that detects damage from the photographed image through image processing and determines the degree of damage; a method determination unit that determines a repair method for the damage based on the damage and the degree of damage; and a repair drawing generation unit that generates a repair drawing showing a repair area and a repair method for repairing the damage based on the damage and the repair method.

[0013] According to this embodiment, the damage detection unit detects the damage and determines the degree of the damage. Further, this embodiment determines the repair method for the damage based on the damage and the degree of damage, and accurately and effectively generates a repair drawing showing the repair area and the repair method for the damage based on the damage and the repair method.

[0014] Preferably, when there are multiple cracks in the photographed image and the distance between the multiple cracks is below a threshold, the repair drawing generation unit connects the adjacent cracks to generate a repair drawing.

[0015] Preferably, the repair drawing generation unit generates a repair drawing with an area larger than the shape of the damage as the repair area.

[0016] Preferably, the repair drawing generation device includes: a repair calculation unit that calculates the size of the repair area based on the repair drawing; and a repair quantity table generation unit that generates a repair quantity table including the size of the repair area.

[0017] Preferably, the repair drawing generation device includes a repair cost calculation unit that calculates the repair cost of the damage based on the size of the repair area and the repair method.

[0018] Preferably, the repair drawing generation device includes a first display control unit that displays at least one of the repair drawing, the repair quantity table, and the repair cost as a first detection result on a display unit.

[0019] Preferably, the repair drawing generation device includes a damage drawing generation unit that generates a damage drawing showing the damage based on the damage.

[0020] Preferably, the repair drawing generation device includes a damage quantity generation unit that generates a damage quantity table including the degree of damage.

[0021] Preferably, the repair drawing generation device includes a second display control unit that displays at least one of the damage drawing and the damage quantity table as a second detection result on the display unit.

[0022] Preferably, the first display control unit and the second display control unit switch to display the first detection result and the second detection result.

[0023] Preferably, the first display control unit and the second display control unit simultaneously arrange and display the first detection result and the second detection result.

[0024] Preferably, the repair drawing generation device includes a first editing reception unit that receives an editing instruction for the first detection result.

[0025] Preferably, the repair drawing generation device includes a second editing reception unit that receives an editing instruction for the second detection result.

[0026] Preferably, the repair drawing generation device includes a panoramic synthesis unit that panoramically synthesizes a plurality of photographed images acquired by the image acquisition unit.

[0027] A repair drawing generation method according to another aspect of the present invention includes the following steps: an image acquisition step of acquiring a photographed image of a structure; a damage detection step of detecting damage from the photographed image by image processing and determining the degree of damage; a method determination step of determining a repair method for the damage based on the damage and the degree of damage; and a repair drawing generation step of generating a repair drawing showing a repair area and a repair method for repairing the damage based on the damage and the repair method.

[0028] A program according to another aspect of the present invention causes a computer to execute a repair drawing generation process, the repair drawing generation process including the following steps: an image acquisition step of acquiring a photographed image of a structure; a damage detection step of detecting damage from the photographed image by image processing and determining the degree of damage; a method determination step of determining a repair method for the damage based on the damage and the degree of damage; and a repair drawing generation step of generating a repair drawing showing a repair area and a repair method for repairing the damage based on the damage and the repair method.

[0029] Advantageous Effects of the Invention

[0030] The present invention detects damage by a damage detection unit and determines the degree of the damage, determines a repair method for the damage based on the damage and the degree of damage, and accurately and effectively generates a repair drawing showing a repair area and a repair method for repairing the damage based on the damage and the repair method. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a conceptual diagram showing a computer on which a repair drawing generation device is mounted.

[0032] Figure 2 is a block diagram showing an example of the hardware configuration of the computer.

[0033] Figure 3 is a diagram schematically showing a photographed image.

[0034] Figure 4 is a block diagram showing a main structural example of the repair drawing generation device.

[0035] Figure 5 It is a flowchart showing an example of a repair method selection process.

[0036] Figure 6 It is a diagram explaining an example when creating a repair diagram for a crack.

[0037] Figure 7 It is a diagram explaining an example when creating a repair diagram for delamination.

[0038] Figure 8 It is a diagram showing an example of a repair diagram.

[0039] Figure 9 It is a flowchart explaining a repair diagram generation method.

[0040] Figure 10 It is a block diagram showing a main structural example of a repair diagram generation device.

[0041] Figure 11 It is a chart showing an example of a repair quantity table.

[0042] Figure 12 It is a diagram showing a storage structure example of a repair cost database.

[0043] Figure 13 It is a diagram showing a modified example of a repair quantity table.

[0044] Figure 14 It is a block diagram showing a main functional structure example of a repair diagram generation device.

[0045] Figure 15 It is a diagram showing a damage diagram.

[0046] Figure 16 It is a diagram showing a damage quantity table.

[0047] Figure 17 It shows a display example of overlapping a repair diagram on a photographic image.

[0048] Figure 18 It shows a display example of overlapping a damage diagram on a photographic image.

[0049] Figure 19 It is a diagram schematically showing the alternate display of the first detection result and the second detection result.

[0050] Figure 20 It is a diagram showing the case of arranging and displaying the first detection result and the second detection result simultaneously. Detailed implementation mode

[0051] Hereinafter, preferred embodiments of a repair map generation device, a repair map generation method, and a program according to an embodiment of the present invention will be described with reference to the accompanying drawings.

[0052] Figure 1 is a conceptual diagram of a computer 1 equipped with a repair map generation device 10 (refer to Figure 4 ). The computer 1 includes a computer main body 1a, a display unit 3, and an operation unit 5.

[0053] The display unit 3 is composed of various monitors such as a liquid crystal monitor that can be connected to the computer 1. The display unit 3 displays a photographed image obtained by photographing a structure. Further, the display unit 3 displays at least one of a repair map, a repair quantity table, and a repair cost as a first detection result. Further, the display unit 3 displays at least one of a damage map and a damage quantity table as a second detection result.

[0054] The operation unit 5 is composed of a keyboard and a mouse that are wired or wirelessly connected to the computer 1. The user can confirm the first and second detection results displayed on the display unit 3, and input corrections and the like via the operation unit (first editing acceptance unit, second editing acceptance unit) 5 to correct or change the first and second detection results.

[0055] Figure 2 is a block diagram showing an example of the hardware configuration of the computer 1.

[0056] The hardware configuration of the computer 1 mainly includes an image acquisition unit 12, a storage unit 16, an operation unit 5, a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and a display unit 3.

[0057] The image acquisition unit 12 corresponds to an input / output interface, and in this example, it acquires a photographed image obtained by photographing with a camera (not shown) wirelessly or wiredly. The camera acquires a photographed image of a structure to be inspected. The image acquisition unit 12 can acquire a photographed image as a divided image obtained by dividing and photographing the structure to be inspected, or can acquire a photographed image of the structure in one image. The structure to be inspected is, for example, a high-rise building, a bridge, or a tunnel.

[0058] Figure 3 is a diagram schematically showing a photographed image obtained by the image acquisition unit 12 acquiring a part of a bridge as a structure to be inspected. Cracks J1 to J5 and peeling K1 are reflected in the photographed image P.

[0059] The storage unit 16 is a storage unit 16 composed of a hard disk device, a flash memory, etc., and stores programs for causing the repair drawing generation device 10 to function, such as an operating system, a damage detection program, a repair drawing generation program, a repair method selection program, a repair quantity table generation program, a database for calculating repair costs, a damage drawing generation program, and a damage quantity table generation program. In addition, various programs can be recorded on an external recording medium (not shown) and distributed, and installed from this recording medium by the CPU 20. Alternatively, various programs can also be stored in a server connected to a network or the like in a state accessible from the outside, and downloaded to the storage unit 16 by the CPU 20 as required for installation and execution.

[0060] The CPU 20 reads out various programs stored in the storage unit 16 or the ROM 24, etc., and centrally controls each unit. And the CPU 20 executes various processes for generating the first detection results (repair drawing, repair quantity table, or repair cost) described later and various processes for generating the second detection results (damage drawing or damage quantity table).

[0061] The RAM 22 is used as a working area of the CPU 20 and serves as a storage unit for temporarily storing the read programs and various data.

[0062] <First Embodiment>

[0063] Next, the repair drawing generation device 10 of the first embodiment of the present invention will be described.

[0064] Figure 4 It is a block diagram showing a main structural example of the repair drawing generation device 10 of the present embodiment.

[0065] The repair drawing generation device 10 mainly includes an image acquisition unit 12 and a CPU 20. The CPU 20 of the present embodiment executes various programs stored in the storage unit 16 or the ROM 24, etc., and thereby the CPU 20 functions as a damage detection unit 20A, a method determination unit 20B, a repair drawing generation unit 20C, and a first display control unit 20D.

[0066] The damage detection unit 20A detects damage from the photographed image through image processing and determines the degree of the detected damage. The damage detection unit 20A is constructed according to the type of damage detected. For example, the damage detection unit 20A is constructed by an AI (artificial intelligence) detector that has undergone machine learning to detect various damages. As a specific example of the detector, there are a peeling detector, a steel bar exposure detector, a water leakage detector, a free lime detector, etc., and the damage detection unit 20A is constructed by a single or multiple detectors.

[0067] The damage detection unit 20A detects damage and determines the degree of the detected damage. Here, the degree of damage includes information such as the actual length, width, area, depth of the damage, the presence or absence of steel bar corrosion, and the presence or absence of rust, and includes items used in the selection of repair methods described later.

[0068] The damage detection unit 20A is constructed by a crack detector and a peeling detector, and detects cracks J1 - J5 and peeling K1 from the photographed image P. For example, the damage detection unit 20A detects cracks J1 - J5 through the crack detector and detects peeling K1 through the peeling detector. Also, the damage detection unit 20A determines the degree of cracks J1 - J5 through the crack detector and determines the degree of peeling K1 through the peeling detector.

[0069] The damage detection unit 20A outputs the type and degree of damage to the method determination unit 20B.

[0070] The method determination unit 20B determines the repair method for the damage based on the detected damage. Specifically, the method determination unit 20B uses the repair method selection program stored in the storage unit 16 to select the repair method for the damage according to the damage and the degree of damage.

[0071] Figure 5 is a flowchart showing an example of the repair method selection process. Additionally, Figure 5 is a flowchart cited from the Bridge Repair and Strengthening Manual (Civil Engineering Department of Nagasaki Prefecture).

[0072] First, when the damage detected by the damage detection unit 20A is "crack", "floor crack", "leakage, free lime", the method determination unit 20B determines whether the presence or absence of steel bar corrosion and rust is detected by the damage detection unit 20A (step S10). And when there is no steel bar corrosion and rust, the method determination unit 20B selects to repair by crack repair work (step S11). Next, the method determination unit 20B determines the crack width (step S12). When the width t of the crack detected by the damage detection unit 20A is t ≤ 0.2 mm, the method determination unit 20B selects to basically not perform repair (step S13). And when the crack width t is 0.2 mm < t < 0.5 mm, the method determination unit 20B selects crack injection work (step S14). And when the crack width t is 0.5 mm ≤ t, the method determination unit 20B selects crack filling work (step S15).

[0073] Here, the crack injection work is a method of cutting the concrete along the crack and injecting the repair material with a specified injection pressure using a special fixture. And the crack filling work is a method of cutting the concrete along the crack and filling the repair material in this part.

[0074] On the other hand, when the types of damage detected by the damage detection unit 20A are "peeling, steel bar exposure" and "warping", and when the types of damage are "crack", "floor crack", "leakage, free lime" and there is steel bar corrosion and rust, the method determination unit 20B selects a sectional repair operation (step S16). Next, the method determination unit 20B determines the depth and area of the defective part detected by the damage detection unit 20A (step S17). When the area of the defective part is 0.5 m 2 or less, the method determination unit 20B selects a plastering method (step S18). And when the depth of the defective part is 3 - 5 cm and the area of the defective part is 0.5 m 2 or more, the method determination unit 20B selects a formwork injection method (step S19). And when the depth of the defective part is 5 cm or more and the area of the defective part is 0.5 m 2 or more, the method determination unit 20B selects a precast concrete method (step S20).

[0075] Here, the plastering method is a method of applying a sectional repair material, the formwork injection method is a method of setting a formwork and injecting an injection material, and the precast concrete method is a method of using concrete manufactured by first putting coarse aggregate into a formwork and then injecting filling mortar for repair.

[0076] In addition, Figure 5 the process of selecting a repair method described in is one specific example, and the selection of a repair method is not limited to this, and various repair method selections can be used. And the information required for the selection of a repair method can be obtained from the damage detection unit 20A or the input from the user via the operation unit 5.

[0077] Return Figure 4 , the repair drawing generation unit 20C generates a repair drawing showing the repair area and repair method for repairing the damage based on the detected damage and repair method. The repair drawing generation unit 20C generates a repair drawing by various methods. For example, the repair drawing generation unit 20C generates a repair drawing for each damage from the photographed image P through a repair drawing generator that has implemented machine learning. That is, at this time, the repair drawing generation unit 20C directly generates a repair drawing from the photographed image P. And the repair drawing generation unit 20C generates a repair drawing of the detected damage by performing a predetermined process on the damage detected from the photographed image P. Hereinafter, specific examples of repair drawing generation will be described. In addition, the repair drawing generation unit 20C does not generate a repair drawing for damage that is selected by the method determination unit 20B not to be repaired as described in step S13 in Figure 5 for example.

[0078] Figure 6 is a diagram for explaining an example when making a repair drawing of a crack. In Figure 6 (A), cracks J3 and J4 are shown, and inFigure 6 (B) shows a repair diagram A2. The repair diagram A2 is generated by the repair diagram generation unit 20C based on the crack J3 and the crack J4.

[0079] As Figure 6 shown, the end 31 of the crack J3 is close to the end 33 of the crack J4. Therefore, the repair diagram A2 is generated by combining the crack J3 and the crack J4. Thus, when the cracks are close, even if they are not connected on the surface (in the photographed image), inside, the cracks are connected. At this time, additional fillers, etc. are required. Therefore, when the damage detected by the damage detection unit 20A is multiple cracks in the photographed image and the multiple cracks are close to each other below the threshold, the repair diagram generation unit 20C connects the close cracks to generate a repair diagram. Thereby, the user can obtain an accurate repair area and can appropriately prepare fillers, etc. In addition, this threshold is determined by the user according to the structure or material of the structure to be inspected, etc. In addition, when combining cracks with each other, the directionality near the crack ends can also be considered. Specifically, when the angle difference of the direction vectors near the crack ends is below the threshold, the repair diagram generation unit 20C combines the cracks to generate a repair diagram.

[0080] The repair diagram A2 represents repairing the cracks J3 and J4 through a crack repair operation. For example, the repair diagram A2 is represented by a red line, thereby indicating that the area of the repair diagram A2 is repaired through a crack repair operation.

[0081] Figure 7 is a diagram for explaining an example when making a repair diagram for the peeling K1. In addition, in Figure 7 only the area of the peeling K1 is shown.

[0082] In Figure 7 the damaged area of the peeling K1 is shown, and the circumscribed rectangle area 35 of the shown damaged area is represented by a dotted line. When repairing the peeling K1, it is repaired by any method of the sectional repair operation, but the repaired area (the chipped concrete) is larger than the actual peeling K1 area. Therefore, the repair diagram generation unit 20C generates a repair diagram D1 for the area that expands +α mm outward from the circumscribed rectangle area 35 in the up, down, left, and right directions. In addition, α for expanding the circumscribed rectangle area 35 is a pre-determined value and can be adjusted by the user. And α for expanding the circumscribed rectangle area 35 can be automatically determined according to the area of the damaged area, etc. At this time, for example, the larger the area of the damaged area, the larger the value of α is set. In addition, the repair diagram D1 is represented by a blue line, for example, thereby indicating that the area of the repair diagram D1 is repaired through a sectional repair operation.

[0083] Return Figure 4, the first display control unit 20D displays the first detection result (at least one of the repair diagram, the repair quantity table, and the repair cost) on the display unit 3. For example, the first display control unit 20D displays the repair diagram on the display unit 3. The repair quantity table and the repair cost will be described later.

[0084] Figure 8 It is a diagram showing an example of the repair diagram Q corresponding to the photographed image P. The repair diagram Q has a repair diagram A1, a repair diagram A2, and a repair diagram D1.

[0085] The repair diagram generation unit 20C generates the repair diagram A1 based on the cracks J1 and J2. Since the cracks J1 and J2 approach each other at a distance below the threshold value, one repair diagram A1 is generated. And, the repair diagram generation unit 20C generates the repair diagram A2 based on the cracks J3 and J4. Since the cracks J3 and J4 approach each other at a distance below the threshold value, one repair diagram A2 is generated. In addition, the repair diagrams A1 and A2 are represented by red lines, for example, indicating that they are repaired by crack repair work.

[0086] And, the repair diagram generation unit 20C does not generate a repair diagram corresponding to the crack J5. This is because the width of the crack J5 is below the threshold value and no repair is performed (for example Figure 5 in step S13), so no repair diagram is made.

[0087] The repair diagram generation unit 20C generates the repair diagram D1 based on the peeling K1. The area shown in the repair diagram D1 is an area that extends d mm outward in the up, down, left, and right directions from the circumscribed rectangle area of the peeling K1. In addition, the repair diagram D1 is represented by a blue line, for example, indicating that it is repaired by sectional repair work.

[0088] Figure 9 It is a flowchart for explaining the repair diagram generation method (repair diagram generation process) using the repair diagram generation device 10.

[0089] First, the image acquisition unit 12 acquires a photographed image of the structure (image acquisition step: step S10). After that, the damage detection unit 20A detects damage from the photographed image through image processing and determines the degree of the detected damage (damage detection step: step S11). Then, the method determination unit 20B determines the repair method for the damage (method determination step: step S12). After that, the repair diagram generation unit 20C generates a repair diagram representing the repair area for repairing the damage (repair diagram generation step: step S13).

[0090] In the above-described embodiment, the hardware structure of the processing unit (e.g., the damage detection unit 20A, the method determination unit 20B, the repair drawing generation unit 20C, the first display control unit 20D) (processing unit) that performs various processes is various processors (processor) shown below. Among various processors, there are a general-purpose processor that executes software (program) to function as various processing units, i.e., a CPU (Central Processing Unit), a programmable logic device such as an FPGA (Field Programmable Gate Array) that can change the circuit structure after manufacturing, and a dedicated circuit such as an ASIC (Application Specific Integrated Circuit) that has a circuit structure designed specifically for executing specific processes.

[0091] One processing unit can be constituted by one of these various processors, or can be constituted by two or more processors of the same type or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units can be constituted by one processor. As an example of constituting multiple processing units by one processor, first, there is a mode in which a computer such as a client and a server is representative, and a combination of one or more CPUs and software constitutes one processor, and this processor functions as multiple processing units. Second, there is a mode in which a system on chip (SoC) is representative, and a processor that uses one IC (Integrated Circuit) chip to implement the functions of the entire system including multiple processing units is used. Thus, various processing units are constituted by using one or more of the above-described various processors as the hardware structure. Moreover, as the hardware structure of these various processors, more specifically, it is a circuitry that combines circuit elements such as semiconductor elements.

[0092] The above-described respective structures and functions can be appropriately implemented by any hardware, software, or a combination of both. For example, the present invention can also be applied to a program that causes a computer to execute the above-described processing steps, a computer-readable recording medium (non-transitory recording medium) that records such a program, or a computer that can install such a program.

[0093] As described above, the crack detection unit 20A detects cracks J1 to J5 and peeling K1 from the photographed image P, determines the repair methods for repairing the cracks J1 to J5 and the peeling K1, and the repair drawing generation unit 20C can accurately and effectively generate a repair drawing A1, a repair drawing A2, and a repair drawing D1.

[0094] <Second Embodiment>

[0095] Next, a second embodiment of the repair drawing generation apparatus 10 will be described. In the present embodiment, a repair quantity table and a repair cost as the first detection result are generated.

[0096] Figure 10 is a block diagram showing a main structural example of the repair drawing generation apparatus 10 of the present embodiment.

[0097] In addition, parts that have already been described in Figure 4 are denoted by the same reference numerals and the description thereof is omitted.

[0098] The repair drawing generation apparatus 10 mainly includes an image acquisition unit 12 and a CPU 20. The CPU 20 of the present embodiment executes various programs stored in the storage unit 16 or the ROM 24 or the like, and thus the CPU 20 functions as a damage detection unit 20A, a method determination unit 20B, a repair drawing generation unit 20C, a first display control unit 20D, a repair calculation unit 20E, a repair quantity table generation unit 20F, and a repair cost calculation unit 20G.

[0099] The repair calculation unit 20E calculates the size of the repair area based on the repair drawing. The repair calculation unit 20E calculates the size of the area actually repaired based on the repair drawing. For example, the repair calculation unit 20E calculates the width, length, and area of the area actually repaired based on the width, length, and area of the damage drawing. For example, the repair calculation unit 20E has a relational expression between the length of the repair drawing and the length on the actual structure, and uses this relational expression to calculate the width, length, and area of the area actually repaired from the repair drawing. The relational expression can be obtained by various methods. For example, by obtaining the actual size information of each pixel of the photographed image P (or the panoramic composite image when panoramic composition has been performed) or obtaining the size information of a part or the whole of the structure reflected in the photographed image P (or the panoramic composite image) and converting it into the actual size information of each pixel, the relational expression can be obtained.

[0100] The repair quantity table generation unit 20F generates a repair quantity table including the repair method of the damage and the size of the repair area. Specifically, the repair quantity table generation unit 20F makes a table by setting the information included in each repair drawing as character information.

[0101] Figure 11 is a diagram showing an example of a repair quantity table corresponding to the repair drawing Q.

[0102] In Figure 11 In the repair quantity table shown, for the items having a repair ID, a type of repair method, and dimensions (width, length, and area) of a repair area, information corresponding to each item is recorded for each repair site (repair drawing). The repair ID is a separate ID attached to each repair drawing. The type of repair method indicates the repair method of each repair drawing determined by the method determination unit 20B. The dimensions (width, length, and area) indicate the size of the repair area calculated by the repair calculation unit 20E.

[0103] Return Figure 10 , and the repair cost calculation unit 20G calculates the repair cost of the damage based on the dimensions of the repair area and the repair method. The repair cost calculation unit 20G calculates the repair cost with reference to the repair cost database stored in the storage unit 16 based on the dimensions of the repair area and the repair method.

[0104] Figure 12 is a diagram showing an example of the storage structure of the repair cost database.

[0105] In Figure 12 the example shown, the major classification of the repair method, the minor classification of the repair method, and the unit repair cost are stored in association with each other.

[0106] When the major classification of the repair method is crack repair work and the minor classification of the repair method is crack injection work, the repair cost is calculated at 10,000 yen / m. Also, when the major classification of the repair method is crack repair work and the minor classification of the repair method is crack filling work, the repair cost is calculated at 25,000 yen / m. Also, when the major classification of the repair method is profile repair work, if the minor classification of the repair method is plastering method, a repair cost of 50,000 yen / m 2 is incurred, if the minor classification of the repair method is formwork injection method, a repair cost of 150,000 yen / m 2 is incurred, and if the minor classification of the repair method is precast concrete method, a repair cost of 300,000 yen / m 2 is incurred.

[0107] In addition, the above repair cost database is an example, and the present invention also uses other repair cost databases.

[0108] Figure 13 is showing Figure 11 a modified example of the repair quantity table shown.

[0109] In Figure 13In a modified example of the repair quantity table shown, there are items of repair ID, repair method type, dimensions (width, length, and area) of the repair area, and repair cost, and information corresponding to each item is recorded for each repair site (repair drawing). In the item of repair cost, the repair cost corresponding to each repair drawing calculated by the repair cost calculation unit 20G is shown. In this way, the repair quantity table generation unit 20F generates a repair quantity table including the repair cost calculated by the repair cost calculation unit 20G, and the user can confirm the repair cost corresponding to each repair drawing.

[0110] As described above, by generating the repair quantity table and displaying it on the display unit 3, the user can confirm the repair drawing as character information. Also, by calculating the repair cost of each repair drawing and displaying it on the display unit 3, the user can confirm the repair cost of each repair drawing.

[0111] <Third Embodiment>

[0112] Next, a third embodiment of the repair drawing generation device 10 will be described. In this embodiment, a damage map and a damage quantity table as the second detection result are generated.

[0113] Figure 14 is a block diagram showing a main functional configuration example of the repair drawing generation device. In addition, parts that have already been described in Figure 4 and Figure 10 are denoted by the same reference numerals and the description thereof is omitted.

[0114] The repair drawing generation device 10 mainly includes an image acquisition unit 12 and a CPU 20. The CPU 20 in this embodiment executes various programs stored in the storage unit 16 or the ROM 24, etc., and thus this CPU 20 functions as a damage detection unit 20A, a method determination unit 20B, a repair drawing generation unit 20C, a first display control unit 20D, a repair calculation unit 20E, a repair quantity table generation unit 20F, a repair cost calculation unit 20G, a damage map generation unit 20H, a damage quantity table generation unit 20I, and a second display control unit 20J.

[0115] The damage map generation unit 20H generates a damage map representing the damage based on the damage detected by the damage detection unit 20A. The damage map generation unit 20H generates a damage map corresponding to the damage detected by the damage detection unit 20A by a known method. For example, if the damage is a crack, the damage map generation unit 20H generates a damage map represented by a line, and if the damage is a peel, the damage map generation unit 20H generates a damage map showing the outer periphery of the peel area by a line. Hereinafter, a specific example of the damage map generated by the damage map generation unit 20H will be described.

[0116] Figure 15 is a diagram showing a damage map S generated by the damage map generation unit 20H based on the photographed image P.

[0117] The damage map S corresponds to the photographic image P and has damage maps C1 to C5 corresponding to cracks J1 to J5 and a damage map H1 corresponding to the peel K1. Also, the damage maps C1 to C5 are represented by, for example, red lines, indicating damage maps of cracks. And the damage map H1 is represented by, for example, a blue line, indicating a damage map of the peel.

[0118] Return Figure 14 , the damage quantity table generation unit 20I generates a damage quantity table including damages and the degrees of damages.

[0119] Figure 16 is a diagram showing the damage quantity table corresponding to the damage map S.

[0120] In Figure 16 the shown damage quantity table, there are items of damage ID, damage type, and degree of damage (size) (width, length, and area), and information corresponding to each item is recorded for each damage part (damage map).

[0121] Return Figure 14 , the second display control unit 20J displays at least one of the damage map and the damage quantity table on the display unit 3 as the second detection result.

[0122] As described above, in the present embodiment, a damage map and / or a damage quantity table is generated and displayed on the display unit 3. By displaying the damage map on the display unit 3, the user can more clearly confirm the damage and can use the damage map to create a report or the like. Moreover, by displaying the damage quantity table on the display unit 3, the user can confirm the damage as character information.

[0123] <First Application Example>

[0124] In this example, the repair map Q or the damage map S is overlapped and displayed on the photographic image P. Hereinafter, a specific example will be described.

[0125] Figure 17 Shows a display example of overlapping the repair map Q on the photographic image P. The first display control unit 20D overlaps the repair map Q on the photographic image P and displays it on the display unit 3. The first display control unit 20D overlaps the repair map A1 (represented by a dotted line) on the cracks J1 and J2 and displays it. And the first display control unit 20D overlaps the repair map A2 (represented by a dotted line) on the cracks J3 and J4 and displays it. And the first display control unit 20D overlaps the repair map D1 (represented by a solid line) on the peel K1 and displays it. In addition, since the crack J5 is not repaired, no repair map is generated. Thus, by overlapping the repair map generated by the repair map generation unit 20C on the photographic image P and displaying it, the user can more clearly grasp the relationship between the damage and the repair map.

[0126] Figure 18 This is a display example showing the damage map S superimposed on the photographed image P. The second display control unit 20J superimposes the damage map S on the photographed image P and displays it on the display unit 3. The second display control unit 20J superimposes and displays the damage map C1 (shown by a dashed line) on the crack J1, and superimposes the damage map C2 (shown by a dashed line) on the crack J2 for display. Also, the second display control unit 20J superimposes the damage map C3 (shown by a dashed line) on the crack J3 for display, and superimposes the damage map C4 (shown by a dashed line) on the crack J4 for display. Also, the second display control unit 20J superimposes the damage map C5 (shown by a dashed line) on the crack J5 for display. Also, the first display control unit 20D superimposes the damage map H1 (shown by a dashed line) on the peeling K1 for display. In this way, by superimposing the damage map generated by the damage map generation unit 20H on the photographed image P for display, the user can clearly grasp the association between the damage and the damage map.

[0127] Here, the photographed image P superimposed and displayed as described above can be a single photographed image, or a panoramic composite of multiple photographed images, and a repair map or a damage map can be superimposed and displayed on the panoramic composite image. The panoramic composite unit (not shown) is implemented by the CPU 20 and performs panoramic composition on multiple photographed images acquired by the image acquisition unit 12.

[0128] <Second Application Example>

[0129] In this example, the first detection result and the second detection result are alternately displayed simultaneously. For example, the repair map Q as the first detection result and the damage map S as the second detection result are alternately or simultaneously displayed. The repair map shows the repair area for repairing the damage and the repair method, and the damage map shows the damage, so they are used for different purposes. For example, the repair map is used for repair design and pre-repair investigation. Therefore, the repair map converts the result of damage detection into information on the repair part or area corresponding to the repair method and outputs it so that the length or area of the repair object can be grasped. On the other hand, the damage map is used for inspection, diagnosis, repair design, and pre-repair investigation. Therefore, the repair map outputs the result obtained by faithfully detecting the damage (crack line, damaged area) so that the degree of damage compared to the past can be grasped. In this example, by alternately or simultaneously displaying repair maps and damage maps of different natures in this way, the convenience for the user is improved. Hereinafter, the alternate display of the first detection result and the second detection result and the simultaneous arrangement display of the first detection result and the second detection result will be described.

[0130] Figure 19 This is a diagram schematically showing the alternate display of the first detection result and the second detection result.

[0131] As Figure 19As shown, the first display control unit 20D and the second display control unit 20J switch between displaying the first detection result and the second detection result. In addition, the switching timing can be appropriately adjusted. For example, the display is switched by the user indicating the switching timing via the operation unit 5.

[0132] Figure 20 FIG. is a diagram showing a case where the first detection result and the second detection result are arranged and displayed side by side.

[0133] As Figure 20 shown, the first display control unit 20D and the second display control unit 20J arrange and display the first detection result and the second detection result side by side. In addition, Figure 20 in, the first detection result and the second detection result are arranged horizontally, but this example is not limited thereto. The first detection result and the second detection result may also be arranged vertically.

[0134] The above describes an example of the present invention, but the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention, which is natural.

[0135] According to the above description, the repair drawing device described in the following supplementary notes 1 to 14 can be grasped.

[0136] [Supplementary Note 1]

[0137] A repair drawing generation device, comprising:

[0138] a camera that acquires a photographed image of a structure; and

[0139] a processor,

[0140] The processor performs the following processing, that is,

[0141] detects damage from the photographed image by image processing and determines the degree of damage,

[0142] determines a repair method for the damage according to the damage and the degree of damage,

[0143] generates a repair drawing showing a repair area and a repair method for repairing the damage according to the damage and the repair method.

[0144] [Supplementary Note 2]

[0145] According to the repair drawing generation device described in Supplementary Note 1, when there are a plurality of cracks in the photographed image and the plurality of cracks are close to each other below a threshold value, the processor connects the adjacent cracks to generate a repair drawing.

[0146] [Supplementary Note 3]

[0147] The mending graph generation device according to appended item 1 or 2, wherein the processor generates a mending graph with an area larger than the shape of the damage as the mending area.

[0148] [Appended item 4]

[0149] The mending graph generation device according to any one of appended items 1 to 3, wherein

[0150] the processor performs the following processing, that is,

[0151] calculate the size of the mending area according to the mending graph,

[0152] generate a mending quantity table including the size of the mending area.

[0153] [Appended item 5]

[0154] The mending graph generation device according to appended item 4, wherein the processor calculates the mending cost of the damage according to the size of the mending area and the mending method.

[0155] [Appended item 6]

[0156] The mending graph generation device according to appended item 5, wherein the processor displays at least one of the mending graph, the mending quantity table, and the mending cost on the monitor as the first detection result.

[0157] [Appended item 7]

[0158] The mending graph generation device according to appended item 6, wherein the processor generates a damage graph representing the damage according to the damage.

[0159] [Appended item 8]

[0160] The mending graph generation device according to appended item 7, wherein the processor generates a damage quantity table including the degree of the damage.

[0161] [Appended item 9]

[0162] The mending graph generation device according to appended item 8, wherein the processor displays at least one of the damage graph and the damage quantity table on the monitor as the second detection result.

[0163] [Appended item 10]

[0164] The mending graph generation device according to appended item 9, wherein the processor switches and displays the first detection result and the second detection result on the monitor.

[0165] [Appended item 11]

[0166] The mending graph generation device according to appended item 9, wherein the processor arranges and displays the first detection result and the second detection result on the monitor simultaneously.

[0167] [Supplementary Note Item 12]

[0168] The patching diagram generation device according to any one of Supplementary Note Items 6 to 11, wherein the processor receives an editing instruction for the first detection result.

[0169] [Supplementary Note Item 13]

[0170] The patching diagram generation device according to any one of Supplementary Note Items 9 to 11, wherein the processor receives an editing instruction for the second detection result.

[0171] [Supplementary Note Item 14]

[0172] The patching diagram generation device according to any one of Supplementary Note Items 1 to 13, wherein the processor performs panoramic synthesis on a plurality of photographed images acquired by a camera.

[0173] Symbol Explanation

[0174] 1 - Computer, 1a - Computer main body, 3 - Display unit, 5 - Operation unit, 10 - Patching diagram generation device, 12 - Image acquisition unit, 16 - Storage unit, 20 - CPU, 20A - Damage detection unit, 20B - Method determination unit, 20C - Patching diagram generation unit, 20D - First display control unit, 20E - Patching calculation unit, 20F - Patching quantity table generation unit, 20G - Patching cost calculation unit, 20H - Damage diagram generation unit, 20I - Damage quantity table generation unit, 20J - Second display control unit, 22 - RAM, 24 - ROM, 31 - End part, 33 - One end part, 35 - Outer circumscribed rectangular area, A1 - Patching diagram, A2 - Patching diagram, C1 - Damage diagram, C2 - Damage diagram, C3 - Damage diagram, C4 - Damage diagram, C5 - Damage diagram, D1 - Patching diagram, H1 - Damage diagram, K1 - Peeling, P - Photographed image, Q - Patching diagram, S - Damage diagram.

Claims

1. A repair drawing generation device, comprising: An image acquisition unit that acquires a photographed image of a structure; A damage detection unit that detects damage from the photographed image through image processing and determines the degree of the damage; A method determination unit that determines a repair method for the damage based on the damage and the degree of the damage; and A repair drawing generation unit that generates a repair drawing showing a repair area for repairing the damage and the repair method based on the damage and the repair method, When the damage is a plurality of cracks in the photographed image, the plurality of cracks are closer to each other than a threshold, and the angular difference between the direction vectors near the ends of the plurality of cracks is less than a threshold, the repair drawing generation unit connects the cracks that are closer and have an angular difference between the direction vectors less than the threshold to generate the repair drawing.

2. The repair drawing generation device according to claim 1, wherein, The repair map generation unit generates the repair map with an area larger than the shape of the damage as the repair area.

3. The repair drawing generation device according to claim 1, wherein, The repair map generation device includes: a repair calculation unit that calculates the size of the repair area according to the repair map; and a repair quantity table generation unit that generates a repair quantity table including the size of the repair area.

4. The repair drawing generation device according to claim 3, wherein, The repair map generation device includes: a repair cost calculation unit that calculates the repair cost of the damage according to the size of the repair area and the repair method.

5. The repair drawing generation device according to claim 4, wherein, The repair map generation device includes: a first display control unit that displays at least one of the repair map, the repair quantity table, and the repair cost as a first detection result on a display unit.

6. The repair drawing generation device according to claim 5, wherein, The repair map generation device includes: a damage map generation unit that generates a damage map representing the damage according to the damage.

7. The repair drawing generation device according to claim 6, wherein, The repair map generation device includes: a damage quantity table generation unit that generates a damage quantity table including the degree of the damage.

8. The repair drawing generation device according to claim 7, wherein, The repair map generation device includes: a second display control unit that displays at least one of the damage map and the damage quantity table as a second detection result on the display unit.

9. The repair drawing generation device according to claim 8, wherein, The first display control unit and the second display control unit alternately display the first detection result and the second detection result.

10. The patching diagram generation device according to claim 8, wherein, The first display control unit and the second display control unit arrange and simultaneously display the first detection result and the second detection result.

11. The patching diagram generation device according to claim 5, wherein, The repair map generation device includes: a first editing acceptance unit that accepts an editing instruction for the first detection result.

12. The patching diagram generation device according to claim 8, wherein, The repair map generation device includes: a second editing acceptance unit that accepts an editing instruction for the second detection result.

13. The patching diagram generation device according to claim 1, wherein, The repair map generation device includes: a panoramic synthesis unit that performs panoramic synthesis on a plurality of the photographed images acquired by the image acquisition unit.

14. A patching diagram generation method, comprising the following steps: An image acquisition step of acquiring a photographed image of a structure; A damage detection step of detecting damage from the photographed image by image processing and determining the degree of the damage; A method determination step of determining a patching method for the damage according to the damage and the degree of the damage; and A patching diagram generation step of generating a patching diagram showing a patching area for patching the damage and the patching method according to the damage and the patching method, When the damage is a plurality of cracks in the photographed image and the plurality of cracks are close to each other below a threshold, and the angle difference of the direction vectors near the ends of the plurality of cracks is below a threshold, in the patching diagram generation step, the cracks that are close to each other and have an angle difference of the direction vectors below the threshold are connected to each other to generate the patching diagram.

15. A computer-readable recording medium storing a program that causes a computer to execute a patching diagram generation process, the patching diagram generation process comprising the following steps: An image acquisition step of acquiring a photographed image of a structure; A damage detection step of detecting damage from the photographed image by image processing and determining the degree of the damage; A method determination step of determining a patching method for the damage according to the damage and the degree of the damage; and A patching diagram generation step of generating a patching diagram showing a patching area for patching the damage and the patching method according to the damage and the patching method, When the damage is multiple cracks in the photographic image, the multiple cracks are below a threshold and close to each other, and the angular difference of the direction vectors near the ends of the multiple cracks is below a threshold, the cracks that are close and have an angular difference of the direction vectors below the threshold are connected to each other in the repair map generation step to generate the repair map.

Images