Repair map generation device, patch map generation method, and computer-readable recording medium

Abstract

Provided are a repair map generation device, a repair map generation method, and a computer-readable recording medium that accurately and efficiently generate, from a captured image of a structure, a repair map that represents a repair region to be repaired and a repair method. A repair map generation device includes: an image acquisition unit that acquires a captured image of a structure; a damage detection unit that detects a damage from the captured image by image processing and determines the degree of the damage; a method determination unit for determining a repair method for the damage on the basis of the damage and the degree of the damage; a repair map generation unit that generates, from the damage and the repair method, a repair map indicating a repair region for repairing the damage and the repair method; a repair calculation unit that calculates the size of the repair region on the basis of the repair map; and a repair number table generation unit that generates a repair number table including the size of the repair region.

Description

[0001] This application is a divisional application of the Chinese invention patent application with the application date of June 3, 2020, application number 202080048377.8, and invention name “Repair image generation device, repair image generation method and computer-readable recording medium”. Technical Field

[0002] The present invention relates to a patch image generating device, a patch image generating method and a computer-readable recording medium, and more particularly to a patch image generating device, a patch image generating method and a computer-readable recording medium for generating a patch image from a photographic image obtained by photographing a structure. Background Art

[0003] Conventionally, a technique has been used in which a photographic image of a structure to be inspected is acquired and damage such as cracks is detected based on the photographic image.

[0004] For example, Patent Document 1 describes a technology that aims to photograph a structure, detect defects from the photographic image, and simply and accurately calculate the cost of repairing the defects. The technology described in Patent Document 1 obtains a photographic image of the object to be evaluated and detects the number, type, and size of defects within the photographic image using methods such as pattern extraction. The repair cost is then calculated based on the number, type, and size of the detected defects.

[0005] Previous technical literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Laid-Open No. 2002-222281 Summary of the Invention

[0008] Technical issues to be solved by the invention

[0009] However, the technique described in Patent Document 1 calculates the repair cost based on the size of the detected damage, but the actual size of the repair may differ from the size of the detected damage. For example, when repairing a peeling area on a concrete wall, the surrounding area may also be included in the repair.

[0010] Furthermore, in practice, repair maps showing the repair area and repair method are sometimes used to prepare repair project plans and pre-repair survey reports, requiring the generation of repair maps. However, the technology described in Patent Document 1 does not generate a repair map showing the repair area and repair method, requiring the user to manually generate the repair map, for example.

[0011] The present invention has been made in view of such circumstances, and its object is to provide a repair map generating device, a repair map generating method, and a program for accurately and efficiently generating a repair map indicating a repair area and a repair method to be repaired from a photographic image of a structure.

[0012] Means for solving technical problems

[0013] A repair pattern generating device as one embodiment of the present invention for achieving the above-mentioned purpose comprises: an image acquisition unit for acquiring a photographic image of a structure; a damage detection unit for detecting damage from the photographic image and determining the extent of the damage through image processing; a method determination unit for determining a repair method for the damage based on the damage and the extent of the damage; and a repair pattern generating unit for generating a repair pattern representing a repair area and a repair method for repairing the damage based on the damage and the repair method.

[0014] According to this method, the damage detection unit detects damage and determines the extent of the damage. Furthermore, the method determines the damage repair method based on the damage and the extent of the damage, and accurately and efficiently generates a repair map showing the repair area and repair method for the damage based on the damage and the repair method.

[0015] Preferably, when the damage is a plurality of cracks in the photographic image and the plurality of cracks are close to each other by less than a threshold value, the repair pattern generating unit connects the close cracks to generate the repair pattern.

[0016] Preferably, the repair pattern generating unit generates the repair pattern using a region larger than the shape of the damage as the repair region.

[0017] Preferably, the repair pattern generating device includes: a repair calculation unit that calculates the size of the repair region based on the repair pattern; and a repair quantity table generating unit that generates a repair quantity table including the size of the repair region.

[0018] Preferably, the repair pattern generating device includes a repair cost calculating unit for calculating a repair cost of the damage based on a size of a repair area and a repair method.

[0019] Preferably, the repair pattern generating device includes a first display control unit, and displays at least one of the repair pattern, the repair quantity table, and the repair fee on the display unit as the first detection result.

[0020] Preferably, the repair pattern generating device includes a damage map generating unit configured to generate a damage map representing the damage based on the damage.

[0021] Preferably, the repair pattern generating device includes a damage number generating unit that generates a damage number table including degrees of damage.

[0022] Preferably, the repair pattern generating device includes a second display control unit, and displays at least one of the damage map and the damage number table on the display unit as the second detection result.

[0023] Preferably, the first display control unit and the second display control unit switch between displaying the first detection result and the second detection result.

[0024] Preferably, the first display control unit and the second display control unit display the first detection result and the second detection result side by side at the same time.

[0025] Preferably, the repair pattern generating device includes a first edit receiving unit configured to receive an edit instruction for the first detection result.

[0026] Preferably, the repair pattern generating device includes a second edit receiving unit configured to receive an edit instruction for the second detection result.

[0027] Preferably, the repair image generating device includes a panoramic synthesis unit that performs panoramic synthesis on the plurality of captured images acquired by the image acquisition unit.

[0028] As another embodiment of the present invention, a repair map generating method includes the following steps: an image acquisition step of acquiring a photographic image of a structure; a damage detection step of detecting damage from the photographic image and determining the extent of the damage through image processing; a method determination step of determining a repair method for the damage based on the damage and the extent of the damage; and a repair map generating step of generating a repair map representing a repair area and a repair method for repairing the damage based on the damage and the repair method.

[0029] As another embodiment of the present invention, a program causes a computer to execute a repair map generation process, which includes the following steps: an image acquisition step of acquiring a photographic image of a structure; a damage detection step of detecting damage from the photographic image and determining the extent of the damage through image processing; a method determination step of determining a repair method for the damage based on the damage and the extent of the damage; and a repair map generation step of generating a repair map representing a repair area and a repair method for repairing the damage based on the damage and the repair method.

[0030] Effects of the Invention

[0031] The present invention detects damage and determines the extent of the damage through a damage detection unit, determines a method for repairing the damage based on the damage and the extent of the damage, and accurately and effectively generates a repair map representing a repair area and a repair method for repairing the damage based on the damage and the repair method. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 This is a conceptual diagram showing a computer equipped with a repair image generating device.

[0033] Figure 2 This is a block diagram showing an example of the hardware configuration of a computer.

[0034] Figure 3 A diagram schematically showing a photographic image.

[0035] Figure 4 This is a block diagram showing a main configuration example of a repair image generating device.

[0036] Figure 5 This is a flowchart showing an example of a repair method selection process.

[0037] Figure 6 This figure explains an example of creating a repair pattern for a crack.

[0038] Figure 7 This is a diagram for explaining an example of creating a repair pattern for peeling.

[0039] Figure 8 1 and 2 are diagrams showing examples of repair maps.

[0040] Figure 9 This is a flowchart illustrating a method for generating a patch image.

[0041] Figure 10 This is a block diagram showing a main configuration example of a repair image generating device.

[0042] Figure 11 This is a graph showing an example of a repair quantity table.

[0043] Figure 12 This is a diagram showing an example of the storage structure of a repair cost database.

[0044] Figure 13 It is a diagram showing a modified example of the repair quantity table.

[0045] Figure 14 This is a block diagram showing an example of the main functional configuration of a repair image generating device.

[0046] Figure 15 It is a diagram showing a damage map.

[0047] Figure 16 This is a diagram showing a damage quantity table.

[0048] Figure 17 A display example in which a repair image is superimposed on a photographic image is shown.

[0049] Figure 18 A display example in which a damage map is superimposed on a photographic image is shown.

[0050] Figure 19 It is a diagram schematically showing the alternating display of the first detection result and the second detection result.

[0051] Figure 20 This is a diagram showing a situation where the first detection result and the second detection result are displayed side by side at the same time.

[0052] Explanation of symbols

[0053] 1-Computer, 1a-Computer body, 3-Display unit, 5-Operation unit, 10-Repair image generating device, 12-Image acquisition unit, 16-Storage unit, 20-CPU, 20A-Damage detection unit, 20B-Method determination unit, 20C-Repair image generating unit, 20D-First display control unit, 20E-Repair calculation unit, 20F-Repair quantity table generating unit, 20G-Repair cost calculation unit, 20H-Damage image generating unit, 20I-Damage quantity table generating unit, 20J-Second display control unit, 22-RAM, 24-ROM, 31-End, 33-End, 35-Circumscribed rectangular area, A1-Repair image, A2-Repair image, C1-Damage image, C2-Damage image, C3-Damage image, C4-Damage image, C5-Damage image, D1-Repair image, H1-Damage map, K1-Peeling, P-Photographic image, Q-Repair image, S-Damage map. DETAILED DESCRIPTION

[0054] Hereinafter, preferred embodiments of a repair image generating device, a repair image generating method, and a program according to an embodiment of the present invention will be described with reference to the accompanying drawings.

[0055] Figure 1 The present invention is equipped with a repair image generating device 10 (refer to Figure 4 ) is a conceptual diagram of a computer 1. The computer 1 includes a computer body 1a, a display unit 3 and an operation unit 5.

[0056] The display unit 3 is composed of various monitors such as a liquid crystal monitor that can be connected to the computer 1. The display unit 3 displays a photographic image of the structure. Furthermore, the display unit 3 displays at least one of a repair map, a repair quantity table, and a repair cost as a first inspection result. Furthermore, the display unit 3 displays at least one of a damage map and a damage quantity table as a second inspection result.

[0057] The operation unit 5 is composed of a keyboard and a mouse, etc., which are connected to the computer 1 by wire or wirelessly. The user can confirm the first and second detection results displayed on the display unit 3 and input corrections or the like via the operation unit (first edit receiving unit, second edit receiving unit) 5 to correct or change the first and second detection results.

[0058] Figure 2 This is a block diagram showing an example of the hardware configuration of the computer 1 .

[0059] The hardware structure of the computer 1 mainly includes an image acquisition unit 12 , a storage unit 16 , an operation unit 5 , a CPU (Central Processing Unit) 20 , a RAM (Random Access Memory) 22 , a ROM (Read Only Memory) 24 , and a display unit 3 .

[0060] The image acquisition unit 12 functions as an input / output interface. In this example, it acquires images captured by a camera (not shown) wirelessly or wired. The camera captures images of the structure being inspected. The image acquisition unit 12 can capture images as segmented images obtained by segmenting the structure being inspected, or it can capture images in which the structure is captured in a single image. Examples of the structure being inspected include high-rise buildings, bridges, and tunnels.

[0061] Figure 3 1 is a diagram schematically showing a photographic image P obtained by capturing a portion of a bridge, which is a structure to be inspected, and acquired by the image acquisition unit 12. The photographic image P shows cracks J1 to J5 and a peel K1.

[0062] The storage unit 16, comprised of a hard disk drive, flash memory, or the like, stores programs for operating the repair map generation device 10, including an operating system, a damage detection program, a repair map generation program, a repair method selection program, a repair quantity table generation program, a database for calculating repair costs, a damage map generation program, and a damage quantity table generation program. Furthermore, these programs may be distributed by recording them on an external recording medium (not shown) and installed from this recording medium by the CPU 20. Alternatively, these programs may be stored in an externally accessible state on a server connected to a network, downloaded upon request to the storage unit 16 by the CPU 20, and then installed and executed.

[0063] The CPU 20 reads various programs stored in the storage unit 16 or the ROM 24, etc., and centrally controls each unit. Furthermore, the CPU 20 executes various processes for generating the first inspection results (repair map, repair quantity table, or repair cost) described later, and various processes for generating the second inspection results (damage map or damage quantity table).

[0064] The RAM 22 is used as a work area of the CPU 20 and is used as a storage unit for temporarily storing read programs and various data.

[0065] <First embodiment>

[0066] Next, a description will be given of a repair pattern generating device 10 according to a first embodiment of the present invention.

[0067] Figure 4 1 is a block diagram showing a main configuration example of the repair image generating device 10 according to the present embodiment.

[0068] The repair pattern generating device 10 mainly includes an image acquiring unit 12 and a CPU 20. The CPU 20 of this embodiment executes various programs stored in the storage unit 16 or the ROM 24, thereby functioning as a damage detecting unit 20A, a method determining unit 20B, a repair pattern generating unit 20C, and a first display control unit 20D.

[0069] The damage detection unit 20A detects damage from photographic images through image processing and determines the extent of the detected damage. The damage detection unit 20A is configured based on the type of damage being detected. For example, the damage detection unit 20A may be implemented using an AI (artificial intelligence) detector that implements machine learning to detect various types of damage. Specific examples of such detectors include peeling detectors, exposed steel bar detectors, water leakage detectors, and loose lime detectors. The damage detection unit 20A may be implemented using a single detector or multiple detectors.

[0070] The damage detection unit 20A detects damage and determines the extent of the detected damage. The extent of the damage includes, for example, information such as the actual length, width, area, depth of the damage, the presence or absence of steel bar corrosion, and rust, and includes items used in selecting a repair method as described later.

[0071] The damage detection unit 20A is constructed from a crack detector and a peeling detector, and detects cracks J1 to J5 and peeling K1 from the photographic image P. For example, the damage detection unit 20A detects cracks J1 to J5 using the crack detector and peeling K1 using the peeling detector. Furthermore, the damage detection unit 20A determines the extent of cracks J1 to J5 using the crack detector and the extent of peeling K1 using the peeling detector.

[0072] The damage detection unit 20A outputs the type of damage and the degree of damage to the method determination unit 20B.

[0073] The method determination unit 20B determines a method for repairing the damage based on the detected damage. Specifically, the method determination unit 20B uses a repair method selection program stored in the storage unit 16 to select a method for repairing the damage based on the damage and the degree of the damage.

[0074] Figure 5 This is a flowchart showing an example of a repair method selection process. Figure 5 This is a flowchart quoted from the Bridge Repair and Reinforcement Manual (Nagasaki Prefecture Civil Engineering Department).

[0075] First, if the damage detected by the damage detection unit 20A is "crack," "floor crack," or "water leakage, loose lime," the method determination unit 20B determines whether the damage detection unit 20A has detected the presence of steel corrosion and rust (step S10). If there is no steel corrosion or rust, the method determination unit 20B selects crack repair (step S11). Next, the method determination unit 20B determines the crack width (step S12). If the crack width t detected by the damage detection unit 20A is t≤0.2mm, the method determination unit 20B selects essentially no repair (step S13). Furthermore, if the crack width t is 0.2mm<t<0.5mm, the method determination unit 20B selects crack injection (step S14). Furthermore, if the crack width t is 0.5mm≤t, the method determination unit 20B selects crack filling (step S15).

[0076] Here, crack injection is a method of cutting concrete along the crack and injecting the repair material at a specified injection pressure using a dedicated jig. Furthermore, crack filling is a method of cutting concrete along the crack and filling the crack with the repair material.

[0077] On the other hand, if the damage type detected by the damage detection unit 20A is "peeling, exposed steel bar," or "warping," and the damage type is "crack," "floor crack," "water leakage, loose lime," and there is steel bar corrosion and rust, the method determination unit 20B selects the cross-section repair operation (step S16). Next, the method determination unit 20B determines the depth and area of the defect detected by the damage detection unit 20A (step S17). The defect area is 0.5m 2 If the depth of the defect is 3 to 5 cm and the area of the defect is 0.5 m, the method determination unit 20B selects the plastering method (step S18). 2 If the depth of the defect is greater than 5 cm and the area of the defect is less than 0.5 m, the method determination unit 20B selects the template injection method (step S19). 2 In the above case, the method determination unit 20B selects the pre-cast concrete method (step S20 ).

[0078] Here, the plastering method is a method of applying a section repair material, the formwork injection method is a method of setting a formwork and injecting the injection material, and the pre-filled concrete method is a method of repairing using concrete produced by first putting a coarse aggregate material into the formwork and then injecting filling mortar.

[0079] in addition, Figure 5The repair method selection process described in the above is one specific example. The selection of the repair method is not limited to this, and various repair methods can be used. In addition, the information required for the selection of the repair method can be obtained from the damage detection unit 20A or the user through the input of the operation unit 5.

[0080] return Figure 4 , the patch image generating unit 20C generates a patch image representing a patch area and a patch method for repairing the damage based on the detected damage and the patch method. The patch image generating unit 20C generates the patch image by various methods. For example, the patch image generating unit 20C generates a patch image of each damage from the photographic image P by a patch image generator that has implemented machine learning. That is, at this time, the patch image generating unit 20C generates the patch image directly from the photographic image P. Furthermore, the patch image generating unit 20C generates the patch image of the detected damage by performing a predetermined process on the damage detected from the photographic image P. A specific example of patch image generation is described below. In addition, the patch image generating unit 20C generates a patch image of the detected damage, for example, in Figure 5 As in step S13 described above, the method determination unit 20B selects damage not to be repaired, and no repair map is generated.

[0081] Figure 6 This figure explains an example of creating a crack repair diagram. Figure 6 (A) shows cracks J3 and J4. Figure 6 (B) shows a repair pattern A2. The repair pattern A2 is generated by the repair pattern generating unit 20C based on the cracks J3 and J4.

[0082] like Figure 6 As shown, the end 31 of the crack J3 is close to the end 33 of the crack J4, so a repair map A2 is generated by combining the cracks J3 and J4. In this way, when the cracks are close, even if they are not connected on the surface (on the photographic image), they are connected internally, and in this case, additional fillers, etc. are required. Therefore, when the damage detected by the damage detection unit 20A is a plurality of cracks in the photographic image and the plurality of cracks are close to each other below a threshold, the repair map generation unit 20C connects the close cracks to generate a repair map. In this way, the user can obtain an accurate repair area and can appropriately prepare fillers, etc. In addition, the threshold is determined by the user based on the structure to be repaired or the material of the structure. In addition, when combining the cracks, the directionality near the crack end can also be considered. Specifically, when the angle difference of the direction vector near the crack end is below a threshold, the repair map generation unit 20C combines the cracks to generate a repair map.

[0083] Repair image A2 shows that cracks J3 and J4 are repaired by crack repair work. For example, repair image A2 is represented by a red line, which means that the area of repair image A2 is repaired by crack repair work.

[0084] Figure 7 This is a diagram illustrating an example of making a repair diagram for peeling K1. Figure 7 Only the area where K1 is peeled off is shown.

[0085] exist Figure 7 In the figure, a damaged area of peeling K1 is shown, and the circumscribed rectangular area 35 of the damaged area shown is represented by a dotted line. When repairing peeling K1, the repair is performed by any method of cross-section repair work, but the repaired area (the area where the concrete is peeled off) is larger than the actual area of peeling K1. Therefore, the repair diagram generation unit 20C generates a repair diagram D1 by expanding the area of the circumscribed rectangular area 35 outward by +α mm in the vertical, horizontal and vertical directions. In addition, α used to expand the circumscribed rectangular area 35 is a predetermined value that can be adjusted by the user. In addition, α used to expand the circumscribed rectangular area 35 can be automatically determined based on the area of the damaged area, etc. In this case, for example, the larger the area of the damaged area, the larger the value of α is set. In addition, the repair diagram D1 is represented by a blue line, for example, which indicates that the area of the repair diagram D1 is repaired by cross-section repair work.

[0086] return Figure 4 The first display control unit 20D displays the first inspection result (at least one of a repair map, a repair quantity table, and a repair fee) on the display unit 3. For example, the first display control unit 20D displays the repair map on the display unit 3. The repair quantity table and the repair fee will be described later.

[0087] Figure 8 1 is a diagram showing an example of the repair map Q corresponding to the photographic image P. The repair map Q includes a repair map A1, a repair map A2, and a repair map D1.

[0088] The repair pattern generator 20C generates a repair pattern A1 based on cracks J1 and J2. Cracks J1 and J2 are close together at a distance below a threshold, so a single repair pattern A1 is generated. Furthermore, the repair pattern generator 20C generates a repair pattern A2 based on cracks J3 and J4. Cracks J3 and J4 are close together at a distance below a threshold, so a single repair pattern A2 is generated. Furthermore, repair patterns A1 and A2 are represented by, for example, red lines, indicating that repairs have been performed through crack repair work.

[0089] Furthermore, the repair pattern generating unit 20C does not generate a repair pattern corresponding to the crack J5. This is because the width of the crack J5 is below the threshold and is not repaired (for example, Figure 5 Step S13), so no repair map is produced.

[0090] The repair pattern generator 20C generates a repair pattern D1 based on the peeling K1. The area shown in the repair pattern D1 is an area extending outward by α mm in the vertical and horizontal directions from the circumscribed rectangular area of the peeling K1. The repair pattern D1 is shown as a blue line, for example, indicating that the repair is being performed by the cross-section repair operation.

[0091] Figure 9 This is a flowchart for explaining a repair image generating method (repair image generating step) using the repair image generating device 10 .

[0092] First, the image acquisition unit 12 acquires a photographic image of the structure (image acquisition step: step S10). The damage detection unit 20A then detects damage from the photographic image through image processing and determines the extent of the detected damage (damage detection step: step S11). The method determination unit 20B then determines a method for repairing the damage (method determination step: step S12). The repair map generation unit 20C then generates a repair map showing the repair area to be used to repair the damage (repair map generation step: step S13).

[0093] In the above-described embodiment, the hardware configuration of the processing units (e.g., the damage detection unit 20A, the method determination unit 20B, the repair image generation unit 20C, and the first display control unit 20D) that perform various processes is comprised of the various processors shown below. These processors include general-purpose processors (CPUs) that execute software (programs) to function as various processing units; processors (e.g., programmable logic devices (PLDs)) whose circuit configuration can be modified after manufacturing, such as FPGAs (Field Programmable Gate Arrays); and processors (e.g., dedicated circuits) with circuit configurations specifically designed to perform specific processes, such as ASICs (Application Specific Integrated Circuits).

[0094] A single processing unit can be composed of one of these various processors, or it can be composed of two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Furthermore, multiple processing units can be composed of a single processor. As examples of multiple processing units composed of a single processor, there is a method, represented by computers such as clients and servers, in which a single processor is composed of a combination of one or more CPUs and software, and this processor functions as multiple processing units. A second method is a method, represented by a system-on-chip (SoC), in which a processor is used to implement the functions of an entire system including multiple processing units using a single IC (Integrated Circuit) chip. In this way, the various processing units are composed of one or more of the above-mentioned various processors as a hardware structure. Furthermore, the hardware structure of these various processors is more specifically a circuit that combines circuit elements such as semiconductor elements.

[0095] The above-mentioned structures and functions can be implemented by any hardware, software, or a combination of both as appropriate. For example, the present invention can also be applied to a program that causes a computer to execute the above-mentioned processing steps, a computer-readable recording medium (non-transitory recording medium) recording such a program, or a computer capable of installing such a program.

[0096] As described above, the damage detection unit 20A detects cracks J1 to J5 and peeling K1 from the photographic image P and determines the repair method for repairing the cracks J1 to J5 and peeling K1. The repair image generation unit 20C can accurately and effectively generate repair images A1, A2 and D1.

[0097] <Second embodiment>

[0098] Next, a description will be given of a second embodiment of the repair map generating device 10. In this embodiment, a table of the number of repairs and the repair cost is generated as a first detection result.

[0099] Figure 10 1 is a block diagram showing a main configuration example of the repair image generating device 10 according to the present embodiment.

[0100] In addition, Figure 4 Parts that have already been explained are marked with the same symbols and the explanation is omitted.

[0101] The repair image generation device 10 mainly includes an image acquisition unit 12 and a CPU 20. In this embodiment, the CPU 20 executes various programs stored in the storage unit 16 or the ROM 24, thereby functioning as a damage detection unit 20A, a method determination unit 20B, a repair image generation unit 20C, a first display control unit 20D, a repair calculation unit 20E, a repair quantity table generation unit 20F, and a repair cost calculation unit 20G.

[0102] The repair calculation unit 20E calculates the size of the repair area based on the repair map. The repair calculation unit 20E calculates the size of the actual repair based on the repair map. For example, the repair calculation unit 20E calculates the width, length, and area of the area to be repaired based on the width, length, and area of the damage map. For example, the repair calculation unit 20E has a relationship between the length of the repair map and the length on the actual structure, and uses this relationship to calculate the width, length, and area of the area to be repaired from the repair map. The relationship can be obtained by various methods. For example, the relationship can be obtained by obtaining the actual size information of each pixel of the photographic image P (or the panoramic composite image when panoramic synthesis has been performed) or by obtaining the size information of a part or the entire structure reflected in the photographic image P (or the panoramic composite image) and converting it into the actual size information of each pixel.

[0103] The repair quantity table generating unit 20F generates a repair quantity table including a method of repairing damage and the size of a repair area. Specifically, the repair quantity table generating unit 20F creates a table by using character information as information on each repair image.

[0104] Figure 11 1 is a graph showing an example of a repair quantity table corresponding to the repair map Q.

[0105] exist Figure 11 The repair quantity table shown includes items such as repair ID, repair method type, and repair area dimensions (width, length, and area). Information corresponding to each item is recorded for each repair site (repair image). The repair ID is a unique ID assigned to each repair image. The repair method type indicates the repair method for each repair image, as determined by the method determination unit 20B. The dimensions (width, length, and area) indicate the size of the repair area calculated by the repair calculation unit 20E.

[0106] return Figure 10 The repair cost calculation unit 20G calculates the repair cost of the damage based on the size of the repair area and the repair method. The repair cost calculation unit 20G calculates the repair cost based on the size of the repair area and the repair method by referring to the repair cost database stored in the storage unit 16.

[0107] Figure 12 This is a diagram showing an example of the storage structure of a repair cost database.

[0108] exist Figure 12 In the example shown, the major category of repair method, the minor category of repair method, and the unit repair cost are stored in association with each other.

[0109] If the repair method is classified as crack repair work and the repair method is classified as crack injection work, the repair fee is calculated as 10,000 yen / m. If the repair method is classified as crack repair work and the repair method is classified as crack filling work, the repair fee is calculated as 25,000 yen / m. If the repair method is classified as section repair work and the repair method is classified as plastering, the repair fee is calculated as 50,000 yen / m. 2 If the repair method is classified as the template injection method, the repair cost will be 150,000 yen / m 2 If the repair method is classified as pre-cast concrete method, the repair cost will be 300,000 yen / m 2 repair costs.

[0110] In addition, the above-mentioned repair cost database is an example, and the present invention also utilizes other repair cost databases.

[0111] Figure 13 Yes Figure 11 FIG. 1 is a diagram showing a modified example of the repair quantity table shown.

[0112] exist Figure 13 The modified example of the repair quantity table shown includes fields such as repair ID, repair method type, repair area dimensions (width, length, and area), and repair cost. Information corresponding to each field is recorded for each repaired area (repair map). The repair cost field displays the repair cost corresponding to each repair map, calculated by the repair cost calculation unit 20G. In this way, the repair quantity table generator 20F generates a repair quantity table including the repair costs calculated by the repair cost calculation unit 20G, allowing the user to confirm the repair cost corresponding to each repair map.

[0113] As described above, by generating a repair quantity table and displaying it on the display unit 3, the user can confirm the repair diagram as character information. In addition, by calculating the repair cost for each repair diagram and displaying it on the display unit 3, the user can confirm the repair cost for each repair diagram.

[0114] <Third embodiment>

[0115] Next, a description will be given of a third embodiment of the repair pattern generating device 10. In this embodiment, a damage map and a damage quantity table are generated as the second detection result.

[0116] Figure 14This is a block diagram showing an example of the main functional structure of the repair image generating device. Figure 4 and Figure 10 Parts that have already been explained are marked with the same symbols and the explanation is omitted.

[0117] The repair map generation device 10 mainly includes an image acquisition unit 12 and a CPU 20. In this embodiment, the CPU 20 executes various programs stored in the storage unit 16 or the ROM 24, thereby functioning as a damage detection unit 20A, a method determination unit 20B, a repair map generation unit 20C, a first display control unit 20D, a repair calculation unit 20E, a repair quantity table generation unit 20F, a repair cost calculation unit 20G, a damage map generation unit 20H, a damage quantity table generation unit 20I, and a second display control unit 20J.

[0118] The damage map generation unit 20H generates a damage map representing the damage based on the damage detected by the damage detection unit 20A. The damage map generation unit 20H generates a damage map corresponding to the damage detected by the damage detection unit 20A using a known method. For example, if the damage is a crack, the damage map generation unit 20H generates a damage map represented by lines. If the damage is a delamination, the damage map generation unit 20H generates a damage map that represents the periphery of the delamination area as lines. A specific example of a damage map generated by the damage map generation unit 20H is described below.

[0119] Figure 15 3 is a diagram showing a damage map S generated based on the photographic image P by the damage map generating unit 20H.

[0120] The damage map S corresponds to the photographic image P and includes damage maps C1 to C5 corresponding to cracks J1 to J5 and a damage map H1 corresponding to delamination K1. Damage maps C1 to C5 are represented by red lines, for example, indicating damage maps of cracks. Damage map H1 is represented by blue lines, for example, indicating damage maps of delamination.

[0121] return Figure 14 The damage quantity table generating unit 20I generates a damage quantity table including damages and damage degrees.

[0122] Figure 16 This is a diagram showing a damage quantity table corresponding to the damage map S.

[0123] exist Figure 16 The damage quantity table shown has items such as damage ID, damage type, and damage extent (size) (width, length, and area), and information corresponding to each item is recorded for each damage site (damage map).

[0124] return Figure 14The second display control unit 20J displays at least one of the damage map and the damage quantity table on the display unit 3 as the second detection result.

[0125] As described above, in this embodiment, a damage map and / or a damage quantity table are generated and displayed on the display unit 3. By displaying the damage map on the display unit 3, the user can more clearly identify the damage and use the damage map to prepare a report, etc. Furthermore, by displaying the damage quantity table on the display unit 3, the user can identify the damage as text information.

[0126] <First application example>

[0127] In this example, the repair map Q or the damage map S is superimposed and displayed on the photographic image P. A specific example will be described below.

[0128] Figure 17 This shows an example of a display in which a repair image Q is superimposed on a photographic image P. The first display control unit 20D displays the repair image Q on the display unit 3 by superimposing it on the photographic image P. The first display control unit 20D displays the repair image A1 (indicated by a dotted line) superimposed on the cracks J1 and J2. Furthermore, the first display control unit 20D displays the repair image A2 (indicated by a dotted line) superimposed on the cracks J3 and J4. Furthermore, the first display control unit 20D displays the repair image D1 (indicated by a solid line) superimposed on the peeling K1. In addition, the crack J5 is not repaired, so a repair image is not generated. In this way, by superimposing the repair image generated by the repair image generating unit 20C on the photographic image P for display, the user can more clearly understand the relationship between the damage and the repair image.

[0129] Figure 18 The following figure shows an example of a display in which a damage map S is superimposed on a photographic image P. The second display control unit 20J displays the damage map S superimposed on the photographic image P on the display unit 3. The second display control unit 20J displays the damage map C1 (indicated by a dotted line) superimposed on the crack J1 and the damage map C2 (indicated by a dotted line) superimposed on the crack J2. Furthermore, the second display control unit 20J displays the damage map C3 (indicated by a dotted line) superimposed on the crack J3 and the damage map C4 (indicated by a dotted line) superimposed on the crack J4. Furthermore, the second display control unit 20J displays the damage map C5 (indicated by a dotted line) superimposed on the crack J5. Furthermore, the first display control unit 20D displays the damage map H1 (indicated by a dotted line) superimposed on the delamination K1. By superimposing the damage map generated by the damage map generation unit 20H on the photographic image P in this manner, the user can clearly understand the relationship between the damage and the damage map.

[0130] Here, the photographic image P displayed as superimposed as described above may be a single photographic image, or may be a composite of multiple photographic images, with a repair image or damage image superimposed on the composite image. A panoramic composite unit (not shown) is implemented by the CPU 20 and performs panoramic composite on the multiple photographic images acquired by the image acquisition unit 12.

[0131] <Application Example 2>

[0132] In this example, the first detection result and the second detection result are displayed alternately at the same time. For example, a repair image Q as the first detection result and a damage image S as the second detection result are displayed alternately or simultaneously. The repair image shows the repair area and the repair method used to repair the damage, while the damage image shows the damage, and therefore each is used for different purposes. For example, the repair image is used for repair design and pre-repair investigation. Therefore, the repair image converts the results of damage detection into information about the repair part or area corresponding to the repair method and outputs it so that the length or area of the repair object can be understood. On the other hand, the damage image is used for inspection, diagnosis, repair design, and pre-repair investigation. Therefore, the repair image outputs the results of faithfully detecting the damage (crack line, damaged area) so that the extent of the damage compared to the past can be understood. In this example, by displaying repair images and damage images of different properties alternately or simultaneously, user convenience is improved. The following explains the alternating display of the first and second detection results and the simultaneous display of the first and second detection results.

[0133] Figure 19 It is a diagram schematically showing the alternating display of the first detection result and the second detection result.

[0134] like Figure 19 As shown, the first display control unit 20D and the second display control unit 20J switch between displaying the first detection result and displaying the second detection result. In addition, the timing of the switch can be adjusted as appropriate. For example, the display is switched by the user instructing the switching timing via the operation unit 5.

[0135] Figure 20 This is a diagram showing a situation where the first detection result and the second detection result are displayed side by side at the same time.

[0136] like Figure 20 As shown, the first display control unit 20D and the second display control unit 20J display the first detection result and the second detection result in parallel. Figure 20 In the example shown in FIG, the first detection result and the second detection result are arranged horizontally, but this example is not limited to this. The first detection result and the second detection result may also be arranged vertically.

[0137] As mentioned above, although the example of this invention was demonstrated, this invention is not limited to the said embodiment, It is a matter of course that various deformation|transformation can be added within the range which does not deviate from the spirit of this invention.

[0138] From the above description, the repair drawing apparatus described in the following Supplementary Notes 1 to 14 can be understood.

[0139] [Supplementary Note 1]

[0140] A repair image generating device comprising:

[0141] a camera to obtain photographic images of the structure; and

[0142] processor,

[0143] The processor performs the following processing, namely,

[0144] Detect damage from photographic images and determine the extent of damage through image processing,

[0145] Determine the repair method based on the damage and the extent of the damage.

[0146] Based on the damage and the repair method, a repair map is generated that shows the repair area and the repair method for repairing the damage.

[0147] [Supplementary Note 2]

[0148] The repair pattern generating device according to Supplementary Item 1, wherein when the damage is a plurality of cracks in the photographic image and the plurality of cracks are close to each other and below a threshold value, the processor connects the close cracks to generate the repair pattern.

[0149] [Supplementary Note 3]

[0150] The repair pattern generating device according to Supplementary note 1 or 2, wherein the processor generates the repair pattern using a region larger than the shape of the lesion as the repair region.

[0151] [Supplementary Note 4]

[0152] The repair image generating device according to any one of Supplementary Notes 1 to 3, wherein:

[0153] The processor performs the following processing, namely,

[0154] Calculate the size of the patch area based on the patch map,

[0155] Generate a patch quantity table containing the dimensions of the patched area.

[0156] [Supplementary Note 5]

[0157] The repair map generating device according to Supplementary note 4, wherein the processor calculates the repair cost of the damage based on the size of the repair area and the repair method.

[0158] [Supplementary Note 6]

[0159] The repair pattern generating device according to Supplementary note 5, wherein the processor displays at least one of the repair pattern, the repair quantity table, and the repair fee on the monitor as the first detection result.

[0160] [Supplementary Note 7]

[0161] The repair map generating device according to Supplementary note 6, wherein the processor generates the damage map representing the damage based on the damage.

[0162] [Supplementary Note 8]

[0163] The repair pattern generating device according to Supplementary note 7, wherein the processor generates a damage quantity table including degrees of damage.

[0164] [Supplementary Note 9]

[0165] The repair pattern generating device according to Supplementary note 8, wherein the processor displays at least one of the damage map and the damage number table on the monitor as the second detection result.

[0166] [Supplementary Note 10]

[0167] The repair image generating device according to Supplementary note 9, wherein the processor switches and displays the first detection result and the second detection result on the monitor.

[0168] [Supplementary Note 11]

[0169] The repair image generating device according to Supplementary note 9, wherein the processor displays the first detection result and the second detection result side by side on the monitor at the same time.

[0170] [Supplementary Note 12]

[0171] The repair image generating device according to any one of Supplementary Notes 6 to 11, wherein the processor receives an edit instruction for the first detection result.

[0172] [Supplementary Note 13]

[0173] The repair image generating device according to any one of Supplementary Notes 9 to 11, wherein the processor receives an edit instruction for the second detection result.

[0174] [Supplementary Note 14]

[0175] The repair image generating device according to any one of Supplementary Notes 1 to 13, wherein the processor performs panoramic synthesis on a plurality of photographic images acquired by the camera.

Claims

1. A repair image generating device comprising: an image acquisition unit for acquiring a photographic image of a structure; a damage detection unit that detects damage from the photographic image and determines the extent of the damage through image processing; a method determination unit, which determines a repair method for the damage according to the damage and the extent of the damage; a repair map generating unit for generating a repair map indicating a repair area and the repair method for repairing the damage based on the damage and the repair method; a repair calculation unit, which calculates the size of the repair area according to the repair map; and The repair quantity table generating unit generates a repair quantity table including the size of the repair area.

2. The repair image generating device according to claim 1, wherein: The repair pattern generating unit generates the repair pattern using a region larger than the shape of the damage as the repair region.

3. The repair image generating device according to claim 1, wherein: The patching image generating device comprises: The repair cost calculation unit calculates a repair cost for the damage based on the size of the repair area and the repair method.

4. The repair image generating device according to claim 3, wherein: The patching image generating device comprises: The first display control unit displays at least one of the repair map, the repair quantity table, and the repair fee on a display unit as a first detection result.

5. The repair image generating device according to claim 4, wherein: The patching image generating device comprises: The damage map generating unit generates a damage map representing the damage based on the damage.

6. The repair image generating device according to claim 5, wherein: The patching image generating device comprises: The damage quantity table generating unit generates a damage quantity table including the degree of the damage.

7. The repair image generating device according to claim 6, wherein: The patching image generating device comprises: The second display control unit displays at least one of the damage map and the damage quantity table on the display unit as a second detection result.

8. The repair image generating device according to claim 7, wherein: The first display control unit and the second display control unit switch between displaying the first detection result and the second detection result.

9. The repair image generating device according to claim 7, wherein: The first display control unit and the second display control unit arrange the first detection result and the second detection result and display them simultaneously.

10. The repair image generating device according to claim 4, wherein: The patching image generating device comprises: The first edit accepting unit accepts an instruction to edit the first detection result.

11. The repair image generating device according to claim 7, wherein: The patching image generating device comprises: The second edit accepting unit accepts an instruction to edit the second detection result.

12. The repair image generating device according to any one of claims 1 to 11, wherein: The patching image generating device comprises: The panoramic synthesis unit performs panoramic synthesis on the plurality of photographic images acquired by the image acquisition unit.

13. A method for generating a patch image, comprising the following steps: an image acquisition step of acquiring a photographic image of the structure; a damage detection step of detecting damage from the photographic image and determining the extent of the damage by image processing; a method determination step, determining a repair method for the damage according to the damage and the extent of the damage; a repair map generating step of generating a repair map showing a repair area and the repair method for repairing the damage according to the damage and the repair method; a patch calculation step of calculating the size of the patch area according to the patch map; and The step of generating a repair quantity table includes generating a repair quantity table including the size of the repair area.

14. A computer-readable recording medium storing a program for causing a computer to execute a repair image generation process, the repair image generation process comprising the following steps: an image acquisition step of acquiring a photographic image of the structure; a damage detection step of detecting damage from the photographic image and determining the extent of the damage by image processing; a method determination step, determining a repair method for the damage according to the damage and the extent of the damage; a repair map generating step of generating a repair map showing a repair area and the repair method for repairing the damage according to the damage and the repair method; a patch calculation step of calculating the size of the patch area according to the patch map; and The step of generating a repair quantity table includes generating a repair quantity table including the size of the repair area.

Images