Inspection support device, method, and program

Abstract

To provide an inspection support device, method, and program capable of satisfactorily outputting, in a case where two or more types of damage are detected from a structure, and particularly, two or more types of damage are detected from the same or adjacent positions of the structure, a damage detection result thereof.SOLUTION: A processor of the inspection support device acquires an image obtained by imaging a structure to be inspected and detects damage to the structure on the basis of the acquired image. In a case where two or more types of damage (cracking B and linear free lime C2) to the structure are detected (Fig.16(A)), the processor determines whether or not two or more types of damage are detected from the same or adjacent positions. In a case where determination is made that the cracking B and the linear free lime C2 are detected from the same or adjacent positions when the processor outputs the damage detection result (a damage image, a damage diagram, and the like), the processor preferentially outputs a damage detection result of the linear free lime C2 in accordance with a priority of a damage type (Fig.16(B)).SELECTED DRAWING: Figure 16

Description

[Technical field]

[0001] The present invention relates to an inspection support device, method, and program, and more particularly to a technique for supporting the inspection of a structure. [Background technology]

[0002] Social infrastructure structures such as bridges require regular inspections for maintenance and repair.

[0003] Patent Document 1 discloses a crack detection method and display method that takes pictures of the inner wall surface of a tunnel with a camera, extracts and quantifies cracks in each small section of the inner wall surface by processing the pictures, and displays crack information for each small section. For example, cracks are displayed in different colors for each small section according to the level of cracking in each small section, making it easier to understand the level of cracking. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2002-188998 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, there are many types of damage to structures other than cracks. For example, in the concrete parts of a structure, there are many types of damage such as water leakage, free lime, rust, peeling, exposed rebar, etc., in addition to cracks. Similarly, in the steel members of a structure, there are many types of damage such as cracks, corrosion, and deterioration of the corrosion protection function.

[0006] Patent document 1 describes displaying cracks in different colors for each sub-section according to the level of cracking in each sub-section, but does not describe detecting two or more types (multiple items) of damage in a structure, nor does it describe a method for outputting the detection results of multiple items of damage.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide an inspection support device, method, and program that can effectively output damage detection results when two or more types of damage are detected in a structure, particularly when two or more types of damage are detected in the same or nearby positions on the structure. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, the invention of a first aspect is an inspection support device equipped with a processor, wherein the processor performs an image acquisition process for acquiring an image of a structure to be inspected, a damage detection process for detecting damage to the structure based on the acquired image, a determination process for determining whether or not two or more types of damage have been detected from the same or nearby positions among the two or more types of damage when two or more types of damage have been detected from the same or nearby positions, and an output process for outputting the damage detection result detected by the damage detection process, wherein if the determination process determines that two or more types of damage have been detected from the same or nearby positions, the damage detection result is output in accordance with the priority order of the damage types.

[0009] According to the first aspect of the present invention, when two or more types of damage are detected on a structure based on an image taken of the structure to be inspected, and in particular when two or more types of damage are detected from the same or similar positions on the structure, the damage detection results are output in order of priority as damage detection results. In this way, when two or more types of damage are detected from the same or similar positions on the structure, the damage detection results are output in order of priority of the damage types, making it possible to deal with cases where two or more types of damage are detected from the same or similar positions on the structure. Note that when two or more types of damage are not in the same or similar positions on the structure, the two or more types of damage detection results can be output as is.

[0010] In the inspection support device according to the second aspect of the present invention, it is preferable that the damage detection process detects damage areas and the damage type for each damage area based on the image, the determination process determines whether or not two or more types of damage types have been detected in the same or adjacent damage areas by the damage detection process, and the output process outputs a damage detection result for the damage type with the highest priority as the damage detection result for the same or adjacent damage areas when the determination process determines that two or more types of damage have been detected in the same or adjacent damage areas. This is because, when two or more types of damage are detected from the same or adjacent positions on a structure, it is effective to output the damage detection result for the damage type with the highest priority and notify the user, etc.

[0011] In the third aspect of the present invention, the adjacent positions are preferably positions where the distance between two or more types of damage is equal to or less than a threshold value.

[0012] In the inspection support device according to the fourth aspect of the present invention, the damage detection process is preferably executed by a trained model that, when an image is input, outputs a damaged area and a damage type for each damaged area as a recognition result.

[0013] In the inspection support device according to the fifth aspect of the present invention, the output process preferably outputs different drawing patterns depending on whether the damage type is linear damage or planar damage.

[0014] In the inspection support device according to the sixth aspect of the present invention, the output process preferably outputs a damage diagram showing a line that does not close the linear damage when the damage type is linear damage, and outputs a damage diagram showing a closed line that surrounds the planar damage when the damage type is planar damage. When outputting a damage diagram using a line drawing pattern, in the case of linear damage, a damage diagram showing a line that does not close the linear damage is used, and in the case of the damage type is planar damage, a damage diagram showing a closed line that surrounds the planar damage is used.

[0015] In the inspection support device according to the seventh aspect of the present invention, it is preferable that the output processing outputs a damage image in which at least the linear damage is filled in when the damage type is linear damage, and outputs a damage image in which at least the planar damage is filled in when the damage type is planar damage.

[0016] In the inspection support device according to the eighth aspect of the present invention, the output process preferably includes outputting the damage detection result to a display for display, or saving the damage detection result in a file in a memory.

[0017] In the inspection support device according to the eighth aspect of the present invention, the priority order of the damage types is preferably a priority order that is set in advance according to the severity of the damage.

[0018] In the inspection support device according to the ninth aspect of the present invention, when the damage types are linear damage including linear free lime and cracks, the linear free lime has a higher priority than the cracks.

[0019] In the inspection support device of the tenth aspect of the present invention, in the case of surface damage including exposed rebar, peeling, rust, surface free lime, and water leakage as damage types, the priority is set in the order of decreasing rebar exposure, peeling, rust, surface free lime, and water leakage.

[0020] In the inspection support device of the twelfth aspect of the present invention, the processor performs a priority order reception process to receive the priority order of the damage type of the structure from an operation unit operated by a user, and the priority order of the damage type is the priority order received from the user via the operation unit.

[0021] In the inspection support device relating to the thirteenth aspect of the present invention, it is preferable that the processor performs an editing instruction reception process to receive an editing instruction for the damage detection result from an operation unit operated by a user, and an editing process to edit the damage detection result in accordance with the received editing instruction.

[0022] In the inspection support device of the fourteenth aspect of the present invention, it is preferable that the damage detection result includes a damage quantity table having items of damage identification information, damage type and size, and in which information corresponding to each item is written for each detected damage.

[0023] The invention of a 15th aspect is an inspection support method in which a processor supports inspection of a structure to be inspected, and each process of the processor includes the steps of acquiring an image of the structure to be inspected, detecting two or more types of damage to the structure based on the acquired image, determining whether or not two or more types of damage have been detected from the same or nearby positions among the two or more types of damage to the detected structure, and outputting the detected damage detection result, where if it is determined in the determining step that two or more types of damage have been detected from the same or nearby positions, the damage detection result is output in accordance with the priority order of the damage types.

[0024] The invention of a 16th aspect is an inspection support program that causes a computer to execute a method for supporting inspection of a structure to be inspected, the method including the steps of acquiring an image of the structure to be inspected, detecting two or more types of damage to the structure based on the acquired image, determining whether or not two or more types of damage have been detected from the same or nearby positions among the two or more types of damage to the detected structure, and outputting the detected damage detection result, wherein if it is determined in the determining step that two or more types of damage have been detected from the same or nearby positions, the damage detection result is output in accordance with the priority order of the damage types. Effect of the Invention

[0025] According to the present invention, when two or more types of damage are detected from a structure, particularly when two or more types of damage are detected from the same or adjacent positions on the structure, the damage detection results can be output satisfactorily. [Brief description of the drawings]

[0026] [Figure 1]FIG. 1 is a diagram showing an example of damage to a structure. [Diagram 2] FIG. 2 is a diagram showing an example of linear free lime. [Diagram 3] FIG. 3 is a diagram showing an example of planar free lime. [Figure 4] FIG. 4 is a diagram showing the types of damage representation methods depending on the type of damage, where FIG. 4(A) shows an image including a crack, and FIG. 4(B) shows an image in which a polyline is drawn along the crack. [Diagram 5] FIG. 5 is a diagram showing different methods of representing damage depending on the type of damage, where FIG. 5(A) shows an image including peeling and exposed rebar, and FIG. 5(B) shows an image in which polygons are drawn surrounding the areas of peeling and exposed rebar. [Figure 6] FIG. 6 is a diagram showing the types of damage representation methods according to the type of damage, where FIG. 6(A) shows an image including planar free lime, and FIG. 6(B) shows an image in which a polygon is drawn surrounding the area of ​​planar free lime. [Figure 7] FIG. 7 is a diagram showing respective polylines when a crack, which is a linear damage, and linear free lime are detected. [Figure 8] FIG. 8 is a diagram used to explain the proximity judgment between the crack, which is the linear damage shown in FIG. 7, and linear free lime. [Figure 9] FIG. 9 is a block diagram showing an example of a hardware configuration of an inspection support device according to the present invention. [Figure 10] FIG. 10 is a conceptual diagram showing an embodiment of a damage detection processing unit constituted by a CPU and the like. [Figure 11] FIG. 11 is a perspective view showing an example of a bridge to be inspected. [Figure 12] FIG. 12 is a diagram showing an example of an ortho-image corresponding to a space, which is one of the inspection units of a bridge. [Figure 13] FIG. 13 is a diagram showing an example of a damage detection result detected based on the orthoimage shown in FIG. [Figure 14]FIG. 14 is a diagram showing an example of an orthoimage on which a damage diagram corresponding to a coffer is superimposed. [Figure 15] FIG. 15 is a chart showing an example of a damage quantity table included in the damage detection result. [Figure 16] FIG. 16 is a schematic diagram showing an example of the damage detection results of cracks and linear free lime by the damage detection processing unit and the output process thereof. [Figure 17] FIG. 17 is a schematic diagram showing another example of the damage detection results of cracks and linear free lime by the damage detection processing unit and the output process thereof. [Figure 18] FIG. 18 is a schematic diagram showing an example of the results of damage detection of planar free lime and linear free lime by the damage detection processing unit and the output process thereof. [Figure 19] FIG. 19 is a schematic diagram showing another example of the results of damage detection of planar free lime and linear free lime by the damage detection processing unit and the output process thereof. [Figure 20] FIG. 20 is a schematic diagram showing an example of damage detection results of rust liquid, planar free lime, and water leakage by the damage detection processing unit, and the output process thereof. [Figure 21] FIG. 21 is a schematic diagram showing another example of the results of damage detection by the damage detection processing unit for rust liquid, planar free lime, and water leakage, and the output process thereof. [Figure 22] FIG. 22 is an image diagram showing a GUI illustrating a second embodiment of the damage detection result output, and is a diagram showing an example of a screen displayed on the display unit. [Diagram 23] FIG. 23 is an image diagram showing a GUI illustrating a second embodiment of the damage detection result output, and is a diagram showing another example of the screen displayed on the display unit. [Figure 24] Figure 24 is an image diagram of a GUI showing a third embodiment of damage detection result output, in which Figure 24(A) shows a case where the transparency of the fill color of the damage image is set to "10," and Figure 24(B) shows a composite image in which a damage image with a transparency of "10" is superimposed on an image of a structure. [Diagram 25]Figure 25 is an image diagram of a GUI showing a third embodiment of damage detection result output, in which Figure 25(A) shows a case where the transparency of the fill color of the damage image is set to "50", and Figure 25(B) shows a composite image in which a damage image with a transparency of "50" is superimposed on an image of a structure. [Figure 26] Figure 26 is an image diagram of a GUI showing a third embodiment of damage detection result output, in which Figure 26(A) shows a case where the transparency of the fill color of the damage image is set to "100," and Figure 26(B) shows a composite image in which a damage image with a transparency of "100" is superimposed on an image of a structure. [Figure 27] FIG. 27 illustrates how vertices can be added to a polygon that encloses an area of ​​damage. [Figure 28] FIG. 28 illustrates a method for removing vertices from polygons that enclose areas of damage. [Figure 29] FIG. 29 is a flowchart showing an embodiment of an inspection support method according to the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of an inspection support device, method, and program according to the present invention will be described with reference to the accompanying drawings.

[0028] [Summary of the Invention] FIG. 1 is a diagram showing an example of damage to a structure, and in particular shows damage to a concrete member that constitutes the structure.

[0029] Figure 1(A) shows a water leak A, which is one of the phenomena caused by damage to concrete members. Water leak A occurs when water leaks out from the damaged area due to damage to the concrete members (cracks, cracks in the construction joints, defective joint materials, etc.).

[0030] Figure 1(B) shows cracks (B) and free lime (C) that have occurred in a concrete member. 1 , and rust solution D. Free lime C 1Rust D refers to the phenomenon in which limescale comes to the surface when water evaporates from inside a concrete member due to water leakage, etc. Also, rust liquid D refers to brown corrosion products that seep out onto the concrete surface as a result of corrosion of reinforcing steel such as reinforcing bars inside the concrete member.

[0031] Figure 1(C) shows peeling E and exposed rebar F that occurred in a concrete member. Peeling E refers to a state in which a piece of concrete that was in a floating state peels off, and exposed rebar F refers to a state in which the rebar inside the concrete is exposed as a result of peeling E.

[0032] Although not shown, damage to steel members constituting a structure may include cracks, corrosion, breakage, deterioration of anticorrosive function, and the like.

[0033] FIG. 2 is a diagram showing an example of linear free lime, and FIG. 3 is a diagram showing an example of planar free lime.

[0034] Linear free lime C shown in Figure 2 (A) and (B) 2 The condition is that the cracks in the concrete are filled with limestone. Therefore, linear free limestone C 2 The cracks and the cracks have almost the same shape, and the linear free lime C 2 The linear free lime C 2 Cracks have occurred in the same location (area) as above.

[0035] The planar free lime shown in Figure 3(A) spreads downward along the horizontal crack due to water leakage from the crack. 1 The free lime C spreads from the cracks in the joints, and is shown in Fig. 3(C). 1 is spreading from the concrete cracks.

[0036] One aspect of the present invention detects damage to a structure to be inspected from an image captured of the structure, and outputs a damage detection result in accordance with the type of damage detected.

[0037] 4 to 6 are diagrams showing the types of damage expression methods according to the type of damage.

[0038] As shown in Fig. 4, when a crack is detected (Fig. 4(A)), the crack is expressed as a drawing pattern of unclosed lines (polylines) along the crack (Fig. 4(B)). This is because in the case of linear damage such as a crack, it is necessary to quantify the length.

[0039] Therefore, even when linear free lime is detected as shown in Fig. 2, the linear free lime is represented by a drawing pattern of polylines that follow the linear free lime. Although cracks and linear free lime are both linear damage, they are different types of damage, so it is preferable to represent them identifiably with polylines of different line types (e.g., colors).

[0040] As shown in Figure 5, when peeling E and exposed rebar F are detected (Figure 5(A)), the method of expressing peeling E and exposed rebar F is to express them as a drawing pattern using closed lines (polygons) that enclose the area of ​​planar damage (Figure 5(B)). This is because in the case of planar damage such as peeling E, it is necessary to quantify the area.

[0041] As shown in Figure 6, the surface of free lime C 1 When surface-shaped free lime C is detected (Fig. 6(A)), 1 To represent the area of ​​planar damage, we use a drawing pattern of closed lines (polygons) that enclose the area of ​​planar damage (Figure 6(B)).

[0042] Furthermore, surface-shaped free lime C 1 , peeling E, and exposed rebar F are all planar damage, but since the types of damage are different, it is preferable to represent them as polygons with different line types (e.g., colors) so that they can be distinguished.

[0043] In one aspect of the present invention, even if damage is classified as the same, if the shape of the damage is different, the damage type is determined to be different, and the damage type is represented by a different drawing pattern according to the shape. For example, linear free lime is represented by a polyline, and planar free lime is represented by a polygon.

[0044] In addition, two or more types of damage may be detected from the same or adjacent positions on a structure (image). Adjacent positions here refer to positions where the distance between two or more types of damage is equal to or less than a threshold. The threshold may be determined by default or may be set by the user.

[0045] For example, in the case of linear free lime, the linear free lime and concrete cracks overlap, and two damages are detected in the same position. Also, in the case of peeling E and exposed rebar F as shown in Figure 5, exposed rebar F exists within peeling E. Therefore, the distance between the two damages, exposed rebar F and peeling E, is below the threshold, and the two damages are located close to each other.

[0046] FIG. 7 is a diagram showing respective polylines when a crack, which is a linear damage, and linear free lime are detected.

[0047] In FIG. 7, X is a polyline indicating a crack, and Y is a polyline indicating linear free lime.

[0048] FIG. 8 is a diagram used to explain the proximity judgment between the crack, which is the linear damage shown in FIG. 7, and linear free lime.

[0049] Hereinafter, with reference to FIG. 8, an example of determining the "proximity" of two types of damage, namely cracks and linear free lime, will be described.

[0050] As shown in FIG. 8(A), the shortest distance between a point of interest P1 (the first vertex, which is the end point of polyline X) of polyline X indicating a crack and the linear polyline of free lime is defined as L1.

[0051] Similarly, as shown in FIG. 8(B), the shortest distance between the focus point P2 (second vertex) of the polyline X and the polyline Y is defined as L2, and as shown in FIG. 8(C), the shortest distance between the focus point P3 (third vertex) of the polyline X and the polyline Y is defined as L3.

[0052] 8(D) to 8(F), the shortest distances on two polylines X and Y are respectively designated as L4, L5, and L6. The shortest distance L4 is the shortest distance at focus point 4 on polyline Y (the vertex that is the end point of polyline Y), the shortest distance L5 is the shortest distance at focus point 5 on polylines X and Y (the focus point midway between focus points 4 and 6), and the shortest distance L6 is the shortest distance at focus point 6 on polyline X (the other vertex that is the end point of polyline X).

[0053] If L1, L2, L3>threshold and L4, L5, L6≦threshold, it is determined that the two polylines Y and X (two damages) are “close” in the range of L4 to L6. Note that the number of attention points P1 to P6 is not limited to the above example.

[0054] In addition, while the above example explained the distance between two types of linear damage, the distance between linear damage and planar damage can also be determined by calculating the shortest distance between each focus point on the polyline and the polygon, and determining whether they are "proximity."

[0055] In one aspect of the present invention, priorities are defined according to the types of damage, and when two or more types of damage are detected at the same or adjacent positions, the damage is represented according to the priorities. Details of the method of representing damage according to the priorities will be described later.

[0056] [Hardware configuration of inspection support device] FIG. 9 is a block diagram showing an example of a hardware configuration of an inspection support device according to the present invention.

[0057] A personal computer or a workstation can be used as the inspection support device 10 shown in Fig. 1. The inspection support device 10 of this example is mainly composed of an image acquisition unit 12, an image database 14, a storage unit 16, an operation unit 18, a CPU (Central Processing Unit) 20, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 24, and a display control unit 26.

[0058] The image acquisition unit 12 corresponds to an input / output interface, and in this example, acquires images of a structure to be inspected, etc. The structure to be inspected includes, for example, a bridge, a tunnel, and the like.

[0059] The images acquired by the image acquisition unit 12 are, for example, a large number of images (a group of captured images) of a structure taken by a drone (unmanned aerial vehicle) or a robot equipped with a camera, or manually. It is preferable that the group of captured images covers the entire structure, and that adjacent captured images overlap.

[0060] The group of captured images acquired by the image acquisition unit 12 is stored in an image database 14.

[0061] The storage unit 16 is a memory that is configured from a hard disk device, a flash memory, etc., and stores an operating system, an inspection support program, information indicating the priority order of damage types, CAD (computer-aided design) data indicating structures, and file The damage inspection results, etc., which have been organized into a layer, are stored. The damage inspection results can be stored as damage information in a layer that differs for each type of damage. The damage information includes a damage diagram.

[0062] If CAD data for the structure to be inspected exists, it can be used. If no CAD data for the structure exists, it can be automatically created based on the captured images stored in the image database 14.

[0063] If the group of captured images stored in the image database 14 were captured by a camera mounted on a drone, feature points between overlapping images in the group of captured images can be extracted, and the position and attitude of the camera mounted on the drone can be estimated based on the extracted feature points. In addition, a three-dimensional point cloud model can be generated in which the three-dimensional positions of the feature points are simultaneously estimated from the estimated results of the camera position and attitude.

[0064] There is a Structure from Motion (SfM) method that tracks the movement of multiple feature points in a group of images captured by a drone as the camera's shooting position moves, and simultaneously estimates the 3D structure of a structure (Structure) and the camera's posture (Motion). In recent years, an optimization calculation method called bundle adjustment has been developed, which makes it possible to produce highly accurate output.

[0065] It should be noted that the camera parameters (focal length, image size of the image sensor, pixel pitch, etc.) required when applying the SfM technique can be those stored in the storage unit 16. Also, CAD data of the structure can be generated based on the generated 3D point cloud model.

[0066] The operation unit 18 includes a keyboard, a mouse, etc., which are connected to the computer by wire or wirelessly, and in addition to functioning as an operation unit for issuing normal operating instructions for the computer, it also functions as an operation unit for editing the damage detection results of the structure detected based on photographed images of the structure through user operation, and for setting the priorities of multiple damage types of the structure through user operation. Details of editing the damage detection results and setting the priorities of the damage types will be described later.

[0067] The CPU 20 reads out various programs stored in the memory unit 16 or the ROM 24, etc., and controls each unit in an integrated manner, as well as performs a damage detection process to detect damage to the structure (two or more types of damage) based on an image of the structure, a determination process to determine whether two or more types of damage have been detected from the same or nearby positions, and an output process to output the damage detection results detected by the damage detection process.

[0068] Damage detection processing, which detects two or more types of damage based on images of a structure, can be performed using artificial intelligence (AI).

[0069] As an AI, for example, a trained model using a Convolutional Neural Network (CNN) can be used.

[0070] FIG. 10 is a conceptual diagram showing an embodiment of a damage detection processing unit constituted by a CPU and the like.

[0071] In FIG. 10, the damage detection processing unit 21 is made up of a plurality of (three in this example) trained models 21A, 21B, and 21C corresponding to a plurality of types of damage.

[0072] Each of the trained models 21A, 21B, and 21C includes an input layer, an intermediate layer, and an output layer, and each layer has a structure in which a plurality of "nodes" are connected by "edges."

[0073] An image 13 of a structure is input to the input layer of the CNN. The intermediate layer has multiple sets, each of which consists of a convolutional layer and a pooling layer, and is the part that extracts features from the image input from the input layer. The convolutional layer filters nearby nodes in the previous layer (performing a convolution operation using a filter) to obtain a "feature map." The pooling layer reduces the feature map output from the convolutional layer to create a new feature map. The "convolutional layer" is responsible for extracting features such as edges from images, and the "pooling layer" is responsible for providing robustness so that the extracted features are not affected by things like translation.

[0074] The output layer of the CNN is a part that outputs a feature map showing the features extracted by the intermediate layer. The output layers of the trained models 21A, 21B, and 21C in this example output, for example, inference results obtained by classifying (segmenting) the areas of damage in the structure shown in the image in pixel units or in units of a group of several pixels, as damage detection results 27A, 27B, and 27C.

[0075] For example, trained model 21A is a trained model trained by machine learning to detect damage caused by water leakage, planar free lime, and rust fluid, and outputs the damage area of ​​each of the damage caused by water leakage, planar free lime, and rust fluid and the damage type for each damage area as damage detection result (recognition result) 27A. Trained model 21B is a trained model trained by machine learning to detect damage caused by peeling and exposed rebar, and outputs the damage area of ​​each of the damage caused by peeling and exposed rebar and the damage type for each damage area as damage detection result 27B. Trained model 21C is a trained model trained by machine learning to detect damage caused by cracks and linear free lime, and outputs the damage area of ​​each of the damage caused by cracks and linear free lime and the damage type for each damage area as damage detection result 27C.

[0076] The damage detection processing unit 21 is not limited to the above embodiment, and may be configured to have an individual trained model for each damage type, and each trained model may output a damage area corresponding to the respective damage type as a damage detection result. In this case, the number of trained models is the same as the number of damage types to be inspected. Alternatively, the damage detection processing unit 21 may be configured to have one trained model that can handle all damage types, and output a damage area and a damage type for each damage area as a damage detection result.

[0077] Returning to Figure 9, the CPU 20 outputs the damage detection results detected by the damage detection process to the display unit (display) 30 via the display control unit 26 for display, or causes the damage detection results to be saved as a file in the memory unit 16.

[0078] The RAM 22 is used as a working area for the CPU 20, and is used as a storage unit for temporarily storing read programs and various data.

[0079] The display control unit 26 is a part that creates display data to be displayed on the display unit 30 and outputs it to the display unit 30. In this example, it causes the display unit 30 to display the damage detection results detected by the CPU 20, and also causes the display unit 30 to display a screen for editing the damage detection results based on user operations from the operation unit 18, etc.

[0080] The display unit 30 uses various types of displays such as an LCD monitor that can be connected to a computer, and displays images of the structure input from the display control unit 26 as well as damage detection results detected from the images, and is also used as part of the user interface together with the operation unit 18.

[0081] The processor including the CPU 20 of the inspection support device 10 configured as above reads out the inspection support program stored in the storage unit 16 or the ROM 24, and executes the inspection support program to perform each of the above processes.

[0082] <Function of the inspection support device> Next, the operation of the inspection support device 10 shown in FIG. 9 will be described using a bridge as an example of a structure.

[0083] FIG. 11 is a perspective view showing an example of a bridge to be inspected.

[0084] As shown in Figure 11, a bridge 1 is composed of various components including main girders 2 spanning between piers 7, cross beams 3 that are set perpendicular to the main girders 2 and connect the main girders together, and diagonal beams 4 and cross beams 5 that connect the main girders 2 together, and a deck 6 for vehicles to run on is poured above the main girders. The deck 6 is generally made of reinforced concrete.

[0085] The deck 6 typically has a rectangular space defined by the main girders 2 and cross girders 3 as its basic unit, and inspection of the deck for damage (cracks, concrete spalling, etc.) is carried out on a space-by-space basis.

[0086] Each lattice of the deck is one of the components (inspection units) that make up the structure (bridge). In addition to the deck (lattice), the inspection units of a bridge include the parts and components that make up the structure (2 main girders, 3 cross beams, 4 diagonal beams, 5 cross beams, 7 piers (columns, walls, beams, corners, and joints)).

[0087] The CPU 20 of the inspection support device 10, the inspection support program stored in the storage unit 16, the RAM 22, the ROM 24, the display control unit 26, etc. constitute a processor, and the processor performs various types of processing as described below.

[0088] The processor performs an image acquisition process to acquire images for each inspection unit from a plurality of images of the structure (bridge 1) to be inspected that are stored in the image database 14.

[0089] FIG. 12 is a diagram showing an example of an ortho-image corresponding to a space, which is one of the inspection units of a bridge.

[0090] An ortho-image is an image obtained by orthogonally projecting an image of a structure (a room) onto the surface of the room. An ortho-image of one room can be created by extracting multiple images corresponding to the room from the group of captured images stored in the image database 14, synthesizing the extracted multiple images into a panorama, and projecting the synthesized panorama onto the surface of the room.

[0091] When an orthoimage (image 13) of the lattice is input, damage detection processing unit 21 shown in FIG. 10 detects damage in the lattice based on input image 13, and outputs damage detection results 27A to 27C.

[0092] FIG. 13 is a diagram showing an example of a damage detection result detected based on the orthoimage shown in FIG.

[0093] The damage detection result shown in FIG. 13 shows a damage diagram indicating the damage to the lattice of the inspected object.

[0094] The damage diagram shown in Figure 13 illustrates five cracks C1 to C5 and concrete spalling H1.

[0095] The damage diagram shown in Figure 13 is represented by a drawing pattern using polylines along each of the cracks C1 to C5 (linear damage) detected on the orthoimage, and a drawing pattern using polygons surrounding the area of ​​peeling H1 (planar damage), or an image in which the inside of the polygons is filled in.

[0096] FIG. 14 is a diagram showing an example of an orthoimage on which a damage diagram corresponding to a coffer is superimposed.

[0097] The orthoimage with the damage diagram superimposed thereon shown in FIG. 14 can be created by superimposing the damage diagram shown in FIG. 13 on the orthoimage shown in FIG.

[0098] Damage maps can be created by assigning colors to damaged areas according to the type of damage, and by overlaying the damage map on the orthoimage, the damaged areas can be easily visually identified.

[0099] FIG. 15 is a chart showing an example of a damage quantity table included in the damage detection result.

[0100] The damage quantity table shown in Figure 15 has items such as damage identification information (ID: identification), damage type, size (width), size (length), and size (area), and information corresponding to each item is recorded for each damage.

[0101] In the case of cracks, which are linear damage, the length and width of each crack C1 to C5 are quantified, and in the case of peeling, which is planar damage, the area of ​​the peeling H1 region is quantified. This information is then entered in the damage quantity table in association with the damage ID.

[0102] [First embodiment of damage detection result output] FIG. 16 is a schematic diagram showing an example of the damage detection results of cracks and linear free lime by the damage detection processing unit and the output process thereof.

[0103] FIG. 16(A) shows a state in which the image 13 is input to the damage detection processing unit 21 (trained model 21C) shown in FIG. 10, and the trained model 21C detects a crack B and linear free lime C. 2 The damage detection results showing the damage areas and the damage types for each of the damage areas are shown in FIG. 1. In this case, the CPU 20 detects the cracks B and linear free lime C. 2 The process then determines whether or not the first and second images have been detected from the same or adjacent positions.

[0104] In the example shown in Figure 16(A), there is a crack B and linear free lime C. 2 For convenience, the free limestone C is shown side by side. 2 The concrete crack B is filled with limestone. Therefore, the linear free lime C 2 Crack B has almost the same shape, and linear free lime C 2 The linear free lime C 2 Crack B has occurred in the same position (area) as above.

[0105] Crack B and linear free lime C shown in Figure 16(A) 2 In this case, CPU20 is crack B and linear free lime C. 2 It is judged that the crack B and the linear free lime C were detected in the same or adjacent positions. 2 When it is determined that the damage types and the damage types are detected from the same or adjacent positions, the CPU 20 performs an output process to output the damage detection result in accordance with the priority order of the damage types.

[0106] In this example, the priority of damage type is linear free lime C over crack B. 2 Since the priority is set to be high, the CPU 20 detects the linear free lime C 2 A damage image in which the area of ​​the damaged portion is filled in is displayed on the display unit 30 via the display control unit 26, or a linear free lime C 2 The CAD data of the damage diagram showing the polyline is output as a file. The file of the CAD data of the damage diagram is preferably stored in the storage unit 16 in association with the image in which the damage is detected.

[0107] FIG. 17 is a schematic diagram showing another example of the damage detection results of cracks and linear free lime by the damage detection processing unit and the output process thereof.

[0108] In the example shown in Figure 17(A), there is a crack B and linear free lime C. 2 A part of the crack B and linear free lime C were detected. 2 Part of the above occurs in the same location.

[0109] In this case, CPU20 is a part of crack B and linear free lime C 2 The CPU 20 judges that the part of the crack B and the linear free lime C are detected from the same position. 2 As for the overlapping portion, the CPU 20 detects linear free lime C as shown in FIG. 17(B). 2 The damage image in which the area of ​​the damaged portion is filled in is displayed on the display unit 30 via the display control unit 26, or the linear free lime C2 The CAD data of the damage diagram showing the polylines is output to a file.

[0110] In addition, CPU20 is linear free lime C 2 The remaining part of the crack B that does not overlap with the area of ​​the crack B is displayed as a damage image in which the area of ​​the crack B is filled in on the display unit 30 via the display control unit 26, or CAD data of a damage diagram showing the polyline of the crack B is output as a file. In addition, the damage image and CAD data showing the crack B and the linear free lime C are output as a file. 2 It is preferable that the damage image and CAD data showing the above-mentioned damage can be distinguished from each other by changing the line type (for example, color), for example.

[0111] FIG. 18 is a schematic diagram showing an example of the results of damage detection of planar free lime and linear free lime by the damage detection processing unit and the output process thereof.

[0112] FIG. 18(A) shows a case where the image 13 is input to the damage detection processing unit 21 (trained models 21A and 21C) shown in FIG. 10, and the trained model 21A detects planar free lime C 1 The damaged area was detected, and linear free lime C was detected by the trained model 21C. 2 In this case, the CPU 20 detects the free lime C 1 and linear free lime C 2 It is determined whether or not the two are detected from the same or adjacent positions.

[0113] In the example shown in FIG. 18(A), the surface of free lime C 1 and linear free lime C 2 Since the free limestone C and the free limestone C overlap each other, the CPU20 is 1 and linear free lime C 2 The above are judged to have been detected from the same or adjacent positions. 1 and linear free lime C 2and are determined to have been detected from the same or adjacent positions, respectively, the CPU 20 outputs a damage detection result in accordance with the priority order of the damage types.

[0114] In the example shown in Figure 18, the surface of free lime C 1 , Linear free lime C 2 Since the priority order is set to be low, the CPU 20 selects the planar free lime C as shown in FIG. 1 and linear free lime C 2 In the overlapping area, the surface free lime C 1 Prioritize the surface free lime C 1 The damaged area is filled with a specific color to be displayed on the display unit 30 via the display control unit 26. 2 The CPU 20 causes the display unit 30 to display a damage image in which a part of the area is filled in on the display unit 30 via the display control unit 26. In addition, as shown in FIG. 1 and linear free lime C 2 In the overlapping area, the surface free lime C 1 CAD data of polygons enclosing the damaged areas, along with non-overlapping linear free lime C 2 Output CAD data of some polylines to a file.

[0115] FIG. 19 is a schematic diagram showing another example of the results of damage detection of planar free lime and linear free lime by the damage detection processing unit and the output process thereof.

[0116] The example shown in Figure 19 has a smaller surface area of ​​free lime compared to the example shown in Figure 18. 1 Priority and linear free lime C 2 The order of priority is reversed, and linear free lime C 2 The priority of the surface free lime C 1 has a higher priority than

[0117] As shown in Figure 19(A), the surface of free lime C 1 and linear free lime C 2When the two parts overlap each other, the CPU 20 detects the planar free lime C as shown in FIG. 1 and linear free lime C 2 In the overlapping area, linear free lime C 2 The damaged area is filled in and the image is displayed with priority. Similarly, the linear free lime C 2 The CAD data of the polyline is given priority and the file is output. In this case, the surface-shaped free lime C 1 In this case, neither damage images nor CAD data will be output.

[0118] FIG. 20 is a schematic diagram showing an example of damage detection results of rust liquid, planar free lime, and water leakage by the damage detection processing unit, and the output process thereof.

[0119] FIG. 20(A) shows a case where an image 13 is input to the damage detection processing unit 21 (trained model 21A) shown in FIG. 10, and rust liquid D and planar free lime C are detected by the trained model 21A. 1 In this case, the CPU 20 detects the rust liquid D, the surface-shaped free lime C, and the damaged area of ​​the water leak A. 1 It is determined whether leaks A and B are detected at the same or adjacent positions.

[0120] In the example shown in Figure 20(A), a surface of free lime C is formed inside the area of ​​water leakage A. 1 The surface of free lime C 1 Since rust liquid D has formed on the inside of the damage, these damages overlap each other in whole or in part.

[0121] Rust liquid D and surface-shaped free lime C shown in Figure 20(A) 1 In the case of the water leakage A, the CPU 20 judges that these damages are detected at the same or adjacent positions. 1 When it is determined that the leaks A and B are detected at the same or adjacent positions, the CPU 20 outputs the damage detection result in the order of priority of the damage types.

[0122] In the example shown in Figure 20, rust liquid D and surface-shaped free lime C 1 Since the priority order is set to be low for the leakage water A and low for the leakage water B, the CPU 20 detects a surface of free lime C on the leakage water A region as shown in FIG. 1 The area is then layered with the free lime C. 1 The area of ​​the rust liquid D is overlaid on the area of ​​the rust liquid D, and the area is filled with a different color for each damage type, and the damage image is displayed on the display unit 30 via the display control unit 26. In addition, the CPU 20 displays the rust liquid D, the planar free lime C, and the like as shown in FIG. 20(C). 1 , and the CAD data of the polygons surrounding each area of ​​leakage A are output to a file.

[0123] FIG. 21 is a schematic diagram showing another example of the results of damage detection by the damage detection processing unit for rust liquid, planar free lime, and water leakage, and the output process thereof.

[0124] The example shown in Figure 21 is different from the example shown in Figure 20 in that the rust liquid D and the surface-shaped free lime C 1 The priority of the leak A is set in reverse, and the leak A is set in reverse, and the surface free lime C is set in reverse. 1 The priority order is set to be low for Rust Liquid D, and low for Rust Liquid E.

[0125] As shown in Figure 21(A), rust liquid D and surface-shaped free lime C 1 21B, the CPU 20 preferentially displays the damage image in which the area of ​​the leaking water A, which has the highest priority, is filled in. In this case, the rust liquid D and the planar free lime C present inside the area of ​​the leaking water A are displayed. 1 The damage image of the water leakage A is no longer displayed. The CPU 20 outputs the CAD data of the polygon surrounding the area of ​​the water leakage A, which has the highest priority, as a file, with priority as shown in FIG. 21(C). In this case, the rust liquid D and the planar free lime C existing inside the area of ​​the water leakage A are 1 The CAD data for the polygons surrounding the object will not be output.

[0126] The priority of the damage types is not limited to the above example, but it is preferable to set the priority according to the severity of the damage (the more advanced the damage is). For example, in the case of linear damage including linear free lime and cracks as damage types, linear free lime is set to a higher priority than cracks. In addition, in the case of surface damage including exposed rebar, peeling, rust, surface free lime, and water leakage as damage types, the priority is set in the order of decreasing rebar exposure, peeling, rust, surface free lime, and water leakage.

[0127] The priority order of the damage types may be set appropriately by the user using the operation unit 18. In this case, the CPU 20 performs a priority order reception process for receiving the priority order of the damage types of the structure from the operation unit 18 operated by the user, stores the received priority order in the storage unit 16 or the like, and reads out the priority order from the storage unit 16 for use as necessary.

[0128] [Second embodiment of damage detection result output] 22 and 23 are image diagrams of a GUI (Graphical User Interface) showing a second embodiment of the damage detection result output.

[0129] FIG. 22 is a diagram showing an example of a screen 40 displayed on the display unit 30. As shown in FIG.

[0130] This screen 40 displays a composite image in which a damage image is superimposed on an image of the structure, check boxes 42 for selecting the type of damage to be displayed, and various icon buttons used for editing, etc. The damage detection results for each damage type detected by the damage detection processing unit 21 based on the image of the structure can be held as CAD data with a layer structure indicating the damage area for each damage type.

[0131] In the example shown in Figure 22, all five damage types, i.e., water leakage, free lime, rust, peeling, and exposed rebar, are checked in the check boxes 42 (five damage types are selected), so damage images of the above five damage types are superimposed on the image of the structure displayed on the screen 40.

[0132] Here, the damage image corresponding to the damage type can be created by filling the damaged area with a color corresponding to the damage type based on the CAD data of the layer corresponding to the damage type. The color corresponding to the damage type can be a color set in advance according to the damage type or a color set by the user.

[0133] FIG. 23 is a diagram showing another example of the screen 40 displayed on the display unit 30. As shown in FIG.

[0134] In the example shown in FIG. 23, the damage image displayed on the screen 40 is different from the example shown in FIG.

[0135] In the screen 40 shown in Figure 23, the three damage types of water leakage, rust, and exposed rebar are checked in the check boxes 42, so that images of the above three damage types are superimposed on the image of the structure displayed on the screen 40.

[0136] Therefore, the screen 40 shown in FIG. 23 is different from the screen 40 shown in FIG. 22 in that the damage images corresponding to free lime and peeling have been deleted.

[0137] According to the second embodiment of the damage detection result output, the user can select one or more desired damage types, and a damage image showing the selected damage type can be displayed. It is preferable that only one or more damage types detected from the image are displayed in the check box 42. The method of displaying the damage area for each damage type is not limited to the embodiment shown in Figs. 22 and 23.

[0138] [Third embodiment of damage detection result output] 24 to 26 are image diagrams of GUIs showing the third embodiment of damage detection result output.

[0139] FIG. 24A is a diagram showing an example of a setting screen 44 for performing various settings.

[0140] In the setting screen 44 shown in Figure 24 (A), a "tab" for setting the color of damage, etc. is selected, and by using this setting screen, the user can set the color of the damage image according to the damage type shown in Figure 22, etc.

[0141] Furthermore, the setting screen 44 shown in FIG. 24(A) is provided with a knob 45A used to set the transparency of the color (fill color) of the damaged image, and a dialog box 45B that displays the transparency.

[0142] In the example shown in Fig. 24(A), the transparency of the fill color of the damage image is set to "10." Note that in this example, the transparency in the case of opaqueness is "0," and the transparency in the case of complete transparency is "100."

[0143] FIG. 24(B) shows a composite image in which a damage image with a transparency level of "10" is superimposed on an image of a captured structure.

[0144] The composite image shown in FIG. 24(B) can be displayed by setting the transparency to "10" on the setting screen shown in FIG. 24(A) and then closing the setting screen.

[0145] FIG. 25(A) shows a setting screen in which the transparency is set to "50," and FIG. 25(B) shows a composite image in which a damage image with a transparency of "50" is superimposed on an image of a structure.

[0146] Moreover, FIG. 26(A) shows a setting screen in which the transparency is set to "100," and FIG. 26(B) shows a composite image in which a damage image with a transparency of "100" is superimposed on an image of a structure.

[0147] In FIG. 26(B), the transparency of the fill color is "100", so the fill color is completely transparent, but the closed polygons surrounding the damage areas for each damage type are displayed in the color set according to the damage type.

[0148] By displaying the damage image by setting the transparency of the color that fills the damage image in this manner, the user can visually recognize the image (damage) of the structure that is covered by the damage image.

[0149] The second and third embodiments of the damage detection result output can be used in combination.

[0150] [Edit damage detection results] When the damage detection processing unit 21 shown in Figure 10 inputs an image 13 of a structure, it outputs the damage type and the damage area for each damage type as damage detection results, but the damage detection results may be erroneous or inaccurate.

[0151] For example, the damage area may be inaccurate because it is classified by pixel or by a group of several pixels. Also, two cracks detected as two lines may be better joined as one line because it may be possible to infer that the cracks are connected inside the concrete.

[0152] Therefore, the CPU 20 performs an editing instruction receiving process for receiving an instruction to edit the damage detection result through an operation on the operation unit 18 (for example, a mouse) operated by the user, and performs an editing process for editing the damage detection result in accordance with the received editing instruction.

[0153] As an example of editing the damage detection results, when linear damage of the same type exists and the endpoints of polylines are close to each other, editing to connect the endpoints may be performed. In this case, editing may be performed by measuring the distance between the endpoints of polylines of the same type of linear damage after the damage detection process, and if the measured distance is equal to or less than a threshold, the endpoints may be automatically connected, or may be automatically connected according to a user's instruction. The threshold may be a default value, or may be set by the user.

[0154] In addition, thresholds for the length and width of linear damage and for the area of ​​planar damage may be set, and damage detection results smaller than the thresholds may be automatically deleted. The damage detection results may be deleted automatically after the damage detection process, or may be deleted at the user's instruction. The thresholds may be default values, or may be set by the user.

[0155] 27 and 28 are diagrams showing examples of editing the damage detection results. When editing the damage detection results, it is preferable to set the transparency of the color used to fill in the damage image high so that the image of the structure can be easily viewed, as shown in the third embodiment of the damage detection result output.

[0156] FIG. 27 illustrates how vertices can be added to a polygon that encloses an area of ​​damage.

[0157] The polygon is drawn by connecting multiple vertices (shown as squares in Figure 27) along the damaged area.

[0158] To add a vertex to this polygon, place the mouse cursor on the polygon line to which you want to add a vertex as shown in Figure 27(A), right-click the mouse, and select [Add] from the context menu. This allows you to add a new vertex to the polygon line as shown in Figure 27(B).

[0159] You can then edit the polygon surrounding the damaged area by dragging the added vertex and moving it to the edge of the original damaged area.

[0160] FIG. 28 illustrates a method for removing vertices from polygons that enclose areas of damage.

[0161] To delete a vertex from this polygon, move the mouse cursor to the vertex you want to delete as shown in Figure 28(A), right-click (to select the vertex), and select [Delete] from the context menu. This will delete the vertex from the polygon as shown in Figure 28(B).

[0162] When a vertex is deleted from a polygon, as shown in FIG. 28(B), lines in the polygon are connected between the vertices before and after the deleted vertex, thereby editing the polygon to enclose the area of ​​damage.

[0163] The above editing example has been described with respect to editing such as adding and deleting vertices in polygons of planar damage, but editing such as adding and deleting vertices in polylines of linear damage can also be performed in the same way.

[0164] In addition, the editing functions include the ability to select an entire polyline or polygon by clicking on the line connecting the vertices, and to delete the entire polyline or polygon at once, as well as the ability to manually add new polylines or polygons to areas where damage has been missed.

[0165] [Inspection support method] FIG. 29 is a flowchart showing an embodiment of an inspection support method according to the present invention.

[0166] The processing of each step shown in FIG. 29 is performed by, for example, a processor constituted by the CPU 20 and the like of the inspection support device 10 shown in FIG.

[0167] In FIG. 29, the processor acquires an image of the structure to be inspected from the image acquisition unit 12, the image database 14, or the like (step S10).

[0168] The damage detection processing unit 21 (FIG. 10) detects damage to the structure based on the image acquired in step S10 (step S12).

[0169] The processor determines whether or not damage is detected by the damage detection performed in step S12 (step S14), and if damage is detected (if "Yes"), determines whether or not two or more types of damage are detected (step S16).

[0170] When step S16 determines that two or more types of damage have been detected (if "Yes"), the processor further determines whether or not two or more types of damage have been detected in the same or adjacent positions (step S18).

[0171] Then, when it is determined in step S18 that two or more types of damage have been detected at the same or adjacent positions (if "Yes"), the processor outputs the damage detection results according to the priority order of the damage types (step S20). The damage detection results are output, for example, by superimposing the damage image on the image, or by displaying the damage image alone on the display unit, or by outputting CAD data showing the damage diagram as a file.

[0172] On the other hand, if two or more types of damage are not detected in step S16 (if "No"), i.e., if only one type of damage is detected, or if it is determined in step S18 that two or more types of damage have not been detected in the same or nearby positions (if "No"), the process transitions to step S22, where the detection results of one or more types of damage are output as is.

[0173] [others] The hardware for realizing the inspection support device according to the present invention can be composed of various processors. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes a program and functions as various processing units, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically to execute specific processing such as an ASIC (Application Specific Integrated Circuit). One processing unit constituting the inspection support device may be composed of one of the above-mentioned various processors, or may be composed of two or more processors of the same or different types. For example, one processing unit may be composed of multiple FPGAs, or a combination of a CPU and an FPGA. In addition, multiple processing units may be composed of one processor. As an example of configuring multiple processing units with one processor, first, there is a form in which one processor is configured by a combination of one or more CPUs and software, as represented by a computer such as a client or a server, and this processor functions as multiple processing units. Secondly, there is a form that uses a processor that realizes the functions of the entire system including multiple processing units on a single IC (Integrated Circuit) chip, as typified by System On Chip (SoC). In this way, the various processing units are configured as a hardware structure using one or more of the above-mentioned various processors. Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit (circuitry) that combines circuit elements such as semiconductor elements. be.

[0174] The present invention also includes an inspection support program that, when installed in a computer, causes the computer to function as the inspection support device according to the present invention, and a storage medium on which this inspection support program is recorded.

[0175] Furthermore, the present invention is not limited to the above-described embodiment, and it goes without saying that various modifications are possible without departing from the spirit of the present invention. [Explanation of symbols]

[0176] 1 Bridges 2 Main digit 3 crossbeam 4. Anti-tilt structure 5 Horizontal structure 6 Floor slab 7. Pier 10 Inspection support device 12 Image acquisition section 13 Images 14 Image Database 16 Memory section 18 Control section 20 CPU 21 Damage detection processing section 21A Pre-trained model 22 RAM 24 ROM 26 Display control section 27A~27C Damage detection results 30 Display section 40 screens 42 Checkbox 44 Setting screen 45A Knob 45B Dialog Box A Water leakage B, C1~C5 Cracks C 1 Free lime (planar) C 2 Free lime (linear) D rust juice E Peeling F. Exposed rebar H1 Peeling L1~L6 Shortest distance P1~P6 Highlights S10~S22 steps X,Y Polyline

Claims

1. An inspection support device including a processor, The processor, A damage detection process for detecting damage to the structure based on an image of the structure; an output process of superimposing a damage detection result in a color corresponding to the type of damage detected on an image of the structure or an image obtained by projective transformation of the image of the structure, and outputting the result; This is an inspection support device.

2. The processor performs a determination process to determine whether or not two or more types of damage are detected from the same or adjacent positions. The inspection support device according to claim 1.

3. the output process performs output process of outputting the damage detection result in accordance with the priority order of the damage types; 3. The inspection support device according to claim 1 or 2.

4. The type of damage includes at least one of cracks, free lime, water leakage, rust, peeling, and exposed rebar; The inspection support device according to any one of claims 1 to 3.

5. The color according to the type of damage is a color preset according to the type of damage, or a color set by the user. The inspection support device according to any one of claims 1 to 4.

6. a user interface for selecting one or more injury types; the output process performs output processing for outputting a damage detection result of a damage type selected by the user interface from among the detected damage types; The inspection support device according to any one of claims 1 to 5.

7. An inspection support method for supporting inspection of a structure by a processor, comprising: Each process of the processor is Detecting damage to the structure based on an image of the structure; a step of superimposing a damage detection result in a color corresponding to the type of damage detected on an image of the structure or an image obtained by projective transformation of the image of the structure, and outputting the result; An inspection support method comprising:

8. An inspection support program that causes a computer to execute a method for supporting inspection of a structure to be inspected, the method comprising: Detecting damage to the structure based on an image of the structure; a step of superimposing a damage detection result in a color corresponding to the type of damage detected on an image of the structure or an image obtained by projective transformation of the image of the structure, and outputting the result; Inspection support program including.

Images