Structure diagnosis example presentation device, method, and program

Abstract

Provided are a structure diagnostic-case presentation device, method, and program that can assist a diagnostician with making a more appropriate diagnosis when diagnosing damage to a target structure that is to be diagnosed. When information (damage information) relating to a target structure which is to be diagnosed is acquired by a first information acquisition unit (20), a similar damage extraction unit (22-1) extracts from a database (12) similar damage, which resembles the damage done to the target structure, on the basis of the acquired damage information. A specific diagnostic case extraction unit (24-1) extracts from the database (12), as a specific diagnostic case, a diagnostic result which is for the structure that includes the extracted similar damage, and which is a diagnostic result for a structure having different diagnostic results from at least two points in time. Information relating to the extracted specific diagnostic case is displayed on a display unit (14).

Description

[Technical Field]

[0001] The present invention relates to an apparatus, method and program for presenting diagnostic examples of structures, and more particularly to a technique for presenting information related to specific diagnostic examples that are prone to misdiagnosis when diagnosing structures. [Background technology]

[0002] Conventionally, when diagnosing a structure, an inspector would closely visually inspect the damaged area of ​​the structure, and if necessary, perform tapping and other inspections to diagnose the damage to the structure based on the damage situation (determining the extent of the damage, estimating the cause of the damage, determining the soundness, determining whether repairs are necessary, selecting a repair method, etc.).

[0003] In response to this, an information processing device has been proposed that determines the attributes of a deformed part of a structure captured in an image (Patent Document 1).

[0004] The information processing device described in Patent Document 1 detects deformed parts such as cracks in a structure in an input image, extracts features related to partial images of the deformed parts from the input image based on the detection results, and uses the extracted features to determine the attributes of the deformed parts.

[0005] If the deformed part is a crack, the attributes of the deformed part include the width of the crack, the risk of the crack, the cause of the crack, and the like.

[0006] Furthermore, Patent Document 1 describes that a class called "false detection" can be added to the crack width class as an attribute of the deformed portion. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Publication No. 2018-198053 Summary of the Invention [Problem to be solved by the invention]

[0008] However, when a diagnostician diagnoses a structure, a high level of skill and experience is required, and a misdiagnosis can occur due to the diagnostician's lack of skill and experience. In addition, the number of skilled diagnosticians is decreasing.

[0009] If a misdiagnosis occurs in the diagnosis of structural damage, optimal repairs cannot be carried out, resulting in a problem of low cost-effectiveness of repairs.

[0010] The information processing device described in Patent Document 1 detects deformed areas such as cracks in a structure from an input image and determines the attributes of the deformed areas using features related to the image portion of the detected deformed areas, but it does not assist the diagnostician in diagnosing the structure (especially by providing assistance in reducing misdiagnosis).

[0011] The present invention has been made in consideration of the above circumstances, and aims to provide a device, method, and program for presenting diagnostic examples of structures that can assist diagnosticians in making more accurate diagnoses of damage to target structures that are the subject of diagnosis. [Means for solving the problem]

[0012] In order to achieve the above object, the invention according to a first aspect is a diagnostic case presentation device for a structure, comprising a processor and a database that stores information about a structure, including at least one of a photographed image of the structure and damage information about the structure, and diagnostic results for damage to the structure at two or more points in time, in association with each other. The processor acquires information about a target structure, which is a diagnostic target, including at least one of a photographed image of the target structure and the damage information, and extracts similar damage that is similar to the damage of the target structure based on the information about the target structure and the information about the structure stored in the database. The processor extracts diagnostic results for structures having similar damage, where the diagnostic results for the structures at two or more points in time are different, from the database as specific diagnostic cases. , special Information related to the diagnostic case is output to the display.

[0013] According to the first aspect of the present invention, when information about a target structure that is a diagnostic target is acquired, the acquired target structure The system extracts specific diagnostic cases from a database based on information about the object, and presents information related to the specific diagnostic cases on a display. Here, specific diagnostic cases are those that have similar damage to the target structure, and the diagnostic results for structures with similar damage differ at two or more points in time. This allows the diagnostician to refer to the information related to the presented specific diagnostic cases when diagnosing the target structure, enabling even an inexperienced diagnostician to make an appropriate diagnosis.

[0014] In the structure diagnosis example presentation device according to the second aspect of the present invention, the specific diagnosis example is a diagnosis example that has been misdiagnosed or is likely to be misdiagnosed, because the specific diagnosis example is one in which the diagnosis results at two or more points in time are different.

[0015] In the structure diagnostic example presentation device according to the third aspect of the present invention, the damage information stored in the database preferably includes at least one of the type of damage to the structure, the location of the damage, and the degree of the damage.

[0016] In the fourth aspect of the present invention, in the structure diagnostic case presentation device, the database stores at least one of images taken at multiple points in time of the same location of the structure, damage information at multiple points in time detected from the images taken at multiple points in time, and information indicating changes in the damage information over time, and the processor preferably acquires information about the target structure at multiple points in time, detects changes in the damage information over time based on the information about the target structure at multiple points in time, and uses the information indicating the changes over time as one piece of information when extracting similar damage that is similar to the damage of the target structure from the database.

[0017] In the diagnostic case presentation device for a structure according to the fifth aspect of the present invention, it is preferable that the processor acquires a photographed image of the target structure and information for calculating actual dimensions related to the photographed image, detects damage to the target structure from the photographed image, and calculates the degree of the detected damage based on the information for calculating actual dimensions.

[0018] In the structure diagnostic example presentation device according to the sixth aspect of the present invention, it is preferable that the processor acquires a group of divided images obtained by dividing the target structure into images, and synthesizes the group of divided images into a panoramic image.

[0019] In the structure diagnostic case presentation device according to the seventh aspect of the present invention, it is preferable that the diagnostic results include at least one of the results of determining the degree of damage, the results of determining the countermeasure category, the results of determining the soundness, the results of estimating the cause of damage, the results of determining whether repair is necessary, and the results of selecting a repair method.

[0020] In the structure diagnostic case presentation device according to the eighth aspect of the present invention, the diagnostic results at two or more points in time preferably include a diagnostic result at a first point in time and a diagnostic result at a second point in time that is later than the first point in time, and the diagnostic result at the first point in time is a diagnostic result at the beginning of an inspection or a diagnostic result at the time of a regular inspection, and the diagnostic result at the second point in time is a diagnostic result confirmed by a different diagnostician from the diagnostician at the first point in time, a diagnostic result at a time of an inspection that is more detailed than the inspection at the first point in time, or a diagnostic result at the time of repair design of the structure.

[0021] In the structure diagnostic case presentation device relating to the ninth aspect of the present invention, it is preferable that the processor calculates the distance in feature space between the first feature vector and the second feature vector, using information about the target structure as a first feature vector and information about the structure stored in the database as a second feature vector, and extracts similar damage from the database that is similar to the damage to the target structure based on information about the structure having the second feature vector whose distance is below a threshold.

[0022] In the structure diagnostic case presentation device according to the tenth aspect of the present invention, it is preferable that the processor extracts from the database as specific diagnostic cases diagnostic results of structures having similar damage, where the diagnostic results at two or more points in time are different, and which match the diagnostic purpose of the target structure.

[0023] In the structure diagnostic example presentation device according to the eleventh aspect of the present invention, the processor preferably extracts the specific diagnostic example with the highest similarity, or extracts a plurality of specific diagnostic examples with the highest similarity.

[0024] In the structure diagnostic case presentation device relating to the 12th aspect of the present invention, it is preferable that the information about the structure stored in the database includes at least one of a photographed image of the structure and damage information about the structure, and at least one of structural information, environmental information, historical information, and inspection information about the structure, and that the information about the target structure acquired in the information acquisition process includes at least one of a photographed image of the target structure and damage information about the target structure, and at least one of structural information, environmental information, historical information, and inspection information about the target structure.

[0025] In the structural diagnostic case presentation device relating to the thirteenth aspect of the present invention, it is preferable that the processor extracts at least one similar damage, extracts at least one specific diagnostic case, calculates the misdiagnosis rate of the specific diagnostic cases based on the number of extracted similar damages and the number of extracted specific diagnostic cases, and outputs at least one specific diagnostic case and the misdiagnosis rate from the extracted specific diagnostic cases to a display.

[0026] A method for presenting diagnostic cases for structures according to a 14th aspect of the present invention involves a processor acquiring information about a target structure, including at least one of photographed images and damage information about the target structure to be diagnosed; extracting similar damage that is similar to the damage to the target structure based on the information about the target structure and information about the structure stored in a database; extracting from the database as specific diagnostic cases diagnostic results for structures having similar damage, where the diagnostic results stored in the database differ at two or more points in time; and outputting information related to the specific diagnostic cases to a display.

[0027] A structure diagnostic case presentation program according to a fifteenth aspect of the present invention is implemented by a computer to acquire information about a target structure, including at least one of photographed images and damage information of the target structure to be diagnosed, extract similar damage that is similar to the damage of the target structure based on the information about the target structure and information about the structure stored in a database, extract from the database as specific diagnostic cases diagnostic results of structures having similar damage, where the diagnostic results stored in the database differ at two or more points in time, and output information related to the specific diagnostic cases to a display. [Effects of the Invention]

[0028] According to the present invention, when a diagnostician diagnoses damage to a target structure that is the subject of diagnosis, information related to a specific diagnosis case is presented, so that even an unskilled diagnostician can make a more appropriate diagnosis. [Brief explanation of the drawings]

[0029] [Figure 1] FIG. 1 is a block diagram showing an embodiment of the hardware configuration of a structure diagnosis example presentation device according to one aspect of the present invention. [Figure 2] FIG. 2 is a block diagram showing a first embodiment of a structure diagnostic example presentation device according to an aspect of the present invention. [Figure 3] FIG. 3 is a block diagram showing a second embodiment of the structure diagnosis example presentation device according to an aspect of the present invention. [Figure 4] FIG. 4 is a diagram showing an example of a method for extracting similar damage by the similar damage extracting unit. [Figure 5] Figure 5 is a chart showing the types of diagnostic objectives and the diagnostic results at two time points for each diagnostic objective. [Figure 6] FIG. 6 is a flowchart illustrating an embodiment of a method for presenting a diagnostic example of a structure according to one aspect of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0030] Hereinafter, preferred embodiments of a diagnostic example presentation device, method, and program for a structure according to one aspect of the present invention will be described with reference to the accompanying drawings.

[0031] [Hardware configuration of the structural diagnostic case presentation device] FIG. 1 is a block diagram showing an embodiment of the hardware configuration of a structure diagnosis example presentation device according to one aspect of the present invention.

[0032] As shown in Figure 1, the structural diagnostic case presentation device 1 can be configured using a personal computer, a workstation, etc., and is equipped with a processor 10, a memory 11, a database 12, a display unit 14, an input / output interface 16, and an operation unit 18, etc.

[0033] The processor 10 is composed of a CPU (Central Processing Unit) and the like, and controls each part of the structure diagnostic case presentation device 1, and functions, for example, as a first information acquisition unit 20, a similar damage extraction unit 22-1, and a specific diagnostic case extraction unit 24-1 shown in Figure 2.

[0034] Here, the term "structure" includes buildings, for example, civil engineering structures such as bridges, tunnels, and dams, as well as buildings, houses, and architectural structures such as walls, pillars, and beams of buildings.

[0035] When the first information acquisition unit 20 acquires information about the target structure to be diagnosed, the processor 10 causes the similar damage extraction unit 22-1 and the specific diagnosis case extraction unit 24-1 to extract specific diagnosis cases from the database 12 that stores information about the structure (past information) and the like, and outputs information related to the extracted specific diagnosis cases to the display unit 14. Details of the first information acquisition unit 20, the similar damage extraction unit 22-1, and the specific diagnosis case extraction unit 24-1 shown in Fig. 2 will be described later.

[0036] The memory 11 includes a flash memory, a read-only memory (ROM), a random access memory (RAM), etc. The flash memory and the ROM are non-volatile memories that store various programs, including an operating system and a structure diagnostic case presentation program according to one embodiment of the present invention. The RAM functions as a work area for processing by the processor 10. It also temporarily stores the structure diagnostic case presentation program stored in the flash memory, etc. The processor 10 may have a part of the memory 11 (RAM) built in. The structure diagnostic case presentation program may be recorded on an external recording medium (not shown) and distributed, and installed by the processor 10 from the recording medium. Alternatively, the structure diagnostic case presentation program may be stored in a state accessible from outside, such as on a server connected to a network, and downloaded to the flash memory or the ROM by the processor 10 upon request, where it is installed and executed.

[0037] The processor 10 controls and processes each part of the structure diagnosis example presentation device 1 in accordance with a structure diagnosis example presentation program, using the RAM as a work area.

[0038] The database 12 is a part that stores and manages information about structures and diagnostic results of damage to the structures at two or more points in time in association with each other. Details of the information about structures and the diagnostic results of damage to the structures at two or more points in time managed by the database 12 will be described later.

[0039] The display unit 14 displays information related to specific diagnostic cases extracted by the processor 10 based on information about the target structure that is the diagnosis target. When diagnosing the target structure, the diagnoser can refer to the information related to the specific diagnostic cases presented on the display. The display can be used as part of a user interface for accepting instructions from the diagnoser.

[0040] The input / output interface 16 includes a connection that can be connected to an external device and a communication unit that can be connected to a network. The connection unit that can be connected to an external device may be a Universal Serial Bus (USB), a High-Definition Multimedia Interface (HDMI) (HDMI is a registered trademark), or the like. The processor 10 can acquire information about a desired target structure via the input / output interface 16. Instead of the display unit 14, an external display device connected to the input / output interface 16 can be used.

[0041] The operation unit 18 includes a keyboard, a pointing device such as a mouse, and a keyboard, and functions as a user interface that accepts various specifications from the diagnostician.

[0042] [First embodiment of the structural diagnostic example presentation device] FIG. 2 is a block diagram showing a first embodiment of a structure diagnostic example presentation device according to an aspect of the present invention.

[0043] The first embodiment of the structure diagnostic case presentation device shown in Figure 2 is composed of a processor 10, a database 12, and a display unit 14 of the structure diagnostic case presentation device 1 having the hardware configuration shown in Figure 1, and the processor 10 functions as a first information acquisition unit 20, a similar damage extraction unit 22-1, and a specific diagnostic case extraction unit 24-1.

[0044] The first information acquisition unit 20, which functions as an input unit, performs an information acquisition process to acquire information about the target structure, which is the diagnosis target, including at least one of a photographed image and damage information of the target structure, in response to an instruction from the diagnoser. In this example, the first information acquisition unit 20 acquires damage information about the target structure.

[0045] The damage information of the target structure acquired by the first information acquisition unit 20 is output to the similar damage extraction unit 22-1.

[0046] The database 12 is a part that stores and manages information about a large number of structures that have been diagnosed in the past and the results of diagnosis of damage to the structures at two or more points in time, in association with each other.

[0047] The information about the structure includes at least one of a photographed image of the structure and damage information about the structure. The damage information includes at least one of the type of damage to the structure, the location of the damage, and the extent of the damage. It may also include an image (damage image) showing damage detected from the photographed image of the structure.

[0048] <Examples of diagnostic results at two or more points in time> The diagnostic results at two or more points in time include a diagnostic result at a first point in time and a diagnostic result at a second point in time that is later than the first point in time.

[0049] The diagnosis result at the first time point may be a diagnosis result at the beginning of an inspection or a diagnosis result at the time of a periodic visual inspection.

[0050] No. 2 time The diagnostic results may be those determined by a different diagnostician from the one at the first point in time (for example, a council such as a result confirmation meeting that finalizes the diagnosis), those determined at a time of inspection that is more detailed than a visual inspection (those determined at the time of visual inspection, as well as destructive testing, non-destructive testing, etc.), or those determined at the time of repair design of the structure.

[0051] Diagnosis results from two or more time points may or may not coincide, with later diagnosis results being more likely than earlier ones.

[0052] <Example of diagnosis result> The diagnosis results include at least one of the following: the assessment result of the degree of damage, the assessment result of the countermeasure classification, the assessment result of the soundness, the estimation result of the cause of damage, the assessment result of whether repair is necessary, and the selection result of the repair method. Damage level assessment results Damage level a / b / c / d / e (Reference: Bridge Periodic Inspection Guidelines: Ministry of Land, Infrastructure, Transport and Tourism) Countermeasure classification results Countermeasure classification: A / B / C / E, etc. (Reference: Bridge Periodic Inspection Guidelines: Ministry of Land, Infrastructure, Transport and Tourism) A: No repairs are required. B: Repairs must be made depending on the situation. C1: From the perspective of preventive maintenance, repairs etc. need to be carried out promptly. C2: From the perspective of the safety of the bridge structure, repairs etc. must be carried out promptly. E1: Urgent action is necessary from the viewpoint of the safety of the bridge structure. E2: Others require urgent action. M: This needs to be addressed through maintenance work. S1: Further investigation is needed. S2: There is a need for follow-up. Healthyness assessment results Soundness: I / II / III / IV (Reference: Bridge Periodic Inspection Guidelines: Ministry of Land, Infrastructure, Transport and Tourism) Examples of causes of damage [For concrete members] Deterioration: Fatigue (repeated load), salt damage, carbonation, alkali-aggregate reaction, frost damage, chemical erosion Factors during construction: hydration heat and drying shrinkage during construction Structural factors: excessive external force, improper design [For steel members] Deterioration: Fatigue (repeated load), salt damage Structural factors: excessive external force, improper design - Repair necessity determination results Repair required / not required Repair method selection results <Examples of repair methods> [Example of concrete member repair method] Crack repair work (crack injection work, crack filling work), cross-section repair work (plastering method, spraying method, filling method), surface treatment work (surface coating work, surface impregnation work), replacement work, peeling prevention work, cathodic protection work, desalination work, re-alkalization work, waterproofing work [Example of repair method for steel components] Plate reinforcement work, component replacement work, repainting work, waterproofing work, stop hole work, welding repair work, bolt replacement, types of repair materials Furthermore, repair performance varies not only depending on the type of repair method but also on the type of repair material used (manufacturer, model number), so selecting a repair method is a concept that includes the selection of both the type of repair method and the repair material.

[0053] Now, based on the information about the target structure, the similar damage extraction unit 22-1 extracts information similar to the information about the target structure from information about structures stored in the database 12 (information about a large number of structures that have been diagnosed in the past).

[0054] The similarity determination can be made based on damage information such as the type of damage, the location of the damage, and the extent of the damage (length, width, area, density, depth, etc.) (average value, maximum value, etc.).

[0055] Furthermore, similarity determination can be made based on the damage information as well as the location and degree of damage over time. In this case, database 12 must store at least one of images of the same location on the structure taken at multiple points in time, damage information at multiple points in time detected from the images taken at multiple points in time, and information indicating the change in damage information over time, and first information acquisition unit 20 must acquire information about the target structure at multiple points in time.

[0056] The similar damage extraction process by the similar damage extraction unit 22-1 detects changes in damage information over time based on information about the target structure at multiple points in time, and information indicating this change over time can be used as one piece of information when extracting similar damage that is similar to the damage of the target structure from the database 12. This makes it possible to extract specific diagnosis cases that also have similar changes in damage information over time. Note that the "multiple points in time" at which photographed images of the same location of the structure stored in the database 12 and damage information detected from the photographed images are acquired may all, some, or not all of the acquisition points in time be the same.

[0057] Furthermore, the similar damage extraction unit 22-1 may determine similarity by taking into consideration information other than damage information, such as at least one of structural information, environmental information, history information, and inspection information of the structure. Details of the structural information, environmental information, history information, and inspection information of the structure will be described later.

[0058] The specific diagnosis case extraction unit 24-1 extracts specific diagnosis results (specific diagnosis cases) from among the diagnosis results of structures having similar damage extracted by the similar damage extraction unit 22-1 (i.e., diagnosis results associated with information on similar damage), from the database 12. The diagnosis results extracted as specific diagnosis cases are diagnosis results of structures for which diagnosis results at two or more points in time are different.

[0059] That is, the specific diagnosis case is a past diagnosis result having damage similar to that of the target structure, and is a diagnosis result in which the diagnosis results at two or more points in time are different (a misdiagnosis result or a diagnosis result that is likely to be mistaken).

[0060] The processor 10 outputs to the display unit 14 information relating to the specific diagnostic case extracted by the specific diagnostic case extraction unit 24-1.

[0061] The display unit 14 displays information related to the specific diagnostic case on the specific diagnostic case presentation unit 14A. The information related to the specific diagnostic case includes the specific diagnostic case itself, or information that, separately from or together with the specific diagnostic case, alerts the user that the specific diagnostic case is a case in which a misdiagnosis is likely to occur.

[0062] It is also preferable to display photographed images, damage information, etc. corresponding to the specific diagnosis case on the display unit 14. Furthermore, the display unit 14 can display photographed images, damage images, damage diagrams, etc. of the target structure.

[0063] When diagnosing a target structure, a diagnoser can refer to information related to the specific diagnostic case presented in the specific diagnostic case presentation unit 14A, thereby enabling even an unskilled diagnoser to make an appropriate diagnosis.

[0064] [Second embodiment of the structural diagnostic example presentation device] FIG. 3 is a block diagram showing a second embodiment of the structure diagnostic example presentation device according to an aspect of the present invention.

[0065] The second embodiment of the structural diagnostic case presentation device shown in Figure 3 is composed of the processor 10, database 12, and display unit 14 of the structural diagnostic case presentation device 1 having the hardware configuration shown in Figure 1, and the processor 10 functions as the image acquisition unit 32, damage detection unit 34, actual size information acquisition unit 35, panorama synthesis unit 36, second information acquisition unit 38, similar damage extraction unit 22-2, and specific diagnostic case extraction unit 24-2.

[0066] The image acquisition unit 32, damage detection unit 34, actual size information acquisition unit 35, and panoramic synthesis unit 36 ​​correspond to the first information acquisition unit 20 shown in Figure 2, and generate damage information based on the captured image of the target structure included in the information 30 about the target structure.

[0067] That is, the image acquisition unit 32 acquires photographed images of the target structure that is the diagnosis target in response to an instruction from the diagnostician, and outputs the acquired photographed images to the damage detection unit 34.

[0068] The damage detection unit 34 performs damage detection processing to detect damage to the target structure shown in the captured image based on the captured image of the target structure input from the image acquisition unit 32. The damage detection unit 34 can apply, for example, a trained model such as a convolution neural network (CNN) that has been machine-learned to detect damage, but is not limited to this and may also detect damage using a detection algorithm.

[0069] Another input to the damage detection unit 34 is information for calculating the actual dimensions of the target structure (actual dimension information) from the actual dimension information acquisition unit 35. The actual dimension information is the actual size of a characteristic part of the target structure in the captured image (for example, the length, width, etc. of a steel member), or the resolution of the subject (mm / pixel).

[0070] The damage detection unit 34 detects damage to the target structure and can detect the size of the damage (crack length and crack width if the damage is a crack) or the degree of the damage based on the actual size information. This makes it possible to extract specific diagnosis cases with similar degrees (sizes) of damage.

[0071] The damage detection unit 34 can detect damage to concrete components such as cracks, water leakage, free lime, peeling, exposed rebar, lifting, surface bubbles, peanut brittleness, cold joints, overlay lines, sand streaks, and sludge leakage, and can detect damage to steel components such as cracks, corrosion, and deterioration of corrosion prevention function. The damage detection results may also be modified as needed by the diagnoser.

[0072] In addition, the damage information detected by the damage detection unit 34 may include at least one of the type of damage to the structure, the location of the damage, and the extent of the damage (length, width, area, density, depth, average value, maximum value, etc.).

[0073] For example, when the image acquisition unit 32 acquires a group of divided images of the target structure, the panoramic synthesis unit 36 ​​performs a synthesis process in which the group of divided images is panoramic-synthesized and also panoramic-synthesized damage information (damage images).

[0074] If the desired resolution (for example, the resolution required to detect a 0.1 mm crack) cannot be obtained with a single image of the target structure, the target structure is photographed in segments (including overlapping areas between adjacent images) to obtain a group of segmented images. The segmented image groups are then panoramic-combined, and damage information is also panoramic-combined. For example, if one crack is photographed across multiple images, the crack in each image can be linked. Note that if the desired resolution can be obtained with a single image, the panoramic composition by the panoramic composition unit 36 ​​can be omitted.

[0075] The damage information of the target structure generated in this manner is output to the similar damage extraction unit 22-2.

[0076] The second information acquisition unit 38 acquires information other than the captured image (other information) from the information 30 about the target structure as second information.

[0077] <Other information> The other information includes at least one of the following: structural information of the structure, environmental information, history information, and inspection information. Structural information: structural type (for bridges: girder bridge, rigid frame bridge, truss bridge, arch bridge, cable-stayed bridge, suspension bridge), component type (for bridges: deck, pier, abutment, girder, etc.), material (steel, reinforced concrete, PC (Prestressed Concrete), etc.) Environmental information: traffic volume (daily, monthly, annual, cumulative, etc.), distance from the sea, climate (average temperature, average humidity, rainfall, snowfall, etc.) Historical information: conditions at the time of construction (temperature at the time of construction, etc.), age (completion date, start of use date, age since then), repair history, disaster history (earthquakes, typhoons, floods, etc.) Inspection information: monitoring information (deflection of the structure, vibration amplitude, vibration period, etc.), core drilling test information, non-destructive testing information (ultrasonic, radar, infrared, hammering, etc.) The other information may also include the diagnostic purpose of the target structure, such as determining the degree of damage, determining the classification of countermeasures, determining soundness, estimating the cause of damage, determining whether repairs are necessary, and selecting repair methods.

[0078] The second information acquisition unit 38 acquires other information (second information) from the information 30 related to the target structure, outputs the second information to the similar damage extraction unit 22-2, and also outputs information indicating the diagnostic purpose to the specific diagnostic case extraction unit 24-2. Note that the information indicating the diagnostic purpose is not limited to being output from the second information acquisition unit 38 to the specific diagnostic case extraction unit 24-2, and the diagnoser may use the operation unit 18 to input the information indicating the diagnostic purpose to the specific diagnostic case extraction unit 24-2.

[0079] The similar damage extraction unit 22-2 extracts information similar to the information about the target structure (information with similar damage information and other information) from among the information about a large number of past structures stored in the database 12, based on information about the target structure including damage information about the target structure input from the panoramic synthesis unit 36 ​​and second information (other information) input from the second information acquisition unit 38.

[0080] FIG. 4 is a diagram showing an example of a method for extracting similar damage by the similar damage extracting unit.

[0081] In FIG. 4, in a feature space defined by feature vectors A and B, a large amount of damage information relating to structures stored in the database 12 and damage information relating to the current diagnosis target are plotted.

[0082] In Figure 4, damage information about structures stored in database 12 is indicated by an x, and damage information about the current diagnosis target is indicated by a ●. Furthermore, feature vector A indicates the maximum crack width (mm), and feature vector B indicates the number of years since the structure began service. The feature space based on feature vectors can be a multidimensional space consisting of three or more feature vectors, but for simplicity's sake, Figure 4 shows a two-dimensional space consisting of two feature vectors.

[0083] The similar damage extraction unit 22-2 calculates the distance between the feature vector (first feature vector) of the damage information of the current diagnosis target indicated by a ● mark and the feature vector (second feature vector) of the damage information indicated by an × mark in the feature space shown in Fig. 4, and extracts the damage information indicated by an × mark when this distance is equal to or less than a threshold (within the dotted circle in Fig. 4) as similar damage. This threshold can be optimized by a statistical method.

[0084] The distance may be a distance (Euclidean distance) when the multiple parameters of the first feature vector and the second feature vector are not weighted, or a distance (Mahalanobis distance) when they are weighted. The weights to be assigned to each parameter may be determined by a statistical method such as principal component analysis.

[0085] In addition to the above judgments, additional search conditions can be specified as points or ranges in the feature space. For example, if you specify bridges with a completion date of January 1, 1990 or later and a basic structure of a girder bridge, you can extract similar damage to structures within the specified range.

[0086] In addition to the above, similar damage can be extracted by setting damage information, structure information, environment information, history information, inspection information, and the like contained in other information as axes of the feature space.

[0087] The method for extracting similar damage may be a method other than the method that judges based on distance in feature space. For example, extraction may be performed using AI (Artificial Intelligence) that judges similarity from images, or AI that judges similarity by combining multiple pieces of information, such as images, damage information, and other information.

[0088] The specific diagnosis case extraction unit 24-2, like the specific diagnosis case extraction unit 24-1 shown in Figure 2, extracts from the database 12, as specific diagnosis cases, the diagnosis results of structures that have similar damage and for which the diagnosis results at two or more points in time are different, and further extracts specific diagnosis cases on the condition that the diagnosis purpose of the target structure matches the diagnosis purpose.

[0089] Figure 5 is a chart showing the types of diagnostic objectives and the diagnostic results at two points in time for each diagnostic objective. Note that Figure 5 shows cases where the diagnostic results at the two points in time (the first and second points in time) are different.

[0090] When the diagnostic objective information input from the second information acquisition unit 38 indicates, for example, a soundness judgment, the specific diagnostic example extraction unit 24-2 extracts specific diagnostic examples in which the soundness judgment results differ at two points in time. Furthermore, there may be two or more diagnostic objectives. In this case, it is preferable to extract specific diagnostic examples in which the diagnostic results of each of the two or more diagnostic objectives differ at two points in time, but it is also possible to extract specific diagnostic examples in which the diagnostic results of one or more of the two or more diagnostic objectives differ at two points in time.

[0091] Furthermore, when multiple specific diagnostic cases are detected, the specific diagnostic case extraction unit 24-2 may extract the specific diagnostic case with the highest similarity, or may extract the top multiple specific diagnostic cases (for example, up to the top three) with the highest similarity.

[0092] The display unit 14 displays information related to the specific diagnostic cases extracted by the specific diagnostic case extraction unit 24-2 on the specific diagnostic case presentation unit 14A. When the specific diagnostic case extraction unit 24-2 extracts a plurality of specific diagnostic cases with the highest similarity, the display unit 14 may display the plurality of specific diagnostic cases in descending order of similarity, or may scroll the plurality of specific diagnostic cases in descending order of similarity according to a scroll operation by the diagnostician.

[0093] The display unit 14 is also capable of displaying information 30 relating to the target structure (photographed images and other information of the target structure), damage information, and the like.

[0094] When diagnosing a target structure, a diagnoser can refer to information related to the specific diagnostic case presented in the specific diagnostic case presentation unit 14A, thereby enabling even an unskilled diagnoser to make an appropriate diagnosis.

[0095] The processor 10 can also perform an error diagnosis rate calculation process to calculate an error diagnosis rate of specific diagnostic cases based on the number of similar damages extracted by the similar damage extraction units 22-1 and 22-2 (similar damage extraction process) and the number of specific diagnostic cases extracted by the specific diagnostic case extraction units 24-1 and 24-2 (specific diagnostic case extraction process). The processor 10 extracts at least one similar damage in the similar damage extraction units 22-1 and 22-2 (similar damage extraction process). The processor 10 also extracts at least one specific diagnostic case in the specific diagnostic case extraction units 24-1 and 24-2 (specific diagnostic case extraction process).

[0096] The misdiagnosis rate can be calculated as the ratio of the total number of similar injuries to the number of specific diagnostic cases among similar injuries where the diagnostic results at two points in time were different.

[0097] The processor 10 can display the specific diagnosis case and the misdiagnosis rate on the display unit 14. The processor 10 can display at least one specific diagnosis case and the misdiagnosis rate on the display unit 14. By being presented with the specific diagnosis case and the misdiagnosis rate, the diagnoser can determine whether the diagnosis of damage to the target structure is likely to be misdiagnosed, and if the misdiagnosis rate is high, the diagnoser can make a more careful diagnosis by referring to the specific diagnosis case.

[0098] [Method of presenting structural diagnostic examples] 6 is a flowchart showing an embodiment of a structure diagnostic example presentation method according to one aspect of the present invention. The processing of each step shown in FIG. 6 is performed by the processor 10 of the structure diagnostic example presentation device 1 shown in FIG.

[0099] In FIG. 6, the processor 10 acquires a photographed image of a target structure that is a diagnostic target in response to an instruction from a diagnostician (step S10).

[0100] The processor 10 detects damage to the target structure shown in the captured image based on the captured image of the target structure, and acquires damage information indicating the damage (step S20, damage detection processing, information acquisition processing).

[0101] The processor 10 extracts similar damage that is similar to the damage of the target structure from the database 12 based on information about the target structure including damage information and information about the structure stored in the database 12 (step S30, similar damage extraction process).

[0102] Next, the processor 10 extracts from the database 12 specific diagnosis results (specific diagnosis results where diagnosis results at two or more points in time differ) from the diagnosis results of structures having similar damage extracted in step S30 (step S40, specific diagnosis case extraction process). The specific diagnosis results are diagnosis results where diagnosis results at two or more points in time differ, and therefore are misdiagnosed diagnosis results or diagnosis results that are likely to be misdiagnosed.

[0103] The processor 10 performs step S 40 The information related to the specific diagnostic case extracted in step S50 is output to the display unit 14 and displayed on the specific diagnostic case presentation unit 14A (step S50, output process). The information related to the specific diagnostic case preferably includes photographed images, damage information, etc. corresponding to the specific diagnostic case, in addition to diagnostic results that differ at two or more points in time.

[0104] This allows a diagnostician to refer to information related to the specific diagnostic case presented in the specific diagnostic case presentation unit 14A when diagnosing a target structure, enabling even an unskilled diagnostician to make an appropriate diagnosis.

[0105] [others] In this embodiment, specific diagnosis cases in which the diagnosis results at two or more points in time are different are extracted from the diagnosis results of structures that have similar damage to the damage of the target structure. However, this is not limited to this, and the diagnosis results of structures that have similar damage to the damage of the target structure may be extracted as specific diagnosis cases from cases in which the diagnosis results at two or more points in time are different.

[0106] In this embodiment, for example, the hardware structure of a processing unit such as a CPU that executes various processes and the database 12 is made up of various processors as follows: The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacture, and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing specific processes.

[0107] A single processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor. Examples of multiple processing units configured with a single processor include, first, a configuration in which one processor is configured with a combination of one or more CPUs and software, as typified by client or server computers, and this processor functions as multiple processing units. Second, a configuration in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip, as typified by a System on Chip (SoC). In this way, the various processing units are configured with one or more of the above-mentioned various processors as a hardware structure.

[0108] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit made up of a combination of circuit elements such as semiconductor elements.

[0109] Furthermore, the present invention includes a structure diagnostic case presentation program that, when installed on a computer, causes the computer to function as the structure diagnostic case presentation device of the present invention, and a non-volatile storage medium on which this structure diagnostic case presentation program is recorded.

[0110] Furthermore, it goes without saying that the present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention. [Explanation of symbols]

[0111] 1 Diagnostic case presentation device 10 processors 11. Memory 12 Databases 14 Display section 14A Specific diagnosis case presentation section 16 Input / Output Interfaces 18 Control section 20 1st Information Acquisition Department 22-1, 22-2 Similar damage extraction section 24-1, 24-2 Specific diagnosis case extraction section 32 Image acquisition unit 34 Damage detection unit 35 Actual size information acquisition section 36 Panorama synthesis section 38 2nd Information Acquisition Department S10~S50 steps

Claims

1. A diagnostic example presentation device for a structure, comprising: a processor; and a database that stores information about the structure, including at least one of a photographed image of the structure and damage information about the structure, and diagnostic results for damage to the structure at two or more points in time, in association with each other, The processor: Acquire information about the target structure, which is the target of diagnosis, including at least one of a photographed image and damage information of the target structure; extracting damage similar to the damage of the target structure based on information about the target structure and information about the structure stored in the database; extracting, from the database as a specific diagnosis case, a diagnosis result of the structure having the similar damage, the diagnosis result of the structure having the similar damage and the diagnosis result at two or more points in time that are different from each other and stored in the database; outputting information related to the specific diagnostic case to a display; A device that displays structural diagnostic examples.

2. The specific diagnostic case is a diagnostic case that has been misdiagnosed or is likely to be misdiagnosed, The structure diagnostic example presentation device according to claim 1 .

3. The damage information stored in the database includes at least one of a type of damage to the structure, a location of the damage, and a degree of the damage. The structure diagnostic example presentation device according to claim 1 or 2.

4. the database stores at least one of the photographed images of the same location of the structure taken at a plurality of times, the damage information at the plurality of times detected from the photographed images taken at the plurality of times, and information indicating a change in the damage information over time; The processor: Acquire information about the target structure at multiple points in time; detecting a change in the damage information over time based on information about the target structure at the plurality of points in time, and using information indicating the change over time as one piece of information when extracting the similar damage that is similar to the damage of the target structure from the database; The structure diagnostic example presentation device according to any one of claims 1 to 3.

5. The processor: acquiring the photographed image of the target structure and information for calculating the actual size related to the photographed image; detecting damage to the target structure from the photographed image, and calculating the degree of the detected damage based on the information for calculating the actual size; The structure diagnostic example presentation device according to any one of claims 1 to 4.

6. The processor: A group of divided photographed images of the target structure is obtained; synthesizing the group of dividedly captured images into a panorama; The structure diagnostic example presentation device according to any one of claims 1 to 5.

7. The diagnosis result includes at least one of a damage degree determination result, a countermeasure classification determination result, a soundness determination result, a damage cause estimation result, a repair necessity determination result, and a repair method selection result. The structure diagnostic example presentation device according to any one of claims 1 to 6.

8. the diagnostic results at two or more points in time include the diagnostic result at a first point in time and the diagnostic result at a second point in time that is later than the first point in time, The diagnosis result at the first time point is the diagnosis result at an early stage of inspection or the diagnosis result at the time of regular inspection, The diagnostic result at the second time point is the diagnostic result confirmed by a diagnostician different from the diagnostician at the first time point, the diagnostic result at the time of an inspection that is more detailed than the inspection at the first time point, or the diagnostic result at the time of repair design of the structure. The structure diagnostic example presentation device according to any one of claims 1 to 7.

9. the processor defines information about the target structure as a first feature vector and information about the structure stored in the database as a second feature vector, calculates the distance in feature space between the first feature vector and the second feature vector, and extracts the similar damage that is similar to the damage of the target structure from the database based on information about the structure having the second feature vector such that the distance is equal to or less than a threshold. The structure diagnostic example presentation device according to any one of claims 1 to 8.

10. The processor extracts, from the database as the specific diagnosis case, the diagnosis result of the structure having the similar damage, where the diagnosis results at the two or more points in time are different and match the diagnosis purpose of the target structure. The structure diagnostic example presentation device according to any one of claims 1 to 9.

11. The processor extracts the specific diagnostic case having the highest similarity, or extracts a plurality of specific diagnostic cases having the highest similarity. The structure diagnostic example presentation device according to any one of claims 1 to 10.

12. the information about the structure stored in the database includes at least one of a photographed image of the structure and damage information about the structure, and at least one of structural information, environmental information, history information, and inspection information about the structure; The acquired information about the target structure includes at least one of a photographed image of the target structure and damage information about the target structure, and at least one of structural information, environmental information, history information, and inspection information about the target structure. The structure diagnostic example presentation device according to any one of claims 1 to 10.

13. The processor: Extracting at least one of the similar lesions; extracting at least one of the specific diagnostic cases; calculating a misdiagnosis rate of the specific diagnosis cases based on the number of the extracted similar damages and the number of the extracted specific diagnosis cases; outputting at least one specific diagnostic case out of the extracted specific diagnostic cases and the misdiagnosis rate to the display; The structure diagnostic example presentation device according to any one of claims 1 to 12.

14. A method for presenting diagnostic examples of a structure using a database that stores information about the structure, including at least one of photographed images of the structure and damage information about the structure, in association with diagnostic results for damage to the structure at two or more points in time, comprising: Acquire information about the target structure, which is the target of diagnosis, including at least one of a photographed image and damage information of the target structure; extracting damage similar to the damage of the target structure based on information about the target structure and information about the structure stored in the database; extracting, from the database as a specific diagnosis case, a diagnosis result of the structure having the similar damage, the diagnosis result of the structure having the similar damage and the diagnosis result at two or more points in time that are different from each other and stored in the database; outputting information related to the specific diagnostic case to a display; A method for presenting diagnostic examples of structures using a processor.

15. A program for presenting diagnostic examples of a structure using a database that stores information about the structure, including at least one of photographed images of the structure and damage information about the structure, in association with diagnostic results for damage to the structure at two or more points in time, comprising: Acquire information about the target structure, which is the target of diagnosis, including at least one of a photographed image and damage information of the target structure; extracting damage similar to the damage of the target structure based on information about the target structure and information about the structure stored in the database; extracting, from the database as a specific diagnosis case, a diagnosis result of the structure having the similar damage, the diagnosis result of the structure having the similar damage and the diagnosis result at two or more points in time that are different from each other and stored in the database; outputting information related to the specific diagnostic case to a display; This is a structural diagnostic case presentation program that uses a computer to achieve this.

Images