Information processing device, information processing method, and program

Abstract

To record information for evaluating a degree of damage to a structure in a more appropriate manner.SOLUTION: An aggregation processing unit 113 aggregates damage level information 407 of a section of a structure 401 corresponding to a partial area 405 associated for each of partial areas 405 subdivided from an inspection image 201 according to an imaging result of the structure 401, for each partial area 409 larger than the partial area 405, the damage level information 407 corresponding to each of the partial areas 405 included in the partial area 409, as damage level information 601, based on at least one of density and continuity in the partial area 409. A storage unit 114 records the damage level information 601 corresponding to the partial area 409, and the damage level information 407 corresponding to each of the partial areas 405 included in the partial area 409, in association with each other.SELECTED DRAWING: Figure 5C

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] The damage level of a structure is evaluated, for example, by taking into account the scale of the damage itself that is the subject of the damage level evaluation, redundancy according to the allowable damage for each part of the structure, and the progression of the damage due to aging. Such damage level evaluation results can be used, for example, to determine the soundness of the structure and to develop a repair plan for the damage. For example, Patent Document 1 discloses an example of a technique for determining the soundness of a structure. Also, Patent Document 2 discloses an example of a technique for developing a repair plan for damage to a structure. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6454793 [Patent Document 2] Patent No. 6472894 Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, as multiple damages that have occurred in a structure progress, the multiple damages may come into contact with each other and become larger. In such cases, even if the individual damages that are independent of each other are not considered to affect the soundness of the structure in determining its soundness, it is possible that the multiple damages may come into contact with each other in the future to become larger damage and affect the soundness of the structure.

[0005] In view of the above problems, an object of the present invention is to make it possible to record information for evaluating the degree of damage to a structure in a more suitable manner. [Means for solving the problem]

[0006] The information processing device of the present invention is characterized in that it comprises: an aggregation means for aggregating, for each second partial region larger than the first partial region, first information regarding the degree of damage of a part of the structure corresponding to the first partial region associated with the first partial region, the first information corresponding to each of a plurality of first partial regions included in the second partial region as second information based on at least one of density and continuity in the second partial region; and a recording means for recording, in association with each other, the second information corresponding to the second partial region and the first information corresponding to each of the plurality of first partial regions included in the second partial region. Effect of the Invention

[0007] According to the present invention, it is possible to record information for evaluating the degree of damage to a structure in a more suitable manner. [Brief description of the drawings]

[0008] [Figure 1A] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device. [Figure 1B] FIG. 2 is a functional block diagram showing an example of a functional configuration of an information processing device. [Diagram 2] FIG. 11 is a diagram for explaining an example of damage level information. [Figure 3A] FIG. 11 is a diagram for explaining an example of damage level information. [Figure 3B] FIG. 11 is a diagram for explaining an example of damage level information. [Figure 4] FIG. 11 is a diagram showing an example of a presentation mode of damage level information. [Figure 5A] FIG. 13 is a diagram for explaining a method of aggregating damage level information. [Figure 5B] FIG. 13 is a diagram illustrating an example of a table related to control of an operation pattern of the aggregation process. [Figure 5C]FIG. 13 is a diagram showing an example of a correspondence relationship before and after application of an aggregation process. [Figure 5D] FIG. 13 is a diagram showing an example of a damage level table. [Figure 6A] FIG. 11 is a diagram showing an example of a result of aggregating processing of damage level information. [Figure 6B] FIG. 11 is a diagram showing an example of a result of aggregating processing of damage level information. [Figure 7A] 11 is a flowchart showing an example of processing by an information processing device. [Figure 7B] 11 is a flowchart showing an example of processing by an information processing device. [Figure 8A] FIG. 11 is a diagram showing an example of a presentation mode of damage level information. [Figure 8B] FIG. 11 is a diagram showing an example of a presentation mode of damage level information. [Figure 9] 13 is a diagram showing an example of a UI for presenting damage level information. FIG. [Figure 10A] 10 is a flowchart showing another example of the process of the information processing device. [Figure 10B] 10 is a flowchart showing another example of the process of the information processing device. [Figure 11] FIG. 13 is a diagram showing an example of a display screen relating to presentation of damage level information. [Figure 12A] 10 is a flowchart showing another example of the process of the information processing device. [Figure 12B] 10 is a flowchart showing another example of the process of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.

[0010] <Hardware configuration> With reference to FIG. 1A, an example of a hardware configuration of an information processing device according to an embodiment of the present disclosure will be described. The information processing device 100 according to this embodiment includes a central processing unit (CPU) 101, a random access memory (RAM) 103, and a read only memory (ROM) 102. The information processing device 100 also includes an auxiliary storage device 104 and a network I / F 107. The information processing device 100 may also include at least one of an input device 105 and an output device 106. The CPU 101, the RAM 102, the ROM 103, the auxiliary storage device 104, the input device 105, the output device 106, and the network I / F 107 are connected to each other via a bus 108.

[0011] The CPU 101 is a central processing unit that controls various operations of the information processing device 100. For example, the CPU 101 may control the operation of the information processing device 100 as a whole. The RAM 102 is a main storage memory for the CPU 101, and is used as a work area or a temporary storage area for developing various programs. The ROM 103 stores a program (eg, BIOS) for the CPU 101 to control the operation of the information processing device 100.

[0012] The auxiliary storage device 104 stores various data and programs such as an OS (Operating System) which is basic software, various applications, etc. The auxiliary storage device 104 can be realized by, for example, a non-volatile memory such as a HDD (Hard Disk Drive) or a SDD (Solid State Drive).

[0013] The network I / F 107 is an interface that is connected to a predetermined network (for example, a LAN or the Internet) and is used to communicate with external devices via the network.

[0014] The input device 105 is a device for receiving instructions from a user, and may be realized by, for example, an operation device such as a pointing device such as a mouse, a keyboard, or a touch panel. The output device 106 is a device for presenting various information to a user. The output device 106 can be realized by a display device such as a display that presents information to a user by displaying various display information, screens, etc.

[0015] The above-mentioned configuration is merely an example and does not necessarily limit the hardware configuration of the information processing device 100. As a specific example, some of the components of the information processing device 100 described above (for example, at least one of the input device 105 and the output device 106) may be externally attached to the outside of the information processing device 100. In addition, the functional configuration shown in FIG. 1B and the processes shown in FIGS. 7A, 7B, 10A, 10B, 12A, and 12B are realized by CPU 101 expanding a program stored in ROM 103 or auxiliary storage device 104 into RAM 102 and executing it.

[0016] <Functional configuration> An example of a functional configuration of an information processing device according to an embodiment of the present disclosure will be described with reference to Fig. 1B. The information processing device 100 according to the present embodiment includes a damage level determination unit 111, a correction processing unit 112, an aggregation processing unit 113, a storage unit 114, and a display control unit 115.

[0017] The damage level determination unit 111 performs image analysis on a captured image of a structure to be inspected (hereinafter also referred to as an "inspection image"), and determines the degree of damage (hereinafter also referred to as a "damage level") in each part of the structure based on the result of the image analysis. As a specific example, the damage level determination unit 111 may divide the inspection image into a plurality of partial regions, perform image analysis for each divided partial region, detect damage in the part of the structure corresponding to the partial region, and determine the damage level in the part based on the detection result. The damage level determination unit 111 may also determine the damage level in each part of the target structure based on inspection images at a plurality of time points including past time points. In this manner, the damage level determination unit 111 associates information (hereinafter also referred to as "damage level information") according to the determination result of the damage level of the part corresponding to the partial region with each partial region divided from the inspection image. The damage level determination unit 111 may hold the damage level information corresponding to each partial region divided from the inspection image by storing it in a predetermined storage area.

[0018] The correction processing unit 112 acquires information on redundancy according to the damage that can be tolerated for each part from the structural information when the target structure was designed. The correction processing unit 112 also acquires information on the progression of the damage based on a comparison of aging changes for each damage occurring in the target structure. Then, the correction processing unit 112 performs a correction process on the damage level information according to the damage level determination result by the damage level determination unit 111 based on the acquired information on redundancy and progression.

[0019] The aggregation processing unit 113 aggregates the damage level information associated with each of the multiple partial regions divided from the inspection image as damage level information for a new partial region that is larger than the multiple partial regions and that includes the multiple partial regions. At this time, the aggregation processing unit 113 may determine a range (a range of a new partial area including a plurality of partial areas) for aggregating the damage level information for each partial area divided from the inspection image based on desired conditions related to aggregation of damage level information (hereinafter also referred to as "aggregation processing conditions"). Information related to the aggregation processing conditions may be stored in a predetermined storage area (for example, the storage unit 114 described later). In addition, when aggregating damage level information associated with each of multiple partial areas divided from the inspection image, the aggregation processing unit 113 may take into account the density of damage in each partial area and the continuity of damage in each partial area when determining the damage level corresponding to the new partial area. Each of the multiple partial regions divided from the inspection image corresponds to an example of a "first partial region", and the damage level information corresponding to the first partial region corresponds to an example of the "first information". Moreover, the new region that includes the multiple first partial regions and is larger than the first partial region corresponds to an example of a "second partial region", and the damage level information corresponding to the second partial region corresponds to an example of the "second information".

[0020] The aggregation processing unit 113 associates the damage level information for each partial area (first partial area) divided from the inspection image with the aggregated damage level information corresponding to a new area (second partial area) including a plurality of the partial areas, and stores the associated damage level information as aggregated damage level information in the storage unit 114. At this time, the aggregation processing unit 113 may record the damage level information for each partial area divided from the inspection image and the aggregated damage level information corresponding to the new area including a plurality of the partial areas by assigning them to different hierarchical levels.

[0021] The processing related to the detection of the damage level by the damage level determination unit 111, the correction processing of the damage level detection results by the correction processing unit 112, and the processing related to the aggregation of damage level information by the aggregation processing unit 113 will be described in detail later.

[0022] The storage unit 114 is a schematic representation of a storage area that stores various types of information and thereby holds the information. For example, the storage unit 114 may store aggregated damage level information output from the aggregation processing unit 113 and thereby hold the aggregated damage level information. Furthermore, the storage unit 114 may store other information or data in addition to the aggregated damage level information. As a specific example, the storage unit 114 may store information related to the aggregation processing conditions described above and structure information described below.

[0023] The display control unit 115 displays desired information on a predetermined output unit (for example, a display, etc.) to present the information to the user. For example, the display control unit 115 may display damage level information of a target structure on a predetermined output unit based on aggregated damage level information stored in the storage unit 114, thereby presenting the damage level information to the user. At this time, the display control unit 115 may control the display mode of the damage level information upon receiving a designation of a condition related to the display of the damage level information. The display control unit 115 may also display information on the target structure (hereinafter also referred to as "structure information") on a predetermined output unit in association with the damage level information. The structure information may be stored in a predetermined storage area such as the storage unit 114. An example of a display mode of the damage level information based on the control of the display control unit 115 will be described in detail later with reference to FIG. 2, FIG. 3A, and FIG. 3B.

[0024] <Damage information> An example of the damage level information according to the present embodiment will be described with reference to Figs. 2, 3A, and 3B, focusing in particular on a method for generating the damage level information.

[0025] First, Fig. 2 will be described. Fig. 2(a) shows an example of an inspection image 201 corresponding to the imaging result of a target structure. The grid lines labeled 202 typically show boundaries dividing the inspection image 201 into a plurality of partial regions. Also, 203 to 206 typically show examples of various types of damage that have occurred in the target structure, which have been captured as a subject in the inspection image 201.

[0026] FIG. 2(b) shows an example of a conceptual diagram in which information is superimposed on the inspection image 201 shown in FIG. 2(a) and numerically represents the damage level determination result for the part of the structure corresponding to each partial region divided by the boundary 202. The numerical values ​​1 to 3 superimposed on each partial region are information indicating the level of damage level of the part of the structure corresponding to the partial region, and the higher the numerical value, the higher the damage level. In addition, the damage level of the part of the structure corresponding to each partial region may be determined based on the degree of the detected damage (e.g., the number, length, size, thickness, intersection state, etc. of the damage) after detecting the damage present in the partial region. Note that the process related to the damage level determination can be performed using existing techniques such as a trained model constructed based on machine learning and image analysis, and therefore a detailed description will be omitted.

[0027] Fig. 2(c) shows an example of a conceptual diagram in which information expressing the degree of progression of each damage (in other words, the degree of growth of the damage) in alphabetic form is superimposed on the inspection image 201 on which the information showing the damage degree shown in Fig. 2(b) is superimposed. For example, in the example shown in Fig. 2(c), the degree of progression of the damage for each partial region is shown as subscripts a to c to the numerical value showing the damage degree. Of the alphabetic subscripts showing the degree of progression of the damage, a indicates the state in which the damage is most progressive, followed in order by b, c.

[0028] The degree of progression of each damage may be determined, for example, by comparing the inspection image 201 corresponding to the imaging result of the target structure with an inspection image corresponding to the imaging result of the target structure acquired in the past. As a specific example, the progression of the damage may be determined by comparing data on the length, thickness, etc. of each detected damage between the inspection images to be compared. Note that the detected damage is, for example, polyline data information having thickness information, so that the positions and number of segments of the polyline data do not necessarily match when comparing the target images. Therefore, for example, the center of gravity position, etc. of each polyline data may be calculated, and the damage may be associated between the images based on the center of gravity position, etc., to compare information on the length, thickness, etc. of the polyline data.

[0029] For example, as shown in FIG. 2(b), the damage level of the damage 204 is determined to be "2" based on the length and thickness of the damage. On the other hand, the progression of the damage 204 is determined to be greater in the width of the damage based on a result of a chronological comparison between the inspection image 201 and an inspection image previously acquired by capturing an image of the same part of the target structure. Therefore, the progression of the damage 204 is determined to be "a", and "2a" is set as the damage level information 208 in FIG. 2(c). Similarly, "1c" and "3a" are set as the damage level information 207 and 209 for the damages 203 and 205. Furthermore, since no progression was observed for the damage 206, "1" indicating the damage level is set as the damage level information 210, and no information indicating progression is set.

[0030] Next, FIG. 3A will be described. FIG. 3A(a) shows an example of a map of redundancy in a range of a target structure captured as an inspection image 201. Redundancy is an index indicating characteristics related to allowable damage in a portion of a structure, and the degree of damage is evaluated higher as the damage occurs in an area with low redundancy. Information regarding redundancy can be obtained, for example, from structural information at the time of designing the structure (for example, information regarding the material and characteristics of each portion of the structure). In FIG. 3A(a), R1 to R4 are set as information indicating redundancy for each partial region. This information indicating redundancy indicates a state in which R1 is the least redundant, followed by R2, R3, and R4, in that order.

[0031] 3A(b) shows an example of a correction table 305 showing correction values ​​based on redundancy and progression to be added to the damage degree determination result based on the inspection image. Set values ​​306 to 309 indicate redundancy values. Set values ​​310 to 312 indicate damage progression values. Set value 313 is a value that means there is no damage progression.

[0032] Moreover, each of the correction values ​​314 to 316 indicates an example of a correction value that is added according to redundancy and progression. As a specific example, the correction value 314 is a correction value that is added to the determination result of the damage degree when the redundancy is "R1" indicated as the set value 306 and the progression is "a" indicated as the set value 310, and "+2" is set as the correction value. Similarly, the correction value 315 is a correction value that is added to the determination result of the damage degree when the redundancy is "R3" indicated as the set value 308 and the progression is "a" indicated as the set value 310, and "+1" is set as the correction value. Moreover, the correction value 316 is a correction value that is added to the determination result of the damage degree when the redundancy is "R4" indicated as the set value 309 and the progression is "b" indicated as the set value 311, and "0" is set as the correction value.

[0033] Next, Fig. 3B will be described. Fig. 3B(c) is a conceptual diagram showing an example of the result of applying correction based on the redundancy map shown in Fig. 3A(a) and the correction table shown in Fig. 3A(b) to the damage degree information in which the progression of damage shown in Fig. 2(c) is added. In the example shown in Fig. 3B(c), the numerical value presented for each partial region indicates the level of damage degree, and the circle surrounding the numerical value indicates that the damage in the target partial region is progressive.

[0034] Fig. 3B(d) shows an example of a case where the image of the damage is excluded from the conceptual diagram shown in Fig. 3B(c) and the damage level information is mainly presented. That is, in the example shown in Fig. 3B(d), the result of applying correction to the damage level information shown in Fig. 2(c) based on the correction table shown in Fig. 3A(b) is presented as information indicating the damage level.

[0035] It is also possible to judge the soundness of the target structure based on the damage degree information for each partial region shown in FIG. 3B(d). As a specific example, when the damage degree for each partial region exceeds a threshold, it is also possible to judge that some effect on the soundness may become apparent for the part of the structure corresponding to the partial region, or for the entire structure. On the other hand, with such a method, it may be difficult to judge that some effect on the soundness may become apparent, for example, when the damage degree for each partial region is less than the threshold but there are multiple partial regions with damage degrees less than the threshold in a closer range. In addition, in a situation where a large amount of damage degree information that has little effect on the soundness judgment is presented, for example, it may be assumed that it takes time to check each piece of damage degree information, and as a result, the work related to the soundness judgment becomes more complicated.

[0036] The above-mentioned method of determining the damage level information for each partial region is merely an example, and the size and granularity of the damage level, redundancy, and progression, and the method of correction based on the redundancy and progression for the damage level determined from the image are not limited to the above-mentioned example. Therefore, in this embodiment, the following explanation will be given on the premise that there is information on redundancy and information on the level of damage level considering the presence or absence of progression, as shown as a conceptual diagram in Figure 3B(d), for each partial region in the inspection image according to the imaging result of the structure.

[0037] Here, a specific example of a presentation mode of damage level information will be described with reference to Fig. 4. In the example shown in Fig. 4, damage level information according to the damage level determination result for each partial region is presented for a part 402 of a pier of a bridge structure 401. Area 403 indicates an area corresponding to part 402 of a pier of bridge structure 401. Partial area 405 indicates a partial area that is the subject of damage level judgment based on an inspection image in accordance with the imaging results of part 402. Boundary 404 indicates a boundary that divides area 403 into multiple partial areas 405. Boundary 406 indicates the boundary on the redundancy map of bridge structure 401. In the example shown in FIG. 4, the area above boundary 406 corresponds to the area where "R1" and "R2" areas with lower redundancy are combined, and the area below boundary 406 corresponds to the area where "R3" and "R4" areas with higher redundancy are combined. For the sake of simplicity, the following description will be given assuming that either of two patterns, "low area" or "high area", is applied to redundancy. Similarly, for progression, either of two patterns, depending on whether or not there is progression, is applied, which is indicated by whether or not a circle is combined with a numerical value indicating the level of damage. As a specific example, the damage level information 407 indicates that the damage level determination result is "2", indicating that the damage is not progressing. As another example, the damage level information 408 indicates that the damage level determination result is "1", indicating that the damage is progressing. Further, partial region 409 is a schematic representation of a region that aggregates a plurality of partial regions 405. For example, in the example shown in Fig. 4, partial region 409 corresponds to a region surrounded by a thin solid line, and is a schematic representation of a region that aggregates nine (3 x 3) partial regions 405. In this case, partial region 405 corresponds to an example of a "first partial region" divided from an inspection image (captured image of a target structure), and partial region 409 corresponds to an example of a "second partial region" that is larger than the first partial region.

[0038] Before the partial areas (partial area 405) divided from the inspection image are aggregated, information including the progressive degree of damage and redundancy map boundaries, as exemplified by area 403, may be presented for a series of parts of structural part 401 including part 402. In addition, in the example shown in Fig. 4, partial regions 405 in which no damage was detected are excluded from the presentation of damage level information. That is, in the example shown in Fig. 4, partial regions 405 in which no damage level information is presented indicate regions in which no damage was detected or regions in which no target structure exists.

[0039] <Aggregation processing> The damage level information aggregation process will be outlined below with reference to FIGS. 5A to 5D, 6A, and 6B. First, FIG. 5A will be described. FIG. 5A is a diagram for explaining an outline of a method for aggregating damage level information. In the example shown in FIG. 5A, aggregation processing is applied to nine (3×3) partial regions 405 divided by a boundary line 404. As a result, a partial region 501 in which the nine (3×3) partial regions 405 are aggregated and new damage level information 504 indicating the damage level corresponding to the partial region 501 are shown. In the following description, similar to the example shown in FIG. 4, the partial region in which damage level information is presented is considered to be a partial region in which damage has been detected, and various processes can be executed based on the number of partial regions in which the damage has been detected and the continuity of the arrangement.

[0040] Next, Fig. 5B will be described. Fig. 5B is a diagram showing an example of a control table 505 related to control of the operation pattern of the aggregation process. In the control table 505, the pattern of the aggregation process is managed according to a combination of the characteristics of redundancy and damage progression in the partial area to be aggregated and the density and continuity of damage present in the partial area. Specifically, the density and continuity of damage are determined based on the number and order of partial areas in which damage level information is presented in the partial area to be aggregated. Moreover, the conditions 506 and 507 relating to redundancy are determined according to, for example, whether or not a partial area with low redundancy is included in the partial areas to be aggregated. In addition, the conditions 508 and 509 relating to the progression of damage are distinguished according to, for example, whether or not progressive damage exists in the partial area that is the subject of the aggregation process (whether or not a circled number indicating the level of damage exists). In addition, the conditions 510 and 511 relating to the density and continuity of damage are determined according to, for example, whether the damage in the partial area to be aggregated is dense (e.g., whether there are five or more damages) or whether there is continuity (e.g., whether there are three or more adjacent damages).

[0041] Moreover, correction values ​​512, 513, and 514 show examples of increase / decrease values ​​applied to the level of damage of the target partial region in each combination of conditions. Also, the increase / decrease value applied to the level of damage of the target partial region may be controlled according to the level of damage of the target partial region. For example, correction values ​​515 and 516 show examples of increase / decrease values ​​applied when the level of damage of the target partial region is "3 or more" and when it is "less than 3" in each combination of conditions, respectively.

[0042] Next, FIG. 5C will be described. FIG. 5C is a diagram showing an example of the correspondence relationship of partial regions in which damage level information is set before and after the application of the aggregation process. In FIG. 5C, the region 521 corresponds to an example of a state before the aggregation process of the damage level information is applied, and is divided into 6×6 partial regions, and the damage level is determined for each of the partial regions. On the other hand, the region 522 corresponds to an example of a state after the aggregation process of the damage level information is applied, and the damage level determination results for each of the partial regions in which the region 521 is divided into 6×6 are aggregated in a partial region in which the range corresponding to the region 521 is divided into 2×2. In addition, each of the dashed borders 523 and 524 is a schematic representation of a border indicating a border between regions with different redundancy. In the example shown in FIG. 5C, the upper and left sides of the border 523 in the region 521 indicate a region with low redundancy. Similarly, the upper and left sides of the border 524 in the region 522 indicate a region with low redundancy. In addition, the numbers shown outside the frames of each of areas 521 and 522 (i.e., on the upper and left sides) are numbers assigned as position indexes when referring to damage level information according to the damage level judgment results in each partial area.

[0043] Next, a description will be given of Fig. 5D. Fig. 5D shows an example of a management table (hereinafter also referred to as a "damage level table") in which damage level information corresponding to each of the areas 521 and 522 shown in Fig. 5C is stored.

[0044] Specifically, the damage level table 525 corresponds to the area 521 , and the damage level table 533 corresponds to the area 522 . Damage level information 527 and 535 correspond to damage level information according to the damage level determination results for each partial area of ​​areas 521 and 522. As with the example described with reference to Fig. 4, damage level information 527 and 535 indicates the level of damage by a numerical value, and if the level is progressive, the numerical value is circled. Redundancy 529 and 537 indicate the redundancy of each partial area of ​​the areas 521 and 522, respectively, with "L" being assigned as the setting value to partial areas with "low" redundancy.

[0045] The indexes 526 and 534 are indexes for referencing damage level information 527 and 535 stored in the damage level tables 525 and 533, respectively, and are associated with each partial area of ​​the areas 521 and 522. In the example shown in Fig. 5D, the indexes 526 and 534 each consist of three numbers, the first number indicating the presence or absence of aggregation processing, and the latter two numbers indicating the vertical and horizontal numbers of the position index described with reference to Fig. 5C. For example, "0-1-1", which is the setting value 528 of index 526, indicates that the information is about the damage level corresponding to a partial area having a vertical index number of "1" and a horizontal index number of "1" in area 521 before the aggregation process is performed. Also, "1-1-1", which is the setting value 536 of index 534, indicates that the information is about the damage level corresponding to a partial area having a vertical index number of "1" and a horizontal index number of "1" in area 522 after the aggregation process is performed.

[0046] The pattern information 538 indicates the size of the partial area after the aggregation process, which is indicated by a pattern using the partial area before the aggregation process as a unit of size. The partial area before the aggregation process and the partial area after the aggregation process are associated with each other based on the index 526, the index 534, and the pattern information 538. For example, for a partial region after the aggregation process in which the setting value of index 534 is "1-1-1", the setting value of pattern information 538 is "3×3". Therefore, the partial region after the aggregation process is associated with nine partial regions before the aggregation process in which the setting values ​​of index 526 are "0-1-1" to "0-1-3", "0-2-1" to "0-2-3", and "0-3-1" to "0-3-3". That is, when setting the value of damage level information 535 for a partial region in which the setting value of index 534 is "1-1-1", the values ​​of damage level information 527 for partial regions corresponding to the range indicated by 530 to 532 are referenced. As a result, even if the number of partial areas aggregated at the end of a structure, for example, is different from that at other parts, it is possible to obtain damage level information for the partial areas aggregated based on index 534 by counting the partial areas based on pattern information 538.

[0047] For example, Fig. 6A shows an example of the result of aggregation processing performed on damage level information (i.e., damage level information of area 403) that takes into account redundancy and progression of the damage level determination results based on the inspection image, for part 402 of structure 401 shown in Fig. 4. For example, damage level information 601 shows an example of damage level information after aggregation processing. Also, partial area 602 shows an example of a partial area that has been excluded from the presentation of damage level information as a result of aggregation processing. Details of damage level information 601 and partial area 602 will be described separately below.

[0048] Moreover, Fig. 6B shows an example of a display mode of the damage level information for presenting the result of the aggregation process performed on the damage level information to the user. In the example shown in Fig. 6B, each partial area after the aggregation process is color-coded according to the level of the damage level so as to be identifiable. More specifically, in the example shown in Fig. 6B, the partial area having a higher level of the damage level is controlled to be colored darker.

[0049] <Processing> An example of processing by the information processing device according to this embodiment will be described with reference to FIGS. 7A and 7B. First, Fig. 7A will be described. Fig. 7A is a flowchart showing an example of a process relating to display of damage level information according to a damage level determination result for each part of a target structure based on an inspection image.

[0050] In S701, the information processing device 100 acquires an inspection image according to the imaging result of the target structure, and acquires information according to the damage detection result for each part of the structure based on the inspection image. An example of the inspection image is the inspection image 201 described with reference to FIG. 2(a). In S702, the information processing device 100 performs an aging comparison for each damage detected based on the inspection image in S701, thereby acquiring information regarding the progression of the damage. In S703, the information processing device 100 acquires information on redundancy of each part of a target structure based on structure information (for example, design drawings, etc.) at the time of designing the structure.

[0051] In S704, the information processing device 100 determines the damage level of a part of the target structure corresponding to each partial region previously divided from the inspection image, based on the amount of damage present in the part and the state of the damage. For example, FIG. 2(b) shows an example of damage level information according to the determination result of the damage level of a part corresponding to each partial region divided from the inspection image. As described above, a learned model constructed based on machine learning and various technologies based on image analysis and the like have been put to practical use for the process related to the determination of the damage level of a part corresponding to each partial region divided from the inspection image, so a detailed description will be omitted.

[0052] In S705, the information processing device 100 applies a correction process to the damage degree determination result in S704 based on the information on the progression and redundancy acquired in S702 and S703. For example, FIG. 3A(b) shows an example of a correction table related to the correction process based on the progression and redundancy. Also, FIG. 3B(c) and (d) show an example of damage degree information according to the application result of the correction process based on the progression and redundancy. Also, based on the execution result of the process of S705, a damage degree table in which damage degree information before the application of the aggregation process is stored, as exemplified as the damage degree table 525 in FIG. 5D, is created. In the following description, in order to make the characteristics of the information processing device 100 according to this embodiment easier to understand, it is assumed that the damage degree table 525 shown in FIG. 5D is created as a damage degree table in which damage degree information before the application of the aggregation process is stored.

[0053] In S706, the information processing device 100 executes processing related to displaying a drawing of the target structure, which serves as a reference position for presenting damage level information for each part of the target structure. The drawing is presented to the user by being displayed on a predetermined output destination such as the output device 106.

[0054] In S707, the information processing device 100 determines whether or not to perform an aggregated display (that is, whether or not to aggregate the damage level information and then display the aggregated damage level information). If the information processing device 100 determines in S707 that the aggregated display is not to be performed, the process proceeds to S708. In S708, the information processing device 100 superimposes and displays the damage level information to which the correction process was applied in S705 for each partial area in which the damage level was determined on the drawing of the structure displayed on the specified output destination in S706.

[0055] On the other hand, if the information processing device 100 determines in S707 that an aggregated display is to be performed, the process proceeds to S710. In S710, the information processing device 100 executes a process related to the aggregation of damage level information. The process of S710 will be described in detail later with reference to FIG. 7B. Based on the execution result of the process of S710, a damage level table is created in which the damage level information after the aggregation process is applied is stored, as exemplified as the damage level table 533 in FIG. 5D. In the following description, in order to more clearly explain the characteristics of the information processing device 100 according to this embodiment, it is assumed that the damage level table 533 shown in FIG. 5D is created as the damage level table in which the damage level information after the aggregation process is applied is stored. In S711, the information processing device 100 superimposes and displays the damage level information after the aggregation process is applied in S710 for each partial region for which the damage level has been determined on the drawing of the structure displayed on the predetermined output destination in S706. In this case, for example, information such as the damage level taking into account the progression of damage and the boundary line of redundancy for each part of the structure, as described with reference to Figs. 6A and 6B, may be displayed.

[0056] In S709, the information processing device 100 determines whether or not to end the process related to the display of the damage level information. For example, the information processing device 100 may determine whether or not to end the process related to the display of the damage level information in response to an instruction from a user. As another example, the information processing device 100 may determine whether or not to end the process related to the display of the damage level information in response to whether or not a predetermined trigger is received. In this way, the information processing device 100 may determine whether or not to end the process related to the display of the damage level information in response to whether or not a predetermined condition is satisfied. The information processing device 100 continues displaying the damage level information on a predetermined output destination (displaying the damage level information based on the processing of S708 or S711) unless it has determined in S709 that the processing related to the display of the damage level information is to be ended. Then, when it is determined in S709 that the process relating to the display of the damage level information is to be ended, the information processing device 100 ends the display of the damage level information to a predetermined output destination, and then ends the series of processes shown in FIG. 7A.

[0057] Next, an example of the process relating to the aggregation of damage level information shown as S710 in FIG. 7A will be described in detail with reference to FIG. 7B.

[0058] In S721, the information processing device 100 creates an empty damage level table 533 in which damage level information after the aggregation process is applied is stored. Then, the information processing device 100 sets values ​​for the INDEX 534 and the pattern information 538 in the damage level table 533 according to the range to which the aggregation process is applied. In S722, the information processing device 100 acquires information on the redundancy of each part of the structure for each partial area divided from the inspection image from the damage level table 525 in which the damage level information before the aggregation process is applied is stored. Note that the information on the redundancy of each part of the structure is acquired based on the redundancy map exemplified in FIG. 3A(a), for example.

[0059] Next, based on the setting value of INDEX 534, the information processing device 100 extracts information (e.g., damage level information) regarding each partial area before aggregation contained in the partial area to be aggregated, and executes the processes of S723 to S728 based on the information.

[0060] The aggregation process executed from S724 to S727 will now be described with a specific example. For example, in region 403 in Fig. 4, each of the 3x3 regions in which partial regions 405 are gathered is treated as a region to be aggregated (i.e., a new partial region after aggregation), and the processes from S724 to S727 are executed for each region to be aggregated.

[0061] Specifically, in S724, the information processing device 100 acquires the maximum level of damage degree from among the damage degrees corresponding to each of the series of partial areas 405 included in the area to be subjected to the aggregation process. In S725, the information processing device 100 acquires information regarding the presence or absence of a progressive damage degree based on the damage degree information corresponding to each of the series of partial regions 405 included in the region that is the target of the aggregation process. In the processes of S724 and S725, information regarding the damage and the presence or absence of progression set for the corresponding partial region in the damage level table 525 is referenced based on the setting value of INDEX 534 in the damage level table 533 generated in S721.

[0062] 4, the maximum level of damage in partial region 409 is "5", and the corresponding damage level information is circled to indicate that the damage level is progressive. Therefore, from damage level table 525, the value of the damage level, "5", is obtained as information on the damage level corresponding to partial region 409, and information indicating that the damage is progressive is obtained as information on the presence or absence of progressive damage. In partial region 409, the damage level information with the highest level of damage also indicates progression, and the damage level information and the information on the presence or absence of damage progression are obtained from the same damage level information. On the other hand, the damage level information and the information on the presence or absence of damage progression may each be obtained from different damage level information.

[0063] In S726, the information processing device 100 acquires information regarding the number of partial areas (partial areas before aggregation) for which damage level information is set within the area to be aggregated (new partial area after aggregation), and information regarding the continuity of the arrangement of those partial areas. 4, the number of partial regions 405 for which damage level information is set is "3", and these partial regions 405 are consecutive. Therefore, "3" is obtained as information regarding the number of partial regions 405 for which damage level information is set, and information indicating that there is continuity is obtained as information regarding the continuity of the arrangement of these partial regions 405.

[0064] Then, in S727, the information processing device 100 executes an aggregation process (that is, a process related to the aggregation of damage level information) for the information acquired in each of S724 to S726 based on the control table 505 shown in FIG. 5B.

[0065] As a specific example, in the case of partial region 409 shown in Fig. 4, the value of the damage level input to the aggregation process is "5", and since the damage also has a progressive nature, condition 508 for when damage in a region is progressive is applied as a condition related to the progressive nature of the damage. Also, since partial region 409 is included in an area with low redundancy, condition 506 for an area with low redundancy is applied as a condition related to the redundancy. In addition, when the area to be subjected to the aggregation process contains both areas with high redundancy and areas with low redundancy, for example, it is preferable to apply the aggregation process to the area to be subjected to the aggregation process as an area with low redundancy. In addition, since the partial region 409 has continuity with respect to the arrangement of the partial regions 405 in which the damage level information is set, the condition 510 in which the damage density is dense or the damage has continuity is applied as a condition related to the damage density and continuity. As a result, in the case of partial region 409, an increase or decrease value of "+1" is applied to the damage level after the aggregation process is applied, but in this embodiment, the maximum value of the damage level is set to "5". Therefore, in damage level information 601 shown in Fig. 6A, "5" is set as the value of the damage level after the aggregation process is applied. Also, in partial region 409, it is determined that there is progressive damage, so a circle is placed around the value of the damage level as flag information indicating the progressive damage.

[0066] 4 (partial region after aggregation), the value of the damage level input to the aggregation process is "1" and does not have damage progression, so condition 509 for when damage in a region does not have progression is applied as a condition related to damage progression. Also, since partial region 410 is included in a region with high redundancy, condition 507 for a region with high redundancy is applied as a condition related to redundancy. In addition, partial region 410 has one partial region 405 with damage level information set and the damage density is "sparse", so condition 511 for when the damage density is sparse or there is single damage is applied as a condition related to the damage density and continuity. As a result, in the case of partial region 410, an increment / decrement value of "-1" is applied to the damage level after the aggregation process is applied, and the damage level after the increment / decrement value is applied becomes "0." As a result, partial region 410 is treated as an area for which no damage level information is set, like partial region 602 shown in FIG. 6.

[0067] In addition, when the increase / decrease value applied based on the control table 505 shown in FIG. 5B becomes “±0”, the damage level value (the level value at which the damage level is at its maximum) input to the aggregation process and information regarding the presence or absence of progression will be inherited by the partial area after the aggregation process.

[0068] In this manner, the information processing device 100 repeatedly executes the processes of S723 to S728 for each region to be aggregated, and when the execution of the processes for the series of regions is completed, ends the series of processes shown in Fig. 7B. That is, in the case of the example shown in Fig. 4, the processes of S723 to S728 are executed for each application unit of the aggregation process for the partial regions 405 for which damage level information is set, among the series of partial regions 405 included in the region 403, and the processing result shown in Fig. 6A is obtained.

[0069] As described above, in the information processing device 100 according to the present embodiment, when the damage level of a structure is presented to the user, the damage level information determined at a finer granularity based on the inspection image is aggregated, so that the damage level information is presented to the user at a coarser granularity. By applying such control, it becomes possible to allow the user to visually recognize the area to be noted in a more suitable manner. Therefore, for example, when a user investigates the soundness of a structure based on the damage level information, it becomes possible to draw the user's attention to the damage level, including the potential damage level, which is important in the investigation of the soundness. In addition, since it is possible to suppress the presentation of information to the user about the damage level with a lower priority in the investigation of the soundness of the structure, it is expected to have the effect of guiding the user to pay attention to the damage level with a higher priority.

[0070] In this embodiment, the application unit of the aggregation process is a 3×3 area, but the application unit of the aggregation process is not necessarily limited to this. As a specific example, the application unit of the aggregation process may be an area larger or smaller than the 3×3 area.

[0071] In the present embodiment, as illustrated in FIG. 6A, an example of the case where the damage level is expressed by a numerical value has been described, but the presenting of the damage level is not necessarily limited to this embodiment. As a specific example, as illustrated in FIG. 6B, in addition to the display by a numerical value, the damage level may be displayed by the color (background color) of the area where the damage level information is displayed. By applying such control, the user can intuitively judge the damage level by the color of the area where the numerical value is displayed, without focusing on the numerical value indicating the damage level, and it is also possible to expect an effect of further improving the visibility of the damage level. In addition, by applying a color according to the damage level to the area after the aggregation process is applied, it is possible to intuitively recognize that the presented damage level information is the damage level information after the aggregation process is applied. Of course, in the process of S708, when the damage level information is presented, the color (background color) of the partial area where the damage level information is presented may be controlled.

[0072] The manner in which the damage progression is indicated is not necessarily limited to the method of encircling the numerical value indicating the level of the damage. As a specific example, the damage progression may be indicated by indicating the numerical value indicating the level of the damage in bold or italics. As another example, the damage progression may be indicated by adding a subscript of a different character type to the numerical value indicating the level of the damage.

[0073] In addition, in the present embodiment, an example of a case where a damage degree is determined for each part of a structure corresponding to a partial area divided from an inspection image of the target structure has been described, but the method of determining the damage degree is not necessarily limited to this. As a specific example, damage occurring in the structure may be detected individually, and a damage degree may be determined for each detected damage. Even in such a case, by setting a partial area wider than the partial areas corresponding to each individual damage as the area to which the aggregation process is applied, it becomes possible to apply the aggregation process in the same manner as in the above-mentioned embodiment.

[0074] In addition, the conditions for applying the aggregation process are not necessarily limited to the example shown as control table 505 in Fig. 5B. As a specific example, the conditions for the progression of damage, the redundancy of each part of the structure, and the density and continuity of damage may be divided into more detailed conditions. Furthermore, the threshold applied to the determination of each condition is not limited to one threshold, and multiple thresholds may be applied.

[0075] <Modification> Below, a modification of the information processing device 100 according to this embodiment will be described.

[0076] (Variation 1) First, an information processing device 100 according to Modification 1 will be described with reference to Fig. 8A, Fig. 8B, Fig. 9, Fig. 10A, and Fig. 10B. In the above-described embodiment, an example of a case where damage level information for each partial region divided from an inspection image and damage level information after aggregation processing are selectively switched and presented is described. In this modification, an example of a mechanism that makes it possible to present damage level information by gradually switching the application range of the aggregation processing by gradually applying the aggregation processing of the damage level information is described.

[0077] Fig. 8A(a) shows an example of a presentation mode of damage level information for each part of the structure 401, which corresponds to the state after the aggregation process of the damage level information has been performed in the above-mentioned embodiment. In contrast to this, Fig. 8A(b) shows an example of a presentation mode of damage level information when another aggregation process is applied from the state shown in Fig. 8A(a). A partial area 803 surrounded by a thick frame corresponds to an area to which further aggregation process is applied (in other words, an application unit of further aggregation process). Moreover, damage level information 804 corresponds to damage level information according to the application result of the aggregation process targeted at the partial area 803. Similarly, Fig. 8B(c) shows an example of the presentation mode of the damage level information when one more aggregation process is applied from the state shown in Fig. 8A(b), and Fig. 8B(d) shows an example of the presentation mode of the damage level information when one more aggregation process is applied from the state shown in Fig. 8B(c).

[0078] When further aggregation processing is performed from the state shown in FIG. 8A(b) to the state shown in FIG. 8B(c), a 3×2 pattern and a 2×2 pattern are applied instead of the 3×3 pattern that was the target of the previously executed aggregation processing. Therefore, as the operation pattern of the aggregation processing in this case, an operation pattern other than the operation pattern based on the control table 505 shown in FIG. 5B is applied. This is also the case when further aggregation processing is performed from the state shown in FIG. 8B(c) to the state shown in FIG. 8B(d).

[0079] Next, an example of a UI applied in this modification will be described with reference to Fig. 9, focusing in particular on a UI for presenting damage level information while applying an aggregation process in stages. A display screen 901 according to this modification includes a display area 902, a slider 908, and buttons 906 and 907.

[0080] The display area 902 is an area where a drawing of a structure and damage level information are displayed. The slider 908 is an interface for receiving from the user a threshold value for the level of damage level used to control the damage level information to be displayed in the display area 902 . The button 906 is an interface for receiving an instruction from the user to apply further aggregation processing of the damage level information. For example, when the button 906 is pressed, one more stage of aggregation processing of the damage level information is applied, and the result is reflected in the display area 902. The button 907 is an interface for receiving an instruction from the user to cancel the further aggregation process of the damage level information that has already been applied. For example, when the button 907 is pressed, the further aggregation process of the damage level information that has already been applied is canceled by one step, and the result is reflected in the display area 902.

[0081] The display screen 901 may also include a button 903, and buttons 904 and 905. The button 904 is an interface for receiving an instruction from the user to enlarge the display area 902 of the drawing of the structure and the damage level information to be displayed in the display area 902. The button 905 is an interface for receiving an instruction from the user to reduce the display area 902 of the drawing of the structure and the damage level information to be displayed in the display area 902. The button 903 is an interface for receiving an instruction from the user regarding scrolling within the display area 902 of the drawing of the structure and the damage level information to be displayed in the display area 902. By using the button 903, for example, when an enlarged display is performed, it is also possible to adjust the area displayed in the display area 902 by scrolling.

[0082] The various UIs shown in FIG. 9(a) may be realized by a hardware UI such as a physical button, or may be realized by a software UI (e.g., a UI displayed on a screen) that can be operated by an operating device such as a mouse or a touch panel.

[0083] Moreover, Fig. 9(b) shows an example of the drawing and damage level information of the structure 401 displayed in the display area 902. In the example shown in Fig. 9(b), the damage level information to be displayed is limited to damage level information with a damage level of 3 or more, due to a threshold value specified for the damage level.

[0084] Next, an example of the process of the information processing device 100 according to this modification will be described with reference to Fig. 10A and Fig. 10B. First, Fig. 10A is a flowchart showing an example of the process related to the display of damage level information. The processes of S1001 to S1005 are substantially similar to the processes of S701 to S705 in Fig. 7A, and therefore detailed description thereof will be omitted. By executing the process of S1005, for example, damage level information is acquired in which a correction process based on the progression of damage and redundancy of each part of the structure is applied to the damage level determination results for each partial area 405 in area 403 as shown in Fig. 4.

[0085] In S1006, the information processing device 100 executes processing related to creation of a damage level table related to management of damage level information aggregated for each hierarchical level, such as the damage level table 533 illustrated in FIG. 5D. The process of S1006 will now be described in more detail with reference to Fig. 10B, which is a flowchart showing an example of a process related to the creation of a damage level table.

[0086] In S1021, the information processing device 100 creates an empty damage level table for recording damage level information corresponding to each area for each aggregation hierarchy when the aggregation process is applied repeatedly in stages, based on damage level information for each partial area before the aggregation process is applied. In S1022, the information processing device 100 writes the damage level information to which the correction processing based on progression and redundancy has been applied in S1005 into the damage level table created in S1021 as damage level information before further aggregation processing is applied.

[0087] In S1023, the information processing device 100 determines the area to which the aggregation process is applied next. For example, when applying the repair process illustrated in Fig. 5A, the information processing device determines a 3 x 3 area as the target of the aggregation process. Note that the area to which the aggregation process is applied next is determined within the range in which the aggregation process can be applied. For example, in the state shown in Fig. 8A(a), it is possible to secure a 3 x 3 area as the target for the next aggregation process. Therefore, in the state shown in Fig. 8A(a), the 3 x 3 area is determined as the area to which the next aggregation process will be applied, similar to the previously applied aggregation process. On the other hand, in the state shown in Fig. 8A(b), it is difficult to secure a 3x3 area as the target for the next aggregation process. Therefore, in the state shown in Fig. 8A(b), the area to which the next aggregation process will be applied is determined within the range that can be secured. Specifically, a 3x2 area is determined as the area to which the next aggregation process will be applied for the center part, and a 2x2 area is determined as the area to which the next aggregation process will be applied for both ends.

[0088] In S1024, the information processing device 100 determines an operation pattern of the aggregation process for the area to which the aggregation process is next applied, determined in S1023. For example, when the area to which the aggregation process is next applied is a 3×3 area, the operation pattern of the aggregation process may be determined based on the control table 505 shown in FIG. 5B. On the other hand, when the area to which the aggregation process is next applied is an area of ​​a pattern other than the 3×3 area (for example, a 3×2 area or a 2×2 area), the conditions related to the determination of the operation pattern of the aggregation process may be appropriately changed. As a specific example, the threshold value related to the determination of the density and continuity of the damage shown in FIG. 5B may be changed according to the number of partial areas to which damage level information is set in the area to which the aggregation process is next applied.

[0089] The repeated process of S1025 to S1027 may be configured to refer to the damage level input from the INDEX of the area where the aggregation process has been performed. This makes it possible to apply the aggregation process shown in S1026 to each area determined in S1023, regardless of the number of areas to be aggregated. That is, by sequentially aggregating the information shown as pattern information 538 in Fig. 5D, it becomes possible to collect damage level information of the area to which the aggregation process is applied, and by replacing the corresponding operation pattern, it becomes possible to execute the repeated process.

[0090] In S1028, the information processing device 100 writes the damage level information after the aggregation process has been applied by the repeated processes of S1025 to S1027 into the damage level table created in S1021. In the damage level table in which the damage level information is written for each hierarchical level in S1028, a number for each hierarchical level is added to the INDEX used to refer to each piece of damage level information, as exemplified as the setting value 536 of the index 534 in Fig. 5D. That is, among the numbers exemplified as the setting value 536, the first number is assigned "1" if it is the result of the first aggregation process, and thereafter, a number incremented by "1" is assigned for each repetition of the aggregation process.

[0091] In S1029, the information processing device 100 determines whether or not the result of the aggregation process extends to an area indicating the entire structure (in other words, whether or not the result of the aggregation process has converged to one area). When the information processing device 100 determines in S1029 that the result of the aggregation process does not extend to the area showing the entire structure, the information processing device 100 advances the process to S1023. In this case, the processes from S1023 onwards are executed again. On the other hand, when the information processing device 100 determines in S1029 that the result of the aggregation process has reached the area showing the entire structure, the series of processes shown in Fig. 10B is terminated. In this case, information (for example, damage level information) is written in the damage level table for each of the series of hierarchical levels related to the aggregation process.

[0092] Now, reference is again made to FIG. 10A. In S1007, the information processing device 100 displays a drawing of the target structure on a predetermined display screen. As a specific example, in the case of the example shown in Fig. 9, the information processing device 100 displays the drawing of the target structure in a display area 902 of a display screen 901.

[0093] In S1008, the information processing device 100 selects a hierarchical level related to the aggregation process that is to be the target of displaying the damage level information, and identifies a damage level table corresponding to the selected hierarchical level. Note that there is no particular limitation on the configuration or method for selecting a hierarchical level that is to be the target of displaying the damage level information. As a specific example, the information processing device 100 may be configured to be able to select an arbitrary hierarchical level at any time. As another example, the information processing device 100 may select a hierarchical level that is to be the target of displaying the damage level information by sequentially switching the hierarchical levels that are the target of displaying the damage level information in response to a desired trigger (for example, an instruction from a user via button 906 or 907 shown in FIG. 9).

[0094] In S1009, the information processing device 100 reads in a threshold value related to the level of damage to be displayed. As a specific example, the information processing device 100 may read in a threshold value selected by a user via a slider 908 shown in FIG. 9. In the example shown in FIG. 9, the threshold value can be selected from "1" to "5" via the slider 908, and damage level information having a damage level below the selected threshold value is excluded from the display. In this case, when "1" is selected as the threshold value, damage level information having damage levels of 1 to 5, i.e., all damage level information, is displayed.

[0095] In S1010, the information processing device 100 extracts damage level information whose damage level is equal to or higher than the threshold selected in S1009 from the damage level information corresponding to the hierarchical level selected in S1008, and displays the damage level information on a predetermined display screen. As a specific example, in the case of the example shown in Fig. 9, the information processing device 100 displays the damage level information in a display area 902 of a display screen 901 so that the damage level information is superimposed on a drawing of a structure displayed in the display area 902. For example, Fig. 9(b) shows an example of a display mode of damage level information when, in the state shown in Fig. 8A(b), damage level information whose damage level is 3 or higher is specified as the damage level information to be displayed via the slider 908.

[0096] In S1011, the information processing device 100 determines whether or not to end the process relating to the display of damage level information. When it is determined in S1011 that the process related to the display of the damage level information is not to be ended, the information processing device 100 advances the process to S1008. In this case, the process from S1008 onwards is executed again. Then, when it is determined in S1011 that the process relating to the display of the damage level information is to be ended, the information processing device 100 ends the display of the damage level information to a predetermined output destination, and then ends the series of processes shown in FIG. 10A.

[0097] As described above, the information processing device 100 according to this modification allows the user to refer to the damage level information according to the damage level determination result based on the inspection image as information aggregated at a desired granularity by appropriately selecting the hierarchical level related to the aggregation process. Also, by appropriately selecting the granularity related to the display of the damage level information (in other words, the range of each area), it becomes possible to check the damage level of each part of the target structure (for example, the pier part or deck part of a bridge) in a more suitable manner.

[0098] In addition, by limiting the damage degree information to be displayed according to, for example, the level of damage degree, it is possible to efficiently check the damage degree by limiting it to, for example, areas with a high degree of damage. Furthermore, as shown in FIG. 8D, it is also possible to present damage level information for the entire structure, and this damage level information can be used to determine the soundness of the structure. Furthermore, even in a situation where there are multiple structures to be inspected, by appropriately selecting the granularity for displaying the damage level information (in other words, the hierarchy for the aggregation process), it is possible to focus on inspecting the parts that are expected to be particularly affected.As a specific example, it is possible to identify structures that are estimated to be more damaged based on the damage level information for each structure, and for those structures, it is possible to gradually identify the parts that are expected to be particularly affected while appropriately lowering the hierarchy for the aggregation process.

[0099] (Variation 2) Next, the information processing device 100 according to the modified example 2 will be described with reference to Figs. 11, 12A, and 12B. In the above-described embodiment and modified example 1, an example of a mechanism that enables the granularity of the display of the damage degree information to be changed by aggregating the damage degree information in each of a plurality of partial regions has been described. In this modified example, an example of a configuration for presenting information related to repair of damage present in a part corresponding to a partial region upon receiving designation of at least a part of a series of partial regions (for example, partial regions before or after aggregation) related to the presentation of the damage degree information will be described. As a specific example, the information processing device 100 according to this modified example tally up the type of repair material for repairing the damage present in the part corresponding to the selected partial region, the amount of the repair material required for the repair, and the like, and presents information according to the result of the tally as information related to the repair of the damage.

[0100] FIG. 11 shows an example of a display screen used to present damage level information in the information processing device 100 according to this modification. In the example shown in FIG. 11, damage level information after aggregation processing is performed is presented for each area to which the aggregation processing is applied. For example, an area 1101 corresponds to an area to be aggregated, and the level of damage level is determined to be "5" based on the result of the aggregation processing of the damage level information. In addition, notification information 1102 is a display area used to present information related to repair of damage existing in the selected area. In the example shown in FIG. 11, when an area 1101 is selected, the type of repair material for repairing the damage existing in the area 1101, the amount of the repair material required for the repair, etc. are aggregated, and notification information 1102 in which information corresponding to the result of the aggregation is presented is displayed. The notification information 1102 corresponds to an example of "third information" related to repair of damage present in a portion of a target structure.

[0101] Next, an example of the process of the information processing device 100 according to this modification will be described with reference to Fig. 12A and Fig. 12B. First, Fig. 12A is a flowchart showing an example of the process related to the display of damage level information. The processing of S1201 to S1210 is substantially similar to the processing of S1001 to S1010 in Fig. 10A, and therefore detailed description thereof will be omitted. By executing the processing of S1010, a display screen related to the presentation of damage level information according to the determination result of the damage level for each part of the target structure, as shown in Fig. 9, is displayed on a predetermined output destination. Then, in S1211, the information processing device 100 executes a process related to displaying information related to the repair of damage, for example, a process related to displaying information related to an estimate of repair materials.

[0102] The process of S1211 will now be described in more detail with reference to Fig. 12B. Fig. 12B is a flowchart showing an example of a process related to displaying information related to the repair of damage, and in particular shows a process for displaying information related to an estimate of a repair material as the information related to the repair of the damage.

[0103] In S1221, the information processing device 100 determines whether or not a desired area (e.g., a partial area before or after aggregation) in which damage level information is displayed has been selected. As a specific example, the information processing device 100 may receive an instruction from a user to select an area in which damage level information is displayed via a display screen 901 shown in FIG. 9(a). If the information processing device 100 determines in S1221 that the desired area in which the damage level information is displayed has not been selected, the information processing device 100 ends the series of processes shown in FIG. 12B. On the other hand, if the information processing device 100 determines in S1221 that a desired area in which damage level information is displayed has been selected, it advances the process to S1222.

[0104] In S1222, the information processing device 100 acquires a series of damage level information before the aggregation process is performed for the area selected in S1221. In this manner, the information processing device 100 individually collects damage level information corresponding to each damage detected based on the inspection image in S1201. In S1223, the information processing device 100 acquires information on the design of the part of the structure corresponding to the area selected in S1221 (hereinafter, also referred to as "design drawing information"). The design drawing information may include information on the characteristics of the part, such as the name and type of the structural material for each part of the target structure.

[0105] In the repeated process of S1224 to S1231, the process is repeatedly executed for each damage corresponding to each piece of damage level information acquired in S1222.

[0106] Specifically, in S1225, the information processing device 100 detects the type of the target damage. Examples of the type of damage include cracks, peeling, water leakage, and floats. In S1226, the information processing device 100 detects the size and scale of the target damage according to the type of the damage detected in S1225. As a specific example, when the target damage is a crack, the information processing device 100 detects the length and width of the crack, and the presence or absence of each of branching, intersection, and tortoiseshell formation, etc., as the size and scale of the damage.

[0107] In S1227, the information processing device 100 acquires information on the properties of the structural member in which the target damage has occurred from the design drawing information acquired in S1223. In S1228, the information processing device 100 selects the type of repair material for repairing the target damage according to the type of the damage, the size of the damage, and the type of structural material identified in S1225 to S1227. Note that information on the type of damage, the type of repair agent according to the type of structural material, and the amount of the repair material required for each unit of the size of the damage may be stored in advance as a correspondence table. In S1229, the information processing device 100 calculates the amount of repair material required when the repair material selected in S1228 is used to repair the damage, based on the size and scale of the target damage. In S1230, the information processing device 100 records information on the type of repair material selected in S1228 and information on the amount of repair material calculated in S1229 in association with the target damage.

[0108] In this manner, the information processing device 100 repeatedly executes the processes of S1225 to S1230 for each of the series of damages. As a result, for each of the series of damages occurring in the portion corresponding to the region selected in S1221, information on the type and amount of repair material used to repair the damage is recorded.

[0109] Then, in S1232, the information processing device 100 displays, on a predetermined output destination, information on the type and total amount of repair material required to repair a series of damages occurring in a portion corresponding to the region selected in S1221. As a result, for example, as illustrated as notification information 1102 in Fig. 11, information on the type and amount of repair material required to repair a series of damages occurring in a portion corresponding to the selected region is displayed as a guide.

[0110] The damage for which the damage level information is presented on the display screen shown in FIG. 11 is detected based on the analysis results of the inspection image corresponding to the imaging results of the side of the structure. Therefore, in order to present more accurate information related to the repair of the damage (e.g., information on the type and amount of repair material, etc.), the damage level determination results based on other inspection images obtained by imaging the structure from other directions may also be used. As a specific example, when the structure is a bridge, the damage level determination results based on inspection images of the deck plate captured from the top or bottom of the bridge or inspection images of the bridge captured from the back side may be used in conjunction with the acquisition of information related to the repair of the damage.

[0111] Now, reference is again made to FIG. 12A. In S1212, the information processing device 100 determines whether or not to end the process relating to the display of the damage level information. When it is determined in S1212 that the process relating to the display of damage level information is not to be ended, the information processing device 100 advances the process to S1208. In this case, the process from S1208 onwards is executed again. Then, when it is determined in S1212 that the process relating to the display of the damage level information is to be ended, the information processing device 100 ends the display of the damage level information to a predetermined output destination, and then ends the series of processes shown in FIG. 12A.

[0112] As described above, with the information processing device 100 according to this modified example, a user can select any area in which damage level information is presented at any hierarchical level related to the aggregation process, and thereby view information related to repair of damage that has occurred in the part corresponding to that area. As described above, the information related to the repair of damage is displayed as a result of aggregation based on the damage level information of each of the series of damages that occurred in the part corresponding to the selected area. Therefore, for example, a user can view information related to the repair of damage that occurred in the part corresponding to the selected area at any granularity by appropriately switching the hierarchy related to the aggregation process and then selecting a desired area. This allows, for example, a user to order repair materials related to the repair of damage that occurred in the part corresponding to the desired area, and to order the repair materials collectively based on the presented information, without the cumbersome task of aggregating the type and amount of repair materials for each damage.

[0113] <Other embodiments> The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-mentioned embodiments is supplied to a system or device via a network or a recording medium, and one or more processors in a computer of the system or device read and execute the program. Also, the present invention can be realized by a circuit (e.g., ASIC) for implementing one or more of the functions. [Explanation of symbols]

[0114] 100 Information processing device 111 Damage level determination section 112 Correction processing section 113 Aggregation Processing Unit 114 Storage section 115 Display control unit

Claims

1. an aggregation means for aggregating, for each second partial area larger than the first partial area, first information relating to a damage degree of a portion of the structure corresponding to the first partial area, which is associated with the first partial area divided from an image of the target structure, and for each second partial area larger than the first partial area, the first information corresponding to each of the first partial areas included in the second partial area, as second information based on at least one of a density and a continuity of damage in the second partial area; a recording means for recording the second information corresponding to the second partial area and the first information corresponding to each of the plurality of first partial areas included in the second partial area in association with each other; An information processing device comprising:

2. The information processing device according to claim 1, characterized in that the recording means assigns the first information for each of the first partial regions and the second information for each of the second partial regions to different hierarchies, thereby recording information regarding the degree of damage to portions of the structure for each hierarchical level according to the granularity of division of the captured image.

3. The information processing apparatus according to claim 2 , wherein the series of layers includes at least a layer corresponding to an area including the entire structure.

4. 4. The information processing device according to claim 2 or 3, further comprising a display control means for associating a partial area divided from the captured image at a granularity corresponding to the specified hierarchy and information regarding the degree of damage of the part of the structure corresponding to the partial area with the captured image and displaying it on a specified output destination.

5. The information processing device according to claim 4, characterized in that the display control means selectively switches between the second information corresponding to the second partial region and the first information corresponding to each of a plurality of first partial regions included in the second partial region, and displays them on the output destination in association with the corresponding region in the captured image.

6. The information processing device according to claim 4 or 5, wherein the display control means suppresses the display of part of the information regarding the degree of damage of a portion of the structure corresponding to each of a series of partial areas divided from the captured image at a granularity corresponding to the specified hierarchy, in accordance with the specified level of damage.

7. a counting means for counting the first information for each of the first partial regions included in the second partial region, the display control means displays, on the output destination, third information related to repair of damage present in a portion of the structure corresponding to the second partial area according to a result of the compilation; 7. The information processing device according to claim 4.

8. The counting means, based on a result of the counting, identifies a type of repair material related to repair of damage present in a portion of the structure corresponding to the second partial region and calculates an amount of the repair material; The third information includes information on the type of the identified repair material and information corresponding to a calculation result of the amount of the repair material. The information processing device according to claim 7.

9. The information processing device according to any one of claims 1 to 8, further comprising a correction means for correcting information regarding the degree of damage of a portion of the structure corresponding to a partial area divided from the captured image, based on at least one of redundancy according to the allowable damage in the portion and the progression of the damage in the portion.

10. The correction means is correcting the information about the degree of damage so that the degree of damage becomes lower as the redundancy becomes higher; The information on the damage level is corrected so that the damage level becomes higher as the redundancy becomes lower. The information processing device according to claim 9.

11. The correction means is correcting the information on the degree of damage so that the degree of damage is higher the more progressive the condition is, The information on the degree of damage is corrected so that the lower the progression, the lower the degree of damage. The information processing device according to claim 9 or 10.

12. An information processing method executed by an information processing device, an aggregation step of aggregating, for each second partial region larger than the first partial region, first information relating to a damage degree of a portion of the structure corresponding to the first partial region, which is associated with the first partial region divided from the captured image of the target structure, into second information based on at least one of a density and a continuity of damage in the second partial region, and the first information corresponding to each of the first partial regions included in the second partial region; a recording step of recording the second information corresponding to the second partial area and the first information corresponding to each of the plurality of first partial areas included in the second partial area in association with each other; 13. An information processing method comprising:

13. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 11.

Images