Information processing apparatus, information processing method, and program

Abstract

To provide an information processing apparatus, an information processing method, and a program that easily correct a result of detection of a planarly spreading deformation.SOLUTION: An information processing method includes the steps of: acquiring information on a deformed area in an image of a structure corresponding to a deformation planarly spreading in the structure; on the basis of the positional relationship between one deformed area and another deformed area, determining whether to couple the one deformed area to the other deformed area; and on the basis of a result of the determination, coupling the one deformed area to the other deformed area.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program, and particularly relates to a technique for detecting deformation in a structure.

Background Art

[0002] In recent years, detection of deformation (for example, cracks) in a structure using image processing has been performed. For example, Patent Document 1 discloses vectorizing damage information about damage in a structure and generating a plurality of deformation vectors having a starting point and an end point. Further, Patent Document 1 discloses generating a new damage vector by connecting the starting point or the end point of two damage vectors. By such a method, the user can grasp the connection relationship between the damage vectors.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] On the other hand, as deformation of a structure, deformation that spreads in a planar shape such as water leakage, peeling, efflorescence, reinforcement exposure, and rust juice is also known. When a single deformation is detected separately into two or more, it becomes difficult to search for, analyze, and evaluate the deformation. On the other hand, in order to correct the detection result of the deformation, the burden on the user to specify the area of the correct deformation is large. Further, with the method of Patent Document 1, the connection relationship of the deformation spreading in a planar shape could not be grasped.

[0005] An object of the present disclosure is to provide a technique for easily correcting a detection result of deformation that spreads in a planar shape.

Means for Solving the Problems

[0006] An information processing apparatus according to an embodiment includes the following configuration. That is, acquisition means for acquiring information on a deformed area in an image of the structure, which corresponds to a deformation spreading in a planar manner in the structure; determination means for determining whether or not to combine the one deformed area with the other deformed area based on the positional relationship between the one deformed area and the other deformed area; combining means for combining the one deformed area with the other deformed area based on the determination result by the determination means; and includes.

Advantages of the Invention

[0007] A technique for easily correcting a detection result of a deformation spreading in a planar manner is provided.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0010] An information processing apparatus according to an embodiment can combine deformed areas. In this specification, a deformed area is a specific area on an image of a structure. The structure is not particularly limited. The structure can be, for example, an expressway for automobiles, a bridge, a tunnel, or a dam. The image of the structure may be the surface (for example, the side surface, the wall surface, or the ceiling surface) of these structures.

[0011] The deformed area corresponds to a planar deformation of the structure. The deformation corresponding to the deformed area is, for example, damage spreading on the same plane such as water leakage, peeling, efflorescence, reinforcement exposure, or rust juice. Such deformation may occur on the concrete surface due to cracks or other factors of the structure. Such a deformed area is represented by a set of points defining the outer periphery of the area or a set of vertices of a polyline defining the outer periphery of the area. In one embodiment, the deformed area corresponds to an area where at least one of water leakage, peeling, efflorescence, reinforcement exposure, and rust juice has occurred in the structure.

[0012] Also, the information processing apparatus according to an embodiment can combine deformed areas based on a deformed line. The deformed line corresponds to a linearly spreading deformation of a structure. In this specification, the deformed line is a line segment or a polyline on an image of the structure. Such a deformed line is represented by a set of coordinates of endpoints or vertices of a line segment or a polyline. Information indicating a width may be further added to the deformed line. The deformation corresponding to the deformed line is, for example, a crack in a structure. The deformation may be a crack occurring on a concrete surface due to damage, deterioration, or other factors of the structure. The crack is a linear damage having a starting point, an ending point, a length, and a width, which occurs on a wall surface or the like of the structure due to aging deterioration or an impact of an earthquake. Further, the deformed line may correspond to a linear mark in the structure. The linear mark may be a chalk trace written along a crack in the structure.

[0013] FIG. 1 is a block diagram showing an example of the hardware configuration of an information processing apparatus according to an embodiment. In the embodiment described below, a computer operates as the information processing apparatus 100. Note that the processing of the information processing apparatus in this embodiment may be realized by a single computer. Further, the information processing apparatus according to this embodiment may be configured by a plurality of computers. That is, the functions of the information processing apparatus in this embodiment may be distributed to a plurality of computers as necessary. Such a plurality of computers are communicably connected to each other and can cooperate to perform the processing of the information processing apparatus.

[0014] The information processing apparatus 100 includes a control unit 101, a volatile memory 102, a non-volatile memory 103, a storage device 104, an input device 105, an output device 106, a communication device 107, and a system bus 108.

[0015] The control unit 101 comprehensively controls the entire information processing apparatus 100. The control unit 101 can include a processor. The processor can be an arithmetic processing processor such as a Central Processing Unit (CPU) or a Micro Processor Unit (MPU).

[0016] The volatile memory 102 temporarily stores programs or data supplied from an external device or the like. The volatile memory 102 can be, for example, a Random Access Memory (RAM).

[0017] The non-volatile memory 103 stores programs and parameters executed by the processor of the control unit 101. The non-volatile memory 103 can be, for example, a Read-Only Memory (ROM).

[0018] The storage device 104 can store programs or data. The storage device 104 may be a semiconductor memory or a magnetic disk. The storage device 104 can be an internal device such as a hard disk or a memory card built into the information processing apparatus 100. Further, the storage device 104 may be an external device such as a hard disk or a memory card detachably connected to the information processing apparatus 100. Further, the storage device 104 may include a disk drive that reads and writes data to and from an optical disk such as a DVD or a Blu-ray (registered trademark) Disc.

[0019] The input device 105 receives user operations. The input device 105 is, for example, a mouse, a keyboard, or a touch panel. The input device 105 can output an instruction related to the received user operation to the control unit 101.

[0020] The output device 106 outputs information to the user. The output device 106 can be a display device such as an LCD (Liquid Crystal Display) or an organic EL display. Such an output device 106 can display data held by the information processing device 100 or data supplied from an external device.

[0021] The communication device 107 is a device that communicably connects the information processing device 100 to a network such as the Internet or a LAN (Local Area Network).

[0022] The system bus 108 is a data transmission path between the respective parts constituting the information processing device 100. The system bus 108 can include an address bus, a data bus, and a control bus that enable data transmission and reception.

[0023] The non-volatile memory 103 can store the Operating System (OS), which is basic software executed by the control unit 101, and applications that realize application-level functions in cooperation with the OS. Further, the non-volatile memory 103 may store an application for performing image analysis processing, which will be described later, for detecting deformation from a photographed image of a structure to be inspected by the information processing device 100.

[0024] The processing of the information processing device 100 according to the present embodiment is realized by the control unit 101 reading and executing software provided by an application. That is, the functions of each part shown in FIG. 2 and the like, which will be described later, can be realized by the processor included in the control unit 101 executing a program stored in a memory such as the volatile memory 102, the non-volatile memory 103, or the storage device 104. Note that the application has software for using the basic functions of the OS installed in the information processing device 100. On the other hand, the OS of the information processing device 100 may have software for realizing the processing in the present embodiment.

[0025] Figure 2 is a block diagram showing an example of the functional configuration of the information processing apparatus 100. The information processing apparatus 100 includes an image management unit 211, an image storage unit 212, an image analysis unit 213, a result storage unit 214, and a result management unit 215. Each function of the information processing apparatus 100 can be configured by hardware and software. As described above, the functions of the information processing apparatus 100 shown in FIG. 2 can be realized by a computer, but some or all of the functions of the information processing apparatus 100 may be realized by dedicated hardware. Note that the information processing apparatus 100 may be realized by a system in which one or more computers and servers are connected by a network.

[0026] The image management unit 211 has functions such as storing, deleting, displaying a list of, and browsing images. The image management unit 211 can store, for example, an image to be inspected in the image storage unit 212. In the present embodiment, the image to be inspected is input to the information processing apparatus 100 by the user. The image storage unit 212 stores image data.

[0027] The image analysis unit 213 detects abnormalities from the image to be inspected. The method for detecting abnormalities is not particularly limited. The image analysis unit 213 can detect abnormalities using, for example, machine learning techniques using Artificial Intelligence (AI). Specifically, the image analysis unit 213 can detect abnormalities from the image to be inspected by performing image analysis on the image to be inspected using a learned model created by deep learning. Then, the image analysis unit 213 can store information indicating the detection result of the abnormality in the result storage unit 214. The result storage unit 214 stores the image analysis result.

[0028] In this embodiment, for an image obtained by photographing an inspection target (for example, the wall surface of a concrete structure) with a camera, image analysis using a learning model is performed to detect a change in the inspection target. When the change is a crack, a change line corresponding to the change is generated by image analysis. Such a change line represents the result of vectorizing the change. Information indicating the length and width of the crack can be added to the change line. When the change is leakage, peeling, efflorescence, reinforcement exposure, or rust juice, etc., a change area corresponding to the change is generated by image analysis. Such a change area represents the result of area-izing the change using a figure (specific examples include a circle or a rectangle, etc.) that encompasses the change.

[0029] The result management unit 215 has a function of editing the image analysis results stored in the result storage unit 214. The result management unit 215 may have functions such as browsing and acquiring the image analysis results. The result management unit 215 can present to the user a browsing screen (Figure 3) and an editing screen (Figure 4) of the image analysis results. On the other hand, in the detection of changes by image analysis, there is a possibility of false detection or detection omission. Therefore, the user can visually confirm the detection results and edit the detection results. In particular, when determining the change area by image analysis processing as compared with the case of manually recording the change area while visually observing the image, a tendency exists for a lump of changes to be easily detected separately as a plurality of change areas. In order to facilitate the analysis (for example, comparison over time) and search of the change areas, in such a case, the detection results can be edited so that a plurality of separately detected change areas are combined.

[0030] The result management unit 215 includes a display control unit 221, a designation acquisition unit 222, a determination unit 223, and a combination processing unit 224. The display control unit 221 acquires information on a deformed area in an image of the structure corresponding to a deformation spreading in a planar shape in the structure. Further, the display control unit 221 may further acquire information on a deformed line in the image of the structure corresponding to a deformation spreading in a linear shape in the structure. Then, the display control unit 221 can output a screen (for example, FIGS. 3 and 4) showing such deformed area and deformed line information.

[0031] As will be described later, the result management unit 215 has a function of editing the detection result so as to combine a plurality of deformed areas. The designation acquisition unit 222 receives the designation of one deformed area and another deformed area to be subjected to the combination process. The determination unit 223 determines whether or not to combine one deformed area with another deformed area based on the positional relationship between one deformed area and another deformed area. The combination processing unit 224 combines one deformed area with another deformed area based on the determination result by the determination unit 223. Details of these processes will be described later.

[0032] In the present embodiment, the information processing apparatus 100 performs a process of detecting a deformation and further performs a process of editing the deformation detection result. However, it is not essential for the information processing apparatus 100 to perform the process of detecting a deformation. For example, a deformation detection result (for example, at least one of a deformed area and a deformed line) generated by another information processing apparatus may be input to the information processing apparatus 100. The result storage unit 214 can store such a deformation detection result. Also in this case, the result management unit 215 can edit the detection result stored in the result storage unit 214 as described later.

[0033] FIG. 3 is a diagram showing an example of a browsing screen 300 of the image analysis result. The user can confirm the image analysis result on such a browsing screen. On the browsing screen 300, the analysis result can be browsed for each image. The browsing screen 300 has an analysis result display column 310 and a legend display column 350.

[0034] In the analysis result display column 310, the deformations detected by image analysis are displayed. The deformation areas and deformation lines corresponding to the deformations can be displayed superimposed on the image of the inspection target. In the example of FIG. 3, deformation lines 321 to 323 corresponding to cracks, a deformation area 331 corresponding to water leakage, and deformation areas 341 to 343 corresponding to efflorescence are shown. The deformation areas and deformation lines may be displayed in different manners according to the attributes of the deformations. In this way, the analysis results can be displayed in an identifiable manner. The analysis result of a crack can include the actual size information of the length and thickness (width) of the crack. In this case, as shown in FIG. 3, the deformation lines corresponding to the cracks may have different display forms (for example, colors and line types) according to the length or thickness of the cracks. Also, as shown in FIG. 3, the deformation areas may have different display forms (for example, patterns) according to the types of the deformations. The deformation areas may have different display forms according to other attributes such as the size of the deformations.

[0035] In the legend display column 350, the display forms for each deformation line and deformation area are shown. In this example, in the legend display column 350, the display forms for each crack width and each type of deformation are shown. The legend display column 350 may be used to receive an input for specifying the deformation to be displayed. In the example of FIG. 3, the legend display column 350 has check boxes corresponding to each deformation. Then, according to whether the check box is checked or not, the display or non-display of the corresponding deformation can be switched.

[0036] Note that the actual size information of the length or thickness of the crack can be calculated based on the resolution and the number of pixels of the image of the detection target. Similarly, the actual size information (for example, area) of the deformation represented by the deformation area can also be calculated based on the resolution and the number of pixels of the image of the detection target. Also, by referring to the data of the drawing of the structure, the coordinates and actual size information of the detected deformation can be converted into coordinates and actual size information according to the coordinate system of the drawing. By such processing, browsing, editing, and analysis of the analysis results by the information processing apparatus 100 or an external apparatus are facilitated.

[0037] FIG. 4 is a diagram showing an example of an editing screen for image analysis results. In FIG. 3, by pressing an editing button 351 provided for each type of abnormality, the screen transitions to the editing screen of FIG. 4. On this editing screen, the detection results of the specified type of abnormality can be edited. In the editing screen 400 shown in FIG. 4, the detection results of efflorescence can be edited. On the other hand, on another editing screen, for each image to be detected, the detection results of all types of abnormalities may be editable.

[0038] The editing screen 400 includes an editing result display column 410, an abnormality name column 421, an editing instruction column 422, and a display switching column 423. The abnormality name column 421 shows the name of the abnormality to be edited. In the editing instruction column 422, various buttons used for the user to input editing instructions are displayed.

[0039] In the editing result display column 410, similar to the analysis result display column 310, the abnormality area and the abnormality line corresponding to the abnormality are superimposed and displayed on the image to be inspected. Whether to display the image to be inspected (background image) can be switched by input to the display switching column 423. On the other hand, the abnormality area and the abnormality line corresponding to the abnormality other than the editing target can be displayed in a different manner from the abnormality area and the abnormality line corresponding to the abnormality to be edited. In the example of FIG. 4, the transparency of the abnormality lines 321 to 323 corresponding to cracks and the abnormality area 331 corresponding to water leakage, etc., which correspond to the abnormality other than the editing target, is set higher than the abnormality areas 341 to 343 corresponding to the efflorescence, which is the abnormality to be edited. Also, the abnormality area and the abnormality line corresponding to the abnormality to be edited can be displayed so as to be superimposed on the abnormality area and the abnormality line corresponding to the abnormality other than the editing target. In the example of FIG. 4, the abnormality areas 341 to 343 corresponding to the efflorescence, which is the abnormality to be edited, are the topmost in the superposition order.

[0040] The frame 415 shown in the editing result display column 410 indicates the application range of the process for combining deformation areas. The user can set the frame 415 to include these multiple deformation areas in order to combine multiple deformation areas corresponding to a single coherent deformation. The process of combining deformation areas according to the set frame 415 will be described later.

[0041] FIG. 5 is a flowchart of the process performed by the information processing apparatus of the present embodiment. The process shown in FIG. 5 is performed by the control unit 101 of the information processing apparatus 100 expanding the program stored in the non-volatile memory 103 into the volatile memory 102 and executing the program to control each component, thereby realizing the functions shown in FIG. 2.

[0042] In S501, the image analysis unit 213 performs image analysis processing on the image of the inspection target. Thus, the image analysis unit 213 detects the deformation lines and deformation areas corresponding to the deformation from the image of the inspection target.

[0043] In S502, the image analysis unit 213 stores the analysis result obtained in S501 in the result storage unit 214. The image analysis unit 213 can store, for example, information indicating the positions of the deformation lines and deformation areas in the result storage unit 214. Specifically, the image analysis unit 213 can store information indicating the start points and end points of the respective deformation lines in the result storage unit 214. Also, the image analysis unit 213 can store information indicating the vertices defining the respective deformation areas in the result storage unit 214. Furthermore, the image analysis unit 213 can store information indicating the attributes of the respective deformation lines or deformation areas (for example, the width of the crack or the type of deformation) in the result storage unit 214.

[0044] In addition, the display control unit 221 acquires information on the deformed area in the image of the structure corresponding to the deformation that spreads in a planar manner in the structure. Then, the display control unit 221 can output information indicating the deformed area. For example, the display control unit 221 can display the analysis result obtained in S501 on the output device 106. Specifically, the display control unit 221 can display the above-described browsing screen 300 on the output device 106.

[0045] After S503, editing of the deformed area according to the user operation is performed. Here, as an example of the editing method, the case of combining a plurality of deformed areas will be described. In the following, the case where one type of deformation (for example, efflorescence) is selected as the editing target will be described. In one embodiment, one deformed area to be combined and another deformed area correspond to the same type of deformation. For example, the deformed area corresponding to the deformation of the type to be edited is combined with the deformed area corresponding to the deformation of the type to be edited. On the other hand, the deformed area corresponding to a certain type of deformation and the deformed area corresponding to another type may not be combined. However, as will be described later, it is also possible to combine the deformed areas corresponding to different types of deformations.

[0046] In S503, the designation acquisition unit 222 acquires a user input indicating the type of deformation corresponding to the deformed area to be combined. As described above, by pressing the editing button 351 provided for each type of deformation on the browsing screen 300, the user can select the type of deformation to be edited (that is, the combination target). In this example, only one type of deformation is selected. However, two or more types of deformations may be selected. Also, regardless of the user input, all types of deformations may be selected.

[0047] In S504, the specification acquisition unit 222 selects a deformed area to be subjected to the combination process. The specification acquisition unit 222 can select, according to user input, one deformed area and other deformed areas that are to be subjected to the combination process. For this purpose, the specification acquisition unit 222 can accept the specification of one deformed area and other deformed areas that are to be subjected to the combination process. Thus, the specification acquisition unit 222 can select the deformed area to be subjected to the combination process according to user input.

[0048] For example, the specification acquisition unit 222 can accept the specification of an area on the image of the structure. The specification acquisition unit 222 can accept such a specification from the user. The specified area is used as the application range of the combination process. Then, the specification acquisition unit 222 can identify the deformed areas in the specified area as one deformed area and other deformed areas to be combined.

[0049] Specifically, the user can specify the application range by changing the size and position of the frame 415 on the editing screen 400. Then, the specification acquisition unit 222 selects the deformed areas included in the frame 415 as the objects of the combination process. Here, the specification acquisition unit 222 may select the deformed areas completely included in the frame 415 as the objects of the combination process. Also, the specification acquisition unit 222 may select the deformed areas that at least partially overlap with the area within the frame 415 as the objects of the combination process. When the type of deformation to be edited is selected in S503, the specification acquisition unit 222 can select, as the objects of the combination process, the deformed areas included in the frame 415 and corresponding to the type of deformation to be edited selected in S503.

[0050] Note that the specified acquisition unit 222 can present the initial setting of the area to the user. The specified acquisition unit 222 may determine the initial setting of the area (i.e., the initial arrangement of the frame 415) according to the analysis result (e.g., the positions of the deformation lines and the deformation areas). The specified acquisition unit 222 can identify the deformation line passing through the largest number of deformation areas among the plurality of deformation lines. Then, the specified acquisition unit 222 can present to the user, as the initial setting, the area set to include all the deformation areas on the identified deformation line. The specified acquisition unit 222 can determine the initial arrangement of the frame 415 so as to surround the area set in this way. As another example, the specified acquisition unit 222 can select the deformation line corresponding to the crack with the largest length or thickness. Then, the specified acquisition unit 222 can determine the initial arrangement of the frame 415 so as to surround the selected deformation line.

[0051] Note that the method for specifying the deformation areas to be subjected to the combination process is not limited to the above method. For example, the user may directly specify two or more deformation areas to be combined. For example, the user may click on two or more deformation areas to be combined on the image of the inspection target where the deformation areas are superimposed. Also, in one embodiment, the application range of the combination process may be automatically set. For example, the specified acquisition unit 222 may set the application range of the combination process to the entire image of the inspection target.

[0052] In S505, the determination unit 223 determines whether to combine the deformation areas selected in S504 as the targets of the combination process. That is, the determination unit 223 determines whether to combine one deformation area with another deformation area based on the positional relationship between one deformation area and the other deformation area. In this way, the determination unit 223 can determine whether to combine the deformation areas based on the position information of each deformation area.

[0053] In this embodiment, the determination unit 223 determines whether or not to combine one deformed area and another deformed area based on the positional relationship among one deformed area, another deformed area, and the deformation line. In this way, the determination unit 223 can determine whether or not to combine the deformed areas based on the positional information of the deformation line in addition to the positional information of each deformed area. In this embodiment, the determination unit 223 determines whether or not to combine one deformed area with another deformed area based on whether or not one deformed area and another deformed area exist on one deformation line. When the application range of the combination process is set as described above, the determination unit 223 determines whether or not to combine a plurality of deformed areas included in the application range specified in S504 based on whether or not the plurality of deformed areas are on one deformation line. When the determination unit 223 determines that these plurality of deformed areas are on one deformation line, the process proceeds to S506. When the determination unit 223 determines otherwise, the process ends.

[0054] Note that the attributes of the deformation lines referred to in this process may be restricted. That is, the determination unit 223 determines whether or not to combine one deformed area and another deformed area based on the positional relationship among one deformed area, another deformed area, and the deformation line having specific attributes. The deformation line having such specific attributes may be, for example, a deformation line corresponding to a crack having a width within a specific range.

[0055] In S506, based on the determination result by the determination unit 223, the combination processing unit 224 combines one deformed area with other deformed areas. That is, the combination processing unit 224 can combine the deformed areas selected in S504. Thus, the combination processing unit 224 generates a new deformed area. In the present embodiment, the combination processing unit 224 combines a plurality of deformed areas on each deformed line. The combination method will be described in detail later with reference to FIGS. 6 and 7. In the example of FIG. 4, the deformed area 341 corresponding to the efflorescence on the crack 323 and the deformed area 342 corresponding to the efflorescence are combined. The deformed area 343 corresponding to the efflorescence is on the crack 323 but not within the frame 415, so it is not combined with other deformed areas. The combination processing unit 224 can record a new deformed area instead of one deformed area and other deformed areas. In this example, one deformed area and other deformed areas correspond to the types of deformations to be edited, and the new deformed area also corresponds to the same type of deformation.

[0056] Referring to FIGS. 6 and 7, some examples of the method for combining deformed areas will be described. The combination method used by the combination processing unit 224 is not particularly limited. For example, the combination processing unit 224 may combine the deformed areas using one of the methods shown below. Also, the combination processing unit 224 may combine one deformed area with other deformed areas according to the method selected by the user from two or more methods.

[0057] In one embodiment, the new deformed area obtained by combining one deformed area with other deformed areas includes one deformed area, other deformed areas, and the area between one deformed area and other deformed areas. FIGS. 6(A) and 7(A) show two deformed areas 601 and 602 before combination on one deformed line 610. Also, FIGS. 6(B) and 7(B) show the deformed areas 620 and 720 after combination. The deformed areas 620 and 720 each include, in addition to the deformed areas 601 and 602 before combination, additional areas 603 and 703 that are deformed areas added by the combination.

[0058] In the method shown in FIG. 6, the combining processing unit 224 first determines, for each of the deformed areas 601 and 602, the point among the points defining the outer periphery that is farthest from the deformed line 610 passing through the deformed area, and obtains the distances a and d between this point and the deformed line. Next, the combining processing unit 224 determines, for each of the deformed areas 601 and 602, the point among the points defining the outer periphery that is on the opposite side of the deformed line 610 from the point determined as described above and is farthest from the deformed line passing through the deformed area. Then, the combining processing unit 224 obtains the distances b and c between this point and the deformed line. Further, the combining processing unit 224 obtains the average distance X of the distances a to d. Then, the combining processing unit 224 determines, between the deformed area 601 and the deformed area 602, the area obtained by expanding the width of the deformed line 610 passing through these deformed areas by the distance X as the additional area 603. This additional area is between the deformed area 601 and the deformed area 602 and is an area within a distance X from the deformed line 610. The combined deformed area 620 is an area obtained by adding the additional area 603 to the deformed area 601 and the deformed area 602.

[0059] Note that the method for determining the additional area is not limited to the above method. As described above, the additional area 603 may be an area within a distance X from the deformed line 610. This distance X may be the maximum distance or the minimum distance of the distances a to d. Also, this distance X may be determined according to the width of the crack corresponding to the deformed line 610. Further, this distance X may be arbitrarily selected by the user.

[0060] In this way, the combining processing unit 224 can generate a new deformed area by combining so as to include one deformed area, another deformed area, and an area (additional area) that spreads along the deformation line between one deformed area and another deformed area. Further, the area that spreads along the deformation line between one deformed area and another deformed area may be an area defined by expanding the deformation line by a predetermined width (the above distance X) in the width direction between one deformed area and another deformed area. The combining processing unit 224 can set this predetermined width according to the size of one deformed area or another deformed area. Specifically, as shown in FIG. 6, the combining processing unit 224 can set this predetermined width according to the distance between the point defining the outer periphery of one deformed area or another deformed area and the deformation line.

[0061] In the method shown in FIG. 7, the combining processing unit 224 first calculates the distance between each vertex defining the deformed area 601 and each vertex defining the deformed area 602. Then, the combining processing unit 224 determines the line between the vertex defining the deformed area 601 and the vertex defining the deformed area 602, and the line between another vertex defining the deformed area 601 and another vertex defining the deformed area 602 such that the two lines are the shortest. For example, the combining processing unit 224 may select these two lines such that the sum of the lengths of the two lines is minimized. Further, the combining processing unit 224 may select the first line that is the shortest and the second line that is the shortest among the lines between the remaining vertices. At this time, the combining processing unit 224 can select two lines so as not to intersect each other. Note that the combining processing unit 224 may select two lines so as to be the longest. Then, the combining processing unit 224 determines the area sandwiched between these two lines as the additional area 703. The deformed area 720 after combination is an area obtained by adding the additional area 703 to the deformed area 601 and the deformed area 602. In this way, the additional area may be an area sandwiched between two lines connecting the outer periphery of one deformed area and the outer periphery of another deformed area.

[0062] According to this embodiment, the detection result of deformation can be corrected so as to combine the deformed areas. In particular, the deformation tends to spread along the crack. For this reason, a single piece of deformation that spreads in a planar manner may be detected separately as a plurality of deformed areas along the crack. Therefore, when a plurality of deformed areas are detected along the crack, it is highly likely that these plurality of deformed areas represent a single piece of deformation. For this reason, in this embodiment, the plurality of deformed areas detected along the crack are combined. On the other hand, the combination of the deformed areas can be performed so that a plurality of deformed areas not along the same crack are not combined. Therefore, the user can appropriately combine a plurality of deformed areas only by performing a simple operation of setting a frame including the deformed areas to be combined on the image. As a result, the user can easily grasp the connection relationship between the deformed areas. In addition, the analysis and search of the deformed areas can be easily performed.

[0063] (Modification example) In the above embodiment, the determination unit 223 determines to combine a plurality of deformed areas when there are a plurality of deformed areas on one deformation line. However, the determination method for whether to combine a plurality of deformed areas is not limited to the above method. For example, the determination unit 223 may determine whether to combine one deformed area with another deformed area based on whether one deformed area and another deformed area exist within a predetermined distance from one deformation line. In this case, when there are a plurality of deformed areas whose processing from one deformation line is within the threshold, the determination unit 223 can determine to combine these plurality of deformed areas.

[0064] Also, in the above embodiment, the determination unit 223 determines whether to combine a plurality of deformed areas based on the positional relationship between the plurality of deformed areas and the deformed lines. On the other hand, the determination unit 223 may determine whether to combine a plurality of deformed areas regardless of the position of the deformed lines. In this case, it is not essential for the information processing apparatus 100 to detect the deformed lines. For example, the determination unit 223 may determine whether to combine a plurality of deformed areas based on the distance between the plurality of deformed areas. Specifically, the determination unit 223 can determine to combine these plurality of deformed areas when the distance between the plurality of deformed areas is equal to or less than a threshold value.

[0065] In the above embodiment, the case of combining a plurality of deformed areas mainly representing the same type of deformation (for example, efflorescence) has been described. However, the information processing apparatus 100 may combine a plurality of deformed areas representing different types of deformations. That is, one deformed area to be combined and another deformed area may correspond to different types of deformations.

[0066] The method of combining a plurality of deformed areas representing different types of deformations is not particularly limited. For example, the combination processing unit 224 can generate a new deformed area by combining one deformed area corresponding to a specific deformation with another deformed area corresponding to another deformation. This new deformed area is a deformed area corresponding to a specific deformation. As a result of the combination process, one deformed area corresponding to a specific deformation is replaced with a new deformed area corresponding to the specific deformation. On the other hand, another deformed area corresponding to another deformation may be maintained.

[0067] For such an example, it will be described with reference to FIG. 8. In this example, based on the position information of a plurality of deformed areas, these plurality of deformed areas are combined. Specifically, the determination unit 223 can determine whether to combine one deformed area with another deformed area based on the degree of overlap between one deformed area and another deformed area. The degree of overlap between the deformed areas can be defined based on the area of the overlapping part or the ratio of the overlapping part. For example, the determination unit 223 can determine to combine a plurality of deformed areas when the degree of overlap is equal to or greater than a threshold value. Further, the determination unit 223 may determine whether to combine a plurality of deformed areas according to the type of deformation represented by each of the plurality of deformed areas. Furthermore, when the degree of overlap is equal to or greater than a threshold value, the determination unit 223 may inquire the user whether to combine a plurality of deformed areas corresponding to different types of deformations. In this case, the display control unit 221 may display the deformed area that is the subject of the inquiry in a display form different from other deformed areas on the editing screen 400 so that the deformed area that is the subject of the inquiry can be identified.

[0068] Also, in one embodiment, the determination unit 223 determines whether to combine one deformed area with another deformed area according to whether the type of deformation corresponding to another deformed area is a predetermined type corresponding to the type of deformation corresponding to one deformed area. As an example, the case where reinforcement exposure is selected as the editing target will be described. In the example of FIG. 8, a deformed area 810 corresponding to rust juice and a deformed area 820 corresponding to reinforcement exposure are detected. Further, the deformed area 820 corresponding to reinforcement exposure is included in the application range of the combination process. By the way, rust juice is likely to occur at the reinforcement exposure site. And, in order to be hidden by the rust juice, there is a possibility that a part of the reinforcement exposure site is not detected. For this reason, it can be predetermined to combine the deformed area corresponding to reinforcement exposure with the deformed area corresponding to rust juice.

[0069] In one embodiment, the determination unit 223 determines whether there is a deformation area 810 corresponding to rust juice that overlaps with the deformation area 820 corresponding to the exposed reinforcing bar to be edited and has an overlap degree equal to or greater than a threshold value. When such a deformation area 810 exists, the combining processing unit 224 combines the deformation area 820 with the deformation area 810 to generate a deformation area 821. The combining processing unit 224 generates such a deformation area 821 as a deformation area corresponding to the exposed reinforcing bar. At this time, the deformation area 810 corresponding to the rust juice is maintained.

[0070] In this way, even when the deformed line is not detected, the detection result of the deformation can be corrected so as to combine the deformation areas.

[0071] (Other embodiments) The content of the present disclosure can also be realized by supplying a program that realizes one or more functions of the embodiment to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0072] The disclosure of this specification includes the following information processing apparatus, information processing method, and program. (Item 1) An acquisition unit that acquires information on a deformation area in an image of the structure corresponding to a deformation that spreads in a planar manner in the structure; A determination unit that determines whether to combine the one deformation area with the other deformation area based on the positional relationship between the one deformation area and the other deformation area; A combining unit that combines the one deformation area with the other deformation area based on the determination result by the determination unit; An information processing apparatus, characterized by comprising: (Item 2) The acquisition unit further acquires information on a deformation line in an image of the structure corresponding to a deformation that spreads in a linear manner in the structure; The determination means determines whether to combine the one deformed area with the other deformed area based on the positional relationship among the one deformed area, the other deformed area, and the deformed line. The information processing apparatus according to claim 1. (Item 3) The determination means determines whether to combine the one deformed area with the other deformed area based on whether the one deformed area and the other deformed area exist on one of the deformed lines. The information processing apparatus according to claim 2. (Item 4) The determination means determines whether to combine the one deformed area with the other deformed area based on whether the one deformed area and the other deformed area exist within a predetermined distance from one of the deformed lines. The information processing apparatus according to claim 2. (Item 5) The deformed line corresponds to at least one of a crack and a linear mark in the structure. The information processing apparatus according to any one of claims 2 to 4. (Item 6) The combining means generates a new deformed area by combining the one deformed area with the other deformed area. The new deformed area includes the one deformed area, the other deformed area, and an area that extends along the deformed line between the one deformed area and the other deformed area. The information processing apparatus according to any one of claims 2 to 5. (Item 7) The new deformed area includes the one deformed area, the other deformed area, and an area defined by widening the deformed line by a predetermined width in the width direction between the one deformed area and the other deformed area. The predetermined width is set according to the distance between a point defining the outer periphery of the one deformed area or the other deformed area and the deformed line. The information processing apparatus according to claim 6. (Item 8) The coupling means generates a new deformed area by coupling the one deformed area with the other deformed area, The new deformed area includes the one deformed area, the other deformed area, and an area between the one deformed area and the other deformed area, The area between the one deformed area and the other deformed area is an area sandwiched between two lines connecting the outer periphery of the one deformed area and the outer periphery of the other deformed area. The information processing apparatus according to any one of items 1 to 7, characterized in that (Item 9) The deformed area corresponds to an area in the structure where at least one of water leakage, peeling, efflorescence, rebar exposure, and rust juice has occurred. The information processing apparatus according to any one of items 1 to 8, characterized in that (Item 10) The one deformed area and the other deformed area correspond to the same type of deformation. The information processing apparatus according to any one of items 1 to 9, characterized in that (Item 11) The one deformed area and the other deformed area correspond to different types of deformation. The information processing apparatus according to any one of items 1 to 9, characterized in that (Item 12) The determination means determines whether to couple the one deformed area with the other deformed area according to whether the type of deformation corresponding to the other deformed area is a predetermined type corresponding to the type of deformation corresponding to the one deformed area. The information processing apparatus according to item 11, characterized in that (Item 13) The determination means determines whether to couple the one deformed area with the other deformed area based on the degree of overlap between the one deformed area and the other deformed area. The information processing apparatus according to any one of items 11 to 12, characterized in that (Item 14) The combining means corresponds to the specific deformation by combining the one deformation area corresponding to the specific deformation with the other deformation area corresponding to another deformation, and generates a new deformation area including the one deformation area and the other deformation area. The information processing apparatus according to any one of items 11 to 13. (Item 15) The combining means combines the one deformation area with the other deformation area according to a method selected by a user from two or more methods. The information processing apparatus according to any one of items 1 to 14. (Item 16) The information processing apparatus according to any one of items 1 to 15, further comprising receiving means for receiving designation of the one deformation area and the other deformation area. (Item 17) The receiving means receives designation of an area on an image of the structure, and specifies the deformation area in the area as the one deformation area and the other deformation area. The information processing apparatus according to item 16. (Item 18) The acquisition means further acquires information on a plurality of deformation lines in an image of the structure, each corresponding to a linearly spreading deformation in the structure. The receiving means specifies the deformation line passing through the largest number of the deformation areas among the plurality of deformation lines, and presents to the user, as an initial setting, the area set to include all the deformation areas on the specified deformation line. The information processing apparatus according to item 17. (Item 19) An information processing method performed by an information processing apparatus, a step of acquiring information on a deformation area in an image of the structure corresponding to a planar spreading deformation in the structure; a step of determining whether to combine the one deformation area with the other deformation area based on a positional relationship between the one deformation area and the other deformation area; A step of combining the one deformed area with the other deformed area based on the determination result by the determination means; An information processing method characterized by having the same. (Item 20) A program for causing a computer to function as the information processing apparatus according to any one of Items 1 to 18.

[0073] The present disclosure is not limited to the above embodiments, and various changes and modifications are possible without departing from its spirit and scope. Therefore, claims are attached to disclose the scope thereof.

Explanation of Signs

[0074] 100: Information processing apparatus, 211: Image management unit, 212: Image storage unit, 213: Image analysis unit, 214: Result storage unit, 215: Result management unit, 221: Display control unit, 222: Designation acquisition unit, 223: Determination unit, 224: Combination processing unit

Claims

1. An acquisition means for acquiring information on a deformed area in an image of the structure corresponding to a deformation spreading in a planar manner in the structure; A determination means for determining whether or not to combine the one deformed area with the other deformed area based on the positional relationship between one deformed area and another deformed area; A combining means for combining the one deformed area with the other deformed area based on the determination result by the determination means; An information processing apparatus comprising the above.

2. The acquisition means further acquires information on a deformed line in the image of the structure corresponding to a deformation spreading linearly in the structure, The determination means determines whether or not to combine the one deformed area with the other deformed area based on the positional relationship among the one deformed area, the other deformed area, and the deformed line. The information processing apparatus according to claim 1.

3. The determination means determines whether or not to combine the one deformed area with the other deformed area based on whether or not the one deformed area and the other deformed area exist on one of the deformed lines. The information processing apparatus according to claim 2.

4. The determination means determines whether or not to combine the one deformed area with the other deformed area based on whether or not the one deformed area and the other deformed area exist within a predetermined distance from one of the deformed lines. The information processing apparatus according to claim 2.

5. The deformed line corresponds to at least one of a crack and a linear mark in the structure. The information processing apparatus according to claim 2.

6. The combining means generates a new deformed area by combining the one deformed area with the other deformed area, The new deformed area includes the one deformed area, the other deformed area, and an area spreading along the deformed line between the one deformed area and the other deformed area. The information processing apparatus according to claim 2.

7. The new deformed area includes the one deformed area, the other deformed area, and an area defined by expanding the deformed line by a predetermined width in the width direction between the one deformed area and the other deformed area. The information processing apparatus according to claim 6, wherein the predetermined width is set according to a distance between a point defining an outer periphery of the one deformed area or the other deformed area and the deformation line.

8. The coupling means generates a new deformed area by coupling the one deformed area with the other deformed area, wherein the new deformed area includes the one deformed area, the other deformed area, and an area between the one deformed area and the other deformed area, The information processing apparatus according to claim 1, wherein the area between the one deformed area and the other deformed area is an area sandwiched between two lines connecting an outer periphery of the one deformed area and an outer periphery of the other deformed area.

9. The information processing apparatus according to claim 1, wherein the deformed area corresponds to an area in the structure where at least one of water leakage, peeling, efflorescence, rebar exposure, and rust juice has occurred.

10. The information processing apparatus according to claim 1, wherein the one deformed area and the other deformed area correspond to the same type of deformation.

11. The information processing apparatus according to claim 1, wherein the one deformed area and the other deformed area correspond to different types of deformation.

12. The information processing apparatus according to claim 11, wherein the determination means determines whether to couple the one deformed area with the other deformed area according to whether a type of deformation corresponding to the other deformed area is a predetermined type corresponding to a type of deformation corresponding to the one deformed area.

13. The information processing apparatus according to claim 11, wherein the determination means determines whether to couple the one deformed area with the other deformed area based on a degree of overlap between the one deformed area and the other deformed area.

14. The information processing apparatus according to claim 11, wherein the coupling means generates a new deformed area corresponding to the specific deformation and including the one deformed area and the other deformed area by coupling the one deformed area corresponding to the specific deformation with the other deformed area corresponding to another deformation.

15. The information processing apparatus according to claim 1, wherein the combining means combines the one deformed area with the other deformed area according to a method selected by a user from two or more methods.

16. The information processing apparatus according to claim 1, further comprising reception means for receiving designation of the one deformed area and the other deformed area.

17. The information processing apparatus according to claim 16, wherein the reception means receives designation of an area on an image of the structure and specifies the deformed area in the area as the one deformed area and the other deformed area.

18. The acquisition means further acquires information on a plurality of deformed lines in an image of the structure, each corresponding to a linearly spreading deformation in the structure, The information processing apparatus according to claim 17, wherein the reception means specifies a deformed line passing through the largest number of the deformed areas among the plurality of deformed lines, and presents to the user, as an initial setting, an area set to include all the deformed areas on the specified deformed line.

19. An information processing method performed by an information processing apparatus, comprising: a step of acquiring information on a deformed area in an image of the structure corresponding to a planar spreading deformation in the structure; a step of determining whether to combine the one deformed area with the other deformed area based on a positional relationship between the one deformed area and the other deformed area; a step of combining the one deformed area with the other deformed area based on the result of the determination. An information processing method characterized by comprising the above steps.

20. A program for causing a computer to function as the information processing apparatus according to any one of claims 1 to 18.

Images