Information processing device, information processing method and program

Abstract

To provide a technology that can properly grasp a state of deformation of an object.SOLUTION: An information processing device 100 identifies common parts and difference parts of first deformation data 201 and second deformation data 202 that is different from the first deformation data 201 of an object, and acquires third deformation data based on the common parts and difference parts identified by a difference determination unit 220, and changes the third deformation data based on the change instruction of the deformation correspondence between the first deformation data 201 and the second deformation data 202.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] A method has been proposed to detect defects such as cracks from images of the wall surface of a concrete structure (object) to be inspected.In this case, due to improvements in computer performance and detection performance, it has become possible to automatically detect defects from images.In addition, a method has been proposed to determine changes in condition such as the progression or disappearance of defects from images taken at different times.

[0003] Patent document 1 describes a technology that detects abnormalities using divided images of the surface of a relatively large structure (object) such as a concrete structure, and creates an abnormality diagram by synthesizing the abnormality detection results based on corresponding points when synthesizing the divided images.

[0004] Furthermore, Patent Document 2 describes a technology for determining changes in condition, such as the length or width of the deformation, by comparing first deformation data created from a first image taken at a different time with second deformation data created from a second image. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2019 / 021729 [Patent Document 2] JP 2019-211277 A Summary of the Invention [Problem to be solved by the invention]

[0006] The technology described in Patent Document 1 and Patent Document 2 does not take into consideration errors that may occur due to ambiguity that occurs when detecting anomalies or determining changes in the state of anomalies. For this reason, the conventional technology has an issue in that it is difficult to properly grasp the state of anomalies of an object.

[0007] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide a technology that can properly grasp the state of a deformation of an object. [Means for solving the problem]

[0008] One embodiment of an information processing device of the present disclosure has an identification means for identifying common parts and different parts of first deformation data of an object and second deformation data different from the first deformation data, an acquisition means for acquiring third deformation data based on the common parts and the different parts, and a modification means for modifying the third deformation data based on an instruction to modify the deformation correspondence relationship between the first deformation data and the second deformation data. Effect of the Invention

[0009] According to the present disclosure, it is possible to properly grasp the state of a deformation of an object. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a diagram illustrating an example of a software configuration of an information processing device according to an embodiment of the present disclosure. [Figure 3A] 3 is a diagram showing an example of a first deformation image shown in FIG. 2. FIG. [Figure 3B] 3 is a diagram showing an example of a second deformation image shown in FIG. 2. FIG. [Figure 4A] FIG. 3 is a diagram showing an example of first deformation data shown in FIG. 2. [Figure 4B] 3 is a diagram showing an example of second deformation data shown in FIG. 2. FIG. [Figure 5A]4B is a diagram illustrating a visualization of first difference determination data obtained by determining the change between the first deformation data shown in FIG. 4A as a reference and the second deformation data shown in FIG. 4B as a difference. [Figure 5B] 4B is used as a reference, and the second difference determination data is determined by determining the change between the first deformation data shown in FIG. 4A and the second difference determination data is visualized and drawn. FIG. [Figure 6] 5B. FIG. 5C is a diagram showing an example of a deformation diagram which is third deformation data generated from the first difference determination data shown in FIG. 5A and the second difference determination data shown in FIG. 5B. [Figure 7] FIG. 2 is a diagram showing an example of a deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. 1. [Figure 8A] FIG. 2 is a diagram showing a first display example of a deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. 1. [Figure 8B] 1. FIG. 4 is a diagram showing a second display example of the deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. [Figure 8C] FIG. 13 is a diagram showing a third display example of the deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. [Figure 8D] FIG. 13 is a diagram showing a fourth display example of the deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. [Figure 8E] FIG. 13 is a diagram showing a fifth display example of the deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. [Figure 8F] FIG. 13 is a diagram showing a sixth display example of the deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. [Figure 9] 1. FIG. 4 is a diagram showing an example of a candidate pattern of deformation corresponding relationships that can be displayed in a display area of ​​a deformation diagram confirmation and correction operation display screen displayed on the display output device of FIG. [Figure 10A] 4B is a diagram showing an example of the structure of a first deformation data table in which the first deformation data shown in FIG. 4A is stored. FIG. [Figure 10B] 4C is a diagram showing an example of the structure of a second deformation data table in which the second deformation data shown in FIG. 4B is stored. FIG. [Figure 11A]5B is a diagram showing an example of a first difference determination table that stores the data structure of the first difference determination data shown in FIG. 5A. FIG. [Figure 11B] 5C is a diagram showing an example of a second difference determination table that stores the data structure of the second difference determination data shown in FIG. 5B. FIG. [Figure 12] 10B is a diagram showing an example of the deformation data shown in FIG. 4A and FIG. 10A being enlarged and drawn. FIG. [Figure 13A] 11B is a diagram showing an example in which the difference determination data (deformation data) with the deformation ID "4117" is enlarged and drawn in the first difference determination table shown in FIG. 11A. FIG. [Figure 13B] 11C is a diagram showing an example in which the difference determination data (deformation data) with the deformation IDs "4218" and "4219" are enlarged and drawn in the second difference determination table shown in FIG. 11B. FIG. [Figure 14] FIG. 7 is a diagram showing an example of an enlarged depiction of the composite deformation data represented by the reference numerals 6115 to 6123 included in the deformation diagram shown in FIG. 6. [Figure 15] 7 is a diagram showing an example of a deformation diagram data table storing the data structure of the deformation diagram shown in FIG. 6. FIG. [Figure 16] FIG. 13 illustrates an example of a legend table according to the embodiment of the present disclosure. [Figure 17] 4B. FIG. 4C is a diagram showing an example of the arrangement in the same coordinate system of a first deformation recorded in the first deformation data shown in FIG. 4A and a second deformation recorded in the second deformation data shown in FIG. 4B. [Figure 18] 11 is a flowchart showing an example of a processing procedure of a deformation diagram generating / editing process included in an information processing method by an information processing device according to an embodiment of the present disclosure. [Figure 19] 18 is a flowchart showing an example of detailed processing procedures for determining the difference in step S1802 in FIG. [Figure 20] 18 is a flowchart showing an example of detailed processing procedures of deformation diagram generation processing in step S1803 of FIG. 18. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, a mode for carrying out the present disclosure (embodiments of the present disclosure) will be described with reference to the drawings. However, the present disclosure is not limited to the embodiments described below. In addition, although the embodiments of the present disclosure described below have multiple features, not all of these multiple features are necessarily essential, and these multiple features may be combined in any manner. Furthermore, in each drawing, the same or equivalent components are given the same reference numerals, and duplicated explanations are omitted as appropriate. Also, in each drawing. Some components that are not important for explanation are omitted.

[0012] In an embodiment of the present disclosure, for example, a computer device operates as an information processing device. In the embodiment of the present disclosure, a state change such as new occurrence, extension, widening, or non-detection due to poor image quality or disappearance due to repair is determined for the deformation of an object detected from images taken at different times. Furthermore, in the embodiment of the present disclosure, an example will be described in which a display means displays the possibility of an error in the deformation diagram, and an appropriate deformation diagram is created so that the error can be corrected.

[0013] In the embodiment of the present disclosure, the term "deformation" refers to cracks and the like that occur on the surface of an object due to damage, deterioration, or other factors of the object, such as a concrete structure such as a highway, a bridge, a tunnel, a dam, etc. Also, a "crack" refers to linear damage that has a starting point, an end point, a length, and a width and occurs on the surface of an object (for example, the wall surface of a structure) due to aging deterioration, the impact of an earthquake, etc.

[0014] 1 is a diagram showing an example of a hardware configuration of an information processing device 100 according to an embodiment of the present disclosure. In this embodiment, a computer device operates as the information processing device 100 as described above. In this case, the processing of the information processing device 100 may be realized by a single computer device, or may be realized by distributing each function related to the processing to multiple computer devices as necessary. In addition, the multiple computer devices in this case are connected to each other so as to be able to communicate with each other.

[0015] The information processing device 100 includes the following hardware components: a control unit 101, a non-volatile memory 102, a work memory 103, a storage device 104, an operation input device 105, a display output device 106, a network interface 107, and a system bus 108.

[0016] The control unit 101 includes a processor for arithmetic processing, such as a CPU or an MPU, which controls the entire information processing device 100. The non-volatile memory 102 is a ROM that stores programs and parameters executed by the processor of the control unit 101. Here, the program realizes the software configuration (FIG. 2) of the information processing device 100 described later, and causes the processor to execute each processing step shown in the flowchart (FIGS. 18 to 20) of the information processing method described later. The work memory 103 is a RAM that temporarily stores programs and data supplied from an external device or the like. The storage device 104 is an internal device such as a hard disk or a memory card built into the information processing device 100, or an external device such as a hard disk or a memory card detachably connected to the information processing device 100. The storage device 104 includes a memory card or a hard disk constituted by a semiconductor memory, a magnetic disk, or the like. The storage device 104 also includes a storage medium constituted by a disk drive that reads / writes data from / to optical disks such as DVDs and Blu-ray (registered trademark) Disks.

[0017] The operation input device 105 is an operation member such as a mouse, keyboard, or touch panel that receives operation input from a user, and outputs the operation input (instruction) from the user to the control unit 101. The display output device 106 is a display device (display means) such as a display or monitor composed of an LCD or an organic EL, and displays data held by the information processing device 100, data supplied from an external device, etc. The network interface 107 is communicably connected to a network such as the Internet or a LAN (Local Area Network). The system bus 108 includes an address bus, a data bus, and a control bus that connect the hardware components (101 to 107) of the information processing device 100 so as to enable data exchange.

[0018] The non-volatile memory 102 stores an OS (operating system), which is basic software executed by the control unit 101, and applications that cooperate with the OS to realize applied functions. In this embodiment, the non-volatile memory 102 also stores an application that enables the information processing device 100 to create a deformation diagram, which will be described later.

[0019] The processing of the information processing device 100 of this embodiment is realized by reading software provided by an application. The application has software for utilizing basic functions of the OS installed in the information processing device 100. The OS of the information processing device 100 may have software for realizing the processing of this embodiment.

[0020] FIG. 2 is a diagram illustrating an example of a software configuration of an information processing device 100 according to an embodiment of the present disclosure. The information processing device 100 has, as processing target data, first deformation data 201 and second deformation data 202 of an object, and a first deformation image 211 and a second deformation image 212 of the object. Here, in the embodiment of the present disclosure, the first deformation data 201 and the second deformation data 202 of the object are different deformation data. For example, the first deformation data 201 and the second deformation data 202 of the object are deformation data acquired at different times for the object, and for example, the second deformation data 202 was acquired later in time than the first deformation data 201. In addition, the first deformation image 211 of the object is an image corresponding to the first deformation data 201, and the second deformation image 212 of the object is an image corresponding to the second deformation data 202. The information processing device 100 has the following software components: an input unit 210, a difference determination unit 220, a deformation diagram creation unit 230, a legend recording unit 240, a fixed common part detection unit 250, a deformation diagram editing operation unit 260, a deformation diagram recording unit 270, and a display data generation unit 280.

[0021] The input unit 210 receives the first deformation data 201, the second deformation data 202, the first deformation image 211, and the first deformation image 212, which are data to be processed.

[0022] The difference determination unit 220 compares the first deformation data 201 and the second deformation data 202 by matching the positional identity of the deformation records stored in the first deformation data 201 and the second deformation data 202 of the object input to the input unit 210 as a criterion. Then, the difference determination unit 220 performs a process to identify common parts and different parts between the first deformation data and the second deformation data of the object based on the result of the comparison, and determines these differences. Here, in the embodiment of the present disclosure, the difference determination unit 220 that performs the process to identify common parts and different parts between the first deformation data and the second deformation data of the object constitutes an "identification means."

[0023] The deformation diagram creation unit 230 performs a process of generating and acquiring a deformation diagram, which is the third deformation data, by combining the common parts and the difference parts of the first deformation data and the second deformation data of the object obtained as a result of the difference determination by the difference determination unit 220. For example, the deformation diagram creation unit 230 generates and acquires a deformation diagram by combining the difference determination data of the second deformation data 202 relative to the first deformation data 201 and the difference determination data of the first deformation data 201 relative to the second deformation data 202, which are obtained by the difference determination unit 220. Here, in the embodiment of the present disclosure, the deformation diagram creation unit 230, which performs a process of generating and acquiring a deformation diagram, which is the third deformation data, constitutes an "acquisition means."

[0024] The legend recording unit 240 holds information defining the recording format of the deformation diagram, which is the third deformation data generated by the deformation diagram creation unit 230, and is referenced when the deformation diagram, which is the third deformation data, is generated by the deformation diagram creation unit 230.

[0025] The immovable common part detection unit 250 performs a process of detecting drawn objects other than visible deformations (common parts not including deformations (immovable common parts)) that exist in common between the first deformation image 211 and the second deformation image 212 input to the input unit 210. The immovable common part detection unit 250 that performs a process of detecting common parts not including deformations (immovable common parts) constitutes a "detection means."

[0026] The deformation diagram editing operation unit 260 displays the deformation diagram, which is the third deformation data acquired by the deformation diagram creation unit 230, on the display output device 106, which is a display means, via the display data generation unit 280. In this way, the deformation diagram editing operation unit 260 provides a function that enables a portion that may be erroneous to be displayed and enables a user to select a correct deformation correspondence relationship between the first deformation data 201 and the second deformation data 202.

[0027] The deformation diagram recording unit 270 stores the deformation diagram edited (including corrections and changes) by the deformation diagram editing operation unit 260.

[0028] The display data generating unit 280 generates display data based on the deformation diagram edited (including correction and modification) by the deformation diagram editing operation unit 260, and performs processing to display this on the display output device 106, which is a display means.

[0029] FIG. 3A is a diagram showing an example of the first deformed image 211 shown in FIG. 2. In FIG. 3A, the first deformed image 211 shown in FIG. 2 is illustrated as a first deformed image 3100. FIG. 3B is a diagram showing an example of the second deformed image 212 shown in FIG. 2. In FIG. 3B, the second deformed image 212 shown in FIG. 2 is illustrated as a second deformed image 3200. The first deformed image 3100 shown in FIG. 3A and the second deformed image 3200 shown in FIG. 3B may be, for example, an image depicting the entire wall surface of a structure (object) to be inspected or an image depicting a part of the wall surface. In this embodiment, the first deformed image 3100 shown in FIG. 3A and the second deformed image 3200 shown in FIG. 3B show examples of images captured of the inner wall surface of a road tunnel, which is the object. More specifically, the first deformed image 3100 shown in FIG. 3A and the second deformed image 3200 shown in FIG. 3B show partial images divided into spans, which are units of the lining of the inner wall of the road tunnel, which is the object. The areas 3101, 3102, and 3103 of the first deformed image 3100 shown in FIG. 3A are schematic representations of installations such as lighting fixtures installed on the inner wall lining surface of the road tunnel, which is the object. The areas 3101, 3102, and 3103 shown in FIG. 3A are respectively representations of fixed common parts, which are the same installations as the areas 3201, 3202, and 3203 shown in FIG. 3B. The point 3104 shown in FIG. 3A is a point indicating the origin coordinates (0,0) of the first deformed image 3100, and the point 3204 shown in FIG. 3B is a point indicating the origin coordinates (0,0) of the second deformed image 3200. Furthermore, deformations 3110 to 3117 shown in FIG. 3A and deformations 3210 to 3220 shown in FIG. 3B each represent a crack deformation that has occurred on the inner wall lining surface of the target object, that is, a road tunnel.

[0030] FIG. 4A is a diagram showing an example of the first deformation data 201 shown in FIG. 2. In FIG. 4A, the first deformation data 201 shown in FIG. 2 is shown as the first deformation data 4100. Specifically, the first deformation data 4100 shown in FIG. 4A is a diagram in which deformation data obtained by detecting only the deformed portion from the first deformation image 3100 shown in FIG. 3A is visualized and drawn. In the first deformation data 4100 shown in FIG. 4A, the crack deformations 3110 to 3117 shown in FIG. 3A are recorded as deformation data 4110 to 4117, respectively. Also, the point 4104 shown in FIG. 4A corresponds to the point 3104 shown in FIG. 3A.

[0031] FIG. 4B is a diagram showing an example of the second deformation data 202 shown in FIG. 2. In FIG. 4B, the second deformation data 202 shown in FIG. 2 is illustrated as the second deformation data 4200. Specifically, the second deformation data 4200 shown in FIG. 4B is a diagram in which deformation data obtained by detecting only the deformation portion from the second deformation image 3200 shown in FIG. 3B is visualized and drawn. In the second deformation data 4200 shown in FIG. 4B, the crack deformations 3210 to 3220 shown in FIG. 3B are recorded as deformation data 4210 to 4220, respectively. Also, the point 4104 shown in FIG. 4A corresponds to the point 3104 shown in FIG. 3A. Also, the point 4204 shown in FIG. 4B corresponds to the point 3204 shown in FIG. 3B.

[0032] FIG. 10A is a diagram showing an example of the structure of a first deformation data table 1000 that stores the first deformation data 4100 shown in FIG. 4A. As shown in FIG. 10A, the first deformation data table 1000 records a deformation ID 1001, a section number 1002, section vertex coordinates 1003, a line width 1004, and a section length 1005 for the deformation data 4110 to 4117 shown in FIG. 4A. The deformation ID 1001 is information that uniquely identifies each deformation data. The section number 1002 is information that indicates the section number of the deformation data. The section vertex coordinates 1003 is information that indicates the coordinates of two vertices that are the endpoints of the section. The line width 1004 is information that indicates the line width of the section. The section length 1005 is information that indicates the length of the section. In the first deformation data table 1000 shown in FIG. 10A, the line width 1004 and the section length 1005 store information on the actual distance (millimeters or meters) calculated from the image resolution. In the first deformation data table 1000 shown in FIG. 10A, each deformation data is input by a user tracing on an image with a tablet or the like, automatically generated by image analysis processing or the like, or input by a combination of these. In addition, the image analysis processing may be performed using a learning model created by machine learning and deep learning of AI (artificial intelligence). In addition, the measurement or estimation of the line width 1004 may also be performed using a learning model of machine learning and deep learning.

[0033] FIG. 12 is a diagram showing an example of an enlarged depiction of the deformation data 4110 shown in FIG. 4A and FIG. 10A. A crack deformation is expressed as vector data and is composed of vertices and line segments connecting the vertices. In FIG. 12, the deformation data 4110 is composed of 10 vertices and 9 section line segments which are line segments connecting the vertices. Each vertex shown in FIG. 12 is represented by X and Y coordinates in an image coordinate system with point 3104 in FIG. 3A (point 4104 in FIG. 4A as well) as the origin coordinate (0,0). The end point 1201 shown in FIG. 12 has an X coordinate value of X1000_0. The Y coordinate value of the end point 1201 is Y1000_0, and the other end point 1202 is X1000 4A and 10A, the Y coordinate value is Y1000_9. The same can be applied to the other deformation data 4111 to 4117 shown in FIG. 4A and FIG. 10A in the same manner as the deformation data 4110 described above.

[0034] Fig. 10B is a diagram showing an example of the structure of the second deformation data table 1010 storing the second deformation data 4200 shown in Fig. 4B. As shown in Fig. 10B, the second deformation data table 1010 records the deformation ID 1011, the section number 1012, the section vertex coordinates 1013, the line width 1014, and the section length 1015 for the deformation data 4210 to 4220 shown in Fig. 4B. The deformation ID 1011, the section number 1012, the section vertex coordinates 1013, the line width 1014, and the section length 1015 shown in Fig. 10B are respectively the same as the deformation ID 1001, the section number 1002, the section vertex coordinates 1003, the line width 1004, and the section length 1005 shown in Fig. 10A. The deformation data with the deformation ID 1011 of "4210" shown in FIG. 10B is made up of (V20+1) vertices and partial sections in (V20) section segments.

[0035] 5A is a diagram in which the first difference determination data 5100, which is determined as a difference between the first deformation data 4100 shown in FIG. 4A and the second deformation data 4200 shown in FIG. 4B, is visualized and drawn. Also, FIG. 5B is a diagram in which the second difference determination data 5200, which is determined as a difference between the first deformation data 4100 shown in FIG. 4A and the second difference determination data 5200 shown in FIG. 4B, is visualized and drawn. The first difference determination data 5100 shown in FIG. 5A and the second difference determination data 5200 shown in FIG. 5B are processed, for example, by the difference determination unit 220.

[0036] In the first difference determination data 5100 shown in FIG. 5A and the second difference determination data 5200 shown in FIG. 5B, the result determined based on whether or not there is a corresponding deformation section for each partial section of the deformation data is represented by the width of the solid line. Specifically, in FIG. 5A and FIG. 5B, a thin line represents "no difference" and a thick line represents "difference". For example, the reference numerals 5115, 5116, 5118, 5122, and 5126 in FIG. 5A are drawn with thick lines, and therefore are partial sections in which differences occur (differences exist). The drawing style for determining the presence or absence of differences may be another form that can be displayed and identified, such as a line type or line color. In addition, the vertices represented by the reference numerals 5119, 5121, 5123, and 5125 in FIG. 5A represent the end points of the sections in which differences occur.

[0037] FIG. 11A is a diagram showing an example of a first difference determination table 1100 storing the data structure of the first difference determination data 5100 shown in FIG. 5A. The first difference determination data 5100 shown in FIG. 5A is based on the first deformation data 4100 shown in FIG. 4A, so the first difference determination table 1100 shown in FIG. 11A stores the deformation ID 1101 in the first deformation data 4100 shown in FIG. 4A. In addition to the deformation ID 1101, the first difference determination table 1100 shown in FIG. 11A records a section number 1102, section vertex coordinates 1103, line width 1104, section length 1105, width increase / decrease 1106, and correspondence ID 1107. Here, the width increase / decrease 1106 is information indicating the width increase / decrease (difference) of the section. The correspondence ID 1107 is information indicating the deformation ID in the deformation data determined to be at the same position.

[0038] Fig. 11B is a diagram showing an example of a second difference determination table 1110 storing the data structure of the second difference determination data 5200 shown in Fig. 5B. Since the second difference determination data 5200 shown in Fig. 5B is based on the second deformation data 4200 shown in Fig. 4B, the second difference determination table 1110 shown in Fig. 11B stores the deformation ID 1111 in the second deformation data 4200 shown in Fig. 4B. In addition to the deformation ID 1111, the second difference determination table 1110 shown in Fig. 11B records a section number 1112, section vertex coordinates 1113, line width 1114, section length 1115, width increase / decrease 1116, and corresponding ID 1117.

[0039] In the first difference determination table 1100 of FIG. 11A, if the section is the same as the section vertex coordinates 1003 in the first deformation data table 1000, the line width 1104 and the section length 1105 are the same as the line width and the section length of the same section in the first deformation data table 1000, respectively. Also, in the first difference determination table 1100 shown in FIG. 11A, if the section vertex coordinates are different, the average value of the line width values ​​of the adjacent sections is stored as the line width 1104. Also, in the first difference determination table 1100 shown in FIG. 11A, if there is no section that matches the corresponding deformation data indicated by the correspondence ID 1107, "no correspondence" is stored in the width increase / decrease 1106 and the correspondence ID 1107. Also, in FIG. 11A, if there is a section that matches the corresponding deformation data indicated by corresponding ID 1107, if the value obtained by subtracting the value of line width 1114 from line width 1104 is negative, "-" (minus) is stored; if it is 0, "0" (zero) is stored; and if it is positive, "+" (plus) is stored.

[0040] A second difference determination table 1110 shown in Fig. 11B has the same configuration as the first difference determination table 1100 shown in Fig. 11A described above. In the second difference determination table 1110 shown in Fig. 11B, width increase / decrease 1116 stores an increase / decrease value determined by subtracting the value of line width 1104 from line width 1114.

[0041] A first difference determination table 1100 shown in FIG. 11A and a second difference determination table 1110 shown in FIG. 11B store all of the difference determination data graphically represented in FIGS. 5A and 5B, respectively.

[0042] FIG. 13A is a diagram showing an example of the difference determination data represented by the reference numerals 5120 to 5126 in FIG. 5A, which are enlarged and drawn. Specifically, FIG. 13A is a diagram showing an example of the difference determination data (deformation data) of the deformation ID 1101 of "4117" in the first difference determination table 1100 shown in FIG. 11A, which is enlarged and drawn. As shown in the first difference determination table 1100 in FIG. 11A, the difference determination data of the deformation ID 1101 of "4117" is composed of 7 vertices and 6 sections. The vertices P0, P1, P2, and P3 shown in FIG. 13A are vertices recorded in the difference determination data (deformation data) of the deformation ID 1101 of "4117", and the vertices C1, C2, and C3 are vertices that specify the corresponding corresponding section. The section connected by the vertices C1-C2 shown in FIG. 13A and the section connected by the vertices C3-P3 shown in FIG. 13A are the corresponding corresponding sections.

[0043] FIG. 13B is a diagram showing an example of the difference determination data (deformation data) of the deformation IDs 1111 of "4218" and "4219" enlarged and drawn in the second difference determination table 1110 shown in FIG. 11B. The difference determination data of the deformation ID 1111 of "4218" shown in FIG. 13B is drawn in thin lines as a determination that the deformation ID matches a part of 4117. Moreover, the difference determination data of the deformation ID 1111 of "4219" shown in FIG. 13B is composed of four vertices and three sections. In the difference determination data of the deformation ID 1111 of "4219" shown in FIG. 13B, the section connected by vertices P6-C4 is the section whose deformation ID matches 4117 and is drawn in thin lines, and the two sections connected by vertices C4-P7-P8 are drawn in thick lines as difference sections.

[0044] In the example of the difference determination data in which the deformation ID 1101 shown in FIG. 11A is "4110", it is shown that the data stored in the second deformation data table 1010 shown in FIG. 10B has the deformation ID 1011 of "4210". In the example of the difference determination data in which the deformation ID 1101 shown in FIG. 11A is "4110", the value of the width increase / decrease 1106 is "0", so that there is no increase or decrease in width and they match. The first difference determination table 1100 shown in FIG. 11A is a difference determination result only for the section data recorded in the first deformation data 4100 in FIG. 4A, and data recorded only in the second deformation data 4200 in FIG. 4B is not stored. Similarly, the second difference determination table 1110 shown in FIG. 11B is a difference determination result only for the section data recorded in the second deformation data 4200 in FIG. 4B, and data recorded only in the first deformation data 4100 in FIG. 4A is not stored.

[0045] FIG. 6 is a diagram showing an example of a deformation diagram (6100) which is the third deformation data generated from the first difference determination data 5100 shown in FIG. 5A and the second difference determination data 5200 shown in FIG. 5B. In the deformation diagram (6100), the classification legend of the deformation is not the presence or absence of a difference, but the presence or absence of a deformation progression. The deformation diagram (6100) which is the third deformation data shown in FIG. 6 has the state of the deformation progression of the first deformation data 201 and the second deformation data 202 as a legend classification shown in a dotted frame. In the deformation diagram (6100) shown in FIG. 6, a deformation determined to be "not progressing" is drawn with a thin solid line, and a deformation determined to be "progressing" is drawn with a thick solid line. In addition, in the deformation diagram (6100) shown in FIG. 6, a deformation determined to be changing in the direction of improvement is distinguished from the presence or absence of a deformation progression as a "difference to be confirmed" and drawn with a dotted line. Here, the change in the deformation direction means that the deformation has disappeared or the extent of the deformation has decreased. It is usually impossible for a deformation that has occurred to disappear or decrease naturally. Therefore, the user is allowed to determine whether the result is correct, that the deformation has disappeared after repair work has been carried out, or whether a deformation that should have been detected has been lost due to a defect in the AI ​​deformation detection. As with the display legend for the difference determination data, the drawing style of the deformation legend in the deformation diagram (6100) may be in another form that can be displayed and identified, such as a line type or line color. In addition, deformations that require special attention, such as "deformation is progressing" or "differences that need to be checked", may be highlighted.

[0046] Fig. 14 is a diagram showing an example of an enlarged drawing of the composite deformation data represented by the reference symbols 6115-6123 included in the deformation diagram (6100) shown in Fig. 6. The reference symbols P0-P8 and the reference symbols C1-C4 in Fig. 14 correspond to the reference symbols in Fig. 13A and Fig. 13B. In Fig. 14, the reference symbols P0-P8 are vertices constituting the deformation data to be synthesized, and the reference symbols C1-C4 are vertices added to define partial matching intervals in the difference determination data.

[0047] FIG. 15 is a diagram showing an example of a deformation diagram data table 1500 that stores the data structure of the deformation diagram (6100) shown in FIG. 6. The deformation diagram data table 1500 stores a deformation ID 1501, a section number 1502, section vertex coordinates 1503, a line width 1504, and a section length 1505 that correspond to the deformation data recorded in FIG. 5A and FIG. 5B. Furthermore, the deformation diagram data table 1500 stores a deformation legend 1506 that determines whether or not a deformation is progressing, and a corresponding ID 1507 in the deformation data to be compared. For example, for data with a deformation ID 1501 of 4210 and section numbers 1502 of 1 to 3, the corresponding ID 1507 is "no correspondence" and the deformation legend is "deformation is progressing." For this reason, the data with deformation ID 1501 of 4210 and section number 1502 of 1 to 3 corresponds to reference number 6101 in Figure 6, which is a new deformation section that is not found in the deformation data to be compared but is found to have occurred in the deformation data to be compared. On the other hand, the data with deformation ID 1501 of 4210 and section number 1502 of 4 has corresponding ID 1507 of "4110." For this reason, the data with deformation ID 1501 of 4210 and section number 1502 of 4 corresponds to reference number 6103 in Figure 6, which is a deformation section of "no deformation progression" with no differences found in the deformation data to be compared.

[0048] FIG. 18 is a flowchart showing an example of a processing procedure of a deformation diagram generating / editing process included in the information processing method by the information processing device 100 according to the embodiment of the present disclosure.

[0049] In this embodiment, the input unit 210 is input with a first deformation image 211 of the object taken at different times in the past, the first deformation data 201 created from this image, and a second deformation image 212 taken most recently, and the second deformation data 202 created from this image. The first deformation data 201 and the second deformation data 202 are data obtained by, for example, an AI (artificial intelligence) performing deformation detection from the first deformation image 211 and the second deformation image 212, respectively. Then, the difference determination unit 220 identifies common parts and different parts between the first deformation data 201 obtained in the past and the second deformation data 202 obtained most recently after the past. Then, the deformation diagram creation unit 230 combines the common parts and different parts between the first deformation data 201 and the second deformation data 202 of the object identified by the difference determination unit 220 to generate and acquire a deformation diagram, which is the third deformation data. Thereafter, the deformation diagram editing operation unit 260 displays the deformation diagram, which is the third deformation data acquired by the deformation diagram creation unit 230, on the display output device 106, which is a display means, via the display data generation unit 280, and performs editing.

[0050] First, in step S1801 of FIG. 18, the input unit 210 launches a deformation diagram generation application (not shown) and inputs the first deformation data 201, the second deformation data 202, the first deformation image 211, and the second deformation image 212 as data to be processed.

[0051] 18, the difference determination unit 220 performs a difference determination process to identify common parts and different parts between the first deformation data 201 and the second deformation data 202 by referring to the first deformation image 211 and the second deformation image 212. At this time, the difference determination unit 220 creates, for example, a first difference determination table 1100 and a second difference determination table 1110 in the work memory 103.

[0052] 18, the deformation diagram creation unit 230 synthesizes the common parts and the difference parts of the first deformation data 201 and the second deformation data 202 of the object to generate and obtain a deformation diagram, which is the third deformation data. At this time, the deformation diagram creation unit 230 creates in the work memory 103 a synthesized deformation diagram data table 1500 by referring to the first difference determination table 1100 and the second difference determination table 1110 created in the work memory 103, for example.

[0053] Next, in step S1804 in FIG. 18, the deformation diagram editing operation unit 260 displays an editable user interface and the deformation diagram data table 1500 created in the work memory 103 on the display output device 106 via the display data generating unit 280. At this time, the deformation diagram editing operation unit 260 may display a deformation diagram based on the deformation diagram data table 1500 on the display output device 106. Thereafter, the deformation diagram editing operation unit 260 updates the deformation diagram data table 1500 according to the user's operation instructions of confirmation, correction, and selection. Also, according to the user's save instruction, the deformation diagram recording unit 270 saves the deformation diagram data table 1500 in the storage device 104. Also, according to the user's edit end instruction, the deformation diagram editing operation unit 260 ends the process of the flowchart related to the deformation diagram generation / editing process shown in FIG. 18.

[0054] FIG. 19 is a flowchart illustrating an example of detailed processing procedures of the difference determination process in step S1802 of FIG.

[0055] First, in step S1901 of FIG. 19, the difference determining unit 220 inputs the data of the first deformed image 211 and the data of the second deformed image 212 stored in the work memory 103 as deformed image data to be processed.

[0056] Next, in step S1902 of FIG. 10, for example, the immovable common part detection unit 250 detects the position of the immovable common part drawn in common in the data of the first deformed image 211 and the data of the second deformed image 212. In this embodiment, as an immovable object that becomes an immovable common part, a rectangular object other than the deformed area recorded in the deformed image is detected as an immovable object candidate. This is because rectangular features can be seen in illuminators and signs installed on the inner wall lining surface of the target object, the tunnel. In this rectangle detection, a contour line is extracted from the first deformed image 211 by a Hough transform or a Sobel filter, and a combination of lines forming a rectangular area is selected. Then, a template matching search is performed on the second deformed image 212 using the selected rectangular area as a pattern, and the object closest to the rectangular area set as the pattern among the matching results is determined as an immovable object. In addition, the vertices of the rectangle are set as a first fixed point and a second fixed point for the first deformed image 211 and the second deformed image 212, respectively. For example, rectangular regions 3101, 3102, and 3103 are detected as immovable objects in a first deformed image 3100 (211) shown in Fig. 3A, and the upper left vertex of rectangular region 3103 is set as a first fixed point. Similarly, rectangular regions 3201, 3202, and 3203 are detected as immovable objects in a second deformed image 3200 (212) shown in Fig. 3B. Then, the upper left vertex of rectangular region 3203, which can be estimated as an immovable object in the same position as region 3103 of the immovable object, is set as a second fixed point.

[0057] 19, for example, the difference determination unit 220 calculates the relative distance between the first fixed point and the second fixed point set in step S1902 as an offset value. Here, the offset value is obtained as the difference ΔX between the X coordinate values ​​and the difference ΔY between the Y coordinate values.

[0058] Next, in step S1904 in Fig. 19, for example, the difference determination unit 220 corrects the coordinate values ​​of the first deformation data table 1000 shown in Fig. 10A by adding the offset value (ΔX, ΔY) calculated in step S1903. As a result, even if there is a misalignment in the shooting range between the first deformation image 211 and the second deformation image 212, the position coordinates on the inner wall lining surface of the target tunnel will match.

[0059] In the difference determination process by the difference determination unit 220, one of two different data is fixed as reference data and the other is used as variable data to determine the difference, so it is determined whether the first deformation data 201 or the second deformation data 202 will be used as the reference data.

[0060] 19, the difference determination unit 220 sets the first deformation data 201 as reference data for the difference determination process. When the first deformation data 201 is set, the first deformation data table 1000 shown in FIG 10A is also set.

[0061] Next, in step S1906 of FIG. 19, the difference determination unit 220 starts a loop for processing all the deformation IDs 1001 recorded in the first deformation data table 1000 set in step S1905.

[0062] Next, in step S1907 of FIG. 19, the difference determination unit 220 starts a loop for processing all sections with section numbers 1002 of the deformation data having the same deformation ID 1001.

[0063] Next, in step S1908 of FIG. 19, the difference determination unit 220 searches whether the section line segment indicated by the section vertex coordinates 1003 matches the second deformation data 202 on the opposite side, and obtains the deformation ID of the second deformation data having the matching section line segment. Here, the coordinate correction process in step S1904 should roughly match the coordinates of the deformation data recorded at the same position. However, due to recording errors due to differences in the deformation recording method and detection errors that occur in the case of deformation detection by AI, a tolerance range is set to determine whether they are recorded at the same position. Here, the width of the tolerance range is AW. A rectangular section is formed by widening the section line segment of the first deformation data 201 by AW on both sides in the vertical direction, and by determining whether the section of the second deformation data 202 exists within this rectangular section, it is possible to determine the same position while allowing for errors.

[0064] On the other hand, in addition to image position shifts due to differences in the shooting range, a case where a single deformation image is generated by combining multiple images shot separately will be described below. In this case, if the shooting conditions (image sensor, lens angle of view, shooting distance to the inner wall lining surface) change between the shooting of the first deformation image 211 and the shooting of the second deformation image 212, local deviations may occur in the combined image. Therefore, the allowable range AW for searching for the same deformation between two deformation data can be set to a large value as shown in Fig. 17 described later in order to improve the capture rate of the same deformation.

[0065] FIG. 17 is a diagram showing an example of the arrangement in the same coordinate system of the first deformations 4114, 4115, and 4116 recorded in the first deformation data 4100 shown in FIG. 4A and the second deformations 4216 and 4217 recorded in the second deformation data 4200 shown in FIG. 4B. The dotted frames R1, R2, and R3 shown in FIG. 17 are rectangular sections when searching for a corresponding deformation based on the second deformation 4216, and the length of the arrow is AW. Since the first deformations 4114, 4115, and 4116 are also included inside the rectangular dotted frames R1, R2, and R3 indicating the correspondence allowable range of the second deformation 4216, it is determined that all of them may correspond to the second deformation 4216. In such a case, a combination candidate of possible corresponding deformations is created, and the corresponding deformation is determined by an evaluation value obtained from the distance from the reference deformation, the deformation section length, and the section width value. The combination candidates that are not selected are stored in the work memory 103 in the same format as the difference determination table. In the case of FIG. 17, the combination candidates of the corresponding deformations stored in the work memory 103 are 10 patterns shown in FIG. 9(a) to FIG. 9(j) described later.

[0066] Here, we return to the explanation of FIG. When the process of step S1908 in FIG. 19 is completed, the process proceeds to step S1909. When proceeding to step S1909 in FIG. 19, the difference determination unit 220 registers the deformation ID of the second deformation data 202 determined to be the same position as deformation correspondence data in the corresponding ID 1107 of the first difference determination table 1100. The difference determination unit 220 transcribes the data of the first deformation data table 1000 in FIG. 10A, which is the reference, for the deformation ID 1101, section number 1102, section vertex coordinates 1103, line width 1104, and section length 1105 of the first difference determination table 1100 shown in FIG. 11A. Then, the difference determination unit 220 compares the line width 1014 of the matching section of the second deformation data 202 indicated by the corresponding ID with the line width 1004 of the first deformation data 201, which is the reference, and registers the width increase / decrease 1106 in the first difference determination table 1100 shown in FIG. 11A. In the width increase / decrease 1106 in FIG. 11A, for example, if the value obtained by subtracting line width 1014 from line width 1004 is negative, then "-" (minus) is registered; if it is "0", then "0" is registered; if it is positive, then "+" (plus) is registered; and if a corresponding ID cannot be obtained and a comparison operation cannot be performed, then "no correspondence" is recorded.

[0067] 19, the difference determination unit 220 determines whether or not the processing of all sections for the same abnormality ID has been completed. If the result of this determination is that the processing of all sections for the same abnormality ID has not yet been completed, an unprocessed section is set, and the processing from step S1907 onwards is performed.

[0068] Also, if the result of the determination in step S1910 in FIG. 19 is that processing for all sections for the same abnormality ID has been completed, the process proceeds to step S1911. 19, the difference determination unit 220 determines whether or not the processing of all the abnormality IDs has been completed. If the result of this determination is that the processing of all the abnormality IDs has not yet been completed, an unprocessed abnormality ID is set, and the processing from step S1906 onward is performed.

[0069] Also, if the result of the determination in step S1911 in FIG. 19 is that the processing of all the abnormality IDs has been completed, the process proceeds to step S1912. When the process proceeds to step S1912 in FIG. 19, the difference determining unit 220 determines whether or not the second deformation data 202 has been processed.

[0070] As a result of the determination in step S1912 in FIG. 19, if the second deformation data 202 has not been processed (S1912 / N), the process proceeds to step S1913. Proceeding to step S1913 in Fig. 19, the difference determination unit 220 sets the second deformation data 202 as reference data for the difference determination process. When the second deformation data 202 is set, the second deformation data table 1010 shown in Fig. 10B is also set. Thereafter, for steps S1906 to S1911, processing is performed in which the second deformation data 202 and the second deformation data table 1010 are applied instead of the above-mentioned first deformation data 201 and first deformation data table 1000, respectively.

[0071] 19, if the second deformation data 202 has been processed (S1912 / Y), a first difference determination table 1100 for the first deformation data 201 is generated in the work memory 103. Similarly, a second difference determination table 1110 for the second deformation data 202 is generated in the work memory 103. Thereafter, the processing of the flowchart shown in FIG. 19 ends.

[0072] FIG. 20 is a flowchart showing an example of detailed processing procedures of the deformation diagram generation processing in step S1803 of FIG.

[0073] First, in step S2001 in Fig. 20, the deformation diagram creation unit 230 sets the second difference determination table 1110 for the second deformation data 202 as difference determination data that is the basis for generating the deformation diagram. The purpose of the deformation diagram generation process in step S1803 in Fig. 18 is to improve the accuracy of the second deformation diagram of the second deformation data 201 detected from the second deformation image 212, which is the most recently captured image.

[0074] Next, in step S2002 of FIG. 20, the deformation diagram creation unit 230 starts a loop for processing all deformation IDs 1111 recorded in the second difference determination table 1110 set in step S2001.

[0075] Next, in step S2003 of FIG. 20, the deformation diagram creation unit 230 starts a loop for processing all sections with section numbers 1112 of the deformation data having the same deformation ID 1111.

[0076] Next, in step S2004 in FIG. 20, the deformation diagram creating unit 230 determines whether or not there is a corresponding ID 1117 for the section to be processed.

[0077] If the result of the determination in step S2004 in FIG. 20 is that there is a corresponding ID 1117 for the section to be processed (S2004 / Y), that is, if a deformation ID corresponding to the corresponding ID 1117 for the section to be processed is registered, the process proceeds to step S2005. When proceeding to step S2005 in FIG. 20, the deformation diagram creation unit 230 searches and collates the corresponding section data of the corresponding first deformation ID, and obtains the value of the width increase / decrease 1106. FIG. 16 illustrates an embodiment of the present disclosure, and is a diagram illustrating an example of a legend table 1600. The legend table 1600 illustrated in FIG. 16 stores a difference determination table type 1601, an increase / decrease width 1602, a correspondence existence / non-existence 1603, and a judgment classification 1604. The deformation diagram creation unit 230 collates the legend table 1600 illustrated in FIG. 16 with the value of the width increase / decrease 1106 under the condition that there is a corresponding ID for the first difference determination table 1100, and determines the judgment classification 1604 of the legend table 1600 illustrated in FIG. 16. For example, if the value of the width increase / decrease 1106 is "0", the judgment classification 1604 is determined to be "no deformation progress". The deformation diagram creating unit 230 deletes the data of the corresponding section in the first difference determination table 1100 for which the determination classification 1604 has been determined so as not to be referred to again.

[0078] 15. Next, in step S2006 in FIG. 20, the deformation diagram creating unit 230 registers the section data of the second difference determination table 1110 to be processed in the deformation diagram data table 1500 shown in FIG.

[0079] Also, if the result of the determination in step S2004 in FIG. 20 is that there is no corresponding ID 1117 for the section to be processed (S2004 / N), that is, if the corresponding ID 1117 for the section to be processed is "no correspondence", the process proceeds to step S2007. Proceeding to step S2007 in Fig. 20, the deformation diagram creation unit 230 interprets this as a newly occurring deformation that does not exist in the first deformation data 201, and determines the judgment classification 1604 in the legend table 1600 shown in Fig. 16 to be "deformation progressing." Then, the deformation diagram creation unit 230 registers the section data in the deformation diagram data table 1500 shown in Fig. 15 as "deformation progressing."

[0080] When the process of step S2006 in FIG. 20 is completed, or when the process of step S2007 in FIG. 20 is completed, the process proceeds to step S2008. 20, the deformation diagram creation unit 230 judges whether or not the processing of all sections for the same deformation ID has been completed. If the result of this judgment is that the processing of all sections for the same deformation ID has not yet been completed, an unprocessed section is set and the processing from step S2003 onwards is carried out.

[0081] Also, if the result of the determination in step S2008 in FIG. 20 is that processing for all sections for the same abnormality ID has been completed, the process proceeds to step S2009. 20, the deformation diagram creation unit 230 judges whether or not the processing of all deformation IDs has been completed. If the result of this judgment is that the processing of all deformation IDs has not been completed, an unprocessed deformation ID is set and the processing from step S2002 onward is performed.

[0082] Also, if the result of the determination in step S2009 in FIG. 20 is that the processing of all the abnormality IDs has been completed, the process proceeds to step S2010. 20, the deformation diagram creation unit 230 sets the first difference determination table 1100 for the first deformation data 201 as the difference determination data that is the basis for generating the deformation diagram. This is to verify whether the first deformation data 201 that is not detected in the second deformation data 202 needs to be added.

[0083] Next, in step S2011 of FIG. 20, the deformation diagram creation unit 230 starts a loop for processing all deformation IDs 1101 recorded in the first difference determination table 1100 set in step S2010.

[0084] Next, in step S2012 of FIG. 20, the deformation diagram creation unit 230 starts a loop for processing all sections with section numbers 1102 of the deformation data having the same deformation ID 1101.

[0085] Next, in step S2013 of FIG. 20, the deformation diagram creating unit 230 judges whether or not there is a corresponding ID 1107 of the section to be processed.

[0086] If the determination result in step S2013 in FIG. 20 is that there is no corresponding ID 1107 for the section to be processed (S2013 / N), that is, if the corresponding ID 1107 for the section to be processed is "no correspondence", the process proceeds to step S2014. When proceeding to step S2014 in Fig. 20, the deformation diagram creation unit 230 searches and collates the corresponding section data of the corresponding second deformation ID, and obtains the value of the corresponding joint vertex. In the example of the difference determination data with the deformation ID "4117" shown in Fig. 13A, the first difference determination table 1100 shown in Fig. 11A has the deformation ID 1101 of 4117, the section number 1102 of 3, and the corresponding ID 1107 of "4218". When searching for data with the deformation ID 1111 of "4218" in the second difference determination table 1110 shown in Fig. 11B, the difference determination data with the deformation ID 1111 of 4218, the section number 1112 of 1, and the corresponding ID 1117 of "4117" is obtained. The section vertex coordinates 1113 in the second difference determination table 1110, (X2008_0, Y2008_0) and (X2008_1, X2008_1), are the vertices P4 and P5 shown in Fig. 13B. Therefore, the deformation diagram creation unit 230 replaces the coordinate values ​​of the vertex C1 (X1017_C1, Y1017_C1) and the vertex C2 (X1017_C2, Y1017_C2) shown in Fig. 13A with the coordinate values ​​of the vertices P4 and P5 shown in Fig. 13B, respectively. In addition, the deformation diagram creation unit 230 adds the differences C1-P4 and C2-P5 to the other section vertices P0, P1, P2, C3, and P3 of the same deformation ID "4117" for correction.

[0087] Next, in step S2015 of Fig. 20, the deformation diagram creation unit 230 refers to the legend table 1600 shown in Fig. 16, and determines the judgment classification 1604 to be "difference to be confirmed" since there is "no correspondence" in the first difference judgment table 1100. Then, the deformation diagram creation unit 230 registers the section data in the deformation diagram data table 1500 shown in Fig. 15 as "difference to be confirmed".

[0088] When the process of step S2015 in FIG. 2 is completed, or when it is determined in step S2013 in FIG. 20 that there is a corresponding ID 1107 for the section to be processed (S2013 / Y), the process proceeds to step S2016. 20, the deformation diagram creation unit 230 judges whether or not the processing of all sections for the same deformation ID has been completed. If the result of this judgment is that the processing of all sections for the same deformation ID has not been completed, an unprocessed section is set and the processing from step S2012 onwards is carried out.

[0089] Also, if the result of the determination in step S2016 in FIG. 20 is that processing of all sections for the same abnormality ID has been completed, the process proceeds to step S2017. 20, the deformation diagram creation unit 230 judges whether or not the processing of all deformation IDs has been completed. If the result of this judgment is that the processing of all deformation IDs has not been completed, an unprocessed deformation ID is set and the processing of step S2011 and subsequent steps is performed.

[0090] Also, if the result of the determination in step S2017 in Fig. 20 is that the processing of all the deformation IDs has been completed, the deformation diagram (6100) shown in Fig. 6 is generated in the work memory 103 as the deformation diagram data table 1500 shown in Fig. 15. Then, the processing of the flowchart shown in Fig. 20 is terminated.

[0091] When the deformation diagram creating unit 230 generates the deformation diagram, which is the third deformation data, the user can confirm and correct (change) this deformation diagram. When the deformation diagram confirmation and correction application is started by an application starting means (not shown), the deformation diagram confirmation and correction process in step S1804 in Fig. 18 described above is executed. The process in step S1804 in Fig. 18 will be explained using the application execution screens in Figs. 7 to 9.

[0092] Fig. 7 is a diagram showing an example of a deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 in Fig. 1. In the deformation diagram confirmation and correction operation display screen 7000 shown in Fig. 7, a deformation diagram and a deformation image are displayed in a display area 7010. The deformation diagram and the deformation image are divided for each span, which is a lining unit, and displayed in the display area 7010, and the display range can be specified by operating a slider 7013, a forward button 7011, and a forward button 7012.

[0093] In the deformation diagram confirmation and correction operation display screen 7000 shown in Fig. 7, the deformation diagram to be confirmed (third deformation data) is enlarged and displayed in the display area 7021. In addition, only the first deformation image 211 (including the first deformation data 201) is enlarged and displayed in the display area 7023, and only the second deformation image 212 (including the second deformation data 202) is enlarged and displayed in the display area 7024. In addition, an image in which the first deformation data 201 and the second deformation data 202 are superimposed is enlarged and displayed in the display area 7022. In addition, on the right side of the display area 7022, a selected section number display area 7031, a total number of deformations display area 7032, a number of confirmations completed display area 7033, and a number of recommended confirmations display area 7034 are provided. Each time the user operates the display switching button 7041, the deformation image superimposed on the display area 7010 is switched between the first deformation image 211, the second deformation image 212, and no image display. The display area 7042 displays the current switching state caused by the display switching button 7041. The user operates the confirm button 7043 when finalizing the state of the deformation to be confirmed and corrected. The user operates the previous button 7044 when displaying the previous deformation to be confirmed and corrected. The user operates the next button 7045 when displaying the next deformation to be confirmed and corrected. The user operates the save button 7046 when saving the deformation diagram in the storage device 104. The end button 7047 is operated by the user when ending all deformation diagram confirmation and correction processing. The confirm all button 7048 is operated by the user when confirming and finalizing all deformations recommended for confirmation.

[0094] When the user operates the Confirm button 7043 on the deformation diagram confirmation and correction operation display screen 7000 shown in FIG. 7, the deformation diagram data table 1500 generated in the work memory 103 is loaded into the application, and the deformation diagram confirmation and correction process is started.

[0095] FIG. 8A is a diagram showing a first display example of the deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 of FIG. 1. In FIG. 8A, the same components as those shown in FIG. 7 are given the same reference numerals, and detailed description thereof will be omitted. In FIG. 7, when the user operates the confirmation button 7043, a deformation diagram based on the deformation diagram data table 1500 loaded into the application is displayed in the display area 7010. In this embodiment, since the superimposed display with the second deformation diagram 212 is specified as the default value for display switching, the deformation diagram (third deformation data) based on the deformation diagram data table 1500 is displayed superimposed on the second deformation diagram 212 in the display area 7010. In addition, the part of the deformation diagram to be recommended for confirmation is displayed in the display area 7021. A rectangular frame 8001 within the range of the display area 7010 in FIG. 8A indicates an area corresponding to the display area 7021. The rectangular frame 8001 is an area obtained by adding a predetermined width to the top, bottom, left and right of the circumscribing area of ​​the combination of deformation data having a deformation correspondence relationship shown in FIG. 17. The rectangular frame 8001 may be the circumscribing area of ​​a set of deformation correspondence relationships, rather than the circumscribing area of ​​the combination of deformation correspondence relationships. The deformation data of the deformation diagram to be recommended for confirmation is a part from which other configuration patterns can be selected in addition to the partial pattern of the deformation diagram determined in the deformation diagram generation process. Other configuration patterns not selected at the time of determination in the deformation diagram generation process are stored in the work memory 103 as other candidate tables. The "3" displayed in the confirmation recommendation number display section 7034 is the total number of deformation diagram parts to be recommended for confirmation.

[0096] In FIG. 8A, the display area 7022 displays the deformation part of the recommended confirmation target, in which the first deformation data 201 and the second deformation data 202 are overlapped so that the deformations in the deformation correspondence are in the same position. However, since it is difficult to confirm the deformation correspondence if they are completely overlapped in the same position, in the display area 7022, they are displayed at a position shifted by about the same width as the display line width. In the display of the deformation line in the display area 7022, a pair of deformations with the same line width are in a deformation correspondence relationship that is considered to have occurred in the same position. In the display area 7022, in order to easily distinguish the deformation data, the deformation IDs that identify the deformation data are displayed as leader line displays "4114", "4115", "4116", "4216" and "4217". In this case, if the deformation ID of the first deformation data 201 is displayed on one side of the deformation data and the deformation ID of the second deformation data 202 is displayed on the other side of the deformation data, it is easy to identify which side the deformation data is. In the example of the deformation correspondence candidate "1 / 10" displayed in the display area 7022 of FIG. 8A, the deformation IDs "4114" and "4216" drawn with the same line width are in a deformation correspondence relationship. Similarly, in the example of the deformation correspondence candidate "1 / 10" displayed in the display area 7022 of FIG. 8A, the deformation IDs "4115" and "4217" drawn with the same line width are in a deformation correspondence relationship. The display of the deformation ID can be erased by entering a specific key input sequence (not shown). FIGS. 8D to 8F, which will be described later, are examples of displays in which the deformation ID has been erased. The result of composing deformation diagrams as the same deformation is displayed in the display area 7021. The display area 7022 of FIG. 8A shows deformation pairs of three different thicknesses. The "1 / 10" displayed in the center of the bottom of the display area 7022 indicates that there are a total of 10 combination patterns of candidates for the corresponding first deformation data 201 and second deformation data 202, and that the first of these is being displayed. The right and left arrows displayed in the display area 7022 are operation icons, and by operating these, the "previous" or "next" combination of deformation correspondence relationships is displayed in the display area 7022.

[0097] In the display area 7023 of Fig. 8A, only the first deformation data 201 of the deformation diagram portion displayed in the display area 7021 is displayed superimposed on the first deformation image 211. In the display area 7024 of Fig. 8A, only the second deformation data 202 of the deformation diagram portion displayed in the display area 7021 is displayed superimposed on the second deformation image 212. For example, in the display area 7024, the deformation is drawn with the same line width as that of the deformation displayed in the display area 7023, making it possible to distinguish the deformation correspondence relationship between the deformation data in the display area 7023 and the display area 7024.

[0098] When the right arrow in the display area 7022 in FIG. 8A is operated, another combination of the deformation correspondence relationships between the first deformation data 201 and the second deformation data 202 is displayed, and the display screen transitions to FIG. 8B.

[0099] FIG. 8B is a diagram showing a second display example of the deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 of FIG. 1. In FIG. 8B, the same components as those shown in FIG. 7 and FIG. 8A are given the same reference numerals, and detailed description thereof will be omitted. In the display area 7022 of FIG. 8B, a combination of deformation correspondence relationships "2 / 10" different from that in FIG. 8A is displayed for the deformation diagram portion shown in the rectangular frame 8001. There are still two sets of deformation correspondence relationships, but in the display area 7022 of FIG. 8B, the deformation correspondence relationships distinguished by the thickness of the drawn lines are different from the "1 / 10" pattern in FIG. 8A. In the display area 7021 of FIG. 8B, the result of updating the deformation diagram by re-executing the difference determination based on the candidate pattern "2 / 10" is displayed.

[0100] FIG. 9 is a diagram showing an example of a candidate pattern of the deformation correspondence relationship that can be displayed in the display area 7022 of the deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 of FIG. 1. In FIG. 8B, as in the case described using FIG. 8A, the user operates the right arrow or left arrow operation icon displayed in the display area 7022, and the candidate patterns of the deformation correspondence relationship shown in FIG. 9(a) to FIG. 9(i) are displayed in the display area 7022. Therefore, the user can specify whether the deformation correspondence relationship of "1 / 10" shown in FIG. 9(a) that was displayed first is correct, or whether the other deformation correspondence relationships shown in FIG. 9(b) to FIG. 9(i) are correct, by using the confirmation button 7043, which is a deformation correspondence specification means. In addition, in FIG. 9(j), since all the line widths are the same, there is no deformation that can be regarded as the same, and all five deformation data are regarded as different deformations that are different from each other. If the desired pattern is not found among the displayed candidate patterns, the user may directly specify the deformation data in the display area 7022 using a pointing device such as a mouse. The candidate patterns shown in Fig. 9(a) to Fig. 9(j) are arranged in order of the certainty of the deformation correspondence relationship. The certainty of the deformation correspondence relationship is calculated based on a reliability value calculated from the perpendicular distance between the deformations, the length of the corresponding deformation sections, the similarity in the direction of the corresponding deformation sections, the distance from a fixed point drawn in common in both the first deformation image and the second deformation image, etc.

[0101] If the user confirms that the first deformation correspondence candidate, FIG. 9(a), is the most appropriate after displaying and examining other candidate patterns, he / she returns to the screen of FIG. 8A and operates the confirmation button 7043. Then, the deformation diagram editing operation unit 260 confirms that the candidate pattern "1 / 10" selected in the display area 7022 is a combination of correct deformation correspondence relationships, and updates and confirms the data of the deformation diagram part based on the confirmed deformation correspondence relationships. In other words, the deformation diagram editing operation unit 260 constitutes a "changing means" that changes the deformation diagram (third deformation data) displayed in the display area 7021, etc., based on a change instruction for the deformation correspondence relationship between the first deformation data 201 and the second deformation data 202 displayed in the display area 7022. When the user operates the next button 7045 that displays the next recommended confirmation target, the display screen transitions to FIG. 8C, and the second recommended confirmation target deformation is displayed.

[0102] FIG. 8C is a diagram showing a third display example of the deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 of FIG. 1. In FIG. 8C, the same components as those shown in FIG. 7 and FIG. 8A to FIG. 8B are given the same reference numerals, and detailed description thereof will be omitted. In the display area 7021 of FIG. 8C, the part of the deformation diagram to be the second recommended confirmation target is displayed. A rectangular frame 8002 within the range of the display area 7010 of FIG. 8C indicates an area corresponding to the display area 7021. In the display area 7022 of FIG. 8C, the overlapping deformation part of the first deformation data 201 and the second deformation data 202 is displayed, as in FIG. 8A. In this embodiment, since the confirmation operation is performed in FIG. 8B, the value of the confirmation completion number display section 7033 is "1", and the value of the confirmation recommendation number display section 7034 is "2".

[0103] In the display area 7023 of Fig. 8C, only the first deformation data 201 of the deformation diagram portion displayed in the display area 7021 is displayed superimposed on the first deformation image 211. In addition, in the display area 7024 of Fig. 8C, only the second deformation data 202 of the deformation diagram portion displayed in the display area 7021 is displayed superimposed on the second deformation image 212.

[0104] In the deformation displayed in the display area 7021 in FIG. 8C, the fixed points of the fixed common parts (for example, the fixed common parts shown by the rectangles in the areas 3101 to 3103 in FIG. 3A) detected by the fixed common part detection unit 250 are present near the deformation. For this reason, the display areas 7023 and 7024 in FIG. 8C are cropped so as to include the fixed points 8011 and 8021, as well as the fixed objects that are the fixed common parts. That is, in the display area 7023 in FIG. 8C, the fixed common parts (including the fixed common part having the fixed point 8011) detected by the fixed common part detection unit 250 and the first deformation data 201 are displayed in an overlapping manner. In addition, in the display area 7024 in FIG. 8C, the fixed common parts (including the fixed common part having the fixed point 8021) detected by the fixed common part detection unit 250 and the second deformation data 202 are displayed in an overlapping manner. When the user checks the distance from the fixed point, it becomes easier to understand that the first deformation data 201 and the second deformation data 202 forming the deformation diagram are in the same position. In the display area 7023 of FIG. 8C, three values ​​are displayed as information 8012 indicating the offset distance, where L is the linear distance from the fixed point 8011 of the first deformation data 201, DX is the distance in the X direction, and DY is the distance in the Y direction. Similarly, in the display area 7024 of FIG. 8C, three values ​​are displayed as information 8022 indicating the offset distance, where L is the linear distance from the fixed point 8021 of the second deformation data 202, DX is the distance in the X direction, and DY is the distance in the Y direction. In this case, the offset distance may be calculated based on the coordinate value of the deformation image data, or may be converted into the actual dimension of the structure (target object).

[0105] 8C, it can be seen that there are other possible combinations of the deformation correspondence relationship, as "1 / 3" is displayed in the display area 7022. The user can operate the left arrow or right arrow operation icon displayed in the display area 7022 to display other possible combinations of the deformation correspondence relationship in the display area 7022.

[0106] Fig. 8D is a diagram showing a fourth display example of the deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 in Fig. 1. In Fig. 8D, the same components as those shown in Fig. 7 and Figs. 8A to 8C are given the same reference numerals, and detailed description thereof will be omitted. Specifically, Fig. 8D displays a combination candidate of the second deformation correspondence relationship of the deformation area of ​​the rectangular frame 8002 within the range of the display area 7010. In the deformation superimposition display of the display area 7022 in Fig. 8D, the combination of the deformation correspondence relationship of "2 / 3" seems possible, but when comparing the offset distance from the fixed point, it can be seen that both the straight-line distance and the distance in the X and Y directions are significantly different from the offset distance in Fig. 8C.

[0107] FIG. 8E is a diagram showing a fifth display example of the deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 of FIG. 1. In FIG. 8E, the same components as those shown in FIG. 7 and FIG. 8A to FIG. 8D are given the same reference numerals, and detailed description thereof will be omitted. Specifically, FIG. 8E displays a combination candidate of the third deformation correspondence relationship of the deformation area of ​​the rectangular frame 8002 within the range of the display area 7010. There is no corresponding combination of the deformation correspondence relationship of "3 / 3" in the display area 7022 of FIG. 8E. Therefore, the display area 7021 of FIG. 8E shows a deformation diagram in which one deformation of the first deformation data 201 and two deformations of the second deformation data 202 are different deformations. If there is no corresponding deformation correspondence relationship, the object to be compared is not specified, and therefore information indicating the offset distance is not displayed in the display areas 7023 and 7024. If you want to check the offset distance, simply display the deformation correspondence combinations of "1 / 3" and "2 / 3."

[0108] Comparing the offset distance information 8012 and the offset distance information 8022 in Fig. 8C, the values ​​are not exactly the same, but are almost the same and can be considered to be within the range of error in the detection position. The overlap of the deformation correspondence relationships in the display area 7022 in Fig. 8C does not look suspicious, so it can be confirmed with the deformation diagram based on the deformation correspondence relationship combination "1 / 3".

[0109] FIG. 8F is a diagram showing a sixth display example of the deformation diagram confirmation and correction operation display screen 7000 displayed on the display output device 106 of FIG. 1. In FIG. 8F, the same components as those shown in FIG. 7 and FIG. 8A to FIG. 8E are given the same reference numerals, and detailed description thereof will be omitted. Specifically, in FIG. 8F, a part of the deformation diagram to be the third recommended object for confirmation is displayed in the display area 7021. A rectangular frame 8003 within the range of the display area 7010 of FIG. 8F indicates an area corresponding to the display area 7021. In the display area 7022 of FIG. 8F, the overlapping deformation part of the first deformation data 201 and the second deformation data 202 is displayed, as in FIG. 8A. In this embodiment, since the confirmation operation is performed in FIG. 8C, the value of the confirmation completion number display section 7033 becomes "2", and the value of the confirmation recommendation number display section 7034 becomes "1".

[0110] In Fig. 8F, operation icons for other candidate combinations of deformation corresponding relationships are not displayed in the display area 7022. This is because there is only one combination of deformation corresponding relationships between the first deformation data 201 and the second deformation data 202 that are the basis of the deformation diagram displayed in the display area 7021.

[0111] When the user finishes checking the third deformation part recommended for confirmation shown in Fig. 8F, checking of all recommended targets for confirmation has been completed, and so by operating the save button 7046, the deformation diagram is saved in the storage device 104. By operating the exit button 7047, all deformation diagram checking and correction processing is completed, and the application is terminated.

[0112] In the process of confirming and correcting the deformation diagram described above, the deformation parts recommended for confirmation were confirmed one by one, but all deformation diagram parts currently determined based on the first priority candidate combination of deformation correspondence relationships may be confirmed by operating the Confirm All button 7048. It has been confirmed that the accuracy of deformation diagram generation is sufficiently high, and if no suspicious parts are found by overviewing the deformation diagram, the user can skip confirmation and create a deformation diagram semi-automatically.

[0113] The display output device 106, which displays the deformation diagram confirmation and correction operation display screen 7000 shown in Figs. 8A to 8F, constitutes a "display means" for displaying the deformation diagram, which is the third deformation data, and the deformation correspondence relationship between the first deformation data 201 and the second deformation data 202. Specifically, the display output device 106 displays the deformation diagram, which is the third deformation data, in a display area 7021, and displays the deformation correspondence relationship between the first deformation data 201 and the second deformation data 202 in a display area 7022. In addition, the display output device 106 displays a plurality of candidates for the deformation correspondence relationship as the deformation correspondence relationship between the first deformation data 201 and the second deformation data 202 in the display area 7022 by operating the right arrow or left arrow displayed in the display area 7022. 8C etc., the display output device 106 which displays the deformation diagram confirmation and correction operation display screen 7000 superimposedly displays the fixed common parts (including the fixed common parts having the fixed point 8011) detected by the fixed common part detection unit 250 and the first deformation data 201 in a display area 7023. Also, the display output device 106 which displays the deformation diagram confirmation and correction operation display screen 7000 shown in Fig. 8C etc., superimposedly displays the fixed common parts (including the fixed common parts having the fixed point 8021) detected by the fixed common part detection unit 250 and the second deformation data 202 in a display area 7024.

[0114] In the present embodiment, an example is shown in which a fixed object, which is a fixed common part used as a reference for position identification, is a rectangular area, but the present invention is not limited to this. For example, the appearance position of a specific character string that appears in common, an elliptical area, an area that can be identified by color, etc. may be detected, or a pattern of a fixed object may be registered and specified in advance, and the registered object may be detected and searched. In addition, a GPU (Graphics Processing Unit) may be added to the information processing device 100 in FIG. 1, and the graphics library may use the GPU, thereby speeding up image processing.

[0115] In this embodiment, the first deformation data 201 and the second deformation data 202 are assumed to be time-lapse data that are photographed, recorded, and detected at different times for the object. This is because the first deformation data 201 has already been confirmed and is considered to have a high degree of certainty compared to the uncertainty of the second deformation data 202. However, in this disclosure, the first deformation data 201 and the second deformation data 202 are not limited to confirmation of difference determination between time-lapse data. In this disclosure, the first deformation data 201 and the second deformation data 202 can also be applied to confirmation of difference determination between two different deformation data from the same period. In this case, the two different deformation data of the first deformation data 201 and the second deformation data 202 may be two different deformation data processed from the same image, such as difference determination of an AI (artificial intelligence) detection model or difference determination of a detection algorithm.

[0116] According to the information processing device 100 according to the embodiment of the present disclosure described above, it is possible to properly grasp the state of the deformation of an object. That is, it is possible to accurately and easily create a deformation diagram that records the state of the deformation.

[0117] (Other embodiments) The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more functions. This program and a computer-readable storage medium having the program stored thereon are included in the present disclosure.

[0118] It should be noted that the above-described embodiments of the present disclosure are merely illustrative examples of the implementation of the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these. In other words, the present disclosure can be implemented in various forms without departing from its technical concept or main features.

[0119] Embodiments of the present disclosure include the following configurations, methods, and programs. [Configuration 1] An identification means for identifying a common portion and a difference portion of a first deformation data of an object and a second deformation data different from the first deformation data; An acquisition means for acquiring third deformation data based on the common part and the difference part; A change means for changing the third deformation data based on an instruction to change the deformation correspondence relationship between the first deformation data and the second deformation data; 13. An information processing device comprising: [Configuration 2] The third deformation data has a state of deformation progress of the first deformation data and the second deformation data as a legend classification. 2. The information processing device according to configuration 1. [Configuration 3] An identification means for identifying a common portion and a difference portion of a first deformation data of an object and a second deformation data different from the first deformation data; An acquisition means for acquiring third deformation data having a state of deformation progress of the first deformation data and the second deformation data as a legend classification based on the common part and the difference part; 13. An information processing device comprising: [Configuration 4] Further, the display control means displays a plurality of candidates for the deformation correspondence relationship. 4. The information processing device according to any one of configurations 1 to 3. [Configuration 5] A detection means for detecting a common part that does not include a deformation, which is present in common between a first deformation image of the object corresponding to the first deformation data and a second deformation image of the object corresponding to the second deformation data; A display control means for superimposing and displaying the common part detected by the detection means and the first deformation data and the second deformation data; 5. The information processing device according to any one of configurations 1 to 4, further comprising: [Configuration 6] The first deformation data and the second deformation data are deformation data acquired at different times for the object. 6. The information processing device according to any one of configurations 1 to 5. [Method 1] A step of identifying a common portion and a difference portion of a first deformation data of the object and a second deformation data different from the first deformation data; An acquisition step of acquiring third deformation data based on the common part and the difference part; A change step of changing the third deformation data based on an instruction to change the deformation correspondence relationship between the first deformation data and the second deformation data; 13. An information processing method comprising: [Method 2] A step of identifying a common portion and a difference portion of a first deformation data of the object and a second deformation data different from the first deformation data; An acquisition step of acquiring third deformation data having a state of deformation progress of the first deformation data and the second deformation data as a legend classification based on the common part and the difference part; 13. An information processing method comprising: [Program 1] A program for causing a computer to execute each step of the information processing method according to the first or second method. [Explanation of symbols]

[0120] 100: Information processing device, 101: Control unit, 102: Non-volatile memory, 103: Work memory, 104: Storage device, 105: Operation input device, 106: Display output device, 107: Network interface, 108: System bus, 201: First deformation data, 202: Second deformation data, 210: Input unit, 211: First deformation image, 212: Second deformation image, 220: Difference determination unit, 230: Deformation map creation unit, 240: Legend recording unit, 250: Fixed common part detection unit, 260: Deformation map editing operation unit, 270: Deformation map recording unit, 280: Display data generation unit

Claims

1. An identification means for identifying a common portion and a difference portion of a first deformation data of an object and a second deformation data different from the first deformation data; An acquisition means for acquiring third deformation data based on the common part and the difference part; A change means for changing the third deformation data based on an instruction to change the deformation correspondence relationship between the first deformation data and the second deformation data; 13. An information processing device comprising:

2. The third deformation data has a state of the deformation progress of the first deformation data and the second deformation data as a legend classification.

2. The information processing apparatus according to claim 1,

3. An identification means for identifying a common portion and a difference portion of a first deformation data of an object and a second deformation data different from the first deformation data; An acquisition means for acquiring third deformation data having a state of deformation progress of the first deformation data and the second deformation data as a legend classification based on the common part and the difference part; 13. An information processing device comprising:

4. Further, the display control means displays a plurality of candidates for the deformation correspondence relationship.

4. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

5. A detection means for detecting a common part that does not include a deformation and is present in common between a first deformation image of the object corresponding to the first deformation data and a second deformation image of the object corresponding to the second deformation data; A display control means for superimposing and displaying the common part detected by the detection means and the first deformation data and the second deformation data; 4. The information processing apparatus according to claim 1, further comprising:

6. The first deformation data and the second deformation data are deformation data acquired at different times for the object.

4. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

7. A step of identifying a common portion and a difference portion of a first deformation data of the object and a second deformation data different from the first deformation data; An acquisition step of acquiring third deformation data based on the common portion and the difference portion; A change step of changing the third deformation data based on a change instruction for the deformation correspondence relationship between the first deformation data and the second deformation data; 13. An information processing method comprising:

8. A step of identifying a common portion and a difference portion of a first deformation data of the object and a second deformation data different from the first deformation data; An acquisition step of acquiring third deformation data having a state of the deformation progress of the first deformation data and the second deformation data as a legend classification based on the common part and the difference part; 13. An information processing method comprising:

9. A program for causing a computer to execute each step of the information processing method according to claim 7 or 8.

Images