Information processing apparatus, information processing method, and program

Abstract

To achieve a technique to allow a user to efficiently perform operations to check a result of inspection.SOLUTION: An information processing apparatus has: search means that searches for inspection information that is obtained by associating a first image obtained by photographing an inspection target and a deformed area of the first image with each other, and that corresponds to a second image obtained by photographing the inspection target; extraction means that extracts an area corresponding to the second image from the inspection information searched for by the search means and corresponding to the second image; and generation means that generates information for presenting the area corresponding to the second image extracted by the extraction means to the second image in a comparable manner.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a technique for displaying inspection results of inspection targets in a comparable manner. [Background technology]

[0002] Methods for inspecting infrastructure structures include performing image analysis on images taken of the structure to be inspected, or performing image processing using a trained model generated by machine learning.

[0003] In addition, a technology has been proposed to assist users in checking inspection information by displaying current inspection results for the same structure in a manner that allows them to be compared with past inspection results (Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Takuji Kawada, Kan'ya Watanabe, Takeo Kawaura, "Improving the efficiency of social infrastructure facility maintenance using AR technology," Mitsubishi Electric Technical Review Vol. 89 No. 2 2015, [Retrieved April 21, 2022], Internet<URL: https: / / www.giho.mitsubishielectric.co.jp / giho / pdf / 2015 / 1502108.pdf> Summary of the Invention [Problem to be solved by the invention]

[0005] Image processing to detect abnormalities from images of the inspection target requires high-resolution images, and to make the inspection work more efficient, images of the inspection target taken over as wide an area as possible are used. Therefore, for example, if the inspection results obtained from images taken on-site and past inspection results are simply superimposed, it becomes difficult to focus on the areas of interest, and there is a possibility that the inspection results cannot be checked efficiently.

[0006] The present invention has been made in consideration of the above problems, and has an object to realize a technique that enables efficient confirmation of inspection results. [Means for solving the problem]

[0007] In order to solve the above problems and achieve the object, the information processing device of the present invention has a search means for searching for inspection information that corresponds to a first image taken of an inspection object and a modified area in the first image, which corresponds to a second image taken of the inspection object, an extraction means for extracting an area corresponding to the second image from the inspection information corresponding to the second image searched by the search means, and a generation means for generating information that presents the area corresponding to the second image extracted by the extraction means in a manner that allows it to be compared with the second image. Effect of the Invention

[0008] According to the present invention, the inspection results can be checked efficiently. [Brief description of the drawings]

[0009] [Figure 1] 1 is a system configuration diagram of the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing the hardware configuration of the information processing apparatus according to the first embodiment. [Diagram 3] FIG. 2 is a functional block diagram of the information processing apparatus according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating inspection information according to the first embodiment. [Diagram 5] 4 is a flowchart showing a control process of the information processing apparatus according to the first embodiment. [Figure 6] FIG. 11 is a diagram illustrating a comparison result of the first embodiment. [Figure 7] FIG. 11 is an explanatory diagram of a method for combining a partial region and a partial deformed region according to the second embodiment. [Figure 8] FIG. 11 is a diagram illustrating a comparison result of the second embodiment. [Figure 9] FIG. 11 is a diagram illustrating a comparison result of the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0011] [Embodiment 1] An embodiment in which an information processing device of the present invention is applied to a computer device used for inspecting infrastructure structures such as concrete structures will be described below.

[0012] In embodiment 1, an example of a system is described in which a computer device operates as an information processing device and displays images of an inspection target taken on-site and past inspection results of the same inspection target for comparison on a client device, thereby enabling efficient confirmation of inspection results.

[0013] In the first embodiment, the "inspection target" refers to a concrete structure to be inspected, such as a highway, a bridge, a tunnel, or a dam. The information processing device performs a defect detection process to detect the presence or absence and state of defects such as cracks, using an image of the inspection target captured by the user. In addition, in the case of a concrete structure, the "deformation" refers to cracks, lifting, or spalling of concrete. Other defects include efflorescence (whitening phenomenon), exposed rebar, rust, water leakage, dripping, corrosion, damage (missing parts), cold joints, deposits, and junk.

[0014] An "inspection image" is an image of an inspection target taken in the past (first image) whose inspection results have already been saved as inspection information. An "input image" is the latest image (second image) of the same inspection target as the inspection image taken on-site by a client device.

[0015] In this embodiment, the capture range of the input image is smaller than the capture range of the inspection image.

[0016] <System configuration> First, a system including an information processing apparatus according to a first embodiment will be described with reference to FIG.

[0017] FIG. 1 is a system configuration diagram of the first embodiment.

[0018] In the system of the first embodiment, a client device 100 and an information processing device 102 are connected via a network 101 so as to be able to communicate with each other.

[0019] The client device 100 is an operating device having a camera function that is operable and carried by a user, and is, for example, a communication terminal such as a smartphone, or an information processing terminal such as a tablet PC (personal computer).

[0020] The information processing device 102 is a computer device such as a desktop computer (PC) or a server computer.

[0021] The network 101 may be an in-house network such as a local area network (LAN), a wide area network (WAN) such as 4G / LTE or 5G, or the Internet.

[0022] An input image of an inspection target captured on-site is transmitted from the client device 100 to the information processing device 102. The information processing device 102 performs an abnormality detection process on the input image received from the client device 100. The information processing device 102 also generates a comparison result that allows comparison of the input image received from the client device 100 with past inspection results of the same inspection target that includes the capture range of the input image, and transmits the comparison result to the client device 100. A user can display the comparison result received from the information processing device 102 on the client device 100 to check the inspection results of the inspection target.

[0023] In addition, the abnormality detection process may be performed using a cloud-based service such as SaaS (Software as a Service).

[0024] <Hardware configuration> Next, the hardware configuration of the information processing apparatus according to the first embodiment will be described with reference to FIG.

[0025] FIG. 2 is a block diagram showing the hardware configuration of the information processing apparatus 102 according to the first embodiment.

[0026] In the first embodiment, a computer device operates as the information processing device 102. The processing of the information processing device of the first embodiment may be realized by a single computer device, or may be realized by distributing each function among a plurality of computer devices as necessary. The plurality of computer devices are connected to each other so as to be able to communicate with each other.

[0027] The information processing device 102 includes a control unit 201 , a non-volatile memory 202 , a work memory 203 , a storage device 204 , an input device 205 , an output device 206 , a network interface 207 , and a system bus 208 .

[0028] The control unit 201 includes an arithmetic processor such as a CPU or MPU that controls the entire information processing device 102. The non-volatile memory 202 is a ROM that stores programs and parameters executed by the processor of the control unit 201. Here, the programs refer to programs for executing the processes of the first, second, and third embodiments described below. The work memory 203 is a RAM that temporarily stores programs and data supplied from an external device or the like. The work memory 203 holds data obtained by executing the control processes described below.

[0029] The storage device 204 is an internal device such as a hard disk or a memory card built into the information processing device 102, or an external device such as a hard disk or a memory card detachably connected to the information processing device 102. The storage device 204 includes a memory card or a hard disk constituted by a semiconductor memory, a magnetic disk, or the like. The storage device 204 also includes a storage medium constituted by a disk drive that reads / writes data from / to optical disks such as DVDs and Blue-ray Discs.

[0030] The input device 205 is an operating member such as a mouse, keyboard, or touch panel that accepts user operations and outputs operation instructions to the control unit 201. The output device 206 is a display device such as a monitor or a display configured with an LCD or an organic EL, and displays data held by the information processing device 102 or data supplied from the outside. The network interface 207 is communicably connected to a network such as the Internet or a LAN (Local Area Network). The system bus 208 includes an address bus, a data bus, and a control bus that connect the components 201 to 207 of the information processing device 102 to be able to transmit and receive data.

[0031] The non-volatile memory 202 stores an OS (operating system), which is basic software executed by the control unit 201, and applications that cooperate with the OS to realize applied functions. In the first embodiment, the non-volatile memory 202 also stores applications that allow the information processing device 102 to realize control processing, which will be described later.

[0032] The control processing of the information processing device 102 of the first embodiment is realized by reading software provided by an application. It is assumed that the application has software for utilizing basic functions of the OS installed in the information processing device 102. It is also possible for the OS of the information processing device 102 to have software for realizing the control processing in the first embodiment.

[0033] <Functional Configuration> Next, functional blocks of the information processing apparatus 102 according to the first embodiment will be described with reference to FIG.

[0034] FIG. 3 is a functional block diagram of the information processing apparatus 102 according to the first embodiment.

[0035] The information processing device 102 has a communication unit 300, an inspection information storage unit 301, an inspection information search unit 302, an inspection information extraction unit 303, and a comparison result generation unit 304. Each function of the information processing device 102 is configured with hardware and / or software. Each functional unit may be configured as a system that is configured with one or more computer devices or server devices and connected via a network. Furthermore, when each functional unit shown in FIG. 3 is configured with hardware instead of being realized with software, it is sufficient to have a circuit configuration corresponding to each functional unit in FIG. 3.

[0036] The communication unit 300 is communicatively connected to the client device 100, and receives operation information corresponding to a user operation, search information required to search for inspection information, and an input image of an inspection target from the client device 100. The communication unit 300 also transmits the comparison result generated by the comparison result generation unit 304 to the client device 100. The client device 100 presents the comparison result received from the information processing device 102 to the user by displaying it on a display device.

[0037] The inspection information storage unit 301 stores inspection information that associates an inspection image of an inspection target with a deformation area included in the inspection image. FIG. 4 illustrates an example of inspection information. The inspection information includes an inspection image 400 and a deformation area 401. The deformation area 401 is information that records an inspection result for the inspection image 400. The deformation area 401 is information that identifies a location where an inspection target such as cracks or rust exists, but is not limited to this. Furthermore, the inspection information is not limited to the example of FIG. 4, and may include additional information necessary for an inspection information search described later, such as the shooting date and time of the inspection image and the shooting location.

[0038] The inspection information search unit 302 searches for inspection information stored in the inspection information storage unit 304 based on the search information received by the communication unit 300 .

[0039] The inspection information extraction unit 303 extracts the inspection image and deformation area contained in the inspection information searched by the inspection information search unit 302, as well as a partial deformation area cut out based on the search information and a partial deformation area which is a deformation area contained in the partial area.

[0040] The comparison result generating unit 304 generates information that presents the partial area and the partial abnormality area extracted by the inspection information extracting unit 303 in a manner that allows them to be compared with the input image.

[0041] <Control processing> Next, the control process of the information processing apparatus 102 according to the first embodiment will be described with reference to FIG.

[0042] The process in Fig. 5 is realized by the control unit 201 of the information processing device 102 shown in Fig. 2 expanding a program stored in the non-volatile memory 202 into the work memory 203 and executing it, thereby controlling each component shown in Fig. 2 to operate as each functional unit shown in Fig. 3. The process in Fig. 5 is started in a state in which the information processing device 102 is connected to the client device 100 so as to be able to communicate with each other.

[0043] In S501, the communication unit 300 receives search information and an input image from the client device 100. The communication unit 300 outputs the search information to the inspection information search unit 302, and outputs the input image to the inspection information extraction unit 303 and the comparison result generation unit 304. The search information includes an input image of an inspection target, and may also include other information such as position information of the inspection target acquired by the client device 100, the shooting direction and shooting angle at the time of shooting, and a deformed area of ​​the input image.

[0044] In S502, the inspection information search unit 302 searches the inspection information stored in the inspection information storage unit 301 based on the search information acquired from the communication unit 300, and outputs the search result to the inspection information extraction unit 303. The search method is performed by a known image search method to search for inspection information corresponding to the input image, but is not limited to a specific search method. For example, an identifier that can uniquely identify the inspection target may be set and saved as supplementary information of the inspection information, and a search may be performed based on the identifier of the inspection target specified by a user operation as search information. In addition, position information such as the spatial coordinates of the inspection target may be held as the inspection information, and the search range may be narrowed down based on the position information of the inspection target acquired by the client device 100 as the search information, and the shooting direction and shooting angle at the time of shooting. In addition, a search may be performed based on the similarity or feature amount between the input image and the inspection information, or the search may be narrowed down to the crack part where the user traced the input image.

[0045] In S503, the inspection information extraction unit 303 performs a process of extracting a partial region corresponding to the region of the input image from the inspection information searched by the inspection information search unit 302. The extraction process is performed, for example, by calculating the similarity between the pixel values ​​of the input image and the pixel values ​​of the inspection image, and cutting out the region of the inspection image with the highest similarity as a partial region, but is not limited to this and may be realized by other methods. For example, similar to the search process in S502, position information such as the spatial coordinates of the inspection target is held as the inspection information, and the inspection target may be extracted based on information such as the position information of the inspection target acquired by the client device 100 and the shooting direction and shooting angle at the time of shooting as search information.

[0046] In addition, the inspection information extraction unit 303 extracts a deformed area included in a partial area cut out from the inspection image as a partial deformed area. The extraction process of the partial deformed area may extract only the range included in the partial area, but if the entire deformed area is not included, the partial area may be expanded until it is included.

[0047] Furthermore, the extraction process may be performed based on the additional information of the inspection information. If the damage level for each affected area is stored as the additional information of the inspection information, only affected areas having a damage level equal to or higher than a predetermined threshold may be extracted. The threshold may be changeable by the user of the client device 100.

[0048] In S504, the comparison result generating unit 304 generates a comparison result using the partial area and partial deformation area extracted by the inspection information extracting unit 303 and the input image, and transmits it to the client device 100 via the communication unit 300. The comparison result is information that allows the deformation area of ​​the input image to be compared with the deformation area of ​​the inspection image. The client device 100 presents the comparison result received from the information processing device 102 to the user by displaying it on the display device.

[0049] FIG. 6 shows an example of the display of the comparison result. In the example of FIG. 6, the comparison result is displayed by superimposing an image in which a partial deformation area 601 cut out from an inspection image is superimposed on an input image 600, and a partial area 602, but this is not limited to this. Also, supplementary information of the inspection information may be displayed in accordance with the partial deformation area 601. Furthermore, an image in which a partial deformation area is superimposed on an input image and an image in which a partial area and a partial deformation area are superimposed may be switchable. Also, an input image and an image in which a partial deformation area is superimposed on a partial area may be displayed side by side. Also, the partial area and the partial deformation area may be rotated, enlarged or reduced according to the shooting direction of the input image and displayed superimposed.

[0050] In addition, the partial deformation area of ​​the comparison result may be editable according to a user operation. For example, the shape of the partial deformation area displayed in the superimposed state may be changed by referring to the crack shape of the input image. In this case, the comparison result generating unit 304 may reflect the editing result in the inspection information used for extraction.

[0051] In addition, not only the partial deformation area but also the supplementary information of the inspection information may be edited. For example, if the supplementary information of the inspection information has a damage degree, the damage degree of the partial deformation area displayed in the superimposed state may be changed based on the crack shape of the input image.

[0052] According to the above-mentioned embodiment 1, by extracting partial areas and partial deformation areas of the inspection image corresponding to the input image photographing the inspection target, the inspector can perform inspection work by focusing on the areas that require attention.

[0053] In addition, by displaying an image in which the partial deformation area is superimposed on the input image and a partial area of ​​the inspection image side by side, the inspection results can be confirmed by comparing the images, making the inspection results more efficient.

[0054] [Embodiment 2] In the second embodiment, an example in which the inspection information search result includes a plurality of pieces of inspection information will be described.

[0055] The hardware configuration and functional blocks of the information processing apparatus 102 according to the second embodiment are similar to those of the first embodiment shown in FIGS.

[0056] When the inspection information search unit 302 finds multiple pieces of inspection information corresponding to the input image, the inspection information extraction unit 303 performs an extraction process of a partial region corresponding to the input image for each of the multiple pieces of inspection information. If the result of the extraction process shows that the partial deformation region of the partial region corresponding to the input image extends across multiple pieces of inspection information, the partial region and the partial deformation region extracted from each piece of inspection information may be combined to form one partial region and one partial deformation region. The combination method is performed by recording the connection relationship between the inspection images and the connection relationship between the deformation regions as supplementary information as the inspection information, and using the connection relationship, but is not limited to this.

[0057] Fig. 7 illustrates a state in which partial regions and partial deformation regions of multiple inspection images are combined. In the example of Fig. 7, partial deformation regions 704 and 705 are extracted from deformation regions 702 and 703 of inspection images 700 and 701 corresponding to the input image. Furthermore, partial deformation regions 706 and partial deformation region 707 are generated by combining partial deformation regions 704 and 705. Then, the comparison result generating unit 304 generates a comparison result using the combined partial region 706 and partial deformation region 707 and the input image.

[0058] Fig. 8 shows a display example of the comparison result in embodiment 2. In the example of Fig. 8, the partial affected area 707 combined as described in Fig. 7 is superimposed on the input image 800, and the partial area 706 is displayed side by side.

[0059] Alternatively, the comparison results of the partial regions and partial deformation regions may be generated without combining them. In this case, the comparison results to be displayed may be switched by a user operation.

[0060] According to the above-mentioned embodiment 2, when multiple partial areas and partial deformation areas are extracted from inspection information corresponding to an input image of the inspection object, a comparison result can be generated based on the combined partial areas and partial deformation areas, so that the inspection result confirmation work can be carried out efficiently, as in embodiment 1.

[0061] [Embodiment 3] In the third embodiment, an example will be described in which inspection information includes an inspection target and an inspection time as supplementary information.

[0062] The hardware configuration and functional blocks of the information processing apparatus 102 according to the third embodiment are similar to those of the first embodiment shown in FIGS.

[0063] The inspection information storage unit 301 stores the inspection image and the abnormality area in the inspection image in association with each other as inspection information, and also stores the inspection target and the inspection time as supplementary information.

[0064] The inspection information search unit 302 searches for inspection information corresponding to the input image, and adds to the search results inspection information having the same inspection target as the search result inspection information as incidental information.

[0065] The inspection information extraction unit 303 performs an extraction process for an area corresponding to the input image from each of the inspection information results, and extracts a partial area and a partial deformation area.

[0066] The comparison result generating unit 304 generates a comparison result for each of the partial areas and partial modified areas extracted by the inspection information extracting unit 303, and sorts them in chronological order using the inspection time, which is the incidental information. Then, the comparison result generating unit 304 transmits each comparison result to the client device 100 via the communication unit 300. The client device 100 presents each comparison result received from the information processing device 102 to the user by displaying it on the display device. The display of each comparison result can be switched to order of inspection time according to a user operation.

[0067] Fig. 9 shows an example of the display of the comparison result in embodiment 3. In the example of Fig. 9(a), a partial region 901 with a more recent inspection time and a partial region 903 with an older inspection time are displayed side by side on an input image 900, and a partial deformation region 902 corresponding to the partial region 901 is displayed superimposed on the input image 900. Also, in the example of Fig. 9(a), the partial region 901 is displayed in the foreground, and the partial region 903 is displayed behind the partial region 901.

[0068] 9(b), a partial region 901 with a more recent inspection time and a partial region 903 with an older inspection time are displayed side by side in an input image 900, and a partial deformation region 904 corresponding to the partial region 903 is superimposed on the input image 900. Also, in the example of FIG. 9(b), the partial region 903 is displayed in the foreground, and the partial region 901 is displayed behind the partial region 901.

[0069] The display state of Fig. 9(a) and the display state of Fig. 9(b) can be switched according to the user's operation. The comparison result is not limited to the example of Fig. 9, and the input image, the partial area at each inspection time, and the partial deformation area may be displayed side by side.

[0070] According to the above-mentioned embodiment 3, the comparison results can be displayed in order of inspection time for the input image of the inspection target, which makes it possible to efficiently check the inspection results and to check changes in the condition over time.

[0071] [Other embodiments] The present invention can also be realized by supplying a program that realizes one or more functions of each embodiment to a system or device via a network or a storage medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0072] The disclosure of this specification includes the following information processing device, information processing method, and program. [Configuration 1] A search means for searching for inspection information that associates a first image of an inspection object with a deformation area of ​​the first image, the first image corresponding to a second image of the inspection object; an extraction means for extracting an area corresponding to the second image from the inspection information corresponding to the second image searched by the search means; a generating unit configured to generate information presenting the area corresponding to the second image extracted by the extracting unit in a manner that allows comparison with the second image. [Configuration 2] A storage means for storing the first image and the abnormality area of ​​the first image as inspection information in association with each other, 2. The information processing apparatus according to configuration 1, wherein the search means searches for inspection information stored in the storage means that corresponds to the second image. [Configuration 3] The storage means stores position information of the abnormality area in the first image as the inspection information, 3. The information processing apparatus according to configuration 2, wherein the search means searches for the inspection information stored in the storage means based on the second image and position information of the second image. [Configuration 4] The storage means stores, as the inspection information, supplementary information of the abnormality area of ​​the first image, The information processing device according to configuration 2 or 3, wherein the extraction means extracts an area corresponding to the second image from inspection information corresponding to the second image searched for by the search means based on the supplementary information. [Configuration 5] The extraction means extracts a partial region of the first image corresponding to the second image and a partial deformation region included in the partial region from the inspection information corresponding to the second image searched by the search means, The information processing device according to any one of configurations 2 to 4, characterized in that the generation means generates information that presents the partial area extracted by the extraction means and the partial deformed area in a comparable manner to the second image. [Configuration 6] The information processing device described in configuration 5, characterized in that the information presented in a comparable manner includes an image in which the partial deformation area extracted by the extraction means is superimposed on the second image, and an image of a partial area of ​​the first image displayed alongside the second image. [Configuration 7] The information processing device according to configuration 5 or 6, wherein the extraction means cuts out the partial region of the first image corresponding to the second image so as to include all of the abnormality areas present in the partial region. [Configuration 8] An editing means for editing the partial deformation area, The information processing device according to any one of configurations 5 to 7, characterized in that the generation means reflects the editing result of the partial abnormality area by the editing means in the inspection information used for extraction by the extraction means. [Configuration 9] The storage means stores a connection relationship between a plurality of partial regions and a connection relationship between a plurality of partial deformation regions as supplementary information of the inspection information, The extraction means extracts partial deformation areas from a plurality of pieces of inspection information corresponding to the second images searched by the search means, 9. The information processing device according to any one of configurations 5 to 8, wherein a plurality of extracted partial abnormality regions are combined based on the connection relationships. [Configuration 10] The extraction means extracts the partial deformation area from each of a plurality of pieces of inspection information corresponding to the second image searched by the search means, The generating means generates a plurality of pieces of information capable of comparing the plurality of partial deformation areas extracted by the extracting means with the second image, 9. The information processing device according to any one of configurations 5 to 8, wherein the plurality of pieces of information are switchable in response to a user operation. [Configuration 11] The storage means stores an inspection target and an inspection time as supplementary information of the inspection information, The search means searches for inspection information of the same inspection object at a different inspection time based on incidental information of the inspection information corresponding to the second image from the inspection information stored in the storage means, The extraction means extracts a partial region and a partial deformation region of the first image corresponding to the second image from inspection information corresponding to the second image searched by the search means, the partial region and the partial deformation region of the first image corresponding to the second image from inspection information at different inspection times, The information processing device according to any one of configurations 5 to 8, characterized in that the generation means generates information that enables comparison of the multiple partial abnormality areas extracted by the extraction means with respect to the second image in order of the inspection time. [Configuration 12] A plurality of partial regions of the first image are displayed on the second image in an overlapping manner in the order of the inspection time, An information processing device as described in configuration 11, characterized in that among the multiple partial regions of the first image, a partial deformation region of a partial region located at the forefront is displayed superimposed on the deformation region of the second image. [Configuration 13] The first image is an image of the inspection target captured in the past, The second image is an image of the same inspection target as the first image, 13. The information processing device according to any one of configurations 1 to 12, further comprising a communication means for transmitting the comparable presented information generated by the generation means to a client device capable of communicating with the information processing device. [Configuration 14] A step in which a search means searches for inspection information that associates a first image taken of an inspection object with a deformation area of ​​the first image, the first image corresponding to a second image taken of the inspection object; An extraction means extracts an area corresponding to the second image from the searched inspection information corresponding to the second image; A method for processing information, comprising: a generating step of generating information that presents the extracted area corresponding to the second image in a manner comparable to the second image. [Configuration 15] A program for causing a computer to function as each of the means of an information processing device according to any one of configurations 1 to 13. [Explanation of symbols]

[0073] 102: information processing device, 200: control unit, 300: communication unit, 301: inspection information storage unit, 302: inspection information search unit, 303: inspection information extraction unit, 304: comparison result generation unit

Claims

1. A search means for searching for inspection information that associates a first image of an inspection object with a deformation area of ​​the first image, the first image corresponding to a second image of the inspection object; an extraction means for extracting an area corresponding to the second image from the inspection information corresponding to the second image searched for by the search means; a generating unit configured to generate information presenting the area corresponding to the second image extracted by the extracting unit in a manner that allows comparison with the second image.

2. A storage means for storing the first image and the abnormality area of ​​the first image as inspection information in association with each other, 2. The information processing apparatus according to claim 1, wherein the search means searches for inspection information stored in the storage means that corresponds to the second image.

3. The storage means stores position information of the abnormality area in the first image as the inspection information, 3. The information processing apparatus according to claim 2, wherein the search means searches for the inspection information stored in the storage means based on the second image and position information of the second image.

4. The storage means stores, as the inspection information, supplementary information of the abnormality area of ​​the first image, 3. The information processing apparatus according to claim 2, wherein the extraction means extracts an area corresponding to the second image from the inspection information corresponding to the second image searched for by the search means based on the supplementary information.

5. The extraction means extracts a partial region of the first image corresponding to the second image and a partial deformation region included in the partial region from the inspection information corresponding to the second image searched by the search means, The information processing apparatus according to claim 2 , characterized in that the generating means generates information that presents the partial area extracted by the extracting means and the partial abnormality area in a manner that allows comparison with the second image.

6. The information processing device described in claim 5, characterized in that the information presented in a comparable manner includes an image in which the partial deformed area extracted by the extraction means is superimposed on the second image, and an image of a partial area of ​​the first image displayed alongside the second image.

7. The information processing apparatus according to claim 5 , wherein the extraction means cuts out the partial region of the first image corresponding to the second image so as to include all of the abnormality regions present in the partial region.

8. An editing means for editing the partial deformation area, 6. The information processing apparatus according to claim 5, wherein the generating means reflects the result of editing the partial abnormality area by the editing means in the inspection information used for extraction by the extracting means.

9. The storage means stores a connection relationship between a plurality of partial regions and a connection relationship between a plurality of partial deformation regions as supplementary information of the inspection information, The extraction means extracts partial deformation areas from a plurality of pieces of inspection information corresponding to the second images searched by the search means, The information processing apparatus according to claim 5, wherein the extracted partial abnormality areas are combined based on the connection relationships.

10. The extraction means extracts the partial deformation area from each of a plurality of pieces of inspection information corresponding to the second image searched by the search means, The generating means generates a plurality of pieces of information capable of comparing the plurality of partial deformation areas extracted by the extracting means with the second image, The information processing apparatus according to claim 5 , wherein the plurality of pieces of information are switchable in response to a user operation.

11. The storage means stores an inspection target and an inspection time as supplementary information of the inspection information, The search means searches for inspection information of the same inspection object at a different inspection time based on incidental information of the inspection information corresponding to the second image from the inspection information stored in the storage means, The extraction means extracts a partial region and a partial deformation region of the first image corresponding to the second image from inspection information corresponding to the second image searched by the search means, the partial region and the partial deformation region of the first image corresponding to the second image from inspection information at different inspection times, The information processing apparatus according to claim 5 , wherein the generating means generates information that enables a comparison of the plurality of partially affected areas extracted by the extracting means with respect to the second image in the order of the inspection time.

12. A plurality of partial regions of the first image are displayed on the second image in an overlapping manner in the order of the inspection time, The information processing device according to claim 11, characterized in that a partial deformation area of ​​a partial area located at the forefront among a plurality of partial areas of the first image is displayed superimposed on the deformation area of ​​the second image.

13. The first image is an image of the inspection target captured in the past, The second image is an image of the same inspection target as the first image, 2. The information processing apparatus according to claim 1, further comprising a communication means for transmitting the information to be presented in a comparable manner, generated by the generation means, to a client device capable of communicating with the information processing apparatus.

14. A step in which a search means searches for inspection information that associates a first image taken of an inspection object with a deformation area of ​​the first image, the first image corresponding to a second image taken of the inspection object; An extraction means extracts an area corresponding to the second image from the searched inspection information corresponding to the second image; A method for processing information, comprising: a generating step of generating information that presents the extracted area corresponding to the second image in a manner comparable to the second image.

15. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 13.

Images