Information processing apparatus, method for controlling information processing apparatus, and program

The information processing device efficiently determines deformation progression in structures by selecting and correlating important deformations in images taken at different times, addressing inefficiencies in existing methods.

JP2024166300AActive Publication Date: 2024-11-28CANON KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024155132
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-09-09
Publication Date
2024-11-28
Estimated Expiration
2040-09-29

AI Technical Summary

Technical Problem

Existing methods for determining deformation changes in structures, such as bridges and tunnels, are inefficient due to positional deviations in images taken at different times, making it time-consuming to find correspondence between deformations while considering these deviations.

Method used

An information processing device that selects partial areas of interest in images taken at different times, determines corresponding areas, and generates display data to efficiently calculate the degree of deformation progress by focusing on important deformations.

Benefits of technology

Enables efficient determination of deformation progression over time, even with numerous deformations, by prioritizing important deformations and reducing processing time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166300000001_ABST
    Figure 2024166300000001_ABST
Patent Text Reader

Abstract

To efficiently determine the state of changes over time of deformations even when a number of deformations are present in a structure.SOLUTION: An information processing apparatus comprises: determination means that determines a partial area of a first image that is an image of a structure in a first period, and determines a partial area corresponding to the partial area in the first image in a second image that is an image of the structure in a second period after the first period; and generation means that, on the basis of a first deformation included in the partial area of the first image and a second deformation included in the partial area of the second image, generates display data for displaying the degree of progress of the second deformation from the first deformation.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a technique for determining deformation changes in a structure. [Background technology]

[0002] When inspecting structures such as bridges and tunnels, it is necessary to understand the extent to which deterioration (changes over time) such as cracks and exposed rebar on the structure's walls has progressed in order to determine the soundness of the structure's components. In particular, when judging the soundness, the progress of deterioration that has a large impact on the function of the structure, such as thick cracks and widespread exposed rebar, is given importance.

[0003] In infrastructure inspections using images, abnormalities are detected from images of the wall surface of the structure taken at different times, and the degree of progression (degree of progression) of each abnormality is calculated by finding the difference between the detected abnormalities. Patent Document 1 describes how cracks with similar features in images taken at different times are considered to be the same crack, and their degree of progression is calculated. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-20220 A Summary of the Invention [Problem to be solved by the invention]

[0005] Since the shooting conditions such as the shooting position and weather change each time a photograph is taken, even if the images are taken of the same wall surface of the same structure, each pixel between the images contains a positional shift. Therefore, in order to determine the state of aging of the deformation, it is necessary to determine the correspondence between the deformations while taking this shift into account. However, a large number of deformations occur on the wall surface of a structure that has aged over the years. Therefore, it takes a lot of time to determine the correspondence between all the deformations detected from images taken at different times while taking into account the shift between the images.

[0006] The present invention has been made in view of the above problems, and aims to provide a technique for efficiently determining the state of aging deterioration. [Means for solving the problem]

[0007] In order to solve this problem, for example, an information processing device of the present invention has the following arrangement. a determination means for determining a partial area of ​​a first image, which is an image of a structure at a first time, and determining a partial area of ​​a second image, which is an image of the structure at a second time after the first time, that corresponds to the partial area of ​​the first image; and a generating means for generating display data for displaying a degree of progress from the first deformation to the second deformation based on a first deformation included in the partial area of ​​the first image and a second deformation included in the partial area of ​​the second image. Effect of the Invention

[0008] According to the present invention, even when a large number of abnormalities exist in a structure, the state of aging of the abnormalities can be efficiently determined. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram for explaining an outline of the present invention. [Diagram 2] Hardware configuration diagram and functional block diagram. [Diagram 3]FIG. 13 is a diagram for explaining the relationship between deformation data and an image. [Figure 4] 4 is a flowchart showing the processing content of the first embodiment. [Diagram 5] FIG. 13 is a diagram for explaining an example of selecting an important abnormality. [Figure 6] FIG. 11 is a diagram for explaining an example of setting a search range. [Figure 7] FIG. 13 is a diagram for explaining an example of calculating a consistency degree. [Figure 8] FIG. 13 is a diagram for explaining an example of determining a reference deformation. [Figure 9] FIG. 11 is a functional block diagram of a second embodiment. [Figure 10] 10 is a flowchart showing the process of the second embodiment. [Figure 11] FIG. 13 is a diagram for explaining the correspondence between deformation groups. [Figure 12] FIG. 13 is a diagram for explaining the progression of a deformation group. [Figure 13] FIG. 13 is a functional block diagram of a third embodiment. [Figure 14] 13 is a flowchart showing the process of the third embodiment. [Figure 15] FIG. 13 is a diagram for explaining deformation groups of different sizes. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0011] [First embodiment] As a first embodiment, an example of a method for calculating the degree of progression of a deformation of an inspection target using two images taken at different times will be described. In particular, in this embodiment, an information processing device for performing so-called infrastructure inspection, such as judging the soundness of a structure such as a bridge, will be described as an example. Terms used in the description of this embodiment are defined as follows.

[0012] In describing an information processing system for infrastructure inspection, the term "inspection target" refers to a concrete structure or the like. The user of the information processing system described in this embodiment aims to inspect the inspection target for abnormalities such as cracks on its surface based on captured images. In the case of a concrete structure, "defects" refer to, for example, cracks, lifting, and spalling of the concrete. Other examples include efflorescence, exposed rebar, rust, water leakage, dripping, corrosion, damage (missing parts), cold joints, deposits, and junk.

[0013] The "first image" and the "second image" are images of the same wall surface of the same structure taken at different times. In this embodiment, the time when the first image was taken refers to a time several years after the time when the second image was taken.

[0014] The outline of this embodiment will be described using an example of calculating the degree of progress indicating the state of crack aging. FIGS. 1(a) and 102 show images 101 and 102 of a bridge wall taken at different times as an example of an infrastructure structure. The image 101 was taken many years after the image 102. A large number of cracks occur on the wall of the infrastructure structure due to aging. Therefore, a large number of cracks exist in the taken images 101 and 102. FIG. 1(c) shows crack data 111 corresponding to the image 101, and FIG. 1(d) shows crack data 112 corresponding to the image 102. The broken and solid lines of the crack data 111 and 112 indicate fine cracks and thick cracks with different crack widths. The crack data is data that, for example, an inspecting engineer inputs the positions and shapes of deformations such as cracks and exposed rebar based on the images and records them in association with the images. As another method of acquiring crack data, for example, it is possible to acquire the data by detecting cracks from images using a model previously trained by machine learning. Note that the images 101, 102 and the crack data 111, 112 include many cracks that are not shown on the paper.

[0015] When judging the soundness of a component, the progression of cracks present on the component surface is confirmed. In order to calculate the progression of a crack, it is necessary to compare cracks taken at different times one by one and determine the differences in crack length, crack width, etc. At this time, the differences between cracks taken at different times include positional and shape deviations caused by differences in shooting conditions, etc. Furthermore, differences due to the progression of the crack itself due to aging are also included. In order to calculate the progression of a crack, it is necessary to determine the correspondence relationship of the cracks while taking these deviations and differences into account.

[0016] If the process of finding the correspondence is performed for all cracks indicated by the crack data 111, it will take a very long time. Therefore, the correspondence is found only for cracks that should be emphasized in determining the soundness. For example, from the crack data 111, thick cracks 121 and 122 that are likely to affect the function of the component are selected. Then, a process is performed to find cracks corresponding to the selected cracks 121 and 122 from the crack data 112. As a method of finding the correspondence between cracks, for example, there is a method of determining based on the degree of overlap when the crack shapes are overlapped. FIG. 1(e) shows the state in which the crack 121 is overlapped on the crack data 112 and the area 131 is enlarged. From FIG. 1(e), the crack with the highest degree of overlap with the crack 121 is found to be the crack 132. After that, the crack progression is calculated using the cracks 121 and 132. The degree of crack progression is calculated, for example, by calculating the difference between the total length of the crack and the maximum crack width.

[0017] As described above, even if a large number of cracks have occurred on the surface of a component, the degree of progression can be efficiently calculated by selecting only the cracks that are important in determining the soundness.

[0018] <Information processing device> FIG. 2(a) is a hardware configuration diagram of an information processing device 200 according to this embodiment. As shown in FIG. 2(a), the information processing device 200 includes a CPU 201, a ROM 202, a RAM 203, a HDD 204, a display unit 205, an operation unit 206, and a communication unit 207. The CPU 201 is a central processing unit (Central Processing Unit) that performs calculations and logical judgments for various processes and controls each component connected to a system bus 208. The ROM (Read-Only Memory) 202 is a program memory that stores programs for control by the CPU 201, including various processing procedures described later, and the RAM (Random Access Memory) 203 is used as a temporary storage area such as the main memory and work area of ​​the CPU 201. The program memory may be realized by loading a program into the RAM 203 from an external storage device connected to the information processing device 200.

[0019] The HDD 204 is a hard disk for storing electronic data and programs according to this embodiment. An external storage device may be used to fulfill a similar role. Here, the external storage device may be realized, for example, by a medium (recording medium) and an external storage drive for realizing access to the medium. Known examples of such media include flexible disks (FDs), CD-ROMs, DVDs, USB memories, MOs, and flash memories. The external storage device may also be a server device connected via a network.

[0020] The display unit 205 is, for example, a CRT display or a liquid crystal display, and is a device that outputs an image on a display screen. The display unit 205 may be an external device connected to the information processing device 200 by wire or wirelessly. The operation unit 206 has a keyboard and a mouse, and accepts various operations by a user. The communication unit 207 performs two-way communication by wire or wirelessly with other information processing devices, communication devices, external storage devices, etc., using known communication technology.

[0021] <Function block diagram> 2(b) is an example of a block diagram showing the functional configuration of the information processing device 200. Each of these functional units is realized by the CPU 201 loading a program stored in the ROM 202 into the RAM 203 and executing processing in accordance with each flowchart described below. Then, the execution result of each processing is stored in the RAM 203. Also, for example, when configuring hardware as an alternative to software processing using the CPU 201, it is sufficient to configure a calculation unit or circuit corresponding to the processing of each functional unit described here.

[0022] The management unit 222 manages images taken at different times, deformation data corresponding to each image, and structural information related to structures stored in the storage unit 221 (e.g., HDD 204). The important deformation selection unit 223 selects deformation data for which the degree of progress is to be calculated as an important deformation from the first deformation data. The search range setting unit 224 sets a range for searching the second deformation data for deformations corresponding to the important deformation selected by the important deformation selection unit 223. The consistency calculation unit 225 performs a process of calculating the consistency using the deformations and important deformations in the search range. The reference deformation determination unit 226 determines the deformation corresponding to the important deformation as the reference deformation based on the calculation result of the consistency degree. The progress calculation unit 227 performs a process of calculating the difference between the important deformation and the reference deformation as the progress degree.

[0023] <Explanation of the relationship between images and deformation data and structural information> In explaining this embodiment, the relationship between the image and the deformation data, and the structural information will be explained. In image inspection, it is preferable to manage the image of the wall surface of the structure in association with its design drawing. FIG. 3(a) shows a state in which an image 311 of the wall surface of a bridge is pasted onto a drawing 300 as an example of an infrastructure structure. The drawing 300 has drawing coordinates 301 with a point 302 as the origin. The position of the image on the drawing is defined by the vertex coordinates of the upper left of the image. For example, the coordinates indicating the position of the image 311 on the drawing are the position (x312, y312) of the vertex 312. The image is stored in the storage unit 221 together with the coordinate information. In this embodiment, the image used in the image inspection of the infrastructure structure is taken at a high resolution (e.g., 1 mm per pixel) so that minute cracks and the like can be confirmed. For this reason, the size of the image of the structure used for inspection is large. For example, the image 311 in FIG. 3(a) is an image of a bridge deck of 20 m x 10 m. When the image resolution is 1.0 mm per pixel (1.0 mm / pixel), the image size of image 311 is 20,000 pixels by 10,000 pixels. Image 311 captured at high resolution contains many (e.g., 1000 or more) cracks, exposed rebars, and other abnormalities, but since it is difficult to display all of the abnormalities on paper, only a portion of the abnormalities are displayed on paper. In the following explanation, even in diagrams that display wide-range images and abnormality data, only a portion of the abnormalities are displayed.

[0024] The deformation data is information that records the results of automatic detection of deformations such as cracks on a concrete wall surface or the results of human input. In explaining this embodiment, it is assumed that the deformation data is managed in association with a drawing. FIG. 3(b) shows a state in which deformation data 321 corresponding to an image 311 is pasted on a drawing 300 at the same position as the image 311. The deformation data 321 contains a large number of deformations (e.g., more than 1000), including deformations that are not displayed on the paper. The position on the drawing of each deformation data in the deformation data 321 is defined by the pixel coordinates that constitute the deformation data. FIG. 3(c) shows an example of a deformation data table 331 that represents the data structure of the deformation data. The first and second fields in this deformation data table 331 indicate an ID for identifying the deformation and the type of deformation. In addition, the coordinate string and the numerical value string in the third and fourth fields of the deformation data table 331 are attribute values ​​that represent a plurality of coordinates that constitute the deformation data and the width of the deformation at the coordinates. For example, crack C001 is represented by n consecutive pixels from (Xc001_1, Yc001_1) to (Xc001_n, Yc001_n). The fifth to seventh fields in the deformation data table 331 store the maximum width, total length / contour length, and area.

[0025] In this manner, in this embodiment, the deformation data is represented by pixels. The deformation data may be represented by vector data such as polylines and curves consisting of multiple points. When the deformation data is represented by vector data, the data volume is reduced and the representation is simpler. An example of deformation data other than cracks is exposed rebar with ID T001. When exposed rebar is represented by polylines, it becomes a deformation having an area surrounded by the polylines. Note that the attribute information held by the deformation data is not limited to the attribute information shown in the deformation data table 331, and other attribute information may be held.

[0026] The structural information is information related to the structure of the structure to be inspected, and includes specifications such as the type and basic structure of the structure, various dimensions of the structure, member information, and completion year. Furthermore, the repair record may include information related to maintenance such as the repair year, repair location, and repair method. In this embodiment, structural information related to a specific position of the structure, such as member information and repair information, is stored together with position information on the drawing. That is, the position on the drawing of each member and the position on the drawing of the repair location are stored as part of the structural information. Therefore, the correspondence between the structural information and the image and the deformation data can be obtained via the drawing. The structural information is stored in the storage unit 221 together with the image and the deformation data, and can be acquired by the management unit 222. Note that the information included in the structural information is not limited to the above information, and other information may be held. In addition, information limited to each type may be held according to the type of the structure.

[0027] <Flowchart> FIG. 4 is a flowchart showing the flow of main processing of the information processing device in this embodiment. Hereinafter, each process (step) will be described with S added to the beginning of the code. In this embodiment, in order to calculate the degree of progress of the deformation occurring on the wall surface of the structure, first and second images taken at two different times are used. The time when the first image was taken is assumed to be several years (for example, 5 years) after the time when the second image was taken. Both the first and second images are assumed to be images of a large number (for example, 1,000 or more) of deformations occurring on the wall surface of the structure. Data in which the deformation is detected from the first image is assumed to be the first deformation data, and data in which the deformation is detected from the second image is assumed to be the second deformation data. In this embodiment, an input for starting processing is received from the operation unit 206, and the processing of the flowchart in FIG. 4 is started. Then, when the calculation processing of the degree of progress is completed, display data showing the calculation result of the degree of progress is displayed on the display unit 205, and the processing ends. Hereinafter, the processing of this embodiment will be described according to the flowchart in FIG. 4.

[0028] <Selection of important changes> In S401, the important deformation selection unit 223 selects a deformation to be calculated as an important deformation from the first deformation data corresponding to the first image. For example, an important deformation can be selected based on attribute information of the deformation data. In this embodiment, a method of selecting an important deformation from the first deformation data based on the maximum width of the deformation data will be described as an example of a method of calculating the progress of a crack.

[0029] FIG. 5(a) shows a first image 501 pasted at coordinates 503 on a drawing 500, and FIG. 5(b) shows first deformation data 502 in the first image 501. The size of the first image 501 is 20,000 pixels by 10,000 pixels. The dashed lines and solid lines in the first deformation data 502 indicate cracks with a maximum width of less than 1.0 mm and cracks with a maximum width of 1.0 mm or more, respectively. The first image 501 and the first deformation data 502 contain many deformations that are not shown on paper.

[0030] As a method for selecting an important deformation from the first deformation data 502, for example, there is a method for selecting deformation data having a maximum width equal to or greater than a reference value as an important deformation to be used for determining the state of aging. The determination formula is shown in the following formula (1). W≦W c …(1) Here, the parameter Wc is the maximum width value of each deformation data, and the parameter W is a reference value (or threshold value) for determining whether or not a deformation is an important deformation. As one method for determining the parameter W in this embodiment, a uniform reference value that is predetermined for the entire structure for each deformation type is used as a threshold value. For example, if the reference value W is 1.0 mm when the deformation type is a crack, the deformations 511 and 512 of solid lines indicating thick cracks of 1.0 mm or more are selected as important deformations in the deformation data 502. As another method for determining the parameter W, there is a method for using a reference value that is predetermined for each structural information. FIG. 5(c) shows an example of a list 521 of different reference values ​​for each structure in a bridge. The correspondence between the image / deformation data and the structure of the structure can be obtained through a drawing. Therefore, the reference value for selecting an important deformation can be switched according to the structure to be inspected. These reference values ​​may be experimentally obtained values, or may be determined based on a past DB that accumulates inspection results. In addition, as another method for determining the parameter W, the user may be allowed to directly specify it. When a user specifies a reference value, it is desirable to be able to specify the range of the reference value as desired. For example, the reference value may be specified on an image-by-image or partial-image basis, or on a structural information basis (e.g., for each component or structure).

[0031] As another method for selecting important variations based on the maximum width, for example, the top 10 deformation data with the largest maximum width may be selected as important variations. By fixing the number of selected important variations, it is possible to suppress an increase in the processing time for calculating the progress degree. As another method, the top 1% of deformation data in descending order of maximum width may be selected as important variations.

[0032] So far, we have explained an example of selecting important variations using the maximum width, which is one of the attribute information, but the attribute information used is not limited to the maximum width. For example, cracks with a length equal to or greater than a reference value can be selected as important variations based on the total length, which indicates the crack length. The formula (1) for determining whether or not a variation is important, and the method for determining the crack length reference value (parameter W), etc. can be the same as when the maximum width is used.

[0033] As another method for selecting a significant deformation, a composite deformation that combines multiple deformation data may be selected. As an example of a composite deformation, FIG. 5(d) shows a lattice crack 531 that combines cracks of the same type. When multiple cracks intersect to form a lattice, the concrete wall surface in the area 532 surrounded by diagonal lines is likely to peel off. As a result, the possibility of concrete falling or deterioration inside the structure due to exposed rebar increases. Therefore, it is desirable to select a composite deformation consisting of multiple identical deformations, such as the lattice crack 531, as a significant deformation. Any method can be used to identify a lattice crack. For example, when multiple cracks whose shapes overlap are selected like a rosary to form a closed area, the selected multiple cracks can be identified as lattice cracks. Another composite deformation that combines multiple deformation data may be a composite deformation that combines deformations of different deformation types. For example, there is a composite deformation 533 in which efflorescence occurs near a crack, as shown in FIG. 5(e). Cracks accompanied by precipitation may progress inside the structure, and have a high impact on the function of the structure. Therefore, it is desirable to select a deformation such as the complex deformation 533 as an important deformation. In addition, complex deformations such as cracks accompanied by precipitation can be identified based on the type of deformation, the shape of the deformation, and the relative positional relationship. As another method for selecting an important deformation, an important deformation may be selected using structural information. For example, in a wall surface where reinforcing bars are laid near the surface of a structure, when the concrete on the wall surface peels off, the reinforcing bars are exposed, and deterioration of the structure is likely to progress. Therefore, it is desirable to select a deformation near a wall surface where member materials such as reinforcing bars are laid inside as an important deformation. Since information on structural members such as reinforcing bars and member materials is stored in the storage unit 221 as structural information, the relative positional relationship between the image or deformation data and the reinforcing bars inside the structure can be obtained through a drawing.

[0034] <Search range settings> In S402, the search range setting unit 224 sets a search range for searching the second deformation data for a deformation corresponding to the major deformation. A method for setting this search range will be described with reference to FIG.

[0035] 6(a) is a diagram showing the first deformation data 611, and FIG. 6(b) is a diagram showing the second deformation data 621. Both deformation data are pasted at the same position on the drawing 600. Of the first deformation data 611, deformations 612 and 613 indicated by solid lines are regarded as important deformations selected by the important deformation selection unit 223.

[0036] One method for setting the search range is to use the coordinate information of the important deformation. Specifically, the rectangular ranges 614 and 615 surrounding the important deformations 612 and 613 on the first deformation data 611 are set as the search range for each important deformation. The size of the search range may be changed to any size as long as it is a rectangular range that surrounds the coordinate information of the important deformation. For example, the rectangular range surrounding the important deformation is set as the initial range, and a rectangular range expanded by any size in the X-axis and Y-axis directions on the drawing is set as the search range.

[0037] When the search range is determined using only the coordinate information of the important deformation, a part of the second deformation data may be divided near the boundary of the search range. FIG. 6(c) shows a part of the area 631 of the second deformation data 621 and a search range 632 determined using the coordinate information of the important deformation 612 as an example of a part of the deformation of the second deformation data being divided. The search range 632 in FIG. 6(c) divides the deformations 633 and 634 near the boundary. If a search range that divides the second deformation data is set, the consistency calculation process of S403 described later becomes complicated. Therefore, the rectangular range is expanded to include all the coordinates of the deformations 633 and 634. FIG. 6(d) shows the expanded search range 635. It is a preferable method to expand the search range in this way so as not to divide the second deformation data.

[0038] <Calculation of consistency> In S403, the consistency calculation unit 225 performs a process of calculating the consistency using the important anomaly and an anomaly within the search range. One method of calculating the consistency is to expand the shape of one anomaly and the important anomaly within the search range, or one of them, and calculate the degree of overlap between the anomalies as the consistency. An example of the consistency calculation process will be described with reference to FIG. 7.

[0039] FIG. 7(a) is a diagram showing an important deformation 701 selected by the important deformation selection unit 223 from the first deformation data. FIG. 7(b) is a diagram showing deformation data 711 included in the search range corresponding to the important deformation 701 from the second deformation data. In calculating the consistency, first, one deformation 712 is selected from the deformation data 711 as a reference deformation candidate. Next, a process is performed to overlap the shape of the deformation 712 and the important deformation 701. At this time, in order to take into account the positional deviation included between the first deformation data and the second deformation data, the shape of the deformation is expanded before being overlapped. FIG. 7(c) shows the state in which the expanded important deformation 702 and the expanded reference deformation candidate 713 are overlapped. Then, the degree of overlap between the important deformation 702 and the reference deformation candidate 713 is calculated as the consistency. This consistency C is calculated, for example, according to the following formula (2). C = {S1Λ S2} / {S1V S2} …(2) In the formula, "Λ" indicates logical product and "V" indicates logical sum. Furthermore, parameter S1 indicates the area of ​​the important deformation 702 after expansion, and parameter S2 indicates the area of ​​the reference deformation candidate 713 after expansion. According to formula (2), if the deformations match, the consistency degree C is 1, and if the deformations do not overlap at all, the consistency degree C is 0. In other words, when the degree of overlap between deformations is calculated as the consistency degree, the possible range of the consistency degree is 0 to 1.

[0040] After calculating one consistency level using formula (2), the important variation is left fixed, and another variation is selected from the variation data within the search range as the next reference variation candidate, and the consistency level is calculated. By repeating this consistency level calculation process, the consistency levels for all variation data within the search range are calculated.

[0041] As another method for calculating the consistency, a feature calculated from the deformation data may be used. As an example, the formula for calculating the consistency C using the area center coordinate of the deformation is shown in formulas (3) and (4). C=1 / {(S 1x - S 2x ) 2 + (S 1y - S 2y ) 2} 1 / 2 …(3) C=C c …(4) Here, the parameter S 1x ,S 1y is the area center coordinate of the important deformation (S 1x ,S 1y ) and the parameter S 2x ,S 2y is the area center coordinate of the reference deformation candidate (S 2x ,S 2y ) Parameter C c is a fixed value when the area centroid coordinates of the deformations coincide, and is an arbitrary constant greater than 1. From formula (3), the greater the distance between the area centroids of the deformations, the smaller the consistency C value. Conversely, when the area centroids of the deformations coincide, the constant C with the highest consistency is c It becomes.

[0042] <Determination of reference deformation> In S404, the reference variation determination unit 226 performs a process of determining a reference variation corresponding to a significant variation based on the result of the consistency degree calculation. An example of determining a reference variation using the consistency degree will be described with reference to FIG. 8. Here, the consistency degree used in this embodiment is the consistency degree calculated based on the degree of overlap between variations. Therefore, the possible values ​​of the consistency degree are 0 to 1, and the closer to 1 the value, the higher the consistency relationship between the variations.

[0043] 8(a) and (b) are diagrams showing an important deformation 801 to be calculated as a consistency degree and deformation data 802 within a search range corresponding to the important deformation 801. An ID consisting of numbers starting with "CR" is written next to each deformation on the deformation data 802. FIG. 8(c) shows a consistency degree list 803 calculated for each of the important deformations 801 and the deformations (reference deformation candidates) on the deformation data 802. As one method of determining the reference deformation based on the consistency degree, the deformation with the highest consistency degree is determined as the reference deformation. For example, the deformation with the highest consistency degree (ID: CR001) in the consistency degree list 803 in FIG. 8(c) is determined as the reference deformation. When there is only one maximum consistency degree, as in the consistency degree list 803, the reference deformation can be uniquely determined using the consistency degree.

[0044] On the other hand, when there are multiple variations with the highest consistency level as in Fig. 8(d), it is not possible to uniquely determine the reference variation. In such a case, it is desirable to generate image data showing the multiple variations with the highest consistency level and the important variation, display them on the display unit 205, and allow the user to determine the reference variation.

[0045] In the consistency calculation result, the maximum consistency value may be close to 0 (e.g., 0.1). In this case, the reference deformation can be uniquely determined based on the consistency, but there is a high possibility that it is not appropriate as a reference deformation in the first place. In such a case, if the calculated maximum consistency value is lower than a predetermined reference value (e.g., 0.2), it is desirable to generate image data showing the reference deformation and important deformation together with the maximum consistency value, display it on the display unit 205, and allow the user to confirm, correct, and select the reference deformation.

[0046] If the calculated consistency is 0 or if the user does not specify a reference variation, it is determined that there is no reference variation corresponding to the important variation. In this case, the important variation itself is determined to have progressed in the progress calculation process of S405 described later. Note that, although an example of determining the reference variation based on the consistency in S404 has been described, this is not limiting. For example, the variation that is the shortest distance from the coordinate position of the important variation among the variations included in the second image may be determined as the reference variation. Also, the reference variation may be determined based on the user's selection.

[0047] <Calculation of progress> In S405, the progress calculation unit 227 calculates the progress of the important deformation using the important deformation and the reference deformation. In this embodiment, a process is performed to obtain the difference in the attribute values ​​of the deformation data as the progress. For example, if the deformation type is a crack, the difference in the maximum width and total length is calculated. The maximum width and total length of the crack are stored in the storage unit 221. Therefore, the progress of the important deformation can be calculated by acquiring the maximum width and total length of each of the important deformation and the reference deformation and obtaining the difference between the deformations. Even if the deformation type is other than a crack, the progress can be calculated in a similar manner. For example, if the deformation type is exposed rebar, the difference in area is calculated as the progress. The area of ​​the deformation data is stored in the storage unit 221 as an attribute value. Therefore, the progress can be calculated by acquiring the areas of the important deformation and the reference deformation and obtaining the area difference between the deformations. Note that, although a configuration for determining the progress as information indicating the state of aging of the deformation has been exemplified in S405, this is not limiting. For example, in S405, the information processing device 200 may be configured to obtain binary information such as "progressing" or "not progressing" as information indicating the state of aging.

[0048] Then, in S406, the progress degree calculation unit 227 outputs the calculated progress degree to the display unit 205, displays the calculated progress degree, and indicates the progress degree to the user. There is no particular limit to the display format of the progress degree, but a numerical value representing the progress degree may be displayed, or the deformation data may be displayed in a color according to the progress degree.

[0049] <Modification of the first embodiment> In the first embodiment, a method for selecting an important deformation from the first deformation data, obtaining a reference deformation corresponding to the important deformation from the second deformation data, and calculating the degree of progress has been described, but an embodiment in which an important deformation is selected from the second deformation data is also conceivable. That is, an important deformation is selected from the second deformation data corresponding to the past inspection results, a reference deformation corresponding to the important deformation is obtained from the first deformation data, and the degree of progress is calculated. This makes it possible to check, for example, how a deformation that was emphasized in determining the soundness of past inspection results has progressed.

[0050] According to the first embodiment described above, even if there are many abnormalities such as cracks detected from images taken at different times, the degree of progression can be efficiently calculated by limiting the abnormalities to those that are important in determining the soundness.

[0051] [Second embodiment] In the first embodiment, an example of determining the degree of progress of some important deformations from among many deformations has been described. When determining the soundness of a structure, there are cases where it is desired to check the overall trend of deformation in addition to the degree of progress of some deformations. However, it is difficult to grasp the overall trend of deformation from the degree of progress of only some deformations. Therefore, in the second embodiment, an example of calculating the degree of progress of deformation data for each small area in addition to the degree of progress of some deformations is described. Specifically, an image is divided, deformation data is grouped for each divided area, and the degree of progress is calculated for each group. This makes it possible to determine the soundness of a structure or member while checking both the degree of progress of some deformations and the degree of progress of the overall deformation. Hereinafter, the second embodiment will be described, focusing on the difference from the first embodiment.

[0052] The hardware configuration of the information processing device 200 according to the second embodiment is similar to that of the first embodiment shown in FIG. 2(a), and therefore the description thereof will be omitted. FIG. 9 is a diagram showing an example of a functional block diagram of the information processing device 200 according to the configuration of the second embodiment. The configuration of the second embodiment is obtained by adding a first group setting unit 901 and a second group setting unit 902 to the configuration of the first embodiment shown in FIG. 2(b). The first group setting unit 901 is a functional unit of the CPU 201, and groups a part of the first deformation data to create a first deformation group. The second group setting unit 902 is a functional unit of the CPU 201, and creates a second deformation group corresponding to the first deformation group. In addition to the process of calculating the degree of progress of a part of the deformation, the progress degree calculation unit 227 performs a process of calculating the degree of progress for each deformation group using the first deformation group and the second deformation group.

[0053] Fig. 10 is a flowchart showing a part of the main processing executed by the information processing device 200 according to the second embodiment. In the flowchart of Fig. 10, it should be understood that the steps having the same numbers as those in the flowchart of Fig. 4 described in the first embodiment execute the same processing as in the first embodiment. In the case of the second embodiment, after the progress degree of the major abnormality is calculated in S405, the processing proceeds to S1001.

[0054] In S1001, the first group setting unit 901 performs a process of setting a first deformation group from the first deformation data. In the following S1002, the second group setting unit 902 sets a second deformation group corresponding to the first deformation group. Then, proceeding to S1003, the first deformation group and the second deformation group are used to calculate the degree of progress of the deformation group. For example, the number of deformations and the total length of deformations in the deformation group are tallied as the degree of progress of the deformation group, and the difference in the tallied data between the deformation groups is regarded as the degree of progress. Then, in S406, the progress degree calculation unit 227 performs a process of displaying the calculated degree of progress on the display unit 205, and the process ends.

[0055] <First group settings and second group settings> Next, the setting of the first deformation group in S1001 and the setting of the second deformation group in S1002 will be described in order with reference to FIG. 11. The deformation data in this second embodiment is cracks on the surface of a structure, as in the first embodiment. The first image and the second image, and the deformation data corresponding to each image, are all pasted at the same position on the same drawing. FIG. 11(a) shows a first image 1101, and FIG. 11(b) shows first deformation data 1102 showing the deformation included in the first image 1101. FIG. 11(c) shows a second image 1121, and FIG. 11(d) shows second shape data 1122 showing the deformation included in the second image 1121.

[0056] In the process of S1001, the first group setting unit 901 sets a first deformation group from the first deformation data. As a method for setting the first deformation group, an example of dividing the first image and grouping the first deformation data for each divided area will be described. First, the first group setting unit 901 divides the first image 1101 into an arbitrary fixed size. The lattice-shaped line segments 1111 are line segments that divide the first image 1101 at equal intervals in the X-axis and Y-axis directions, and divide the first image 1101 at intervals of, for example, 1,024 pixels. Next, the first group setting unit 901 selects one area 1112 surrounded by diagonal lines from among the divided areas, and acquires the upper left vertex coordinates 1113 and area size of the area 1112. Then, the first group setting unit 901 sets a diagonal line area 1114 at the same position and size as the area 1112 on the first deformation data 1102. Thereafter, the deformation data included in the shaded area 1114 is grouped to form a first deformation group 1115. By repeating the above process for each divided area, the first deformation group can be set for the entire image. Here, an example of dividing the first image 1101 at equal intervals has been described, but the image may be divided at any interval. For example, the image may be divided at intervals of 1,024 pixels in the X-axis direction and 512 pixels in the Y-axis direction to create the first deformation group in rectangular area units.

[0057] In the subsequent process of S1002, the second group setting unit 902 sets a second deformation group corresponding to the first deformation group. For example, a method of setting the second deformation group is to group the second deformation data included in the same position and the same range as the first deformation group. Here, an example of setting the second deformation group corresponding to the first deformation group 1115 will be described. First, the second group setting unit 902 acquires the upper left vertex coordinate 1116 and the area size of the hatched area 1114. Next, the second group setting unit 902 sets a hatched area 1131 in the same position and the same range as the hatched area 1114 on the second deformation data 1122 in FIG. 11(d). Then, the second deformation data included in the hatched area 1131 is grouped to form a second deformation group 1132. In this way, the second deformation group can be set by associating groups of deformation data in the same position and the same range with each other.

[0058] Normally, since the shooting conditions are different when shooting at different times, even when the same wall surface of the same structure is shot, there is a positional shift between each pixel of the first image and the second image. Therefore, there is also a positional shift between the first deformation data and the second deformation data. The above example is an example in which this positional shift is ignored and the first deformation group and the second deformation group are simply created. The degree of deformation between the deformation groups is intended to capture the rough tendency of the progression, so it is not necessary to strictly correspond between the deformation groups. In this way, the method of simply creating the first deformation group and the second deformation group simplifies the group creation process.

[0059] On the other hand, when obtaining the correspondence between the deformation groups, the positional deviation may be taken into consideration. As an example of a method for obtaining the positional deviation between images, an outline of a process for obtaining the positional deviation for each region using image features will be described. First, one divided region on the first image is selected, and a partial image in the region is obtained. Next, the obtained partial image is superimposed on the second image, and the square sum of the brightness value difference of each pixel is calculated. This calculation process is repeated while shifting the superposition position, and the position where the calculation result is the smallest, that is, the positional deviation in region units, is obtained. By repeating this process for each divided region of the first image, the positional deviation between images can be obtained for the entire region unit. Here, as an example, the result of setting the second deformation group by reflecting the positional deviation from the first deformation group is shown in FIG. 11(e). FIG. 11(e) is a diagram showing a second deformation group 1141 obtained by correcting the positional deviation from the first deformation group 1115. In this way, the second deformation group can be set taking into consideration the positional deviation between images.

[0060] As another method for acquiring the positional deviation between the deformation groups, it may be determined based on the coordinate information of the important deformation. For example, at least one of the important deformations included in the first deformation group is selected, and the average of the area centroid coordinates of the important deformation is set as the start point of the positional deviation. Then, the average of the area centroid coordinates of the reference deformation corresponding to the selected important deformation is set as the end point of the positional deviation. The vector connecting this start point and the end point is set as the positional deviation of the first deformation group. In this way, by substituting the positional deviation of the important deformation for the positional deviation between the deformation groups, the second deformation group taking the positional deviation into consideration can be efficiently obtained.

[0061] <Calculation process of the degree of progression of the deformation group> In S1003, the progress calculation unit 227 calculates the progress between the deformation groups from the first deformation group and the second deformation group. In this embodiment, the progress is calculated using aggregated data obtained by aggregating deformation data within the deformation group. For example, when the deformation type is crack, the number of cracks, crack density, etc. are obtained as aggregated data for each of the first deformation group and the second deformation group. Thereafter, the progress calculation unit 227 calculates the difference between the aggregated data as the progress between the deformation groups.

[0062] 12(a) and (b) show examples of aggregated data 1201 and a progression degree 1202 between deformation groups when the deformation type is cracks. The aggregated data 1201 is a result of tallying the number of cracks, number density, total length, and average maximum width for each of the first deformation group and the second deformation group. Of the aggregated data 1201, the number can be obtained by counting the number of deformation data for each deformation group. The number density can be calculated using the number of deformation data, as well as the area size and image resolution of the deformation group. The total length and average maximum width can be calculated by aggregating the attribute values ​​of each deformation data within the deformation group. The progression degree 1202 can be calculated by finding the difference in aggregated data between deformation groups.

[0063] FIG. 12(c) shows an example of a visualization screen of the progress calculation result in the second embodiment. FIG. 12(c) is an example of displaying a visualization result 1212 in which the progress of the important deformation and the progress of the deformation for each area are visualized on a window 1211. The visualization result 1212 is a result of visualizing the progress related to the crack number density, and is expressed in different patterns for each area depending on the difference in the progress. In the visualization result 1212, an area with a higher pattern density is expressed as an area with a higher progress, and a suitable display method is to express each area with different brightness or different color depending on the progress. The cracks 1221 and 1222 on FIG. 12(c) indicate important deformations, and information related to the progress is written near the cracks, as in the progress information 1123. In this way, by simultaneously displaying the progress for each area and the progress of the important deformation, the user can easily check the progress of the important deformation and the overall progress trend of the deformation.

[0064] It is desirable that the user can switch the visualization contents of the progress on the visualization screen. For example, the CPU 201 switches the deformation data of the progress display target in the visualization result 1212 in accordance with the user's selection of the type selection item 1213. In response to the user's switching of the display data selection item 1214, the CPU 201 switches the display target of the deformation data in the visualization result 1212 (e.g., display only important deformations, display all deformations). In response to the user's switching of the progress display target item 1215, the CPU 201 switches the display target of the progress in the visualization result 1212 (e.g., number density, total length, maximum width average). In this way, it is a suitable method to enable the user to switch the contents to be confirmed. It is also desirable to be able to confirm the progress of important deformations and the progress of each area in detail. For example, an area is selected by selection using the progress display area selection 1216 or by clicking using the mouse 1224. Detailed progress information is displayed in accordance with the area selection. For example, in FIG. 12( c ), progress information corresponding to the selected area “A4-2” is displayed in the progress result 1217 .

[0065] As described above, according to the second embodiment, in addition to the degree of progress of a portion of the deformation, the degree of progress of the deformation in area units can be calculated. This makes it possible to determine the overall degree of progress of the deformation without determining the consistency of each of the deformation data with past deformation data. Furthermore, for important deformation data, it becomes possible to grasp the degree of progress in detail from past deformation data, such as the amount of change in crack width.

[0066] [Third embodiment] In the second embodiment, an example of calculating the degree of progress of the deformation in units of regions in addition to the degree of progress of some of the deformations has been described. The deterioration state of a structure varies greatly from part to part due to various factors. Therefore, there are cases where it is desired to check the degree of progress of the deformation in detail in some parts. However, when calculating the degree of progress of the deformation in a fixed region size, it is necessary to reduce the region size in order to grasp the degree of progress in detail, which significantly increases the processing time. Therefore, in the third embodiment, an example of calculating the degree of progress of the deformation in different region sizes for each part will be described. By changing the region size for grouping the deformations according to the part, it is possible to grasp the degree of progress of the deformation in a specific part in detail while suppressing the increase in processing time. Hereinafter, the third embodiment will be described, focusing on the difference from the second embodiment.

[0067] The hardware configuration of the information processing device 200 according to the third embodiment is similar to that of the first embodiment shown in Fig. 2(a), and therefore description thereof will be omitted. Fig. 13 is a diagram showing an example of a functional block diagram of the information processing device 200 according to the configuration of the third embodiment. In this third embodiment, a division size acquisition unit 1301 is added to the configuration shown in the second embodiment (Fig. 9). The division size acquisition unit 1301 is a functional unit of the CPU 201, and acquires the size of a range into which a part of the first deformation data is grouped.

[0068] Fig. 14 is a flowchart showing a part of the main processing executed by the information processing device 200 according to the third embodiment. In the flowchart of Fig. 14, it should be understood that the same processing as in the second embodiment is executed in the steps having the same numbers as those in the flowchart of Fig. 10 described in the second embodiment. In the case of the third embodiment, after the progress degree of the major abnormality is calculated in S405, the processing proceeds to S1401.

[0069] In S1401, the first group setting unit 901 performs a process of dividing the first deformation data and setting a first deformation group based on the division size acquired by the division size acquisition unit 1301. In the following S1002, the second group setting unit 902 sets a second deformation group corresponding to the first deformation group. Then, the process proceeds to S1003, where the progress degree calculation unit 227 calculates the progress degree of the deformation group using the first deformation group and the second deformation group. Then, in S406, the progress degree calculation unit 227 causes the display unit 205 to display the progress degree calculation result, and this process ends.

[0070] <First group setting of different sizes> The process of setting the first deformation group with different sizes in S1401 will be described with reference to Fig. 15. The deformation data in this embodiment is set to be cracks on the surface of a structure, similar to the second embodiment.

[0071] In S1401, the first group setting unit 901 divides the first deformation data based on the division size acquired by the division size acquisition unit 1301, and sets a first deformation group for each division area. As a method for determining the division size of the first deformation data, there is a method for determining the division size based on the structure information. FIG. 15(a) shows an example of a list 1501 of different division sizes for each part of a bridge. FIGS. 15(b) and 15(c) show an example of dividing the first deformation data using the list 1501 of division sizes. FIG. 15(b) is a diagram showing first deformation data 1502 corresponding to a bridge deck image and a grid-like division line 1511. The size of the hatched area 1512 on FIG. 15(b) is 512 pixels by 512 pixels. FIG. 15(c) is a diagram showing first deformation data 1503 corresponding to a bridge pier image of a bridge and a grid-like division line 1521. The size of the hatched area 1522 in FIG. 15(c) is 1,024 pixels by 1,024 pixels. The correspondence between each deformation data and the structural information can be found via the drawing. Therefore, by using the structural information, the degree of deformation of only a specific portion can be found in detail. As a method for determining the division sizes shown in the division size list 1501, an experimentally determined value may be used, or a user-specified division size may be used.

[0072] As another method for determining the division size of the first deformation data, the division size may be determined based on the distribution of deformation. Specifically, the distribution (density) of deformation is obtained in advance in the first deformation data. Then, the first deformation data is divided into different sizes according to the distribution of deformation. FIG. 15(d) shows an example in which the first deformation data 1531 is divided into different sizes according to the distribution of deformation. In the first deformation data 1531, the division size is small near the center where deformations are dense, and the division size is large near the edge where deformations are sparse. In this way, by changing the division size based on the distribution of deformation, for example, the progress of deformation can be obtained in detail only in the area where deformations are dense.

[0073] As another method for determining the division size of the first deformation data, it may be determined based on the important deformation. For example, the division size of the first deformation data may be small near the important deformation and large at a position away from the important neighborhood. By grasping the progress of the deformation around the important deformation in detail, it becomes easier to determine the degree of the impact of the important deformation on the function of the structure and the possibility of the important deformation progressing in the future.

[0074] As another method for determining the division size of the first deformation data, it is possible to repeatedly divide the data into a plurality of different sizes (division at multiple division levels) to create a plurality of first deformation groups with different division sizes. For example, the entire first deformation data is divided into three division levels (1,024 pixels x 1,024 pixels, 512 pixels x 512 pixels, 256 x 256 pixels), and a first deformation group is set at each division level. Then, although detailed processing is omitted, the degree of deformation is calculated for each divided area. By dividing the first deformation data at multiple division levels in this way, it becomes possible to easily switch between a narrow detailed degree of deformation and a wide rough degree of deformation in the user's work of checking the degree of deformation. Note that the range of the first deformation data divided at multiple division levels may be limited to an arbitrary range for each division level. For example, at the first division level (1,024 pixels x 1,024 pixels), the entire first deformation data is divided, and at the second division level (256 x 256 pixels), only the area near the significant deformation on the first deformation data is divided.By limiting the range of the first deformation data for each division level, it becomes possible to check the detailed degree of progression only for a specific range while suppressing the increase in time required for progression calculation.

[0075] As described above, according to the third embodiment, it is possible to calculate the degree of progression of the deformation of a specific portion in detail while suppressing a significant increase in processing time.

[0076] In the above embodiment, a bridge has been used as an example of a structure to facilitate understanding, but the type of structure is not limited to this and may be other structures (e.g., buildings, dams, etc.).

[0077] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0078] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0079] 221: storage unit, 222: management unit, 223: importance selection unit, 224: search range setting unit, 225: post-matching calculation unit, 226: reference deformation determination unit, 227: progress calculation unit

Claims

1. a determination means for determining a partial area of ​​a first image, which is an image of a structure at a first time, and determining a partial area in a second image, which is an image of the structure at a second time after the first time, that corresponds to the partial area of ​​the first image; an information processing device comprising: a generating means for generating display data for displaying a degree of progress from the first deformation to the second deformation based on a first deformation included in the partial area of ​​the first image and a second deformation included in the partial area of ​​the second image.

2. The information processing apparatus according to claim 1 , wherein the partial regions are regions obtained by dividing the first image at equal intervals.

3. The information processing apparatus according to claim 1 , wherein the partial region of the first image and the partial region of the second image correspond to the same region of the structure.

4. The information processing device according to claim 1, further comprising a calculation means for calculating a degree of progress of the second deformation included in the partial area of ​​the second image from the first deformation based on the first deformation and the second deformation.

5. The information processing device according to claim 1, characterized in that, when the type of the deformation is a crack, the number of cracks or the crack density of the first deformation and the second deformation are obtained.

6. The information processing apparatus according to claim 1 , wherein the generating means generates the display data for displaying the partial area in accordance with the degree of progress.

7. The information processing apparatus according to claim 1 , further comprising: a step of switching a progress display target of the partial area in response to a user instruction.

8. a determining step of determining a partial area of ​​a first image, which is an image of a structure at a first time, and determining a partial area in a second image, which is an image of the structure at a second time after the first time, that corresponds to the partial area of ​​the first image; A control method for an information processing device, comprising: a generating process for generating display data for displaying a degree of progress from the first deformation to the second deformation based on a first deformation included in the partial area of ​​the first image and a second deformation included in the partial area of ​​the second image.

9. A program for causing a computer to function as each of the means included in the information processing device according to claim 1 when the computer reads and executes the program.

10. A selection means for selecting a part of the deformations among the multiple deformations included in a first image, which is an image of the structure at a first time, based on at least one of the information on the deformation, the information on the structure, and the information on two or more deformations; A determination means for determining a deformation corresponding to the deformation selected by the selection means from among a plurality of deformations included in a second image, which is an image of the structure at a second time different from the first time; An information processing device comprising: a generating means for generating display data for displaying a degree of progress of the deformation selected by the selection means or the deformation determined by the determining means based on the deformation selected by the selection means or the deformation determined by the determining means.

11. The information processing apparatus according to claim 10 , wherein the display data indicates a difference between the selected abnormality and the determined abnormality.

12. A selection process of selecting some of the deformations included in a first image, which is an image of the structure at a first time, based on at least one of the information on the deformation, the information on the structure, and the information on two or more deformations; A determination process for determining a deformation corresponding to the deformation selected by the selection process from among a plurality of deformations included in a second image, which is an image of the structure at a second time different from the first time; A control method for an information processing device, comprising: a generation process for generating display data for displaying the progress of the selected deformation or the determined deformation based on the deformation selected in the selection process and the deformation determined in the determination process.

13. A program for causing a computer to function as each of the means included in the information processing device according to claim 10 or 11 by reading and executing the program on a computer.

Citation Information

Patent Citations

  • Image processing apparatus, image processing method, and program

    JP2019020220A

  • Device and method for determining crack change

    JP2019211277A

  • Information processor, control method of information processor, and program

    JP2020096325A

  • Information processing device, information processing method, and program

    JP2022056085A

  • Deformation management device, deformation management method, and deformation management program

    JP6749528B1