Image processing device, method for controlling the image processing device, and program

Abstract

The present invention aims to provide an image processing device that can identify a deformed object and its background even when the colors of the deformed object superimposed on the image are similar. [Solution] The system includes an acquisition means for acquiring an image of a structure, and a display control means for superimposing a deformation object, which indicates the location of deformation of the structure, a first deformation object and a second deformation object different from the first deformation object, onto the image, wherein the display control means displays the contour colors of the first deformation object and the contour colors of the second deformation object in different colors.

Description

Technical Field

[0001] The present invention relates to an image processing apparatus, a control method for an image processing apparatus, and a program.

Background Art

[0002] In recent years, detecting deformation (for example, cracks) of a structure using image analysis has been carried out. For example, Patent Document 1 proposes a technique for displaying, on a screen, a result of detecting deformation of a structure from an image. Patent Document 1 can display, on the screen, the color and line type of a line indicating the position of each deformation to be different from each other according to the width of each deformation. Thereby, a user can visually recognize each deformation on the screen.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique of Patent Document 1, when a part of deformation objects whose colors are similar to each other overlaps with a target (a part of an image or another deformation object), there is a problem that it is difficult for a user to visually recognize each of the deformation object and the target.

[0005] Therefore, an object of the present invention is to provide an image processing apparatus capable of identifying each of a deformation object and its background even when the color of the deformation object superimposed on an image is similar to the color of its background.

Means for Solving the Problems

[0006] To achieve the object of the present invention, an image processing apparatus according to one embodiment of the present invention has the following configuration. That is, the image processing apparatus comprises acquisition means for acquiring an image of a structure, and display control means for superimposing a deformation object, which indicates the location of deformation of the structure, a first deformation object and a second deformation object different from the first deformation object, onto the image, wherein the display control means displays the contour color of the first deformation object and the contour color of the second deformation object in different colors. [Effects of the Invention]

[0007] According to the present invention, the objective is to provide an image processing device that can identify a deformed object and its background even when the colors of the deformed object superimposed on the image are similar. [Brief explanation of the drawing]

[0008] [Figure 1] A block diagram showing an example of the hardware configuration of an image processing device. [Figure 2] A block diagram showing an example of the functional configuration of an image processing device. [Figure 3] This figure shows an example of a screen for viewing image analysis results. [Figure 4] This figure shows an example of a parameter comparison viewing screen. [Figure 5] A flowchart illustrating an example of the processes performed by an image processing device. [Modes for carrying out the invention]

[0009] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] (First Embodiment) The first embodiment displays an image on the screen showing the location of structural deformation, and changes one or more of the hue, saturation, and brightness of the contour line of the deformation according to the type of deformation. Deformation refers to cracks that occur on the concrete surface of structures such as expressways, bridges, tunnels, and dams due to damage, deterioration, and other factors. Cracks refer to linear damage with a start point, end point, length, and width that occurs on the wall surface of a structure due to aging deterioration and earthquake impact.

[0011] Figure 1 is a block diagram showing an example of the hardware configuration of an image processing device.

[0012] In the embodiments described below, a computer operates as the image processing device 100. The processing of the image processing device in this embodiment may be implemented by a single computer, or it may be implemented by distributing each function across multiple computers as needed. The multiple computers are connected to each other in a way that allows them to communicate with one another.

[0013] The image processing device 100 includes a control unit 101, a volatile memory 102, a non-volatile memory 103, a storage device 104, an input device 105, an output device 106, a communication device 107, and a system bus 108.

[0014] The control unit 101 includes a CPU (Central Processing Unit) and an MPU (Micro Processor Unit), which are arithmetic processing processors that comprehensively control the entire image processing device 100.

[0015] The volatile memory 102 is a RAM (Random Access Memory) that temporarily stores programs and data supplied from external devices, etc.

[0016] The non-volatile memory 103 is a ROM (Read-Only Memory) that stores the program and parameters executed by the processor of the control unit 101.

[0017] The storage device 104 is an internal device such as a hard disk and a memory card built in the image processing apparatus 100 or an external device such as a hard disk and a memory card detachably connected to the image processing apparatus 100. The storage device 104 includes memory cards and hard disks composed of semiconductor memories and magnetic disks. The storage device 104 also includes a disk drive that reads / writes data to / from optical disks such as DVDs and Blue-ray Discs.

[0018] The input device 105 is a mouse, a keyboard, a touch panel, etc. that receive user operations, and outputs an instruction related to the received user operation to the control unit 101.

[0019] The output device 106 is a display device such as an LCD (Liquid Crystal Display) and an organic EL display, and displays data held by the image processing apparatus 100 and data supplied from an external device.

[0020] The communication device 107 is a device that is communicably connected to a network such as the Internet and a LAN (Local Area Network).

[0021] The system bus 108 includes an address bus, a data bus, and a control bus that enable data transmission and reception between each part constituting the image processing apparatus 100.

[0022] The non-volatile memory 103 stores an OS (Operating System), which is basic software executed by the control unit 101, and an application that realizes an application function in cooperation with the OS. The non-volatile memory 103 also stores an application that realizes an image analysis process for detecting deformation from an image obtained by the image processing apparatus 100 by photographing an inspection target described later.

[0023] The processing of the image processing apparatus 100 in this embodiment is achieved by the control unit 101 reading and executing software provided by an application. The application is assumed to have software for utilizing the basic functions of the OS installed on the image processing apparatus 100. The OS of the image processing apparatus 100 may also have software for implementing the processing in this embodiment.

[0024] Figure 2 is a block diagram showing an example of the functional configuration of an image processing device.

[0025] The image processing device 100 includes an image management unit 211, an image storage unit 212, an image analysis unit 213, an analysis result storage unit 214, and an analysis result management unit 215. Each function of the image processing device 100 is implemented by hardware and software. Note that each functional unit may be configured as a system connecting one or more computers and servers via a network.

[0026] The image management unit 211 has functions for saving, deleting, displaying in a list, and viewing images.

[0027] The image storage unit 212 stores the image data.

[0028] The image analysis unit 213 performs image analysis using a trained model created through AI (Artificial Intelligence) machine learning and deep learning in order to detect abnormalities from images of the object to be inspected.

[0029] The analysis result storage unit 214 stores the image analysis results.

[0030] The analysis result management unit 215 has the function of viewing and retrieving image analysis results stored in the analysis result storage unit 214.

[0031] The analysis results management unit 215 presents the user with a screen for viewing the image analysis results, which will be described later, via the output device 106.

[0032] The analysis result management unit 215 has the function of viewing and retrieving image analysis results stored in the analysis result storage unit 214. The analysis result management unit 215 presents the user with an image analysis result viewing screen (shown in Figure 3) and a parameter comparison viewing screen (shown in Figure 4).

[0033] The following describes an example of a workflow for detecting deformations from images of an object to be inspected (for example, a concrete structure), as a premise for this embodiment. In this embodiment, deformations of a concrete structure are detected by performing image analysis using a learning model on images of the wall surface of the concrete structure taken with a camera.

[0034] When photographing an object to be inspected on-site, it is difficult to capture the entire object in a single image with sufficient image resolution to detect any deformations. Therefore, the process involves taking close-up shots of a portion of the object by gradually changing the shooting range. Then, each of the multiple images taken using this procedure undergoes image processing such as enlargement, reduction, rotation, perspective transformation, color adjustment, and noise reduction. After that, the multiple processed images are stitched together to generate a single composite image.

[0035] Unlike methods that manually record deformations while visually inspecting images, image analysis-based deformation detection may result in false detections and missed detections. Therefore, another image processing device or external server checks and corrects the deformation detection results. For example, if the deformation is a crack, crack information is overlaid on the drawing or image, and an analysis result (i.e., a deformation object) is created with the length and width of the crack noted. Note that the deformation object is not limited to information about cracks occurring in the structure superimposed on the drawing or image, but also includes information about any deformation occurring in the structure (e.g., information about rust stains and water leaks) superimposed on the drawing or image. The deformation object can be a figure that indicates the part of the deformation. For example, the deformation object may be a figure that encompasses the part of the deformation (specifically, a circle, a rectangle, or their outlines), or it may be a figure that has a shape corresponding to the shape of the deformation (e.g., a line of a predetermined thickness along the crack).

[0036] Figure 3 shows an example of a screen for viewing image analysis results.

[0037] The image analysis results viewing screen 301 is a screen that allows users to view the results for each analyzed image. On the viewing screen 301, the image file name 311, detection name 312, upload date and time 313, detection date and time 314, parameters 315, list of analyzed images 320, analysis result display area 321, and legend display area 323 are displayed.

[0038] In image file name 311, the file name of the image on which the image analysis was performed (for example, "001.jpg") is displayed.

[0039] In detection name 312, the detection name (for example, "001.jpg") is displayed.

[0040] In upload date 313, the upload date and time (for example, "2022 / 07 / 19 13:45") is displayed.

[0041] At detection time 314, the detection execution time (for example, "2022 / 07 / 19 21:45") is displayed.

[0042] In parameter 315, the parameter values ​​(for example, "Detection amount: High, Short crack removal: Medium, Crack width: Wide") are displayed.

[0043] In the analysis results display area 321, the analysis results 330, such as cracks, are displayed overlaid on the image of the detected deformation. The analysis results 330 include actual size information of the length and thickness (width) of the cracks. The analysis results 330 are displayed in an identifiable manner using different display formats (e.g., color or line type) depending on the length and thickness (width) of the cracks.

[0044] In the legend display section 323, the actual dimensions of the length and width of the cracks, along with their corresponding display colors, the display colors corresponding to rust stains and water leaks, and checkboxes for outlines are displayed. In this way, the display format and outline checkboxes are displayed for each type of deformation. The display format can also be changed. The actual dimensions of the cracks can be calculated based on the image resolution and the number of pixels in the image. Furthermore, by comparing the actual dimensions of the deformation with the data in the drawing, the coordinates of the analysis results 330 are converted to numerical values ​​that match the coordinate system of the drawing. This makes it possible to view and edit the analysis results 330 using an image processing device or an external server.

[0045] The display or hiding of contour lines is toggled depending on whether the contour line checkbox 324 is checked or not. This allows the user to choose whether or not to display contour lines in the analysis result display area 321.

[0046] Figure 4 shows an example of a parameter comparison viewing screen.

[0047] The parameter comparison viewing screen 401 is a screen that allows comparison of time series and parameters (detection amount and small area removal settings). The comparison viewing screen 401 displays the image file name 311, detection name 312, upload date and time 313, detection date and time 314, parameters 315, detection date and time list 420, analysis result display field 321, legend display field 323, and contour line checkbox 324.

[0048] The image file names 311 to parameter 315 and the analysis result display fields 321 to contour checkbox 324 have been explained in Figure 3, so their explanation will be omitted here.

[0049] In the detection date and time list 420, the detection date and time (for example, "2022 / 07 / 15 18:50", "2022 / 07 / 14 19:50", "2022 / 07 / 13 23:50", "2022 / 07 / 13 09:50") is displayed.

[0050] Figure 5 is a flowchart illustrating an example of the processing performed by the image processing device. The following explanation of this process will refer to Figure 3.

[0051] This process is achieved when the control unit 101 of the image processing device 100 shown in Figure 1 loads the program stored in the non-volatile memory 103 into the volatile memory 102 and executes it.

[0052] In S501, the control unit 101 displays a list of uploaded images on the output device 106. The control unit 101 receives instructions to select a desired image file and to start analysis.

[0053] In S502, the image analysis unit 213 performs image analysis on the selected image file.

[0054] In S503, the control unit 101 determines whether the image analysis by the image analysis unit 213 has been completed. If the control unit 101 determines that the image analysis by the image analysis unit 213 has been completed (Yes in S503), the process proceeds to S504. If the process in S504 is not required, the process proceeds to S505. If the control unit 101 determines that the image analysis by the image analysis unit 213 has not been completed (No in S503), the process returns to S502.

[0055] In S504, the control unit 101 displays information on the output device 106 that associates the results of determining the display color for each type of deformation with the legend. Here, the method by which the control unit 101 determines the display color for each type of deformation will be explained. In this embodiment, deformations are classified into three categories: "cracking," "rust staining," and "water leakage," but are not limited to these. For example, deformations can include spalling, efflorescence, and exposed rebar. The "cracking" category is further classified into three types (for example, less than 0.2 mm, 0.2 mm to less than 0.5 mm, and 0.5 mm or more). The control unit 101 then determines the display color for the "cracking," "rust staining," and "water leakage" categories according to the level of importance (or danger) that the user must address promptly regarding the deformation of the structure. The importance of the "water leakage" category is set to be the highest, the importance of "rust staining" to be the second highest, and the importance of "cracking" to be the lowest. The importance of each category may be set in advance by the user. The control unit 101 decides to display "water leakage" in the darkest color, "rust stain" in a medium-density color, and "cracks" in a light color, based on the importance of each category. Furthermore, for the three categories of "cracks," the control unit 101 determines the color to display each category according to the width of each crack. As another example, different display colors may be determined for each category, such as "cracks," "rust stain," and "water leakage." This results in determining the display color for each type of damage. This information may be pre-set or can be arbitrarily changed by the user.

[0056] In S505, the analysis result storage unit 214 saves the analysis results. The analysis result management unit 215 displays an image on the output device 106 in which the analysis results are superimposed on the image on the viewing screen 301 or the comparison viewing screen 401. At this time, the control unit 101 calculates the color difference d between the color of the analysis result 350 and the color of the image at the location where a part of the analysis result 350 overlaps with the image, using the color difference formula in the RGB color space (for example, formula (1) below) or CIE DE2000. The overlapping location is a location of a part of the analysis result 350, and is represented, for example, by two-dimensional coordinates (x,y).

[0057] TIFF2026095513000002.tif16165...(Formula 1) Here, d is the color difference, R1, G1, B1 are the RGB values ​​of the analysis result, and R2, G2, B2 are the RGB values ​​of the image.

[0058] The control unit 101 may change one or more of the hue, saturation, and brightness of the contour line color of the analysis result 350 if the color difference d is less than the threshold. For example, if the color difference d is less than the threshold, the control unit 101 displays the contour line color of the analysis result 350 in black, as shown in Figure 3, and displays the image without changing its color. Here, the control unit 101 changes the color of the entire contour line of the analysis result 350, but is not limited to this; it may change the color of a part of the contour line, or change the color of the entire analysis result 350. On the other hand, if the color difference d is greater than or equal to the threshold, the control unit 101 does not change one or more of the hue, saturation, and brightness of the contour line color of the analysis result 350, and does not change the color of the image.

[0059] As described above, when the colors of analysis result 350 and the image are similar at the point where they overlap, the color of the outline of analysis result 350 is changed to, for example, black, without changing the color of the image. This makes it easier for the user to distinguish between analysis result 350 and the image.

[0060] In S506, the control unit 101 determines whether the contour check box 324 is checked or not. If the control unit 101 determines that the contour check box 324 is checked (Yes in S506), the process proceeds to S507. If the control unit 101 determines that the contour check box 324 is not checked (No in S506), the process ends.

[0061] In S507, the control unit 101 determines whether analysis result 330 and analysis result 340 overlap based on whether the distance d1 (not shown) between a predetermined position in analysis result 330 and a predetermined position in analysis result 340 is greater than a threshold. The predetermined position can be any position that allows for the determination of overlap between analysis result 330 and analysis result 340. The predetermined position can be, for example, the center position or any position on the circumference of analysis result 330 and analysis result 340, respectively. Changing the color of the analysis results depending on whether they overlap is an example of changing the color of the analysis results depending on the background color of the analysis results. Returning to the above explanation, the threshold is the sum of the radius r1 (not shown) of analysis result 330 and the radius r2 (not shown) of analysis result 340 (=r1+r2). Here, analysis result 330 and analysis result 340 represent analysis results of different types of deformation. For example, analysis result 330 indicates that the deformation is "water leakage" and is displayed in dark gray. On the other hand, analysis result 340 indicates that the deformation is "rust stain," and is displayed in light gray.

[0062] If the distance d1 is less than the threshold (=r1+r2), the control unit 101 determines that some positions in analysis result 330 and some positions in analysis result 340 overlap (Yes in S507), and the process proceeds to S508. On the other hand, if the distance d1 is not less than the threshold (=r1+r2) (i.e., greater than), the control unit 101 determines that some positions in analysis result 330 and some positions in analysis result 340 do not overlap (No in S507), and the process ends.

[0063] Here, the control unit 101 can calculate the color difference d between the color of analysis result 330 and the color of analysis result 340 at the location where a part of analysis result 330 and a part of analysis result 340 overlap, using the color difference formula in the RGB color space (for example, formula (1) above) or CIE DE2000.

[0064] In S508, the control unit 101 changes the contour colors of analysis result 330 and analysis result 340, respectively, so that the color difference d between the contour colors of analysis result 330 and analysis result 340 increases. Here, the control unit 101 changes the contour colors of analysis result 330 and analysis result 340 so that at least one of the following properties—hue, saturation, and brightness—differs. For example, the control unit 101 changes the contour color of analysis result 330 to black and the contour color of analysis result 340 to white. This increases the color difference d in the brightness direction, making it easier for the user to distinguish between analysis result 330 and analysis result 340. Note that analysis result 330 corresponds to the first deformation object, and analysis result 340 corresponds to the second deformation object.

[0065] As described above, according to the first embodiment, when the color of the first deformed object and the image overlap at a position where the first deformed object and the image overlap, the color of the outline of the first deformed object is changed so that the color difference between the color of the first deformed object and the image is increased. This makes it easier for the user to distinguish between the first deformed object and the image. Furthermore, when the color of the first deformed object and the second deformed object overlap at a position where the two colors are similar, the colors of the outlines of the first and second deformed objects are changed so that the color difference between them is increased. This makes it easier for the user to distinguish between the first and second deformed objects.

[0066] (Second Embodiment) When the control unit 101 superimposes deformation objects, which trace the location of cracks in the structure, onto the image, it superimposes deformation objects on the image in a way that does not display part of the contour lines of the deformation objects. The results of the control unit 101 superimposing deformation objects onto the image are shown in the analysis results 430 and 440 in Figure 4. Here, the contour lines (shown as thick black lines) at ends 430a and 430b of analysis result 430 are not displayed. Ends 430a and 430b represent the start or end points of the crack. Similarly, the contour lines (shown as thick black lines) at ends 440a, 440b, and 440c of analysis result 440 are not displayed. Ends 440a to 430c represent the start or end points of the crack.

[0067] Next, the control unit 101 determines whether the analysis result 430 and the analysis result 440 overlap based on a comparison of the distance between a predetermined position of the analysis result 430 (for example, the position of the end portion 430a) and a predetermined position of the analysis result 440 (for example, the position of the portion 440d) and a threshold. Since this determination method is the same as in the first embodiment, a detailed explanation is omitted. If the above distance is less than or equal to the threshold, the control unit 101 determines that the analysis result 430 and the analysis result 440 overlap.

[0068] Furthermore, at the point where analysis result 430 and analysis result 440 overlap, the control unit 101 determines the order in which to superimpose analysis result 430 and analysis result 440 onto the image based on whether the respective parts of analysis result 430 and analysis result 440 are specific parts (i.e., edges). If the control unit 101 determines that at the overlapping point, the part of analysis result 430 is an edge 430a and the part of analysis result 440 is a part other than an edge 440d, it decides to superimpose analysis result 440 onto the image in the order of analysis result 440, then analysis result 430.

[0069] Here, if the control unit 101 overlays the analysis result 430 and then the analysis result 440 onto the image, the analysis result 440 is displayed on top of the edge 430a of the analysis result 430, so the edge 430a is hidden by the analysis result 440. On the other hand, if the control unit 101 overlays the analysis result 440 and then the analysis result 430 onto the image, as shown in Figure 4, the edge 430a is displayed without being hidden by the analysis result 440. In this way, the control unit 101 determines the overlap between analysis results and further determines the analysis result that has an edge at the overlapping position. Based on this determination, the control unit 101 draws the analysis result that has an edge (i.e., the start or end point of the deformation) at the overlapping position at the forefront of the image.

[0070] As a result, multiple deformation objects (analysis result 430, analysis result 440) indicating the start and end points of a crack are superimposed on the image, allowing the user to visually identify both analysis result 430 and analysis result 440. In other words, the user will not overlook the start or end point of a crack on the image, and will be able to quickly and accurately address the deformation (e.g., cracks). Thus, this embodiment has the excellent effect of contributing to improved accuracy in infrastructure inspections.

[0071] (Third embodiment) The first and second embodiments described a method for changing the display color of the contour lines of deformed objects. In the third embodiment, when the position of a figure (e.g., a line, circle, and polygon) drawn with white chalk on a structure is detected from an image, the color of a portion of the contour line of the deformed object that overlaps with the position of the chalk-drawn figure is changed. Here, the control unit 101 changes a predetermined color of a portion of the contour line of the deformed object to black, for example, so that the color difference between the color of the position of the chalk-drawn figure (e.g., white) and the color of a portion of the contour line of the deformed object becomes larger. The control unit 101 does not change the color of a portion of the contour line of the deformed object that does not overlap with the position of the chalk-drawn figure detected on the image. The control unit 101 may also change one or more of the hue, saturation, and brightness of the color of a portion of the contour line of the deformed object. This makes it easier for the user to distinguish between the color of the position of the chalk-drawn figure and the color of a portion of the contour line of the deformed object, thereby further improving user visibility.

[0072] (Other examples) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0073] The disclosures herein include the following image processing devices, methods, and programs. (Item 1) An acquisition means for acquiring information indicating the location of deformation of the structure in an image of the structure, A display control means for superimposing a first deformation object indicating the location of deformation in the structure onto an image of the structure, comprising: a display control means for controlling the color of the first deformation object in the superimposed display according to the background color of the first deformation object. An image processing apparatus characterized by the following: (Item 2) The background is a second deformed object that is different from the image or the first deformed object. The image processing apparatus according to item 1, characterized in that it is a picture processing apparatus. (Item 3) The background color is the color of the image in the portion over which the first deformed object is superimposed, or the color of the second deformed object that overlaps with the first deformed object. The image processing apparatus according to item 2, characterized in that (Item 4) The display control means controls the change of at least a portion of the color of the first deformed object from a predetermined color when the background is the image and the color difference between the color of the first deformed object and the background color is less than a threshold. The image processing apparatus according to item 2 or 3, characterized in that it is an image processing apparatus. (Item 5) The display control means controls the color of the first deformed object to the predetermined color when the background is the image and the color difference is greater than the threshold. The image processing apparatus according to item 4, characterized in that (Item 6) A determination means for determining the color of the first deformed object and the second deformed object according to the type of deformation of the first deformed object and the second deformed object, The display control means controls the color determined by the determination means to display the contour color of the first deformed object and the contour color of the second deformed object in different colors from each other, if the background is the second deformed object and the color difference between the color of the first deformed object and the color of the second deformed object based on the determination result of the determination means is smaller than a threshold. The image processing apparatus according to item 2, characterized in that (Item 7) The display control means, when the background is the second deformed object and the color difference is greater than the threshold, controls the color of the first deformed object and the color of the second deformed object to be the color determined by the determination means. The image processing apparatus according to item 6, characterized in that (Item 8) The display control means superimposes the first deformed object onto the image so as not to display a portion of the contour of the first deformed object. The image processing apparatus according to item 1, characterized in that it is a picture processing apparatus. (Item 9) The system includes a determination means for determining whether the first deformed object and the second deformed object overlap based on the distance between a predetermined position of the first deformed object and a predetermined position of the second deformed object. The image processing apparatus according to item 2, characterized in that (Item 10) The determination means, when the first deformed object and the second deformed object overlap based on the distance, determines which of the portion of the first deformed object and the portion of the second deformed object at the overlapping position has a specific portion. The display control means superimposes the first deformed object or the second deformed object having the specific portion onto the foreground of the image based on the determination result of the determination means. The aforementioned specific part is the starting or ending point of the deformation. The image processing apparatus according to item 9, characterized in that (Item 11) The display control means displays at least one of the first deformation object and the second deformation object, which indicates the location of a deformation of a specific type of deformation of the structure, superimposed on the foreground of the image. The image processing apparatus according to item 2, characterized in that (Item 12) The aforementioned deformation is at least one of the following: cracking, water leakage, spalling, efflorescence, exposed rebar, and rust stains. The image processing apparatus according to item 1, characterized in that it is a picture processing apparatus. (Item 13) The background is a figure drawn on the structure in the image. The image processing apparatus according to item 1, characterized in that it is a picture processing apparatus. (Item 14) The outline color of the first deformed object and the outline color of the second deformed object differ from each other in one or more of the following aspects: hue, saturation, and lightness. The image processing apparatus according to feature 6. (Item 15) A portion of the contour of the first deformed object is the longitudinal end of the first deformed object. The image processing apparatus according to claim 8. (Item 16) The acquisition means of the image processing device includes an acquisition step of acquiring information indicating the location of deformation of the structure in an image of the structure, The display control means of the image processing apparatus comprises a display control step of superimposing a first deformation object indicating the location of deformation of the structure onto an image of the structure, wherein the display control step of controlling the color of the first deformation object in the superimposed display according to the background color of the first deformation object. A method characterized by the following: (Item 17) A program for causing a computer to function as one of the means of an image processing apparatus described in any one of items 1 through 15.

[0074] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0075] 100 Image Processing Devices 101 Control Unit 102 Volatile memory 103 Non-volatile memory 104 Storage Devices 105 Input device 106 Output device 107 Communication equipment 108 System Bus 211 Image Management Department 212 Image storage section 213 Image Analysis Department 214 Image analysis results storage section 215 Image analysis results management department

Claims

1. A means for acquiring images of structures, A deformation object indicating the location of deformation of the structure, comprising a display control means for superimposing a first deformation object and a second deformation object different from the first deformation object onto the image, The display control means displays the contour color of the first deformed object and the contour color of the second deformed object in different colors. An image processing apparatus characterized by the following:

2. The system includes a determination means for determining the color of the first deformed object and the second deformed object, respectively, according to the type of deformation of the first deformed object and the second deformed object. The display control means displays the contour colors of the first deformed object and the contour colors of the second deformed object in different colors if the color difference between the colors of the first deformed object and the second deformed object is less than a threshold. The image processing apparatus according to feature 1.

3. The system includes a determination means for determining whether the first deformed object and the second deformed object overlap based on the distance between the positions of the first deformed object and the second deformed object. If the determination means determines that the first deformed object and the second deformed object overlap, the display control means displays the outline color of the first deformed object and the outline color of the second deformed object in different colors. The image processing apparatus according to feature 1.

4. The outline color of the first deformed object and the outline color of the second deformed object differ in one or more of the following: hue, saturation, and lightness. The image processing apparatus according to feature 1.

5. The aforementioned deformation is at least one of the following: cracking, water leakage, spalling, efflorescence, exposed rebar, and rust stains. The image processing apparatus according to feature 1.

6. A means for acquiring images of structures, The system includes a display control means for superimposing a first deformation object, which indicates the location of deformation in the structure, onto the image. The display control means superimposes the first deformed object onto the image so as not to display a portion of the contour of the first deformed object. An image processing apparatus characterized by the following:

7. A portion of the contour of the first deformed object is the longitudinal end of the first deformed object. The image processing apparatus according to claim 6.

8. The deformation is a crack, and a portion of the contour of the first deformed object is the start or end point of the crack. The image processing apparatus according to claim 6.

9. The display control means superimposes on the image a second deformation object, which is different from the first deformation object and indicates the location of the deformation of the structure. The system includes a determination means for determining the color of the first deformed object and the second deformed object, respectively, according to the type of deformation of the first deformed object and the second deformed object. The image processing apparatus according to claim 6.

10. The display control means determines the order in which the first deformed object and the second deformed object are superimposed on the image. The image processing apparatus according to feature 9.

11. The system includes a determination means for determining whether the first deformed object and the second deformed object overlap based on the distance between the positions of the first deformed object and the second deformed object. If the determination means determines that the first deformed object and the second deformed object overlap, it determines whether the portion of the first deformed object or the portion of the second deformed object at the overlapping position is an end, The display control means displays the first deformed object or the second deformed object, in which the portion at the overlapping position is the end, superimposed on the first deformed object or the second deformed object, in which the portion at the overlapping position is not the end. The image processing apparatus according to feature 10.

12. The outline color of the first deformed object and the outline color of the second deformed object differ in one or more of the following: hue, saturation, and lightness. The image processing apparatus according to feature 9.

13. The aforementioned deformation is at least one of the following: cracking, water leakage, spalling, efflorescence, exposed rebar, and rust stains. The image processing apparatus according to claim 6.

14. The acquisition process involves obtaining images of structures, A display control step is provided for displaying a deformation object that indicates the location of deformation of the structure, wherein a first deformation object and a second deformation object different from the first deformation object are superimposed on the image. In the display control step, the outline color of the first deformed object and the outline color of the second deformed object are displayed in different colors. A control method for an image processing apparatus, characterized by the features described above.

15. A program for causing a computer to function as one of the means of an image processing apparatus according to any one of claims 1 to 5.

16. The acquisition process involves obtaining images of structures, The system includes a display control step that superimposes a first deformation object, which indicates the location of deformation in the structure, onto the image. In the display control step, the first deformed object is superimposed on the image so that a portion of the contour of the first deformed object is not displayed. A control method for an image processing apparatus, characterized by the features described above.

17. A program for causing a computer to function as one of the means of an image processing apparatus according to any one of claims 6 to 13.

Images