Image processing device, method, and program

The image processing device improves the visibility of structural deformations by adjusting outline colors based on background differences, addressing the challenge of similar colors in overlapping objects.

JP7580435B2Active Publication Date: 2024-11-11CANON KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022141015
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-09-05
Publication Date
2024-11-11
Estimated Expiration
2042-09-05

AI Technical Summary

Technical Problem

Existing image processing technologies struggle to visually distinguish deformed objects from their background when they share similar colors, making it difficult to recognize overlapping deformations in structures.

Method used

An image processing device that adjusts the hue, saturation, and brightness of deformation outlines based on their type and background color differences, ensuring distinct color representation of overlapping objects.

Benefits of technology

Enhances the visibility of deformed objects by creating clear color contrasts, allowing for accurate identification and inspection of structural deformations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007580435000002
    Figure 0007580435000002
  • Figure 0007580435000003
    Figure 0007580435000003
  • Figure 0007580435000004
    Figure 0007580435000004
Patent Text Reader

Abstract

To provide an image processing apparatus which can discriminate a deformed object displayed over an image and its background respectively even when a color of the deformed object and a color of its background are similar.SOLUTION: Information indicating a position of deformation of a structure in an image obtained by capturing the structure is acquired. Display control means displays a first deformed object indicating the position of deformation of the structure, over the image obtained by capturing the structure and performs control to determine a color of the first deformed object in accordance with a color of a background of the first deformed object when displaying the first deformed object over the image.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an image processing device, a method, and a program. [Background technology]

[0002] In recent years, image analysis has been used to detect deformations in structures (e.g., cracks). For example, Patent Document 1 proposes a technology for displaying the results of detecting deformations in structures from images on a screen. Patent Document 1 can display on the screen the colors and types of lines indicating the positions of each deformation so that they differ from one another depending on the width of each deformation. This allows the user to visually recognize each deformation on the screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6569002 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology of Patent Document 1 has a problem in that when part of a deformed object and a target (part of an image or another deformed object) that are similar in color overlap, it is difficult for the user to visually recognize the deformed object and the target.

[0005] Therefore, the present invention aims to provide an image processing device that can distinguish between an abnormality object and its background even if the color of the abnormality object superimposed on an image and the color of the background are similar. [Means for solving the problem]

[0006] In order to achieve the object of the present invention, an image processing device according to an embodiment of the present invention has the following configuration: That is, the image processing device has an acquisition means for acquiring information indicating a position of a deformation of a structure in an image obtained by photographing the structure, and a display control means for superimposing a first deformation object indicating the position of the deformation of the structure on the image obtained by photographing the structure, the display control means performing control for determining a color of the first deformation object in the superimposed display depending on a color of a background of the first deformation object. The background is a second deformed object different from the image or the first deformed object, and a determination means is further provided for determining the color of each of the first deformed object and the second deformed object according to the type of the deformed state of each of the first deformed object and the second deformed object, and the display control means performs control to change the color determined by the determination means so that the color of the outline of the first deformed object and the color of the outline of the second deformed object are displayed in different colors when the background is the second deformed object and the color difference between the color of the first deformed object and the color of the second deformed object based on the determination result of the determination means is smaller than a threshold value. It is characterized by: Effect of the Invention

[0007] According to the present invention, it is an object to provide an image processing device that can distinguish between an abnormality object and its background even if the color of the abnormality object superimposed on an image and the color of the background are similar. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of a hardware configuration of an image processing apparatus. [Diagram 2] FIG. 2 is a block diagram showing an example of a functional configuration of an image processing apparatus. [Diagram 3] FIG. 13 is a diagram showing an example of a viewing screen for image analysis results. [Figure 4] FIG. 13 is a diagram showing an example of a parameter comparison viewing screen. [Diagram 5] 11 is a flowchart illustrating an example of a process executed by the image processing apparatus. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] (First embodiment) In the first embodiment, an image showing the position of a deformation of a structure is displayed on a screen, and one or more of the hue, saturation, and brightness of the contour line of the deformation are changed according to the type of deformation. The deformation refers to cracks that occur on the concrete surface due to damage, deterioration, and other factors of structures such as highways, bridges, tunnels, and dams. A crack refers to linear damage with a start point, end point, length, and width that occurs on the wall surface of a structure due to aging and earthquake shock.

[0011] FIG. 1 is a block diagram showing an example of a hardware configuration of an image processing device.

[0012] In the embodiment described below, a computer operates as the image processing device 100. The processing of the image processing device of this embodiment may be realized by a single computer, or may be realized by distributing each function among multiple computers as necessary. The multiple computers are connected to each other so that they can communicate with each other.

[0013] The image processing device 100 includes a control unit 101, a volatile memory 102, a non-volatile memory 103, a storage device 104, an input device 105, an output device 106, a communication device 107, and a system bus .

[0014] The control unit 101 includes an arithmetic processor such as a CPU (Central Processing Unit) and an MPU (Micro Processor Unit) that control the entire image processing device 100.

[0015] The volatile memory 102 is a RAM (Random Access Memory) that temporarily stores programs and data supplied from an external device or the like.

[0016] The non-volatile memory 103 is a ROM (Read-Only Memory) that stores programs and parameters executed by the processor of the control unit 101 .

[0017] The storage device 104 is an internal device such as a hard disk and a memory card built into the image processing device 100, or an external device such as a hard disk and a memory card detachably connected to the image processing device 100. The storage device 104 includes a memory card and a hard disk constituted by a semiconductor memory, a magnetic disk, etc. The storage device 104 also includes a disk drive that reads / writes data from / to optical disks such as DVDs and Blue-ray Discs.

[0018] The input device 105 is a mouse, a keyboard, a touch panel, or the like that receives user operations, and outputs instructions related to the received user operations to the control unit 101.

[0019] The output device 106 is a display device such as an LCD (Liquid Crystal Display) or an organic EL display, and displays data held by the image processing device 100 and data supplied from an external device.

[0020] The communication device 107 is a device that is communicatively connected to a network such as the Internet or a LAN (Local Area Network).

[0021] The system bus 108 includes an address bus, a data bus, and a control bus that enable data transmission and reception between each unit constituting the image processing device 100 .

[0022] The non-volatile memory 103 stores an OS (Operating System) which is basic software executed by the control unit 101, and applications which cooperate with the OS to realize applied functions. The non-volatile memory 103 also stores an application which realizes an image analysis process for detecting abnormalities from an image of an inspection target captured by the image processing device 100, which will be described later.

[0023] The processing of the image processing device 100 of this embodiment is realized by the control unit 101 reading and executing software provided by an application. Note that the application has software for utilizing basic functions of the OS installed in the image processing device 100. Note that the OS of the image processing device 100 may have software for realizing the processing of this embodiment.

[0024] FIG. 2 is a block diagram illustrating an example of a functional configuration of the image processing device.

[0025] The image processing device 100 has an image management unit 211, an image storage unit 212, an image analysis unit 213, an analysis result storage unit 214, and an analysis result management unit 215. Each function of the image processing device 100 is realized by hardware and software. Note that each functional unit may be configured as a system in which one or more computers and servers are connected via a network.

[0026] The image management unit 211 has functions for storing, deleting, displaying a list of, and viewing images.

[0027] The image storage unit 212 stores image data.

[0028] The image analysis unit 213 performs image analysis using a trained model created by machine learning and deep learning of AI (Artificial Intelligence) in order to detect abnormalities from images of the inspection object.

[0029] The analysis result storage unit 214 stores the image analysis results.

[0030] The analysis result management unit 215 has a function of browsing, acquiring, etc. the image analysis results stored in the analysis result storage unit 214 .

[0031] The analysis result management unit 215 presents a viewing screen for the image analysis results, which will be described later, to the user via the output device 106.

[0032] The analysis result management unit 215 has a function of viewing and acquiring the image analysis results stored in the analysis result storage unit 214. The analysis result management unit 215 presents the user with an image analysis result viewing screen (shown in FIG. 3) and a parameter comparison viewing screen (shown in FIG. 4).

[0033] As a premise of this embodiment, an example of a workflow for detecting abnormalities from images of an inspection target (e.g., a concrete structure) will be described below. In this embodiment, abnormalities in the concrete structure are detected by performing image analysis using a learning model on images of the wall surface of the concrete structure captured by a camera.

[0034] When photographing an inspection target on-site, it is difficult to capture the entire range of the inspection target in a single image with sufficient image resolution to detect any abnormality in the inspection target. Therefore, the work of photographing a part of the inspection target range in close-up is performed by gradually changing the shooting range. Then, each of the multiple images taken in this shooting procedure is subjected to image processing such as enlargement, reduction, rotation, projective transformation, color adjustment, and noise removal. After that, the multiple images that have been image-processed are stitched together to generate a single composite image.

[0035] Unlike the method of manually recording the abnormality while visually inspecting the image, the detection of the abnormality by image analysis may result in false detection and missed detection. For this reason, another image processing device or an external server checks and corrects the detection result of the abnormality. For example, if the abnormality is a crack, the crack information is superimposed on the drawing or image to create an analysis result (i.e., an abnormality object) with the length and width of the crack added. Note that the abnormality object is not limited to the information of the crack that occurs in the structure superimposed on the drawing or image, but includes the information of any abnormality that occurs in the structure (for example, information on the location of rust and water leakage) superimposed on the drawing or image. The abnormality object may be a figure indicating the part of the abnormality. For example, the abnormality object may be a figure that includes the part of the abnormality (specific examples include a circle, a rectangle, or the outline of these), or may be a figure having a shape corresponding to the shape of the abnormality (for example, a line having a predetermined thickness along the crack).

[0036] FIG. 3 is a diagram showing an example of a viewing screen for the image analysis results.

[0037] The image analysis result viewing screen 301 is a screen that allows the results of each analysis image to be viewed. On the viewing screen 301, an image file name 311, a detection name 312, an upload date and time 313, a detection date and time 314, parameters 315, an analysis image list 320, an analysis result display field 321, and a legend display field 323 are displayed.

[0038] In the image file name 311, the name of the image file on which the image analysis was performed (for example, "001.jpg") is displayed.

[0039] In detection name 312, the detection name (for example, "001.jpg") is displayed.

[0040] In the upload date and time 313, the upload date and time (for example, "2022 / 07 / 19 13:45") is displayed.

[0041] In the detection date and time 314, the date and time when the detection was performed (for example, "2022 / 07 / 19 21:45") is displayed.

[0042] In parameters 315, parameter values ​​(for example, "detection amount: high, short crack removal: medium, crack width: wide") are displayed.

[0043] In the analysis result display field 321, analysis results 330 of cracks and the like are displayed as abnormalities detected by image analysis, superimposed on the image of the detection target. The analysis results 330 include actual size information of the length and thickness (width) of the crack. The analysis results 330 are displayed in a identifiable manner in different display forms (e.g., colors and line types) according to the length and thickness (width) of the crack.

[0044] In the legend display field 323, actual size information of crack length and thickness (width) and the corresponding display colors, display colors corresponding to rust and water leakage, and check boxes for the outline are displayed. In this way, the display form for each type of deformation and check boxes for the outline are displayed. The display form can also be changed. The actual size information of crack length and thickness (width) can be calculated based on the image resolution and the number of pixels of the image. Furthermore, by comparing the actual size information of the deformation with the data on the drawing, the coordinates of the analysis result 330 are converted into numerical values ​​that match the coordinate system of the drawing. This makes it possible to view and edit the analysis result 330 using an image processing device or an external server.

[0045] The contour line is switched between being displayed and not displayed depending on whether or not the contour line check box 324 is checked. This allows the user to select whether or not to display the contour line in the analysis result display field 321.

[0046] FIG. 4 is a diagram showing an example of a parameter comparison viewing screen.

[0047] The parameter comparison viewing screen 401 is a screen that allows comparison by time series and parameters (detection amount and small area removal settings). On the comparison viewing screen 401, an image file name 311, a detection name 312, an upload date and time 313, a detection date and time 314, parameters 315, a detection date and time list 420, an analysis result display field 321, a legend display field 323, and a contour check box 324 are displayed.

[0048] The image file name 311 to the parameters 315 and the analysis result display field 321 to the contour check box 324 have been described with reference to FIG. 3 and will not be described here.

[0049] In the detection date and time list 420, the detection date and time (for example, "2022 / 07 / 15 18:50", "2022 / 07 / 14 19:50", "2022 / 07 / 13 23:50", "2022 / 07 / 13 09:50") is displayed.

[0050] 5 is a flowchart showing an example of processing executed by the image processing device. The flow of this processing will be described below with reference to FIG.

[0051] This process is realized by the control unit 101 of the image processing device 100 shown in FIG. 1 expanding a program stored in the non-volatile memory 103 into the volatile memory 102 and executing it.

[0052] In S501, the control unit 101 displays a list of uploaded images on the output device 106. The control unit 101 accepts an instruction to select a desired image file and start analysis.

[0053] In S502, the image analysis unit 213 executes image analysis on the selected image file.

[0054] In S503, the control unit 101 determines whether or not the image analysis by the image analysis unit 213 is complete. If the control unit 101 determines that the image analysis by the image analysis unit 213 is complete (Yes in S503), the process proceeds to S504. If the process of S504 is unnecessary, the process proceeds to S505. If the control unit 101 determines that the image analysis by the image analysis unit 213 is not complete (No in S503), the process returns to S502.

[0055] In S504, the control unit 101 displays the result of determining the display color for each type of deformation and information associated with the legend on the output device 106. Here, a method for the control unit 101 to determine the display color for each type of deformation will be described. In this embodiment, the deformation is classified into three categories, "crack", "rust", and "leakage", but is not limited to these. For example, the deformation may include spalling, efflorescence, and exposed rebar. The "crack" category is further classified into three types (for example, less than 0.2 mm, less than 0.2 mm-0.5 mm, and 0.5 mm or more). Then, the control unit 101 determines the display colors for the "crack", "rust", and "leakage" categories according to the level of importance (or risk) that the user must deal with the deformation of the structure immediately. The "leakage" category has the highest importance, the "rust" category has the second highest importance, and the "crack" category has the lowest importance. The importance of each category may be set in advance by the user. Based on the importance of each category, the control unit 101 determines to display the color of "water leakage" in the darkest color, the color of "rust" in the medium density color, and the color of "crack" in the light color. Furthermore, for the display colors of the three types of "crack" categories, the control unit 101 determines the color to display each crack width category according to each crack width. As another example, a different display color may be determined for each category such as "crack", "rust", and "water leakage". This results in determining the display color for each type of deformation. This information may be set in advance, or may be arbitrarily changed by the user.

[0056] In S505, the analysis result storage unit 214 stores the analysis result. Furthermore, the analysis result management unit 215 displays, on the output device 106, an image in which the analysis result is superimposed on the image on the viewing screen 301 or the comparison viewing screen 401. At this time, the control unit 101 calculates the color difference d between the color of the analysis result 350 and the color of the image at a position where a part of the analysis result 350 and the image overlap, using a color difference formula in the RGB color space (for example, formula (1) below) or CIE DE2000. Note that the overlapping position refers to the position of a part of the analysis result 350, and is expressed, for example, by two-dimensional coordinates (x, y).

[0057] TIFF0007580435000001.tif16165...(Formula 1) Here, d is the color difference, R1, G1, and B1 are the RGB values ​​of the analysis result, and R2, G2, and B2 are the RGB values ​​of the image.

[0058] When the color difference d is less than the threshold, the control unit 101 may change one or more of the hue, saturation, and brightness of the color of the contour of the analysis result 350. For example, when the color difference d is less than the threshold, the control unit 101 displays the color of the contour of the analysis result 350 in black as shown in FIG. 3, and displays the image without changing the color. Here, the control unit 101 changes the color of the entire circumference of the contour of the analysis result 350, but is not limited to this, and may change the color of a part of the contour, or may change the color of the entire analysis result 350. On the other hand, when the color difference d is equal to or greater than the threshold, the control unit 101 does not change one or more of the hue, saturation, and brightness of the color of the contour of the analysis result 350, and does not change the color of the image.

[0059] As described above, when the color of analysis result 350 and the color of the image at the overlapping position of analysis result 350 are similar to each other, the color of the image is not changed but the color of the outline of analysis result 350 is changed to, for example, black. This makes it easier for the user to visually recognize analysis result 350 and the image.

[0060] In S506, the control unit 101 determines whether or not the contour check box 324 is checked. If the control unit 101 determines that the contour check box 324 is checked (Yes in S506), the process proceeds to S507. If the control unit 101 determines that the contour check box 324 is not checked (No in S506), the process ends.

[0061] In S507, the control unit 101 determines whether the analysis result 330 and the analysis result 340 overlap based on whether the distance d1 (not shown) between a predetermined position of the analysis result 330 and a predetermined position of the analysis result 340 is greater than a threshold value. The predetermined position may be any position as long as it is possible to determine whether the analysis result 330 and the analysis result 340 overlap. The predetermined position may be, for example, the center position or any position on the circumference of each of the analysis results 330 and 340. Here, changing the color of the analysis result depending on whether the analysis results overlap is an example of changing the color of the analysis result depending on the background color of the analysis result. Returning to the above explanation, the threshold value is the sum (=r1+r2) of the radius r1 (not shown) of the analysis result 330 and the radius r2 (not shown) of the analysis result 340. Here, the analysis result 330 and the analysis result 340 represent analysis results with different types of abnormality. For example, the analysis result 330 indicates that the abnormality is "water leakage" and is displayed in dark gray. On the other hand, the analysis result 340 indicates that the abnormality is "rust fluid" and is displayed in light gray.

[0062] If the distance d1 is smaller than the threshold value (=r1+r2), the control unit 101 determines that a portion of the position of analysis result 330 overlaps with a portion of the position of analysis result 340 (Yes in S507), and the process proceeds to S508. On the other hand, if the distance d1 is not smaller (i.e., larger) than the threshold value (=r1+r2), the control unit 101 determines that a portion of the position of analysis result 330 does not overlap with a portion of the position of analysis result 340 (No in S507), and the process ends.

[0063] Here, the control unit 101 can calculate the color difference d between the color of the analysis result 330 and the color of the analysis result 340 at the position where a part of the analysis result 330 and a part of the analysis result 340 overlap, using the color difference formula in the RGB color space (for example, the above formula (1)) or CIE DE2000.

[0064] In S508, the control unit 101 changes the color of the contour line of the analysis result 330 and the color of the contour line of the analysis result 340 so that the color difference d between the color of the contour line of the analysis result 330 and the color of the contour line of the analysis result 340 becomes large. Here, the control unit 101 changes the color of the contour line of the analysis result 330 and the color of the contour line of the analysis result 340 so that one or more of the hue, saturation, and brightness are different. For example, the control unit 101 changes the color of the contour line of the analysis result 330 to black and the color of the contour line of the analysis result 340 to white. As a result, the color difference d becomes large in the brightness direction, making it easier for the user to visually recognize each of the analysis result 330 and the analysis result 340. Note that the analysis result 330 corresponds to the first deformed object, and the analysis result 340 corresponds to the second deformed object.

[0065] As described above, according to the first embodiment, when the color of the first deformed object and the color of the image are similar at a position where a part of the first deformed object overlaps with the image, the color of the contour line of the first deformed object is changed so that the color difference between the color of the first deformed object and the color of the image is increased. This makes it easier for the user to visually recognize the first deformed object and the image. Also, when the color of the first deformed object and the color of the second deformed object are similar at a position where a part of the first deformed object and a part of the second deformed object overlap, the color of the contour line of each of the first deformed object and the second deformed object is changed so that the color difference between the two is increased. This makes it easier for the user to visually recognize each of the first deformed object and the second deformed object.

[0066] Second embodiment When the control unit 101 superimposes a deformation object that traces the position of a crack in a structure on an image, the control unit 101 superimposes the deformation object on the image without displaying part of the contour line of the deformation object. The result of the control unit 101 superimposing the deformation object on the image is the analysis result 430 and the analysis result 440 in FIG. 4. Here, the contour lines (shown in thick black lines) at the ends 430a and 430b of the analysis result 430 are not displayed. The ends 430a and 430b represent the start or end points of the crack. In addition, the contour lines (shown in thick black lines) at the ends 440a, 440b, and 440c of the analysis result 440 are not displayed. The ends 440a to 430c represent the start or end points of the crack.

[0067] Next, the control unit 101 judges whether or not the analysis results 430 and 440 overlap based on a comparison between the distance between a predetermined position of the analysis result 430 (e.g., the position of the end portion 430a) and a predetermined position of the analysis result 440 (e.g., the position of the portion 440d) and a threshold value. This judgment method is similar to that in the first embodiment, and therefore detailed explanation will be omitted. The control unit 101 judges that the analysis results 430 and 440 overlap when the above distance is equal to or less than the threshold value.

[0068] Furthermore, control unit 101 determines the order in which analysis result 430 and analysis result 440 are superimposed on the image based on whether or not each of analysis result 430 and analysis result 440 is a specific part (i.e., an end part) at the overlapping position of analysis result 430 and analysis result 440. When control unit 101 determines that the part of analysis result 430 at the overlapping position is end part 430a and the part of analysis result 440 is part 440d other than the end part, control unit 101 determines to superimpose and display analysis result 440 and analysis result 430 in that order on the image.

[0069] Here, when the control unit 101 superimposes and displays the analysis result 430 and the analysis result 440 on the image in this order, the analysis result 440 is displayed on the end 430a of the analysis result 430, so that the end 430a is hidden by the analysis result 440. On the other hand, when the control unit 101 superimposes and displays the analysis result 440 and the analysis result 430 on the image in this order, the end 430a is displayed without being hidden by the analysis result 440, as shown in FIG. 4. In this way, the control unit 101 judges whether the analysis results overlap, and further judges the analysis result that has an end at the overlapping position. Based on this judgment result, the control unit 101 draws the analysis result that has an end (i.e., the start point or end point of the deformation) at the overlapping position in the foreground of the image.

[0070] As a result, a plurality of abnormality objects (analysis result 430, analysis result 440) showing the start point to the end point of the crack are each superimposed on the image, so that the user can visually recognize each of the analysis results 430 and 440. In other words, the user will not overlook the start point or end point of the crack on the image, and can quickly and accurately deal with the abnormality (for example, the crack). In this way, the present embodiment has an excellent effect of contributing to improving the accuracy of infrastructure inspection.

[0071] Third embodiment In the first and second embodiments, a method for changing the display color of the contour of a deformed object has been described. In the third embodiment, when the position of a figure (e.g., a line, a circle, and a polygon) drawn with white chalk on a structure is detected from an image, the color of a part of the contour of the deformed object that overlaps with the position of the figure drawn with chalk is changed. Here, the control unit 101 changes a predetermined color of a part of the contour of the deformed object to, for example, black so that the color difference between the color of the position of the figure drawn with chalk (e.g., white) and the color of the part of the contour of the deformed object becomes large. Note that the control unit 101 does not change the color of the part of the contour of the deformed object that does not overlap with the position of the figure drawn with chalk detected on the image. In addition, the control unit 101 may change one or more of the hue, saturation, and brightness of the color of the part of the contour of the deformed object. This makes it easier for the user to distinguish between the color of the position of the figure drawn with chalk and the color of the part of the contour of the deformed object, thereby further improving the user's visibility.

[0072] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0073] The disclosure of this specification includes the following image processing device, method, and program. (Item 1) An acquisition means for acquiring information indicating a position of a deformation of a structure in an image of the structure; A display control means for superimposing a first abnormality object indicating the position of the abnormality of the structure on an image of the structure, and a display control means for controlling the superimposition display to determine a color of the first abnormality object according to a background color of the first abnormality object. 13. An image processing device comprising: (Item 2) The background is a second deformed object different from the image or the first deformed object, 2. The image processing device according to item 1, (Item 3) The color of the background is the color of the image in the portion where the first deformed object is superimposed, or the color of the second deformed object superimposed on the first deformed object, 3. The image processing device according to item 2, (Item 4) The display control means performs control to change the color of at least a part of the first abnormality object from a predetermined color when the background is the image and the color difference between the color of the first abnormality object and the color of the background is smaller than a threshold value. 4. The image processing device according to item 2 or 3. (Item 5) The display control means controls the color of the first abnormality object to be the predetermined color when the background is the image and the color difference is greater than the threshold value. 5. The image processing device according to item 4, (Item 6) A determination means for determining a color of each of the first and second deformed objects according to the type of the deformed state of each of the first and second deformed objects; The display control means performs control to change the color determined by the determination means so that the color of the outline of the first deformed object and the color of the outline of the second deformed object are displayed in different colors when the background is the second deformed object and the color difference between the color of the first deformed object and the color of the second deformed object based on the determination result of the determination means is smaller than a threshold value. 3. The image processing device according to item 2, (Item 7) The display control means controls the color of the first deformed object and the color of the second deformed object to be a color based on the determination result of the determination means when the background is the second deformed object and the color difference is greater than the threshold value. 7. The image processing device according to item 6, (Item 8) The display control means displays the first deformed object superimposed on the image so as not to display a part of the contour of the first deformed object. 2. The image processing device according to item 1, (Item 9) A determination means for determining whether the first deformed object and the second deformed object overlap based on a distance between a predetermined position of the first deformed object and a predetermined position of the second deformed object, 3. The image processing device according to item 2, (Item 10) The determination means, when the first deformed object and the second deformed object overlap based on the distance, determines which of the part of the first deformed object and the part of the second deformed object at the overlapping position has a specific part; The display control means displays the first deformed object or the second deformed object having the specific portion on the front of the image in a superimposed manner based on the determination result of the determination means, The specific portion is a start point or an end point of the deformation. 10. The image processing device according to item 9, (Item 11) The display control means displays at least one of the first deformation object and the second deformation object, which indicate the position of the deformation of a specific deformation type of the structure, in a manner superimposed on the foreground of the image. 3. The image processing device according to item 2, (Item 12) The deformation is at least one of cracks, water leakage, peeling, efflorescence, exposed rebar, and rust fluid; 2. The image processing device according to item 1, (Item 13) The background is a graphic drawn on the structure in the image. 2. The image processing device according to item 1, (Item 14) The color of the outline of the first deformed object and the color of the outline of the second deformed object are different from each other in at least one of hue, saturation, and brightness. 7. The image processing device according to claim 6, (Item 15) A part of the contour of the first deformed object is an end portion in the longitudinal direction of the first deformed object; 9. The image processing device according to claim 8, (Item 16) An acquisition step in which an acquisition means of the image processing device acquires information indicating a position of a deformation of the structure in an image obtained by photographing the structure; The display control means of the image processing device includes a display control step of superimposing a first abnormality object indicating a position of an abnormality in the structure on an image of the structure, and a display control step of controlling the color of the first abnormality object in the superimposed display to be determined according to a background color of the first abnormality object. A method comprising: (Item 17) A program for causing a computer to function as each of the means of the image processing device according to any one of items 1 to 15.

[0074] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0075] 100 Image processing device 101 Control section 102 Volatile Memory 103 Non-volatile memory 104 Storage Devices 105 Input Device 106 Output Device 107 Communication Equipment 108 System Bus 211 Image Management Department 212 Image Storage Unit 213 Image Analysis Unit 214 Image analysis results storage section 215 Image analysis results management department

Claims

1. An acquisition means for acquiring information indicating a position of a deformation of a structure in an image of the structure; A display control means for superimposing a first deformed object indicating a position of the deformed state of the structure on an image of the structure, the display control means performing control for determining a color of the first deformed object in the superimposed display according to a background color of the first deformed object, The background is a second deformed object different from the image or the first deformed object, Further comprising a determination means for determining a color of each of the first and second deformed objects according to the type of the deformed state of each of the first and second deformed objects; The display control means performs control to change the color determined by the determination means so that the color of the outline of the first deformed object and the color of the outline of the second deformed object are displayed in different colors when the background is the second deformed object and the color difference between the color of the first deformed object and the color of the second deformed object based on the determination result of the determination means is smaller than a threshold value.

13. An image processing device comprising:

2. An acquisition means for acquiring information indicating a position of a deformation of a structure in an image of the structure; A display control means for superimposing a first deformed object indicating a position of the deformed state of the structure on an image of the structure, the display control means performing control for determining a color of the first deformed object in the superimposed display according to a background color of the first deformed object, The display control means displays the first deformed object superimposed on the image so as not to display a part of the contour of the first deformed object.

13. An image processing device comprising:

3. An acquisition means for acquiring information indicating a position of a deformation of a structure in an image of the structure; A display control means for superimposing a first deformed object indicating a position of the deformed state of the structure on an image of the structure, the display control means performing control for determining a color of the first deformed object in the superimposed display according to a background color of the first deformed object, The background is a second deformed object different from the image or the first deformed object, Further comprising a determination means for determining whether the first deformed object and the second deformed object overlap based on a distance between a predetermined position of the first deformed object and a predetermined position of the second deformed object, When the first deformed object and the second deformed object overlap based on the distance, the determination means determines which of the part of the first deformed object and the part of the second deformed object at the overlapping position has a specific part, The display control means displays the first deformed object or the second deformed object having the specific portion on the foreground of the image in a superimposed manner based on the determination result of the determination means, The specific portion is a start point or an end point of the deformation.

13. An image processing device comprising:

4. The background is a second deformed object different from the image or the first deformed object, 3. The image processing device according to claim 2.

5. The color of the background is the color of the image in the portion where the first deformed object is superimposed, or the color of the second deformed object superimposed on the first deformed object, 5. The image processing device according to claim 1, 3 or 4.

6. The display control means controls the color of at least a part of the first deformed object to be changed from a predetermined color when the background is the image and the color difference between the color of the first deformed object and the color of the background is smaller than a threshold value.

5. The image processing device according to claim 1,

7. The display control means controls the color of the first abnormality object to be the predetermined color when the background is the image and the color difference is greater than the threshold value.

7. The image processing device according to claim 6,

8. Further comprising a determination means for determining a color of each of the first and second deformed objects according to the type of the deformed state of each of the first and second deformed objects; The display control means performs control to change the color determined by the determination means so that the color of the outline of the first deformed object and the color of the outline of the second deformed object are displayed in different colors when the background is the second deformed object and the color difference between the color of the first deformed object and the color of the second deformed object based on the determination result of the determination means is smaller than a threshold value.

5. The image processing device according to claim 3, wherein the image processing device is a digital camera.

9. The display control means controls the color of the first deformed object and the color of the second deformed object to be a color based on the determination result of the determination means when the background is the second deformed object and the color difference is greater than the threshold value.

9. The image processing device according to claim 8,

10. The display control means displays the first deformed object superimposed on the image so as not to display a part of the contour of the first deformed object.

4. The image processing device according to claim 1, wherein the first and second inputs are input to the image processing apparatus.

11. A determination means for determining whether the first deformed object and the second deformed object overlap each other based on a distance between a predetermined position of the first deformed object and a predetermined position of the second deformed object, 5. The image processing device according to claim 1, wherein the first and second inputs are input to the image processing apparatus.

12. When the first deformed object and the second deformed object overlap based on the distance, the determination means determines which of the part of the first deformed object and the part of the second deformed object at the overlapping position has a specific part, The display control means displays the first deformed object or the second deformed object having the specific portion on the foreground of the image in a superimposed manner based on the determination result of the determination means, The specific portion is a start point or an end point of the deformation. The image processing device according to claim 11 .

13. The display control means displays at least one of the first deformation object and the second deformation object, which indicate the position of a deformation of a specific type of the structure, in a manner superimposed on the foreground of the image.

5. The image processing device according to claim 1, 3 or 4.

14. The deformation is at least one of cracks, water leakage, peeling, efflorescence, exposed rebar, and rust fluid.

4. The image processing device according to claim 1, wherein the first and second inputs are input to the image processing apparatus.

15. The background is a graphic drawn on the structure in the image.

4. The image processing device according to claim 1, wherein the first and second inputs are input to the image processing apparatus.

16. The color of the outline of the first deformed object and the color of the outline of the second deformed object are different from each other in at least one of hue, saturation, and brightness.

5. The image processing device according to claim 1, 3 or 4.

17. A part of the contour of the first deformed object is an end portion in the longitudinal direction of the first deformed object, 3. The image processing device according to claim 2.

18. A part of the contour of the first deformed object is an end portion in the longitudinal direction of the first deformed object, The image processing device according to claim 10 .

19. An acquisition step in which an acquisition means of the image processing device acquires information indicating a position of a deformation of the structure in an image obtained by photographing the structure; A display control step in which a display control means of the image processing device superimposes a first deformation object indicating a position of deformation of the structure on an image of the structure, and a display control step in which a color of the first deformation object in the superimposed display is determined according to a background color of the first deformation object, The background is a second deformed object different from the image or the first deformed object, The determination means of the image processing device further includes a determination step of determining the color of each of the first deformed object and the second deformed object according to the type of the deformed state of each of the first deformed object and the second deformed object, In the display control step, when the background is the second deformed object and the color difference between the color of the first deformed object and the color of the second deformed object based on the determination result of the determination step is smaller than a threshold value, the display control means of the image processing device performs control to change the color determined in the determination step so that the color of the outline of the first deformed object and the color of the outline of the second deformed object are displayed in different colors. A method comprising:

20. An acquisition step in which an acquisition means of the image processing device acquires information indicating a position of a deformation of the structure in an image obtained by photographing the structure; A display control step in which a display control means of the image processing device superimposes a first deformation object indicating a position of deformation of the structure on an image of the structure, and a display control step in which a color of the first deformation object in the superimposed display is determined according to a background color of the first deformation object, In the display control step, the display control means of the image processing device superimposes and displays the first deformed object on the image so as not to display a part of the contour of the first deformed object. A method comprising:

21. An acquisition step in which an acquisition means of the image processing device acquires information indicating a position of a deformation of the structure in an image obtained by photographing the structure; The display control means of the image processing device is a display control means for superimposing a first deformed state object indicating a position of the deformed state of the structure on an image of the structure, and a display control step for controlling the color of the first deformed state object in the superimposed display to be determined according to a background color of the first deformed state object, The background is a second deformed object different from the image or the first deformed object, The determination means of the image processing device further includes a determination step of determining whether the first deformed object and the second deformed object overlap based on a distance between a predetermined position of the first deformed object and a predetermined position of the second deformed object, The determination means of the image processing device, in the determination step, when the first deformed object and the second deformed object overlap based on the distance, determines which of the part of the first deformed object and the part of the second deformed object at the overlapping position has a specific part, In the display control step, the display control means of the image processing device superimposes and displays the first deformed object or the second deformed object having the specific portion on the foreground of the image based on the judgment result of the judgment step, The specific portion is a start point or an end point of the deformation. A method comprising:

22. A program for causing a computer to function as each of the means of the image processing apparatus according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • Defect image display control device and program

    JP6569002B2

  • Defect detection apparatus and program

    WO2017103982A1

  • Image display device, image display method, and program

    WO2021171839A1

  • Inspection support device, method, and program

    WO2021199830A1