Display control device and its control method

Abstract

Improve the readability of information regarding multiple deformations within inspection images. [Solution] The display control device comprises a management means for managing deformation information relating to multiple deformations occurring in a target object, and a display control means for displaying information relating to one or more deformations corresponding to a partial area of ​​the target object based on the deformation information. The deformation information includes shape information, identification information, and additional information for each of the multiple deformations. The display control means displays a deformation object corresponding to each of the one or more deformations based on the shape information, displays a first label indicating the identification information corresponding to each of the one or more deformations, displays a second label indicating the additional information corresponding to each of the one or more deformations that does not overlap with the labels of other deformations, and does not display at least one second label that overlaps with the labels of other deformations.

Description

Technical Field

[0001] The present invention relates to a technique for displaying information on abnormalities in an image obtained by photographing an inspection object.

Background Art

[0002] Concrete surfaces of bridges and buildings may develop abnormalities (such as cracks and water leakage) due to various factors. In recent years, systems that input inspection images of concrete surfaces taken by cameras into a computer to automatically detect abnormalities have begun to spread, and the digitization of inspections has advanced. Patent Document 1 discloses a method of assigning identification information unique to each detected abnormality in an inspection image and managing the abnormality detection results as abnormality information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An inspector needs to display an inspection image and abnormality information on a computer screen to confirm the validity of the abnormality detection result. However, when there are a plurality of abnormalities densely present in the range of the inspection image to be displayed, there is a problem that the readability of the identification information / additional information of each abnormality decreases.

[0005] In view of such problems, the present invention has been made, and an object thereof is to provide a display control technique for improving the readability of information on a plurality of abnormalities in an inspection image.

Means for Solving the Problems

[0006] In order to solve the above problems, the display control device according to the present invention has the following configuration. That is, the display control device A management means for managing deformation information regarding multiple deformations occurring in the target object, A display control means that displays information on one or more deformations corresponding to a partial region of the target object based on the deformation information, Equipped with, The deformation information includes shape information, identification information, and additional information for each of the plurality of deformations. The display control means is A deformation object corresponding to each of the one or more deformations is displayed on the display unit based on the shape information. A first label indicating identification information corresponding to each of the one or more aforementioned deformations is displayed on the display unit. Of the second labels indicating additional information corresponding to each of the one or more aforementioned abnormalities, the display unit displays any second label that does not overlap with the first label or second label of another abnormality, and does not display any second label that overlaps with the first label or second label of another abnormality. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a display control technology that improves the readability of information regarding multiple deformations within an inspection image. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram shows the hardware configuration of the display control device. [Figure 2] This diagram shows the functional configuration of the display control device. [Figure 3] This is a diagram illustrating information about the deformation. [Figure 4] This figure shows an example of a display screen showing the abnormality. [Figure 5] This diagram illustrates how to display the deformation ID / deformation additional information. [Figure 6] This diagram illustrates the control process for displaying the deformation ID and additional deformation information. [Figure 7] This is a flowchart of the display process. [Figure 8]This diagram illustrates variations in display methods. [Modes for carrying out the invention]

[0009] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] (First Embodiment) As a first embodiment of the display control device according to the present invention, an information processing device that controls the display of information related to deformation (deformed object / identification information / additional information) in an image (inspection image) of an object to be inspected will be described below as an example.

[0011] <Device configuration> Figure 1 shows the hardware configuration of the information processing device. The embodiment described below describes an example in which a general-purpose computer (PC) is used as the information processing device.

[0012] The computer 101 includes a control unit 111, volatile memory 112, non-volatile memory 113, storage device 114, input device 115, output device 116, communication device 117, and system bus 118. A graphics processing unit (GPU) 151 may also be added as needed.

[0013] The control unit 111 includes an arithmetic processing processor such as a CPU (Central Processing Unit) that comprehensively controls the entire computer. The volatile memory 112 is a RAM (Random Access Memory) that temporarily stores programs and data supplied from external devices and the like. The non-volatile memory 113 is a ROM (Read-Only Memory) that stores programs and parameters executed by the processor of the control unit.

[0014] The storage device 114 is a storage such as a flash memory or a hard disk built into or externally connected to the computer 101. Also, the storage device 114 can be constituted by a combination of a storage medium such as a DVD and a drive that reads and writes data to and from the storage medium.

[0015] The input device 115 is an operation unit such as a mouse, a keyboard, or a touch panel that accepts user operations, and transmits an operation instruction to the control unit 111. The output device 116 is a display device such as a display or a monitor, and displays the processing result of the software executed by the control unit 111. The communication device 117 connects to the Internet or a local area network (LAN) and communicates with external devices. The system bus 118 includes an address bus, a data bus, and a control bus that connect each component of the computer 101 so that data can be exchanged.

[0016] The non-volatile memory 113 stores a basic input / output system (BIOS) that boots the computer 101 and controls each hardware. When the computer is booted, by reading and executing the BIOS, the computer boots the operating system (OS) installed in the storage device 114.

[0017] In this embodiment, information processing by the computer 101 is achieved by the control unit 111 executing the OS or additional software installed on the OS. Multiple computers 101 may be used as needed. In that case, a server-client configuration may be adopted. For example, computationally intensive information processing may be performed on the server computer, and the client computer may view the information processing results from the server computer using a browser or the like. Alternatively, the client computer may execute a web application provided by the server computer.

[0018] Figure 2 shows the functional configuration of the information processing device. As described above, each function (information processing) of the information processing device is realized by the control unit 111 executing the OS or additional software installed on the OS.

[0019] The image storage unit 211 stores images (inspection images) uploaded by the user. The image management unit 212 uniquely identifies and manages the image files stored in the image storage unit 211. For example, the image management unit 212 assigns a universal unique identifier (UUID) to the image files stored in the image storage unit 211 and manages the file name, registration date and time, etc.

[0020] The image analysis unit 213 performs image analysis on the image files stored in the image storage unit 211 to detect structural deformation. One example of an image analysis method is to use an artificial intelligence (AI) model pre-trained by machine learning to detect and output deformation from the input image, but any other method may be used. To perform AI inference processing at high speed, it is possible to configure the system to use the GPU 151.

[0021] The image analysis result storage unit 214 stores the analysis results from the image analysis unit 213. For example, it classifies the deformations detected in the inspection image by type of deformation (cracks, water leakage, etc.) and stores them as shape data such as polylines and polygons.

[0022] The image analysis result management unit 215 manages the association between images stored in the image storage unit 211 and the analysis results stored in the image analysis result storage unit 214. Furthermore, even if multiple image analyses are performed on a single image, the image analysis result management unit 215 can collectively associate that single image with all of those multiple analysis results.

[0023] The user interface (UI) control unit 216 displays the data (images and image analysis results) managed and stored by each of the above-mentioned functional units on the display unit, which is the output device 116. It also displays a UI that accepts user input on the display unit. The UI control unit 216 may be implemented by a local application on the computer 101, or by running a web application provided by a server in the browser of the computer 101.

[0024] <Information about damage and display of information about damage> In inspecting concrete surfaces, types of damage include cracks, water leakage, rust stains, exposed rebar, and efflorescence. Below, we will describe a method of managing individual damages by assigning identification information to them, focusing on the representative types of damage, "cracking" and "water leakage." In addition, supplementary information (width, length, area, etc.) is managed for each individual damage.

[0025] Figure 3 illustrates the deformation information stored in the image analysis result storage unit 214. Table 301 is a table that stores deformation information for multiple deformations. Each record (each deformation) in Table 301 contains identification information (ID) 311, deformation type 312, deformation ID 313, size information 314, and vertex coordinates 315.

[0026] ID311 is identification information for uniquely identifying a deformation. Deformation type 312 stores the type of deformation, such as cracks or water leaks. Deformation ID313 is identification information that combines deformation type 312 and ID311 to improve readability. As described later, deformation ID313 is used as the string displayed on the deformation label in the GUI display. In other words, it is identification information that makes it easier for users to distinguish individual deformations. Here, ID311 is combined with a prefix indicating deformation type 312 (such as CR (Crack), WL (Water leak)), but other expressions are also acceptable.

[0027] Size information 314 contains information about the actual size of the deformation. For deformations represented by polylines (linear deformations such as cracks), the length of the polyline and the width of the polyline (such as the width of the widest opening of the crack) are stored. For deformations represented by polygons (deformations with two-dimensional spread, such as water leaks), the maximum width in the horizontal direction and the maximum height in the vertical direction of the polygon are stored. Size information is not limited to these; more detailed information or other size information may be stored. Vertex coordinates 315 contain shape information of the deformation and are the vertex coordinates of the polyline or polygon.

[0028] In image analysis of captured images (inspection images), the image is processed pixel by pixel, and therefore the pixel coordinate system is used. However, it is also possible to convert to actual size depending on the image resolution (mm / pixel) of the object being photographed.

[0029] Figure 4 shows an example of a deformation display screen (GUI) displayed on the display unit by the UI control unit 216. GUI 400 is a GUI for presenting inspection images and deformation detection results to the user.

[0030] The original image 401 is an inspection image (a partial area) acquired from the image storage unit 211. The polyline 402 is a figure drawn with polylines representing crack deformation. The polygon 403 is a figure drawn with polygons representing water leakage deformation. By overlaying one or more deformation objects (polyline 402, polygon 403) onto the original image 401 as the background image, the user can visually confirm where and how large the deformations are detected in the image.

[0031] The zoom magnification display 411 is a UI component that indicates the zoom magnification of the image display. Buttons 412 and 413 are UI components that control zoom in and zoom out. In other words, the user can change the display magnification of the original image 401 by pressing buttons 412 and 413 (mouse click or touch operation). The display on the zoom magnification display 411 changes accordingly.

[0032] Checkbox 421 is a UI component that switches the display of the polyline 402 and polygon 403 of the deformation on or off for each type of deformation. Furthermore, since the severity of a crack can be roughly determined by its width, checkboxes that switch on or off for each crack width may be provided, as shown in Figure 4.

[0033] Checkbox 422 is a UI component that toggles the display of the deformation label on and off. Additionally, as shown in Figure 4, a checkbox 423 may be provided to toggle the display of additional deformation information on and off.

[0034] Figure 5 illustrates the method for displaying deformation ID / deformation additional information. Screen 500 shows how to determine the display position of the information label when only polylines exist, and Screen 510 shows how to determine the display position of the information label when only polygons exist.

[0035] Screen 500 is a diagram showing the arrangement of information labels when displayed on a polyline 501 indicating a crack. Point 502 is the midpoint of the polyline 501. For example, if the polyline is composed of five segments (line segments or arcs), the midpoint of the third and central segment may be used as the midpoint of the polyline. Alternatively, the midpoint can be determined in any way, such as by calculating the total length of the polyline and setting the midpoint of the polyline at a position half that length.

[0036] Area 503 is the label display area for the deformation ID. The width and height of area 503 are determined by the number of characters in the deformation ID and the display font. In this example, area 503 for the deformation ID label is defined with point 502 as the center. In this case, the center of area 503 in the width and height direction coincides with point 502 (midpoint). Note that the placement of area 503 can be determined in any way, such as aligning the left edge and top edge of area 503 with point 502 (midpoint).

[0037] Area 504 is the label display area for the deformation information. Similar to area 503 described above, the width and height of area 504 are determined by the number of characters in the deformation information and the display font. In the example of screen 500, the left edge of area 503 and the left edge of area 504 are aligned, and area 504 is placed directly below area 503 (without overlapping). Alternatively, the center of area 504 and the center of area 503 may be aligned, or area 504 may be configured to be placed at the right edge of area 503. The arrangement of areas 503 and 504 can be determined in any way.

[0038] Screen 510 is a diagram showing the arrangement when information labels are superimposed on a polygon 511 indicating a water leak. Point 512 is the center point of polygon 511. For example, the circumscribing rectangle of the polygon can be found, and its center point can be set to 511. However, since deformations appearing in structures can take on various shapes, the center point can be determined by any method, such as using the centroid of the polygon as the center point. Region 513 is the label display area for the deformation ID, and region 514 is the label display area for additional deformation information. The method for determining the size and placement of regions 513 and 514 is the same as for regions 503 and 504 described above, so the explanation is omitted.

[0039] Screen 520 shows an example of displaying information labels when both a polyline and a polygon overlap. Label display 521 is a label display of the deformation ID for polyline 501, and label display 522 is a label display of the deformation ID for polygon 511. Label display 521 is displayed in the same position as area 503 in screen 500, and label display 522 is displayed in the same position as area 513 in screen 510.

[0040] Furthermore, because label 521 and label 522 are located close together, they partially overlap. Here, a priority has been assigned to the type of damage, with "cracks > water leakage". Therefore, label 521 is displayed in front of label 522.

[0041] Therefore, the rendering order on screen 520 (from back to front) is as follows: original image 401, polygon 511 (water leak), polyline 501 (crack), label display 522 (water leak deformation ID), and label display 522 (crack deformation ID). This makes it possible to control the display so that information of higher priority deformation types is shown in the foreground.

[0042] Figure 6 illustrates the details of the control when displaying the deformation ID and additional deformation information. Display screen 600 shows an example of the GUI (Figure 4) when the zoom level is increased to 200%.

[0043] Label display 601 is a label display of deformation information for polylines, and label display 602 is a label display of deformation information for polygons. Here, the position of each label display is determined in the same way as explained with reference to screens 500 and 510. An example of displaying size information 314 as deformation information is also shown.

[0044] As illustrated, in screen 600, label display 601 is displayed at the forefront, so there are no readability issues. On the other hand, label display 602 is partially hidden by the "label display of deformation ID for polyline," resulting in readability problems (the text is illegible or difficult to see). Furthermore, displaying a large amount of unnecessary information to the user, as in screen 600, reduces usability. Also, unlike deformation ID, deformation-related information is not essential.

[0045] Therefore, when label display overlap occurs as shown in screen 600, the display is controlled as shown in screen 610. Specifically, if label display 602, which is partially hidden by the overlap, contains low-priority information (anomaly information), label display 602 is hidden. This makes the display screen highly readable.

[0046] <Device Operation> Figure 7 is a flowchart of the display control process in the information processing device. The display control process is performed by the UI control unit 216, which is realized by the control unit 111 executing the OS or additional software installed on the OS. Prior to processing, the UI control unit 216 obtains the original image and its corresponding analysis results (table 301) from the image storage unit 211 and the image analysis result storage unit 214. It is also assumed that the original image is displayed in the GUI 400.

[0047] In S701, the UI control unit 216 determines whether it has detected a change in the display area 401 (display position and / or display magnification) of the original image. Changes in the display area of ​​the original image can be accepted by the user by manipulating UI components on the GUI 400 (e.g., dragging the original image 401, pressing buttons 412 and 413). If the answer is yes, the process proceeds to S702 to update the display; otherwise, the process ends.

[0048] In S702, the UI control unit 216 selects only the deformation information whose deformation coordinates are within the range of the display area 401 from among the multiple deformation information contained in the table 301 and inputs it into the work array. In the following steps, processing is performed on the deformation information contained in the work array.

[0049] In S703, the UI control unit 216 sorts the workpiece array in descending order of priority (lower priority at the beginning of the array). Here, as mentioned above, it is assumed that priority is assigned according to the deformation type 312, but other criteria may be used to determine priority. For example, the deformation information may be analyzed and sorted by the degree of deformation progression (larger crack width, longest total crack length, or, in the case of surface shapes, largest area).

[0050] S704 loops through the work array sorted in S703 from the beginning to the end (loop 1). In S704, the UI control unit 216 displays the "deformation objects (polylines, polygons)" of the deformations in the work array and sequentially displays the "deformation ID labels" in the order of the work array (i.e., in order of increasing priority). As a result, the labels of deformation IDs of deformations with higher priority are displayed relatively in front. Note that the "deformation objects (polylines, polygons)" and "deformation ID labels" may be displayed sequentially in parallel.

[0051] In S705, the UI control unit 216 sorts the work array in order of priority, based on the deformation information within the work array (the higher the priority, the higher the priority at the beginning of the array).

[0052] Lines S706 to S708 loop through the sorted work array from the beginning to the end (loop 2).

[0053] In S706, the UI control unit 216 checks the display area (label display position / size) for the "deformation additional information label display" in order of priority within the work array. The deformation additional information is, for example, size information in table 301, but it may also be other additional information. The display area (label display position / size) for the "deformation additional information label display" is determined as shown in area 504 and area 514 as explained with reference to Figure 5.

[0054] In S707, the UI control unit 216 determines whether the display area for the deformation information overlaps with other labels already displayed ("deformation ID label display" or "deformation information label display"). For example, it is determined that label display 601 in Figure 6 does not overlap, while label display 602, which is determined after label display 601, does overlap. If the answer is No, the process proceeds to S708; if the answer is Yes, S708 is skipped. In S708, the UI control unit 216 displays the "deformation information label display".

[0055] As a result of the display control described above, regarding the label display of deformation IDs, overlapping labels are allowed, and labels are displayed for all deformations within the work array. However, since the labels of deformation IDs of higher-priority deformations are displayed relatively in front, a decrease in readability is unlikely to occur for labels of deformation IDs of higher-priority deformations.

[0056] Furthermore, regarding the display of labels for additional information on defects, labels will only be displayed for defects where label overlap does not occur, and for defects with relatively high priority among those where label overlap occurs. In other words, it becomes possible to suppress cluttered displays that reduce readability.

[0057] As described above, according to the first embodiment, when displaying labels for deformations, display control is performed based on the priority of the deformation and the type of label display. This makes it possible to display deformation information in a way that suppresses a decrease in readability.

[0058] In S707 described above, only whether the display area for the deformation information overlaps with other labels already displayed was determined. However, the system may be configured to calculate the degree of overlap and control whether or not the display is shown based on whether it is below a threshold. Alternatively, the system may be configured to switch whether or not to allow overlapping label displays based on user specifications.

[0059] Furthermore, if the display magnification of the GUI screen is enlarged beyond a predetermined magnification, additional deformation information that was not displayed before enlargement may be displayed in a position that does not overlap with other deformation IDs and additional deformation information. Also, if the display is reduced beyond a predetermined magnification, additional deformation information that was displayed before reduction may be hidden.

[0060] (modified version) In the first embodiment described above, an example was given in which the "label display of the deformation ID" and the "label display of additional deformation information" were made using opaque label displays. However, transparent label displays may also be used for the display.

[0061] Figure 8 illustrates variations in label display.

[0062] Screen 800 shows an example where the label display (rectangular area) is a transparent image. This allows the user to view the background original image and the deformation object (polyline / polygon) while displaying the deformation ID labels 801 and 802.

[0063] Screen 810 shows an example of displaying the text outline of the label 811 with a different color border. Specifically, the text outline is bordered with a different color than the text color to improve the readability of the label text. This makes it possible to improve the problem where the text of the displayed label blends into the background and becomes difficult to see when the background image is a black object or similar.

[0064] Screen 820, in addition to Screen 800, shows an example of using graphic elements such as icons as labels, not just text. It also displays deformation objects (polylines and polygons) in predetermined colors. For example, the color of the icon and deformation shape can be set according to the width of the crack.

[0065] Solid line 821 is a polyline indicating cracks of 1.0 mm or larger and is displayed in red. Solid line 822 is a polyline indicating cracks of 0.5 mm or larger but less than 1.0 mm and is displayed in orange. Icon 831 is a red icon attached to the deformation ID label corresponding to solid line 821. Icon 832 is an orange icon attached to the deformation ID label corresponding to solid line 822. In other words, by coloring the labels of deformation objects and deformation IDs according to the color scheme shown in the legend, the relationship between deformation objects and deformation IDs is clearly displayed.

[0066] Furthermore, the format of the label display (deformation ID / deformation additional information) does not need to be limited to text only; various display styles and graphics can be used as needed.

[0067] Furthermore, the text color, background color, or color tile of the deformation label may be made changeable. In addition, the system may be configured to determine priority according to multiple categories specified in the legend (such as crack width and deformation type). Furthermore, the system may be configured to highlight the corresponding deformation object when the mouse cursor hovers over (over) the deformation label.

[0068] The disclosures herein include the following display control devices, control methods, and programs. (Item 1) A management means for managing deformation information regarding multiple deformations occurring in the target object, A display control means that displays information on one or more deformations corresponding to a partial region of the target object based on the deformation information, Equipped with, The deformation information includes shape information, identification information, and additional information for each of the plurality of deformations. The display control means is A deformation object corresponding to each of the one or more deformations is displayed on the display unit based on the shape information. A first label indicating identification information corresponding to each of the one or more aforementioned deformations is displayed on the display unit. Of the second labels indicating additional information corresponding to each of the one or more aforementioned deformations, the display unit will display any second label that does not overlap with the first or second label of another deformation, and will not display any second label that overlaps with the first or second label of another deformation. A display control device characterized by the following: (Item 2) The system further includes acquisition means for acquiring multiple images of the aforementioned target object. The display control means displays one or more images corresponding to the partial region on the display unit, and superimposes the deformation object, the first label, and the second label onto the one or more images. The display control device according to item 1, characterized in that it is a display control device. (Item 3) The system further comprises a modification means for accepting changes to the aforementioned sub-region, The display control means updates the display on the display unit when it receives a change to the partial area by the modification means. A display control device according to item 1 or 2, characterized in that it is a display control device. (Item 4) The system further includes a priority designation means for receiving priority designations for the aforementioned multiple abnormalities, The display control means is The corresponding first labels are displayed sequentially on the display unit in order of the least priority of the modifications. The display area of ​​the corresponding second label is determined in order of the deformation with the highest priority, and any overlap with the first or second label of other deformations is determined. A display control device according to any one of items 1 to 3, characterized in that it is the display control device described in any one of items 1 to 3. (Item 5) The aforementioned priority is based on at least one of the type of deformation and the degree of deformation. The display control device described in item 4, characterized by the features described herein. (Item 6) The display control means is The display area of ​​the first label is determined based on the shape information of the corresponding deformation, and the display area of ​​the second label is determined based on the display area of ​​the first label. A display control device according to any one of items 1 to 5, characterized by the above. (Item 7) The display control means displays the deformation object and the first label corresponding to the same deformation in the same color. A display control device according to any one of items 1 to 6, characterized in that... (Item 8) The display control means displays the deformed object and the first label in different colors according to the degree of deformation progression. A display control device according to any one of items 1 to 7, characterized by the above. (Item 9) A control method for displaying deformations occurring in a target object on a display unit, An acquisition step to acquire deformation information relating to multiple deformations occurring in the target object, A display control step of displaying information on one or more deformations corresponding to a partial region of the target object based on the deformation information, Includes, The deformation information includes shape information, identification information, and additional information for each of the plurality of deformations. In the aforementioned display control step, A deformation object corresponding to each of the one or more deformations is displayed on the display unit based on the shape information. A first label indicating identification information corresponding to each of the one or more aforementioned deformations is displayed on the display unit. Of the second labels indicating additional information corresponding to each of the one or more aforementioned deformations, the display unit will display any second label that does not overlap with the first or second label of another deformation, and will not display any second label that overlaps with the first or second label of another deformation. A control method characterized by the following: (Item 10) A program that causes a computer to execute the control method described in item 9.

[0069] (Other examples) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0070] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0071] 211 Image storage unit; 212 Image management unit; 213 Image analysis unit; 214 Image analysis result storage unit; 215 Image analysis result management unit; 216 UI control unit

Claims

1. A management means for managing deformation information regarding multiple deformations occurring in the target object, A display control means that displays information regarding one or more deformations corresponding to a partial region of the target object based on the deformation information, Equipped with, The deformation information includes shape information, identification information, and additional information for each of the plurality of deformations. The display control means is A deformation object corresponding to each of the one or more deformations is displayed on the display unit based on the shape information. A first label indicating identification information corresponding to each of the one or more aforementioned deformations is displayed on the display unit. Of the second labels indicating additional information corresponding to each of the one or more aforementioned deformations, the display unit will display any second label that does not overlap with the first or second label of another deformation, and will not display any second label that overlaps with the first or second label of another deformation. A display control device characterized by the following:

2. The system further includes acquisition means for acquiring multiple images of the aforementioned target object. The display control means displays one or more images corresponding to the partial region on the display unit, and superimposes the deformation object, the first label, and the second label onto the one or more images. The display control device according to feature 1.

3. The system further comprises a modification means for accepting changes to the aforementioned sub-region, The display control means updates the display on the display unit when it receives a change to the partial area by the modification means. The display control device according to feature 1.

4. The system further includes a priority designation means for receiving priority designations for the aforementioned multiple abnormalities, The display control means is The corresponding first labels are displayed sequentially on the display unit in order of the least priority of the modifications. The display area of ​​the corresponding second label is determined in order of the deformation with the highest priority, and any overlap with the first or second label of other deformations is determined. The display control device according to feature 1.

5. The aforementioned priority is based on at least one of the type of deformation and the degree of deformation progression. The display control device according to feature 4.

6. The display control means is The display area of ​​the first label is determined based on the shape information of the corresponding deformation, and the display area of ​​the second label is determined based on the display area of ​​the first label. The display control device according to feature 1.

7. The display control means displays the deformation object and the first label corresponding to the same deformation in the same color. The display control device according to feature 1.

8. The display control means displays the deformed object and the first label in different colors according to the degree of deformation progression. The display control device according to feature 1.

9. A control method for displaying deformations occurring in a target object on a display unit, An acquisition step to acquire deformation information relating to multiple deformations occurring in the target object, A display control step which includes displaying information on one or more deformations corresponding to a partial region of the target object based on the deformation information, Includes, The deformation information includes shape information, identification information, and additional information for each of the plurality of deformations. In the aforementioned display control step, A deformation object corresponding to each of the one or more deformations is displayed on the display unit based on the shape information. A first label indicating identification information corresponding to each of the one or more aforementioned deformations is displayed on the display unit. Of the second labels indicating additional information corresponding to each of the one or more aforementioned deformations, the display unit will display any second label that does not overlap with the first or second label of another deformation, and will not display any second label that overlaps with the first or second label of another deformation. A control method characterized by the following:

10. A program for causing a computer to execute the control method described in claim 9.

Images