Display control device, display control method, and display control program

Abstract

To provide a display control device, a display control method, and a display control program, in which a user can easily understand whether specific provision information is provided on a tomographic image corresponding to a designated tomographic position on a designated object.SOLUTION: A display control device displays a designated object for designating a tomographic position corresponding to each of a plurality of tomographic images, and a tomographic image corresponding to the designated tomographic position. In a tomographic image in which user provision information and provision information including computer provision information, a mark representing the provision information is displayed at a position in a depth direction of the designated object corresponding to the tomographic position of the tomographic image. When the user provision information and the provision information including computer provision information are provided to the tomographic images at the same tomographic position, a mark representing the user provision information and a mark representing the computer provision information are displayed at different positions not overlapping with each other.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to a display control device, a display control method, and a display control program. [Background technology]

[0002] In recent years, medical image diagnosis has been performed using three-dimensional images taken by imaging devices such as CT (Computed Tomography) devices and MRI (Magnetic Resonance Imaging) devices. Such three-dimensional images include tomographic images taken at multiple different cross-sectional positions. In image diagnosis using three-dimensional images, doctors switch between and display the multiple tomographic images.

[0003] As a technique for switching between and displaying multiple tomographic images, a technique for displaying a slider bar for specifying a tomographic position corresponding to each of multiple tomographic images has been proposed (see Patent Document 1). With this technique, a slider is displayed on the slider bar, and the user specifies a tomographic position by moving the slider, and a tomographic image corresponding to the specified tomographic position is displayed. Also, with this technique, for example, a mark indicating that a computer diagnosis result is included is displayed next to the slider bar at a tomographic position corresponding to a tomographic image that includes the results of an image diagnosis performed by a computer, such as an abnormal shadow candidate (hereinafter referred to as a "computer diagnosis result").

[0004] Also, a technique has been proposed for displaying a label indicating the name of an organ included in a tomographic image corresponding to a tomographic position specified by a slider bar (see Patent Document 2). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-173910 [Patent Document 2] Patent No. 6419441 Summary of the Invention [Problem to be solved by the invention]

[0006] In the technology described in Patent Document 1, simply displaying a mark next to a slider bar can make it difficult for a user to determine whether a tomographic image at a specified tomographic position is assigned with additional information such as a computer diagnosis result. Particularly when there are many tomographic sections, it is difficult for a user to determine whether additional information is assigned to the tomographic image at the tomographic position specified by the slider or to adjacent tomographic images. This is because, when there are many tomographic sections and additional information is assigned to each of multiple tomographic images at adjacent tomographic positions, multiple marks corresponding to each additional information are closely spaced next to the slider bar, resulting in overlapping marks. Here, the additional information such as a computer diagnosis result described in Patent Document 1 is unique to each tomographic image, in the sense that the additional information assigned to each tomographic image is associated one-to-one with the mark corresponding to the additional information. Thus, in the technology described in Patent Document 1, it can be difficult for a user to determine whether unique additional information is assigned to the tomographic image corresponding to the tomographic position specified on the slider bar.

[0007] Furthermore, the technology described in Patent Document 2 is merely a technology for displaying labels of the names of organs included in a tomographic image corresponding to a specified tomographic position. Therefore, even with the technology described in Patent Document 2, as with Patent Document 1, it is sometimes difficult for a user to know whether or not unique information has been added to a tomographic image corresponding to a specified tomographic position on a slider bar.

[0008] The annotated information attached to the tomographic images described in Patent Document 2 is annotated information attached to each organ, and is not unique to each tomographic image; the annotated information attached to each tomographic image is associated one-to-one with the label. For example, even if the tomographic position specified on the slider bar is changed, as long as the same organ is shown in each tomographic image at the tomographic position before and after the change, the annotated information attached to each tomographic image is the same, and therefore a label with the same organ name is displayed. This means that one label is associated with multiple annotated information attached to multiple tomographic images containing the same organ. Therefore, as described above, even with the technology described in Patent Document 2, as with Patent Document 1, it may be difficult for a user to determine whether unique annotated information has been attached to a tomographic image corresponding to the tomographic position specified on the slider bar.

[0009] The present disclosure has been made in consideration of the above circumstances, and aims to provide a display control device, a display control method, and a display control program that allow a user to easily understand whether or not unique information has been assigned to a tomographic image corresponding to a tomographic position specified by a specified object. [Means for solving the problem]

[0010] The display control device of the present disclosure includes at least one processor, and the processor controls the display of designated objects for specifying a cross-sectional position corresponding to each of multiple medical cross-sectional images obtained by imaging a subject, and the cross-sectional images corresponding to the designated cross-sectional positions, and for cross-sectional images to which attribute information including at least one of user-assigned information assigned by a user and computer-assigned information assigned by a computer is assigned, the processor controls the display of a mark representing the attribute information at a depth-direction position of the designated object corresponding to the cross-sectional position of the tomographic image to which the attribute information is assigned, and when user-assigned information and computer-assigned information are assigned to cross-sectional images at the same cross-sectional position, the processor controls the display of the mark representing the user-assigned information and the mark representing the computer-assigned information at positions where they do not overlap. The depth direction refers to the depth direction of the multiple tomographic images.

[0011] In addition, the display control device of the present disclosure may be configured such that, when additional information is added to a tomographic image corresponding to a specified tomographic position, the processor controls the display of a mark representing the additional information so that it is displayed differently from other marks.

[0012] In the display control device of the present disclosure, the specified object may include a slider bar.

[0013] In the display control device of the present disclosure, the designated object may include a schema.

[0014] In addition, the display control device of the present disclosure may have a processor that controls the display of the slider bar by using different colors for the portion from one end of the slider bar to the specified fault position and the portion from the other end to the specified fault position.

[0015] In addition, the display control device of the present disclosure may be configured such that the assigned information includes computer-assigned information, and the processor controls the display so that a mark representing the computer-assigned information assigned to an undisplayed tomographic image and a mark representing the computer-assigned information assigned to an already-displayed tomographic image are distinguishable from each other.

[0016] In addition, the display control device of the present disclosure may be configured such that the assigned information includes computer-assigned information, and the processor receives input indicating whether the computer-assigned information is correct or not, and if the processor receives input indicating that the computer-assigned information is incorrect, the color of the mark representing the computer-assigned information is changed from the current display color to a color closer to the background color.

[0017] In addition, the display control device of the present disclosure may include computer-assigned information, and the processor may accept input to switch between displaying and hiding the computer-assigned information, and control switching between displaying and hiding a mark representing the computer-assigned information in accordance with the accepted input.

[0018] In addition, the display control device of the present disclosure may have a processor that controls the display of computer-assigned information on a tomographic image to which computer-assigned information has been assigned, and may also control the display and non-display of both a mark representing the computer-assigned information and the computer-assigned information on the tomographic image depending on the input received.

[0019] In addition, the display control device of the present disclosure may include, as computer-generated information, a contour of a region of interest in a tomographic image, and when the contour of a region of interest is attached to a tomographic image corresponding to a specified tomographic position, the processor controls the display of the contour of the region of interest on the tomographic image, and may further control the display of the contour of a region of interest attached to any of other tomographic images in which the same region of interest as the region of interest to be displayed has been detected.

[0020] Furthermore, the display control device according to the present disclosure may be configured such that the processor performs control to display the largest contour among contours of the regions of interest added to other tomographic images.

[0021] In addition, in the display control device of the present disclosure, the computer-assigned information may include information that the computer extracts a group of tomographic images that show the same object from a plurality of tomographic images, selects a representative tomographic image from the extracted group of tomographic images, and assigns to the selected tomographic image.

[0022] In addition, in the display control device of the present disclosure, the user-assigned information may include information assigned by the user to a representative tomographic image among a group of tomographic images that show the same object.

[0023] In addition, the display control method disclosed herein controls the display of a designated object for specifying a cross-sectional position corresponding to each of multiple medical cross-sectional images obtained by photographing a subject, and the cross-sectional image corresponding to the designated cross-sectional position, and for a cross-sectional image to which attribute information including at least one of user-assigned information assigned by a user and computer-assigned information assigned by a computer is assigned, controls the display of a mark representing the attribute information at a depth position of the designated object corresponding to the cross-sectional position of the assigned cross-sectional image, and when user-assigned information and computer-assigned information are assigned to cross-sectional images of the same cross-sectional position, a processor provided in the display control device performs a process of controlling the display of the mark representing the user-assigned information and the mark representing the computer-assigned information in positions where they do not overlap.

[0024] In addition, the display control program of the present disclosure controls the display of designated objects for specifying the tomographic positions corresponding to each of multiple medical tomographic images obtained by photographing a subject, and the tomographic images corresponding to the designated tomographic positions, and for tomographic images to which assigned information including at least one of user-assigned information assigned by a user and computer-assigned information assigned by a computer is assigned, controls the display of a mark representing the assigned information at a depth position of the designated object corresponding to the tomographic position of the assigned tomographic image, and causes a processor provided in the display control device to execute a process of controlling the display of the mark representing the user-assigned information and the mark representing the computer-assigned information at positions where they do not overlap, when user-assigned information and computer-assigned information are assigned to tomographic images of the same tomographic position. [Effects of the Invention]

[0025] According to the present disclosure, it is possible for a user to easily understand whether or not unique additional information is added to a tomographic image corresponding to a tomographic position designated by a designated object. [Brief explanation of the drawings]

[0026] [Figure 1]FIG. 1 is a block diagram illustrating an example of a configuration of a diagnosis support system. [Figure 2] FIG. 2 is a block diagram illustrating an example of a hardware configuration of a display control device. [Figure 3] FIG. 2 is a block diagram showing an example of a functional configuration of a display control device. [Figure 4] FIG. 10 is a diagram showing an example of a display screen of a slider bar and a tomographic image. [Figure 5] FIG. 10 is a diagram illustrating a slider bar. [Figure 6] FIG. 10 is a diagram showing an example of a state in which a mark representing additional information is highlighted. [Figure 7] 10A and 10B are diagrams illustrating examples of marks representing displayed and undisplayed computer-added information. [Figure 8] FIG. 10 is a diagram showing an example of an annotation, which is one of computer-added information and user-added information, displayed on a tomographic image. [Figure 9] FIG. 10 is a diagram showing an example of a mark representing computer-assigned information that is determined to be incorrect. [Figure 10] 10A and 10B are diagrams for explaining switching between displaying and hiding marks representing computer-assigned information. [Figure 11] 10A and 10B are diagrams for explaining switching between displaying and hiding computer-assigned information on a tomographic image. [Figure 12] 10 is a flowchart illustrating an example of a display control process. [Figure 13] 10 is a flowchart showing an example of a processing routine when a fault plane position is specified. [Figure 14] 10 is a flowchart showing an example of a processing routine when a user makes a decision on computer-assigned information. [Figure 15] 10 is a flowchart illustrating an example of a processing routine for switching between displaying and hiding computer-assigned information. [Figure 16] FIG. 10 is a diagram showing an example of a slider bar according to a modified example. [Figure 17]FIG. 10 is a diagram showing an example of a display state of computer-assigned information according to a modified example. [Figure 18] 10A and 10B are diagrams for explaining a process of adding computer-added information according to a modified example. [Figure 19] FIG. 10 is a diagram showing an example of a display screen of a schema and a tomographic image according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0027] Hereinafter, examples of embodiments for carrying out the technology of the present disclosure will be described in detail with reference to the drawings.

[0028] First, the configuration of a diagnosis support system 10 according to this embodiment will be described with reference to Fig. 1. As shown in Fig. 1, the diagnosis support system 10 includes a display control device 12, an imaging device 14, and an image storage device 16. The display control device 12, the imaging device 14, and the image storage device 16 are each connected to a network N and are capable of communicating with each other via the network N.

[0029] The imaging device 14 is a device that captures an image of a diagnostic target region of a subject, thereby generating a three-dimensional medical image representing the region. The three-dimensional medical image captured by the imaging device 14 includes a plurality of tomographic images. In this embodiment, an example in which a CT device is used as the imaging device 14 will be described, but this is not limiting. For example, a device that generates three-dimensional medical images other than a CT device, such as an MRI device or a PET (Positron Emission Tomography) device, may also be used as the imaging device 14. Furthermore, in this embodiment, an example in which axial cross-sectional images are used as the tomographic images constituting the three-dimensional medical image will be described, but this is not limiting. Tomographic images of cross-sections other than axial cross-sections, such as sagittal cross-sections and coronal cross-sections, may also be used as the tomographic images constituting the three-dimensional medical image.

[0030] The image storage device 16 is a computer that saves and manages medical images and includes a storage device for storing the medical images. The image storage device 16 transmits and receives medical images generated by the imaging device 14 between the display control device 12 and the imaging device 14 via the network N. The storage format of the medical images and communication between the devices via the network N are based on a predetermined protocol such as DICOM (Digital Imaging and Communication in Medicine).

[0031] Next, the hardware configuration of the display control device 12 according to this embodiment will be described with reference to Fig. 2. Examples of the display control device 12 include a personal computer and a server computer. The display control device 12 may also be a cloud server.

[0032] 2, the display control device 12 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, and a non-volatile storage unit 22. The display control device 12 also includes a display 23 such as a liquid crystal display, an input unit 24 such as a keyboard and a mouse, and a network I / F (Interface) 25 connected to a network N. The CPU 20, the memory 21, the storage unit 22, the display 23, the input unit 24, and the network I / F 25 are connected to a bus 26.

[0033] The storage unit 22 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. The storage unit 22 serving as a storage medium stores a display control program 30. The CPU 20 reads the display control program 30 from the storage unit 22, expands it in the memory 21, and executes the expanded display control program 30.

[0034] Next, the functional configuration of the display control device 12 according to this embodiment will be described with reference to Fig. 3. As shown in Fig. 3, the display control device 12 includes a reception unit 40 and a display control unit 42. The CPU 20 executes the display control program 30, thereby functioning as the reception unit 40 and the display control unit 42.

[0035] The receiving unit 40 receives various instructions input by the user via the input unit 24. The various instructions input by the user will be described in detail later.

[0036] 4, the display control unit 42 controls the display of a slider bar SB for specifying a cross-sectional position corresponding to each of a plurality of medical cross-sectional images obtained by imaging the subject, and the cross-sectional images corresponding to the specified cross-sectional positions, on the display 23. The plurality of medical cross-sectional images obtained by imaging the subject are a group of cross-sectional images constituting the three-dimensional medical image specified as the display target, among the three-dimensional medical images stored in the image storage device 16. As shown in FIG. 4, the screen displayed on the display 23 includes a display area A1 for displaying the slider bar SB, and a display area A2 for displaying the cross-sectional images.

[0037] In this embodiment, each tomographic image is configured to be assigned user-assigned information and computer-assigned information. Hereinafter, user-assigned information and computer-assigned information will be referred to collectively as "assigned information" without distinction. In this embodiment, the "assigned information" refers to unique assigned information for each tomographic image, in which the assigned information assigned to each tomographic image is associated with a mark (described later) corresponding to the assigned information in a one-to-one relationship. Examples of user-assigned information include bookmarks added by the user as markers for tomographic images that the user wants to view later, and annotations such as information about regions of interest (ROIs) included in the tomographic image. Examples of computer-assigned information include information about regions of interest detected by computer-aided diagnosis (CAD) or artificial intelligence (AI) image diagnosis. The region of interest here refers to a region of interest that the user focuses on, such as the region of a lesion such as a tumor. Examples of information about the region of interest include the contour, position, and area of ​​the region of interest. The computer-assigned information may be assigned by one or more computers. The computer that adds the computer-added information may be the display control device 12, a control device included in the imaging device 14, or the image storage device 16. It may also be a computer such as an image processing device external to the diagnosis support system 10.

[0038] 5 shows only the display area A1 of the display areas A1 and A2 shown in FIG. 4. The display control unit 42 controls the display of the slider SD at a position along the longitudinal direction of the slider bar SB corresponding to the specified cross-sectional position. In FIG. 5, the "H" enclosed in a rectangle represents the head side of the subject, and the "F" enclosed in a rectangle represents the foot side. That is, the position of the slider SD on the slider bar SB represents a cross-sectional position closer to the head among the cross-sectional positions of each of the cross-sectional images constituting the three-dimensional medical image, as it approaches "H," and as it approaches "F," it represents a cross-sectional position closer to the foot side. FIG. 5 shows an example in which the most head-side cross-sectional position among the cross-sectional positions of each of the cross-sectional images constituting the three-dimensional medical image is specified. The slider bar SB and the slider SD are examples of designation objects for designating cross-sectional positions corresponding to each of multiple cross-sectional images.

[0039] In addition, for a tomographic image to which additional information has been added, the display control unit 42 controls the display of a mark representing the added information, whereby one tomographic image can be identified by one mark, at the position of the slider bar SB corresponding to the tomographic position of the tomographic image to which additional information has been added.

[0040] Specifically, for a tomographic image to which a bookmark has been added, the display control unit 42 controls to display a mark BM representing the bookmark at a position on the slider bar SB corresponding to the tomographic position of the tomographic image to which the bookmark has been added. Also, for a tomographic image to which an annotation has been added, the display control unit 42 controls to display a mark AN representing the annotation at a position on the slider bar SB corresponding to the tomographic position of the tomographic image to which the annotation has been added. Also, for a tomographic image to which computer-added information has been added, the display control unit 42 controls to display a mark CD representing the computer-added information at a position on the slider bar SB corresponding to the tomographic position of the tomographic image to which the computer-added information has been added.

[0041] The display control unit 42 controls the display of each mark at the position of the slider bar SB corresponding to the cross-sectional position by shifting it along the direction perpendicular to the longitudinal direction of the slider bar SB (i.e., the longitudinal direction of the slider SD). This prevents multiple marks from overlapping even if they are at the same cross-sectional position.

[0042] The display control unit 42 also controls the display of a button BT for receiving an input from the user to switch between displaying and hiding the computer-assigned information.

[0043] The user specifies the cross-sectional position of the cross-sectional image that the user wants to display via the input unit 24. For example, the user specifies the cross-sectional position by dragging the slider SD to the cross-sectional position of the cross-sectional image that the user wants to display on the slider bar SB. Also, for example, the user specifies the cross-sectional position of the cross-sectional image that the user wants to display on the slider bar SB by scrolling the wheel of the mouse.

[0044] Furthermore, when attached information is attached to a tomographic image corresponding to a specified tomographic position, the display control unit 42 controls to highlight a mark representing the attached information. For example, as shown in Fig. 6, the display control unit 42 controls to highlight the mark corresponding to the specified tomographic position by displaying the outline of the mark thicker than the marks corresponding to non-specified tomographic positions. Fig. 6 shows an example in which a bookmark, an annotation, and computer-attached information are attached to a tomographic image corresponding to a specified tomographic position.

[0045] For example, the display control unit 42 may perform control to highlight the marks corresponding to designated fault positions by making the color of the outline of the marks different from the color of the outline of the marks corresponding to undesignated fault positions. Furthermore, for example, the display control unit 42 may perform control to highlight the marks corresponding to designated fault positions by blinking only the marks. These highlighting modes are merely examples, and other modes may also be used.

[0046] 7, the display control unit 42 controls the display of a mark CD (indicated as "Not Displayed" on the left side of FIG. 7) representing computer-added information added to an undisplayed tomographic image and a mark CD (indicated as "Displayed" on the right side of FIG. 7) representing computer-added information added to a displayed tomographic image in a distinguishable manner. Specifically, for example, when the background color is black, the display control unit 42 displays the mark CD representing computer-added information added to an undisplayed tomographic image by filling it with a relatively bright color (e.g., orange). On the other hand, when a tomographic position corresponding to the tomographic image is specified and the tomographic image is displayed and has been displayed, the color of the mark CD added to the displayed tomographic image is changed to a color close to the background color (e.g., light gray). This allows the user to know at a glance whether or not the computer-added information, i.e., whether or not the region of interest detected by the computer has been confirmed.

[0047] 8, for a tomographic image to which computer-attached information has been attached, the display control unit 42 controls the display of the computer-attached information on the tomographic image. Specifically, for example, the display control unit 42 controls the display of a region of interest represented by the computer-attached information in a color (e.g., orange) different from that of other regions. Furthermore, the computer-attached information is initially displayed without a contour.

[0048] 8, the display control unit 42 controls the display of annotations on tomographic images to which annotations have been added. Specifically, for example, the display control unit 42 controls the display of the outline of the region of interest represented by the annotation in a color (e.g., white) different from the color of the region of interest represented by the computer-added information. Therefore, the user can understand whether the region of interest displayed on the tomographic image was detected by a user operation or by a computer. Note that in FIG. 8, for ease of understanding, the outline of the region of interest represented by the annotation, which is a solid white line, is shown by a dashed line.

[0049] Furthermore, as shown in FIG. 8, when the display control unit 42 displays the computer-attached information on the tomographic image, the display control unit 42 controls the display of a button designated by the user when the computer-attached information is correct (the "agree" button in the example of FIG. 8) and a button designated by the user when the computer-attached information is incorrect (the "disagree" button in the example of FIG. 8). Here, whether the computer-attached information is correct or incorrect means, more precisely, whether the user judges the information to be correct or incorrect. If the contour of the region of interest represented by the computer-attached information is correct, the user selects the "agree" button via the input unit 24. On the other hand, if the contour of the region of interest represented by the computer-attached information is incorrect, the user selects the "disagree" button via the input unit 24.

[0050] When the receiving unit 40 receives an input indicating that the computer-added information is incorrect, i.e., when the "disagree" button is selected, the display control unit 42 performs the following control. In this case, as shown in FIG. 9, the display control unit 42 performs control to change the color of the mark CD representing the computer-added information from the current display color to a color close to the background color. Specifically, the display control unit 42 performs control to change the color of the mark CD from gray, which indicates that the information has already been displayed, to dark gray, which is close to the black background color. This makes it possible to make information added by the computer but unnecessary for the user less noticeable.

[0051] When the receiving unit 40 receives an input indicating that the computer-attached information is correct, i.e., when the "agree" button is selected, the display control unit 42 performs the following control. In this case, the display control unit 42 performs control to add an annotation to the tomographic image to which the computer-attached information designated as correct has been attached. Therefore, the outline of the region of interest represented by the computer-attached information designated as correct is displayed as an annotation, for example, in white. In this case, since the computer-attached information remains attached, the user can understand whether the region of interest is a region of interest designated by the user without being detected by the computer, or a region of interest detected by the computer and determined to be correct by the user.

[0052] In some cases, computer-based detection may detect multiple regions of interest. Therefore, the user may wish to hide the computer-assigned information during image diagnosis. When the user wishes to switch between displaying and hiding the computer-assigned information, the user designates button BT via the input unit 24.

[0053] When the receiving unit 40 receives an input to switch between displaying and hiding the computer-added information, the display control unit 42 controls to switch between displaying and hiding the mark CD representing the computer-added information in accordance with the received input, as shown in Fig. 10. Furthermore, in this embodiment, the display control unit 42 also controls to switch between displaying and hiding the computer-added information on the tomographic image in addition to the mark CD, as shown in Fig. 11.

[0054] Next, the operation of the display control device 12 according to this embodiment will be described with reference to Fig. 12. The CPU 20 executes the display control program 30, thereby executing the display control process shown in Fig. 12. The display control process is executed, for example, when a user inputs an execution instruction via the input unit 24 and identification information capable of identifying a group of tomographic images constituting a three-dimensional medical image to be displayed.

[0055] In step S10 of FIG. 12 , the display control unit 42 acquires from the image storage device 16 a group of tomographic images identified according to the input identification information, and controls the display 23 to display an initial screen based on the acquired group of tomographic images. Specifically, as described above, the display control unit 42 controls the display 23 to display a slider bar SB for specifying a tomographic position corresponding to each of the acquired group of tomographic images, and a tomographic image corresponding to the specified tomographic position. Also, as described above, the display control unit 42 controls the display 23 to display a slider SD at a position along the longitudinal direction of the slider bar SB corresponding to the specified tomographic position. Note that, although an example in which the most head-side tomographic position is applied as the specified tomographic position on the initial screen will be described, this is not limiting. The most foot-side tomographic position or a central tomographic position may also be applied as the specified tomographic position on the initial screen.

[0056] As described above, the display control unit 42 controls the display of a mark representing the attached information at the position of the slider bar SB corresponding to the tomographic position of the attached tomographic image for each of the tomographic images in the group of tomographic images. The display control unit 42 also controls the display of a button BT for receiving an input from the user to switch between displaying and hiding the computer-attached information. By the processing of step S10, the screen shown in FIG. 4 as an example is displayed on the display 23. When step S10 is executed for the second or subsequent time, the display control unit 42 maintains the most recent display state.

[0057] In step S12, the receiving unit 40 waits until it receives an instruction input by the user via the input unit 24. When the user inputs an instruction via the input unit 24, the determination in step S12 is affirmative, and the process proceeds to step S14. In step S14, the receiving unit 40 determines whether the instruction received in step S12 is an instruction to end the display. If this determination is negative, the process proceeds to step S16. In step S16, the display control unit 42 performs control to switch the display in accordance with the instruction received in step S12. When the process in step S16 ends, the process returns to step S12. On the other hand, if the determination in step S14 is negative, the display control process ends. The display states of the display objects displayed in the display region A1 and the display region A2 at the time the display control process ends are stored in the image storage device 16, for example, in association with the tomographic image group, and the display states are retained when step S10 is executed from the second time onward.

[0058] If the instruction received in step S12 is an instruction to specify a cross-sectional position by dragging the slider SD or scrolling the mouse wheel, the processing routine shown in FIG. 13 is executed in step S16.

[0059] 13, the display control unit 42 controls to move the slider SD to the position of the slider bar SB corresponding to the tomographic position specified by the user operation. In step S22, the display control unit 42 controls to switch the tomographic image in the display area A2 to the tomographic image of the specified tomographic position.

[0060] In step S24, the display control unit 42 determines whether or not additional information has been added to the tomographic image at the specified tomographic position. If this determination is affirmative, the process proceeds to step S26. In step S26, the display control unit 42 determines whether or not a bookmark has been added to the tomographic image at the specified tomographic position. If this determination is affirmative, the process proceeds to step S28.

[0061] In step S28, the display control unit 42 performs control to highlight the mark BM representing the bookmark added to the tomographic image of the specified tomographic position. If the determination in step S26 is negative, the process of step S28 is not executed and the process proceeds to step S30.

[0062] In step S30, the display control unit 42 determines whether or not an annotation has been added to the tomographic image at the specified tomographic position. If this determination is positive, the process proceeds to step S32. In step S32, the display control unit 42 performs control to highlight the mark AN representing the annotation added to the tomographic image at the specified tomographic position. In step S34, the display control unit 42 performs control to display the annotation on the tomographic image, as described above. If the determination in step S30 is negative, the processes from step S32 to step S34 are not executed, and the process proceeds to step S36.

[0063] In step S36, the display control unit 42 determines whether computer-attached information has been attached to the tomographic image at the specified tomographic position. If this determination is affirmative, the process proceeds to step S38. In step S38, the display control unit 42 performs control to highlight the mark CD representing the computer-attached information attached to the tomographic image at the specified tomographic position. In step S40, as described above, the display control unit 42 changes the color of the mark CD representing the computer-attached information attached to the tomographic image at the specified tomographic position to a color indicating that the information has already been displayed. Note that if the color of this mark CD is a color indicating that the information has already been displayed or a color indicating that the computer-attached information is incorrect, the display control unit 42 does not change the color of the mark CD. In step S42, the display control unit 42 performs control to display the computer-attached information on the tomographic image, as described above.

[0064] When the process of step S42 is completed, the process routine shown in Fig. 13 is completed. If the determination of step S36 is negative, the processes of steps S38 to S42 are not executed, and the process routine shown in Fig. 13 is completed. If the determination of step S24 is negative, the processes of steps S26 to S42 are not executed, and the process routine shown in Fig. 13 is completed.

[0065] If the instruction received in step S12 indicates whether the computer-assigned information specified by the "agree" button or the "disagree" button is correct or incorrect, the processing routine shown in FIG. 14 is executed in step S16.

[0066] 14, the reception unit 40 determines whether the received instruction is an input indicating that the computer-assigned information is correct, i.e., whether the "agree" button has been selected. If this determination is affirmative, the process proceeds to step S52. If the instruction received by the reception unit 40 is an input indicating that the computer-assigned information is incorrect, i.e., if the "disagree" button has been selected, the determination in step S50 is negative, and the process proceeds to step S54.

[0067] In step S52, the display control unit 42 performs control to add annotations to the tomographic images to which computer-attached information designated as correct has been attached, as described above. When the processing of step S52 ends, the processing routine shown in Fig. 14 ends. In step S54, the display control unit 42 performs control to change the color of the mark CD representing the computer-attached information from the current display color to a color close to the background color, as described above. When the processing of step S54 ends, the processing routine shown in Fig. 14 ends.

[0068] If the instruction received in step S12 is an instruction to switch between displaying and hiding the computer-added information by specifying the button BT, the processing routine shown in FIG. 15 is executed in step S16.

[0069] 15, the reception unit 40 determines whether the received instruction is an instruction to display the computer-attached information. If this determination is affirmative, the process proceeds to step S62. If the instruction received by the reception unit 40 is an instruction to hide the computer-attached information, the determination in step S60 is negative, and the process proceeds to step S64.

[0070] In step S62, the display control unit 42, as described above, performs control to hide the mark CD representing the computer-added information and to hide the computer-added information on the tomographic image. When the processing of step S62 ends, the processing routine shown in Fig. 15 ends. In step S64, the display control unit 42, as described above, performs control to display the mark CD representing the computer-added information and to display the computer-added information on the tomographic image. When the processing of step S64 ends, the processing routine shown in Fig. 15 ends.

[0071] As described above, according to this embodiment, unique attached information can be attached to each tomographic image, one tomographic image can be identified by one mark, and when attached information is attached to the tomographic image corresponding to the specified tomographic position, the mark representing the attached information is highlighted. Therefore, the user can easily understand whether unique attached information is attached to the tomographic image corresponding to the tomographic position specified on the slider bar SB.

[0072] In the above embodiment, as shown in Fig. 16, the display control unit 42 may perform control to display the slider bar SB with different colors from one end of the slider bar SB to the specified fault position and from the other end to the specified fault position, without displaying the slider SD. In this case, it is not necessary to display the slider SD, which is a dedicated object for specifying the fault position. However, in this case, the slider SD may also be displayed as in the above embodiment.

[0073] 17, for a tomographic image to which computer-generated information has been added, the display control unit 42 may control the display of a contour O2 of the region of interest in addition to the contour O1 of the region of interest represented by the computer-generated information added to the tomographic image. In this case, for example, the display control unit 42 controls the display of the contour O2 of the region of interest represented by the computer-generated information added to any of the other tomographic images in which the same region of interest has been detected. Specifically, the display control unit 42 controls the display of the largest contour of the contours of the region of interest represented by the computer-generated information added to any of the other tomographic images in which the same region of interest has been detected as the contour O2. Examples of the largest contour here include the contour with the largest area or the contour with the longest length.

[0074] In the above embodiment, the computer assigns computer-generated information to all tomographic images in which a region of interest is detected. However, this is not limiting. As shown in FIG. 18, the computer may extract a group of tomographic images that include the same object (e.g., a region of interest) from multiple tomographic images constituting a 3D medical image, select a representative tomographic image from the extracted group of tomographic images, and assign computer-generated information only to the selected tomographic image. In this case, for example, the computer may identify, as the same region of interest, regions of interest in which the absolute value of the difference in the center of gravity positions of the detected regions of interest in consecutive tomographic images is equal to or less than a predetermined first threshold and the absolute value of the difference in area is equal to or less than a predetermined second threshold. In this case, the first and second thresholds may be preset values ​​that are upper limits of the difference between the same regions of interest in consecutive tomographic images. In this case, for example, the computer may extract, as the representative tomographic image, the tomographic image in which the region of interest with the largest area or the longest contour length is detected from the extracted group of tomographic images. In this case, the computer may be the display control device 12, a control device provided in the imaging device 14, the image storage device 16, or a computer external to the diagnosis support system 10.

[0075] In this case, the process selected by the computer as the tomographic image to which the additional information is to be added may also be performed by the user via the input unit 24. In this case, the user-added information is information added by the user to a representative tomographic image among a group of tomographic images showing the same subject.

[0076] In the above embodiment, a slider bar SB and a slider SD are used as designation objects for specifying cross-sectional positions corresponding to each of a plurality of cross-sectional images. However, this is not limiting. For example, as shown in FIG. 19, a schema SM and a slider SD may be used as designation objects for specifying cross-sectional positions corresponding to each of a plurality of cross-sectional images. The schema SM here refers to a schematic diagram of a part of a human body. FIG. 19 illustrates an example in which a plurality of medical cross-sectional images obtained by tomosynthesis imaging using a mammography device are used as the multiple cross-sectional images. The upper row of FIG. 19 illustrates cross-sectional images obtained by performing MLO (Medio-Lateral Oblique) imaging on the right breast, and the lower row illustrates cross-sectional images obtained by performing CC (Cranio-Caudal) imaging on the right breast. In FIG. 19, the depth direction of the cross-sectional images, i.e., the movement direction of the slider SD, is indicated by a dashed double arrow. In this embodiment, too, for example, the user specifies a cross-sectional position by dragging the slider SD to the cross-sectional position of the cross-sectional image to be displayed on the schema SM. In this case, if additional information is added to the cross-sectional image corresponding to the specified cross-sectional position, a mark representing the additional information is highlighted. In this embodiment, the marks AN and CD may be displayed in the schema SM so that the two-dimensional arrangement of the breast when viewed from the front can be seen.

[0077] 4 and 5 and the schema SM and slider SD shown in Fig. 19 may both be displayed in the display area A1. In this embodiment, an operation performed on one of them may be reflected in the other in conjunction with the operation performed on the other.

[0078] Furthermore, in the above embodiment, the following various processors can be used as the hardware structure of a processing unit that executes various processes, such as the reception unit 40 and the display control unit 42. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as dedicated electrical circuits that are processors having a circuit configuration specifically designed to execute specific processes, such as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).

[0079] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0080] Examples of configuring multiple processing units with a single processor include, first, a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units, as typified by computers such as client and server. Second, a form in which a processor is used to realize the functions of the entire system including multiple processing units with a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs). In this way, various processing units are configured using one or more of the above-mentioned various processors as a hardware structure.

[0081] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0082] In the above embodiment, the display control program 30 is pre-stored (installed) in the storage unit 22, but the present invention is not limited to this. The display control program 30 may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. The display control program 30 may also be downloaded from an external device via a network.

[0083] The disclosure of Japanese Patent Application No. 2020-040359, filed on March 9, 2020, is incorporated herein by reference in its entirety. In addition, all documents, patent applications, and technical standards described herein are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard was specifically and individually indicated to be incorporated by reference.

Claims

1. at least one processor; The processor: performing control to display a designation object for designating a cross-sectional position corresponding to each of a plurality of medical cross-sectional images obtained by imaging the subject, and the cross-sectional image corresponding to the designated cross-sectional position; For a tomographic image to which attached information including at least one of user-attached information attached by a user and computer-attached information attached by a computer is attached, a mark representing the attached information is displayed at a depth position of the designated object corresponding to the tomographic position of the attached tomographic image; When the user-assigned information and the computer-assigned information are assigned to a tomographic image at the same tomographic position, the mark representing the user-assigned information and the mark representing the computer-assigned information are displayed at positions where they do not overlap. Display control device.

2. When the additional information is added to the tomographic image corresponding to the specified tomographic position, the processor performs control to highlight a mark representing the additional information. The display control device according to claim 1 .

3. The specified object includes a slider bar. The display control device according to claim 1 or 2.

4. The specified object includes a schema. The display control device according to claim 1 or 2.

5. The processor controls the display of the slider bar by changing the color from one end of the slider bar to the designated fault position and the color from the other end of the slider bar to the designated fault position. The display control device according to claim 3 .

6. the attached information includes the computer-attached information, The processor controls to display a mark representing the computer-added information added to an undisplayed tomographic image and a mark representing the computer-added information added to a displayed tomographic image in a distinguishable manner. The display control device according to any one of claims 1 to 5.

7. the attached information includes the computer-attached information, the processor accepts an input indicating whether the computer-assigned information is correct; When an input indicating that the computer-assigned information is incorrect is received, the color of the mark indicating the computer-assigned information is changed from the current display color to a color closer to the background color. The display control device according to any one of claims 1 to 6.

8. the attached information includes the computer-attached information, the processor accepts an input for switching between displaying and hiding the computer-assigned information; In response to the received input, the computer controls switching between displaying and hiding the mark representing the assigned information. The display control device according to any one of claims 1 to 7.

9. the processor controls the display of the computer-attached information on the tomographic image to which the computer-attached information has been attached; In response to the received input, control is performed to switch between displaying and not displaying both the mark representing the computer-added information and the computer-added information on the tomographic image. The display control device according to claim 8 .

10. the annotation information includes a contour of a region of interest in the tomographic image as the computer annotation information; When a contour of the region of interest is added to a tomographic image corresponding to a specified tomographic position, the processor controls to display the contour of the region of interest on the tomographic image; Furthermore, control is performed to display the outline of the region of interest that is assigned to any of the other tomographic images in which the same region of interest as the region of interest to be displayed is detected. The display control device according to any one of claims 1 to 9.

11. The processor controls to display the largest contour of the contours of the region of interest added to the other tomographic images. The display control device according to claim 10.

12. The computer-assigned information is The computer extracting a group of tomographic images showing the same object from the plurality of tomographic images; Select a representative tomographic image from the extracted tomographic images, Contains information to be added to the selected tomographic image The display control device according to any one of claims 1 to 11.

13. The user-assigned information includes information assigned by a user to a representative tomographic image of a group of tomographic images showing the same object, among the plurality of tomographic images. The display control device according to any one of claims 1 to 12.

14. performing control to display a designation object for designating a cross-sectional position corresponding to each of a plurality of medical cross-sectional images obtained by imaging the subject, and the cross-sectional image corresponding to the designated cross-sectional position; For a tomographic image to which attached information including at least one of user-attached information attached by a user and computer-attached information attached by a computer is attached, a mark representing the attached information is displayed at a depth position of the designated object corresponding to the tomographic position of the attached tomographic image; When the user-assigned information and the computer-assigned information are assigned to a tomographic image at the same tomographic position, the mark representing the user-assigned information and the mark representing the computer-assigned information are displayed at positions where they do not overlap. A display control method in which processing is executed by a processor provided in a display control device.

15. performing control to display a designation object for designating a cross-sectional position corresponding to each of a plurality of medical cross-sectional images obtained by imaging the subject, and the cross-sectional image corresponding to the designated cross-sectional position; For a tomographic image to which attached information including at least one of user-attached information attached by a user and computer-attached information attached by a computer is attached, a mark representing the attached information is displayed at a depth position of the designated object corresponding to the tomographic position of the attached tomographic image; When the user-assigned information and the computer-assigned information are assigned to a tomographic image at the same tomographic position, the mark representing the user-assigned information and the mark representing the computer-assigned information are displayed at positions where they do not overlap. A display control program for causing a processor included in the display control device to execute the process.

Images