Medical image display device

Abstract

To support more properly formulation of an operation plan.SOLUTION: A medical image display device in an embodiment includes an acquisition part, a first specific part, a second specific part and a display control part. The acquisition part acquires volume data, or an image data set of image data at plural times. The first specific part specifies an attention image showing an observation cross section from the image data set. The second specific part specifies an attention area based on the image data set. The display control part displays an attention image, and information on the attention area.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to a medical image display device. [Background technology]

[0002] In recent years, a method has been proposed to support surgical planning for heart valves, in which the distribution of calcification in the heart valve is calculated from images of the subject, and the degree of difficulty of replacing the artificial valve is calculated. With this method, users such as doctors check the position and amount of calcification on the observed cross-section of the heart valve to estimate the degree to which the artificial valve will open. However, because the valve has a three-dimensional shape, it is difficult to check the overall calcification only on the observed cross-section, and the estimation may be inaccurate.

[0003] It should be noted that this situation is not limited to surgical plans relating to heart valves, but may occur in surgical plans relating to other anatomical structures as well. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-226693 A [Patent Document 2] JP 2014-151208 A [Patent Document 3] Special Publication No. 2013-544559 [Patent Document 4] JP 2000-287962 A [Patent Document 5] JP 2017-189384 A Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to more appropriately support the formulation of a surgical plan. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0006] A medical image display device according to an embodiment includes an acquisition unit, a first identification unit, a second identification unit, and a display control unit. The acquisition unit acquires an image dataset of volume data or image data at multiple time points. The first identification unit identifies an image of interest showing an observation cross section from the image dataset. The second identification unit identifies a region of interest based on the image dataset. The display control unit displays the image of interest and information related to the region of interest. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a medical image display device according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of an image data set of volume data acquired by the acquisition function according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of an image data set of volume data acquired by the acquisition function according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of the specification of an image of interest and an observation area performed by the first specification function according to the first embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of display of information related to the attention area performed by the display control function according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of display of information related to the attention area performed by the display control function according to the first embodiment. [Figure 7]FIG. 7 is a diagram showing a specific example of display of information related to the attention area performed by the display control function according to the first embodiment. [Figure 8] FIG. 8 is a flowchart showing the procedure of processing performed by the processing circuitry of the medical image display device according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing an example of display of information related to the attention area performed by the display control function according to the first modification of the first embodiment. [Figure 10] FIG. 10 is a diagram showing another example of display of information related to the attention area performed by the display control function according to the first modification of the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a setting screen displayed by a display control function according to the first modification of the first embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of display of information related to a closed region performed by the display control function according to the second embodiment. [Figure 13] FIG. 13 is a diagram showing another example of display of information related to a closed region performed by the display control function according to the second embodiment. [Figure 14] FIG. 14 is a diagram showing an example of display of information showing the aortic valve annulus performed by the display control function according to the first modification of the second embodiment. [Figure 15] FIG. 15 is a diagram showing an example of an image data set of image data at a plurality of time points acquired by the acquisition function according to the third embodiment. [Figure 16] FIG. 16 is a diagram showing an example of specification of an image of interest and an observation area performed by the first specification function according to the third embodiment. [Figure 17] FIG. 17 is a diagram showing an example of display of information related to the attention area performed by the display control function according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of a medical image display device will be described in detail with reference to the drawings.

[0009] (First embodiment) FIG. 1 is a diagram showing an example of the configuration of a medical image display device according to the first embodiment.

[0010] For example, as shown in FIG. 1, a medical image display device 100 according to this embodiment is communicably connected to an X-ray CT (Computed Tomography) device 1 and a medical image storage device 2 via a network 3.

[0011] In addition, the medical image display device 100 may be further connected to other medical image diagnostic devices such as a Magnetic Resonance Imaging (MRI) device, an ultrasound diagnostic device, a PET (Positron Emission Tomography) device, and a SPECT (Single Photon Emission Computed Tomography) device, in addition to the X-ray CT device 1.

[0012] The X-ray CT device 1 generates a CT image of a subject. Specifically, the X-ray CT device 1 collects projection data representing the distribution of X-rays that have passed through the subject by rotating an X-ray tube and an X-ray detector on a circular orbit that surrounds the subject. The X-ray CT device 1 then generates a CT image based on the collected projection data.

[0013] The medical image storage device 2 stores various medical images related to subjects. Specifically, the medical image storage device 2 acquires CT images from the X-ray CT device 1 via the network 3, and stores the CT images in a memory circuit within the device. For example, the medical image storage device 2 is realized by a computer device such as a server or a workstation. Also, for example, the medical image storage device 2 is realized by a PACS (Picture Archiving and Communication System) or the like, and stores the CT images in a format conforming to DICOM (Digital Imaging and Communications in Medicine).

[0014] The medical image display device 100 displays various images related to a subject. Specifically, the medical image display device 100 acquires a CT image from an X-ray CT device 1 or a medical image storage device 2 via a network 3, and displays the CT image and various information obtained from the CT image. For example, the medical image display device 100 is realized by a computer device such as a server or a workstation.

[0015] For example, the medical image display device 100 includes a network (NetWork: NW) interface 110, a storage circuitry 120, an input interface 130, a display 140, and a processing circuitry 150.

[0016] The NW interface 110 controls the transmission and communication of various data transmitted and received between the medical image display device 100 and other devices connected via the network 3. Specifically, the NW interface 110 is connected to the processing circuit 150, and transmits data received from other devices to the processing circuit 150, or transmits data received from the processing circuit 150 to other devices. For example, the NW interface 110 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

[0017] The memory circuitry 120 stores various data and various programs. Specifically, the memory circuitry 120 is connected to the processing circuitry 150, and stores data received from the processing circuitry 150, or reads out stored data and transmits it to the processing circuitry 150. For example, the memory circuitry 120 is realized by a semiconductor memory element such as a random access memory (RAM) or a flash memory, a hard disk, an optical disk, or the like.

[0018] The input interface 130 accepts input operations of various instructions and various information from a user. Specifically, the input interface 130 is connected to the processing circuit 150, converts the input operation received from the user into an electrical signal, and transmits the electrical signal to the processing circuit 150. For example, the input interface 130 is realized by a trackball, a switch button, a mouse, a keyboard, a touch pad that performs an input operation by touching the operation surface, a touch screen in which a display screen and a touch pad are integrated, a non-contact input interface using an optical sensor, a voice input interface, and the like. Note that in this specification, the input interface 130 is not limited to only those that have physical operation parts such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and transmits the electrical signal to a control circuit is also included as an example of the input interface 130.

[0019] The display 140 displays various information and various data. Specifically, the display 140 is connected to the processing circuit 150, and displays various information and various data received from the processing circuit 150. For example, the display 140 is realized by a liquid crystal monitor, a CRT (Cathode Ray Tube) monitor, a touch panel, or the like.

[0020] The processing circuitry 150 controls the entire medical image display device 100. For example, the processing circuitry 150 performs various processes in response to an input operation received from a user via the input interface 130. Also, for example, the processing circuitry 150 receives data transmitted by another device from the NW interface 110 and stores the received data in the storage circuitry 120. Also, for example, the processing circuitry 150 transmits the data received from the storage circuitry 120 to the NW interface 110, thereby transmitting the data to another device. Also, for example, the processing circuitry 150 causes the display 140 to display the data received from the storage circuitry 120.

[0021] The above describes an example of the configuration of the medical image display device 100 according to this embodiment. With such a configuration, the medical image display device 100 according to this embodiment is installed in a medical facility such as a hospital or a clinic, and supports the formulation of a surgical plan by a user such as a doctor.

[0022] For example, the medical image display device 100 according to this embodiment is used when formulating a surgical plan for a heart valve.

[0023] For example, one method of treating patients with valvular disease is to transport an artificial valve through blood vessels to the location of the valve to be treated and replace it (hereinafter referred to as catheter surgery). In this catheter surgery, the artificial valve is transported in a finely folded state and then unfolded at the location of the valve to be treated, thereby replacing the valve. For this reason, in catheter surgery, it is important to obtain information on the shape of the valve before surgery and estimate the amount of opening of the artificial valve.

[0024] Here, for example, a technique for automatically extracting a valve region from an image and automatically calculating predetermined measurement items is known as a technique for assisting in the acquisition of morphological information. With this technique, a user such as a doctor estimates the amount of opening of the artificial valve based on the calculated measurement results, but accurate estimation is difficult when the valve is calcified. This is because calcification makes the valve stiff and prevents it from opening to its full diameter.

[0025] In response to this, for example, a method has been proposed to support surgical planning for heart valves, in which the distribution of calcification in a heart valve is calculated from an image of the subject, and the degree of difficulty of replacing the artificial valve is calculated. In this method, a user such as a doctor checks the position and amount of calcification on an observed cross-section of the heart valve to estimate the degree to which the artificial valve will open. However, because the valve has a three-dimensional shape, it is difficult to check the overall calcification only on the observed cross-section, and the estimation may be inaccurate.

[0026] It should be noted that this situation is not limited to surgical plans relating to heart valves, but may occur in surgical plans relating to other anatomical structures as well.

[0027] For this reason, the medical image display device 100 according to this embodiment is configured to more appropriately support the formulation of a surgical plan.

[0028] Specifically, the medical image display device 100 has an acquisition function 151, a first identification function 152, a second identification function 153, and a display control function 154 as processing functions possessed by the processing circuitry 150. Here, the acquisition function 151 is an example of an acquisition section. Also, the first identification function 152 is an example of a first identification section. Also, the second identification function 153 is an example of a second identification section. Also, the display control function 154 is an example of a display control section.

[0029] The acquisition function 151 acquires an image data set of volume data of a subject from the X-ray CT device 1 or the medical image storage device 2 via the NW interface 110. Here, the volume data is a CT image captured by the X-ray CT device 1.

[0030] The image data of the volume data acquired by the acquisition function 151 is not limited to CT images, and any type of image data may be used as long as it is an image type that stores three-dimensional information of a target anatomical structure. For example, images captured by other medical image diagnostic devices, such as ultrasound images captured by an ultrasound diagnostic device or MR images captured by an MRI device, may be used.

[0031] 2 and 3 are diagrams showing an example of an image data set of volume data acquired by the acquisition function 151 according to the first embodiment.

[0032] For example, as shown in FIGS. 2 and 3, in this embodiment, for the sake of simplicity, it is assumed that the acquisition function 151 acquires an image data set of volume data including eight slice images S1 to S8 arranged in order in the cranio-caudal direction, and each slice image includes 10 pixels in the X direction and 10 pixels in the Y direction.

[0033] Returning to FIG. 1, the first specifying function 152 specifies an image of interest showing an observation cross section from the image data set of the volume data acquired by the acquiring function 151 .

[0034] Here, the image of interest is image data showing the observation cross section observed by the user, for example, image data displayed on the display screen of the display 140. In addition, when a plurality of image data are displayed on the display screen of the display 140, the first specifying function 152 may specify all of them as the image of interest, or may specify only a part of the image data as the image of interest. For example, when specifying only a part of the image data as the image of interest, the first specifying function 152 may specify image data designated by an operating device such as a mouse (for example, image data displayed in a display area on the display screen at the position where the mouse cursor is present) as the image of interest, or may specify image data displayed in a display area on the display screen at a gaze position detected by a known gaze detection device as the image of interest. Note that the method by which the first specifying function 152 specifies the image of interest is not limited to the method described here, and any method may be used as long as it can specify the image of interest from image data.

[0035] For example, when a surgical plan is to be created regarding a heart valve, the first identification function 152 identifies an image of interest that shows a cross section including the heart valve from the image data set of the volume data.

[0036] In addition, the first identification function 152 further identifies an observation area from the image of interest.

[0037] For example, when a surgical plan is to be developed regarding a heart valve, the first identification function 152 further identifies an area including a heart valve from the image of interest.

[0038] Here, the observation area is an area in the image of interest that is observed by the user. It may be the image of interest itself, or a part of the image of interest. In the case of a part of the area, it may be an area specified by the user using the input interface 130, or it may be an area specified based on a specific algorithm. For example, it may be an area displayed in a display area on a display screen in the image of interest, or the observation area may be specified by a known image processing technique.

[0039] FIG. 4 is a diagram showing an example of the specification of an image of interest and an observation area performed by the first specification function 152 according to the first embodiment.

[0040] For example, as shown in Fig. 4, in this embodiment, it is assumed that the first specifying function 152 specifies the slice image S3 as an image of interest from the image data set of the volume data shown in Figs. 2 and 3. It is also assumed that the first specifying function 152 specifies an area in the slice image S3 specified as the image of interest, the X coordinate of which is in the range of 3 to 7 and the Y coordinate of which is in the range of 4 to 8, as an observation area (area R1 indicated by a thick frame in Fig. 4).

[0041] In this embodiment, an example in which the image of interest is on the same cross section as the slice image will be described, but the example of the image of interest is not limited to this. For example, the image of interest may be image data of a cross section obtained by reconstructing a CT image in an arbitrary direction using a known technique (multi-planar reconstruction: MPR (Multi Planar Reconstruction)).

[0042] Returning to FIG. 1, the second identification function 153 identifies a region of interest based on the image data set of the volume data acquired by the acquisition function 151 .

[0043] Here, the region of interest is position information on an image that occupies a structure or the like that a user wants to confirm on an observation cross section. Note that the region of interest may be a two-dimensional region or a three-dimensional region.

[0044] In this embodiment, the second specifying function 153 specifies the region of interest based on data corresponding to the observation region specified by the first specifying function 152 in the image data set of the volume data. Here, the second specifying function 153 may specify the region of interest from the data itself corresponding to the observation region, or may specify the region of interest from data corresponding to a region different from the observation region specified based on the observation region (a region wider or narrower than the observation region). However, the embodiment is not limited to this, and the second specifying function 153 may specify the region of interest from the entire volume data.

[0045] For example, when a surgical plan is to be developed for a heart valve, the second identification function 153 identifies a calcified region of the heart valve based on data corresponding to a region including the heart valve in the image data set of the volume data.

[0046] For example, the second specifying function 153 may specify the region of interest by receiving a manual specification of the region of interest from a user using a user interface. The second specifying function 153 may also extract a region based on an anatomical structure depicted in an image using a known region extraction technique, and specify the region as the region of interest. Examples of the known region extraction technique include binarization processing based on CT values, graph cut processing, and the like.

[0047] The method by which the second specifying function 153 specifies the region of interest is not limited to the above-mentioned method, and any method may be used as long as it can specify the region of interest from an image. For example, the second specifying function 153 may estimate and specify the region of interest from a shape model of the region of interest that has been learned in advance from learning data using a machine learning technique. In addition, for example, when using a region extraction technique such as the binarization process described above, if processing is performed on the entire image, there is a high possibility that regions other than the target structure will also be specified, making the subsequent processing complicated. Therefore, the second specifying function 153 may specify a region related to the region of interest (for example, in the case where the region of interest is calcification in the aortic valve, the heart region or the region around the aortic valve, etc.) as a related region, and perform processing only on the related region to specify the region of interest. In this case, for example, the second specifying function 153 may specify the related region by manually accepting a designation of the region to be the related region from the user using a user interface.

[0048] For example, in this embodiment, it is assumed that the second identifying function 153 identifies, as the region of interest, the region corresponding to the position of the pixel highlighted in black in Fig. 4. That is, it is assumed that the second identifying function 153 identifies, as the region of interest, nine regions, (7,7,S1), (3,9,S2), (7,4,S3), (2,2,S5), (7,4,S5), (5,5,S6), (4,4,S7), (5,5,S7), and (4,8,S8) shown in Fig. 4, when the region in the XYZ coordinate system is represented as (X, Y, Z).

[0049] The display control function 154 causes the display 140 to display the image of interest specified by the first specifying function 152 and information relating to the region of interest specified by the second specifying function 153.

[0050] For example, when a surgical plan is to be developed regarding a heart valve, the display control function 154 displays information regarding a calcified region of the heart valve as information regarding the region of interest.

[0051] Moreover, in this embodiment, the display control function 154 displays information about the region of interest at a position in the image of interest that corresponds to the region of interest.

[0052] Specifically, the display control function 154 displays information about each area of ​​interest at a corresponding position in the observation area on the image of interest based on a preset condition.

[0053] Moreover, in this embodiment, the display control function 154 displays information related to the region of interest superimposed on the image of interest.

[0054] Specifically, the display control function 154 projects and displays, on the image of interest screen, information related to the region of interest that is based on a cross section or time point different from that of the image of interest.

[0055] For example, the display control function 154 projects and displays information about the region of interest that is based on a cross section or time point different from that of the image of interest in a direction perpendicular to the surface of the image of interest.

[0056] 5 and 6 are diagrams showing an example of display of information related to the attention area performed by the display control function 154 according to the first embodiment.

[0057] For example, assume that a condition is set such that "positions corresponding to the observation region of the region of interest existing in a direction perpendicular to the cross section of the observation region are displayed in red." In this case, for example, as shown in FIG. 5, the display control function 154 displays in red a pixel at (7,7,S3) which is a corresponding position in the observation region of the region of interest of (7,7,S1) in the slice image S3 specified as the image of interest. Note that in FIG. 5, pixels displayed in red are marked with a diagonal line pattern slanting downward to the right. Similarly, the display control function 154 displays in red a pixel at (5,5,S3) which is a corresponding position in the observation region of the region of interest of (5,5,S6) and (5,5,S7) in the slice image S3. Similarly, the display control function 154 displays in red the pixel (4,5,S3) which is a corresponding position in the observation region of the attention region (4,5,S7) in the slice image S3, and the pixel (4,8,S3) which is a corresponding position in the attention region of the attention region (4,8,S8). Similarly, the display control function 154 displays in red the pixel (7,4,S3) which is a corresponding position in the observation region of the attention region (7,4,S5) in the slice image S3. Here, in the slice image S3, pixels other than the pixel which displays information about the attention region are displayed with the original pixel value as it is (that is, the display of the pixel does not change). Note that in the example shown in FIG. 5, the pixel (7,4,S3) which is a corresponding position in the observation region of the attention region (7,4,S5) in the slice image S3 has already been identified as the attention region. In such a case, the display control function 154 may not change the display form of the region.

[0058] As another example, suppose that a condition is set such that "positions corresponding to the observation region of the attention region present in the head direction in the direction perpendicular to the cross section of the observation region are displayed in blue." In this case, for example, as shown in FIG. 6, a pixel at (7,7,S3) which is a corresponding position in the observation region of the attention region of (7,7,S1) is displayed in blue. In FIG. 6, pixels displayed in blue are marked with a diagonal line slanting downward to the left. Furthermore, the display control function 154 does not change the display of pixels at corresponding positions in the observation region for other attention regions since they do not meet the condition.

[0059] FIG. 7 is a diagram showing a specific example of display of information related to the attention area performed by the display control function 154 according to the first embodiment.

[0060] For example, as shown in Fig. 7, when a surgical plan for a heart valve is formulated, the display control function 154 displays information on a calcified region of the heart valve at a corresponding position in the region including the heart valve on the image of interest. For example, the display control function 154 displays pixels in red or blue at positions corresponding to the calcified region in the region including the heart valve on the image of interest by the above-mentioned method. In Fig. 7, pixels displayed in red are marked with a diagonal line slanting downward to the right, and pixels displayed in blue are marked with a diagonal line slanting downward to the left.

[0061] The conditions used by the display control function 154 are not limited to the above conditions, and any conditions may be used as long as they allow determination for displaying information corresponding to each attention region in the observation region. For example, the conditions may be a condition for changing the display form of "a position corresponding to the observation region of the attention region existing in a 45 degree angle direction with respect to the observation cross section", or a condition for changing the display form of "a position corresponding to the observation region of the attention region existing within 3 pixels in a direction perpendicular to the cross section of the observation region (Z direction)".

[0062] In the above example, the display control function 154 uses red and blue colors to display information about the region of interest, but the pixel values ​​in the region of interest may be used as is, or the transparency may be set so that the original pixel value information can be observed. The display control function 154 may express information about the region of interest using textures, patterns, etc., instead of colors.

[0063] The above describes each processing function of the processing circuitry 150 of the medical image display device 100. Here, for example, the processing circuitry 145 is realized by a processor. In this case, for example, each of the above-mentioned processing functions is stored in the storage circuitry 120 in the form of a program executable by a computer. Then, the processing circuitry 150 realizes a function corresponding to each program by reading and executing each program stored in the storage circuitry 120. In other words, the processing circuitry 145 has each processing function shown in FIG. 1 in a state where each program is read.

[0064] FIG. 8 is a flowchart showing the processing procedure of the processing performed by the processing circuitry 150 of the medical image display device 100 according to the first embodiment.

[0065] 8, when the processing circuitry 150 receives a start instruction from a user via the input interface 130 (step S11, Yes), the processing circuitry 150 acquires an image data set of volume data of the subject from the X-ray CT apparatus 1 or the medical image storage apparatus 2 via the NW interface 110 (step S12). This step corresponds to the acquisition function 151. For example, the processing circuitry 150 executes this step by reading a program corresponding to the acquisition function 151 from the storage circuitry 120 and executing it.

[0066] Next, the processing circuitry 150 identifies an image of interest showing an observation cross section from the image data set of the volume data (step S13), and further identifies an observation area from the image of interest (step S14). This step corresponds to the first specifying function 152. For example, the processing circuitry 150 executes this step by reading out a program corresponding to the first specifying function 152 from the storage circuitry 120 and executing it.

[0067] Next, the processing circuitry 150 identifies a region of interest based on the image data set of the volume data (step S15). This step corresponds to the second identifying function 153. For example, the processing circuitry 150 executes this step by reading out a program corresponding to the second identifying function 153 from the storage circuitry 120 and executing it.

[0068] Next, the processing circuitry 150 causes the display 140 to display the image of interest and information related to the region of interest (step S16). This step corresponds to the display control function 154. For example, the processing circuitry 150 executes this step by reading out a program corresponding to the display control function 154 from the storage circuitry 120 and executing it.

[0069] The processing circuit 150 is not limited to being realized by a single processor, but may be configured by combining multiple independent processors, and each processor may execute a program to realize each processing function. Each processing function of the processing circuit 150 may be realized by being appropriately distributed or integrated into a single or multiple processing circuits. Each processing function of the processing circuit 150 may be realized by a mixture of hardware such as a circuit and software. Here, an example in which a program corresponding to each processing function is stored in a single storage circuit 120 has been described, but the embodiment is not limited to this. For example, a configuration in which a program corresponding to each processing function is distributed and stored in multiple storage circuits, and the processing circuit 150 reads out and executes each program from each storage circuit. Software for realizing each processing function may run on a server via a network such as a cloud.

[0070] As described above, in the first embodiment, the acquisition function 151 acquires an image data set of volume data from the X-ray CT apparatus 1 or the medical image storage apparatus 2. The first identification function 152 identifies an image of interest showing an observation cross section from the image data set of the volume data. The second identification function 153 identifies a region of interest based on the image data set of the volume data. The display control function 154 then causes the display 140 to display the image of interest and information related to the region of interest.

[0071] According to this configuration, a region of interest is specified based on an image data set having information on a direction perpendicular to the observation section, such as volume data, and information on the region of interest that exists outside the observation section is displayed, thereby making it possible to present information on the region of interest that exists outside the observation section to a user. This allows a user, such as a doctor, to more accurately recognize information on the region of interest when formulating a surgical plan.

[0072] For example, when a surgical plan for a heart valve is to be formulated, the medical image display device 100 identifies a calcified region of the heart valve based on the image data set of the volume data, and displays information about the calcified region on the display 140 together with an image of interest. This makes it possible to clearly display information about the position and amount of calcification that exists outside the observation cross section on the observation cross section. As a result, users such as doctors can more accurately recognize information about calcification in a target area on the observation cross section, and can perform measurements and estimations more accurately.

[0073] Therefore, according to the first embodiment, it is possible to more appropriately support the formulation of a surgical plan.

[0074] (Modification 1 of the first embodiment) In the first embodiment described above, the display control function 154 displays information about each attention area in the same display form (red, blue, etc.) based on preset conditions, but the method of displaying information about the attention area is not limited to this.

[0075] For example, the display control function 154 may control the display form of the information on each attention area based on a condition (hereinafter, a second condition) that is set in advance separately from the above-mentioned conditions.

[0076] For example, the display control function 154 controls the display format of information regarding the attention area based on the spatial or temporal distance between the attention area and the information regarding the attention area projected onto the attention image, or based on the positional relationship between the attention area and the information regarding the attention area projected onto the attention image.

[0077] Alternatively, for example, the display control function 154 controls the display form of the information relating to the region of interest projected onto the image of interest based on the pixel values ​​of the information relating to the region of interest.

[0078] As one example, the display control function 154 may change the display form of information related to the region of interest depending on the distance from the observation cross section.

[0079] FIG. 9 is a diagram showing an example of display of information related to the attention area performed by the display control function 154 according to the first modification of the first embodiment.

[0080] For example, assume that the second condition is set as follows: "When the distance of the attention region from the observation cross section is 1-2 slices, the color is red, when the distance is 3-4 slices, the color is blue, and when the distance is 5 slices or more, the color is green." In this case, for the attention regions (7,7,S1) and (7,4,S5) shown in FIG. 4, the distance from the observation region is 2 slices, so that, for example, as shown in FIG. 9, in the slice image S3 specified as the image of interest, the pixels (7,7,S3) and (7,4,S3) which are the corresponding positions in the observation region of the attention region are displayed in red. In FIG. 9, the pixels displayed in red are marked with a diagonal line slanting downward to the right. In addition, for the attention regions (5,5,S6), (5,5,S7), and (4,5,S7) shown in FIG. 4, the distance from the observation region is 3 or 4 slices, so in the slice image S3, the display control function 154 displays the pixels (5,5,S3) and (4,5,S3) which are corresponding positions in the observation region of the attention region in blue. In FIG. 9, the pixels displayed in blue are marked with a diagonal line pattern slanting downward to the left. In addition, for the attention region (4,8,S8) shown in FIG. 4, the distance from the observation region is 5 slices, so in the slice image S3, the display control function 154 displays the pixel (4,8,S3) which is the corresponding position in the observation region of the attention region in green. In FIG. 9, the pixels displayed in green are marked with a dot pattern.

[0081] As another example, the display control function 154 may change the display format of information related to the regions of interest according to the number of regions of interest corresponding to each position on the observation cross section.

[0082] FIG. 10 is a diagram showing another example of the display of information related to the attention area performed by the display control function 154 according to the first modification of the first embodiment.

[0083] For example, suppose that the second condition is set to "red when the number of attention regions corresponding to the position of the observation region is one pixel, and blue when the number of attention regions corresponding to the position of the observation region is two or more pixels." In this case, for the attention regions (7,7,S1), (4,5,S7), and (4,8,S8) shown in Fig. 4, the display control function 154 displays the pixels at the positions of the observation regions in red, for example, as shown in Fig. 10, since the number of attention regions corresponding to the corresponding positions in the respective observation regions in the slice image S3 specified as the image of interest is only one pixel, (7,7,S3), (4,5,S3), and (4,8,S3). In Fig. 10, the pixels displayed in red are marked with a diagonal line slanting downward to the right. Furthermore, for the attention areas (7,4,S3) and (7,4,S5) as well as (5,5,S6) and (5,5,S7) shown in Fig. 4, the number of attention areas corresponding to (7,4,S3) and (5,5,S3), which are corresponding positions in the respective observation areas, in the slice image S3 is two pixels, so the display control function 154 displays the pixels at the positions of the observation areas in blue, for example, as shown in Fig. 10. In Fig. 10, the pixels displayed in blue are marked with a diagonal line slanting downward to the left.

[0084] As another example, the display control function 154 may change the display form of information related to the region of interest according to the pixel value of the region of interest.

[0085] For example, assume that the second condition is set to "red if the magnitude of the pixel value in the attention area is equal to or greater than a threshold, and blue if it is less than the threshold." In this case, when multiple attention areas correspond to the position of the observation area, the display control function 154 sets the average, maximum, or total value of the pixel values ​​in the multiple attention areas as the pixel value under the above-mentioned condition.

[0086] The second condition is not limited to the above example, and may be any condition as long as it makes it possible to identify information corresponding to each of the attention areas based on a specific condition.

[0087] For example, in the above example, the display form is changed by allocating colors to discrete cases, but when conditions are set for continuous values ​​such as the distance from the observation section, the number of attention areas, and pixel values, the second condition may be set to continuously change the display form. For example, the second condition may be set to continuously allocate colors according to the distance using a 255-level grayscale, such that the closer the attention area is to the observation section, the stronger the white color is assigned, and the farther the area is from the observation section, the blacker the color is assigned. The second condition may also be set to continuously change the transparency.

[0088] Also, for example, the second condition may be set so that the display form is changed according to the positional relationship between the observation section and the region of interest. For example, the second condition may be set so that for a region of interest present in slice images (slice images S1 and S2 shown in FIG. 4) in the cranial direction relative to the observation section, pixels at corresponding positions on the observation section are displayed in reddish color, and for a region of interest present in slice images (slice images S4 to S8 shown in FIG. 4) in the caudal direction, pixels at corresponding positions on the observation section are displayed in blued color.

[0089] Also, for example, a condition combining some of the above-mentioned multiple conditions may be set as the second condition. For example, multiple conditions may be combined to set the second condition, such as "a region of interest that is 1 to 2 slices away from the observation cross section and has a pixel value of the region of interest equal to or greater than a threshold is colored green." Also, a condition of "not displaying" may be set as the second condition, such as "a region of interest that satisfies both conditions of being 2 slices away from the observation cross section and having a pixel value of the region of interest less than a threshold is not displayed on the observation cross section."

[0090] Furthermore, the above-mentioned various second conditions may be arbitrarily set by the user using a user interface.

[0091] For example, the display control function 154 receives conditions from the user regarding at least one of the distance from the observation cross section, the number of regions of interest corresponding to each position on the observation cross section, and the pixel values ​​of the regions of interest, and changes the display format of the information regarding the regions of interest based on the received conditions.

[0092] For example, the display control function 154 causes the display 140 to display a setting screen for inputting a setting value related to the second condition, and receives the condition from the user.

[0093] FIG. 11 is a diagram showing an example of a setting screen displayed by the display control function 154 according to the first modification of the first embodiment.

[0094] For example, as shown in FIG. 11, the display control function 154 causes the display 140 to display a setting screen including check boxes for selecting one or more of three conditions: distance from the observation cross section, pixel value of the region of interest (total if multiple regions of interest), and number of regions of interest, text boxes for inputting setting values ​​for each condition, and check boxes for selecting whether or not to display regions of interest that satisfy the selected condition.

[0095] The user interface for setting the second condition is not limited to the setting screen shown in Fig. 11, and may be any interface as long as the user can set the above-mentioned conditions. For example, the user interface for setting the second condition may be an interface that allows various logical expressions (AND, OR, NOT, etc.) to be input, thereby allowing complex conditions to be set. Also, for example, the interface may be an interface that allows the user to appropriately set the display form (color, texture, pattern, etc.) when displaying information related to the region of interest for each condition.

[0096] (Modification 2 of the first embodiment) In addition, in the first embodiment described above, after the first identification function 152 identifies the image of interest and the observation area, the second identification function 153 identifies the area of ​​interest, and the display control function 154 displays information related to the area of ​​interest, but the timing of displaying the information related to the area of ​​interest is not limited to this.

[0097] For example, after the acquisition function 151 acquires an image data set of volume data, the second identification function 153 identifies an area of ​​interest based on the image data set, and at a timing instructed by the user, the first identification function 152 identifies the image of interest and the observation area, and the display control function 154 displays information regarding the area of ​​interest.

[0098] In this case, the second specifying function 153 specifies the region of interest based on the entire image data set, rather than specifying the region of interest based on data in the image data set of the volume data that corresponds to the observation region specified by the first specifying function 152. Then, the display control function 154 displays only information relating to the region of interest specified by the second specifying function 153, whose corresponding position on the image of interest is included in the observation region specified by the first specifying function 152.

[0099] This allows the user to display information about the area of ​​interest at any time.

[0100] Furthermore, for example, the display control function 154 may slice through images or change the magnification ratio by having the user perform an operation called browsing on the image displayed on the display screen of the display 140. In this example, the observation area identified by the first identification function 152 changes in response to the operation. In this case, the display control function 154 may update an area related to the attention area every time the user performs the operation, or may switch the display of information related to the attention area in response to an instruction from the user.

[0101] Second Embodiment Next, a second embodiment will be described. In the following, the second embodiment will be described mainly with respect to differences from the first embodiment, and detailed descriptions of contents common to the first embodiment will be omitted.

[0102] In the first embodiment described above, the display control function 154 is configured to display information related to the area of ​​interest. In the second embodiment, however, information related to the area of ​​interest in a closed area that includes at least a portion of the area of ​​interest is displayed on the display 140.

[0103] For example, when a surgical plan is to be developed for a heart valve, the display control function 154 displays an image of interest and information about a calcified region in a closed region that includes at least a part of the calcified region.

[0104] For example, the display control function 154 automatically measures a predetermined measurement item using the region of interest identified by the second identification function 153, and displays the measurement value obtained by the measurement together with the image of interest. For example, the display control function 154 measures the number of pixels in the region of interest inside a cylinder when an arbitrary radius is set with the center of the observation region identified by the first identification function 152 as the center, and displays the measured number of pixels together with the image of interest. Here, the inside of the cylinder is an example of a closed region. Also, the number of pixels in the region of interest inside the cylinder is an example of information about a calcified region in a closed region.

[0105] FIG. 12 is a diagram showing an example of display of information related to a closed region performed by the display control function 154 according to the second embodiment.

[0106] For example, as shown in Fig. 12, the display control function 154 sets the pixel (5, 6, S3) which is the center of the observation area (area R1 shown by a thick frame in Fig. 4) as the center in the example shown in Fig. 4, sets the radius to 1.5 pixels, and sets the bottom surface of the cylinder to slice image S1 and slice image S8. Note that these settings may be arbitrarily set by the user using a user interface, or may be set in advance. Also, these settings may be automatically set according to the size of the observation area and the distribution of the areas of interest.

[0107] In FIG. 12, the circumference of a circle corresponding to the surface of the set cylinder is indicated by a broken line in each of the slice images S1 to S8. Here, the pixels that are partly or entirely included inside the circumference are (5,5,S6), (4,5,S7), and (5,5,S7). Therefore, the display control function 154 displays 3 as the number of pixels in the region of interest that exists inside the cylinder. In this case, for example, the display control function 154 may convert a pixel that is only partly included inside the circumference, such as (4,5,S7), into a value according to the proportion of the pixel included inside the circumference. For example, if the proportion of the pixel at (4,5,S7) that is included inside the circumference is 0.6, the display control function 154 displays 2.6 as the number of pixels in the region of interest that exists inside the cylinder.

[0108] The shape of the closed region set as the measurement range is not limited to a cylinder, and may be set to any shape. For example, the shape of the closed region may be set to a shape similar to the shape of the observation region, or may be set to a sphere or a rectangular parallelepiped. Alternatively, the observation region itself (i.e., the entire observation region) may be set as the closed region to be measured.

[0109] In addition, the value of the measurement item may be any value as long as it is information related to the region of interest, for example, it may be the total value of the pixel values ​​of the region of interest instead of the number of pixels, or a composite vector of vectors from the center to each region of interest may be calculated. When calculating the vector amount, the display control function 154 may visualize the magnitude and direction of the vector using a symbol such as an arrow on the image of interest.

[0110] Furthermore, the display control function 154 may receive conditions related to at least one of the number of attention regions and the pixel values ​​of the attention regions from the user, and set and display a closed region based on the received conditions.

[0111] In this case, for example, the display control function 154 may calculate the circumference of a circle centered on the center of the observation area when the number of pixels of the attention area existing inside the cylinder reaches the number of pixels accepted by the user.

[0112] FIG. 13 is a diagram showing another example of the display of information related to a closed region performed by the display control function 154 according to the second embodiment.

[0113] For example, as shown in FIG. 13, the display control function 154 sets a cylinder centered on the pixel (5, 6, S3) which is the center of the observation area (area R1 shown by a thick frame in FIG. 4) in the example shown in FIG. 4. Then, the display control function 154 calculates the number of pixels in the attention area existing inside the cylinder while gradually expanding the radius of the cylinder, and calculates the circumference when the calculated number of pixels is 3.5. Note that these settings may be arbitrarily set by the user using a user interface, or may be set in advance. For example, the number of pixels in the attention area is set to 3.5 by the user.

[0114] In FIG. 13, the circumference of the circle corresponding to the surface of the cylinder when the number of pixels of the region of interest existing inside the cylinder is 3.5 in each of the slice images S1 to S8 is indicated by a broken line. Here, for the pixels (5,5,S6) and (5,5,S7), the number of pixels is calculated as 1 because all of the pixels are included inside the cylinder. For the pixels (4,5,S7), 90% of the pixels are included inside the cylinder, so the number of pixels is calculated as 0.9. For the pixels (7,7,S1) and (4,8,S8), 30% of the pixels are included inside the cylinder, so the number of pixels is calculated as 0.3. In this case, the total number of pixels is 3.5, and the circumference in this case has a diameter of 4. Therefore, the display control function 154 calculates and displays 4π as a measured value.

[0115] In the above example, the display control function 154 calculates the circumference based on the number of pixels in the region of interest inside the cylinder, but the circumference may be calculated based on pixel values. Also, for example, the display control function 154 may calculate the circumference based on a value obtained by multiplying each pixel value by a value according to the distance from the center as a weight.

[0116] Furthermore, the value calculated as the measurement value may be any value, for example, the rectangular size of a cylinder, the area of ​​a circle, or the volume of a cylinder.

[0117] In this embodiment, the display control function 154 may or may not display information indicating the closed region set as the measurement range (broken line in the examples shown in FIGS. 12 and 13) on the target image. The display control function 154 may also switch between displaying and hiding the information indicating the closed region based on an instruction from the user.

[0118] In addition, in this embodiment, the display control function 154 may further display information regarding the closed region described above in addition to the information regarding the attention region described in the first embodiment, or may display information regarding the closed region instead of the information regarding the attention region.

[0119] As described above, in the second embodiment, the display control function 154 displays information about the region of interest in a closed region that includes at least a part of the region of interest.

[0120] According to this configuration, when a user such as a doctor formulates a surgical plan, the user can easily recognize a closed region that includes a region of interest that satisfies a specific index (for example, a quantity).

[0121] Therefore, the second embodiment can also more appropriately support the formulation of a surgical plan.

[0122] (Modification of the second embodiment) In the second embodiment described above, the display control function 154 is configured to display information related to the attention area. However, for example, important information other than the information related to the attention area may also be displayed.

[0123] For example, when the observation target is an aortic valve, the display control function 154 may extract the contour of the aorta from the image data set of the volume data, and further display information indicating the contour in the image of interest.

[0124] Alternatively, for example, the display control function 154 may extract an aortic valve annulus from the image data set of the volume data, and further display information indicating the aortic valve annulus together with the annulus diameter in the image of interest.

[0125] FIG. 14 is a diagram showing an example of a display of information showing the aortic valve annulus performed by the display control function 154 according to the first modification of the second embodiment.

[0126] For example, as shown in Fig. 14, the display control function 154 displays information indicating the contour of the aortic valve annulus on the slice image S3 specified as the image of interest, in addition to the information shown in Fig. 12. Note that in Fig. 14, the information indicating the contour of the aortic valve annulus displayed by the display control function 154 is indicated by a dashed line. Fig. 14 also shows an example in which the information indicating the contour of the aortic valve annulus is projected and displayed on each slice image.

[0127] This enables more precise evaluation of the effect of the region of interest on the observation cross section.

[0128] (Modifications of the first and second embodiments) In the above-described first and second embodiments, a case has been described in which a surgical plan for a heart valve is formulated, but the anatomical structure targeted in each embodiment is not limited to a heart valve.

[0129] For example, when a surgical plan for a coronary artery is to be formulated, the second identification function 153 may identify the position of plaque in the coronary artery as a region of interest, and the display control function 154 may display information about the identified plaque on the observation cross section. In this case, the display control function 154 may change the display form of the information according to the concentration and size of the plaque.

[0130] Furthermore, for example, when a surgical plan is formulated for an anatomical structure including multiple blood vessels, it may be necessary to grasp the relationship between the observation section and the position of the blood vessel in the direction of the observation section. In this case, the second identification function 153 may identify the position of the main blood vessel as the region of interest, and the display control function 154 may display information related to the identified main blood vessel on the observation section.

[0131] Also, for example, when a treatment plan for radiation therapy is formulated, it may be necessary to grasp the positional relationship of other organs in the irradiation direction of radiation. In this case, the second identification function 153 may identify the position of an important organ (for example, the position of an eyeball in irradiation of the brain) existing in the irradiation direction as a region of interest, and the display control function 154 may display information about the identified important organ on a cross section corresponding to the irradiation field.

[0132] (Third embodiment) Next, a third embodiment will be described. In the following, the third embodiment will be described mainly with respect to differences from the first embodiment, and detailed descriptions of contents common to the first embodiment will be omitted.

[0133] In the first embodiment described above, the medical image display device 100 displays information regarding the area of ​​interest based on an image dataset of volume data at one time point, whereas in the second embodiment, it displays information regarding the area of ​​interest based on image datasets of image data at multiple time points.

[0134] Specifically, the acquisition function 151 acquires an image data set of image data of a subject at multiple time points from the X-ray CT device 1 or the medical image storage device 2 via the NW interface 110. Here, the image data at multiple time points is a CT image captured by the X-ray CT device 1.

[0135] For example, in a single examination of the heart or lungs, images are captured at multiple points in time along the time axis by an imaging method known as 4D imaging. For example, the acquisition function 151 acquires an image data set of images captured at multiple points in time in this manner. Alternatively, for example, in a single examination, one image is captured, but in a case where multiple examinations are performed through periodic follow-up, an image data set of images captured at multiple points in time in the multiple examinations may be acquired.

[0136] FIG. 15 is a diagram showing an example of an image data set of image data at multiple time points acquired by the acquisition function 151 according to the third embodiment.

[0137] 15, for example, in this embodiment, the acquisition function 151 acquires an image data set including volume data at four time points T1 to T4, and including eight slice images S1 to S8 in which each volume data is arranged in the cranial-caudal direction. Here, each slice image included in each volume data includes 10 pixels in the X direction and 10 pixels in the Y direction, similar to the first embodiment.

[0138] The first specifying function 152 specifies an image of interest showing an observation cross section from an image data set of image data at multiple time points acquired by the acquiring function 151. The first specifying function 152 further specifies an observation region from the image of interest. Note that the method by which the first specifying function 142 specifies the image of interest and the observation image is the same as the method described in the first embodiment.

[0139] FIG. 16 is a diagram showing an example of the specification of an image of interest and an observation area performed by the first specification function 152 according to the third embodiment.

[0140] For example, as shown in Fig. 16, in this embodiment, it is assumed that the first specifying function 152 specifies a slice image S3 at time T3 as an image of interest from the image data set of the volume data at time points T1 to T4 shown in Fig. 15. It is also assumed that the first specifying function 152 specifies an area in the slice image S3 specified as the image of interest, the area being in the range of X coordinates 3 to 7 and Y coordinates 4 to 8, as an observation area (area indicated by a thick frame in Fig. 16). Note that, for the sake of simplicity of explanation, only the slice image S3 at each time point is shown in Fig. 16.

[0141] The second specifying function 153 specifies the region of interest based on the image data set of image data at multiple time points acquired by the acquiring function 151. Here, the second specifying function 153 specifies the region of interest based on data corresponding to the observation region specified by the first specifying function 152 in the image data set of the volume data. Note that the method by which the second specifying function 153 specifies the region of interest is similar to the method described in the first embodiment.

[0142] Specifically, in this embodiment, the second specifying function 153 acquires a region of interest from each of volume data at a plurality of time points. For example, it is assumed that the region corresponding to the position of the pixel marked in black in FIG. 16 is specified as a region of interest. That is, it is assumed that the second specifying function 153 specifies (7,7,S3) in the slice image S3 at time T1 shown in FIG. 16, (3,9,S3) in the slice image S3 at time T2, (7,4,S3) in the slice image S3 at time T3, and (4,6,S3) and (5,6,S3) in the slice image S3 at time T4 as regions of interest. Note that in FIG. 16, for the sake of simplicity, the region of interest is shown only in the slice image S3, but in reality, the region of interest is specified from all slice images.

[0143] The display control function 154 causes the display 140 to display the image of interest identified by the first identification function 152 and information relating to the region of interest identified by the second identification function 153. In addition, the display control function 154 causes the information relating to the region of interest to be displayed at a position in the image of interest corresponding to the region of interest.

[0144] Specifically, the display control function 154 displays information about each of the attention areas in the images captured at different times at corresponding positions in the observation area on the attention image based on preset conditions.

[0145] FIG. 17 is a diagram showing an example of display of information related to the attention area performed by the display control function 154 according to the third embodiment.

[0146] For example, assume that a condition is set that "positions corresponding to each pixel of the observation region of the region of interest in an image captured at a time other than the time of capturing the image including the observation region are displayed in red." In this case, for example, as shown in FIG. 17, the display control function 154 displays in red the pixel (7,7,S3) at T3, which is the corresponding position of (7,7,S3) in the slice image S3 at time T1 with respect to the observation region of the region of interest. Similarly, the display control function 154 displays in red the pixels (4,6,S3) and (5,6,S3) in the slice image S3 at time T3, which correspond to (4,6,S3) and (5,6,S3) in the slice image S3 at time T4. In FIG. 17, the pixels displayed in red are marked with a diagonal line pattern slanting downward to the right, and the pixels displayed in blue are marked with a diagonal line pattern slanting downward to the left.

[0147] In addition, the conditions used by the display control function 154 are not limited to the above-mentioned conditions, and any conditions may be used as long as they can determine whether information corresponding to each attention area is displayed in the observation area.

[0148] As described above, in the third embodiment, the acquisition function 151 acquires an image data set of image data at multiple time points from the X-ray CT apparatus 1 or the medical image storage apparatus 2. The first identification function 152 identifies an image of interest showing an observation cross section from the image data set of image data at multiple time points. The second identification function 153 identifies a region of interest based on the image data set of image data at multiple time points. The display control function 154 then causes the display 140 to display the image of interest and information related to the region of interest.

[0149] According to this configuration, a region of interest is identified based on an image data set having information on the time axis direction, such as image data at multiple points in time, and information on the region of interest that exists outside the observation cross section can be presented to a user by displaying information on the region of interest, thereby enabling a user, such as a doctor, to more accurately recognize information on the region of interest when formulating a surgical plan.

[0150] Therefore, the third embodiment also makes it possible to more appropriately support the formulation of a surgical plan.

[0151] (Modification of the third embodiment) In the third embodiment described above, the display control function 154 displays information about areas of interest that satisfy a condition among all areas of interest in image data acquired by the acquisition function 151, but it may also display information about only areas of interest in image data at a clinically important time point, for example.

[0152] In this case, the first identification function 152 further identifies at least one important image data from the image data set of the image data at multiple time points acquired by the acquisition function 151.

[0153] Furthermore, the display control function 154 causes the display 140 to display only information relating to the area of ​​interest in at least one important piece of image data identified by the first identification function 152 .

[0154] For example, in the case of an examination targeting the heart, the first identification function 152 may identify image data at the time of end diastole or early systole, and the display control function 154 may display only information related to the region of interest identified from the image data. In this case, the first identification function 152 may identify the time of end diastole or early systole based on cardiac phase information during ECG-gated imaging stored as additional information in the DICOM header, or may calculate the volume of the left ventricle by a known image processing technique and identify the time based on the volume.

[0155] Also, for example, in the case where multiple examinations are performed as part of regular follow-up, the first identification function 152 may identify image data from the initial examination or the examination after treatment, and the display control function 154 may display only the area of ​​interest identified from the image data.

[0156] Also, for example, the first identification function 152 may identify important image data by receiving designation of image data for identifying an attention area from a user.

[0157] In this modification, the second identifying function 153 may identify the area information only from the image data identified by the first identifying function 152. This allows the area of ​​interest to be identified only from the image data at the required time point, thereby reducing the calculation cost.

[0158] (Modifications of the first and third embodiments) Moreover, the above-described first and third embodiments may be implemented in combination.

[0159] For example, the display control function 154 associates, for each volume data, a region of interest with a slice section at each other time point corresponding to a slice section at one time point specified as an image of interest, by the method described in the first embodiment. Furthermore, the display control function 154 displays information about the region of interest associated with the slice section at each other time point in association with the slice section at one time point specified as an image of interest, by the method described in the third embodiment.

[0160] Furthermore, the configuration of the medical image display device 100 described in the above-mentioned embodiment and modified example can also be applied to a console device of a medical image diagnostic device such as the X-ray CT device 1 and the medical image storage device 2. In that case, functions equivalent to the above-mentioned acquisition function 151, first specification function 152, second specification function 153, and display control function 154 are implemented in a processing circuit included in the console device of the medical image diagnostic device and a processing circuit included in the medical image storage device 2.

[0161] In the above-mentioned embodiment and modified example, the acquisition unit, the first identification unit, the second identification unit, and the display control unit in this specification are respectively realized by the acquisition function, the first identification function, the second identification function, and the display control function of the processing circuit, but the embodiment is not limited to this. For example, the acquisition unit, the first identification unit, the second identification unit, and the display control unit in this specification may be realized by only hardware, only software, or a combination of hardware and software, in addition to being realized by the acquisition function, the first identification function, the second identification function, and the display control function described in the embodiment.

[0162] The term "processor" used in the description of the above-mentioned embodiment means a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). Here, instead of storing a program in a memory circuit, the program may be directly built into the circuit of the processor. In this case, the processor realizes its function by reading and executing the program built into the circuit. Furthermore, each processor in the present embodiment is not limited to being configured as a single circuit for each processor, and may be configured as a single processor by combining multiple independent circuits to realize its function.

[0163] Here, the program executed by the processor is provided in advance in a ROM (Read Only Memory) or a storage circuit. The program may be provided by being recorded in a computer-readable non-transitory storage medium such as a CD (Compact Disk)-ROM, a FD (Flexible Disk), a CD-R (Recordable), or a DVD (Digital Versatile Disk) in a format that can be installed in these devices or in a format that can be executed. The program may also be provided or distributed by being stored on a computer connected to a network such as the Internet and downloaded via the network. For example, the program is composed of modules including each of the above-mentioned processing functions. As actual hardware, a CPU reads out the program from a storage medium such as a ROM and executes it, so that each module is loaded onto a main storage device and generated on the main storage device.

[0164] In addition, in the above-mentioned embodiment and modified examples, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution or integration of each device is not limited to that shown in the figure, and all or a part of it can be functionally or physically distributed or integrated in any unit according to various loads, usage conditions, etc. Furthermore, all or any part of each processing function performed by each device can be realized by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic.

[0165] Furthermore, among the processes described in the above-mentioned embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified.

[0166] The various data handled in this specification are typically digital data.

[0167] According to at least one of the embodiments described above, it is possible to more appropriately support the formulation of a surgical plan.

[0168] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0169] 100 Medical image display device 150 Processing circuit 151 Acquisition Function 152 1st specific function 153 Second specific function 154 Display control function

Claims

1. an acquisition unit for acquiring an image data set of the volume data; a first identification unit that identifies an image of interest that indicates an observation cross section from the image data set; A second identification unit that identifies a region of interest based on the image data set; a display control unit that projects and displays information about the region of interest that exists in a direction perpendicular to the observation cross section of the image of interest on the image of interest, and controls a display form of the information about the region of interest based on a spatial distance between the region of interest and the observation cross section of the image of interest; A medical image display device comprising:

2. The first identification unit further identifies an observation area from the image of interest, The second identification unit identifies the region of interest based on data corresponding to the observation region in the image data set. The medical image display device according to claim 1 .

3. the display control unit causes information regarding a calcified region of a heart valve to be displayed as information regarding the region of interest. The medical image display device according to claim 1 .

4. an acquisition unit for acquiring an image data set of the volume data; a first identification unit that identifies an image of interest showing a cross section including a heart valve from the image data set; a second identification unit that identifies a calcified region of the cardiac valve based on data corresponding to a region including the cardiac valve in the image data set; a display control unit that projects and displays information about the calcified region that is present in a direction perpendicular to a cross section of the image of interest that includes the cardiac valve, on the image of interest, and controls a display form of the information about the calcified region based on a spatial distance between the calcified region and the cross section of the image of interest that includes the cardiac valve; A medical image display device comprising:

5. The display control unit displays information about the attention area at a position corresponding to the attention area in the attention image.

4. The medical image display device according to claim 1.

6. the display control unit further changes a display form of information about the regions of interest in accordance with at least one of the number of the regions of interest corresponding to each position of the observation cross section and pixel values ​​of the regions of interest.

6. The medical image display device according to claim 1,

7. the display control unit receives from a user conditions related to at least one of a distance from the observation cross section, the number of the regions of interest corresponding to each position on the observation cross section, and pixel values ​​of the regions of interest, and changes a display form of information related to the regions of interest based on the received conditions. The medical image display device according to claim 6.

8. The display control unit further displays information about the attention region in a closed region including at least a part of the attention region.

8. The medical image display device according to claim 1, wherein the display device is a display device for displaying a medical image.

9. The information regarding the region of interest is information regarding the number of the regions of interest within the closed region or pixel values ​​of the regions of interest. The medical image display device according to claim 8.

10. The first identification unit further identifies at least one important image data from the image dataset; The display control unit displays only information related to the region of interest in the at least one important image data.

10. The medical image display device according to claim 1, wherein the display device is a display device for displaying a medical image.

11. The display control unit causes information about the region of interest to be superimposed on the image of interest. The medical image display device according to claim 1 .

12. The display control unit further controls a display form of the information about the region of interest based on a positional relationship between the information about the region of interest and the observation cross section of the image of interest. The medical image display device according to claim 1 .

13. The display control unit further controls a display form of the information relating to the attention area projected onto the attention image based on a pixel value of the information relating to the attention area. The medical image display device according to claim 1 .

14. the display control unit controls a display form of the information about the region of interest in accordance with the information about the region of interest and a spatial distance from the observation cross section of the image of interest. The medical image display device according to claim 1 .

15. The display control unit further controls a display form of the information about the region of interest according to a positional relationship between the information about the region of interest and the observation cross section of the image of interest. The medical image display device according to claim 1 .

16. the display control unit receives from a user conditions related to at least one of the number of the attention regions and pixel values ​​of the attention regions, and sets and displays the closed region based on the received conditions. The medical image display device according to claim 8.

17. The volume data is a CT image. The medical image display device according to any one of claims 1 to 16.

18. an acquisition unit for acquiring an image dataset of image data at multiple time points; a first identification unit that identifies an image of interest that indicates an observation cross section from the image data set; A second identification unit that identifies a region of interest based on the image data set; a display control unit that displays information about the region of interest that exists at a time point different from that of the image of interest on the image of interest, and controls a display form of the information about the region of interest based on a temporal distance between the region of interest and the observation cross section of the image of interest; A medical image display device comprising:

Images