Medical image processing device, method of controlling medical image processing device, and medical image processing program

Abstract

To provide a medical image processing device capable of handling three-dimensional medical images with good operability and contributing to execution of reliable surgical operations.SOLUTION: A medical image processing device comprises a display control unit for controlling display of a three-dimensional image 300 representing an anatomical structure of a subject. The display control unit is configured to perform: a1) processing for generating an image including a graphical user interface 140 for defining a display range of the three-dimensional image 300, the graphical user interface 140 including a first slider for defining a cutting reference plane on one side of the three-dimensional image along a prescribed reference axis in a three-dimensional space, and a second slider for defining a cutting reference plane on the other side of the three-dimensional image along the prescribed reference axis; and a2) processing for displaying the three-dimensional image (300) located between the cutting reference planes.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a medical image processing device, a control method for a medical image processing device, and a medical image processing program that display the anatomical structures of a subject as two-dimensional or three-dimensional medical images, and in particular to a medical image processing device, a control method for a medical image processing device, and a medical image processing program that can handle three-dimensional medical images with good operability and contribute to the performance of highly reliable surgery. [Background technology]

[0002] Conventionally, medical images are generated based on tomographic image data obtained by an imaging device such as a CT device, and diagnosis and treatment are performed using the medical images. Medical images are used, for example, to check the presence or absence of a lesion, for simulation before surgery, and for navigation during surgery. As medical images, not only two-dimensional images but also three-dimensional images (three-dimensional models) that three-dimensionally represent anatomical structures are increasingly being used. Note that the tomographic image data acquired by the imaging device is data of a plurality of slices, i.e., two-dimensional images, while the three-dimensional images are obtained by creating volume data from the two-dimensional image data.

[0003] For example, Patent Document 1 discloses a medical image display device capable of displaying two-dimensional images and three-dimensional images on the same display device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2020-863 Summary of the Invention [Problem to be solved by the invention]

[0005] The device described in the above document also makes it possible to effectively confirm the presence or absence of lesions and perform simulations while observing both two-dimensional and three-dimensional images. However, in this type of device, which is expected to be used immediately before or during surgery, it is desirable from the perspective of performing highly reliable surgery to be able to handle medical images with greater ease.

[0006] SUMMARY OF THE PRESENTLY PREFERRED EMBODIMENTS An object of the present invention is to provide a medical image processing apparatus, a medical image processing method, and a medical image processing program that can handle three-dimensional medical images with ease and contribute to the performance of highly reliable surgery. [Means for solving the problem]

[0007] In order to achieve the above object, one aspect of the present invention is as follows: A medical image processing device including a display control unit that controls display of a three-dimensional image representing an anatomical structure of a subject, The display control unit is A process for generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising: a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space; a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis; An image generation process comprising: A process of displaying the three-dimensional image existing between the cutting reference planes; 13. A medical image processing device configured to:

[0008] (Definition of terms) "Two-dimensional image" (in the context of medical imaging) refers to a cross-sectional image of a subject, such as an image that is displayed in shades of gray according to the CT number. "Three-dimensional image" refers to a three-dimensional model that represents an anatomical structure in three dimensions. As an example, a three-dimensional image is composed of multiple layers that are set for each anatomical structure, and in addition to coordinate information, the image has multiple layer information that indicates these layers, and different hue information for each layer (each anatomical structure). As an example, this information may be information inherited from each voxel of a volume data set when the three-dimensional image is created from the volume data set. In the three-dimensional image, the anatomical structures may be displayed in different colors for each layer. "Anatomical structure" refers to recognizable objects within a subject (such as organs, bones, blood vessels, etc.), including fat and lesions such as tumors. In addition, even if an anatomical structure is viewed as a whole, it may be treated as multiple anatomical structures if it is divided into multiple units or has separate functions. For example, the upper lobe, middle lobe, and lower lobe of the lungs can each be treated as separate anatomical structures, and the arterial and venous blood vessels can each be treated as separate anatomical structures. With regard to the word "select", for example, when it is said that "the operator selects an icon", the means for selecting an icon is not particularly limited, and includes, for example, the operator touching (tapping) the icon via a touch panel, selecting the icon with a cursor using a mouse or the like, selecting the icon using gesture input, etc. In one embodiment, a "controller" has a CPU and memory and performs arithmetic processing, and may also be called a "controller," a "processor," a "controller unit," a "controller circuit," a "controller module," a "processor section," a "arithmetic section," a "processor unit," a "processor module," or the like. The "controller" may be composed of a microcomputer, a microcontroller, a programmable logic controller, an application specific integrated circuit, or other programmable circuit. In this specification, the "controller" may be a single physical configuration, or two or more control units may functionally cooperate to constitute a single "controller." "Semi-transparent" in image display is one of the display formats for anatomical structures in 3D images, and refers to the setting of transparency so that other anatomical structures that were hidden can be seen. It also includes a display in which the anatomical structure that is considered to be semi-transparent is almost impossible to see.

[0009] (General description of medical image processing equipment) As an example, a medical image processing device includes an input device for receiving input from an operator, one or more control units (processor units) for performing predetermined data processing based on the input, and a display device for displaying medical images, and displays two-dimensional and three-dimensional images. Devices that do not include a display device and only perform image generation, etc., are also included in the medical image processing device of the present invention. Display functions possessed by a medical image processing device include at least one of the following: - Movement, rotation, enlargement, reduction, etc. of medical images, change of cross-sectional position, etc. -Colored display of specific anatomical structures, transparent display, etc. Displaying corresponding positions in two-dimensional and three-dimensional images, etc. Effect of the Invention

[0010] According to the present invention, it is possible to provide a medical image processing apparatus, a medical image processing method, and a medical image processing program that can handle three-dimensional medical images with good operability and contribute to the implementation of highly reliable surgery. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram of a medical image processing apparatus according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of an image displayed on the medical image processing apparatus. [Diagram 3] FIG. 13 is a diagram showing an example of a display image (a state in which a cut surface is displayed together with a three-dimensional image). [Figure 4] FIG. 13 illustrates an example of a graphical user interface for a flatcut function. [Diagram 5] FIG. 13 illustrates an example of a graphical user interface for a flat cut function (with the three-dimensional image partially cut away). [Figure 6] FIG. 5 is a diagram for explaining functions of the user interface in FIG. [Figure 7] FIG. 13 is a diagram for explaining a 3D pointer displayed with respect to a three-dimensional image. [Figure 8] FIG. 13 is a diagram showing a method of operating a 3D pointer. [Figure 9] FIG. 13 is a diagram for explaining a virtual probe function. [Figure 10] FIG. 13 is a diagram for explaining a margin sphere. [Figure 11] FIG. 13 is a diagram showing an example of a user interface for changing the size of the margin sphere. [Figure 12] FIG. 13 is a diagram illustrating an example of a user interface for changing the transparency of an object. [Figure 13] FIG. 13 is a diagram for explaining a coagulation range simulation function. [Figure 14] FIG. 11 is a diagram showing an example of an input method for displaying a pointer. [Figure 15]FIG. 15 is a diagram showing a pointer displayed by the input method of FIG. 14. [Figure 16] FIG. 13 is a diagram showing an example of an input method for specifying a circular region. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, several embodiments of the present invention will be described with reference to the drawings. Note that the specific device configurations and methods described below relate to only one embodiment of the present invention, and the present invention is not necessarily limited to this.

[0013] 1, in this example, the medical image processing system 1 includes an image display control unit 11, a data storage unit 12, a display device 13, and an input device 14. The medical image processing system 1 may further include a data input / output interface 15, a medical information management device 21, a liquid injection device 22, and an imaging device 23. The medical image processing system 1 is configured so that a three-dimensional image and a second image, which is another type of image associated with the three-dimensional image, can be simultaneously displayed on the display device 13. In the following, an example will be described in which the second image is a two-dimensional image.

[0014] Display device 13 may be any display capable of displaying an image created by image display control unit 11, such as a liquid crystal display or an organic EL display. There may be one or more display devices 13.

[0015] The input device 14 may be any device, such as a keyboard or a mouse, that can receive input operations by an operator and input data, etc., to the image display control unit 11. A touch panel that combines a display and a touch screen can also be used as the display device 13 and the input device 14. The input device 14 can also be combined with a non-contact input unit that can perform input without contact. Non-contact input units can be divided into those that use gesture recognition technology and those that use voice recognition technology. An example of a non-contact input unit that uses gesture recognition technology is the "Leap Sensor" (manufactured by Leap Motion). The "Leap Sensor" is an input device that can recognize the movement of an operator's fingers, etc., without contact, and has an infrared irradiation unit and an infrared camera, etc. When infrared rays irradiated from the infrared irradiation unit hit the operator's hand, the reflected light is photographed by an infrared camera, and the image is analyzed to detect the position, movement, shape, etc. of the operator's hand and fingers in a three-dimensional space in real time. Another example of a non-contact input unit that uses gesture recognition technology is the "RealSense" (manufactured by Intel). "RealSense" is a modularized 3D camera consisting of an RGB camera and an infrared camera, an infrared sensor, etc., and can obtain depth information in addition to color information, and can recognize the movements of the operator's fingers, etc. in three dimensions. In this embodiment, both the Leap sensor and RealSense can be used, and in either case, the operator's movements for input include the same movements as the operator's movements on a touch panel (e.g., tap, double tap, swipe, flick, pinch in, pinch out, etc.), as well as movements in the depth direction. When actually performing input operations, a transparent flat plate made of acrylic resin or the like is placed at an appropriate position, and input operations are performed using the flat plate as a reference plane, thereby preventing erroneous recognition due to positional deviation in the depth direction.

[0016] A voice recognition unit is an example of a non-contact input unit that uses voice recognition technology. The voice recognition unit may have a microphone that captures the voice generated by the operator, and a voice recognition device that recognizes the voice captured by the microphone and converts it into an operation signal. The voice recognition device may be installed anywhere, but it is preferable to install the microphone near the operator.

[0017] The data storage unit 12 stores at least one data set capable of generating a three-dimensional image showing the three-dimensional arrangement of a plurality of anatomical structures. The data storage unit 12 may include at least one of a hard disk drive (HDD), a solid state drive (SSD), and various memories. In addition to the two-dimensional image data and three-dimensional image data, the data storage unit 12 may store at least one program, table, database, etc. required for the processing performed by the image display control unit 11. The data set stored in the data storage unit 12 can be acquired from the medical information management device 21 through the data input / output interface 15. The data input / output interface 15 may be connected to the medical information management device 21 wirelessly or by wire.

[0018] Examples of the medical information management device 21 include picture archiving and communication systems (PACS), radiology information systems (RIS), and hospital information systems (HIS). The medical information management device 21 manages data of medical images of a subject into which a medical fluid (e.g., contrast medium) is injected by a medical fluid injector 22 and which is captured by an imaging device 23. The medical fluid injector 22 may be any injection device that injects a medical fluid such as a contrast medium filled in a syringe, a medical fluid bag, or the like, into the subject according to preset injection conditions.

[0019] The imaging device 23 may be any device capable of capturing medical images composed of image data, such as a computed tomography (CT) device, a magnetic resonance imaging (MRI) device, an angiography device, a positron emission tomography (PET) device, an ultrasonic diagnostic device, etc. The data set stored in the data storage unit 12 may also be acquired from the imaging device 23.

[0020] The data set stored in the data storage unit 12 is exemplified by a volume data set for a plurality of anatomical structures. The volume data set is a data set obtained by arranging a plurality of (e.g., 300) slice image data pieces, which are continuously photographed at regular intervals (e.g., 1 mm intervals) in a specific direction (e.g., body axis direction, left-right direction, front-back direction, a direction inclined to at least one of these directions) of the subject, in the body axis direction. The data set stored in the data storage unit 12 may be raw data directly or indirectly acquired from the imaging device 23. In this case, it is preferable that the image display processing unit 11 is configured to reconstruct the raw data stored in the data storage unit 12 and obtain an arbitrary image. The volume data set is composed of a plurality of voxels, and a plurality of anatomical structures are extracted by a predetermined process based on the voxel value of each voxel. Then, transmittance and hue are set for each voxel for each extracted anatomical structure. Thus, each voxel includes coordinate information, transmittance information, and hue information. In this way, the anatomical structures are extracted, and a three-dimensional image is created by performing rendering processing on the volume data set in which the transmittance and hue are set for each anatomical structure. Examples of the rendering processing include volume rendering (VR) and maximum intensity projection (MIP). Since each processing for creating a three-dimensional image from a volume data set, such as the processing for extracting the anatomical structures, the setting of the transmittance and hue for each voxel, and the rendering processing, may be known processing, detailed description thereof will be omitted here. In addition, the extraction of the anatomical structures in the volume data set and the setting of the transmittance and hue may be performed by this image display control unit 11, or the volume data set in which the anatomical structures are extracted and the transmittance and hue are set may be stored in advance in the data storage unit 12 or the like.

[0021] The volume data set in which the transmittance and hue are set for each anatomical structure may be divided into a plurality of layers for each anatomical structure, and each voxel may include layer information. In this case, the volume data set may be stored in the data storage unit 12 or the like as one data file having a plurality of pieces of layer information for each anatomical structure, or may be stored in the data storage unit 12 or the like as a plurality of data files each divided for each piece of layer information. The form in which the volume data set is stored may be arbitrarily selected by the operator when storing the volume data set.

[0022] It is possible to create a two-dimensional image by cutting out the volume data set on an arbitrary plane and reconstructing it. This type of processing is called arbitrary plane reconstruction (MPR). Basically, two-dimensional images used in the medical field include an axial section perpendicular to the subject's body axis direction, a sagittal section perpendicular to the subject's left-right direction, and a coronal section perpendicular to the subject's front-back direction. These two-dimensional images can be created using two-dimensional image data at a desired cross-sectional position created from the volume data set. The creation of the two-dimensional image data may be performed by the image display control unit 11 using a volume data set stored in the data storage unit 12 or the like. Alternatively, a plurality of two-dimensional image data (two-dimensional image data sets) created in advance using the volume data set may be stored in the data storage unit 12 or the like together with the original volume data set. In either case, at the stage when the two-dimensional image data is created from the volume data, the coordinate information of each voxel of the volume data is inherited by the two-dimensional image data, and therefore the three-dimensional image and the two-dimensional image based on the common volume data have common coordinate data. In addition, when the two-dimensional image is displayed, an interpolation process of the two-dimensional image data may be performed. For example, when two-dimensional image data sets in multiple cross sections, such as the above-mentioned axial, sagittal and coronal cross sections, are stored in the data storage unit 12, etc., the two-dimensional image data set may be stored in the data storage unit 12 as one data file having multiple two-dimensional image data for all cross sections, or may be stored in the data storage unit 12, etc. as multiple data files, each having multiple two-dimensional image data for each cross section.

[0023] Regarding the configuration in Fig. 1, the medical image processing device indicated by reference numeral 10 may be configured as a device in which an image display control unit 11, a data storage unit 12, a display device 13, an input device 14, and a data input / output interface 15 are housed in a single housing. The medical image processing device 10 may be a portable terminal such as a tablet terminal or a notebook personal computer having a touch panel display. However, the present invention is not limited to this, and the medical image processing terminal 10 may be configured as a workstation in which the display device 13 and the input device 14 are configured as separate units from the image display control unit 11.

[0024] The image display control unit 11 may be configured as a computer unit equipped with a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and executes various processes for controlling the display of images on the display device 13 according to inputs received by the input device 14. The processes performed by the image display control unit 11 may be realized by a computer program, or may be realized by hardware using a logic circuit. When the processes performed by the image display control unit 11 are realized by a computer program, the computer program may be stored in the data storage unit 12, etc., as described above. The computer program stored in the data storage unit 12 is executed by being loaded into the RAM of the image display control unit 11, and various processes are executed by cooperating with hardware such as the CPU.

[0025] The computer program may be stored in a computer-readable recording medium. The recording medium storing the computer program may be a non-transient recording medium. The non-transient recording medium is not particularly limited, and may be, for example, a memory card, a CD-ROM, or other recording medium. The computer program stored in the recording medium may be stored in the computer unit via a suitable reader. Examples of the suitable reader include a card reader when the recording medium is a memory card, and a CD drive when the recording medium is a CD-ROM. Alternatively, the computer program may be downloaded from an external server to the computer unit via a communication network.

[0026] The image display control unit 11 (see FIG. 1) may have, as conceptual components, an input determination unit, a display processing unit, and a user interface unit in order to execute various processes for controlling the display of images.

[0027] The input determination unit determines what processing should be performed on the image displayed on the display device 13 based on the input received by the input device 14, the type of the input device 14 that received the input, changes in the input signal, etc. The display processing unit mainly performs processing on the display area of ​​the display device 13 and processing on image display within the display area.

[0028] To briefly explain these processes using an example in which a volume data set is stored in the data storage unit 12, etc., as an example, in regard to the processing of the display area, the display processing unit generates specific medical images shown in Fig. 2, etc., and displays them on the display device. The user interface unit plays a role in generating and / or displaying images of various user interfaces, including image buttons (icons) for input operations by the operator.

[0029] In processing the image display within the display area, as described in detail below, a three-dimensional image created from a volume data set stored in the data storage unit 12 or the like is displayed, and at the same time, a two-dimensional image corresponding to a position identified in the three-dimensional image is created from the volume data set stored in the data storage unit 12 or the like and displayed.

[0030] [Example of displayed image] A display screen according to one embodiment of the present invention may be as shown in FIG. 2. In this example, a display image 100 includes two areas, a three-dimensional image display area 101A and a two-dimensional image display area 101B (hereinafter, these areas will not be distinguished from each other and will be simply expressed as "image display areas (101A, 101B)"). Note that, although an example in which various icons and the like are operated via a touch panel will be described below, the present invention is of course not limited to this. Also, for convenience of explanation, there may be cases where reference numerals will be omitted in the explanation.

[0031] The image display areas 101A and 101B may be displayed side by side in the horizontal direction, or may be separated by a division line 102 as shown in Fig. 2. As an example, the division line 102 is provided so as to be movable in the horizontal direction, and the size of each of the image display areas 101A and 101B can be changed by moving the division line 102 left and right. An operation target portion 102a may be provided on a part of the division line 102 so that the operator can easily intuitively understand that the division line 102 is movable. The division line 102 moves left and right by touching the vicinity of the operation target portion 102a with a finger and moving it left and right.

[0032] In the example of FIG. 2, a model including a liver object 305 and a blood vessel object 303 is displayed as a three-dimensional image 300 in the image display area 101A.

[0033] In the image display area 101A, various icons 111 to 116 are displayed for operating the display of the three-dimensional image 300. The icon 111 is a menu icon for calling various functions, and the icon 112 is for changing the display of the three-dimensional image to a predetermined posture set in advance. The icon 113 is for taking a screenshot of the displayed image and saving it, and the icon 114 is for displaying the saved image. The icon 115 is a flat cut icon for changing and adjusting the display range of the three-dimensional image (described in detail later). The icon 116 is for changing the display resolution of the three-dimensional image, and in this example, it is switchable between 512×512×512 pixels and 1024×1024×1024 pixels. The same icons may be displayed in the image display area 101B, and in this embodiment, icons with the same functions are denoted by the same symbols (see FIG. 2). Note that the icons 115 and 116 are not displayed in the image display area 101B because their functions are intended only for the three-dimensional image here.

[0034] [Various functions of medical image processing equipment] The medical image processing device 10 has various functions related to the display of medical images, etc. Some of these functions will be described below. Note that in the following description, image processing is realized, as an example, by the functions of the image display control unit 11 shown in FIG.

[0035] (a) Image rotation, zoom in / out, display change, etc. In the medical image processing device 10, the three-dimensional image 300 can be changed in display, such as by rotating in any direction, enlarging or reducing, by a predetermined input operation by the operator. For example, an input operation on a touch panel may be used for changing the display. Specifically, examples of the change in display include rotating the three-dimensional image 300 according to the swipe direction by a swipe operation, and shrinking or enlarging the three-dimensional image 300 by a pinch-in or pinch-out operation. Similarly, the two-dimensional image 200 can be changed in display, such as by changing the cross-sectional position, enlarging or reducing, like the three-dimensional image 300. Note that the function for operating the two-dimensional image and the function for operating the three-dimensional image may be the same.

[0036] (b) Displaying the cross-sectional position of the two-dimensional image on a three-dimensional image The two-dimensional image 200 and the three-dimensional image 300 have corresponding coordinate information in the body axis direction, the left-right direction, and the front-back direction of the subject. Therefore, by using this coordinate information, it is also possible to display on the three-dimensional image 300 a cross-sectional position corresponding to the current display of the two-dimensional image 200. The position of the two-dimensional image 200 in the body axis direction can be changed, and although the input method for this is not particularly limited, for example, by moving a scroll indicator (not shown) displayed in the display area 100B, a tomographic image at a body axis direction position corresponding to the position is displayed.

[0037] A more specific display mode in this embodiment may be as follows. That is, as shown in FIG. 3, a cut surface 310 corresponding to the position of the current tomographic image in the two-dimensional image 200 may be displayed together with the three-dimensional image 300. By displaying such a cut surface 310, it becomes possible to visually and easily grasp which position in the three-dimensional image the current tomographic image corresponds to. Specifically, a configuration may be adopted in which a predetermined position p(x, y, z) in the two-dimensional image 200 and a corresponding predetermined position P(x, y, z) in the three-dimensional image 300 are displayed. In addition, with regard to the display of such positions p and P, auxiliary lines (not shown) or the like for easily indicating the positions may be displayed as necessary.

[0038] (c) Other functions related to image display With regard to functions that can be called up from the menu button icon 111 (see FIG. 2), when the menu button icon 111 is selected, a group of function call icons (not shown) is displayed, and the operator may select a desired icon from among them to select the corresponding function. Examples of such functions may include the following:

[0039] The medical image processing device 10 may have a revert function. The three-dimensional image 300 can be arbitrarily changed in its displayed orientation, size, etc., and the two-dimensional image can be arbitrarily changed in its displayed cross-sectional position, size, etc. The revert function is a function for initializing the display of the three-dimensional image and / or the two-dimensional image. Initializing the display means displaying an initial image in the image display areas 101A and 101B.

[0040] The medical image processing device 10 may have a clipping function. Here, as an example, the clipping function is a function for cutting out and displaying an arbitrary part of a three-dimensional image. Although detailed illustration is omitted, as a specific example, a configuration may be used in which clipping processing is executed when an icon displayed as "BBox" is selected. Specifically, in the clipping function, selection is performed in a state in which a part of a three-dimensional image is surrounded by a hexahedron. The hexahedron is displayed semi-transparently so that the operator can visually recognize the anatomical structure located inside it. In this state, clipping is performed as follows. That is, when one face of the hexahedron to be clipped is selected, the selected face becomes active, and when the active face is slid, the shape of the hexahedron is changed and the target range in the three-dimensional image is changed. When an anatomical structure exists on the clipped face, the anatomical structure may be displayed in a cross section on the clipped face. Note that when another face is tapped, the tapped other face becomes active, and the three-dimensional image may be further clipped on the other face in the same manner as described above.

[0041] The medical image processing device 10 may have a perspective display function. The perspective display is one of the representation methods that create a sense of perspective by displaying a three-dimensional image by perspective projection. When an operator slides, for example, a button for adjusting the angle of view (not shown) in a predetermined direction, the width of the angle of view of the three-dimensional image is adjusted according to the amount of sliding or the position of the slider. For example, when the angle of view is widened, a part in a near position is displayed larger and a part in a far position is displayed smaller. By displaying the three-dimensional image by perspective projection, an image close to an image seen by an endoscope can be displayed. Therefore, the perspective display function can be effectively used in endoscopic surgery, for example, in which an operation is performed while comparing an image acquired from an imaging device with an image of an actual organ acquired by an endoscope.

[0042] Next, some examples and functions of the graphical user interface that improves the operability of the medical image processing apparatus 10 will be further described.

[0043] (Flat cut function) The medical image processing apparatus 10 may have a flat cut function. The "flat cut function" is a function for cutting a three-dimensional image by one or more reference planes and displaying the image. This function will be described with reference to Figs. 4 to 6.

[0044] The operation for activating the flat cut function is not particularly limited, but for example, this function may be activated by selecting a flat cut icon 115 displayed on the screen as shown in Fig. 4. This icon 115 may be displayed within the image display area 101A.

[0045] When the icon 115 is selected, a graphical user interface 140 is displayed. This graphical user interface 140 includes a first slider 145a and a second slider 145b that can be slid independently. Each slider is adapted to move along a guide line 145c. The sliders 145a and 145b may move in any direction, but in this example, they move in the vertical direction as shown. When each slider 145a and 145b is located at the end of its movable range (specifically, as an example, when the sliders are furthest apart from each other), the three-dimensional image is not cut out and is displayed in its entirety.

[0046] On the other hand, as shown in FIG. 5, by changing the positions of the sliders 145a and 145b, the three-dimensional image is displayed in a partially cut state. Specifically, when the first slider 145a is slid slightly downward from the end of the movable range, a cutting reference plane (not shown) on one side along a predetermined reference axis (here, the "x-axis" in one example) of the three-dimensional image is set corresponding to the position. The three-dimensional image is displayed in a state cut by the cutting reference plane. In this example, the liver object 305 is cut by the end surface 305a. Similarly, when the second slider 145b is slid slightly from the end of the movable range, a cutting reference plane (not shown) on the opposite side is set corresponding to the position. Specifically, the liver object 305 is cut by the cutting reference plane and the end surface 305b is displayed. In this embodiment, that is, only the three-dimensional medical image within the area corresponding to the distance L1 between the sliders 145a and 145b (the area corresponding to the distance L2 in FIG. 5) is displayed, and the outside of that is not displayed.

[0047] Such a graphical user interface 140 has the advantage that, as necessary, it is possible to move the sliders 145a, 145b to narrow the display area of ​​the three-dimensional image or to display its end surface, thereby enabling the anatomical structure of the three-dimensional image to be confirmed in more detail.

[0048] In one embodiment, it is preferable that the three-dimensional image in the state of Fig. 5 can be moved, rotated, and enlarged / reduced so that the three-dimensional image in the state of Fig. 5 can be observed from various directions and checked by enlarging / reducing it. With such a configuration, for example, the three-dimensional image can be rotated and displayed so that the end surface 305a facing the back side in Fig. 5 becomes the front side. It is also possible to enlarge and display the end surface 305a.

[0049] In one embodiment, the graphical user interface 140 is preferably configured to allow the two sliders 145a and 145b to be moved simultaneously while maintaining the distance L1 between the sliders 145a and 145b. In order to allow the two sliders 145a and 145b to be moved simultaneously, a method of selecting a special icon to set such a mode and then moving the sliders may be assumed. However, as an example, the interface may be configured to allow the two sliders 145a and 145b to be moved together while maintaining the distance L1 by touching any position (for example, near the guide line 145c) in the area between the sliders 145a and 145b as shown in FIG. 6(b) while the sliders 145a and 145b are in a predetermined position as shown in FIG. 6(a) and moving it up and down. The display area of ​​the three-dimensional image is also changed in real time in conjunction with the movement of the slides 145a and 145b. According to this configuration, it is possible to change the display area of ​​the three-dimensional image while maintaining the distance L1 once determined by moving the individual sliders 145a, 145b, so that the display range can be fine-tuned with a very simple operation.

[0050] (3D pointer function) The medical image processing device 10 may have a 3D pointer function. The "3D pointer function" refers to a function of displaying a three-dimensional pointer on a specific object in a three-dimensional image, and in particular, refers to a function of moving the pointer so as to follow the surface of the object. This function will be described with reference to Figs. 7 and 8.

[0051] In the display screen shown in FIG. 7, a two-dimensional image 200 and a corresponding three-dimensional image 300 are displayed, as in FIG. 2. For convenience of explanation, only a blood vessel object 303′ is displayed in the three-dimensional image 300. When the operator designates an arbitrary point p in the two-dimensional image 200 in a state in which a mode for displaying a 3D pointer is selected, a 3D pointer 161 is displayed at a corresponding point P in the three-dimensional image 300. The shape and size of the 3D pointer 161 are not particularly limited, and any shape may be used as long as it can clearly indicate a predetermined position in a three-dimensional image displayed stereoscopically. Other methods for displaying the pointer 161 will be described later with reference to other drawings.

[0052] At this point, the 3D pointer 161 displayed in the three-dimensional image 300 is linked to one of the objects (here, a blood vessel object 303′) and is displayed so as to be in contact with the object 303′. In such a 3D pointer 161, the following problem is considered when the pointer is moved. That is, when the 3D pointer 161 is moved in a three-dimensional space, the pointer can usually be moved in any direction, so it is assumed that the pointer may move away from the target object when the operator moves the pointer. Therefore, in this embodiment, the 3D pointer 161 is configured to move along the surface of the target object 303′ without moving away from the object 303′ when the 3D pointer 161 is moved.

[0053] Regarding how to move the 3D pointer 161, various methods may be adopted, and for example, the following may be used. In the following, an example will be described assuming that an operator operates the pointer with a finger via a touch panel, but of course, the input format may be other than that. As shown in FIG. 8, when the operator touches the first region 161a of the 3D pointer 161 and moves the finger, the 3D pointer 161 rotates with the rotation center 161p as a reference, and the direction of the pointer 161 changes. The first region 161a may be a region including a part of the base end side of the pointer 161. On the other hand, when the operator touches the second region 161b of the 3D pointer 161 and moves the finger, the entire pointer 161 can be moved in any direction (while maintaining the direction of the pointer). The second region 161b may be a region including a part of the tip side of the pointer. By such an operation, the direction and position of the 3D pointer 161 can be freely changed.

[0054] The 3D pointer 161 is displayed in a three-dimensional space (image display area 101A). Therefore, it is preferable that the pointer can be moved with good operability not only in the up, down, left, and right directions, but also in the depth direction (one example). As an example, and not particularly limited thereto, the 3D pointer 161 may be moved by simultaneous movement (e.g., upward or downward, or right or left) of multiple fingers (three or four fingers). From another perspective, the 3D pointer 161 itself may be displayed as multiple images with parallax, so that it can be viewed stereoscopically on the display screen.

[0055] (Virtual probe function) The medical image processing apparatus 10 may have a virtual probe function. The "virtual probe function" refers to placing a virtual probe in a three-dimensional image and displaying a virtual captured image captured by the virtual probe on the screen. This function will be described with reference to FIG. 9.

[0056] 9, a predetermined three-dimensional image (liver object 305 as an example) is displayed in image display area 101A. A virtual probe 171 is displayed in contact with or close to this object 305. This probe 171 represents an ultrasound probe of an ultrasound diagnostic device as an example. The shape of probe 171 may be any of a linear type, a convex type, a sector type, a single type, etc., and may be either a probe for two-dimensional images or a probe for three-dimensional images.

[0057] An image that will be captured by an imaging device including the probe 171 is displayed in the display region 101B. Here, an ultrasound diagnostic image 220 is displayed in the display region 101B. This configuration in which a virtual ultrasound diagnostic image 220 targeting a predetermined three-dimensional image is displayed has the advantage that it is possible to confirm the shape and arrangement of an anatomical structure in a target object without actually capturing an image of a subject.

[0058] It is also desirable that the virtual probe 171 in Fig. 9 has good operability. For example, when a first region 171a on the handle side of the probe 171 is touched and moved, the probe 171 may be configured to change its orientation (inclination) based on a predetermined rotation center. Also, when a second region 171b on the tip side of the probe 171 is touched and moved, the entire probe 171 may be moved.

[0059] With regard to the movement of the virtual probe 171, movement may be performed similarly to the 3D pointer 161 described above, such that the probe 171 moves along the surface of the three-dimensional image of the object.

[0060] (Margin ball adjustment user interface) The medical image processing device 10 may have a user interface for adjusting a margin sphere. The "margin sphere" refers to a sphere or polyhedron surrounding a specific object (for example, a tumor object) in a three-dimensional image, and this margin sphere is used, for example, to confirm how much margin of the target tumor should be removed when the tumor is resected. The "margin sphere adjustment user interface" is a user interface for easily changing the size of the margin sphere, etc. This function will be described with reference to Figs. 10 and 11.

[0061] First, the margin sphere will be described. When a predetermined input is received from an operator, the medical image processing apparatus 10 of this embodiment displays a minimum circumscribed sphere 377 surrounding a tumor 365 in a three-dimensional image, as shown in FIG. 10(a). The "predetermined input" is not particularly limited, but may be a selection of an icon displayed on the screen, a voice input, or a gesture input at a position away from the screen. Then, as shown in FIG. 10(b), a margin sphere 378 that is one size larger than the circumscribed sphere 377 and has a predetermined margin (for example, 1 mm, 2 mm, 3 mm, 4 mm, 5 mm, 10 mm, 15 mm, etc.) added thereto is displayed. As an example, this margin sphere 378 is a sphere concentric with the circumscribed sphere 377. The margin sphere 378 may be displayed in a transparent color so that its inside can be seen. It is to be noted that only the margin sphere 378 may be displayed, and the circumscribed sphere 377 may be hidden.

[0062] As the appropriate margin value varies depending on the tumor removal procedure, the target organ, etc., it is preferable that the operator is able to set a desired value, and for example, the value may be input and changed by inputting a numerical value and / or by operating a user interface on the screen. A specific example of the user interface will be described later with reference to FIG. 11.

[0063] 10(b), when the margin sphere 378 is in contact with, for example, a nearby major blood vessel 353b, the medical image processing device 10 may be configured to display a warning to that effect and / or highlight the blood vessel portion. The blood vessel 353b may be highlighted by highlighting the portion (which may include the vicinity) that the margin sphere 378 is in contact with, or the entire blood vessel 353b from its origin to its tip. This configuration is advantageous because it allows the user to confirm in advance which blood vessels need to be resected when removing the tumor 365 (the portion of the blood vessel 353 indicated by reference numeral 353a does not need to be resected).

[0064] 10(b), when the margin sphere 378 is in contact with some anatomical structure, the mask of the anatomical structure (which may be, but is not limited to, a solid organ such as the liver) included inside the margin sphere 378 may be automatically separated, and the volume included inside may be calculated and the amount of volume may be displayed as necessary. Regarding the amount of volume, instead of one margin sphere, the sum of the volumes included in each of the multiple margin spheres may be calculated.

[0065] A user interface 150 as shown in FIG. 11 may be employed to change the size of the margin sphere 378. This user interface 150 includes a slider 156 for setting the length of the margin. In this example, the slider 156 is slidable within a range of approximately 0 mm to 20 mm (as an example), and is configured to be movable along the horizontal axis. Note that the numerical values ​​on the horizontal axis indicate the length of the margin, but such a display is not essential.

[0066] When the slider 156 is at the "0" position, the margin length is 0, and in the above example, only the circumscribed sphere 377 is displayed. By moving the slider 156, a numerical value according to the slider position is set as the margin length. The size of the margin sphere 378 in the three-dimensional image may be changed in real time. According to such a graphical user interface 150, the size of the margin sphere 378 can be changed very intuitively and immediately, and the relationship between the tumor 365 and the margin sphere 378 can also be confirmed in the three-dimensional image, which contributes to the implementation of a highly accurate surgery.

[0067] In the user interface 150, information indicating the length of the margin may be displayed as a large number in the display area 151. Specifically, in the illustrated example, the number "10" may be displayed in the display area 151. With this configuration, it is possible to provide the operator with information on the specific set numerical value with good visibility.

[0068] Furthermore, the user interface 150 may include a plurality of size indicators 159 in the form of concentric arcs that connect the values ​​on the vertical axis and the values ​​on the horizontal axis. Furthermore, to make it easier to visually grasp the currently set value, among the plurality of size indicators 159, only the indicator 159 that indicates the current margin length and corresponds to the position of the slider 156 may be highlighted. For example, in this example, the indicators 159 that exist in the range from "0" to "10" are displayed thicker than the others.

[0069] The user interface 150 may be one in which a specific numerical value is input by selecting a preset value, rather than inputting a numerical value via a slider 156. In the example of FIG. 11, a preset value display section 157 displays "0" mm, "10" mm, and "20" mm (as an example) as preset values ​​on the vertical axis. When any of these is selected, the corresponding margin length may be set. It should be noted that the above numerical values ​​and preset numbers are, of course, merely examples and can be changed as appropriate.

[0070] As an embodiment of user interface 150, slider 156 may move continuously along the horizontal axis, or may move in steps corresponding to discrete values ​​such as "1", "2", "3", "4", and "5" mm. User interface 150 in Fig. 11 can be displayed at any position on the display screen, but may be displayed within display area 101A, for example.

[0071] (User interface for changing transparency) The medical image processing device 10 may have a user interface for changing the transparency of an object. The "transparency of an object" refers to the transparency of each object of an anatomical structure included in a three-dimensional image, and the transparency of the object can be adjusted, so that, for example, an object displayed in the foreground as seen from the operator can be displayed semi-transparently while another object in the background can be observed. The user interface will be described with reference to FIG. 12.

[0072] As shown in FIG. 12, the user interface 170 includes a slider 177 that slides along a circular orbit 173, and the operator moves the slider 177 to change the transparency of the object. The transparency may range from 0% to 100%, but is not limited thereto and may be any numerical range. The start point 173a of the circular orbit 173 may correspond to 0%, and the end point 173b may correspond to 100%. The circular orbit 173 may not be a closed circle, but may extend over a range in which the central angle of the sector is 180° or more and less than 360°, more specifically, 270° or more and less than 360° (as an example). However, a completely closed circular orbit may be used, in which the slider 177 can be rotated 360° or more. In order to easily identify the current transparency, a highlight 174 may be displayed from the start point 173a to the position of the slider 177.

[0073] According to the user interface 160 as shown in FIG. 12, the transparency can be changed with high accuracy even in a compact space on the screen for the following reasons. That is, as a user interface for changing the transparency, for example, a configuration (not shown) in which a slider is moved back and forth linearly can be adopted. However, in touch panel operation, the operator needs to move his / her hand up and down or left and right (one example) to move the slider linearly, and a relatively large motion is required. On the other hand, in the case of the configuration as shown in FIG. 12, for example, the slider 177 can be moved a sufficient distance by touching and rotating the slider 177 with the index finger without moving the hand much. In other words, there is no need to move the hand much, and fine input by finger movement can be made compared to linear movement, so that a technical advantage is also achieved that fine adjustment of the transparency can be easily performed.

[0074] User interface 170 in FIG. 12 can be displayed at any position on the display screen, but may be displayed within display area 101A, for example.

[0075] (Coagulation range simulation function for cauterization or freezing) The medical image processing device 10 may have a function of simulating the coagulation range in a target part of a subject. The "coagulation range simulation function" is a function of simulating the extent to which coagulation will occur when a target part of a subject is cauterized and resected by cauterization using an electrode needle (it can be applied not only to cauterization but also to freezing). With reference to FIG. 13, the case of cauterization will be described as an example.

[0076] As a percutaneous local therapy for necrotizing a tumor and its surrounding area, for example, there is a method in which energy is applied to a target area of ​​a subject from an electrode needle or probe, thereby cauterizing the cellular tissue and causing coagulation necrosis. The extent of the area that is cauterized by the application of energy from an electrode needle or the like depends on the shape of the electrode needle, the performance of the device, etc.

[0077] Fig. 13 is a schematic diagram showing the difference in the coagulation range due to the difference in the electrode needle. Fig. 13(a) shows a probe 190a which is a virtual representation of a certain electrode needle, and shows that when this probe is inserted into a target area of ​​a subject and used, a region 195a undergoes coagulation necrosis. Fig. 13(b) shows a probe 190b which is a different electrode needle, and shows that a region 195b undergoes coagulation necrosis when used. Fig. 13(c) shows a probe 190c which is yet another electrode needle, and shows that a region 195c undergoes coagulation necrosis.

[0078] The coagulation range can also be taken as a function of time. Therefore, the cauterization time of the probe may be simulated, or the display mode may be such that the area sphere is gradually enlarged in response to time. This method may be applied not only to cauterization but also to freezing. In this embodiment, the medical image processing device 10 thus has information on the coagulation characteristics of each probe, and may be configured to be able to simulate the coagulation range when, for example, a probe is virtually punctured into a predetermined anatomical structure of a three-dimensional medical image and energy is applied.

[0079] As for the puncture of the probe, for example, a simulation function of the route when puncturing the probe (i.e., what route the probe should puncture through, or what route it should not puncture through) may be provided. For example, when a certain anatomical structure to be avoided, such as a blood vessel, is present on the route along which the probe is punctured, the device may determine this and issue an alert (display a message, issue a warning sound, etc.), and / or automatically avoid the route. Although not limited thereto, the alert may be a highlighting display, such as coloring or blinking of a certain object (for example, a display on a screen).

[0080] Since it is assumed that a predetermined target site may be coagulated and necrotized using multiple probes (or by multiple probe punctures), it is preferable to be able to perform a simulation of a range corresponding to multiple cases. In addition, for example, if a tumor is present in multiple locations or is widespread, the treatment may be performed in several separate sessions (on different days). In addition, additional treatment may be required at a later date. In this way, it is assumed that the cauterization method and freezing method may require multiple treatments on different days rather than a single treatment, so it is preferable to be able to save the simulation results of the coagulation range and / or output them to an external device (time information, subject information, surgery information, device user information, etc. may be included). Such data may be called up as necessary to continue the simulation (for example, to perform a simulation of an additional probe).

[0081] In addition, medical images include those generated based on image data of a CT device and those generated based on image data of an MR device. Even for the same subject, data of different modalities may be used depending on the purpose of the treatment or the contents of the examination (for example, an image based on data of a CT device is used first, and an image based on data of an MR device is used as necessary). In such a case, it is also preferable in one embodiment that a medical image based on data of a first modality (for example, a CT device) and a medical image based on data of a second modality (for example, an MR device) can be replaced and / or superimposed (overlayed) so that a simulation can be performed consistently. The images may be replaced not only during one simulation operation, but also after the fact (for example, images may be replaced at a later date). Images of different modalities may be aligned automatically or manually. The replacement of image data as described above is useful in that it enables various simulations, but it does not necessarily involve replacing images of different modalities. For example, even if the medical images are based on image data from the same imaging device (e.g., a CT device), it may be possible to replace relatively low-resolution data (such as data captured with a thicker slice thickness for confirmation before the actual imaging) with high-resolution data.

[0082] (Capture function for device usage status) The medical image processing device 10 may have a function of capturing and storing the usage status of the device. This function is mainly for storing information on the fact that the medical image processing device 10 was actually used while performing treatment on a subject and / or the details of the treatment. In this way, a configuration in which information on the usage status of the device is stored makes it possible to use the information in determining medical fees, etc.

[0083] The information on the usage status may be stored inside the medical image processing apparatus 10 (in the data storage unit 12 or the like), or may be transmitted to the outside and stored in, for example, the medical information management apparatus 21 (see FIG. 1).

[0084] The information on the usage status may be, for example, at least one or a combination of subject identification information, date and time information (time) when the surgery was performed, time information of the surgery, time information of the device usage, screenshot images of the displayed three-dimensional images, screenshot images of the displayed two-dimensional images, doctor and other medical staff information, contrast agent injector information, contrast agent information, contrast protocol information, etc. The time and information related to time may be captured in a manner embedded in the screenshot images. Although not limited thereto, the screenshot images may be arbitrarily selected from only two-dimensional images, only three-dimensional images, or a combination thereof.

[0085] The timing of acquiring information regarding the usage status may be at a predetermined time interval or at a predetermined time, but may be the following timing. That is, when the medical image processing device 10 is being used (for example, when observing a three-dimensional image during surgery, etc.), if there is no input from the operator for a certain period of time or more, the device may be configured to automatically acquire and store or transmit to the outside predetermined information regarding the usage status. At this time, time stamp information associated with the information acquisition timing may be added. Specifically, the hash value of the target electronic information (image data as an example) and accurate time information issued by the time stamp authority may be added with an electronic signature of the time stamp authority. By adding such a time stamp, it is possible to confirm that the electronic information existed at that time (proof of existence), and also to later prove non-tampering.

[0086] (Timer function) The medical image processing device 10 may have a timer function for measuring the operation time. For example, in a liver cancer operation, a technique called the Pringle method may be used in which forceps or the like are used to temporarily block the blood flowing into the liver in order to suppress bleeding. In this case, it is important to accurately measure and manage the time during which the blood flow is blocked (or not blocked). Therefore, the medical image processing device 10 may be configured, for example, to display the time during which the blood flow is blocked using a timer, and to sound an alarm and / or display an alert when a predetermined specified time has elapsed. Similarly, the time during which the blood flow is not blocked may be displayed using a timer, and to sound an alarm and / or display an alert. In this way, a configuration in which the time during relaxation and / or blocking can be confirmed using a timer allows for safer treatment. Although not limited to this, the timer function during relaxation may be configured to display a first display color (e.g., green) and / or emit a first sound so that a safe state can be recognized, and on the other hand, during blocking, a display in a second display color (e.g., red) and / or emit a second sound (to inform of the blocking state) may be displayed. The timer function during blockage may further include an extension function, and may be configured to allow selection from preset values ​​such as 1 minute, 2 minutes, and 3 minutes, or to allow input of any extension time. The medical image processing device 10 may be configured to prohibit operation or reject operation during the time when blood circulation is blocked. By prohibiting operation while the timer during blood circulation is functioning, unintentional change or resetting of the timer is prevented, and accurate time measurement is performed.

[0087] (Various input methods) In a device such as a tablet terminal where input is mainly performed via a touch panel, it is desirable to provide an easy-to-operate and intuitive input. The medical image processing device 10 of this embodiment may have a function of displaying a pointer (cursor, arrow) at a predetermined position of a three-dimensional image, for example. In this case, an input method such as that shown in FIG. 14 may be used to display the cursor.

[0088] First, as shown in FIG. 14, two points (P1, P2) on the screen are selected. For example, the selection may be made by touching the two points with the thumb and index finger. The medical image processing apparatus 10 accepts the input of the two points (P1, P2) by the operator and specifies the coordinates of each point. Next, in one example, the operator slides the index finger from point P2 to point P2' while keeping the thumb at the position where it was initially touched. The medical image processing apparatus 10 may be configured to display a pointer 161 (see FIG. 15) using the input as a trigger when (i) two points P1 and P2 are selected and then (ii) one point is kept fixed and the other point is moved in a direction that increases the distance between the two points. In the pointer 161, the fixed point P1 is the tip side of the arrow, and the opposite point P2' is the rear end side of the arrow. For example, when such an input is made in image display area 101A and / or image display area 101B, an arrow 161 may be displayed, and this input method makes it possible to easily display the pointer by making the above input directly on the display screen, without the need to previously select a mode for displaying the arrow (such as by touching a dedicated icon, for example).

[0089] In the medical image-processing device 10, it is also preferable that, for example, a part of a three-dimensional image can be selected as a circular region. In this case, an input method as shown in Fig. 16 may be available for specifying the circular region.

[0090] First, as shown in FIG. 16(a), two points (P11, P12) on the screen are selected. For example, the selection may be made by touching the two points with the thumb and index finger. The medical image processing apparatus 10 accepts the input of the two points P11 and P12 by the operator and specifies the coordinates of each point. Next, the operator simultaneously slides the thumb and index finger around the point o in an arc shape like a compass. When such an input is detected, the medical image processing apparatus 10 may be configured to display a circle 198 with the point o as the center and the distance between P11 and P12 as the diameter, as shown in FIG. 16(b). According to such an input method, a circular area can be selected in only two steps: selecting the two points and rotating them.

[0091] Although the embodiment of the present invention has been described above with reference to the specific drawings, the present invention is not limited to the above specific configuration and can be modified as appropriate without departing from the spirit of the invention. Different technical features can also be combined as appropriate. For example, the content disclosed as an invention of a product can be understood as an invention of a method, a program, or a program medium.

[0092] (Additional Note) This application discloses the following: The reference symbols in parentheses are provided for reference purposes only and are not intended to limit the present invention to the specific embodiments. A1. A medical image processing device (10) including a display control unit (11) for controlling the display of a three-dimensional image (300) representing an anatomical structure of a subject, The display control unit (11) a1: a process for generating an image including a graphical user interface (140) for defining a display range of the three-dimensional image (300), the graphical user interface (140) comprising: a first slider (145a) for defining a cutting reference plane (e.g., 305a) on one side of the three-dimensional image along a given reference axis (e.g., x-axis) in three-dimensional space; a second slider (145b) for defining a cutting reference plane (e.g., 300b) on the other side of the three-dimensional image along the predetermined reference axis (e.g., the x-axis); An image generation process comprising: a2: a process of displaying the three-dimensional image (300) existing between the cutting reference planes; 13. A medical image processing device configured to:

[0093] 1. A method for controlling a medical image processing device that displays a three-dimensional image representing an anatomical structure of a subject, comprising: a1: generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising: a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space; a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis; a generating step, a2: displaying the three-dimensional image existing between the cutting reference planes; A method for controlling a medical image processing device, comprising:

[0094] 1. A medical image processing program for displaying a three-dimensional image representative of an anatomical structure of a subject, comprising: a1: generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising: a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space; a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis; a generating step, a2: displaying the three-dimensional image existing between the cutting reference planes; A medical image processing program that performs the following:

[0095] B1. A medical image processing device (10) including a display control unit (11) for controlling the display of a three-dimensional image (300) representing an anatomical structure of a subject, The display control unit (11) b1: A process of generating an image including a two-dimensional image (200) which is a tomographic image obtained by imaging a subject and the three-dimensional image (300); b2: A process of detecting a predetermined position (p) in the two-dimensional image specified by an operator; b3: a process of displaying a 3D pointer at a position (P) in the three-dimensional image corresponding to the predetermined position (p), the 3D pointer being displayed in association with a predetermined object in the three-dimensional image; b4: when an input for moving the 3D pointer is received from an operator, a process of moving the 3D pointer along the predetermined object; A medical image processing device configured to perform the following:

[0096] C1. A medical image processing device (10) including a display control unit (11) for controlling the display of a three-dimensional image (300) representing an anatomical structure of a subject, The display control unit (11) c1: A process of identifying that a predetermined object (e.g., a tumor) has been selected in the three-dimensional image; c2: A process of displaying a three-dimensional margin sphere (378) surrounding the selected object; and c3: displaying a graphical user interface (150) for setting the size of the margin sphere (378), the graphical user interface including a slider (156) whose position corresponds to the size of the margin sphere (378) and a size indicator (159) indicating the size of the margin body determined based on the position of the slider; A medical image processing device configured to perform the following:

[0097] D1. A medical image processing device (10) comprising a control unit (11) for controlling the display of medical images (200, 300) representing an anatomical structure of a subject, The control unit (11) d1: A process of determining whether or not there has been no input from an operator for a certain period of time while the medical image is being displayed, the medical image being assumed to be used during surgery; d2: A process of capturing the screen of the medical image displayed at that time and acquiring the image data when the input is not received for a certain period of time; d3: A process of storing the image data in a predetermined data storage unit or transmitting the image data to an outside of the device; A medical image processing device configured to perform the following: [Explanation of symbols]

[0098] 1 Medical image processing system 10 Medical image processing device 11 Image display control unit 12 Data storage section 13 Display Devices 14 Input Devices 15 Data Input / Output Interface 21 Medical information management device 22 Chemical injection device 23 Imaging device 100 display screens 101A, 101B Image display area 102 Dividing Line 111~116 Icon 140 Graphical User Interface 145a, 145b Slider 150 Graphical User Interface 156 Slider 157 Preset value display section 159 Size Indicator 161 3D Pointer 170 Graphical User Interface 171 Virtual Probe 173 Circular Orbit 174 Highlighting 177 Slider 190a~190c Probe 195a-195c Expected necrotic area 198 Circle (Circular Area) 200 2D images 220 Ultrasound Diagnostic Imaging 300 3D images 303, 303′, 305 Objects 305a, 305b end face 310 Cut surface 365 Tumors 377 Circumscribed sphere 378 Margin Ball p, P position

Claims

1. A medical image processing device including a display control unit that controls display of a three-dimensional image representing an anatomical structure of a subject, The display control unit is a1: A process for generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising: a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space; a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis; An image generation process comprising: a2: a process of displaying the three-dimensional image existing between the cutting reference planes; 13. A medical image processing device configured to:

2. the first and second sliders are independently movable; and When a predetermined input is performed, the first and second sliders can be moved simultaneously while maintaining the distance between the sliders. The medical image processing device according to claim 1 .

3. The medical image processing apparatus according to claim 2 , wherein the predetermined input is to select a part of an area between the first slider and the second slider and move the part in a predetermined direction.

4. The medical image processing apparatus according to any one of claims 1 to 3, wherein the graphical user interface is displayed in a display area for displaying a three-dimensional image.

5. A cross-section of the three-dimensional image is displayed on the cutting reference plane on one side, and / or Another cross section of the three-dimensional image is displayed on the other side of the cutting reference plane. The medical image processing device according to any one of claims 1 to 4.

6. With the display range specified, The three-dimensional image is displayed in at least one of a rotatable, movable, and scalable manner. The medical image processing device according to any one of claims 1 to 5.

7. 1. A method for controlling a medical image processing device that displays a three-dimensional image representing an anatomical structure of a subject, comprising: a1: generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising: a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space; a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis; a generating step, a2: displaying the three-dimensional image existing between the cutting reference planes; A method for controlling a medical image processing device, comprising:

8. 1. A medical image processing program for displaying a three-dimensional image representative of an anatomical structure of a subject, comprising: a1: generating an image including a graphical user interface for defining a display range of the three-dimensional image, the graphical user interface comprising: a first slider for defining a cutting reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space; a second slider for identifying a cutting reference plane on the other side of the three-dimensional image along the predetermined reference axis; a generating step, a2: displaying the three-dimensional image existing between the cutting reference planes; A medical image processing program that performs the following:

Images