Medical image processing device, control method for medical image processing device, and medical image processing program

Abstract

The present invention provides a medical image processing device that enables easy handling of three-dimensional medical images and contributes to the reliable execution of surgical procedures. [Solution] The medical image processing device includes a display control unit that controls the display of a three-dimensional image 300 representing the anatomical structure of a subject. The display control unit is configured to perform the following processes: generate an image including a two-dimensional image 200, which is a tomographic image obtained by imaging a subject, and a three-dimensional image 300; detect a predetermined position p in the two-dimensional image 200 specified by the operator; display a 3D pointer 161 at a position P corresponding to the predetermined position p in the three-dimensional image 300, linked to a predetermined object in the three-dimensional image 300; and, when the operator inputs to move the 3D pointer 161, move the 3D pointer 161 along the predetermined object.

Description

Technical Field

[0001] The present invention relates to a medical image processing apparatus that displays an anatomical structure of a subject as a two-dimensional or three-dimensional medical image, a control method for the medical image processing apparatus, and a medical image processing program. In particular, the present invention relates to a medical image processing apparatus, a control method for the medical image processing apparatus, and a medical image processing program that can handle three-dimensional medical images with good operability and contribute to the implementation of highly reliable surgeries.

Background Art

[0002] Conventionally, medical images have been generated based on tomographic image data obtained by an imaging apparatus such as a CT apparatus, and diagnosis and treatment have been performed using the medical images. Medical images are used, for example, to confirm the presence or absence of lesions, perform preoperative simulations, and perform intraoperative navigation. As medical images, not only two-dimensional images but also three-dimensional images (three-dimensional models) that represent anatomical structures three-dimensionally have come to be used. Note that the tomographic image data acquired by the imaging apparatus is data of a plurality of slice images, that is, two-dimensional image data, while the three-dimensional image is obtained by creating volume data from the two-dimensional image data.

[0003] For example, Patent Document 1 discloses a medical image display apparatus that can display a two-dimensional image and a three-dimensional image on the same display device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] While the devices described in the above literature allow for good confirmation of lesions and simulations while observing both two-dimensional and three-dimensional images, for this type of device, which is intended for use immediately before or during surgery, it is desirable from the perspective of reliable surgical execution that medical images can be handled with greater ease of use.

[0006] Therefore, the object of the present invention is to provide a medical image processing apparatus, a medical image processing method, and a medical image processing program that can handle three-dimensional medical images with good operability and contribute to the reliable execution of surgery. [Means for solving the problem]

[0007] To achieve the above objective, an invention according to one embodiment of the present invention is as follows: A medical image processing device comprising a display control unit that controls the display of a three-dimensional image representing the anatomical structure of a subject, The above-mentioned display control unit is A process for generating an image that includes a graphical user interface for defining the display range of the above three-dimensional image, wherein the graphical user interface is A first slider for defining a cross-sectional reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space, A second slider for identifying the cross-sectional reference plane on the other side of the three-dimensional image along the predetermined reference axis, This includes image generation processing, A process to display the three-dimensional image that exists between the above-mentioned cross-sectional reference planes, A medical image processing device configured to perform the following actions.

[0008] (Definition of terms) A "two-dimensional image" (in the context of medical imaging) refers to a cross-sectional image of a subject, such as an image represented by varying shades of gray according to the magnitude of the CT value. A "three-dimensional image" refers to a three-dimensional model that represents an anatomical structure in three dimensions. For example, a three-dimensional image is composed of multiple layers, each set for a specific anatomical structure. In addition to coordinate information, it contains multiple layer information indicating these layers, and different hue information for each layer (each anatomical structure). This information may, for example, be information inherited from each voxel in a volume dataset when creating a three-dimensional image from that volume dataset. In a three-dimensional image, anatomical structures may be displayed in different colors for each layer. "Anatomical structures" refer to recognizable objects within a subject (e.g., organs, bones, blood vessels, etc.), and also include fat, tumors, and other lesions. Furthermore, even if an anatomical structure as a whole is a single structure, if it can be divided into multiple units or has separate functions, it may be treated as multiple anatomical structures. For example, the lungs can be treated as separate anatomical structures in their upper, middle, and lower lobes, and blood vessels can be treated as separate anatomical structures in their arterial and venous systems. Regarding the term "select," for example, when it is stated that "the operator selects an icon," the means of selecting the icon are not particularly limited and include all methods such as the operator touching (tapping) the icon via a touch panel, selecting the icon with a cursor using a mouse, or selecting the icon using gesture input. A "control unit" is, in one form, a unit that has a CPU and memory, etc., and performs arithmetic processing, and may also be called a "controller," "processor," "controller unit (control unit)," "controller circuit (control circuit)," "controller module (control module)," "processor section," "arithmetic section," "processor unit," "processor module," etc. A "control unit" can consist of a microcomputer, microcontroller, programmable logic controller, integrated circuit for a specific application, and other programmable circuits. In this specification, a "control unit" may be a single physical configuration, or two or more control units may functionally cooperate to constitute a single "control unit." In image display, "semi-transparent" refers to a display method for anatomical structures in three-dimensional images, where the transparency is set so that other hidden anatomical structures can be seen. It also includes displays where the anatomical structure being displayed is almost invisible.

[0009] (General description of medical image processing equipment) A medical image processing device, as an example, includes an input device for receiving input from an operator, one or more control units (processor units) for performing predetermined data processing based on the input, and a display device for displaying medical images, and displays two-dimensional and three-dimensional images. A device that does not have a display device and only performs image generation, etc., is also included in the medical image processing device of the present invention. At least one of the following are examples of display functions that a medical image processing device may have: • Movement, rotation, enlargement / reduction, etc., of medical images, changes in cross-sectional position, etc. • Color-coded representation of specific anatomical structures, display in a translucent state, etc. Display of corresponding positions in two-dimensional and three-dimensional images, etc. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a medical image processing apparatus, a medical image processing method, and a medical image processing program that can handle three-dimensional medical images with good operability and contribute to the implementation of highly reliable surgeries.

Brief Description of the Drawings

[0011] [Figure 1] It is a block diagram of a medical image processing apparatus according to an embodiment of the present invention. [Figure 2] It is a diagram showing an example of an image displayed on the medical image processing apparatus. [Figure 3] It is a diagram showing an example of a display image (in a state where a cutting plane is displayed together with a three-dimensional image). [Figure 4] It is a diagram showing an example of a graphical user interface for the flat cut function. [Figure 5] It is a diagram showing an example of a graphical user interface for the flat cut function (in a state where the three-dimensional image is partially cut). [Figure 6] It is a diagram for explaining the function of the user interface in FIG. 4. [Figure 7] It is a diagram for explaining the 3D pointer displayed for the three-dimensional image. [Figure 8] It is a diagram showing the operation method of the 3D pointer. [Figure 9] It is a diagram for explaining the virtual probe function. [Figure 10] It is a diagram for explaining the margin sphere. [Figure 11] It is a diagram showing an example of a user interface for changing the size of the margin sphere. [Figure 12] It is a diagram showing an example of a user interface for changing the transparency of an object. [Figure 13] ] It is a diagram for explaining the coagulation range simulation function. [Figure 14] It is a diagram showing an example of an input method for displaying a pointer. [Figure 15]This figure shows the pointer displayed using the input method shown in Figure 14. [Figure 16] This figure shows an example of an input method for specifying a circular area. [Modes for carrying out the invention]

[0012] Several embodiments of the present invention will be described below with reference to the drawings. It should be noted that the specific equipment configurations and methods described below relate only to one embodiment of the present invention, and the present invention is not necessarily limited thereto.

[0013] As shown in Figure 1, the medical image processing system 1 in this example comprises an image display control unit 11, a data storage unit 12, a display device 13, and an input device 14. The medical image processing system 1 may further include a data input / output interface 15, a medical information management device 21, a drug injection device 22, and an imaging device 23. The medical image processing system 1 is configured to simultaneously display a three-dimensional image and a second image, which is another type of image associated with the three-dimensional image, on the display device 13. In the following description, the case where the second image is a two-dimensional image will be used as an example.

[0014] The display device 13 may be any display capable of displaying images created by the image display control unit 11, such as a liquid crystal display or an organic EL display. There may be one or more display devices 13.

[0015] The input device 14 may be any device that can accept input operations from the operator and input data to the image display control unit 11, such as a keyboard or mouse. Alternatively, a touch panel combining a display and a touchscreen can be used as the display device 13 and input device 14. The input device 14 can also be a contactless input unit that allows for contactless input. Contactless input units can be divided into those that utilize gesture recognition technology and those that utilize voice recognition technology. An example of a contactless input unit that utilizes gesture recognition technology is the "Leap Sensor" (manufactured by Leap Motion). The "Leap Sensor" is an input device that can recognize the movements of the operator's fingers etc. without contact, and has an infrared irradiator and an infrared camera etc. When infrared light emitted from the infrared irradiator hits the operator's hand, the reflected light is captured by the infrared camera and image analysis is performed to detect the position, movement and shape of the operator's hand and fingers in three-dimensional space in real time. Another example of a contactless input unit that utilizes gesture recognition technology is "RealSense" (manufactured by Intel). "RealSense" is a modular system that integrates a 3D camera composed of an RGB camera and an infrared camera, an infrared sensor, and other components. In addition to color information, it can acquire depth information and recognize the movements of the operator's fingers in three dimensions. In this configuration, both the Leap sensor and RealSense can be used. In either case, the operator's actions for input can be the same as those on a touch panel (e.g., tap, double tap, swipe, flick, pinch in, pinch out), as well as movements in the depth direction. When performing actual input operations, a transparent flat plate made of acrylic resin or the like can be placed at an appropriate position, and the input operation can be performed using this plate as a reference surface to prevent misrecognition due to positional deviations in the depth direction.

[0016] An example of a contactless input unit utilizing voice recognition technology is a voice recognition unit. The voice recognition unit may include a microphone that acquires voice generated by the operator, and a voice recognition device that recognizes the voice acquired by the microphone and converts it into an operation signal. The voice recognition device can be installed in any location, but the microphone is preferably installed near the operator.

[0017] The data storage unit 12 stores at least one dataset capable of creating a three-dimensional image representing the three-dimensional arrangement of multiple anatomical structures. The data storage unit 12 may include at least one of the following: an HDD (Hard Disk Drive), an SSD (Solid State Drive), and various types of memory. In addition to these two-dimensional and three-dimensional image data, the data storage unit 12 may also store at least one program, table, database, etc., necessary for processing performed by the image display control unit 11. The dataset stored in the data storage unit 12 can be acquired from the medical information management device 21 through the data input / output interface 15. The data input / output interface 15 may be wirelessly connected to the medical information management device 21 or connected via a wired connection.

[0018] Examples of medical information management devices 21 include PACS (Picture Archiving and Communication Systems), RIS (Radiology Information System), and HIS (Hospital Information System). The medical information management device 21 manages the data of medical images of the patient, which are captured by the imaging device 23 after a drug solution (e.g., contrast agent) is injected by the drug solution injection device 22. The drug solution injection device 22 may be any injection device that injects a drug solution, such as a contrast agent, filled in a syringe or drug solution bag, into the patient according to pre-set injection conditions.

[0019] The imaging device 23 may be any device capable of acquiring medical images composed of image data, such as a CT (Computed Tomography) device, an MRI (Maganetic Resonance Imaging) device, angiography device, a PET (Positoron Emission Tomography) device, or an ultrasound diagnostic device. The dataset stored in the data storage unit 12 can also be acquired from the imaging device 23.

[0020] Regarding the datasets stored in the data storage unit 12, an example of a dataset is a volume dataset of multiple anatomical structures. A volume dataset is obtained by arranging multiple (e.g., 300) slice image data, which are continuously captured by the imaging device 23 on a subject in a specific direction (e.g., axial direction, left-right direction, anterior-posterior direction, or a direction tilted to at least one of these directions) at regular intervals (e.g., 1 mm intervals), in the axial direction. The dataset stored in the data storage unit 12 may also be raw data acquired directly or indirectly from the imaging device 23. In this case, it is preferable that the image display processing unit 11 is configured to reconstruct the raw data stored in the data storage unit 12 to obtain an arbitrary image. The volume dataset consists of multiple voxels, and multiple anatomical structures are extracted by predetermined processing based on the voxel value of each voxel. Transmittance and hue are then set for each extracted anatomical structure for each voxel. Therefore, each voxel contains coordinate information, transmittance information, and hue information. In this way, anatomical structures are extracted, and a three-dimensional image is created by rendering a volume dataset in which transparency and hue are set for each anatomical structure. Rendering methods include volume rendering (VR) and maximum projection (MIP). The processes for extracting anatomical structures, setting transparency and hue for each voxel, and rendering, as well as other processes for creating a three-dimensional image from a volume dataset, may be well-known processes, so detailed explanations of these are omitted here. Furthermore, the extraction of anatomical structures and the setting of transparency and hue in the volume dataset may be performed by the image display control unit 11, or a volume dataset in which anatomical structures have been extracted and transparency and hue have been set may be stored in the data storage unit 12 or the like beforehand.

[0021] A volume dataset, in which transmittance and hue are set for each anatomical structure, is divided into multiple layers for each anatomical structure, and each voxel may contain layer information. In this case, the volume dataset may be stored in the data storage unit 12, etc., as a single data file containing the layer information for each anatomical structure, or it may be stored in the data storage unit 12, etc., as multiple data files separated by each layer information. The operator may be able to arbitrarily select which form the volume dataset is stored in when the volume dataset is stored.

[0022] Furthermore, it is possible to create a two-dimensional image by cutting out a volume dataset in an arbitrary plane and reconstructing it. This process is called arbitrary cross-sectional reconstruction (MPR). Two-dimensional images used in the medical field basically include axial cross-sections perpendicular to the subject's body axis, sagittal cross-sections perpendicular to the subject's left-right direction, and coronal cross-sections perpendicular to the subject's front-to-back direction. These two-dimensional images can be created using two-dimensional image data at a desired cross-sectional position, created from a volume dataset. The creation of two-dimensional image data may be performed by the image display control unit 11 using a volume dataset stored in the data storage unit 12, etc. Alternatively, multiple two-dimensional image data sets (two-dimensional image datasets) created in advance using a volume dataset may be stored in the data storage unit 12, etc., along with the original volume dataset. In either case, when two-dimensional image data is created from volume data, the coordinate information of each voxel in the volume data is carried over to the two-dimensional image data, and therefore, three-dimensional images and two-dimensional images based on common volume data have common coordinate data. In addition, interpolation processing of the two-dimensional image data may be performed when displaying the two-dimensional image. For example, when a two-dimensional image dataset of multiple cross-sections, such as the axial, sagittal, and coronal sections described above, is stored in the data storage unit 12, the two-dimensional image dataset may be stored in the data storage unit 12 as a single data file containing multiple two-dimensional image data for all cross-sections, or it may be stored in the data storage unit 12 as multiple data files, each containing multiple two-dimensional image data for each cross-section.

[0023] Regarding the configuration of Figure 1, the medical image processing device indicated by reference numeral 10 may be configured such that an image display control unit 11, a data storage unit 12, a display device 13, an input device 14, and a data input / output interface 15 are housed in a single enclosure. The medical image processing device 10 may be a portable terminal such as a tablet terminal or a notebook personal computer with a touch panel display. However, the present invention is not limited to this, and the medical image processing terminal 10 may be configured as a workstation in which the display device 13 and the input device 14 are configured as separate units from the image display control unit 11.

[0024] The image display control unit 11 can be configured as a computer unit equipped with a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), and performs various processes to control the display of images on the display device 13 according to the input received by the input device 14. The processes performed by the image display control unit 11 may be implemented by a computer program or by hardware using logic circuits. When the processes performed by the image display control unit 11 are implemented by a computer program, the computer program may be stored in a data storage unit 12 or the like, as described above. The computer program stored in the data storage unit 12 is executed by being loaded into the RAM of the image display control unit 11, and various processes are performed in cooperation with hardware such as the CPU.

[0025] Computer programs may be stored on a computer-readable recording medium. The recording medium storing the computer program may be a non-transient recording medium. Non-transient recording media are not particularly limited and may include, for example, memory cards, CD-ROMs, etc. Computer programs stored on the recording medium may be stored in a computer unit via an appropriate reader. An appropriate reader may be, for example, a card reader if the recording medium is a memory card, or a CD drive if the recording medium is a CD-ROM. Alternatively, computer programs may be downloaded to the computer unit from an external server via a communication network.

[0026] The image display control unit 11 (see Figure 1) may conceptually include an input determination unit, a display processing unit, and a user interface unit in order to perform various processes that control the display of the image.

[0027] The input determination unit determines what processing to perform on the image displayed on the display device 13 based on the input received by the input device 14, the type of input device 14 that received the input, and changes in the input signal. The display processing unit mainly performs processing on the display area of ​​the display device 13 and processing on the display of the image within the display area.

[0028] To briefly explain these processes using the example of a case where a volume dataset is stored in the data storage unit 12, the display processing unit generates specific medical images as shown in Figure 2 and displays them on the display device. The user interface unit is responsible for generating and / or displaying various user interface images, including image buttons (icons) for input operations from the operator.

[0029] In the image display process within the display area, as will be described in detail later, a three-dimensional image created from a volume dataset stored in the data storage unit 12 is displayed, and at the same time, a two-dimensional image corresponding to a position identified in the three-dimensional image is created from the volume dataset stored in the data storage unit 12 and displayed.

[0030] [Specific examples of displayed images] One embodiment of this display screen may be as shown in Figure 2. In this example, the display image 100 includes two areas: a three-dimensional image display area 101A and a two-dimensional image display area 101B (hereinafter, these will not be distinguished and will simply be referred to as "image display area (101A, 101B)"). In the following, an example in which various icons, etc., are operated via a touch panel will be described, but it is naturally not limited to this. Also, for the sake of explanation, reference numerals may be omitted in the description.

[0031] The image display areas 101A and 101B may be displayed side by side, for example, in a horizontal direction, or they may be separated by a dividing line 102, as shown in Figure 2. This dividing line 102 is, for example, provided to be movable in the left-right direction, and the size of each image display area 101A and 101B can be changed by moving it left or right. To make it easy for the operator to intuitively understand that the dividing line 102 is movable, an operable area 102a may be provided on a part of the dividing line 102. By touching the vicinity of this operable area 102a with a finger and moving it left or right, the dividing line 102 moves left or right.

[0032] In the example in Figure 2, a model including a liver object 305 and a blood vessel object 303 is displayed in the image display area 101A as a three-dimensional image 300.

[0033] The image display area 101A also displays various icons 111 to 116 for operating the display of the three-dimensional image 300. Icon 111 is a menu icon for calling up various functions, and icon 112 is for changing the display of the three-dimensional image to a predetermined orientation that has been set in advance. Icon 113 is for taking a screenshot of the displayed image and saving it, and icon 114 is for displaying the saved image. Icon 115 is a flat cut icon for changing and adjusting the display range of the three-dimensional image (details will be described later). Icon 116 is for changing the display resolution of the three-dimensional image, and in this example, it is possible to switch between 512×512×512 pixels and 1024×1024×1024 pixels. The same icons may also be displayed in the image display area 101B, and in this embodiment, icons with the same function are represented by the same reference numeral (see Figure 2). Note that icons 115 and 116 are functions that only apply to three-dimensional images here, and are therefore not displayed in the image display area 101B.

[0034] [Various functions in medical image processing equipment] The medical image processing device 10 has various functions related to the display of medical images. Some of these functions will be described below. In the following description, image processing is implemented, for example, by the functions of the image display control unit 11 shown in Figure 1.

[0035] (a) Rotating, resizing, and changing the display of images, etc. In the medical image processing device 10, the three-dimensional image 300 can be rotated in any direction, enlarged or reduced, and its display can be changed by predetermined input operations performed by the operator. These display changes may be performed using, for example, input operations on a touch panel. Specifically, display changes include rotating the three-dimensional image 300 according to the swipe direction using a swipe operation, and reducing or enlarging the three-dimensional image 300 using pinch-in and pinch-out operations. Similarly, the two-dimensional image 200 can also be modified in the same way as the three-dimensional image 300, such as changing the cross-sectional position and enlarging or reducing its display. Note that the functions for manipulating the two-dimensional image and the functions for manipulating the three-dimensional image may be the same.

[0036] (b) Display the cross-sectional position of the two-dimensional image on the three-dimensional image. The two-dimensional image 200 and the three-dimensional image 300 each have corresponding coordinate information in the axial, left-right, and front-back directions of the subject's body. Therefore, using this coordinate information, it is possible to display the cross-sectional position corresponding to the current display of the two-dimensional image 200 on the three-dimensional image 300. The position of the two-dimensional image 200 in the axial direction can be changed, and the input method for doing so is not particularly limited, but for example, by moving the scroll indicator (not shown) displayed within the display area 100B, the tomographic image at the axial position corresponding to that position will be displayed.

[0037] A more specific display configuration in this embodiment may be as follows: That is, as shown in Figure 3, a cross-section 310 corresponding to the current position of the tomographic image in the two-dimensional image 200 may be displayed together with the three-dimensional image 300. Displaying such a cross-section 310 makes it easy to visually understand which position in the three-dimensional image corresponds to the current tomographic image. Specifically, a configuration may be used in which a predetermined position p(x, y, z) in the two-dimensional image 200 and a predetermined position P(x, y, z) in the corresponding three-dimensional image 300 are displayed. Regarding the display of such positions p, auxiliary lines (not shown) or the like may be displayed as needed to make the position easier to understand.

[0038] (c) Other functions related to image display Regarding the functions that can be accessed from the menu button icon 111 (see Figure 2), when the menu button icon 111 is selected, a group of function call icons (not shown) may be displayed, and the operator may select a desired icon from among them to select the corresponding function. Examples of such functions may include the following:

[0039] The medical image processing device 10 may have a revert function. The orientation and size of the three-dimensional image 300 can be arbitrarily changed, and the position and size of the cross-sectional area of ​​the two-dimensional image can be arbitrarily changed. The revert function is a function that initializes the display of the three-dimensional image and / or the two-dimensional image. Initializing the display means displaying the initial image in the image display areas 101A and 101B.

[0040] The medical image processing device 10 may have a clipping function. The clipping function, as an example, is a function that cuts out and displays an arbitrary part of a three-dimensional image. While detailed illustrations are omitted here, a specific example is a configuration in which clipping is performed when an icon labeled "BBox" is selected. Specifically, in the clipping function, a part of the three-dimensional image is selected while surrounded by a hexahedron. The hexahedron is displayed semi-transparently so that the operator can see the anatomical structures located inside it. In this state, clipping is performed as follows: When one face of the hexahedron to be clipped is selected, the selected face becomes active, and sliding this active face changes the shape of the hexahedron, changing the target range in the three-dimensional image. If an anatomical structure exists on the clipped face, the anatomical structure may be displayed in cross-section on the clipped face. Furthermore, if another face is tapped, that other face becomes active, and the three-dimensional image can be clipped on other faces in the same manner as described above.

[0041] The medical image processing device 10 may also have a perspective display function. Perspective display is one method of representing a sense of depth by representing a three-dimensional image using fluoroscopic projection. When the operator slides, for example, a field of view adjustment button (not shown) in a predetermined direction, the width of the field of view of the three-dimensional image is adjusted according to the amount of slide or the position of the slider. For example, when the field of view is widened, parts that are closer are displayed larger, and parts that are farther away are displayed smaller. By representing the three-dimensional image using fluoroscopic projection, it is possible to display an image similar to the image seen with an endoscope. Therefore, the perspective display function can be effectively used in endoscopic surgery, for example, by comparing the image acquired from the imaging device with the actual organ image obtained by the endoscope while performing the procedure.

[0042] Next, we will further describe some examples of graphical user interfaces and functions that make the operability of the medical image processing device 10 more preferable.

[0043] (Flat cut function) The medical image processing device 10 may also have a flat-cut function. A "flat-cut function" is a function that cuts a three-dimensional image using one or more reference planes for display. This function will be explained with reference to Figures 4 to 6.

[0044] The operation required to activate the flat cut function is not particularly limited, but for example, the function may be activated by selecting the flat cut icon 115 displayed on the screen, as shown in Figure 4. This icon 115 may be displayed within the image display area 101A.

[0045] Selecting icon 115 displays the graphical user interface 140. This graphical user interface 140 includes a first slider 145a and a second slider 145b, each independently movable. Each slider moves along a guideline 145c. The direction of movement of sliders 145a and 145b can be any direction, but in this example, they move in the vertical direction as shown. When each slider 145a and 145b is at the end of its range of motion (specifically, for example, when the sliders are furthest apart), the entire three-dimensional image is displayed without any cropping.

[0046] On the other hand, as shown in Figure 5, by changing the positions of sliders 145a and 145b, the displayed three-dimensional image is also displayed in a partially cropped state. Specifically, when the first slider 145a is slid slightly downward from the end of the movable range, a cutting reference plane (not shown) on one side along a predetermined reference axis of the three-dimensional image (in this example, the "x-axis") is set corresponding to that position. The three-dimensional image is displayed in a state where it is cut by that cutting reference plane. In this example, the liver object 305 is shown cut at the end face 305a. Similarly, with respect to the second slider 145b, when it is slid slightly from the end of the movable range, a cutting reference plane (not shown) on the opposite side is set corresponding to that position. Specifically, the liver object 305 is shown cut by this cutting reference plane, with the end face 305b displayed. In this embodiment, only the three-dimensional medical image within the region corresponding to the distance L1 between sliders 145a and 145b (the region corresponding to the distance L2 in Figure 5) is displayed, and the area outside of that region is not displayed.

[0047] Such a graphical user interface 140 allows users to narrow the display area of ​​the three-dimensional image or display its edge faces by moving the sliders 145a and 145b as needed, which has the advantage of allowing for a more detailed examination of the anatomical structure of the three-dimensional image.

[0048] In one embodiment, it is preferable that the three-dimensional image in the state shown in Figure 5 can be moved, rotated, and scaled while remaining in the state shown in the figure, so that it can be observed from multiple angles and examined by zooming in and out. With such a configuration, for example, the three-dimensional image can be rotated and displayed so that the end face 305a, which is facing the back in the illustration in Figure 5, is facing the front. It is also possible to enlarge and display the end face 305a.

[0049] As a graphical user interface 140, it is preferable in one form that the two sliders 145a and 145b can be moved simultaneously while maintaining the distance L1 between them. To enable simultaneous movement of the two sliders 145a and 145b, one possible method is to select a special icon to enter such a mode before moving the sliders. However, as an example, with the sliders 145a and 145b in predetermined positions as shown in Figure 6(a), the interface may be such that, as shown in Figure 6(b), the two sliders 145a and 145b can be moved together while maintaining the distance L1 by touching an arbitrary position in the area between the sliders 145a and 145b (for example, near the guideline 145c) and moving it up or down. The display area of ​​the three-dimensional image is also changed in real time in conjunction with the movement of the sliders 145a and 145b. With this configuration, it is possible to change the display area of ​​the three-dimensional image while maintaining the distance L1 that was initially determined by moving the individual sliders 145a and 145b, thus allowing for very simple fine-tuning of the display range.

[0050] (3D pointer function) The medical image processing device 10 may also have a 3D pointer function. A "3D pointer function" refers to a function that displays a three-dimensional pointer on a predetermined object in a three-dimensional image, and in particular, the pointer is designed to move along the surface of the object when moved. This function will be explained with reference to Figures 7 and 8.

[0051] In the display screen schematically shown in Figure 7, a two-dimensional image 200 and its corresponding three-dimensional image 300 are displayed, similar to Figure 2. For the sake of explanation, the three-dimensional image 300 is shown with only the blood vessel object 303' displayed. When the mode for displaying the 3D pointer is selected, if the operator specifies an arbitrary point p in the two-dimensional image 200, for example, a 3D pointer 161 will be displayed at the corresponding point P in the three-dimensional image 300. The shape and size of the 3D pointer 161 are not particularly limited; any shape that can clearly indicate a predetermined position in the three-dimensionally displayed image is acceptable. Other methods for displaying the pointer 161 will be described later, referring to other drawings.

[0052] The 3D pointer 161 displayed in the three-dimensional image 300 is at this point linked to one of several objects (in this case, the blood vessel object 303') and is displayed touching the object 303'. With such a 3D pointer 161, the following problems can be considered when moving the pointer. That is, when moving the 3D pointer 161 in three-dimensional space, the pointer can usually be moved in any direction, so it is conceivable that when the operator moves the pointer, the pointer may move away from the target object. Therefore, in this embodiment, when the 3D pointer 161 is moved, the 3D pointer 161 is configured to move along the surface of the target object 303' without moving away from it.

[0053] Various methods can be used to move the 3D pointer 161, but for example, the following is one possible method. In the following explanation, we will assume an example where the operator manipulates the pointer with their finger via a touch panel, but of course, the input format may be other. As shown in Figure 8, when the finger is moved while touching the first region 161a of the 3D pointer 161, the 3D pointer 161 rotates around the rotation center 161p, and its orientation changes. The first region 161a may include a part of the base end of the pointer 161. On the other hand, when the finger is moved while touching the second region 161b of the 3D pointer 161, the entire pointer 161 can be moved in any direction (while maintaining the pointer's orientation). The second region 161b may include a part of the tip end of the pointer. Through these operations, the orientation and position of the 3D pointer 161 can be freely changed.

[0054] The 3D pointer 161 is displayed in three-dimensional space (image display area 101A). Therefore, it is preferable that it can be moved with good operability not only in the up, down, left, and right directions, but also in the depth direction (for example). Although not particularly limited, for example, the 3D pointer 161 may be moved by the simultaneous movement of multiple fingers (three or four fingers) (for example, up or down, or right or left). From another perspective, the 3D pointer 161 itself may be displayed as multiple images with parallax, allowing for stereoscopic viewing within the display screen.

[0055] (Virtual probe function) The medical image processing device 10 may also have a virtual probe function. The "virtual probe function" involves placing a virtual probe on a three-dimensional image and displaying a virtual image captured by that virtual probe on the screen. This function will be explained with reference to Figure 9.

[0056] In Figure 9, a predetermined three-dimensional image (an object 305 of the liver, for example) is displayed in the image display area 101A. A virtual probe 171 is displayed in contact with or in close proximity to this object 305. This probe 171 represents, for example, an ultrasound probe of an ultrasound diagnostic device. The shape of the probe 171 may be linear, convex, sector, single, etc., and it may be either a probe for two-dimensional images or a probe for three-dimensional images.

[0057] The image to be captured by the imaging device including the probe 171 is displayed in the display area 101B. Here, the ultrasound diagnostic image 220 is displayed in the display area 101B. This configuration, in which a virtual ultrasound diagnostic image 220 is displayed for a predetermined three-dimensional image, has the advantage of allowing confirmation of the shape and arrangement of anatomical structures within the target object without actually performing imaging on the patient.

[0058] Furthermore, it is desirable that the virtual probe 171 in Figure 9 also has good operability. For example, when the first region 171a on the handle side of the probe 171 is touched and moved, the probe 171 may change its orientation (tilt) with respect to a predetermined pivot point. Also, when the second region 171b on the tip side of the probe 171 is touched and moved, the entire probe 171 may be moved.

[0059] Regarding the movement of the virtual probe 171, similar to the 3D pointer 161 described above, the probe 171 may be moved along the surface of the target three-dimensional image.

[0060] (Margin sphere adjustment user interface) The medical image processing device 10 may have a user interface for adjusting margin spheres. A "margin sphere" is a sphere or polyhedron that surrounds a predetermined object in a three-dimensional image (for example, a tumor object). This margin sphere is used, for example, to confirm how much margin to leave around the target tumor during tumor resection. A "margin sphere adjustment user interface" is a user interface for easily changing the size of the margin sphere. This function will be explained with reference to Figures 10 and 11.

[0061] First, let's explain the margin sphere. In this embodiment, the medical image processing device 10 displays the smallest circumscribing sphere 377 surrounding the tumor 365 in the three-dimensional image, as shown in Figure 10(a), when a predetermined input is received from the operator. The "predetermined input" is not particularly limited and may include selecting an icon displayed on the screen, voice input, or gesture input from a position away from the screen. Then, as shown in Figure 10(b), a larger margin sphere 378 is displayed, which is the circumscribing sphere 377 with a predetermined margin (for example, 1 mm, 2 mm, 3 mm, 4 mm, 5 mm, 10 mm, 15 mm, etc.) added to it. This margin sphere 378 is, for example, a sphere concentric with the circumscribing sphere 377. The margin sphere 378 may be displayed with a transparent color so that its interior can be seen. Note that only the margin sphere 378 may be displayed and the circumscribing sphere 377 may be hidden.

[0062] Since the appropriate margin value varies depending on the tumor removal procedure and the target organ, it is preferable that the system be configured to allow the operator to set the desired value. For example, this value may be input and / or changed by entering a numerical value and / or by operating a user interface on the screen. A specific example of a user interface will be described later with reference to Figure 11.

[0063] Furthermore, as shown in Figure 10(b), if the margin sphere 378 is in contact with, for example, a nearby major blood vessel 353b, the medical image processing device 10 may be configured to display a warning to that effect and / or to highlight the portion of the blood vessel. The blood vessel 353b may be highlighted only in the portion that the margin sphere 378 is in contact with (including its vicinity), or the entire blood vessel 353b from its origin to its tip may be highlighted. Such a configuration is advantageous because it allows for prior confirmation of which blood vessels need to be resected when removing the tumor 365 (parts of the blood vessel 353 indicated by reference numeral 353a, etc., do not need to be resected).

[0064] Furthermore, as shown in the example in Figure 10(b), if the margin sphere 378 is in contact with some anatomical structure, the mask of the anatomical structure contained within the margin sphere 378 (which may be a parenchymal organ such as the liver, for example) may be automatically separated, or the volume contained within may be calculated and displayed as needed. Regarding the volume, there may be no single margin sphere, and the sum of the volumes contained within each of multiple margin spheres may be calculated.

[0065] A user interface 150, as shown in Figure 11, may be used to change the size of the margin sphere 378. This user interface 150 includes a slider 156 for setting the margin length. In this example, the slider 156 can be slid within a range of approximately 0 mm to 20 mm (one example) and is configured to move along the horizontal axis. Note that the numerical value on the horizontal axis indicates the margin length, but such a display is not mandatory.

[0066] When slider 156 is at the "0" position, the margin length is 0, and in the example above, only the circumscribing sphere 377 is displayed. By moving slider 156, a value corresponding to the slider position is set as the margin length. The size of the margin sphere 378 in the three-dimensional image may also be changed in real time. With such a graphical user interface 150, the size of the margin sphere 378 can be changed very intuitively and instantly, and the relationship between the tumor 365 and the margin sphere 378 can also be confirmed in the three-dimensional image, thus contributing to the performance of highly accurate surgery.

[0067] The user interface 150 may display information representing the margin length as a large number within the display area 151. Specifically, in the illustrated example, the number "10" may be displayed within the display area 151. With such a configuration, the operator can be provided with easily visible information on specific setting values.

[0068] Furthermore, the user interface 150 may include multiple concentric arc-shaped size indicators 159 that connect the values ​​on the vertical axis and the values ​​on the horizontal axis. Also, to make it easier to visually grasp the current setting value, only the indicator 159 that represents the current margin length corresponding to the position of the slider 156 may be highlighted among the multiple size indicators 159. For example, in this example, the indicators 159 in the range from "0" to "10" are displayed thicker than the others.

[0069] The user interface 150 may be configured so that a predetermined numerical value is entered by selecting a preset value, rather than by numerical input via the slider 156. In the example in Figure 11, the vertical axis displays preset values ​​such as "0" mm, "10" mm, and "20" mm (one example) in the preset value display section 157. Selecting any of these may set the corresponding margin length. Of course, the above numerical values ​​and number of presets are merely examples and can be changed as appropriate.

[0070] As an embodiment of the user interface 150, the slider 156 may move continuously along the horizontal axis, or it may move in steps corresponding to discrete values ​​such as "1", "2", "3", "4", and "5" mm. The user interface 150 in Figure 11 can be displayed at any position on the display screen, but as an example, it may be displayed within the display area 101A.

[0071] (User interface for changing transparency) The medical image processing device 10 may have a transparency changing user interface for changing the transparency of objects. "Object transparency" refers to the transparency of individual objects of anatomical structures included in a three-dimensional image. By making the object transparency adjustable, it becomes possible, for example, to display objects that are closer to the operator as semi-transparent while observing other objects in the background. The user interface will be described with reference to Figure 12.

[0072] As shown in Figure 12, the user interface 170 includes a slider 177 that slides along a circular orbit 173, and the transparency of an object is changed by the operator moving this slider 177. The transparency range may be 0% to 100%, but is not limited to this range and may be any numerical range. The starting point 173a of the circular orbit 173 may correspond to 0%, and the ending point 173b may correspond to 100%. The circular orbit 173 may not be a closed circle, but may extend over a range where the central angle of the sector is 180° or more and less than 360°, more specifically 270° or more and less than 360° (one example). However, it may also be a completely closed circular orbit, and the slider 177 may be able to rotate more than 360°. To make it easier to identify the current transparency, the area from the starting point 173a to the position of the slider 177 may be highlighted 174.

[0073] The user interface 160 shown in Figure 12 allows for highly accurate changes to transparency even in a compact screen space for the following reasons. Specifically, a user interface for changing transparency could also employ a configuration (not shown) in which a slider moves linearly back and forth. However, in touch panel operation, linear slider movement requires the operator to move their hand up and down or left and right (for example), which requires relatively large motions. On the other hand, with the configuration shown in Figure 12, for example, the slider 177 can be moved a sufficient distance simply by touching and rotating it with the index finger without moving the hand significantly. In other words, there is no need to move the hand significantly, and finer input through finger movements is possible compared to linear movement, thus offering the technical advantage of easier fine-tuning of transparency.

[0074] The user interface 170 in Figure 12 can be displayed at any position on the display screen, but for example, it may be displayed within the display area 101A.

[0075] (Simulation function for the coagulation range in cauterization or cryotherapy) The medical image processing device 10 may also have a function to simulate the coagulation range in the target area of ​​the subject. The "coagulation range simulation function" is a function that simulates, for example, how much of the target area of ​​the subject will coagulate when cauterizing and excising it using an electrode needle (it can be applied not only to cauterization but also to cryotherapy). The case of cauterization will be explained as an example with reference to Figure 13.

[0076] One percutaneous local therapy for necrotizing tumors and surrounding tissues involves applying energy to the target area of ​​the patient via an electrode needle or probe, thereby cauterizing and coagulating the cell tissue. The extent to which the area is cauterized by the energy applied from the electrode needle depends on the shape of the electrode needle, the performance of the device, and other factors.

[0077] Figure 13 schematically illustrates the differences in coagulation range due to different electrode needles. Figure 13(a) shows probe 190a, which hypothetically represents a certain electrode needle, and shows that when this probe is used by puncturing the target area of ​​the subject, area 195a undergoes coagulation necrosis. Figure 13(b) shows probe 190b, which represents another electrode needle, and shows that when used, area 195b undergoes coagulation necrosis. Figure 13(c) shows probe 190c, which represents yet another electrode needle, and shows that area 195c undergoes coagulation necrosis.

[0078] Furthermore, the coagulation range can also be considered as a function of time. Therefore, the cauterization time of the probe can be simulated, or the display can be configured to gradually enlarge the region sphere in accordance with time. This method can be applied not only to cauterization but also to freezing. In this embodiment, the medical image processing device 10 has information on the coagulation characteristics of each probe, and may be configured to simulate the coagulation range when, for example, the probe is virtually inserted into a predetermined anatomical structure in a three-dimensional medical image and energy is applied.

[0079] Regarding probe puncture, for example, the system may have a simulation function for the route to be used when puncturing the probe (i.e., which route should be used for puncture, or which route should not be used for puncture). For example, if a predetermined anatomical structure to be avoided, such as a blood vessel, is present on the route to be punctured by the probe, the device may detect this and issue an alert (display a message, emit a warning sound, etc.), and / or the route may be automatically avoided. Although not limited to these, the alert may also be a highlighting display such as coloring or flashing of a predetermined object (e.g., a display on the screen).

[0080] Since it is conceivable that a predetermined target site may be subjected to coagulation necrosis using multiple probes (or by multiple probe punctures), it is preferable to be able to perform simulations of the range corresponding to multiple procedures. Also, for example, if a tumor is present in multiple locations or is widespread, the procedure may be performed in several stages (on different days). In addition, additional procedures may be required at a later date. Thus, since it is conceivable that ablation and cryotherapy may not necessarily be performed in a single procedure but may require multiple procedures on different days, it is preferable to be able to save the simulation results of the coagulation range and / or output them to an external device (which may include time information, subject information, surgical information, device user information, etc.). The system may also be configured to allow such data to be retrieved as needed and the simulation to be continued (for example, by performing simulations of additional probes).

[0081] Medical images can be generated based on CT scan data or MRI scan data. Even for the same patient, data from different modalities may be used depending on the purpose of the procedure or the content of the examination (for example, initially using images based on CT scan data, and then using images based on MRI scan data as needed). In such cases, it is preferable in one form that medical images based on data from a first modality (e.g., a CT scan) and medical images based on data from a second modality (e.g., an MRI scan) can be interchangeable and / or overlaid, so that simulations can be performed consistently. It may also be possible to change images retrospectively, not just during a single simulation (for example, changing images at a later date). It may also be possible to automatically or manually align images from different modalities. While the swapping of image data as described above is useful in that it enables various simulations, it is not always necessary to swap images from different modalities. For example, even with medical images based on image data from the same imaging device (e.g., a CT scanner), it may be possible to swap between relatively low-resolution data (such as data acquired with a thicker slice thickness for confirmation before the actual imaging) and high-resolution data.

[0082] (Device usage capture function) The medical image processing device 10 may have a function to capture and save the usage status of the device. This function is primarily for saving information about whether the medical image processing device 10 was actually used during a procedure on a patient, and / or the content of that use. With a configuration that saves information about the usage status of the device in this way, it becomes possible to use this information in determining medical fees, etc.

[0083] Information regarding usage status may be stored internally in the medical image processing device 10 (data storage unit 12, etc.), or it may be transmitted externally and stored, for example, in a medical information management device 21 (see Figure 1).

[0084] Information regarding usage may include, for example, at least one or a combination of the following: subject identification information, date and time of surgery, surgery duration information, device usage time information, screenshots of displayed three-dimensional images, screenshots of displayed two-dimensional images, physician and other medical personnel information, contrast agent injector information, contrast agent information, contrast protocol information, etc. Information related to time and duration may be captured in a manner embedded in the screenshot image. While not limited to these, screenshot images may be selected to include only two-dimensional images, only three-dimensional images, or a combination thereof.

[0085] The timing for acquiring information regarding usage status may be at predetermined time intervals or at predetermined times, but it may also be at the following timing: When the medical image processing device 10 is in use (for example, when observing a three-dimensional image during surgery), if no input is received from the operator for a certain period of time or longer, the device may be configured to automatically acquire predetermined information regarding usage status and save or transmit it externally. In this case, timestamp information associated with the timing of information acquisition may be attached. Specifically, this may be the hash value of the target electronic information (image data in one example) and the precise time information issued by the timestamp authority, with the timestamp authority's digital signature attached. By attaching such a timestamp, it is possible to confirm that the electronic information existed at that time (proof of existence), and it is also possible to prove that it has not been tampered with afterward.

[0086] (Timer function) The medical image processing device 10 may also have a timer function for measuring surgical time. For example, in liver cancer surgery, a technique called the Pringle maneuver is sometimes used to temporarily block blood flow to the liver using forceps or the like to control bleeding. In this case, it is important to accurately measure and manage the time when blood flow is blocked (or not blocked). Therefore, the medical image processing device 10 may be configured to display the time when blood flow is blocked on a timer and emit an alarm sound and / or alert when a predetermined time has elapsed. Similarly, it may be configured to display the time when blood flow is not blocked on a timer and emit an alarm sound and / or alert. By configuring the device to allow confirmation of relaxation and / or blockage times using a timer, safer procedures can be performed. Although not limited to this, the timer function for relaxation may be configured to display a first display color (e.g., green) and / or emit a first sound to indicate a safe state, while during blockage, it may be configured to display a second display color (e.g., red) and / or emit a second sound (to indicate a blocked state). The timer function during blood flow occlusion may also be equipped with an extension function. For example, it may be configured to allow selection from preset values ​​such as 1 minute, 2 minutes, or 3 minutes, or it may be configured to allow numerical input of any extension time. The medical image treatment device 10 may be configured to be in a state where operation is prohibited or operation is rejected during the time when blood flow is occluded. A configuration in which operation is prohibited when the timer during blood flow occlusion is functioning prevents the timer from being unintentionally changed or reset, and ensures accurate time measurement.

[0087] (Various input methods) In devices where input is primarily via a touch panel, such as tablet terminals, it is desirable that the device offers good operability and intuitive input. The medical image processing device 10 of this embodiment may, for example, be equipped with a function to display a pointer (cursor, arrow) at a predetermined position in a three-dimensional image. In this case, an input method such as the one shown in Figure 14 may be used to display the cursor.

[0088] First, as shown in Figure 14, two points (P1, P2) on the screen are selected. For example, the selection may be made by touching the two points with the thumb and index finger. The medical image processing device 10 accepts the input of these two points (P1, P2) from the operator and identifies the coordinates of each point. Next, as an example, the operator keeps the thumb in the position it initially touched and slides the index finger from point P2 to point P2'. The medical image processing device 10 may be configured to display a pointer 161 (see Figure 15) as a trigger when (i) two points P1 and P2 are selected, and then (ii) input is received to move one point while keeping the other point fixed in a direction that increases the distance between the two points. In the pointer 161, the fixed point P1 is the tip of the arrow, and the opposite point P2' is the trailing end of the arrow. For example, if such input is made in the image display area 101A and / or the image display area 101B, the arrow 161 may be displayed. With this input method, the pointer can be easily displayed by directly making the above input on the display screen without requiring any operation such as selecting a mode for displaying the arrow in advance (for example, by touching a dedicated icon).

[0089] In the medical image processing device 10, it is also preferable that, for example, a portion of a three-dimensional image can be selected as a circular region. In this case, an input method such as that shown in Figure 16 may be available for specifying the circular region.

[0090] First, as shown in Figure 16(a), two points (P11, P12) are selected on the screen. For example, the selection may be made by touching the two points with the thumb and index finger. The medical image processing device 10 accepts the input of these two points P11 and P12 from the operator and identifies the coordinates of each point. Next, the operator simultaneously slides their thumb and index finger in an arc shape around point o, like a compass. When the medical image processing device 10 detects such input, it may be configured to display a circle 198 centered on point o with a diameter equal to the distance between P11 and P12, as shown in Figure 16(b). With this input method, a circular area can be selected in only two steps: selecting two points and rotating them.

[0091] Although embodiments of the present invention have been described above with reference to specific drawings, the present invention is not limited to the above-described specific configurations and can be modified as appropriate without departing from the spirit of the invention. Furthermore, different technical features can be combined as appropriate. For example, content disclosed as a product invention may be understood as an invention of a method, program, or program medium.

[0092] (Note) This application discloses the following. The reference numerals in parentheses are provided for reference only and are not intended to limit the present invention to any particular embodiment. A1. A medical image processing device (10) comprising a display control unit (11) that controls the display of a three-dimensional image (300) representing the anatomical structure of a subject, The above-mentioned display control unit (11) is, a1: A process for generating an image that includes a graphical user interface (140) for defining the display range of the three-dimensional image (300), wherein the graphical user interface (140) is A first slider (145a) for defining a cross-sectional reference plane (e.g., 305a) on one side of the three-dimensional image along a predetermined reference axis (e.g., x-axis) in three-dimensional space, A second slider (145b) for defining the cross-sectional reference plane (e.g., 300b) on the other side of the three-dimensional image along the predetermined reference axis (e.g., x-axis), This includes image generation processing, a2: A process to display the three-dimensional image (300) that exists between the above cutting reference planes, A medical image processing device configured to perform the following actions.

[0093] A method for controlling a medical image processing device that displays a three-dimensional image representing the anatomical structure of a subject, a1: A step of generating an image that includes a graphical user interface for defining the display range of the three-dimensional image, wherein the graphical user interface is A first slider for defining a cross-sectional reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space, A second slider for identifying the cross-sectional reference plane on the other side of the three-dimensional image along the predetermined reference axis, The generation step includes, a2: A step of displaying the three-dimensional image that exists between the aforementioned cutting reference planes, A method for controlling a medical image processing device, including [a specific component].

[0094] A medical image processing program that displays a three-dimensional image representing the anatomical structure of a subject, and which is installed on one or more computers. a1: A step of generating an image that includes a graphical user interface for defining the display range of the three-dimensional image, wherein the graphical user interface is A first slider for defining a cross-sectional reference plane on one side of the three-dimensional image along a predetermined reference axis in three-dimensional space, A second slider for identifying the cross-sectional reference plane on the other side of the three-dimensional image along the predetermined reference axis, The generation step includes, a2: A step of displaying the three-dimensional image that exists between the aforementioned cutting reference planes, A medical image processing program that performs this task.

[0095] B1. A medical image processing device (10) comprising a display control unit (11) that controls the display of a three-dimensional image (300) representing the anatomical structure of a subject, The above-mentioned display control unit (11) is, b1: A process to generate an image including a two-dimensional image (200) which is a tomographic image obtained by imaging the subject, and the three-dimensional image (300) mentioned above. b2: A process to detect a predetermined position (p) in the two-dimensional image specified by the operator, b3: A process for displaying a 3D pointer at a position (P) corresponding to a predetermined position (p) in the above three-dimensional image, wherein the 3D pointer is displayed in association with a predetermined object in the three-dimensional image. b4: When the operator inputs to move the 3D pointer, the process involves moving the 3D pointer along the predetermined object. A medical image processing device configured to perform the following.

[0096] C1. A medical image processing device (10) comprising a display control unit (11) that controls the display of a three-dimensional image (300) representing the anatomical structure of a subject, The above-mentioned display control unit (11) is, c1: A process to identify that a specific object (e.g., a tumor) has been selected from the above three-dimensional image, c2: This process displays a three-dimensional margin sphere (378) surrounding the selected object, and further, c3: A process for displaying a graphical user interface (150) for setting the size of the margin sphere (378), wherein the graphical user interface includes a slider (156) whose position corresponds to the size of the margin sphere (378), and a size indicator (159) that shows the size of the margin body determined based on the position of the slider. A medical image processing device configured to perform the following.

[0097] D1. A medical image processing device (10) comprising a control unit (11) that controls the display of medical images (200, 300) representing the anatomical structures of a subject, The control unit (11) described above is: d1: A process to determine whether or not there has been no input from the operator for a certain period of time while the medical image, which is assumed to be in use during surgery, is displayed. d2: If no input is received for a certain period of time, the process involves capturing the screen of the medical image displayed at that time and obtaining the image data. d3: A process of storing the image data in a predetermined data storage unit or transmitting it to an external device, A medical image processing device configured to perform the following. [Explanation of Symbols]

[0098] 1. Medical Image Processing System 10 Medical Image Processing Equipment 11 Image display control unit 12 Data storage unit 13 Display Devices 14 Input Devices 15. Data Input / Output Interfaces 21 Medical information management device 22 Drug injection device 23 Imaging device 100 display screens 101A, 101B Image display area 102 division lines Icons 111-116 140 Graphical User Interfaces 145a, 145b Sliders 150 Graphical User Interfaces 156 Slider 157 Preset Value Display Section 159 Size Indicator 161 3D Pointer 170 Graphical User Interfaces 171 Virtual Probes 173 circular orbit 174 Highlighting 177 Slider 190a~190c probe 195a~195c Predicted necrotic area 198 yen (circular area) 200 2D images 220 Ultrasound diagnostic images 300 three-dimensional images Objects 303, 303′, and 305 305a, 305b end face 310 Cut surface 365 Tumors 377 Circumscribed sphere 378 Margin Spheres p, P position

Claims

1. A medical image processing device comprising a display control unit that controls the display of a three-dimensional image representing the anatomical structure of a subject, The display control unit, - A process to generate an image including a two-dimensional image which is a tomographic image obtained by imaging the subject, and the three-dimensional image, - A process for detecting a predetermined position in the two-dimensional image specified by the operator, - A process for displaying a 3D pointer at a position corresponding to a predetermined position in the three-dimensional image, wherein the 3D pointer is displayed in association with a predetermined object in the three-dimensional image. - When the operator inputs to move the 3D pointer, the process involves moving the 3D pointer along the predetermined object. A medical image processing device configured to perform the following.

2. A medical image processing device comprising a display control unit that controls the display of a three-dimensional image representing the anatomical structure of a subject, The display control unit, - A process to generate an image including a two-dimensional image which is a tomographic image obtained by imaging the subject, and the three-dimensional image, - A process for detecting a predetermined position in the two-dimensional image specified by the operator, - A process for displaying a 3D pointer at a position corresponding to a predetermined position in the three-dimensional image, wherein the 3D pointer is displayed in association with a predetermined object in the three-dimensional image. A medical image processing device configured to perform the following.

Images