Medical image processing device, medical image processing method and program

Abstract

Provided are a medical image processing device capable of assisting in determining a separation plane based on a three-dimensional distance between a tissue to be excised and a tissue to be preserved, a medical image processing method, and a program. A processor executes a command of a program to acquire a three-dimensional medical image, set a separation plane for separating a first region specified in the medical image, measure a first distance that is the minimum distance between an arbitrary point on the surface of the first region and the separation plane, measure a second distance that is the minimum distance between an arbitrary point on the surface of a second region specified in the medical image and the separation plane, and cause a display device to display the medical image such that at least one of first distance information indicating the first distance and second distance information indicating the second distance is displayed.

Description

[Technical Field]

[0001] The present disclosure relates to a medical image processing device, a medical image processing method, and a program. [Background technology]

[0002] Rectal cancer originates in the lumen of the intestine and invades the tissue outside the intestine as it progresses. For advanced cancers that require surgery, a total mesorectal excision is performed, in which the mesorectum, the fatty tissue surrounding the rectum, is removed along with the cancer. A total mesorectal excision is abbreviated as TME, which stands for total mesorectal excision.

[0003] In surgery where total mesorectal resection is performed, it is necessary to achieve both an adequate margin around the cancer and preservation of important tissues around the mesorectum, such as nerves and blood vessels.

[0004] The reason why resection with sufficient margins is required is that the distance between the cancer and the dissection surface around the rectum (Circumferential Resection Margin (CRM)) is margin ) of 1 mm or less is a strong predictor of local recurrence.

[0005] On the other hand, the reason why it is necessary to preserve the surrounding tissues is that thin blood vessels and autonomic nerves run around the mesorectum, and if the autonomic nerves are damaged, it may cause urinary disorders and sexual dysfunction.

[0006] Non-Patent Document 1 describes that in function-preserving rectal cancer surgery, the excision layer is selected according to the progression of the cancer to maintain radical cure. The same document also describes that nerve damage increases or decreases depending on the level of the excision layer.

[0007] Patent Document 1 describes an endoscopic image diagnosis support device that displays a distance distribution from a bronchial wall to a region of interest outside the bronchus superimposed on a volume rendering image. The device described in this document uses a three-dimensional image to generate a first projection image and a second projection image in which the region of interest is projected onto the inner wall of the bronchus. The first projection image and the second projection image are highlighted according to the projection distance.

[0008] Patent Document 2 describes a blood flow visualization device that uses a computer to automatically analyze vascular lesions. The device described in this document acquires medical images, determines vascular lesions using vascular shapes constructed from the medical images, and calculates the geometric characteristics of the vascular lesions.

[0009] Patent Document 3 describes a medical image processing device that measures the thickness of fat regions around coronary arteries. The device described in this document measures the distribution and thickness of fat regions formed around coronary arteries based on volume data, and generates two-dimensional fat thickness distribution data.

[0010] Patent Document 4 describes a technology for displaying images used in surgical planning for breast cancer resection surgery. The image processing device described in the document is a device that generates VR images and the like using reconstructed data, identifies the tumor area, calculates the distance on the body surface from a reference point to the tumor area, and displays it on the VR image.

[0011] Patent Document 5 describes a medical image processing device that divides an organ of a subject into a plurality of regions, corrects the edges and boundaries of the regions, and calculates a region to be resected in the organ using the division results. [Prior art documents] [Patent documents]

[0012] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-039874 [Patent Document 2] International Publication No. 2017 / 047820 [Patent Document 3] Japanese Patent Application Laid-Open No. 2011-218037 [Patent Document 4] Japanese Patent Application Laid-Open No. 2009-022369 [Patent Document 5] Japanese Patent Publication No. 2020-120828 [Non-patent literature]

[0013] [Non-Patent Document 1] Yusuke Kinugasa, "Fascia anatomy around the rectum from a surgeon's perspective and the dissection layer for function-preserving rectal cancer surgery" [online], September 8, 2012, Clinical Laboratory Anatomy Research Society, [Retrieved January 25, 2021], Internet (http: / / www.jrsca.jp / contents / records / contents / PDF / 13-PDF / p08.pdf) Summary of the Invention [Problem to be solved by the invention]

[0014] However, in order to determine a dissection plane before surgery that allows for both the removal of a lesion such as cancer with a sufficient margin around the lesion and the preservation of important tissues around the lesion, it is necessary to know the three-dimensional distance between the tissue to be removed and the tissue to be preserved, as well as the three-dimensional distance between the dissection plane and the tissue to be removed.

[0015] When determining the three-dimensional distance between tissue to be resected and tissue to be preserved, it is necessary to determine whether the tissue to be measured for the three-dimensional distance and the planned dissection plane are selected in the correct position in the medical image. Such determination requires evaluation of the two-dimensional cross-sectional image of the three-dimensional medical image. In other words, when examining the dissection plane, it is necessary to clearly display the spatial distance between the targets for measuring the three-dimensional distance in the two-dimensional cross-sectional image.

[0016] Patent Documents 1 to 5 do not describe any display for evaluating the three-dimensional distance between the dissection surface for dissecting the tissue to be resected and the three-dimensional distance between the tissue to be resected and the tissue to be preserved, and do not describe any means for solving such problems.

[0017] The present invention has been made in consideration of the above circumstances, and aims to provide a medical image processing device, a medical image processing method, and a program that can assist in determining a separation plane based on the three-dimensional distance between the tissue to be resected and the tissue to be preserved. [Means for solving the problem]

[0018] The medical image processing device of the present disclosure is a medical image processing device that includes a processor and a storage device in which a program executed by the processor is stored, wherein the processor executes instructions of the program to acquire a three-dimensional medical image, set a separation plane for separating a first region identified in the medical image, measure a first distance that is the nearest distance between any position on the surface of the first region and the separation plane, measure a second distance that is the nearest distance between any position on the surface of a second region identified in the medical image and the separation plane, and when displaying the medical image on a display device, display at least one of first distance information representing the first distance and second distance information representing the second distance.

[0019] According to the medical image processing device of the present disclosure, at least one of the three-dimensional distance between the first region and the separation surface and the three-dimensional distance between the second region and the separation surface can be grasped at a glance, thereby assisting in determining the separation surface.

[0020] The first region may identify a region containing tissue to be separated, and the second region may identify a region containing tissue to be preserved.

[0021] The region where the separation surface is designated may be a third region that exists between the first region and the second region.

[0022] In another aspect of a medical image processing device, when a cross-sectional image corresponding to any cross-section in a medical image is displayed on a display device, the processor displays first distance information in an outer edge region on the side of the first region of the separation surface.

[0023] According to this aspect, it is possible to prevent the visibility of the separation surface from being impaired, and it is possible to grasp at a glance the side of the separation surface to which the first distance is applied.

[0024] The edge region may be a region that contacts the separation surface, or may be a region that does not contact the separation surface.

[0025] In another aspect of a medical image processing device, when a cross-sectional image corresponding to any cross-section in a medical image is displayed on a display device, the processor displays second distance information in an outer edge region on the side of the second region of the separation surface.

[0026] According to this aspect, it is possible to prevent the visibility of the separation surface from being impaired, and it is possible to grasp at a glance the side of the separation surface to which the second distance is applied.

[0027] In a medical image processing apparatus according to another aspect, the processor applies a color map that represents distance using color to display the first distance information and the second distance information.

[0028] According to this aspect, the first distance and the second distance can be grasped at a glance based on the information represented by the colors of the color map.

[0029] Examples of color maps include a mode in which different colors are applied to represent different distances, and a mode in which different densities are applied to represent different distances.

[0030] In another aspect of a medical image processing device, a processor displays a volume rendering image corresponding to a medical image on a display device, and superimposes at least one of the first distance information and the second distance information on the volume rendering image.

[0031] According to this aspect, in the volume rendering image, at least one of the three-dimensional distance between the first region and the separation surface and the three-dimensional distance between the second region and the separation surface can be grasped at a glance, which can assist in determining the separation surface.

[0032] In a medical image processing apparatus according to another aspect, the processor changes the display manner of the first distance information and the display manner of the second distance information according to a user's viewpoint in the volume rendering image.

[0033] According to this aspect, the first distance and the second distance as seen from the user's viewpoint can be grasped at a glance.

[0034] In another aspect of the medical image processing device, the processor superimposes and displays first distance information on the first region in the volume rendering image when the first region is located on the user's viewpoint side of the separation surface.

[0035] According to this aspect, for a first area visible from the user's viewpoint, first distance information can be displayed at a position visible from the user's viewpoint.

[0036] In another aspect of the medical image processing device, the processor superimposes second distance information on the separation surface when the second region is present on the opposite side of the separation surface from the user's viewpoint in the volume rendering image.

[0037] According to this aspect, for a second area that is not visible from the user's viewpoint, second distance information can be displayed at a position that is visible from the user's viewpoint.

[0038] In another aspect of the medical image processing device, the processor superimposes and displays first distance information on the separation surface when the first region is present on the opposite side of the separation surface from the user's viewpoint in the volume rendering image.

[0039] According to this aspect, for a first area that is not visible from the user's viewpoint, first distance information can be displayed at a position that is visible from the user's viewpoint.

[0040] In another aspect of the medical image processing device, the processor superimposes second distance information onto the second region in the volume rendering image when the second region is located on the side of the separation surface that is closer to the user's viewpoint.

[0041] According to this aspect, for the second area visible from the user's viewpoint, second distance information can be displayed at a position visible from the user's viewpoint.

[0042] The medical image processing method of the present disclosure is a medical image processing method in which a computer acquires a three-dimensional medical image, sets a separation plane for separating a first region identified in the medical image, measures a first distance that is the nearest distance between an arbitrary position on the surface of the first region and the separation plane, measures a second distance that is the nearest distance between an arbitrary position on the surface of a second region identified in the medical image and the separation plane, and displays at least one of first distance information representing the first distance and second distance information representing the second distance when displaying the medical image on a display device.

[0043] According to the medical image processing method of the present disclosure, it is possible to obtain the same effects as those of the medical image processing device of the present disclosure. The components of the medical image processing device of other aspects can be applied to the components of the medical image processing method of other aspects.

[0044] The program of the present disclosure is a program that enables a computer to perform the following functions: acquire three-dimensional medical images; set a separation plane when separating a first region identified in the medical image; measure a first distance, which is the closest distance between any position on the surface of the first region and the separation plane; measure a second distance, which is the closest distance between any position on the surface of a second region identified in the medical image and the separation plane; and display at least one of first distance information representing the first distance and second distance information representing the second distance when displaying the medical image on a display device.

[0045] According to the program of the present disclosure, it is possible to obtain the same effects as those of the medical image processing device of the present disclosure. The components of the medical image processing device of other aspects may be applied to the components of the program of other aspects. [Effects of the Invention]

[0046] According to the present invention, at least one of the three-dimensional distance between the first region and the separation surface and the three-dimensional distance between the second region and the separation surface can be grasped at a glance, which can assist in determining the separation surface. [Brief explanation of the drawings]

[0047] [Figure 1] Figure 1 shows an example of CRM measurement from an MRI image of a patient with rectal cancer. [Figure 2] FIG. 2 shows a diagram of stereotactic anterior resection. [Figure 3] FIG. 3 is an image showing the orientation of FIG. [Figure 4] FIG. 4 shows the resection surface. [Figure 5] FIG. 5 is a schematic diagram showing an arbitrary cross section of an MRI image. [Figure 6] FIG. 6 is an image diagram showing the orientation of FIG. [Figure 7] FIG. 7 is a schematic diagram showing a first example of an ablation line. [Figure 8] FIG. 8 is a schematic diagram showing a second example of the ablation line. [Figure 9] FIG. 9 is a schematic diagram showing a third example of the ablation line. [Figure 10] FIG. 10 is a functional block diagram of a medical image processing apparatus according to an embodiment. [Figure 11] FIG. 11 is a block diagram showing an example of the configuration of a medical image processing apparatus according to an embodiment. [Figure 12] FIG. 12 is a flowchart showing the procedure of the medical image processing method according to the embodiment. [Figure 13] FIG. 13 is an image diagram showing an example of three-dimensional distance information superimposed on a two-dimensional cross section. [Figure 14] FIG. 14 is an image diagram showing another example in which three-dimensional distance information is superimposed on a two-dimensional cross section. [Figure 15] FIG. 15 is a schematic diagram showing an example of a display screen for the first distance measurement in the distance measurement process. [Figure 16]FIG. 16 is a schematic diagram showing an example of a display screen for the second distance measurement in the distance measurement step. [Figure 17] FIG. 17 is a schematic diagram showing a display example of the first color map. [Figure 18] FIG. 18 is a schematic diagram showing an example of the display of the second color map. [Figure 19] FIG. 19 is a schematic diagram showing a display example of a color map according to a modified example. [Figure 20] FIG. 20 is a schematic diagram showing an example of displaying three-dimensional distance information in a volume rendering image. [Figure 21] FIG. 21 is a schematic diagram of FIG. 20 viewed from the tissue to be preserved. [Figure 22] FIG. 22 is a schematic diagram of FIG. 20 viewed from the tissue to be excised. [Figure 23] FIG. 23 is a schematic diagram showing a display example of three-dimensional distance information applied to each tissue shown in FIG. [Figure 24] FIG. 24 is a block diagram showing an example of the configuration of a medical information system including a medical image processing apparatus according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0048] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings. In this specification, the same components are designated by the same reference numerals, and redundant explanations will be omitted where appropriate.

[0049] [Example of distance measurement in rectal cancer] Figure 1 shows an example of CRM measurement from an MRI image of a patient with rectal cancer. In Figure 1, the cancer TU, muscularis propria MP, and mesorectum ME are distinguished by using different fill patterns. While Figure 1 shows a two-dimensional image, the MRI image actually obtained is a three-dimensional image. MRI is an abbreviation for Magnetic Resonance Imaging.

[0050] In modalities such as MRI and CT, two-dimensional slice images are successively captured to obtain three-dimensional data showing the three-dimensional shape of an object. The term "three-dimensional image" can include the concepts of a collection of successively captured two-dimensional slice images and a two-dimensional sequence. The term "image" can also include the meaning of image data. CT is an abbreviation for Computed Tomography.

[0051] The arrow in Figure 1 indicates the closest point, the point from the cancer TU to the mesorectum ME. The closest distance, which is the distance between the closest point and the mesorectum ME, is an important parameter when determining the stage of cancer. If the closest distance is 1 mm or less, the cancer is considered CRM-positive.

[0052] [Explanation of stereotactic anterior resection] Figure 2 shows a diagram of stereotactic anterior resection. Figure 3 is an image showing the orientation of Figure 2. Figure 2 is a view looking into the pelvis from the head side. Figure 3 uses arrows to illustrate the position of the abdominal side in Figure 2.

[0053] Figure 2 shows the cancer being removed by stereotactic anterior resection, which involves removing the fat 2 around the rectum 1 where the cancer has developed and removing the entire cancer. When removing the cancer, it is important to completely remove the cancer without damaging the nerves 3.

[0054] Figure 4 shows the resection plane. When cancer is removed, it is removed at resection plane 4. If resection plane 4 is located too close to the inside of rectum 1, the cancer will be exposed. On the other hand, if resection plane 4 is located too close to the outside of rectum 1, nerve 3 may be damaged.

[0055] FIG. 5 is a schematic diagram showing an arbitrary cross section of an MRI image. The figure shows a state in which a cancer 5 occurring in the rectum 1 has crossed the boundary 6 between the rectum 1 and fat 2 and reached the fat 2. FIG. 6 is an image diagram showing the orientation of FIG. 5. An area 7 shown in FIG. 6 represents the position of the rectum 1, etc. shown in FIG. 5. The rectum 1, fat 2, and cancer 5 shown in FIG. 5 correspond to the muscularis propria MP, mesorectum ME, and cancer TU shown in FIG. 1, respectively.

[0056] 7 is a schematic diagram showing a first example of a resection line. The resection line 4A shown in the figure is set when the cancer 5 is to be resected together with the fat 2 surrounding the rectum 1 where the cancer 5 developed. In other words, the resection line 4A coincides with the outline of the fat 2.

[0057] If the resection line 4A is set, there is a risk that the nerve 3 may be damaged when the cancer 5 is resected. The resection line 4A in the cross-sectional image shown in Fig. 7 corresponds to the resection plane 4 shown in Fig. 4. The same applies to the resection line 4B shown in Fig. 8 and the resection line 4C shown in Fig. 9.

[0058] Figure 8 is a schematic diagram showing a second example of a resection line. The resection line 4B shown in the figure is set when the cancer 5 is resected while avoiding the nerves 3 and leaving part of the fat 2. In other words, part of the resection line 4B coincides with the outline of the fat 2 and part of the resection line 4B is inside the fat 2. When the resection line 4B is set, there is a risk that the cancer 5 may not be completely removed.

[0059] Figure 9 is a schematic diagram showing a third example of a resection line. The resection line 4C shown in the figure is set when cancer 5 is resected while avoiding nerve 3 and leaving part of fat 2. That is, like the resection line 4B shown in Figure 8, part of the resection line 4C coincides with the outline of fat 2 and part of the resection line 4C is inside fat 2, while sufficient margins are left between the resection line 4C and nerve 3 and cancer 5.

[0060] When the resection plane 4 shown in Figure 4 is set, the medical image processing device described below measures the three-dimensional distance between the cancer 5, which is the tissue to be resected, and the tissue to be preserved, such as nerves 3 and blood vessels, and displays the measurement results on a two-dimensional cross-sectional image to assist in determining the resection plane 4.

[0061] From medical images such as MRI images, tissues to be preserved and 4 9. The three-dimensional distance between the resection surface 4 shown in FIG. 9 and the tissue to be resected, such as cancer 5 shown in FIG.

[0062] This allows the resection plane 4 to be planned before surgery, so that a sufficient margin can be obtained from the tissue to be preserved. If it is determined in advance that a sufficient margin cannot be obtained, it is possible to abandon preserving the tissue to be preserved and select a surgical procedure that resects the nerves 3, blood vessels, etc.

[0063] [Configuration example of medical image processing device] Figure 10 is a functional block diagram of a medical image processing apparatus according to an embodiment. The medical image processing apparatus 20 shown in the figure is realized using computer hardware and software. Software is synonymous with program. The term medical image used in the following embodiments is synonymous with the term medical image.

[0064] The medical image processing device 20 includes an image acquisition unit 222, a lesion area extraction unit 224, a lesion area input reception unit 226, a resection plane extraction unit 228, a resection plane input reception unit 230, a distance measurement unit 232, and a display image generation unit 234. The medical image processing device 20 is also connected to an input device 214 and a display device 216.

[0065] The image acquisition unit 222 acquires medical images to be processed from an image storage server or the like. In this embodiment, an MRI image captured using an MRI device is used as the medical image to be processed. The medical image to be processed is not limited to an MRI image, and may be an image captured using another modality such as a CT device.

[0066] In this embodiment, imaging diagnosis of cancer occurring in the digestive tract such as the large intestine is assumed, and an example of a medical image acquired via the image acquisition unit 222 is a three-dimensional image in which an area including the cancer and its surrounding tissue is captured as a single image. Furthermore, since the medical image processing device 20 measures distance three-dimensionally in units of millimeters, it is preferable that the target image be high-resolution three-dimensional data of isotropic voxels.

[0067] The lesion area extraction unit 224 performs a lesion area extraction process that applies image recognition to automatically extract a lesion area contained in a medical image acquired via the image acquisition unit 222. In this embodiment, the lesion area is a cancer area. An example of the process performed by the lesion area extraction unit 224 is to apply machine learning, such as deep learning, to an input medical image and extract a lesion area using a trained model that has been trained to perform an image segmentation task.

[0068] An example of a learning model for image segmentation is a convolutional neural network, which can be referred to as CNN, an abbreviation of Convolution Neural Network.

[0069] Lesion area extraction unit 224 is not limited to segmentation that classifies a lesion area from other areas, and may be configured to perform segmentation that classifies each of multiple areas surrounding a lesion area. For example, lesion area extraction unit 224 may extract a lesion area and a conserving area using a trained model that receives an input of a three-dimensional image, classifies each area, such as a cancer area that is a lesion area and other surrounding organs that are conserving areas, and outputs an image of the segmentation result with a mask pattern applied to each area, to extract the lesion area and the conserving area.

[0070] Lesion area input receiving unit 226 receives input of information about a lesion area automatically extracted using lesion area extraction unit 224. Lesion area input receiving unit 226 also receives input of information about a lesion area specified by a user using input device 214. A doctor who is the user can use input device 214 to freely specify an area different from the lesion area automatically extracted by lesion area extraction unit 224. For example, a doctor can use input device 214 to specify an area that is recognized as cancer or is suspected of being cancer, among areas that were not extracted as cancer in the automatic extraction.

[0071] The lesion region described in the embodiment is an example of a first region identified in a medical image, and the sparing region described in the embodiment is an example of a second region identified in a medical image.

[0072] The resection plane extraction unit 228 performs processing to extract candidates for the resection plane 4, which serves as a reference when resecting the lesion area from the medical image, based on the information on the lesion area obtained via the lesion area input reception unit 226. Since the extent of cancer spread varies depending on the stage of cancer, an appropriate candidate for the resection plane 4 is automatically extracted depending on the stage of cancer. Note that the candidate for the resection plane 4 may be a curved surface of any shape.

[0073] The resection plane input receiving unit 230 receives input of information on candidates for the resection plane 4 automatically extracted using the resection plane extraction unit 228. The resection plane input receiving unit 230 also receives input of information on the resection plane specified by the user using the input device 214. The doctor, who is the user, can use the input device 214 to specify a resection plane 4 that is different from the candidates for the resection plane 4 automatically extracted using the resection plane extraction unit 228.

[0074] The resection plane 4 different from the automatically extracted candidate resection plane 4 may be a surface obtained by modifying a part of the automatically extracted candidate resection plane 4. The resection plane 4 is determined based on information input via the resection plane input receiving unit 230. Note that, like the candidate resection plane 4, the resection plane 4 may be a curved surface of any shape.

[0075] For example, when a doctor considers the resection plane before surgery, he or she can specify not only an actual anatomical boundary surface but also a virtual surface within a layer as a candidate for the resection plane 4. The resection plane 4 described in the embodiment is an example of a separation plane used when separating a first region identified in a medical image.

[0076] The distance measurement unit 232 measures the three-dimensional distance from the cancer 5 to the resection plane 4 and the three-dimensional distance from the tissue to be preserved to the resection plane. The tissue to be preserved is tissue located on the opposite side of the resection plane 4 from the cancer 5. An example of the tissue to be preserved is a nerve 3 shown in FIG. 9.

[0077] When a user inputs a designated lesion area, one possible mode is to measure the distance from the designated area to the resection surface 4. Another possible mode is to group the entire lesion area, including the automatically extracted lesion area and the lesion area designated by the user, and treat the entire area as a single lesion area, and measure the distance between the lesion area and the resection surface 4. Preferably, the system is configured to allow selection of these measurement modes.

[0078] The following method can be used to measure the distance: For each of multiple points on the contour of the lesion area to be measured, the distance to the closest point on the resection plane 4 is calculated, and the shortest distance between the two points among the multiple calculated distances is obtained as the closest distance between the resection plane 4 and the lesion area.

[0079] Similar to measuring the distance between the resection surface 4 and the lesion area, the distance between the resection surface 4 and the preservation area is measured, and the nearest distance between the resection surface 4 and the preservation area is obtained. Note that the multiple points on the contour of the lesion area described in the embodiment are an example of any position on the surface of the first area. The multiple points on the contour of the preservation area described in the embodiment are an example of any position on the surface of the second area.

[0080] The display image generation unit 234 generates a display image to be displayed on the display device 216. The display image generation unit 234 generates a two-dimensional image for display from the three-dimensional image. Examples of the two-dimensional image for display include a cross-sectional image and a volume rendering image.

[0081] The display image generating unit 234 generates at least one of an axial slice image, a coronal slice image, and a sagittal slice image, or may generate all three types of slice images.

[0082] The display image generating unit 234 generates an image representing the resection plane 4 determined using the resection plane extracting unit 228. The image representing the resection plane 4 is displayed superimposed on a cross-sectional image, etc. An example of the image representing the resection plane 4 displayed superimposed on a cross-sectional image is the resection line 4C shown in FIG.

[0083] The display image generating unit 234 generates first distance information representing the distance between the resection plane 4 and the lesion area measured using the distance measuring unit 232. The display image generating unit 234 also generates second distance information representing the distance between the resection plane 4 and the lesion area measured using the distance measuring unit 232.

[0084] The display image generation unit 234 may apply graphic elements such as a color map and a color bar as the first distance information and the second distance information. The first distance information and the second distance information generated by the display image generation unit 234 are superimposed and displayed on the cross-sectional image.

[0085] 11 is a block diagram showing an example of the configuration of a medical image processing apparatus according to an embodiment. The medical image processing apparatus 20 includes a processor 202, a computer-readable medium 204 which is a non-transitory tangible entity, a communication interface 206, and an input / output interface 208.

[0086] The medical image processing device 20 may be in the form of a server, a personal computer, a workstation, or a tablet terminal.

[0087] The processor 202 includes a central processing unit (CPU). The processor 202 may include a graphics processing unit (GPU). The processor 202 is connected to a computer-readable medium 204, a communication interface 206, and an input / output interface 208 via a bus 210. An input device 214 and a display device 216 are connected to the bus 210 via the input / output interface 208.

[0088] The input device 214 may be a keyboard, a mouse, a multi-touch panel, other pointing devices, a voice input device, etc. The input device 214 may be any combination of multiple devices.

[0089] The display device 216 may be a liquid crystal display, an organic EL display, a projector, or any combination of multiple devices. The EL in organic EL display is an abbreviation for Electro-Luminescence.

[0090] The computer-readable medium 204 includes a memory serving as a primary storage device and a storage serving as an auxiliary storage device. The computer-readable medium 204 may be a semiconductor memory, a hard disk drive, a solid-state drive, or the like. The computer-readable medium 204 may be any combination of multiple devices.

[0091] A hard disk drive may be referred to as an HDD, which is an abbreviation of the English term Hard Disk Drive, and a solid state drive may be referred to as an SSD, which is an abbreviation of the English term Solid State Drive.

[0092] The medical image processing device 20 is connected to a communication line via a communication interface 206, and is communicably connected to devices such as a DICOM server 40 and a viewer terminal 46 connected to a network within a medical institution. The communication line is not shown. DICOM stands for Digital Imaging and Communications It is an abbreviation for in Medicine.

[0093] The computer-readable medium 204 stores a plurality of programs including a medical image processing program 220 and a display control program 260. The computer-readable medium 204 stores various data, various parameters, and the like.

[0094] The processor 202 executes the instructions of the medical image processing program 220 and functions as an image acquisition unit 222, a lesion area extraction unit 224, a lesion area input reception unit 226, a resection plane extraction unit 228, a resection plane input reception unit 230, a distance measurement unit 232, and a display image generation unit 234.

[0095] The display control program 260 generates a display signal required for display output to the display device 216 and controls the display of the display device 216 .

[0096] [Procedure for medical image processing method] 12 is a flowchart showing the procedure of the medical image processing method according to the embodiment. In an image acquisition step S12, the processor 202 acquires a medical image to be processed from the DICOM server 40 or the like.

[0097] In the lesion area extraction step S14, the processor 202 automatically extracts a lesion area as tissue to be resected from the input medical image. Also, in the lesion area extraction step S14, the processor 202 extracts a preserving area as tissue to be preserved from the input medical image.

[0098] Generally, when a lesion is excised, the membrane surrounding the fat surrounding the organ in which the lesion is located is also excised. In the lesion area extraction step S14, the fat area on which the resection plane can be set and the membrane surrounding the fat area are extracted.

[0099] Examples of regions to be preserved include blood vessels, nerves, pelvis, bones, muscles, cancer, lymph nodes, ureters, and organs. The organ may be another organ in the organ containing the lesion area, or a region other than the lesion area in the organ containing the lesion area.

[0100] The processor 202 may segment the medical image using the trained model to extract a lesion area and a sparing area. The processor 202 may determine the automatically extracted lesion area and sparing area as targets for measuring distance.

[0101] In the resection plane determination step S16, the processor 202 automatically extracts a candidate for the resection plane 4 based on the identified lesion area. The processor 202 may extract a membrane enveloping a fatty area as a candidate for the resection plane 4. If the processor 202 does not obtain a user input representing a modification of the candidate for the resection plane 4, the processor 202 may determine the automatically extracted candidate for the resection plane 4 as the resection plane 4.

[0102] When automatically extracting candidates for the resection plane 4, the processor 202 may extract candidates for the resection plane 4 taking into consideration a margin previously specified by the user. For example, if 2 millimeters is specified as the margin, in an area where the CRM is 2 millimeters or more, the outer periphery of the mesorectum may be extracted as a candidate for the resection plane 4, and in an area where the CRM is less than 2 millimeters, a plane beyond the mesorectum that is 2 millimeters from the outer periphery of the cancer may be extracted as a candidate for the resection plane 4.

[0103] In the distance measurement step S18, the processor 202 measures a first distance, which is the closest distance between the resection surface 4 and the lesion area. Also, in the distance measurement step S18, the processor 202 measures a second distance, which is the closest distance between the resection surface 4 and the preservation area.

[0104] In the display image generating step S20, the processor 202 generates a display image in which the first distance information representing the first distance and the second distance information representing the second distance are superimposed on any cross-sectional image.

[0105] In a display step S22, the processor 202 displays the generated display image on the display device 216. This allows the user to grasp at a glance the distance between the resection plane 4 and the lesion area and the distance between the resection plane 4 and the preservation area in the cross-sectional image.

[0106] The display image generating step S20 can generate a display image showing the processing results of the lesion area extracting step S14 and the resection plane determining step S16. The displaying step S22 can cause the display device 216 to display the display image showing the processing results of the lesion area extracting step S14 and the resection plane determining step S16.

[0107] In the user input receiving step S24, the processor 202 receives input of various instructions from the user. The user can perform various inputs such as specifying a lesion area and a resection plane 4 from the input device 214.

[0108] In lesion area designation input determination step S26, processor 202 determines whether or not there is an input specifying a lesion area and an input specifying a conservation area from input device 214. If the user performs an operation such as designating a suspected lesion area in the medical image and inputs information specifying a lesion area and information specifying a conservation area, the determination is YES. If the determination is YES, processor 202 proceeds to lesion area extraction step S14 and determines the designated lesion area and conservation area as targets for distance measurement.

[0109] On the other hand, if the processor 202 determines that there is no input specifying a lesion area in the lesion area designation input determination step S26, the determination is NO. If the determination is NO, the processor 202 proceeds to the resection plane designation step S28.

[0110] In the resection plane designation step S28, the processor 202 determines whether or not there is an input from the input device 214 specifying the resection plane 4. If the user performs an operation to designate the resection plane 4 and inputs information designating the resection plane 4, the determination is YES. If the determination is YES, the processor 202 proceeds to the resection plane determination step S16, and determines the designated resection plane 4 as the reference for distance measurement.

[0111] On the other hand, in the resection plane designation step S28, the processor 202 makes a NO determination when it determines that no information designating the resection plane 4 has been input. If the determination is NO, the processor 202 proceeds to the termination determination step S30.

[0112] When editing the resection plane 4 based on user input, it is preferable to implement an editing restriction that does not accept editing that does not have a sufficient margin for the closest distance between the resection plane 4 and the lesion area.

[0113] For example, if an edit command is issued that would cause the closest distance between the resection plane 4 and the lesion area to be less than a distance previously designated by the user, the edit command may be invalidated. If the edit command is invalidated, an error message may be displayed on the display device 216.

[0114] In the termination determination step S30, the processor 202 determines whether to terminate the display of the medical image. The condition for terminating the display may be a termination instruction input by the user or a termination command based on the program. If the termination condition is not met and the determination result of the termination determination step S30 is NO, the processor 202 proceeds to the display step S22 and continues the display.

[0115] On the other hand, in the termination determination step S30, if the termination condition is met, such as when the user performs an operation to close the display window, the determination is YES. If the determination is YES, the processor 202 terminates the display and ends the flowchart of FIG.

[0116] The processing functions of the medical image processing apparatus 20 can also be realized by sharing the processing among a plurality of computers.

[0117] [Example of display of first distance information and second distance information] Figure 13 is an image showing an example of superimposing three-dimensional distance information on a two-dimensional cross section. This figure shows a two-dimensional cross-sectional image of an arbitrary axial cross section. In the cross-sectional image 300 shown in this figure, a resection line 301 has been adjusted based on the specification of the user (physician) in the region where the cancer 5 is close to the nerve 3.

[0118] A first color map 302 showing the distribution of nearest neighbor distances between the resection line 301 and the cancer 5 is displayed in the outer edge region of the resection line 301 on the cancer 5 side. Also, a second color map 304 showing the distribution of nearest neighbor distances between the resection line 301 and the nerve 3 is displayed in the outer edge region of the resection line 301 on the nerve 3 side.

[0119] The outer edge region of the ablation line 301 may refer to a region that is in contact with the ablation line 301. The outer edge region of the ablation line 301 may refer to a region that is not in contact with the ablation line 301.

[0120] The distance from the ablation line 301 to the first color map 302 is preferably equal to or less than the width of the ablation line 301 or the width of the first color map 302. Similarly, the distance from the ablation line 301 to the second color map 304 is preferably equal to or less than the distance from the ablation line 301 or the width of the second color map 304.

[0121] The first color map 302 shows the distribution of the nearest neighbor distance between the ablation line 301 and the cancer 5 for each position on the ablation line 301. The ablation line 301 shown in Figure 13 has a narrower line width as the nearest neighbor distance between the ablation line 301 and the cancer 5 decreases, and a wider line width as the nearest neighbor distance between the ablation line 301 and the cancer 5 increases. For convenience of illustration, Figure 13 shows the first color map 302 with a uniform line width. The same applies to the second color map 304.

[0122] In the first color map 302, an arbitrary color is applied to an area where the nearest distance between the resection line 301 and the cancer 5 is equal to or less than a specified threshold. The first color map 302 may be configured to display the numerical value of the nearest distance between the resection line 301 and the cancer 5 when a user input such as a mouse-over or click is acquired. For convenience of illustration, the first color map 302 shown in FIG. 13 is not color-coded.

[0123] The same applies to the second color map 304. The first color map 302 and the second color map 304 may be distinguished from each other by using different colors.

[0124] 13 shows a cross-sectional image 300 in which a first color map 302 and a second color map 304 are displayed for a portion of the region of the ablation line 301. The first color map 302 and the second color map 304 may be displayed for multiple regions of the ablation line 301.

[0125] That is, the first color map 302 may be hidden in areas where the nearest neighbor distance between the resection line 301 and the cancer 5 exceeds a predetermined distance. Similarly, the second color map 304 may be hidden in areas where the nearest neighbor distance between the resection line 301 and the nerve 3 exceeds a predetermined distance.

[0126] For example, at least one of the first color map 302 and the second color map 304 can be displayed for the region of the resection line 301 determined in accordance with the designation of the doctor who is the user.

[0127] 14 is an image diagram showing another example of superimposing three-dimensional distance information on a two-dimensional cross section. In the cross-sectional image 310 shown in the figure, a first color map 312 and a second color map 314 are displayed for the entire region of the resection line 301.

[0128] The first color map 312 shown in Fig. 14 may have a similar configuration to the first color map 302 shown in Fig. 13. Similarly, the second color map 314 shown in Fig. 14 may have a similar configuration to the second color map 304 shown in Fig. 13.

[0129] [Example of user interface] Next, a specific example of the user interface will be described. A display device 216 shown in Fig. 10 displays cross-sectional images showing the results of the processing performed in each step shown in Fig. 12.

[0130] In the lesion area extraction step S14, the segmentation results of the lesion area and the preservation area are displayed on the display device 216. For example, the cross-sectional image shown in Figure 5 is displayed on the display device 216 as the processing result of the lesion area extraction step S14.

[0131] In the resection plane determination step S16, the display device 216 displays candidate resection lines such as the resection line 4A shown in Fig. 7, the resection line 4B shown in Fig. 8, and the resection line 4C shown in Fig. 9 superimposed on the cross-sectional image shown in Fig. 5. The display device 216 can display the resection line 4C shown in Fig. 9 as the determined resection line.

[0132] 15 is a schematic diagram showing an example of a display screen for the first distance measurement in the distance measurement step. The display window 320 shown in the figure is an example of a display mode in the distance measurement step S18. The display window 320 can also be used to display the processing results in the lesion area extraction step S14 and the resection plane determination step S16.

[0133] 15 includes a main display area 322, a first sub-display area 324A, a second sub-display area 324B, and a third sub-display area 324C. The main display area 322 is disposed in the center of the display window 320.

[0134] The first sub-display area 324A, the second sub-display area 324B, and the third sub-display area 324C are arranged on the left side of the main display area 322 in the same figure. The first sub-display area 324A, the second sub-display area 324B, and the third sub-display area 324C are arranged side by side in the vertical direction in the same figure.

[0135] In FIG. 15, an axial cross-sectional image is displayed in the main display area 322, and an arbitrary position of the resection line 301 is displayed. Place and An arrow line 332 indicating the distance to the cancer 5 is superimposed on the axial cross-sectional image. Instead of the arrow line 332, a numerical value may be displayed.

[0136] 15 shows the cross-sectional image 310 shown in FIG. 14 as an axial cross-sectional image. The same is true for the axial cross-sectional images in each of FIGS.

[0137] Fig. 16 is a schematic diagram showing an example of a display screen for the second distance measurement in the distance measurement step. Fig. 16 shows an example in which an arrow line 334 indicating the distance between the resection line 301 and the nerve 3 is displayed. The arrow line 332 shown in Fig. 15 and the arrow line 334 shown in Fig. 16 may be displayed on the same display screen.

[0138] The arrow line 332 shown in FIG. 15 and the arrow line 334 shown in FIG. 16 may be displayed for all distance measurement positions, or may be displayed for some distance measurement positions such as representative measurement positions.

[0139] Fig. 17 is a schematic diagram showing an example of the display of a first color map. This figure shows the first color map 312 shown in Fig. 14. The first color map 312 shown in Fig. 17 uses both line width and color to display the nearest neighbor distance. That is, depending on the nearest neighbor distance between the resection line 301 and the cancer 5, the first color map 312 becomes darker as the nearest neighbor distance between the resection line 301 and the cancer 5 becomes relatively shorter, and becomes lighter as the nearest neighbor distance between the resection line 301 and the cancer 5 becomes relatively longer.

[0140] For example, the first color region 312A in the first color map 312 is darker than the second color region 312B and the third color region 312C, and the resection line 301 and the cancer 5 are closer in the first color region 312A than in the second color region 312B and the third color region 312C.

[0141] The first color map 312 shown in Figure 17 shows a stepwise change in the nearest neighbor distance between the resection line 301 and the cancer 5, but a first color map that continuously shows a change in the nearest neighbor distance between the resection line 301 and the cancer 5 may also be applied.

[0142] The first color map 312 shown in FIG. 17 represents the difference in the nearest neighbor distance between the resection line 301 and the cancer 5 by applying density, but also represents the difference in the nearest neighbor distance between the resection line 301 and the cancer 5 by applying color, saturation of the same color, and brightness of the same color. , cut It may also represent the difference in nearest neighbor distance between the exclusion line 301 and the cancer 5. The same applies to the second color map 314 shown in FIG.

[0143] Fig. 18 is a schematic diagram showing an example of a display of the second color map. This figure shows the second color map 314 shown in Fig. 14. The second color map 314 is configured in the same manner as the first color map 312 shown in Fig. 17. A detailed description of the second color map 314 will be omitted here.

[0144] 19 is a schematic diagram showing a display example of a color map according to a modified example, in which a first color map 312 and a second color map 314 are superimposed on a cross-sectional image 310.

[0145] Either the first color map 312 or the second color map 314 may be selectively superimposed on the cross-sectional image 310. A mode in which only the first color map 312 is displayed, a mode in which only the second color map 314 is displayed, or a mode in which both the first color map 312 and the second color map 314 are displayed may be selectively switched in response to a user input.

[0146] 15 to 19 illustrate examples of displaying the first color map 312 and the second color map 314 shown in FIG. 14, but the first color map 302 and the second color map 304 shown in FIG. 13 may also be displayed.

[0147] [Example of application to volume rendering images] Similar to the cross-sectional image 300 shown in Figure 13, the first distance information corresponding to the first color map 302 and the second distance information corresponding to the second color map 304 shown in Figure 13 can also be superimposed on the volume rendering image.

[0148] 10 may generate a volume rendering image from a group of multiple cross-sectional images. The display image generation unit 234 may generate multiple volume rendering images with different user viewpoints. The display image generation unit 234 may generate a color map corresponding to the volume rendering image.

[0149] Fig. 20 is a schematic diagram showing an example of displaying three-dimensional distance information in a volume rendering image. Fig. 20 shows a volume rendering image 400 viewed from above, showing a resection plane 402, a tumor 404 as the tissue to be resected, and a blood vessel 410 as the tissue to be preserved.

[0150] An arrow 420 indicates the direction of the viewpoint when viewing the resection surface 402 from the blood vessel 410 side. An arrow 422 indicates the direction of the viewpoint when viewing the resection surface 402 from the tumor 404 side.

[0151] A first color map 406A is superimposed on the tumor 404 at a position opposite the resection plane 402. The first color map 406A represents information on the nearest neighbor distance between the resection plane 402 and the tumor 404. The first color map 406A is applied to a volume rendering image viewed from the tumor 404 side of the resection plane 402.

[0152] Fig. 21 is a schematic diagram of Fig. 20 viewed from the tissue-preserving target side. In the volume rendering image 424 shown in Fig. 21, a first color map 406B is displayed on the surface of the resection surface 402 on the blood vessel 410 side.

[0153] The position of the first color map 406B on the resection plane 402 corresponds to the position of the tumor 404 when the tumor 404 is projected onto the resection plane 402. The position of the tumor 404 may be the position of the center of gravity of the tumor 404. The shape of the first color map 406B corresponds to the shape of the tumor 404 when the tumor 404 is projected onto the resection plane 402.

[0154] The first color map 406B is located on the opposite side of the resection surface 402 from the blood vessel 410 and indicates the nearest distance between the tumor 404, which is not visible in the volume rendering image 424, and the resection surface 402. Colors that can be distinguished from the resection surface 402 and the blood vessel 410 are applied to the first color map 406B.

[0155] The first color map 406B is applied with a density according to the nearest neighbor distance between the tumor 404 and the resection surface 402. For example, when the nearest neighbor distance between the tumor 404 and the resection surface 402 is relatively short, the density of the first color map 406B is made relatively dark.

[0156] The volume rendering image 424 may be superimposed with a second color map that indicates the nearest distance between the resection surface 402 and the blood vessel 410. The second color map is not shown in FIG.

[0157] Fig. 22 is a schematic diagram of Fig. 20 viewed from the side of the tissue to be resected. In the volume rendering image 430 shown in Fig. 22, a second color map 412B is superimposed on the surface of the resection surface 402 on the side of the tumor 404.

[0158] The second color map 412B is on the opposite side of the resection surface 402 from the tumor 404 and indicates the nearest neighbor distance between the resection surface 402 and the blood vessel 410 that is not visible in the volume rendering image 430. The first color map 406B is applied with colors that allow the resection surface 402 and the tumor 404 to be distinguished from each other.

[0159] The volume rendering image 430 may be superimposed with a first color map that indicates the nearest neighbor distance between the resection plane 402 and the tumor 404. The first color map is not shown in FIG.

[0160] The position of the second color map 412B on the resection surface 402, the shape of the second color map 412B, and the display mode of the nearest neighbor distance between the resection surface 402 and the blood vessel 410 are the same as those of the first color map 406B shown in FIG.

[0161] Fig. 23 is a schematic diagram showing a display example of three-dimensional distance information applied to each tissue shown in Fig. 20. In the volume rendering image 440 shown in Fig. 23, a first color map 406A representing the nearest neighbor distance between the resection surface 402 and the tumor 404 and a second color map 412A representing the nearest neighbor distance between the resection surface 402 and the blood vessel 410 are superimposed and displayed.

[0162] The first color map 406A is the tissue on the tumor 404 side of the resection surface 402, and is displayed on the tissue between the resection surface 402 and the tumor 404. The second color map 412A is the tissue on the blood vessel 410 side of the resection surface 402, and is displayed on the tissue between the resection surface 402 and the blood vessel 410.

[0163] That is, in the volume rendering image viewed from the viewpoint of the tissue to be preserved, if the tissue to be resected is on the opposite side of the resection plane and cannot be seen, a first color map is displayed on the resection plane, and a second color map is displayed on the tissue between the resection plane and the tissue to be preserved.

[0164] Similarly, in the volume rendering image viewed from the viewpoint of the tissue to be resected, if the tissue to be preserved is on the opposite side of the resection plane and the tissue to be preserved is not visible, the second color map is displayed on the resection plane, and the first color map is displayed on the tissue between the resection plane and the tissue to be preserved.

[0165] [Application to medical information systems] 24 is a block diagram showing an example of the configuration of a medical information system including a medical image processing apparatus according to an embodiment. The medical information system 100 is a computer network established in a medical institution such as a hospital.

[0166] The medical information system 100 includes a modality 30 for capturing medical images, a DICOM server 40, a medical image processing device 20, an electronic medical record system 44, and a viewer terminal 46. The components of the medical information system 100 are connected via a communication line 48. The communication line 48 may be an in-house communication line within a medical institution. Alternatively, part of the communication line 48 may be a wide-area communication line.

[0167] Examples of modalities 30 include a CT device 31, an MRI device 32, an ultrasound diagnostic device 33, a PET device 34, an X-ray diagnostic device 35, an X-ray fluoroscopic diagnostic device 36, and an endoscopy device 37. There may be various combinations of types of modalities 30 connected to communication line 48 depending on the medical institution. PET is an abbreviation for Positron Emission Tomography.

[0168] The DICOM server 40 is a server that operates in accordance with the DICOM specifications. The DICOM server 40 is a computer that stores and manages various data, including images captured using the modality 30, and is equipped with a large-capacity external storage device and a database management program.

[0169] The DICOM server 40 communicates with other devices via a communication line 48, sending and receiving various data including image data. The DICOM server 40 receives various data including image data generated using the modality 30 via the communication line 48, and stores and manages the data on a recording medium such as a large-capacity external storage device. The storage format of the image data and communication between devices via the communication line 48 are based on the DICOM protocol.

[0170] The medical image processing device 20 can acquire data from the DICOM server 40 or the like via a communication line 48. The medical image processing device 20 can also send processing results to the DICOM server 40 and the viewer terminal 46. . medicine The processing functions of the medical image processing apparatus 20 may be installed in the DICOM server 40 or the viewer terminal 46.

[0171] Various types of data stored in the database of the DICOM server 40 and various types of information including the processing results generated by the medical image processing apparatus 20 can be displayed on the viewer terminal 46.

[0172] The viewer terminal 46 is a terminal for viewing images, called a PACS viewer or a DICOM viewer. Multiple viewer terminals 46 can be connected to the communication line 48. The form of the viewer terminal 46 is not particularly limited, and may be a personal computer, a workstation, a tablet terminal, or the like. The viewer terminal 46 may be configured so that the input device can be used to specify the lesion area and the measurement reference plane, for example.

[0173] [Example of application to a program that runs a computer] A program that causes a computer to realize the processing functions of the medical image processing device 20 can be stored in a computer-readable medium, such as an optical disk, a magnetic disk, a semiconductor memory, or other tangible, non-transitory information storage medium, and the program can be provided through the information storage medium.

[0174] Furthermore, instead of providing a program stored on a tangible, non-transitory computer-readable medium, it is also possible to provide a program signal as a download service using a telecommunications line such as the Internet.

[0175] The hardware structure of the processing units that execute various processes in the medical image processing device 20, such as the image acquisition unit 222, the lesion area extraction unit 224, the lesion area input reception unit 226, the resection plane extraction unit 228, the resection plane input reception unit 230, the distance measurement unit 232, and the display image generation unit 234, is, for example, various processors as shown below. Note that the processing units may include aspects called processing units. Note It may be referred to as a processor.

[0176] Various types of processors include CPUs, which are general-purpose processors that execute programs and function as various processing units, GPUs, which are processors specialized for image processing, programmable logic devices such as FPGAs, which are processors whose circuit configuration can be changed after manufacturing, and dedicated electrical circuits such as ASICs, which are processors with circuit configurations designed specifically to execute specific processes.

[0177] FPGA is an abbreviation for Field Programmable Gate Array. ASIC is an abbreviation for Application Specific Integrated Circuit. Programmable logic devices can be called PLDs, which are an abbreviation of Programmable Logic Devices in English.

[0178] A single processing unit may be composed of one of these various processors, or two or more processors of the same or different types. For example, a single processing unit may be composed of multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU. Multiple processing units may also be composed of a single processor. Examples of multiple processing units composed of a single processor include, first, a configuration in which a single processor is composed of a combination of one or more CPUs and software, as typified by client or server computers, and this processor functions as multiple processing units. Second, a configuration in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC chip, as typified by a system-on-chip. In this way, the various processing units are composed of one or more of the above-mentioned various processors as a hardware structure.

[0179] The system on chip can be referred to as SoC, which is an abbreviation of System On Chip in English. IC is an abbreviation of Integrated Circuit.

[0180] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements. Note that an electric circuit can be referred to using the English term circuitry.

[0181] [Operational effects of the medical image processing apparatus according to the embodiment] The medical image processing apparatus 20 according to the embodiment provides the following advantageous effects.

[0182] [1] When resecting tissue to be resected, such as a lesion area, a resection plane is specified between the tissue to be resected and the tissue to be preserved, and the nearest distance between the resection plane and the tissue to be resected and the nearest distance between the resection plane and the tissue to be preserved are measured. Based on the measurement results, first distance information representing information on the nearest distance between the resection plane and the tissue to be resected and second distance information representing information on the nearest distance between the resection plane and the tissue to be preserved are superimposed and displayed on the two-dimensional cross-sectional image. This can assist in determining the resection plane when resecting the tissue to be resected.

[0183] [2] The first distance information displayed on the cross-sectional image is displayed on the side of the tissue to be resected of the resection plane, in the outer edge region of the resection plane, thereby preventing a decrease in visibility of the resection plane and allowing the visibility of the first distance information and the side to which the first distance is applied to be grasped at a glance.

[0184] [3] The second distance information displayed on the cross-sectional image is displayed on the side of the tissue to be preserved on the resection plane, in the outer edge region of the resection plane. This prevents a decrease in visibility of the resection plane, and improves the visibility and two It is possible to see at a glance which side the distance applies to.

[0185] [4] The first distance information displayed on the volume rendering image is displayed on the side of the resection plane that is the tissue to be preserved, so that the first distance information corresponding to the tissue to be resected that is hidden by the resection plane can be visually recognized.

[0186] [5] The second distance information displayed on the volume rendering image is displayed on the side of the resection plane that is the tissue to be resected, so that the second distance information corresponding to the tissue to be preserved that is hidden by the resection plane can be visually recognized.

[0187] [6] A color map is applied to the first distance information and the second distance information, so that a user looking at the first distance information and the second distance information can understand the content of the first distance information at a glance.

[0188] The above-described embodiments of the present invention may be modified, added, or deleted as appropriate within the scope of the spirit of the present invention. The present invention is not limited to the above-described embodiments, and many modifications may be made by a person skilled in the art within the technical concept of the present invention. Furthermore, the embodiments, modifications, and applications may be implemented in appropriate combinations. [Explanation of symbols]

[0189] 1 rectum 2 fat 3. Nerves 4 Resection surface 4A Resection line 4B Resection line 4C Resection line 5. Cancer 6 boundaries 7 areas 20 Medical image processing device 30 Modalities 31 CT device 32 MRI machine 33 Ultrasound diagnostic equipment 34 PET equipment 35 X-ray diagnostic equipment 36 X-ray fluoroscopy equipment 37 Endoscopic equipment 40 DICOM Server 44 Electronic Medical Record System 46 viewer terminals 48 Communication Lines 100 Medical Information Systems 202 processors 204 Computer-readable medium 206 Communication Interface 208 Input / Output Interface 210 Bus 214 Input Device 216 Display device 220 Medical Image Processing Program 222 Image acquisition unit 224 Lesion area extraction unit 226 Lesion area input reception unit 228 Excision surface extraction part 230 Resection surface input reception unit 232 Distance measurement unit 234 Display image generation unit 260 Display Control Program 300 cross-sectional images 302 First Color Map 304 Second Color Map 310 cross-sectional images 312 First Color Map 312A First Color Area 312B Second Color Area 312C Third Color Area 314 Second Color Map 320 display window 322 Main Display Area 324A First sub display area 324B Second sub display area 324C Third sub-display area 332 Arrow Line 334 Arrow Line 402 Resection plane 404 Tumor 406A First Color Map 406B First Color Map 410 Blood vessels 412A Second Color Map 412B Second Color Map 420 Arrow Line 422 Arrow Line 424 Volume Rendered Images 430 Volume Rendered Images 440 volume rendering images ME Mesorectum MP muscularis propria TU Cancer S12~S30 Each step of the medical image processing method

Claims

1. a processor; a storage device in which a program executed by the processor is stored, The processor executes the instructions of the program, Acquire three-dimensional medical images, setting a separation plane for separating a first region identified in the medical image; measuring a first distance, which is the closest distance between an arbitrary position on the surface of the first region and the separation surface; measuring a second distance, which is the nearest distance between an arbitrary position on the surface of the second region identified in the medical image and the separation surface; A medical image processing apparatus that displays at least one of first distance information representing the first distance and second distance information representing the second distance when displaying the medical image on a display device.

2. The processor: The medical image processing device according to claim 1 , wherein when a cross-sectional image corresponding to an arbitrary cross-section in the medical image is displayed on the display device, the first distance information is displayed in an outer edge region on the side of the first region of the separation surface.

3. The processor:

3. A medical image processing device as described in claim 1 or 2, wherein when a cross-sectional image corresponding to any cross-section in the medical image is displayed on the display device, the second distance information is displayed in an outer edge area on the side of the second area of ​​the separation surface.

4. The processor: The medical image processing apparatus according to claim 1 , wherein the first distance information and the second distance information are displayed using a color map that represents distance using color.

5. The processor: displaying a volume rendering image corresponding to the medical image on the display device; The medical image processing apparatus according to claim 1 , wherein at least one of the first distance information and the second distance information is displayed superimposed on the volume rendering image.

6. The processor: The medical image processing apparatus according to claim 5 , wherein a display mode of the first distance information and a display mode of the second distance information are changed depending on a user's viewpoint on the volume rendering image.

7. The processor: The medical image processing device according to claim 6 , wherein, when the first region is present on the side of the separation plane on which the user's viewpoint is located in the volume rendering image, the first distance information is superimposed on the first region.

8. The processor: The medical image processing device according to claim 6 or 7, wherein when the second region exists on the opposite side of the separation surface from the user's viewpoint in the volume rendering image, the second distance information is superimposed on the separation surface.

9. The processor: The medical image processing device according to claim 6 , wherein, when the first region exists on the opposite side of the separation plane from the user's viewpoint in the volume rendering image, the first distance information is superimposed and displayed on the separation plane.

10. The processor:

10. A medical image processing device according to claim 6 or 9, wherein, when the second region is present on the side of the separation surface on which the user's viewpoint is located in the volume rendering image, the second distance information is superimposed on the second region.

11. The computer Acquire three-dimensional medical images, setting a separation plane for separating a first region identified in the medical image; measuring a first distance, which is the closest distance between an arbitrary position on the surface of the first region and the separation surface; measuring a second distance, which is the nearest distance between an arbitrary position on the surface of the second region identified in the medical image and the separation surface; A medical image processing method in which, when the medical image is displayed on a display device, at least one of first distance information representing the first distance and second distance information representing the second distance is displayed.

12. On the computer, The ability to capture three-dimensional medical images; a function of setting a separation plane when separating a first region identified in the medical image; a function of measuring a first distance, which is the closest distance between an arbitrary position on the surface of the first region and the separation surface; a function of measuring a second distance, which is the nearest distance between an arbitrary position on the surface of a second region identified in the medical image and the separation surface; and A program that realizes the function of displaying at least one of first distance information representing the first distance and second distance information representing the second distance when the medical image is displayed on a display device.

13. A non-transitory computer-readable recording medium on which the program according to claim 12 is recorded.

Images