Medical image processing device, medical image processing program and medical image processing method

The medical image processing device addresses the challenges of large data and processing time in conventional systems by extracting contour lines and evaluating curvature and radius change rate to estimate thrombosis risk efficiently.

JP2024161818AActive Publication Date: 2024-11-20中岛 康博 +2
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023076878
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-08
Publication Date
2024-11-20
Estimated Expiration
2043-05-08

AI Technical Summary

Technical Problem

Conventional medical image diagnostic apparatuses face challenges with large data amounts, increased calculation loads, and prolonged processing times when generating three-dimensional and two-dimensional morphological images, making it difficult to automatically estimate the risk of plaque detachment leading to thrombosis.

Method used

A medical image processing device that extracts a contour line from a blood vessel cross-section, detects radius change rate and curvature, sets an evaluation value based on these parameters, and displays it to estimate the risk of thrombosis.

Benefits of technology

Reduces calculation load and enables easy estimation of plaques with a high risk of thrombosis, improving diagnostic efficiency by reducing processing time and data volume.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024161818000001_ABST
    Figure 2024161818000001_ABST
Patent Text Reader

Abstract

To reduce a computational load and easily estimate plaque with a high risk of thrombosis.SOLUTION: A medical image processing device 1 acquires a medical image that includes an image of a blood vessel cross-section acquired by a medical diagnostic device, extracts a contour line 131a corresponding to the surface of the blood vessel inner wall from the image of the blood vessel cross-section included in the medical image, detects the radius change rate in the circumferential direction of the contour line 131a, detects the curvature in the circumferential direction of the contour line 131a, sets an evaluation value determined according to the risk of thrombosis on the blood vessel cross-section from the radius change rate or curvature, and displays the evaluation value on display means.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a medical image processing apparatus, a medical image processing program, and a medical image processing method for processing medical images including, for example, images of blood vessel cross sections captured by a medical image capture apparatus. [Background technology]

[0002] One of the main causes of thrombosis, such as cerebral infarction and myocardial infarction, is the detachment (rupture) of substances (plaques) such as cholesterol and fats that are attached to the intima of blood vessels. When plaque detaches from the intima of blood vessels due to some factor, a blood clot forms at the detached site, which then travels through the bloodstream and blocks the blood vessel (coronary artery, etc.), causing thrombosis. In order to prevent or treat such thrombosis early, it is important to detect plaques that are likely to detach early.

[0003] Furthermore, in order to reduce the physical burden on the patient during the examination, a technology has been proposed for estimating plaque properties based on the CT images (cross-sectional images) of the patient (Patent Document 1). The medical image diagnostic device of the prior art described in Patent Document 1 generates three-dimensional and two-dimensional morphological images based on the CT images, estimates the positions of multiple plaques in the blood vessel and the hardness of each plaque based on the morphological images, and further extracts the vascular wall structure and core line structure from the morphological images, and identifies plaques that are likely to detach from the multiple plaques based on the stress value and hardness applied to the blood vessel wall due to pulsation that are determined from the vascular wall structure and core line structure.

[0004] However, in conventional medical image diagnostic devices, the amount of data generated is huge because 3D and 2D morphological images are generated, which results in problems such as a large computational load and increased processing time.In addition, it remains difficult to automatically estimate or determine the detachment possibility (rupture possibility) and risk of plaque discovered based on CT images, that is, to estimate or determine plaque with a high risk of thrombosis, and ultimately, doctors check the medical images to make a judgment. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-108199 A Summary of the Invention [Problem to be solved by the invention]

[0006] In view of the above-mentioned problems, an object of the present invention is to provide a medical image processing device, a medical image processing program, and a medical image processing method that can reduce the computational load and easily estimate plaques with a high risk of thrombosis. [Means for solving the problem]

[0007] The present invention is characterized in that it provides a medical image processing device, a medical image processing program, and a medical image processing method comprising: an image acquisition unit that acquires a medical image including an image of a blood vessel cross-section captured by a medical imaging device; a contour extraction unit that extracts a contour corresponding to the surface of the inner wall of the blood vessel from the image of the blood vessel cross-section included in the medical image; a radius change rate detection unit that detects a radius change rate in the circumferential direction of the contour; a curvature detection unit that detects the curvature of the contour in the circumferential direction; an evaluation value setting unit that sets an evaluation value determined based on the radius change rate or the curvature in the blood vessel cross-section according to the risk of thrombosis in the blood vessel cross-section; and an evaluation value display unit that displays the evaluation value on a display means. Effect of the Invention

[0008] According to the present invention, it is possible to provide a medical image processing apparatus, a medical image processing program, and a medical image processing method that can reduce the calculation load and easily estimate plaques with a high risk of thrombosis. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a medical image processing apparatus according to the present invention. [Diagram 2]FIG. 2 is an explanatory diagram showing an example of data stored in an auxiliary storage unit of the medical image processing apparatus. [Diagram 3] FIG. 13 is an explanatory diagram showing an example of a screen configuration of an image processing screen in a basic state. [Figure 4] FIG. 4 is an explanatory diagram showing an example of the screen configuration of an image processing screen on which a medical image is displayed. [Figure 5A] FIG. 4 is an explanatory diagram showing an example of a medical image before contour line extraction processing. [Figure 5B] FIG. 11 is an explanatory diagram showing an example of a mask image after contour line extraction. [Figure 6] FIG. 13 is an explanatory diagram showing an example of pre-processing for setting a circumscribing circle or the like from a contour line. [Figure 7] 11 is a graph showing the distances between a central position and multiple measurement points that make up a contour line. [Figure 8] FIG. 4 is an explanatory diagram showing an example of a method for detecting roughness. [Figure 9] FIG. 11 is an explanatory diagram showing an example of a method for setting an evaluation value in a composite evaluation. [Figure 10] FIG. 13 is an explanatory diagram showing an example of the screen configuration of an image processing screen in a state in which an evaluation value is displayed. [Figure 11] FIG. 13 is an explanatory diagram showing an example of a screen configuration of an image processing screen in a state where a contour line is displayed in an enlarged manner. [Figure 12] FIG. 13 is an explanatory diagram showing another example of the screen configuration of the image processing screen in a state where a contour line is displayed in an enlarged manner. [Figure 13] FIG. 13 is an explanatory diagram showing another example of the screen configuration of the image processing screen in a state where a storage menu is displayed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] 1 is a block diagram showing an example of the configuration of a medical image processing device 1 that processes medical images including blood vessel cross sections. The medical image processing device 1 is an electronic device (computer) having at least an image processing function. The medical image processing device 1 is a stationary computer or a portable computer, and is configured as a general-purpose computer (terminal) such as a desktop PC, a notebook (laptop) PC, or a tablet PC.

[0012] A medical image is a cross-sectional image of a subject (patient) captured by a medical imaging device, and is an image including at least an image of a blood vessel cross section. In other words, a medical image is an image including at least an image of a human blood vessel cross section. For example, a medical image is an image (CT image) including cross-sectional images at multiple slice positions in the patient's body axis direction captured by a CT device, or cross-sectional images (transverse cross-sectional images) perpendicular to the blood vessel core line. Note that a medical image is not limited to a CT image, and may be an image captured by an MRI device or the like.

[0013] 1, the medical image processing device 1 includes a control unit 11, an input unit 12, a display unit 13, a storage medium connection unit 14, a communication unit 15, and an auxiliary storage unit 16. Each of the input unit 12, the display unit 13, the storage medium connection unit 14, the communication unit 15, and the auxiliary storage unit 16 is electrically connected to the control unit 11 via a communication line or the like (so that signals that can be processed by a computer can be mutually transmitted and received).

[0014] The control unit 11 includes a calculation unit 11a and a main memory unit 11b, and executes various calculations and control operations in the medical image processing device 1. The calculation unit 11a is an arithmetic processing unit having a CPU or an MPU, etc. The main memory unit 11b has a RAM (DRAM) and a ROM, etc. The RAM is used as a work area and a buffer area for the calculation unit 11a. Program data stored in the auxiliary memory unit 16 and data required for executing the programs are appropriately expanded in the RAM. The ROM stores the startup program of the medical image processing device 1 and default values ​​for various information, etc.

[0015] The input unit 12 includes an input component that accepts operation input from the user of the medical image processing device 1, and an input detection circuit that is interposed between the input component and the calculation unit 11a. The input component is, for example, a touch panel (touch input means), hardware operation keys (hardware keys), a computer mouse, etc. The touch panel may be of any type, such as a capacitance type, an electromagnetic induction type, a resistive film type, or an infrared type. The input detection circuit outputs an operation signal or operation data corresponding to the operation (operation input) of each input component to the calculation unit 11a.

[0016] The display unit 13 includes a display and a display control circuit interposed between the display and the calculation unit 11a. For example, an LCD (liquid crystal display) or an organic EL display can be used as the display. The display control circuit includes a GPU and a VRAM. Under the instruction of the calculation unit 11a, the GPU generates display image data in the VRAM for displaying various screens (such as an image processing screen 100 described later) on the display using image generation data stored in the RAM, and outputs a display image corresponding to the display image data generated in the VRAM to the display.

[0017] When the input unit 12 has a touch panel, the touch panel may be provided so as to overlap the display surface of the display of the display unit 13. In this case, the touch panel cooperates with the display of the display unit 13 to configure a display with a touch panel (touch panel display). When a touch panel display is configured, a GUI (Graphical User Interface) including software keys (operation keys or operation buttons) may be displayed on the display of the display unit 13. In this case, operation input can be accepted via the GUI (operation screen). Note that the software keys refer to operation keys (operation buttons) reproduced by software on the display surface of the display of the display unit 13, for example. Hereinafter, software keys provided (displayed) on the GUI will be simply referred to as "buttons".

[0018] The storage medium connection unit 14 is an interface (external memory connection unit) for reading data from various storage media (hereinafter referred to as "external memory") such as a USB memory and writing data to the external memory. For example, the external memory is an optical disk (e.g., CD-R, DVD-R, BD-R, etc.) and a flash memory (e.g., USB memory, SD memory card, memory stick, etc.). The storage medium connection unit 14 has a mounting unit (e.g., an optical drive capable of mounting an optical disk or a memory slot capable of mounting a flash memory) for mounting various types of external memory. The control unit 11 can read data from the external memory connected to the storage medium connection unit 14 and can also write data to the external memory connected to the storage medium connection unit 14.

[0019] The communication unit 15 includes a communication circuit for connecting to a dedicated line or a public line (public network) such as the Internet. The communication circuit is a wired communication circuit or a wireless communication circuit, and is connected to other electronic devices (external computers) such as medical imaging devices such as an X-ray CT device or an MRI device so as to be able to communicate with each other via the dedicated line or the public line according to instructions from the calculation unit 11a.

[0020] The auxiliary storage unit 16 is composed of other non-volatile memories such as an HDD, an SSD, a flash memory, and an EEPROM, and stores programs and various data for the calculation unit 11a to control the operation of the medical image processing apparatus 1.

[0021] The auxiliary storage unit 16 of the medical image processing device 1 stores (registers) various data used by the medical image processing device 1, such as data for executing medical image processing. The auxiliary storage unit 16 also stores a user program 20 for executing various operations of the medical image processing device 1 in response to operation inputs by a user of the medical image processing device 1, and user data 21 necessary for the operation of the medical image processing device 1.

[0022] The user program 20 and the user data 21 are read out from the auxiliary storage unit 36 ​​as necessary and stored (expanded) in the main storage unit 11b (RAM). The operation of the medical image processing device 1 is realized by the calculation unit 11a executing the user program 20 expanded in the main storage unit 11b (RAM).

[0023] The user program 20 includes a plurality of programs for executing medical image processing. For example, the user program 20 includes a main processing program 20a for selecting and executing various functions provided in the medical image processing device 1, a screen display program 20b for displaying various screens on the display of the display unit 13, a contour line extraction program 20c for extracting a contour line (closed cross section) corresponding to the surface of the blood vessel inner wall from a medical image, a radius change rate detection program 20d for detecting a radius change rate in the circumferential direction of the contour line, a curvature detection program 20e for detecting a curvature in the circumferential direction of the contour line, a concavity detection program 20f for detecting a depth of a concavity (degree of concavity: concavity degree) corresponding to a distance from a circumscribed circle of the contour line, and an evaluation value setting program 20g for setting an evaluation value (including an average evaluation value setting unit in medical images) determined according to the risk of thrombosis in the contour line (blood vessel cross section). The user program 20 may also include a roughness detection program for detecting the roughness of the contour line.

[0024] The user data 21 includes data such as medical image data (medical image data) 21a, contour data extracted from the medical image (contour data) 21b, data on the radius change rate at the contour (radius change rate data) 21c, data on the curvature at the contour (curvature data) 21d, data on the concavity at the contour (concaveness data) 21e, data such as reference values ​​for setting an evaluation value from the radius change rate, curvature, or concavity (evaluation data) 21f, and data on the evaluation value at the contour (evaluation value data) 21g.

[0025] It should be noted that the configuration of the medical image processing apparatus 1 shown in FIG. 1 and FIG. 2 is merely an example, and is not limited thereto, and can be appropriately changed according to the needs of the specifications of the medical image processing apparatus 1, etc. <Example of medical image processing>

[0026] In the medical image processing device 1 of the present invention, medical image processing for setting an evaluation value according to the risk of thrombosis from a medical image is executed by the operation of the control unit 11. That is, in the medical image processing, the risk of thrombosis can be estimated from the evaluation value set for the medical image.

[0027] 3 to 13 are explanatory diagrams showing examples of various screens or images related to medical image processing using medical images. Various screens or images related to medical image processing are displayed on the display of the display unit 13 by executing a screen display program 20b in the control unit 11. An example of the operation of medical image processing executed by the medical image processing device 1 will be described with reference to FIGS. 3 to 13. Note that the various operations are realized by the control unit 11 controlling the hardware constituting the medical image processing device 1 and operating in accordance with the various programs stored in the medical image processing device 1.

[0028] 3, when medical image processing is executed, an image processing screen 100 is displayed on the display unit 13 of the medical image processing device 1. Hereinafter, it is assumed that various operation screens shown in FIGS. 3 to 13 are displayed on the display of the display unit 13 of the medical image processing device 1.

[0029] The image processing screen 100 is a basic screen in medical image processing, and is a screen for acquiring a medical image (medical image to be analyzed) that is the subject of image processing (subject to analysis), analyzing the medical image to be analyzed, and displaying an evaluation value for the medical image to be analyzed that is set according to the risk of thrombosis.

[0030] 3 shows an initial state of the image processing screen 100, before the medical image to be analyzed is displayed (acquired). The image processing screen 100 includes an operation execution section 101, an image display section 102, a function selection section 103, and a cancel button 104.

[0031] The operation execution unit 101 is provided to cause the medical image processing apparatus 1 to execute operations such as reading out a medical image to be analyzed and setting an evaluation value for the medical image to be analyzed according to the risk of thrombosis. The operation execution unit 101 has a medical image acquisition button 101a and an analysis execution button 101b.

[0032] The medical image acquisition button 101a is a button to which a function of acquiring a medical image to be analyzed (specifying a medical image to be analyzed from readable medical images) is assigned. When the medical image acquisition button 101a is selected (operated), a window (image selection window) for selecting a medical image to be acquired is displayed, and an arbitrary medical image can be selected (specified) as an analysis target. Although not shown, in the image selection window, a directory in the auxiliary storage unit 16 or a directory in an external memory connected to the storage medium connection unit 14 can be selected, and an arbitrary medical image can be acquired by selecting data of a medical image stored in the arbitrary directory (data of the medical image is read out).

[0033] In the medical image processing of the present invention, one (single) medical image can be acquired as the medical image to be analyzed, and multiple medical images with different axial positions of blood vessels can also be acquired together (as an image set containing multiple medical images) as the medical image to be analyzed. When multiple medical images are acquired as the medical image to be analyzed, a number (page number) is assigned to each of the multiple medical images, and the medical image can be switched by the number selection unit 100a provided on the image processing screen 100.

[0034] The analysis execution button 101b is a button to which a function of displaying an evaluation value for a medical image to be analyzed is assigned. However, as shown in Fig. 3, the analysis execution button 101b is disabled and cannot be selected in a state before the medical image to be analyzed is acquired (medical image non-display state). Note that, in the disabled state, the analysis execution button 101b is displayed semi-transparently, grayed out, or in a low-luminance color.

[0035] The image processing screen 100 in Fig. 4 shows a state after a medical image to be analyzed has been acquired. As shown in Fig. 4, the analysis execution button 101b is enabled and selectable in the state after a medical image to be analyzed has been acquired (medical image display state).

[0036] The operation of selecting the medical image acquisition button 101a, the analysis execution button 101b, and various other buttons includes a tap operation on a touch panel, a click operation with a computer mouse (mouse pointer), and the like.

[0037] The cancel button 104 is assigned a function of stopping (canceling) the process being executed when the medical image acquisition button 101a or the analysis execution button 101b is selected and various processes (medical image readout process or analysis process) are being executed (before the medical image readout process or analysis process is completed). For example, when it is taking a long time to read a medical image with a large amount of data or when it is taking a long time to analyze the image, the cancel button 104 can be selected to stop the process being executed.

[0038] 3 and 4, the image display unit 102 is an area in which a part or all of a medical image to be analyzed, or various images related to the medical image to be analyzed, are displayed. In this embodiment, the image display unit 102 is disposed at the upper center of the image processing screen 100.

[0039] Moreover, the display area of ​​the image display unit 102 occupies 40% to 60% of the area of ​​the image processing screen 100. In this way, by enlarging the display area of ​​the image display unit 102, the medical image to be analyzed can be displayed in a large size, and the visibility of the medical image to be analyzed can be improved.

[0040] 3, before the medical image to be analyzed is acquired, only a monochrome (e.g., achromatic) background image is displayed on the image display unit 102. On the other hand, once the medical image to be analyzed is acquired, the image display unit 102 displays the medical image to be analyzed, as shown in FIG.

[0041] The medical image displayed on the image display unit 102 can be enlarged / reduced and moved. For example, if the input unit 12 has a computer mouse, the medical image can be enlarged / reduced by operating the mouse wheel, and the medical image can be moved (moved relatively to the display area of ​​the image display unit 102) by dragging (a slide operation after touching within the display area of ​​the medical image).

[0042] Further, a scroll bar 102a for vertically moving (scrolling) the display area of ​​the image display unit 102 for medical images is provided near the image display unit 102. The scroll bar 102a has a bar extending in a rod shape, arrow buttons (arrows) arranged at the upper and lower ends of the bar, and a knob movably provided on the bar. The medical image displayed on the image display unit 102 moves up and down according to the position of the knob. In this embodiment, the scroll bar 102a is vertically disposed so as to be adjacent to the right end of the image display unit 102. That is, the scroll bar 102a is a vertical scroll bar.

[0043] When the analysis execution button 101b is selected (operated) in the medical image display state, a contour line corresponding to the surface of the blood vessel inner wall is extracted from the blood vessel cross-sectional image (blood vessel cross-sectional image) included in the medical image. Then, an evaluation value according to the risk of thrombosis (according to the properties of plaque) is set from the shape of the extracted contour line (shape of the blood vessel inner wall).

[0044] A method for setting the evaluation value will be described below. First, a contour corresponding to the contour shape of the vascular inner wall surface is extracted from the medical image according to the contour extraction program 20c (contour extraction step). The contour extraction step will be briefly described. For example, it is assumed that a medical image 120 including a vascular cross-sectional image (vascular cross-sectional image) 121 as shown in FIG. 5A is set as a medical image to be analyzed. The vascular cross-sectional image 121 in FIG. 5A is a substantially circular image located at the lower center of the medical image 120. A mask image 130 as shown in FIG. 5B is generated from such a medical image 120. The mask image 130 is an image in which a region (vascular lumen region) 131 estimated to be the inside region of the blood vessel (the inside of the vascular inner wall, i.e., the region corresponding to the vascular lumen) and a region other than the vascular lumen region (extravascular region) 132 are filled with different colors in the medical image 120. Here, the color density of the vascular lumen region and the color density of the extravascular region are set to be such that they can be clearly distinguished as different regions in computer processing. For example, the color of the blood vessel lumen region and the color of the extravascular region can be achromatic, and it is preferable that the blood vessel lumen region is white and the extravascular region is black.

[0045] For estimating the vascular region, a known AI algorithm used for region extraction such as U-net can be used. For example, U-net can estimate the vascular lumen region and extravascular region from an unknown medical image (extract the vascular lumen region) by learning a pair of a medical image 120 as shown in Fig. 5A as an original image and a mask image 130 including the vascular lumen region as shown in Fig. 5B as training data.

[0046] When the mask image 130 from which the blood vessel lumen region 131 has been extracted is generated, a binarization process is performed on the mask image 130. In this embodiment, the binarization process makes the blood vessel lumen region white and the extravascular region black. After the binarization process, the outer contour of the blood vessel lumen region is extracted as a contour line (outer contour of a closed cross section) 131a corresponding to the contour shape of the blood vessel inner wall (see FIG. 6). This completes the contour line extraction step.

[0047] Next, pre-processing is performed to set an evaluation value from the contour line 131a (pre-processing step). In the pre-processing step, a minimum circumscribing circle 131b for the contour line 131a and a center position 131c of the minimum circumscribing circle 131b are set. After this, the center position 131c is defined as the center position of the blood vessel (blood vessel center position) (treated as the blood vessel center position).

[0048] Next, the contour 131a is decomposed into a plurality of points or regions (hereinafter referred to as "measurement points"), and the distance (radius) R between each of the plurality of measurement points constituting the contour 131a and the central position 131c is measured (radius measurement step).

[0049] Then, using the measurement point with the shortest radius R (closest to the central position 131c) as the starting point (base point), an evaluation value is set according to the radius R (i.e., the cross-sectional shape of the vascular inner wall centered on the central position 131c) of each of the multiple measurement points in the circumferential direction in a clockwise or counterclockwise direction (clockwise in this embodiment) (evaluation value setting step).

[0050] In the present invention, the evaluation value can be set by a plurality of types of evaluation indexes. The evaluation value may differ depending on the type of evaluation index. The evaluation indexes include "degree of concavity," "rate of change in radius," "curvature," "roughness," and a "composite evaluation" that combines two or more of these evaluation indexes. The contents of each evaluation index will be explained below.

[0051] The "degree of concavity" is determined according to the measurement points constituting the contour 131a and the magnitude of the distance (separation distance) L from the minimum circumscribing circle 131b (see FIG. 7). That is, the degree of concavity is set for each measurement point according to the separation distance L corresponding to the depth of the concavity of the contour 131a relative to the minimum circumscribing circle 131b. The "degree of concavity" is set according to the degree of concavity detection program 20f. The evaluation data 21f includes data for setting the degree of concavity from the separation distance L (for example, converting the separation distance L into the degree of concavity), and when the degree of concavity detection program 20f is executed, the degree of concavity is set according to the data for setting the degree of concavity. When the evaluation index is the "degree of concavity", an evaluation value (thrombosis risk) is set in proportion to the degree of concavity.

[0052] The "radius change rate" refers to the rate of change (radius change rate) of the radius R of the contour 131a in the circumferential direction. The radius change rate is set based on the contour 131a, but is set for each measurement point according to the radius change rate detection program 20d. The radius change rate can be obtained by differentiating the values ​​of the radius R that are continuous in the circumferential direction. FIG. 7 is a graph showing the distance (radius R) between a plurality of measurement points constituting the contour 131a obtained in a certain experimental example and the central position 131c. For example, the radius change rate when focusing on a certain region Q in the line graph shown in FIG. 7 corresponds to the slope θ of the line graph of the portion of the region Q. If the contour 131a is assumed to be an approximately perfect circle, the radius does not change in the circumferential direction, and the radius change rate is 0 (zero). On the other hand, when there are irregularities on the inner wall of the blood vessel, the radius changes, and the radius change rate is greater for steeper irregularities than for gentler irregularities. When the evaluation index is the "radius change rate," the evaluation value is set in proportion to the radius change rate (maximum change rate or cumulative change rate).

[0053] "Curvature" refers to the curvature of the contour 131a in the circumferential direction. The curvature can be obtained by differentiating the value of the radius change rate. The curvature is set based on the contour 131a, but is set for each measurement point in accordance with the curvature detection program 20e. The larger the rate of change of the radius change rate (the ratio of change in the radius change rate to the circumferential length) is (the more rapidly the radius change rate changes), the larger the curvature is. When the evaluation index is "curvature", the evaluation value is set in proportion to the curvature (maximum curvature or accumulated curvature).

[0054] "Roughness" is determined by graphing (continuously curved) successive values ​​of radius R in the circumferential direction, and depending on the magnitude of the difference D between the original continuous curve (contour line) and a curve (smoothed curve) obtained by smoothing the original continuous curve (see Figure 8). Relatively small changes in radius R become smaller through smoothing, and the difference D from the original continuous curve becomes larger. In other words, "roughness" is effective in capturing relatively small changes. When the evaluation index is "roughness", the evaluation value is set in proportion to the roughness (the magnitude of the maximum difference D or the accumulated value of the differences D).

[0055] The "composite evaluation" is a combination of two or more indexes of "degree of concavity", "rate of radius change", "curvature", and "roughness". However, in the present invention, at least one of "rate of radius change" and "curvature" is adopted in the "composite evaluation". The "composite evaluation" can be made by calculating an evaluation value for each single evaluation index of "degree of concavity", "rate of radius change", "curvature", and "roughness", and adopting the maximum evaluation value for each evaluation index. In addition, when all of "degree of concavity", "rate of radius change", "curvature", and "roughness" are combined, it can also be called an "overall evaluation".

[0056] Fig. 9 is an explanatory diagram showing an example of a composite evaluation. In the example shown in Fig. 9, evaluation values ​​are calculated for all of "degree of concavity," "rate of change in radius," "curvature," and "roughness," and the maximum value of these is used, so this can be called an "overall evaluation."

[0057] By the above-mentioned procedure, an evaluation value determined according to the risk of thrombosis in the blood vessel cross section (contour line 131a) included in the medical image to be analyzed can be automatically set based on each evaluation index. The evaluation value is set according to the evaluation value setting program 20g. When multiple medical images are selected (obtained) as the medical images to be analyzed, an evaluation value for each of the multiple medical images is automatically set.

[0058] Once the evaluation value is set, the evaluation value is displayed in various forms on the image processing screen 100, as shown in Figures 10 and 11. For example, the evaluation value is displayed so as to be visually recognizable by an annular image display section 105 which displays an annular image (annular image) 105a displayed in a form according to the evaluation value, superimposed on the position of the vascular inner wall of the medical image, and a first graph display section 106 which displays (graphs) the evaluation value as a line graph 106a in correspondence with the circumferential position of the contour line (cross-sectional shape of the vascular inner wall).

[0059] In the annular image 105a, each of the measurement points constituting the annular image 105a is colored in a color according to the evaluation value. For example, the measurement point with the lowest evaluation value (lowest evaluation value point) is colored in blue, the measurement point with the highest evaluation value (highest evaluation value point) is colored in red, and the measurement points other than the lowest evaluation value point and the highest evaluation value point are colored in a color between blue and red on the color wheel according to the evaluation value. Specifically, in the annular image 105a, the parts with the lowest evaluation value are colored in colors such as blue-green, green, yellow-green, yellow, and orange. Therefore, it can be visually recognized that the parts of the annular image 105a that are colored red or close to red have a high evaluation value, that is, a high risk of thrombosis.

[0060] The line graph 106a displayed in the first graph display section 106 is in the form of a cut-out at the lowest point of the surface of the blood vessel inner wall included in the medical image and developed horizontally. In the line graph 106a, the vertical axis indicates the evaluation value, and the horizontal axis indicates the position in the circumferential direction. Similarly to the annular image 105a, each of the measurement points constituting the line graph 106a is colored according to the evaluation value.

[0061] In addition, when multiple medical images are selected (obtained) as medical images to be analyzed, an average evaluation value is calculated, which is the average of the evaluation values ​​of the vascular cross sections (contour lines 131a) of the multiple medical images. For example, the average evaluation value can be calculated by dividing the total evaluation value of all measurement points constituting the contour line 131a by the number of measurement points constituting the contour line 131a.

[0062] When multiple medical images are selected as medical images to be analyzed, a second graph display section 107 is displayed, which displays (graphs) the average evaluation values ​​of the multiple medical images as a line graph 107a corresponding to the positions in the axial direction of the blood vessel, as shown in Fig. 10 to Fig. 12. In the line graph 107a, the horizontal axis indicates the evaluation value, and the vertical axis indicates the positions in the axial direction of the blood vessel. Therefore, it is possible to visually confirm not only the evaluation value in one cross section, but also how the evaluation value changes in the axial direction of the blood vessel, and it is possible to easily find a part where the inner shape of the blood vessel, which is originally circular, is partially concave, that is, plaque adhering inside the blood vessel.

[0063] Also, as shown in FIG. 12, when the line graph 107a is displayed in the second graph display section 107, an index image 107b indicating the position (current cross-sectional position) in the vascular axis direction of the medical image currently displayed in the image display section 102 may be displayed. The current cross-sectional position (displayed on the image processing screen 100) can be changed by dragging the index image 107b or by selecting (by mouse click or touch operation, etc.) any position in the display area of ​​the second graph display section 107. Also, when multiple medical images are selected as medical images to be analyzed, the cross-sectional positions displayed on the image processing screen 100 may be selected in order from the position (cross-sectional position) with the highest average evaluation value in the vascular axis direction. That is, the average evaluation values ​​in multiple medical images (cross-sectional positions) are arranged in descending order, and the display order of the cross-sectional positions is set in descending order of the average evaluation value. Furthermore, when multiple medical images are selected as medical images to be analyzed, only the cross-sectional positions with the average evaluation value exceeding a predetermined threshold may be selected (cross-sectional positions with the average evaluation value not exceeding a predetermined threshold are hidden).

[0064] The function selection section 103 is provided for selecting (setting) various functions on the image processing screen 100. The functions on the image processing screen 100 are broadly divided into functions relating to display (display functions) and functions relating to data storage (storage functions), and the function selection section 103 is provided with a switchable tab (display function tab) 103a for selecting the display function and a tab (storage function tab) 103b for selecting the storage function.

[0065] 10 to 12 show a state in which the display function tab 103a is enabled (selected). As shown in Fig. 10 to 12, the display function tab 103a is provided with an evaluation index selection section 103c for selecting an evaluation index and a display item selection section 103d for selecting an item to be displayed (display item).

[0066] In the evaluation index selection unit 103c, an evaluation index (method of calculating an evaluation value) related to the setting of an evaluation value can be selected. For example, as the evaluation index, "degree of concavity", "rate of change in radius", "curvature", "roughness", "composite evaluation (overall evaluation)", etc. can be selected. In this embodiment, radio buttons for selecting each evaluation index are arranged vertically. When one of the selectable evaluation indexes "degree of concavity", "rate of change in radius", "curvature", and "roughness" is selected by operating these radio buttons, the display content is in accordance with the evaluation value set only from the selected evaluation index. When "composite evaluation" is selected, the display content is in accordance with the evaluation value set from a combination of two or more evaluation indexes. In the initial state (default), "composite evaluation" is selected. In this way, the user of the medical image processing device 1 can freely select the evaluation index. In particular, when the user of the medical image processing device 1 is a medical professional, the risk of thrombosis can be more appropriately diagnosed by checking (using as reference) the evaluation value in the blood vessel cross section from various viewpoints.

[0067] In the display item selection unit 103d, it is possible to select whether to display the display items displayed on the image display unit 102. For example, as the display items, it is possible to select "medical image examination information", "contour line of the blood vessel inner wall", "minimum circumscribing circle of the blood vessel inner wall", "center position of the minimum circumscribing circle", etc. In this embodiment, check boxes for selecting whether to display / hide each display item are arranged vertically. It is possible to select whether to display or hide each display item by operating these check boxes. Here, the "contour line of the blood vessel inner wall" corresponds to the contour line 131a, the "minimum circumscribing circle of the blood vessel inner wall" corresponds to the minimum circumscribing circle 131b, and the "center position of the minimum circumscribing circle" corresponds to the center position 131c. In this way, it is possible to freely customize the display / hide of the display items so that the user of the medical image processing device 1 can easily view them, and it is possible to improve the usability of the medical image processing device 1.

[0068] 13 shows a state in which the storage function tab 103b is enabled (selected). The storage function tab 103b displays a storage menu for storing various data, and includes an image storage selection section 103e for storing medical images in the medical image processing apparatus 1, and an evaluation value storage button 103f for storing data of evaluation values ​​(evaluation value data) in the medical image in the medical image processing apparatus 1.

[0069] In the image storage selection unit 103e, a storage method (save method) of a medical image can be selected in a plurality of types (storage modes). For example, a "RAW IMAGE" that stores the entire image as is, a "DISPLAYED IMAGE" that cuts out and stores the area displayed on the image display unit 102, and a "ZOOM VESSEL" that stores an image enlarged so that the vascular lumen area fits in the image with the center position of the blood vessel (center position 131c) as the center of the image can be selected. In this embodiment, radio buttons for selecting each evaluation index are arranged vertically. When the storage execution button 103g is operated with one of the selectable storage modes "RAW IMAGE", "DISPLAYED IMAGE", and "ZOOM VESSEL" selected by operating these radio buttons, the image is stored according to the selected storage mode.

[0070] The evaluation value storage button 103f is assigned a function of storing evaluation value data set for a medical image in the medical image processing apparatus 1. The evaluation value data stored in the medical image processing apparatus 1 is stored in association with the corresponding medical image.

[0071] According to the present invention, a contour line 131a corresponding to the surface of the inner wall of a blood vessel is extracted from an image of a blood vessel cross section included in a medical image captured by a medical imaging device, and an evaluation value determined according to the risk of thrombosis is set from at least the radius change rate in the circumferential direction of the contour line 131a or the curvature in the circumferential direction of the contour line 131a, and the evaluation value is displayed on the display of the display unit 13. Therefore, medical personnel (particularly doctors) who use the medical image processing device 1 can confirm (use as a reference) the evaluation value in the blood vessel cross section. In other words, the medical image processing device 1 can appropriately support the diagnosis of the risk of thrombosis. Furthermore, in the present invention, since the evaluation value can be set only from a two-dimensional cross-sectional image, plaques with a high risk of thrombosis can be estimated by simple processing.

[0072] Furthermore, according to the present invention, it is possible to set an evaluation value by combining the rate of change of radius and the curvature, so that the evaluation value can be set more accurately and diagnosis of the risk of thrombosis can be more appropriately assisted.

[0073] Furthermore, according to the present invention, it is possible to detect the degree of concavity corresponding to the distance from the circumscribing circle of the contour line 131a, and it is possible to set an evaluation value from a combination of at least two or more of the radius change rate, curvature, and concavity degree, so that it is possible to set the evaluation value more accurately and to more appropriately assist in the diagnosis of thrombosis risk.

[0074] Furthermore, according to the present invention, the evaluation value is displayed in a graph corresponding to the circumferential position of the contour line 131a, thereby improving the visibility of the evaluation value and more appropriately assisting in the diagnosis of thrombosis risk.

[0075] According to the present invention, the contour lines are extracted from each of a plurality of medical images having different axial positions of blood vessels, and an average evaluation value, which is the average of the evaluation values ​​of each of the plurality of medical images, is calculated from the contour lines in each of the plurality of medical images, and the average evaluation value is displayed. This allows medical personnel (particularly doctors) using the medical image processing device 1 to confirm (use as reference) the evaluation value according to the axial position of the blood vessel. That is, the medical image processing device 1 can appropriately support the diagnosis of thrombosis risk. According to the present invention, the evaluation value can be confirmed, and the image of the blood vessel cross section at the part where the evaluation value was performed can be confirmed, so that, for example, a doctor can diagnose the thrombosis risk in order from the blood vessel cross section at the part with the higher evaluation value. Therefore, it becomes possible for a doctor to check in detail only the part where a depression is physically generated in the blood vessel (the part with the higher evaluation value) and make an appropriate diagnosis in a short time, without spending time operating the medical image processing device 1 to look at the blood vessel cross section all along the length of the blood vessel.

[0076] The body sound acquisition support device in this invention corresponds to the medical image processing device 1, and similarly, the image acquisition unit corresponds to the medical image acquisition button 101a, the contour line extraction unit corresponds to the contour line extraction program 20c and the control unit 11 operating in accordance with the same, the radius change rate detection unit corresponds to the radius change rate detection program 20d and the control unit 11 operating in accordance with the same, the curvature detection unit corresponds to the curvature detection program 20e and the control unit 11 operating in accordance with the same, the evaluation value setting unit corresponds to the evaluation value setting program 20g and the control unit 11 operating in accordance with the same, the evaluation value display unit corresponds to the annular image display unit 105 and the first graph display unit 106, etc., the concavity detection unit corresponds to the concavity detection program 20f and the control unit 11 operating in accordance with the same, the graph display unit corresponds to the first graph display unit 106, and the average evaluation value setting unit corresponds to the evaluation value setting program 20g and the control unit 11 operating in accordance with the same, but this invention is not limited to this embodiment and can be made into various other embodiments. Furthermore, the screens and specific configurations described in the above embodiment are merely examples and can be modified as appropriate according to the actual product.

[0077] For example, in the above embodiment, the medical image processing device 1 is a general-purpose computer, but the present invention is not limited to this. For example, the medical image processing device 1 may be incorporated into a part of a medical imaging device such as an X-ray CT device or an MRI device. Furthermore, the medical image processing device 1 may cooperate with the medical imaging device to configure a medical image processing system.

[0078] In addition, the present invention can be provided not only as a medical image processing device, but also as a medical image processing method, a program, and a non-temporary (non-transient) tangible storage medium storing the program using the medical image processing device. [Industrial Applicability]

[0079] The present invention can be utilized in industries such as processing medical images including cross-sectional images of blood vessels captured by a medical imaging device. [Explanation of symbols]

[0080] 1...Medical image processing device 11...Control section 12...Input section 13…Display section 14...Storage medium connection part 15…Communications Department 16…Auxiliary storage section

Claims

1. an image acquisition unit for acquiring medical images including images of blood vessel cross sections captured by a medical image capture device; a contour line extraction unit that extracts a contour line corresponding to a surface of an inner wall of a blood vessel from an image of the blood vessel cross section included in the medical image; a radius change rate detection unit for detecting a radius change rate in a circumferential direction of the contour line; a curvature detection unit for detecting a curvature of the contour line in a circumferential direction; an evaluation value setting unit that sets an evaluation value determined according to a risk of thrombosis in the blood vessel cross section from the radius change rate or the curvature; An evaluation value display unit that displays the evaluation value on a display means Medical imaging equipment.

2. The evaluation value setting unit sets the evaluation value from a combination of the radius change rate and the curvature.

2. The medical image processing apparatus according to claim 1.

3. A depression degree detection unit detects a depression degree corresponding to a distance from the circumscribing circle of the contour line, The evaluation value setting unit sets the evaluation value from a combination of at least two of the radius change rate, the curvature, and the concavity.

3. The medical image processing apparatus according to claim 2.

4. The evaluation value display unit further includes a graph display unit that displays the evaluation value in a graph in correspondence with a position in a circumferential direction of the contour line. The medical image processing device according to claim 3.

5. The image acquisition unit acquires a plurality of medical images of blood vessels at different axial positions; The contour line extraction unit extracts a contour line of each of the plurality of medical images; the evaluation value setting unit includes an average evaluation value setting unit that calculates an average evaluation value, which is an average of the evaluation values ​​in each of the plurality of medical images, from the contour lines of each of the plurality of medical images; The evaluation value display unit has an average evaluation value display unit that displays the average evaluation value.

5. The medical image processing apparatus according to claim 4.

6. A computer of a medical image processing apparatus having a display means, an image acquisition unit for acquiring medical images including images of blood vessel cross sections captured by a medical image capture device; a contour line extraction unit that extracts a contour line corresponding to a surface of an inner wall of a blood vessel from an image of the blood vessel cross section included in the medical image; a radius change rate detection unit for detecting a radius change rate in a circumferential direction of the contour line; a curvature detection unit for detecting a curvature of the contour line in a circumferential direction; an evaluation value setting unit that sets an evaluation value determined according to a risk of thrombosis in the blood vessel cross section from the radius change rate or the curvature; The evaluation value is displayed on the display means. A medical image processing program.

7. A medical image processing method using a medical image processing device equipped with a display means, comprising: Acquire a medical image including a cross-sectional image of a blood vessel captured by a medical imaging device; extracting a contour line corresponding to a surface of an inner wall of a blood vessel from an image of the blood vessel cross section included in the medical image; Detecting a rate of change of radius in a circumferential direction of the contour line; Detecting a curvature of the contour line in a circumferential direction; setting an evaluation value determined based on the radius change rate or the curvature according to a risk of thrombosis in the blood vessel cross section; The evaluation value is displayed on the display means. Medical image processing method.

Citation Information

Patent Citations

  • IVOCT image vessel wall lumen contour extraction method

    CN109118508A

  • Apparatus, method, and program for reconstructing intra-tubular-structure image

    JP2012075702A

  • Scoring intravascular lesions and stent deployment in medical intraluminal ultrasound imaging

    JP2021517033A

  • Intraluminal image-based vessel diameter determination and associated devices, systems, and methods

    US20230008714A1

  • Medical image-processing device and method

    WO2010055815A1