Medical image processing apparatus and medical image processing method

Abstract

To provide a medical image processing device and a medical image processing method which can make the tip of a medical device clear in a tomosynthesis image of a subject to which the medical device is inserted.SOLUTION: A medical image processing device handling a tomosynthesis image generated by using a plurality of projection images obtained by imaging a subject within an angular range of less than 180 degrees comprises: a storage unit which stores blur data for each coordinate of an imaging space in advance; and a correction unit which corrects the tomosynthesis image by using the blur data.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a medical image processing apparatus and a medical image processing method for handling medical images obtained by an X-ray tomosynthesis apparatus, and to a technique for making the tip of a medical device inserted into a subject clear. [Background technology]

[0002] X-ray tomosynthesis devices are devices that use multiple projection images obtained by photographing a subject from multiple directions to generate tomosynthesis images, which are cross-sectional images in a plane parallel to the bed. In addition, three-dimensional images generated from multiple tomosynthesis images are used to confirm the three-dimensional arrangement of medical devices such as guide sheaths to be inserted into the subject. However, X-ray tomosynthesis devices that photograph multiple projection images involve a higher amount of radiation exposure than X-ray fluoroscopy devices, and it is desirable to reduce this amount of radiation exposure.

[0003] Patent Document 1 discloses that in order to reduce the amount of radiation exposure during tomosynthesis imaging, the sizes and positions of multiple imaging targets are identified, an angle range in which each imaging target can be separated is calculated, and a projection image is obtained within that angle range. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6502188 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, consideration is insufficient to clarify the tip of a medical device, such as a catheter or endoscope, inserted into a subject. In an X-ray tomosynthesis device, the angle range in which a projection image is captured is limited to less than 180 degrees, so distortion occurs in the generated tomosynthesis image, and the tip of the medical device becomes blurred. If the distortion of the tomosynthesis image is large, the three-dimensional position of the tip of the medical device cannot be confirmed, which hinders treatment, etc.

[0006] SUMMARY OF THE PRESENT DISCLOSURE An object of the present invention is to provide a medical image processing apparatus and a medical image processing method that are capable of making the tip of a medical device clear in a tomosynthesis image of a subject into which the medical device is inserted. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the present invention provides a medical image processing device that handles tomosynthesis images generated using a plurality of projection images captured within an angular range of less than 180 degrees, and is characterized in comprising a memory unit that pre-stores blur data for each coordinate in the shooting space, and a correction unit that corrects the tomosynthesis image using the blur data.

[0008] The present invention also provides a medical image processing method for handling a tomosynthesis image generated using a plurality of projection images captured within an angular range of less than 180 degrees, characterized in that it includes a reading step of reading out blur data for each coordinate in an imaging space, and a correction step of correcting the tomosynthesis image using the blur data. Effect of the Invention

[0009] According to the present invention, it is possible to provide a medical image processing apparatus and a medical image processing method that can make the tip of a medical device clear in a tomosynthesis image of a subject into which the medical device is inserted. [Brief description of the drawings]

[0010] [Figure 1] Overall configuration of medical image processing device [Diagram 2] Overall configuration diagram of an X-ray tomosynthesis device, an example of a medical imaging device [Diagram 3] FIG. 1 is a diagram showing an example of a processing flow of the first embodiment. [Figure 4] FIG. 13 is a diagram showing an example of a table in which blur data for each coordinate in a shooting space is recorded; [Diagram 5] FIG. 13 is a diagram showing an example of a process flow of the second embodiment. [Figure 6] FIG. 13 is a diagram showing an example of a table in which adjustment coefficients for each type of medical device are recorded. [Figure 7] FIG. 13 is a diagram showing an example of a display window according to the second embodiment; [Figure 8] FIG. 13 is a diagram showing an example of a relationship between an adjustment coefficient and contrast. [Figure 9] FIG. 13 is a diagram showing an example of a process flow of the third embodiment. [Figure 10] FIG. 13 is a diagram showing an example of an operation window according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of a medical image processing apparatus and a medical image processing method according to the present invention will be described with reference to the accompanying drawings. In the following description and the accompanying drawings, components having the same functional configuration are designated by the same reference numerals to avoid redundant description. EXAMPLES

[0012] 1 is a diagram showing the hardware configuration of a medical image processing device 1. The medical image processing device 1 is configured by a calculation unit 2, a memory 3, a storage device 4, and a network adapter 5, which are connected by a system bus 6 so as to be capable of transmitting and receiving signals. The medical image processing device 1 is also connected to a medical image capturing device 10 and a medical image database 11 via a network 9 so as to be capable of transmitting and receiving signals. Furthermore, a display device 7 and an input device 8 are connected to the medical image processing device 1. Here, "capable of transmitting and receiving signals" refers to a state in which signals can be transmitted and received between each other or from one device to the other, regardless of whether the transmission is electrically or optically wired or wireless.

[0013] The calculation unit 2 is a device that controls the operation of each component, and is specifically a CPU (Central Processing Unit) or MPU (Micro Processor Unit). The calculation unit 2 loads programs stored in the storage device 4 and data required for program execution into the memory 3, executes them, and performs various image processing on medical images. The memory 3 stores the programs executed by the calculation unit 2 and intermediate progress of the calculation processing. The storage device 4 is a device that stores the programs executed by the calculation unit 2 and data required for program execution, and is specifically a HDD (Hard Disk Drive) or SSD (Solid State Drive). The network adapter 5 is for connecting the medical image processing device 1 to a network 9 such as a LAN, a telephone line, or the Internet. Various data handled by the calculation unit 2 may be transmitted to and received from outside the medical image processing device 1 via a network 9 such as a LAN (Local Area Network).

[0014] The display device 7 is a device that displays the processing results of the medical image processing device 1, and is specifically a liquid crystal display, etc. The input device 8 is an operation device with which an operator issues operation instructions to the medical image processing device 1, and is specifically a keyboard, mouse, touch panel, etc. The mouse may be another pointing device such as a track pad or a track ball.

[0015] The medical imaging apparatus 10 is, for example, an X-ray tomosynthesis apparatus that captures a subject from multiple directions to obtain multiple projection images and generates a tomographic image from the multiple projection images, and will be described later with reference to Fig. 2. The medical image database 11 is a database system that stores the projection images and tomographic images obtained by the medical imaging apparatus 10, corrected images obtained by applying image processing to the tomographic images, and the like.

[0016] The overall configuration of an X-ray tomosynthesis apparatus 200, which is an example of the medical imaging apparatus 10, will be described with reference to Fig. 2. In Fig. 2, the direction perpendicular to the paper surface is the X-axis, the vertical direction is the Y-axis, and the horizontal direction is the Z-axis. The X-ray tomosynthesis apparatus 200 includes an X-ray source 201, an X-ray detector 202, a bed 204, and an operation console 205.

[0017] The X-ray source 201 is a device that irradiates X-rays onto a subject 203 placed on a bed 204. When a high voltage according to imaging conditions set on an operation console 205 is applied to the X-ray source 201, the subject 203 is irradiated with X-rays.

[0018] The X-ray detector 202 is a device that measures the spatial distribution of transmitted X-rays by detecting X-rays that have passed through the subject 203. The X-ray detector 202 is disposed opposite the X-ray source 201, and a large number of detection elements are arranged two-dimensionally in the ZX plane. A two-dimensional projection image is generated based on the signal measured by the X-ray detector 202.

[0019] At least one of the X-ray source 201 and the X-ray detector 202 is moved in the Z-axis direction to obtain multiple projection images by imaging the subject 203 from multiple directions. The obtained multiple projection images are used to generate a tomosynthesis image, which is a tomographic image in a plane parallel to the bed 204, i.e., the ZX plane.

[0020] The console 205 is a device that sets imaging conditions and generates and displays tomosynthesis images, and is configured as a so-called computer. A tomosynthesis image of the chest of the subject 203 is displayed on the console 205 illustrated in Fig. 2. The console 205 may be the medical image processing device 1 illustrated in Fig. 1.

[0021] In the X-ray tomosynthesis device 200, the angle range for capturing the projection images is limited to less than 180 degrees, for example, 20 degrees to 40 degrees, so that distortion occurs in the generated tomosynthesis image, and the tip of a medical device such as a catheter or endoscope inserted into the subject 203 becomes blurred. If the distortion of the tomosynthesis image is large, the three-dimensional arrangement of the tip of the medical device cannot be confirmed, which causes an impediment to treatment, etc. Therefore, in the first embodiment, a processing flow is executed to make the tomosynthesis image clear.

[0022] An example of the flow of processing executed in the first embodiment will be described step by step with reference to FIG.

[0023] (S301) The calculation unit 2 acquires a plurality of projection images obtained by photographing the subject 203 from multiple directions. The calculation unit 2 may receive the projection images photographed by the X-ray tomosynthesis device 200, or may read out the projection images stored in advance in the storage device 4 or the medical image database 11.

[0024] (S302) The calculation unit 2 generates a tomosynthesis image using the multiple projection images acquired in S301.

[0025] (S303) The calculation unit 2 reads out blur data for each coordinate in the shooting space. The blur data for each coordinate is stored in advance in the storage device 4 in the form of a table as shown in Fig. 4, for example. In the table shown in Fig. 4, blur data is associated with each three-dimensional coordinate. For example, the blur data Blr_111 is associated with the coordinates (x1, y1, z1), Blr_211 is associated with (x2, y1, z1), and Blr_nnn is associated with (xn, yn, zn).

[0026] Furthermore, the storage device 4 may store an equation for calculating the blur data from the coordinates of the shooting space. When an equation for calculating the blur data is stored, the storage capacity of the storage device 4 can be saved.

[0027] The blur data may be stored in the storage device 4 as a point spread function (PSF) generated by X-ray simulation or phantom imaging. For phantom imaging, a microsphere phantom smaller than the coordinates of one point or the size of a pixel is used.

[0028] (S304) The calculation unit 2 corrects the tomosynthesis image generated in S302 using the blur data read out in S303. That is, the calculation unit 2 functions as a correction unit that corrects the tomosynthesis image. For example, the point response function for each coordinate is deconvolved with the tomosynthesis image to correct the blur contained in the tomosynthesis image. The calculation unit 2 causes the display device 7 to display the corrected tomosynthesis image.

[0029] The above-described process corrects the blurring in the tomosynthesis image, making it possible to clearly show the tip of the medical device inserted into the subject, without interfering with treatment using the medical device. EXAMPLES

[0030] In the first embodiment, the correction of a tomosynthesis image using blur data for each coordinate of the imaging space has been described. The correction using the blur data corresponds to a process of emphasizing high-frequency components, and may emphasize and manifest white noise and the like contained in the tomosynthesis image. In the second embodiment, therefore, the limitation of the range in which the tomosynthesis image is corrected in order to suppress the manifestation of white noise and the like will be described. Note that the hardware configuration of the medical image processing device 1 in the second embodiment is the same as that in the first embodiment, and therefore the description will be omitted.

[0031] An example of the flow of processing executed in the second embodiment will be described step by step with reference to FIG.

[0032] (S301) As in the first embodiment, a projection image is acquired.

[0033] (S302) As in the first embodiment, a tomosynthesis image is generated.

[0034] (S503) The calculation unit 2 extracts a medical device region, which is a region of a medical device, from the tomosynthesis image generated in S302. Since the material of the medical device is known, a region of the tomosynthesis image whose brightness value is within a predetermined range may be extracted as the medical device region. In addition, since the shape of the medical device is known, the medical device region may be re-extracted based on the similarity of shape from the medical device region extracted based on the brightness value.

[0035] For extraction of the medical device region, a machine learning engine generated by learning from a tomographic image including a known medical device region as training data may be used. The machine learning engine is configured using, for example, a CNN (Convolutional Neural Network). The tomographic image used as the training data may be a tomosynthesis image or an X-ray CT image. However, when an X-ray CT image is used as the training data, the accuracy of extraction of the medical device region can be improved since the spatial resolution of the X-ray CT image is higher.

[0036] The position of the medical device region extracted from the tomosynthesis image may be corrected based on the region of the medical device extracted from the projection image used to generate the tomosynthesis image. The specific procedure will be described below. (1) Extract the region of the medical device from each of the multiple projection images used to generate the tomosynthesis image. (2) Perform a forward projection calculation on the medical device region extracted from the tomosynthesis image at the same projection angle as each projection image to obtain forward projection data in which the medical device region is pseudo-projected. (3) Calculate the difference between the medical device region included in each forward projection data and the medical device region extracted from each projection image. (4) If the calculated difference is within a predetermined range, the process ends. If it is not within the predetermined range, correct the medical device region in the tomosynthesis image, then return to (2) and repeat (3) and (4). In other words, the medical device region contained in the tomosynthesis image is modified so that the difference between the forward projection data obtained by performing a forward projection operation on the medical device region extracted from the tomosynthesis image and the medical device region extracted from the projection image falls within a specified range.

[0037] (S504) The calculation unit 2 reads out blur data for each coordinate of the medical device region extracted in S503 and its surrounding region. The surrounding region of the medical device region is a region within a predetermined number of pixels, for example, up to 3 pixels from the boundary of the medical device region.

[0038] (S505) The calculation unit 2 corrects the tomosynthesis image generated in S302 using the blur data read out in S504. That is, the range in which the tomosynthesis image is corrected is limited to the medical device region and its surrounding area. By limiting the range to be corrected to the medical device region and its surrounding area, the emergence of white noise and the like is suppressed.

[0039] The blur data used to correct the tomosynthesis image may be adjusted using an adjustment coefficient set according to the type of medical device. Since the X-ray attenuation coefficient differs depending on the type of medical device, the degree of blur also changes. Therefore, the blur data may be adjusted according to the type of medical device. The adjustment coefficient for each type of medical device is stored in the storage device 4 in the form of a table as shown in FIG. 6, for example. In the table shown in FIG. 6, an adjustment coefficient α1 is set for the catheter, α2 for the endoscope, and α3 for the guide sheath. The blur data is adjusted by being multiplied by the adjustment coefficient for each type of medical device. By adjusting the blur data according to the type of medical device inserted into the subject 203, the medical device region becomes clearer.

[0040] The calculation unit 2 displays the corrected tomosynthesis image on the display device 7. FIG. 7 shows an example of a display window. In the display window shown in FIG. 7, the extracted medical device region 701 is superimposed on the tomosynthesis image of the chest, and an arrow 702 indicating the moving direction of the medical device is displayed. The moving direction of the medical device is calculated from the tip and bent part of the medical device. The tip and bent part of the medical device are obtained by thinning the extracted medical device region 701. The three-dimensional shape of the extracted medical device region may also be superimposed on a three-dimensional image generated from multiple tomosynthesis images.

[0041] The above-described process flow corrects the blur in the tomosynthesis image, making it possible to clearly show the tip of the medical device inserted into the subject. In addition, the correction range is limited to the medical device area and its surrounding area, making it possible to suppress the emergence of white noise, etc.

[0042] Instead of setting the range for correcting the tomosynthesis image based on the extracted medical device region, the blur data may be adjusted using an adjustment coefficient set according to the contrast of the tomosynthesis image, and the tomosynthesis image may be corrected using the adjusted blur data. By adjusting the blur data using an adjustment coefficient set according to the contrast of the tomosynthesis image, the degree of correction is adjusted according to the contrast of the tomosynthesis image.

[0043] Fig. 8 shows an example of the relationship between the adjustment coefficient α and the contrast C. Fig. 8 illustrates an adjustment coefficient α that is minimum when the contrast C is a certain reference value and increases according to the absolute value of the contrast C. The blur data for each coordinate is adjusted by being multiplied by the adjustment coefficient α that is set according to the contrast C of the coordinate. In other words, the medical device region and its surrounding region can be made clear without extracting the medical device region. EXAMPLES

[0044] In the first and second embodiments, the correction of a tomosynthesis image generated using an acquired projection image has been described. If the time resolution of the corrected tomosynthesis image is insufficient, it may cause problems in treatment, etc. The time resolution means the imaging time required for generating a tomosynthesis image. Assuming that the X-ray source moves at a constant speed and images are captured, the imaging time is proportional to the number of projection images. The shorter the imaging time is for a moving medical device, that is, the fewer the number of projection images, the smaller the positional deviation of the medical device on the tomosynthesis image, while the longer the imaging time is, that is, the more the number of projection images, the larger the positional deviation of the medical device on the tomosynthesis image. Therefore, in the third embodiment, the selection of a projection image used for generating a tomosynthesis image will be described in order to display a tomosynthesis image having the necessary time resolution for the positional deviation of the medical device within the allowable range. Since the hardware configuration of the medical image processing device 1 in the third embodiment is the same as that in the first embodiment, the description will be omitted.

[0045] An example of the flow of processing executed in the third embodiment will be described step by step with reference to FIG.

[0046] (S901) The calculation unit 2 sets the time resolution, that is, the calculation unit 2 functions as a time resolution setting unit.

[0047] The time resolution may be set using an operation window exemplified in Fig. 10. The operation window in Fig. 10 has a time resolution adjustment section 1001. The time resolution adjustment section 1001 is used when an operator adjusts the time resolution, and is configured by, for example, a slide bar or a text box.

[0048] The calculation unit 2 may also calculate the speed of the medical device from an X-ray fluoroscopic image captured prior to generating the tomosynthesis image, and set the time resolution based on the calculated speed. The higher the speed of the medical device, the higher the time resolution is set.

[0049] (S902) The calculation unit 2 sets the number of projection images used to generate a tomosynthesis image based on the time resolution set in S901. The number of projection images is set to be greater as the set time resolution becomes lower, and to be smaller as the set time resolution becomes higher.

[0050] (S903) The calculation unit 2 acquires the number of projection images set in S902. The calculation unit 2 may instruct the X-ray tomosynthesis apparatus 200 to capture the set number of projection images, or may read out the set number of projection images from among the projection images stored in advance in the storage device 4 or the medical image database 11.

[0051] (S302) As in the first embodiment, a tomosynthesis image is generated.

[0052] (S503) As in the second embodiment, a medical device region is extracted from a tomosynthesis image.

[0053] (S504) As in the second embodiment, blur data for each coordinate of the medical device region and its surrounding region is read out.

[0054] (S505) As in the second embodiment, the tomosynthesis image is corrected.

[0055] The above-described process flow corrects the blurring in the tomosynthesis image, making it possible to clearly show the tip of the medical device to be inserted into the subject. In addition, the tomosynthesis image is generated using the projection images selected according to the set time resolution, so that the tomosynthesis image having the required time resolution is displayed.

[0056] Above, several embodiments of the present invention have been described. Note that the present invention is not limited to the above embodiments, and the components can be modified and embodied without departing from the gist of the invention. Furthermore, several components disclosed in the above embodiments may be appropriately combined. Furthermore, some components may be deleted from all the components shown in the above embodiments. [Explanation of symbols]

[0057] 1: medical image processing device, 2: calculation unit, 3: memory, 4: storage device, 5: network adapter, 6: system bus, 7: display device, 8: input device, 10: medical image capture device, 11: medical image database, 200: X-ray tomosynthesis device, 201: X-ray source, 202: X-ray detector, 203: subject, 204: bed, 205: operation console, 701: medical device area, 702: arrow, 1001: time resolution adjustment unit

Claims

1. A medical image processing apparatus that handles a tomosynthesis image generated using a plurality of projection images obtained by photographing a subject into which a medical device is inserted within an angle range of less than 180 degrees, comprising: A storage unit that stores blur data for each coordinate of a shooting space in advance; a correction unit that corrects the tomosynthesis image using the blur data, the correction unit extracts a medical device region that is a region of the medical device from the tomosynthesis image, sets a correction range in the tomosynthesis image based on the medical device region, adjusts the blur data by multiplying the blur data by an adjustment coefficient that is set depending on whether the type of the medical device is a catheter, an endoscope, or a guide sheath, and corrects the correction range using the adjusted blur data.

2. The medical image processing apparatus according to claim 1 , The medical image processing apparatus, wherein the storage unit stores a table in which the blur data is associated with each of the coordinates.

3. The medical image processing apparatus according to claim 1 , The medical image processing apparatus, wherein the storage unit stores a formula for calculating the blur data from coordinates of the imaging space.

4. The medical image processing apparatus according to claim 1 , 2. A medical image processing apparatus, comprising: a storage unit for storing the blur data for each coordinate; the blur data being a point response function generated by X-ray simulation or phantom imaging;

5. The medical image processing apparatus according to claim 1 , The medical image processing apparatus according to claim 1, wherein the correction unit calculates a traveling direction of the medical device based on a tip and a bent portion of the medical device obtained by performing a thinning process on the medical device region.

6. 6. The medical image processing apparatus according to claim 5, The medical image processing apparatus, wherein the correction unit calculates a three-dimensional shape of the medical device.

7. The medical image processing apparatus according to claim 1 , The medical image processing apparatus, characterized in that the correction unit extracts the medical device region using a machine learning engine generated by learning from a tomographic image including a known medical device region as training data.

8. The medical image processing apparatus according to claim 7, The medical image processing apparatus, wherein the training data includes an X-ray CT image.

9. The medical image processing apparatus according to claim 1 , The medical image processing device is characterized in that the correction unit corrects the medical device area so that a difference between forward projection data obtained by performing a forward projection calculation on the medical device area and the area of ​​the medical device extracted from the projection image falls within a predetermined range.

10. The medical image processing apparatus according to claim 1 , A time resolution setting unit that sets a time resolution of the tomosynthesis image, The medical image processing apparatus, wherein the correction unit corrects a tomosynthesis image generated using a number of projection images set based on the time resolution.

11. The medical image processing apparatus according to claim 10, The medical image processing apparatus, wherein the time resolution setting unit receives a time resolution inputted into an operation window.

12. The medical image processing device according to claim 11, The medical image processing device, characterized in that the time resolution setting unit calculates the speed of a medical device inserted into the subject using an X-ray fluoroscopic image taken prior to generating the tomosynthesis image, and sets the time resolution based on the calculated speed.

13. 1. An X-ray tomosynthesis apparatus for capturing a plurality of projection images in an angular range of less than 180 degrees and generating a tomosynthesis image using the projection images, comprising: An X-ray tomosynthesis apparatus comprising the medical image processing apparatus according to claim 1.

14. A medical image processing method for processing a tomosynthesis image generated using a plurality of projection images of a subject having a medical device inserted therein, the method comprising: a reading step of reading out blur data for each coordinate in an imaging space; and a correction step of correcting the tomosynthesis image using the blur data, the reading step comprising: a medical image processing method comprising: extracting a medical device region, which is an area of ​​the medical device, from the tomosynthesis image; setting a correction range in the tomosynthesis image based on the medical device region; adjusting the blur data by multiplying the blur data by an adjustment coefficient that is set depending on whether the type of the medical device is a catheter, an endoscope, or a guide sheath; and correcting the correction range using the adjusted blur data, the medical image processing method comprising: extracting a medical device region, which is an area of ​​the medical device, from the tomosynthesis image;

Images