Medical image processing device, treatment system, medical image processing method, program, and recording medium

Abstract

The present invention provides a medical image processing device, a treatment system, a medical image processing method, a program, and a recording medium capable of dealing with interferenceal change. [Solution] The medical image processing device includes: a first image acquisition unit that acquires a first image captured in a first stage; a second image acquisition unit that acquires a second image captured in a second stage; a 3D-3D positioning execution unit that aligns the position of the second image with the position of the first image; a region information acquisition unit that acquires region information corresponding to the region of the first image; a region estimation unit that estimates the region in the second image corresponding to the region information; a tracking model acquisition unit that acquires a tracking model; a tracking unit that tracks an object in the second image using the tracking model; and an error calculation unit that calculates the error between the tracking position, which is the position of the object in the second image tracked by the tracking unit, and the position of the object in the second image.

Description

Technical Field

[0001] Embodiments of the present invention relate to a medical image processing apparatus, a treatment system, a medical image processing method, a program, and a recording medium.

Background Art

[0002] Radiation therapy is a treatment method that destroys a lesion in a patient's body by irradiating the lesion with radiation. At this time, the radiation needs to be accurately irradiated to the position of the lesion. This is because if the normal tissue in the patient's body is irradiated with radiation, it may affect the normal tissue. Therefore, when performing radiation therapy, the position of the lesion in the patient's body is grasped three-dimensionally in the treatment planning stage. To perform this grasping, a three-dimensional fluoroscopic image of the patient is taken. A CT image obtained by Computed Tomography (CT) is an example of a three-dimensional fluoroscopic image. Based on the grasped position of the lesion, the direction of irradiation and the intensity of the irradiated radiation are planned so as to reduce the irradiation to normal tissue. Thereafter, in the treatment stage where the treatment is actually performed, the radiation is irradiated to the lesion according to the planned irradiation direction and irradiation intensity with the position of the patient adjusted to the position of the patient in the treatment planning stage.

[0003] In the patient positioning in the treatment stage, a three-dimensional fluoroscopic image is virtually placed in the treatment room, and the position of the movable bed on which the patient is actually lying in the treatment room is adjusted so that it coincides with the position of the three-dimensional fluoroscopic image.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In radiation therapy, addressing interfractional change is crucial. Interfractional change refers to the phenomenon where the position of an object, such as a tumor, within the patient's body changes between the treatment planning stage and the treatment stage. In other words, it is necessary to align the radiation irradiation position identified in the treatment planning stage with the position of the object during the treatment stage.

[0006] This invention has been made in consideration of these circumstances and aims to provide a medical image processing device, a treatment system, a medical image processing method, a program, and a recording medium that can deal with interferenceal change. [Means for solving the problem]

[0007] The medical image processing apparatus of the embodiment includes: a first image acquisition unit that acquires a first image, which is a three-dimensional fluoroscopic image of a patient taken in a first stage; a second image acquisition unit that acquires a second image, which is a three-dimensional fluoroscopic image of the patient taken in a second stage later than the first stage; a 3D-3D positioning execution unit that aligns the position of the second image with the position of the first image based on the pixel values ​​of the first and second images; a region information acquisition unit that acquires region information corresponding to a region of the first image; a region estimation unit that estimates a region in the second image corresponding to the region information; a tracking model acquisition unit that acquires a tracking model created based on the first image; a tracking unit that tracks an object in the second image using the tracking model; and an error calculation unit that calculates the error between the tracking position, which is the position of the object in the second image tracked by the tracking unit, and the position of the object in the second image. [Effects of the Invention]

[0008] According to embodiments of the present invention, it is possible to provide a medical image processing apparatus, a treatment system, a medical image processing method, a program, and a recording medium capable of dealing with interferenceal change. [Brief explanation of the drawing]

[0009] [Figure 1] A block diagram showing the schematic configuration of a treatment system equipped with a medical image processing device according to an embodiment. [Figure 2] A block diagram showing the schematic configuration of a treatment system equipped with a medical image processing device according to the embodiment, from a different angle than Figure 1. [Figure 3] A block diagram showing the schematic configuration of the medical image processing device according to the embodiment. [Figure 4] A diagram that estimates the region in the second image based on the first image. [Figure 5] A diagram illustrating the differences in tumor location based on respiratory waveforms in 4D-CT and DRR. [Figure 6] A flowchart showing an example of the processing flow performed by the medical image processing device of the embodiment. [Modes for carrying out the invention]

[0010] The medical image processing apparatus, treatment system, medical image processing method, and program of the embodiment will be described below with reference to the drawings.

[0011] [Overall structure] Figure 1 is a block diagram showing the schematic configuration of a treatment system 1 equipped with a medical image processing device 100 of an embodiment. The treatment system 1 comprises, for example, a treatment device 10, a medical image processing device 100, and a display device 200. The treatment device 10 comprises, for example, a patient table 12, a patient table control unit 14, a treatment beam irradiation gate 18 (irradiation unit), and a first imaging device D1. In Figure 1, a computed tomography (CT) device 16 (hereinafter referred to as "CT imaging device 16") is shown as an example of the first imaging device D1.

[0012] The treatment table 12 is a movable treatment table that fixes a patient P (subject) receiving radiation therapy in a lying position, for example, using a restraint device. The treatment table 12 moves with the patient P fixed inside the annular CT scanner 16 having an opening, according to the control from the treatment table control unit 14. The treatment table control unit 14 controls the translational mechanism and rotational mechanism provided on the treatment table 12 in order to position the patient P fixed to the treatment table 12 according to the movement amount signal output by the medical image processing device 100. The translational mechanism can drive the treatment table 12 in three axial directions (X axis, Y axis, Z axis), and the rotational mechanism can rotate the treatment table 12 around the three axes. In other words, the treatment table control unit 14 moves the treatment table 12 with six degrees of freedom by controlling the translational mechanism and rotational mechanism of the treatment table 12, for example. The bed control unit 14 has six degrees of freedom to control the bed 12, but may have fewer than six degrees of freedom (e.g., four degrees of freedom) or more than six degrees of freedom (e.g., eight degrees of freedom). The bed 12 is installed so as to be movable to both positions when the position where imaging by the CT scanner 16 is performed and the position where the treatment beam B is irradiated by the treatment beam irradiation gate 18 are different.

[0013] The CT scanner 16 performs three-dimensional computed tomography. The CT scanner 16 has multiple radiation sources arranged inside the opening of its annular (gantry), and each radiation source emits radiation to visualize the inside of the patient P's body. In other words, the CT scanner 16 emits radiation from multiple locations around the patient P. In the CT scanner 16, the radiation emitted from each radiation source is, for example, X-rays. The CT scanner 16 uses multiple radiation detectors arranged inside the annular opening to detect the radiation emitted from the corresponding radiation source that has passed through the patient P's body and reached it. The CT scanner 16 generates a CT image of the inside of the patient P's body based on the magnitude of the radiation energy detected by each radiation detector. The CT image of patient P generated by the CT scanner 16 is a three-dimensional digital image that represents the magnitude of the degree of radiation attenuation at each location inside the body as a digital value. The CT scanner 16 outputs the generated CT image to the medical image processing device 100. The imaging of the inside of the patient P in the CT scanner 16, that is, the irradiation of radiation from each radiation source and the generation of CT images based on the radiation detected by each radiation detector, is controlled, for example, by an imaging control unit (not shown).

[0014] The treatment beam irradiation gate 18 irradiates the patient P with radiation as treatment beam B to destroy the tumor (lesion), which is the target area for treatment, located within the patient P's body. Treatment beam B can be, for example, X-rays, gamma rays, electron beams, proton beams, neutron beams, or heavy ion beams. Treatment beam B is irradiated linearly from the treatment beam irradiation gate 18 to the patient P (more specifically, the tumor inside the patient P's body). The irradiation of treatment beam B at the treatment beam irradiation gate 18 is controlled, for example, by a treatment beam irradiation control unit (not shown). In the illustrated treatment system 1, the treatment beam irradiation gate 18 is an example of an "irradiation unit".

[0015] In radiation therapy, the irradiation direction and intensity of the treatment beam B are planned by simulating the patient P being placed on the treatment table 12 in the treatment room. This stage of planning the treatment is called the "treatment planning stage." The treatment planning stage is an example of the "first stage." After the first stage, the second stage is performed. Here, the "second stage" is a concept that includes not only the period during which the treatment beam B is actually irradiated to the patient P, but also the period immediately before and after that.

[0016] In the treatment planning stage, specifically, a physician identifies the irradiation target area on a CT image (an example of the "first image"), or such processing is performed automatically. For this reason, the CT image in the treatment planning stage is associated with information related to the treatment plan (hereinafter referred to as "treatment planning information"), such as parameters representing the angle of the treatment table 12 in the treatment room and the patient's position (lying on their back or stomach). This is also true for CT images taken immediately before radiation therapy and CT images taken during previous radiation therapy. In other words, the CT image taken inside the patient P's body by the CT scanner 16 is associated with treatment planning information, such as parameters representing the angle of the treatment table 12 and the patient's position at the time of imaging. The treatment planning information may also include information regarding the irradiation direction and intensity when irradiating patient P with the treatment beam B. The treatment planning information may also include information such as the location of the tumor and the location of organs at risk that should be avoided. The treatment planning information may include parameters assigned to each pixel of the CT image for coloring the location of the tumor, organs at risk, etc. The treatment planning information may also be assigned in association with a predetermined region of the first image. Among the treatment planning information, the information assigned in association with a specific region of the first image is called "regional information." For example, if the regional information is the location of a tumor or a risk organ, the regional information is assigned in association with pixels, etc., in the region corresponding to the tumor or risk organ in the first image.

[0017] In addition, the region information assigned to the first image may include a so-called gate window. The gate window is used to control the irradiation position and irradiation timing of the treatment beam B. More specifically, the output of the treatment beam irradiation gate 18 is turned on only during the period when a specific target enters the range of the gate window, so that the treatment beam B can be accurately irradiated onto a tumor or the like. By using the gate window, for example, when the position of a tumor or the like moves with the respiration of the patient P, it becomes possible to irradiate the treatment beam B only during the period when the tumor is located at a suitable position.

[0018] In FIG. 1, a CT imaging device 16 is shown as an example of the first imaging device D1. However, the first imaging device D1 may have a configuration that generates an image obtained by three-dimensionally imaging the inside of the patient P, such as a cone-beam (CB) CT device, a magnetic resonance imaging (MRI) device, or an ultrasonic diagnostic device.

[0019] In the second stage, the medical image processing device 100 outputs a movement amount signal for moving the hospital bed 12 to the hospital bed control unit 14 in order to position the patient P at the same position as in the treatment planning stage. That is, the medical image processing device 100 outputs a movement amount signal for moving the patient P so that the treatment beam B can be appropriately irradiated onto a tumor or tissue to be treated in radiotherapy to the hospital bed control unit 14. The movement amount signal is determined based on the first displacement amount, the second displacement amount, and the like, which will be described later.

[0020] In the second stage, the display device 200 displays an image for presenting various information in the treatment system 1 to the operator (such as a doctor) of the radiation therapy using the treatment system 1, including the process of aligning the patient P in the medical image processing device 100. The display device 200 displays, for example, various images such as a CT image or a fluoroscopic X-ray image output by the medical image processing device 100, or an image with various information superimposed on these images. Here, the various information includes, for example, patient information (age, gender, height, weight, etc.), imaging conditions of the image (imaging site, presence or absence of a contrast agent, tube voltage, tube current, etc.), imaging date and time, or the patient's body position (head-up supine position, foot-down prone position, etc.). The display device 200 includes, for example, a device such as a liquid crystal display (LCD). The operator of the radiation therapy can obtain information when performing radiation therapy using the treatment system 1 by visually checking the image displayed on the display device 200. The treatment system 1 may be provided with a user interface such as an operation unit (not shown) operated by the operator of the radiation therapy, and may be configured to be manually operable for various functions executed by the treatment system 1.

[0021] FIG. 2 is a block diagram showing the schematic configuration of the treatment system 1 from an angle different from that of FIG. 1. As shown in FIG. 2, the treatment system 1 includes a second imaging device D2. The second imaging device D2 has, for example, two radiation sources 20 (radiation source 20-1 and radiation source 20-2) and two radiation detectors 30 (radiation detector 30-1 and radiation detector 30-2). However, the second imaging device D2 may be, for example, an ultrasonic diagnostic device or the like.

[0022] Radiation source 20-1 irradiates patient P with radiation r-1 from a predetermined angle for fluoroscopy. Radiation source 20-2 irradiates patient P with radiation r-2 from a predetermined angle different from that of radiation source 20-1 for fluoroscopy. Radiation r-1 and radiation r-2 are, for example, X-rays. Figure 2 shows a case where X-ray imaging is performed from two directions on patient P, who is fixed on a bed 12. Note that in Figure 2, the control unit that controls the irradiation of radiation r by radiation source 20 is omitted from the illustration.

[0023] Radiation detector 30-1 detects radiation r-1 that has been irradiated from radiation source 20-1 and passed through patient P's body, and generates an X-ray fluoroscopic image of patient P's body corresponding to the energy magnitude of the detected radiation r-1. Radiation detector 30-2 detects radiation r-2 that has been irradiated from radiation source 20-2 and passed through patient P's body, and generates an X-ray fluoroscopic image of patient P's body corresponding to the energy magnitude of the detected radiation r-2. Radiation detector 30 has X-ray detectors arranged in a two-dimensional array, and generates a digital image as an X-ray fluoroscopic image, representing the energy magnitude of the radiation r that reached each X-ray detector as a digital value. This X-ray fluoroscopic image is an example of a "third image". The third image is a two-dimensional fluoroscopic image of patient P taken immediately before radiation therapy (i.e., in the second stage). The third image may also be an echo image generated by an ultrasound diagnostic device.

[0024] The radiation detector 30 is, for example, a flat panel detector (FPD), an image intensifier, or a color image intensifier. The following describes the case where each radiation detector 30 is an FPD. The radiation detector 30 (FPD) outputs the generated X-ray fluoroscopic images to the medical image processing device 100. Note that in Figure 2, the control unit that controls the generation of X-ray fluoroscopic images by the radiation detector 30 is omitted from the diagram.

[0025] The specific configuration of the second imaging device D2 may be changed. For example, the second imaging device D2 may be equipped with three or more sets of radiation sources 20 and radiation detectors 30. Alternatively, the second imaging device D2 may be equipped with only one set of radiation sources 20 and radiation detectors 30. Hereinafter, the combination of radiation sources 20 and radiation detectors 30 may be referred to as an "X-ray imaging device".

[0026] The various components shown in Figures 1 and 2 may be connected to each other by wires, or they may be connected wirelessly, for example, by a LAN (Local Area Network) or a WAN (Wide Area Network).

[0027] [Medical Image Processing Equipment] The following describes the medical image processing apparatus 100 according to the embodiment. Figure 3 is a block diagram mainly showing the schematic configuration of the medical image processing apparatus 100 according to the embodiment. The medical image processing apparatus 100 includes, for example, a first image acquisition unit 110, a second image acquisition unit 120, a 3D-3D positioning execution unit 130, a region information acquisition unit 140, a region estimation unit 150, a tracking model acquisition unit 160, a tracking unit 170, an error calculation unit 180, and a model correction unit 190.

[0028] Some or all of the components of the medical image processing device 100 are realized, for example, by a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or GPU (Graphics Processing Unit), or by the cooperation of software and hardware. Some or all of the functions of these components may be realized by a dedicated LSI. The program may be stored in advance in a storage device (a storage device with a non-transient recording medium) such as a ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), or flash memory provided by the medical image processing device 100. The program may be stored on a removable recording medium (non-transient recording medium) such as a DVD or CD-ROM, and installed on the HDD or flash memory of the medical image processing device 100 when the recording medium is inserted into the drive device of the medical image processing device 100. Alternatively, the program may be downloaded from another computer device via a network and installed on the HDD or flash memory of the medical image processing device 100.

[0029] The first image acquisition unit 110 acquires a first image of patient P during the treatment planning stage (first stage). The first image is a three-dimensional CT image representing the three-dimensional shape of the patient P's body, taken, for example, by a CT scanner 16 during the treatment planning stage. The first image is used to determine the direction (path including inclination and distance) and intensity of the treatment beam B irradiated onto patient P during radiation therapy. The first image may also be an MRI image taken by an MRI scanner during the treatment planning stage. The first image may be accompanied by the aforementioned region information. The first image acquisition unit 110 may acquire multiple still images taken at different timings within the respiratory cycle of the same patient P as the first image. The first image may also be a video, in which time axis information is added to a three-dimensional fluoroscopic image. For example, the first image may be a 3D-CT image.

[0030] The second image acquisition unit 120 acquires a second image of patient P immediately before the start of radiation therapy (i.e., the second stage). The second image is a three-dimensional CT image representing the three-dimensional shape of the inside of patient P's body, taken, for example, by a CT scanner 16, in order to align the patient P's body position (i.e., position) when irradiating with the treatment beam B during radiation therapy. In other words, the second image is an image taken by the CT scanner 16 immediately before irradiating with the treatment beam B from the treatment beam irradiation gate 18. In this case, the first and second images are taken at different times, but the method of taking each image is the same. The second image may also be an MRI image taken by an MRI scanner in the second stage. The second image acquisition unit 120 may acquire multiple still images taken at different timings within the respiratory cycle of the same patient P as the second image. The second image may also be a video, in which time axis information is added to a three-dimensional fluoroscopic image. For example, the second image may be a 3D-CT image. The region information added to the first image may be copied and added to the second image.

[0031] The medical image processing device 100 may generate a two-dimensional DRR image based on a three-dimensional second image. A DRR (Digitally Reconstructed Radiograph) image is a digitally reconstructed X-ray photograph obtained by virtually reconstructing an X-ray fluoroscopic image from a three-dimensional image (e.g., a CT image).

[0032] The 3D-3D positioning execution unit 130 performs 3D-3D positioning processing to align the position of patient P when performing radiation therapy, based on the first image acquired by the first image acquisition unit 110 and the second image acquired by the second image acquisition unit 120. More specifically, for example, the medical image processing device 100 calculates the amount of three-dimensional displacement (hereinafter sometimes referred to as the "first displacement amount") between the first image acquired by the first image acquisition unit 110 and the second image acquired by the second image acquisition unit 120, and aligns the position between the first image and the second image by correcting the second image by the calculated first displacement amount. The 3D-3D positioning execution unit 130 may also compare the first image with one or more second images, select a pair of first and second images with a high similarity based on pixel values, and perform positioning with the selected pair. Here, "two or more second images" refers to, for example, multiple CT images taken at different timings within the respiratory cycle. The location of a tumor may change depending on the respiratory cycle. By using a pair of images, the first and second images, which have a high degree of similarity, it is possible to reduce the deviation caused by the respiratory cycle during 3D-3D positioning.

[0033] In the second stage, the medical image processing device 100 may output a movement signal to the bed control unit 14 to move the bed 12 on which the patient is placed and fixed by a first displacement amount, and the bed control unit 14 may move the bed 12 by the first displacement amount. Alternatively, if the CT scanner 16 and the treatment beam irradiation gate 18 are installed at separate locations, the medical image processing device 100 may output a movement signal to the bed control unit 14 to move the bed 12 by the distance between the CT scanning position and the irradiation position plus the first displacement amount. The bed control unit 14 may then move the bed 12 by the distance between the CT scanning position and the irradiation position plus the first displacement amount.

[0034] The region information acquisition unit 140 acquires region information corresponding to a predetermined region of the first image. In the example shown in Figure 4(a), "region A" is set in the chest area of ​​the first image. The aforementioned region information is associated with this region A. Furthermore, a target T is located within the range of region A. Target T is, for example, a tumor. The region information may be stored, for example, together with the first image on a recording medium provided by the medical image processing device 100. In this case, the region information acquisition unit 140 reads the region information from the recording medium.

[0035] The region estimation unit 150 estimates the region in the second image that corresponds to the region information, based on the first image and the region information. In the example in Figure 4(a), the region information assigned to the first image corresponds to region A in the patient P's chest. Therefore, as shown in Figure 4(b), the region estimation unit 150 estimates the region A' in the chest that should be associated with the region information in the second image. The estimation method is not limited, but for example, the position of region A' may be estimated based on the positional relationship (vector L) between the diaphragm boundary Q and region A in the first image and the diaphragm boundary Q in the second image. In the example in Figures 4(a) and 4(b), the position of the diaphragm boundary Q at the time of exhalation, i.e., when the diaphragm is at its lowest point in both images, is shifted between the first and second images, so it is inferred that the position of target T is also shifted between the first and second images. This is an example of interferenceal change. Therefore, region A' in the second image is inferred to be at a shifted position relative to region A in the first image. In the second image, region information (for example, the direction and intensity of irradiation when irradiating patient P with treatment beam B) may be applied to the estimated region A' and treatment may be performed. Alternatively, Deformable Image Registration (DIR) may be used to obtain a three-dimensional motion vector between the first and second images, and the tumor position in the second image may be determined from the amount of displacement corresponding to the tumor in the first image.

[0036] The tracking model acquisition unit 160 acquires a tracking model created based on the first image. Here, "tracking model" is a model for tracking the position of an object in multiple still or moving images. "Object" is, for example, a part of the human body referenced in radiotherapy, such as a tumor or a marker. The object may be the same as or different from target T. The tracking model may be obtained by machine learning using the first image, determining the positional relationship between the object and a landmark (e.g., the boundary of the diaphragm, a specific bone, etc.) that serves as a reference for estimating the object's position. Alternatively, the tracking model may be obtained by machine learning using the first image, estimating the object's position from the image pattern (e.g., the distribution of pixel values ​​for each pixel) in the still or moving images.

[0037] The tracking model may be a pre-trained model that has been trained using AI (Artificial Intelligence) functions. Alternatively, the tracking model may use deep learning, a type of machine learning, to track the position of objects. Examples of classifiers used in the tracking model include Random Forest, Decision Tree, Support Vector Machine (SVM), K Nearest Neighbor Algorithm (KNN), and Logistic Regression.

[0038] The tracking model may be stored, for example, along with the first image and region information, on a recording medium provided by the medical image processing device 100. For example, the tracking model is created during the treatment planning stage. In this case, the tracking model acquisition unit 160 acquires the tracking model by reading it from the recording medium.

[0039] The tracking unit 170 tracks the position of an object in the second image using the tracking model acquired by the tracking model acquisition unit 160. In this specification, the position of an object in the second image obtained by the tracking unit 170 is referred to as the "tracked position". For example, if the second image consists of multiple still images, the position of the object in each still image is obtained as the "tracked position". Alternatively, if the second image is a video, the position of the object in the video is obtained as the "tracked position" associated with the time axis.

[0040] A specific example of tracking by the tracking unit 170 will be explained using Figure 4. Figure 4(a) is an example of the first image. The symbol P indicates the boundary of the diaphragm as an example of a "landmark for estimating the position of an object". The symbol T indicates the position of the tumor as an example of an "object". In other words, in the example of Figure 4, the target and the object are the same tumor. In Figure 4(a), the positional relationship between the boundary Q of the diaphragm and the target T is shown, for example, by the distance and direction of vector L. Figure 4(b) is an example of the second image. Comparing Figures 4(a) and (b), the position of the boundary Q of the diaphragm is different. For example, if the diaphragm and the target T move synchronously, in Figure 4(b), the position of the target T in the second image can be tracked using the position of the boundary Q of the diaphragm and vector L. Note that the method for estimating region A' and the method for tracking the position of the target T in the second image may be the same or different. For example, region A' may be estimated using vector L, and the position of target T may be tracked using the image pattern in the second image (e.g., the distribution of pixel values ​​for each pixel).

[0041] Figure 5 illustrates an example of the tracking unit 170 tracking the position of different objects depending on the respiratory cycle. As shown in Figure 5(a), a patient's respiration can be represented by a respiratory waveform with time on the horizontal axis and amplitude on the vertical axis. For example, if a tumor (an example of an "object") is located around the chest, the position of the tumor changes according to the phase in the respiratory waveform. That is, the position of the tumor in the 4D-CT (an example of a "second image") shown in Figure 5(b) changes over time. The tracking unit 170 can track the position of the tumor for each phase in the respiratory waveform by using a tracking model. Furthermore, if a DRR is generated using 4D-CT, as shown in Figure 5(c), the trajectory of the tumor's position in the DRR, which consists of multiple still images, can be obtained. This trajectory may be used to correct the tracking model by the model correction unit 190.

[0042] The error calculation unit 180 calculates the error between the tracking position determined by the tracking unit 170 and the position of the object in the second image detected by a method other than the tracking model. Here, "a method other than the tracking model" may be, for example, the radiation therapist visually inspecting the second image. Alternatively, "a method other than the tracking model" may be image analysis of the DRR generated based on the second image. Alternatively, Deformable Image Registration (DIR) may be used to obtain a three-dimensional motion vector between the first and second images, and the tumor position in the second image may be determined from the displacement amount corresponding to the tumor in the first image.

[0043] The model correction unit 190 corrects the tracking model based on the error calculated by the error calculation unit 180. Correction means, for example, correcting the model parameters so that L' in the second image is obtained instead of L in the first image of Figure 4. Alternatively, the model parameters are corrected so that the position of the object is estimated from the image pattern of the tumor in the second image (for example, the distribution of pixel values ​​for each pixel). Or, in the case of correcting an AI model or machine learning model, the second image is included in the training data and retraining or fine tuning is performed. The corrected tracking model is stored on the recording medium of the medical image processing device 100 and may be used for tracking by the tracking unit 170 in subsequent times. By correcting the tracking model in this way, it becomes possible to track the position of the object in the second image, i.e., in multiple still images or videos, with greater accuracy. These processes make it possible to deal with so-called interferenceal changes, where the position of the object changes between the first and second images. In addition, it becomes possible to accurately grasp the position of the object that fluctuates in the second image, for example, due to the respiratory cycle, and to irradiate the target with the treatment beam B with greater accuracy.

[0044] Next, with reference to Figure 6, the processing flow performed by the medical image processing device 100 will be described. Figure 6 is a flowchart showing an example of the processing flow performed by the medical image processing device 100.

[0045] First, the first image acquisition unit 110 acquires a three-dimensional fluoroscopic image (e.g., a CT image) that has been taken in advance during the treatment planning stage as the first image (step S100). Next, the medical image processing device 100 moves the bed 12 on which the patient P is fixed to a position where it can be photographed by the first imaging device D1 (e.g., a CT scanner 16) (step S102). Specifically, the medical image processing device 100 outputs a movement amount signal to the bed control unit 14, and the bed control unit 14 controls the translation mechanism and the like provided on the bed 12. Next, the first imaging device D1 takes a three-dimensional fluoroscopic image (e.g., a 4D-CT image) of the patient P (step S104). Next, the second image acquisition unit 120 acquires the three-dimensional fluoroscopic image (e.g., a 4D-CT image or multiple CT images) taken in step S104 as the second image (step S106).

[0046] Next, the 3D-3D positioning execution unit 130 performs 3D-3D positioning processing based on the first image acquired by the first image acquisition unit 110 and the second image acquired by the second image acquisition unit 120, and calculates the first displacement amount (step S108). Next, the region information acquisition unit 140 acquires region information associated with the first image (step S110). Next, the region estimation unit 150 estimates the position of the region on the second image that corresponds to the region associated with the region information in the first image (step S112). Next, the tracking unit 170 tracks the position of the object (e.g., tumor T) in the second image using the tracking model acquired by the tracking model acquisition unit 160 (step S114). Next, the error calculation unit 180 calculates the error between the tracking position, which is the position of the object in the second image tracked by the tracking unit 170, and the position of the object in the second image (step S116). Next, the model correction unit 190 corrects the tracking model based on the error calculated by the error calculation unit 180 (step S118).

[0047] As described above, the medical image processing apparatus 100 of the embodiment includes: a first image acquisition unit 110 that acquires a first image, which is a three-dimensional fluoroscopic image of a patient taken in the first stage; a second image acquisition unit 120 that acquires a second image, which is a three-dimensional fluoroscopic image of a patient taken in the second stage, which is later than the first stage; a 3D-3D positioning execution unit 130 that aligns the position of the second image with the position of the first image based on the pixel values ​​of the first and second images; a region information acquisition unit 140 that acquires region information corresponding to the region of the first image; a region estimation unit 150 that estimates the region in the second image that corresponds to the region information; a tracking model acquisition unit 160 that acquires a tracking model created based on the first image; a tracking unit 170 that tracks an object in the second image using the tracking model; and an error calculation unit 180 that calculates the error between the tracking position, which is the position of the object in the second image tracked by the tracking unit, and the position of the object in the second image. This configuration enables the medical image processing device 100 to accurately track the position of an object in the second image and to handle interferenceal changes.

[0048] The medical image processing device 100 may also include a model correction unit 190 that corrects the tracking model based on the second image and the error calculated by the error calculation unit 180. This configuration can further improve the tracking accuracy of the tracking model.

[0049] The region A' estimated by the region estimation unit 150 may be the extent of the tumor in the second image.

[0050] The region A' estimated by the region estimation unit 150 may be the range of the marker in the second image.

[0051] The tracking model used by the tracking unit 170 may be obtained by machine learning using the image pattern of the tumor in the first image.

[0052] The tracking model used by the tracking unit 170 may be obtained by machine learning the relationship between the position of the tumor and the position of the diaphragm in the first image.

[0053] The error calculated by the error calculation unit 180 may be the three-dimensional Euclidean distance between the centroid position of the object in the second image and the tracking position by the tracking unit 170.

[0054] The error calculated by the error calculation unit 180 may be the distance between the trajectory obtained from the tumor position of the first image, which is two or more still images or videos, and the tracking position determined by the tracking unit 170.

[0055] The model correction unit 190 may correct the tracking model based on the difference between the image pattern of the tumor in the first image and the image pattern of the tumor in the second image.

[0056] The model correction unit 190 may correct the tracking model based on the relationship between the tumor's position in the second image and the diaphragm's boundary position.

[0057] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of Symbols]

[0058] 1…Treatment system 10…Treatment device 12…Treatment table 14…Treatment table control unit 100…Medical image processing device 110…First image acquisition unit 120…Second image acquisition unit 130…3D-3D positioning execution unit 140…Region information acquisition unit 150…Region estimation unit 160…Tracking model acquisition unit 170…Tracking unit 180…Error calculation unit 190…Model correction unit

Claims

1. A first image acquisition unit acquires a first image, which is a three-dimensional fluoroscopic image of the patient taken in the first stage, A second image acquisition unit acquires a second image, which is a three-dimensional fluoroscopic image of the patient taken in a second stage that is later than the first stage, A 3D-3D positioning execution unit that aligns the position of the second image with the position of the first image based on the pixel values ​​of the first and second images, A region information acquisition unit that acquires region information corresponding to the region of the first image, A region estimation unit that estimates the region corresponding to the region information in the second image, A tracking model acquisition unit that acquires a tracking model created based on the first image, A tracking unit that tracks an object in the second image using the aforementioned tracking model, The system includes an error calculation unit that calculates the error between the tracking position, which is the position of the object in the second image tracked by the tracking unit, and the position of the object in the second image. Medical image processing equipment.

2. The system further includes a model correction unit that corrects the tracking model based on the second image and the error. The medical image processing apparatus according to claim 1.

3. The region estimated by the region estimation unit is the extent of the tumor in the second image. The medical image processing apparatus according to claim 1.

4. The region estimated by the region estimation unit is the range of the marker in the second image. The medical image processing apparatus according to claim 1.

5. The aforementioned tracking model was trained using machine learning with the image pattern of the tumor in the first image. The medical image processing apparatus according to claim 1.

6. The aforementioned tracking model was developed using machine learning to determine the relationship between the tumor's position and the diaphragm's position in the first image. The medical image processing apparatus according to claim 1.

7. The error is the three-dimensional Euclidean distance between the centroid position of the object in the second image and the tracking position by the tracking unit. The medical image processing apparatus according to claim 1.

8. The error is the distance between the trajectory obtained from the tumor position in the first image, which is two or more still images or a video, and the tracking position by the tracking unit. The medical image processing apparatus according to claim 1.

9. The model correction unit corrects the tracking model based on the difference between the image pattern of the tumor in the first image and the image pattern of the tumor in the second image. The medical image processing apparatus according to claim 2.

10. The model correction unit corrects the tracking model based on the relationship between the tumor's position and the diaphragm's boundary position in the second image. The medical image processing apparatus according to claim 2.

11. A medical image processing apparatus according to any one of claims 1 to 10, A treatment apparatus comprising: an irradiation unit for irradiating the patient with radiation; a first imaging device for capturing the second image; a bed for placing and securing the patient; and a bed control unit for controlling the movement of the bed. A treatment system equipped with these features.

12. Computers The first image, which is a three-dimensional fluoroscopic image of the patient taken in the first stage, is obtained. A second image, which is a three-dimensional fluoroscopic image of the patient taken in the second stage after the first stage, is obtained. Based on the pixel values ​​of the first and second images, 3D-3D positioning is performed to align the position of the second image with the position of the first image. Obtain region information corresponding to the region of the first image, In the second image, estimate the region corresponding to the region information, Obtain a tracking model created based on the first image mentioned above. Using the aforementioned tracking model, the object in the second image is tracked, The error between the tracking position, which is the position of the object in the second image tracked by the tracking model, and the position of the object in the second image is calculated. Medical image processing methods.

13. On the computer, The first image, which is a three-dimensional fluoroscopic image of the patient taken in the first stage, is obtained. A second image, which is a three-dimensional fluoroscopic image of the patient taken in the second stage after the first stage, is obtained. Based on the pixel values ​​of the first and second images, 3D-3D positioning is performed to align the position of the second image with the position of the first image. To obtain region information corresponding to the region of the first image, In the second image, estimate the region corresponding to the region information. Obtain a tracking model created based on the first image mentioned above. The tracking model is used to track the object in the second image. The tracking model calculates the error between the tracking position, which is the position of the object in the second image tracked by the tracking model, and the position of the object in the second image. program.

14. A recording medium on which a program is stored, The aforementioned program is installed on the computer. The first image, which is a three-dimensional fluoroscopic image of the patient taken in the first stage, is obtained. A second image, which is a three-dimensional fluoroscopic image of the patient taken in the second stage after the first stage, is obtained. Based on the pixel values ​​of the first and second images, 3D-3D positioning is performed to align the position of the second image with the position of the first image. To obtain region information corresponding to the region of the first image, In the second image, estimate the region corresponding to the region information. Obtain a tracking model created based on the first image mentioned above. The tracking model is used to track the object in the second image. The tracking model calculates the error between the tracking position, which is the position of the object in the second image tracked by the tracking model, and the position of the object in the second image. Recording medium.

Images