X-ray fluoroscopic imaging device and X-ray image processing method

Abstract

Provided are an X-ray fluoroscopic imaging device and an X-ray image processing method. The X-ray fluoroscopic imaging device comprises: an imaging unit; an X-ray image acquisition unit that acquires an X-ray image; a blood vessel extraction image acquisition unit that acquires a blood vessel extraction image; a synthetic image generation unit that generates a second synthetic image synthesized by the X-ray image and the blood vessel extraction image; and a region of interest setting unit that sets a region of interest where a device is photographed, wherein the synthetic image generation unit is configured to align the X-ray image and the blood vessel extraction image with the device and blood vessel image photographed in the region of interest as a reference, thereby generating the second synthetic image.

Description

Technical Field

[0001] The present invention relates to an X-ray fluoroscopic imaging device and an X-ray image processing method, and in particular to an X-ray fluoroscopic imaging device for generating a composite image by aligning a blood vessel extraction image with an X-ray image. Background Art

[0002] Conventionally, an X-ray fluoroscopy apparatus is known that generates a composite image obtained by aligning a blood vessel extraction image with an X-ray image. For example, Japanese Patent Application Publication No. 2019-171105 discloses such an X-ray fluoroscopy apparatus.

[0003] The X-ray fluoroscopy device disclosed in Japanese Patent Publication No. 2019-171105 is configured to superimpose a previously captured blood vessel image on a perspective image motion image being photographed. The X-ray fluoroscopy device disclosed in Japanese Patent Publication No. 2019-171105 includes: a feature point search unit that searches for feature points from images and motion images; a center of gravity calculation unit that calculates the center of gravity for multiple feature points; a vector group calculation unit that calculates a vector group representing the relative position of the feature points based on the center of gravity; a selection unit that selects a vector group from the vector groups; and an image superposition unit that superimposes the blood vessel image corresponding to the selected vector group on the perspective image motion image. In the X-ray fluoroscopy device disclosed in Japanese Patent Publication No. 2019-171105, when a device such as a catheter is introduced into a blood vessel to perform surgery, an image obtained by superimposing the blood vessel image on the perspective image motion image of the device is displayed to the operator.

[0004] However, in the structure disclosed in Japanese Patent Publication No. 2019-171105, a vector group is calculated based on the feature points captured in both the blood vessel image and the perspective image motion image, and a superimposed image (synthetic image) obtained by superimposing the blood vessel image on the perspective image motion image is generated. Although the feature points are captured in both the blood vessel image and the perspective motion image, the feature points are not necessarily near the blood vessel into which the device is introduced. Therefore, if there are no feature points near the blood vessel into which the device is introduced, it is possible that as the distance between the position of the feature point and the position of the device increases, the positional alignment error between the blood vessel image (blood vessel extraction image) and the perspective image motion image (X-ray image) increases. That is, near the device of the synthetic image, the positional deviation between the blood vessel extraction image and the X-ray image may increase. Here, in the case of an operation to introduce a device such as a catheter into a blood vessel, the surgical operator operates the device by looking at the vicinity of the device in the blood vessel to select the blood vessel into which the device is introduced at the branching portion of the blood vessel, etc. Therefore, it is desirable to have an X-ray fluoroscopy device that can generate a synthetic image that suppresses the positional deviation between the X-ray image and the blood vessel extraction image near the device. Summary of the invention

[0005] The present invention has been made to solve the above-mentioned problem, and provides an X-ray fluoroscopy apparatus and an X-ray image processing method capable of suppressing positional deviation between a blood vessel extraction image and an X-ray image near a device.

[0006] In order to achieve the above-mentioned object, an X-ray fluoroscopy apparatus according to a first aspect of the present invention comprises: an imaging unit including an X-ray source for irradiating X-rays to a subject and an X-ray detector for detecting the X-rays irradiated from the X-ray source; an X-ray image acquisition unit for acquiring an X-ray image captured by the imaging unit; a blood vessel extraction image acquisition unit for acquiring a blood vessel extraction image in which a blood vessel image of the subject is extracted and which is generated in advance based on a contrast image, which is an X-ray image captured in a state where a contrast agent is administered to the subject; a synthetic image generation unit for generating a synthetic image synthesized by aligning an X-ray image captured in a state where no contrast agent is administered and the blood vessel extraction image; and a region of interest setting unit for setting a region of interest that is a part of the X-ray image and captures a device of a blood vessel introduced into the subject, wherein the synthetic image generation unit is configured to generate the synthetic image by aligning the X-ray image and the blood vessel extraction image based on the device captured in the region of interest set by the region of interest setting unit and the blood vessel image captured in the blood vessel extraction image.

[0007] In addition, the X-ray image processing method of the second aspect of the present invention includes the following steps: acquiring an X-ray image; a blood vessel extraction image acquisition unit acquiring a blood vessel extraction image pre-generated based on a contrast image, the contrast image being an X-ray image captured in a state where a contrast agent is administered to a subject and the image is captured; a synthetic image generation unit generating a synthetic image synthesized by aligning an X-ray image captured in a state where no contrast agent is administered with the blood vessel extraction image; a region of interest setting unit setting a region of interest that is a part of the X-ray image and captures a device introduced into a blood vessel of the subject; and generating a synthetic image by aligning the X-ray image with the blood vessel extraction image again based on the device captured in the region of interest and the blood vessel image captured in the blood vessel extraction image.

[0008] In the X-ray fluoroscopy apparatus of the first aspect, as described above, a synthetic image generating unit is provided, which generates a synthetic image by performing position alignment between an X-ray image and a blood vessel extraction image based on a device captured in a region of interest set by a region of interest setting unit and a blood vessel image captured in a blood vessel extraction image. Thus, since the position alignment between the X-ray image and the blood vessel extraction image is performed based on the device captured in the region of interest and the blood vessel image captured in the blood vessel extraction image, the position alignment between the X-ray image and the blood vessel extraction image can be performed with high accuracy near the device. As a result, a synthetic image can be generated in which positional deviation between the X-ray image and the blood vessel extraction image is suppressed near the device. In addition, the vicinity of the device refers to both the position of the device itself and the position around (near) the device.

[0009] In addition, in the X-ray image processing method of the second aspect, as described above, the step of re-aligning the X-ray image and the blood vessel extraction image based on the device captured in the region of interest and the blood vessel image captured in the blood vessel extraction image is included to generate a composite image. Thus, it is possible to provide an X-ray image processing method capable of generating a composite image in which the positional deviation between the X-ray image and the blood vessel extraction image in the vicinity of the device is suppressed, similarly to the X-ray fluoroscopy apparatus of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 It is a diagram showing the overall structure of an X-ray fluoroscopy apparatus according to one embodiment.

[0011] Figure 2 This is a schematic diagram for explaining a structure in which a synthetic image generating unit according to one embodiment generates a synthetic image.

[0012] Figure 3 FIG. 1 is a schematic diagram for explaining a blood vessel extraction image acquired by a blood vessel extraction image acquisition unit according to an embodiment.

[0013] Figure 4 It is a schematic diagram for explaining the positional deviation between the X-ray image and the blood vessel extraction image.

[0014] Figure 5 This is a schematic diagram for explaining a configuration in which a synthetic image generating unit according to one embodiment generates a synthetic image when a region of interest is set.

[0015] Figure 6 This is a schematic diagram for explaining a synthetic image as a moving image generated by a synthetic image generating unit according to one embodiment.

[0016] Figure 7This is a schematic diagram for explaining a configuration in which a synthetic image generating unit according to one embodiment acquires a region corresponding to a region of interest.

[0017] Figure 8 This is a schematic diagram for explaining a configuration in which a synthetic image generating unit according to one embodiment positions an X-ray image and a blood vessel extraction image based on a region of interest and a region corresponding to the region of interest.

[0018] Fig.9A This is a schematic diagram of a first frame of a second synthetic image for explaining the size of a region of interest set by a region of interest setting unit according to one embodiment.

[0019] Fig. 9B This is a schematic diagram of a second frame of a second synthetic image for explaining the size of a region of interest set by a region of interest setting unit according to one embodiment.

[0020] Fig. 9C This is a schematic diagram of the third frame of the second synthetic image for explaining the size of the region of interest set by the region of interest setting unit according to one embodiment.

[0021] Fig.9D This is a schematic diagram of the fourth frame of the second synthetic image for explaining the size of the region of interest set by the region of interest setting unit according to one embodiment.

[0022] Fig.10 This is a schematic diagram for explaining a configuration in which a region of interest setting unit receives resetting of a region of interest according to one embodiment.

[0023] Fig.11 This is a flowchart for explaining the process of generating a composite image.

[0024] Fig.12 This is a flowchart for explaining the process of resetting the region of interest and generating a synthetic image. DETAILED DESCRIPTION

[0025] (Structure of X-ray Fluoroscopic Device)

[0026] Reference Figure 1 The structure of an X-ray fluoroscopy apparatus 100 according to an embodiment of the present invention will be described.

[0027] like Figure 1 As shown, the X-ray fluoroscopy apparatus 100 of this embodiment includes an imaging unit 1, a computer 2, an input receiving unit 3, a display unit 4, a storage unit 5, and a top plate 6. In this embodiment, the X-ray fluoroscopy apparatus 100 images a heart 91 of a subject 90 as a subject. For example, the X-ray fluoroscopy apparatus 100 is used in an operation for treating a stenotic site of a blood vessel 92a of the heart 91 using a device 7.

[0028] The imaging unit 1 includes an X-ray source 1a, an X-ray detector 1b, and an arm 1c disposed so that the X-ray source 1a and the X-ray detector 1b face each other.

[0029] The X-ray source 1a is configured to irradiate X-rays to the subject. Specifically, a voltage is applied to the X-ray source 1a by a driving unit (not shown) to thereby irradiate X-rays. The X-ray source 1a has a collimator that can adjust the irradiation range, i.e., the irradiation area, of the X-rays. In this embodiment, the X-ray source 1a is mounted on the front end of one side of the arm 1c.

[0030] The X-ray detector 1b is configured to detect X-rays irradiated from the X-ray source 1a. In the present embodiment, the X-ray detector 1b is mounted on the front end of the other side of the arm 1c. That is, the X-ray detector 1b is arranged on the side opposite to the X-ray source 1a across the top plate 6. In addition, the X-ray detector 1b is configured to be able to detect X-rays. The X-ray detector 1b is, for example, an FPD (Flat Panel Detector). The X-ray detector 1b is configured to detect X-rays that have passed through the subject and output a detection signal based on the detected X-rays.

[0031] The computer 2 includes a processor 2a such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an FPGA (Field-Programmable Gate Array) for image processing, as well as a ROM (Read Only Memory) and a RAM (Random Access Memory).

[0032] like Figure 1 As shown, the processor 2a includes a control unit 20. The control unit 20 is configured to control the imaging unit 1, etc. The control unit 20 is configured by software as a functional block implemented by the processor 2a executing various programs. The control unit 20 can be configured by hardware by providing a dedicated processor (processing circuit).

[0033] like Figure 1As shown in FIG. 1 , the control unit 20 includes an X-ray image acquisition unit 20a, a blood vessel extraction image acquisition unit 20b, a synthetic image generation unit 20c, and a region of interest setting unit 20d. The X-ray image acquisition unit 20a, the blood vessel extraction image acquisition unit 20b, the synthetic image generation unit 20c, and the region of interest setting unit 20d are configured by software as functional blocks that are realized by the control unit 20 executing a program for image processing. The X-ray image acquisition unit 20a, the blood vessel extraction image acquisition unit 20b, the synthetic image generation unit 20c, and the region of interest setting unit 20d may be configured by separate hardware by providing a dedicated processor (processing circuit).

[0034] The X-ray image acquisition unit 20a is configured to acquire the X-ray image 10 captured by the imaging unit 1. The blood vessel extraction image acquisition unit 20b is configured to acquire a contrast image 11 (see FIG. 1 ) based on the X-ray image 10 captured in a state where a contrast medium is administered to the subject. Figure 3 ) A blood vessel image 92 of the subject extracted and generated in advance (refer to Figure 2 ) of the blood vessel extraction image 12. In addition, the composite image generating unit 20c is configured to generate a first composite image 13 and a second composite image 14 synthesized by aligning the X-ray image 10 captured without the administration of a contrast agent with the blood vessel extraction image 12. In addition, the region of interest setting unit 20d is configured to set a region of interest 92a (see FIG. 1 ) which is a part of the X-ray image 10 and captures the blood vessel 92a introduced into the subject. Figure 2 ) device 7 (refer to Figure 2 ) of the region of interest 30 (refer to Figure 5 ) The detailed configurations of the X-ray image acquisition unit 20a, the blood vessel extraction image acquisition unit 20b, the synthetic image generation unit 20c, and the region of interest setting unit 20d will be described later.

[0035] The input receiving unit 3 is configured to receive an operation input for setting the region of interest 30 on the X-ray image 10. The input receiving unit 3 includes, for example, an input device such as a mouse and a keyboard.

[0036] The display unit 4 is configured to display the X-ray image 10 or the second synthesized image 14. In the present embodiment, the display unit 4 displays any one of the X-ray image 10, the first synthesized image 13, and the second synthesized image 14. The display unit 4 is a monitor provided in the X-ray fluoroscopy apparatus 100.

[0037] The storage unit 5 is configured to store the X-ray image 10 acquired by the X-ray image acquisition unit 20a, the blood vessel extraction image 12 acquired by the blood vessel extraction image acquisition unit 20b, and the first synthetic image 13 and the second synthetic image 14 generated by the synthetic image generation unit 20c. In addition, the storage unit 5 is configured to store various programs executed by the control unit 20. The storage unit 5 includes a non-volatile memory such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0038] like Figure 1 As shown, the top plate 6 is formed into a rectangular flat plate shape when viewed from above. The subject 90 is placed on the top plate 6 in a manner such that the head and foot direction of the subject 90 is along the long side of the rectangle, and the left and right direction of the subject 90 is along the short side of the rectangle. In addition, in the present application specification, the head and foot direction of the subject 90 is set as the X direction, the left and right direction of the subject is set as the Y direction, and the direction orthogonal to the X direction and the Y direction is set as the Z direction.

[0039] A moving mechanism (not shown) is provided on the top plate 6. The X-ray fluoroscopy apparatus 100 moves the top plate 6 in the longitudinal direction (X direction) by the moving mechanism, thereby changing the relative position of the top plate 6 and the imaging unit 1 while imaging the subject.

[0040] like Figure 1 As shown, the operator (doctor, technician, etc.) injects contrast medium into the subject 90 placed on the top plate 6 and changes the relative position of the imaging unit 1 and the top plate 6, while taking a plurality of contrast images 11 (see Figure 3 ). Before contrast medium is administered, it penetrates blood vessel 92a (refer to Figure 2 ) has no difference in attenuation of X-rays that pass through the surrounding tissues, so a clear X-ray image 10 of the blood vessel 92a cannot be generated. Therefore, by administering a contrast agent that shields X-rays to the subject 90, a difference is created in attenuation of X-rays that pass through the blood vessel 92a and attenuation of X-rays that pass through the surrounding tissues, so that a clear contrast image 11 of the blood vessel 92a can be generated.

[0041] However, when the amount of contrast agent administered increases, the burden on the subject 90 increases, and the visibility of the device 7 in the X-ray image 10 also decreases, so when the operator performs surgery using the device 7, the contrast agent is not administered into the blood vessel 92a of the subject 90. Therefore, when the operator introduces the device 7 into the blood vessel 92a, it is sometimes difficult to visually recognize the blood vessel 92a in the X-ray image 10.

[0042] (First synthetic image)

[0043] Therefore, in this embodiment, if Figure 2 As shown in FIG. 1 , the synthesized image generating unit 20 c is configured to generate a first synthesized image 13 by aligning the X-ray image 10 with the blood vessel extraction image 12. Figure 2 In the example shown, the background of the X-ray image 10 is indicated by hatching.

[0044] The X-ray image acquisition unit 20a acquires the X-ray image 10. In addition, the blood vessel extraction image acquisition unit 20b acquires the blood vessel extraction image 12.

[0045] The X-ray image 10 is a picture taken when the subject 90 (see Figure 1 ) is an image taken in a state where a contrast agent is administered. Since no contrast agent is administered, the device 7 is captured in the X-ray image 10, but the blood vessel 92a is not captured. Figure 2 The X-ray image 10 shown shows the blood vessel 92a with a dotted line for convenience. The device 7 includes at least one of a catheter, a stent, and a guide wire introduced into the blood vessel 92a. Hereinafter, an example in which the catheter is imaged as the device 7 will be described.

[0046] The blood vessel extracted image 12 is an image in which the blood vessel image 92 is captured. In this embodiment, for convenience, an image in which only the blood vessel image 92 is captured is used as the blood vessel extracted image 12 for description. The blood vessel image 92 is an image of a blood vessel 92a. The details of the blood vessel extracted image 12 will be described later.

[0047] The synthetic image generating unit 20c can generate the first synthetic image 13 by aligning the entire X-ray image 10 with the entire blood vessel extraction image 12. Specifically, the synthetic image generating unit 20c aligns the X-ray image 10 with the blood vessel extraction image 12 based on the overall shape of the device 7 captured in the X-ray image 10 and the shape of the blood vessel image 92 in the blood vessel extraction image 12.

[0048] (Blood vessel extraction image)

[0049] like Figure 3 As shown, a blood vessel extraction image 12 is generated based on a contrast image 11 captured in a state where a contrast agent is administered and an X-ray image 10 captured in a state where a contrast agent is not administered. Specifically, the blood vessel extraction image 12 is generated by performing a black-and-white inversion process on a difference image 15 between the contrast image 11 and the X-ray image 10.

[0050] The X-ray image 10 is captured without contrast agent administration, so the blood vessel 92a is not captured, and only the background portion is captured. In addition, the contrast image 11 is captured with contrast agent administration, so the blood vessel 92a and the background portion are captured. Therefore, in the difference image 15 between the contrast image 11 and the X-ray image 10, only the blood vessel 92a is captured. In addition, in the contrast image 11, the background portion is illustrated by hatching.

[0051] The blood vessel extraction image 12 is generated by performing black-and-white inversion processing, which is processing for inverting the brightness of the difference image 15. That is, in the blood vessel extraction image 12, the blood image 92, which is an image of the blood vessel 92a, is drawn in white, and the portion other than the blood vessel 92a is drawn in black.

[0052] (Position deviation in the composite image)

[0053] Here, in Figure 2 In the structure shown, the synthetic image generation unit 20c uses the entire X-ray image 10 and the entire blood vessel extraction image 12 for position alignment. The X-ray image 10 and the blood vessel extraction image 12 are images captured at different time points (moments) and may not be completely consistent. Therefore, when the X-ray image 10 and the blood vessel extraction image 12 are used for position alignment, if the overall error is to be minimized, there will be local position deviation. That is, Figure 4 As shown in the first synthesized image 13, in the first synthesized image 13, the position of the device 7 and the position of the blood vessel image 92 may be misaligned. Figure 4 Yes Figure 2 The dotted line diagram in FIG. 4 shows an enlarged schematic diagram of the region 40. Figure 4 In the example shown, a virtual component 70 is shown by a dotted line to indicate the position of the component 7 when no positional deviation occurs.

[0054] In addition, for example, it is considered that a gold marker or the like that is captured in both the X-ray image 10 and the blood vessel extraction image 12 is introduced into the subject 90, and position alignment is performed based on the gold marker captured in both the X-ray image 10 and the blood vessel extraction image 12. However, even when position alignment is performed based on the gold marker, the two images are exactly consistent around the position of the gold marker, but the error becomes larger as the distance from the gold marker increases.

[0055] like Figure 4 As shown, when the positions of the device 7 and the blood vessel image 92 are deviated, it is difficult for the operator to accurately move the device 7 to the branch portion 92b of the blood vessel 92a.

[0056] (Second synthetic image)

[0057] Therefore, in this embodiment, if Figure 5 As shown, the synthetic image generating unit 20c (see Figure 1 ) is configured as follows: by passing through the region of interest setting unit 20d (refer to Figure 1 ) and the blood vessel image 92 captured in the blood vessel extraction image 12 are used as references to align the X-ray image 10 and the blood vessel extraction image 12, thereby generating a second synthesized image 14.

[0058] like Figure 5 As shown, the region of interest setting unit 20d is configured to set the region of interest 30 in the X-ray image 10 based on the operation input received by the input receiving unit 3. Specifically, the region of interest setting unit 20d sets the region of interest 30 of a predetermined shape and a predetermined size in the X-ray image 10 at a position based on the operation input received by the input receiving unit 3. Figure 5 In the illustrated example, the region of interest setting unit 20d sets a circular region of interest 30 in the X-ray image 10. The size of the region of interest 30 will be described later.

[0059] In addition, in the present embodiment, the synthetic image generating unit 20c is configured to generate the second synthetic image 14 by aligning the X-ray image 10 with the blood vessel extraction image 12 based on the device 7 captured in the region of interest 30 when the region of interest 30 is set by the region of interest setting unit 20d that receives the operation input while the X-ray image 10 or the first synthetic image 13 is displayed on the display unit 4. That is, in a case where a slight positional deviation is allowed, such as when the device 7 is introduced into a thick blood vessel 92a, the first synthetic image 13 in which the entire X-ray image 10 is aligned with the entire blood vessel extraction image 12 is displayed on the display unit 4. In addition, in a case where the device 7 reaches a position where the positional deviation is not allowed, such as the branch portion 92b of the blood vessel 92a, the second synthetic image 14 generated by aligning the X-ray image 10 with the blood vessel extraction image 12 based on the device 7 captured in the region of interest 30 set according to the operation input of the operator may be displayed on the display unit 4.

[0060] (As a composite image of a moving image)

[0061] like Figure 6 As shown, in this embodiment, the X-ray image acquisition unit 20a is configured to acquire the X-ray images 10 generated successively as live images. In addition, the synthetic image generation unit 20c is configured to acquire the region 31 (see FIG. 1 ) corresponding to the region of interest 30 in the blood vessel extraction image 12 based on the device 7 captured in the region of interest 30 in each frame of the live image. Figure 7), and align the region 31 corresponding to the region of interest 30 in the acquired blood vessel extraction image 12 with the position of the region of interest 30 in each frame of the live image, thereby generating a second synthesized image 14. In addition, acquiring the region 31 corresponding to the region of interest 30 means acquiring the position (position coordinates) of the region 31 corresponding to the region of interest 30 in the blood vessel extraction image 12.

[0062] The X-ray image acquisition unit 20a is configured to acquire a plurality of X-ray images 10 corresponding to at least one cycle of the heart 91 as live images. The X-ray images 10 are live images captured at a predetermined frame rate. The predetermined frame rate is, for example, 15fps (frames per second) or 7.5fps. Figure 6 , for convenience, an example is shown in which the X-ray image acquisition unit 20a acquires five frames of X-ray images 10, namely, X-ray image 10a, X-ray image 10b, X-ray image 10c, X-ray image 10d and X-ray image 10e as live images.

[0063] In addition, the blood vessel extraction image acquisition unit 20b is configured to acquire a plurality of blood vessel extraction images 12 corresponding to at least one cycle of the heart 91 as the blood vessel extraction image 12. The blood vessel extraction image 12 is an image indicating the position of the blood vessel 92a in the X-ray image 10. Therefore, the blood vessel extraction image 12 is preferably captured at a higher frame rate than the X-ray image 10 to acquire a frame corresponding to the blood vessel 92a of the X-ray image 10. For example, the blood vessel extraction image 12 is preferably captured at 30 fps. Figure 6 , for convenience, an example of the blood vessel extracted image 12 in which the blood vessel extracted image acquisition unit 20b acquires nine frames of blood vessel extracted image 12, namely, blood vessel extracted image 12a, blood vessel extracted image 12b, blood vessel extracted image 12c, blood vessel extracted image 12d, blood vessel extracted image 12e, blood vessel extracted image 12f, blood vessel extracted image 12g, blood vessel extracted image 12h, and blood vessel extracted image 12i is shown as the blood vessel extracted image 12.

[0064] The synthetic image generating unit 20c performs position alignment of each frame of the live image (X-ray image 10) with the blood vessel extraction image 12, thereby generating a second synthetic image 14 as a moving image. Specifically, the synthetic image generating unit 20c performs position alignment of each frame of the X-ray image 10 with one of the plurality of blood vessel extraction images 12, thereby generating the second synthetic image 14 in units of frames. Figure 6 2 , for convenience, an example is shown in which the synthesized image generating unit 20 c generates five frames of the second synthesized image 14 , namely, a second synthesized image 14 a , a second synthesized image 14 b , a second synthesized image 14 c , a second synthesized image 14 d , and a second synthesized image 14 e .

[0065] (Acquisition of a Region Corresponding to a Region of Interest)

[0066] Here, the synthetic image generating unit 20c selects an image to be aligned with the X-ray image 10 from among the plurality of blood vessel extraction images 12. Specifically, the synthetic image generating unit 20c selects the blood vessel extraction image 12 to be aligned based on the shape of the device 7 in the X-ray image 10 and the shape of the blood vessel image 92 in the blood vessel extraction image 12. More specifically, in order to align the X-ray image 10 with the blood vessel extraction image 12 based on the region of interest 30, the synthetic image generating unit 20c obtains a portion corresponding to the region of interest 30 in the blood vessel extraction image 12, thereby selecting the blood vessel extraction image 12 to be aligned.

[0067] However, if Figure 6 As shown in FIG. 1 , the device 7 is captured in the X-ray image 10, but is not captured in the blood vessel extraction image 12. Therefore, in the present embodiment, the synthetic image generation unit 20c is configured to acquire, based on the shape of the device 7 captured in the region of interest 30 in each frame of the live image and the shape of the blood vessel image 92 captured in the blood vessel extraction image 12, a region 31 corresponding to the region of interest 30 is acquired from the blood vessel extraction image 12 of the phase closest to the phase of the region of interest 30 in each frame of the live image (see FIG. 1 ). Figure 7 ).

[0068] In this embodiment, if Figure 7 As shown, the composite image generator 20 c is configured to acquire a region 31 corresponding to the region of interest 30 in the blood vessel extraction image 12 based on the shape of the device 7 captured in the region of interest 30 and the shape of the blood vessel image 92 captured in the blood vessel extraction image 12 .

[0069] Since the device 7 is traveling in the blood vessel 92a, the device 7 is captured in the X-ray image 10 as a shape along the blood vessel 92a. Therefore, the shape of the device 7 in the X-ray image 10 coincides with the contour line of the blood vessel image 92 in the blood vessel extraction image 12 or the curve passing through the center of the blood vessel image 92 with high accuracy. Therefore, in the present embodiment, for example, the synthetic image generation unit 20c performs shape fitting between the shape of the device 7 captured in the region of interest 30 and the shape of the blood vessel image 92 captured in the blood vessel extraction image 12, thereby acquiring a region in the blood vessel extraction image 12 that has a high correlation with the shape of the device 7 captured in the region of interest 30 as the region 31 corresponding to the region of interest 30. In addition, as a method of acquiring the region 31 corresponding to the region of interest 30, other known methods may be used.

[0070] (Position alignment using a region of interest and a region corresponding to the region of interest)

[0071] like Figure 8 As shown, the synthetic image generating unit 20c performs the position alignment between the X-ray image 10 and the blood vessel extracted image 12 based on the region of interest 30 in the X-ray image 10 and the region 31 corresponding to the region of interest 30 in the blood vessel extracted image 12. Specifically, the synthetic image generating unit 20c performs the position alignment between the X-ray image 10 and the blood vessel extracted image 12 based on the shape of the device 7 captured in the region of interest 30 and the shape of the blood vessel image 92 captured in the blood vessel extracted image 12.

[0072] (Size of the region of interest)

[0073] FIG. 9A to FIG. 9D The first to fourth frames of the second synthesized image 14 as a moving image, namely, second synthesized images 14a to 14d are shown. In the present embodiment, the subject is the subject 90 (see Figure 1 )'s heart 91 (reference Figure 1 ), the device 7 and the blood vessel 92a displayed in the second synthetic image 14 move due to the beating of the heart 91. In this embodiment, the region of interest setting unit 20d is configured to set the region of interest 30 of a size corresponding to the movement range of the device 7 when the device 7 moves with the beating of the heart 91 in the live image (X-ray image 10). Fig.9A As shown in FIG. 1 , the device 7 is moved to the uppermost side in the second composite image 14, and Fig.9D In any case where the device 7 moves to the lowermost side in the second synthetic image 14 as shown, the size of the region of interest 30 is set so that the device 7 is captured within the region of interest 30 .

[0074] (Resetting of the area of ​​interest)

[0075] When performing surgery using a device 7 such as a catheter, the branch portion 92b of the blood vessel 92a is not limited to one, and the next branch portion 92b may be located outside the region of interest 30. Therefore, during surgery, the device 7 may move from inside the region of interest 30 to outside the region of interest 30. In this embodiment, Fig.10As shown, the region of interest setting unit 20d is configured to accept resetting of the region of interest 30 if the front end 7a of the device 7 captured in the region of interest 30 moves outside the region of interest 30. In this embodiment, when the operator visually confirms that the front end 7a of the device 7 moves outside the region of interest 30, the operation input for resetting the region of interest 30 is performed. In addition, the control unit 20 may be configured to track the front end 7a of the device 7 through image processing and detect that the front end 7a of the device 7 moves outside the region of interest 30. The control unit 20 may be configured to notify the operator to re-set the region of interest 30 when detecting that the front end 7a of the device 7 moves outside the region of interest 30.

[0076] (Processing of generating a synthetic image)

[0077] Next, refer to Fig.11 The process of generating the first synthetic image 13 and the second synthetic image 14 by the synthetic image generating unit 20 c will be described.

[0078] In step 101, the X-ray image acquisition unit 20a acquires the X-ray image 10. In the process of step 101, the X-ray image acquisition unit 20a successively acquires the X-ray image 10 from the imaging unit 1 as a live image.

[0079] In step 102, the blood vessel extracted image acquisition unit 20b acquires a blood vessel extracted image 12 generated in advance based on the contrast image 11, which is an X-ray image 10 captured while a contrast agent is administered to the subject. In the process of step 102, the blood vessel extracted image acquisition unit 20b acquires a plurality of blood vessel extracted images 12 from the storage unit 5.

[0080] In step 103, the synthetic image generating unit 20c generates a first synthetic image 13 synthesized by aligning the X-ray image 10 captured without administering a contrast agent with the blood vessel extraction image 12. The first synthetic image 13 in step 103 is generated by aligning the entire X-ray image 10 with the entire blood vessel extraction image 12. That is, the first synthetic image 13 generated in step 103 is an image in which the device 7 and the blood vessel image 92 may be misaligned.

[0081] In step 104 , the control unit 20 displays the first synthesized image 13 on the display unit 4 .

[0082] In step 105, the region of interest setting unit 20d determines whether there is an operation input for setting the region of interest 30. If there is no operation input for setting the region of interest 30, the process proceeds to step 106. If there is an operation input for setting the region of interest 30, the process proceeds to step 107.

[0083] In step 106, the control unit 20 determines whether there is an input to end the display of the first synthesized image 13. If there is no input to end the display of the first synthesized image 13, the process proceeds to step 101. If there is an input to end the display of the first synthesized image 13, the process ends.

[0084] When the process proceeds from step 105 to step 107, in step 107, the region of interest setting unit 20d sets the region of interest 30 that is a part of the X-ray image 10 and captures the device 7 introduced into the blood vessel 92a of the subject. In the process of step 107, the region of interest setting unit 20d sets the region of interest 30 based on the operation input for setting the region of interest 30.

[0085] In step 108, the synthetic image generating unit 20c acquires the region 31 corresponding to the region of interest 30. The process of step 108 also includes a process in which the synthetic image generating unit 20c selects the blood vessel extraction image 12 to be aligned with the position of the X-ray image 10.

[0086] In step 109 , the synthetic image generator 20 c re-aligns the X-ray image 10 and the blood vessel extraction image 12 based on the device 7 captured in the region of interest 30 and the blood vessel image 92 captured in the blood vessel extraction image 12 , thereby generating a second synthetic image 14 .

[0087] In step 110 , the control unit 20 displays the second synthesized image 14 on the display unit 4 .

[0088] In step 111, the control unit 20 determines whether there is an input to end the display of the second synthesized image 14. If there is no input to end the display of the second synthesized image 14, the process proceeds to step 108. If there is an input to end the display of the second synthesized image 14, the process ends.

[0089] In the present embodiment, the control unit 20 performs the above-mentioned processing of steps 101 to 106 on the X-ray image 10 as a live image, and causes the display unit 4 to display the first synthetic image 13, when there is no operation input for setting the region of interest 30. That is, the control unit 20 generates the first synthetic image 13 in units of frames, and causes the display unit 4 to display it. In addition, when there is an operation input for setting the region of interest 30, the control unit 20 performs the above-mentioned processing of steps 107 to 111 on the X-ray image 10 as a live image, generates the second synthetic image 14, and causes the display unit 4 to display it. That is, the control unit 20 generates the second synthetic image 14 in units of frames, and causes the display unit 4 to display it.

[0090] Next, refer to Fig.12 Next, a description will be given of a process in which the region of interest setting unit 20d re-sets the region of interest 30. Note that steps that are the same as those in the process of generating the second synthetic image 14 are denoted by the same reference numerals, and detailed descriptions thereof will be omitted.

[0091] In step 201, the region of interest setting unit 20d determines whether the tip 7a of the device 7 is within the region of interest 30. When the tip 7a of the device 7 is within the region of interest 30, the process of step 201 is repeated. When the tip 7a of the device 7 is not within the region of interest 30, the process proceeds to step 202.

[0092] In step 202, the region of interest setting unit 20d determines whether there is an operation input for setting the region of interest 30. If there is no operation input for setting the region of interest 30, the process of step 202 is repeated. If there is an operation input for setting the region of interest 30, the process proceeds to steps 107 to 111, the second synthesized image 14 is generated, and the generated second synthesized image 14 is displayed on the display unit 4. Thereafter, the process ends.

[0093] (Effects of this embodiment)

[0094] In this embodiment, the following effects can be obtained.

[0095] In the present embodiment, as described above, the X-ray fluoroscopic imaging apparatus 100 comprises: an imaging unit 1 including an X-ray source 1a for irradiating X-rays to a subject, and an X-ray detector 1b for detecting the X-rays irradiated from the X-ray source 1a; an X-ray image acquisition unit 20a for acquiring an X-ray image 10 captured by the imaging unit 1; a blood vessel extraction image acquisition unit 20b for acquiring a blood vessel extraction image 12 in which a blood vessel image 92 of the subject is extracted and which is generated in advance based on the X-ray image 10 captured in a state where a contrast agent is administered to the subject, that is, a contrast image 11; and a synthetic image generation unit 20c for generating a synthetic image by using the X-ray source 1a for irradiating X-rays to a subject. a second synthesized image 14 synthesized by aligning the X-ray image 10 and the blood vessel extraction image 12 captured in a state where a contrast agent is administered; and a region of interest setting unit 20d that sets a region of interest 30 that is a part of the X-ray image 10 and captures the device 7 introduced into the blood vessel 92a of the subject, wherein the synthesized image generating unit 20c is configured to align the X-ray image 10 and the blood vessel extraction image 12 based on the device 7 captured in the region of interest 30 set by the region of interest setting unit 20d and the blood vessel image 92 captured in the blood vessel extraction image 12, thereby generating the second synthesized image 14. Thus, the X-ray image 10 and the blood vessel extraction image 12 are aligned based on the device 7 captured in the region of interest 30 and the blood vessel image 92 captured in the blood vessel extraction image 12, so that the X-ray image 10 and the blood vessel extraction image 12 can be aligned with high accuracy near the device 7. As a result, it is possible to generate the second synthesized image 14 in which the positional deviation between the X-ray image 10 and the blood vessel extraction image 12 in the vicinity of the device 7 is suppressed.

[0096] In addition, in the present embodiment, as described above, the X-ray image processing method includes the following steps: acquiring an X-ray image 10; a blood vessel extraction image acquisition unit 20b acquiring a blood vessel extraction image 12 generated in advance based on the X-ray image 10 captured in a state where a contrast agent is administered to a subject and the image is captured; a synthetic image generation unit 20c generating a second synthetic image 14 synthesized by aligning the X-ray image 10 captured in a state where no contrast agent is administered and the blood vessel extraction image 12; a region of interest setting unit 20d setting a region of interest 30 that is a part of the X-ray image 10 and captures the device 7 introduced into the blood vessel 92a of the subject; and aligning the X-ray image 10 and the blood vessel extraction image 12 again based on the device 7 captured in the region of interest 30 and the blood vessel image 92 captured in the blood vessel extraction image 12, thereby generating the second synthetic image 14. Thus, it is possible to provide an X-ray image processing method capable of generating the second synthesized image 14 in which the positional deviation between the X-ray image 10 and the blood vessel extraction image 12 near the device 7 is suppressed, similarly to the above-mentioned X-ray fluoroscopy apparatus 100 .

[0097] In addition, in the above-mentioned embodiment, by configuring as follows, further effects as described below can be obtained.

[0098] That is, in the present embodiment, as described above, the synthetic image generating unit 20c is configured to acquire the region 31 corresponding to the region of interest 30 in the blood vessel extraction image 12 based on the shape of the device 7 captured in the region of interest 30 and the shape of the blood vessel image 92 captured in the blood vessel extraction image 12. Here, the device 7 travels in the blood vessel 92a, and therefore, in the X-ray image 10, the device 7 is captured along the shape of the blood vessel 92a. Therefore, the shape of the device 7 in the X-ray image 10 and the contour line of the blood vessel image 92 in the blood vessel extraction image 12 or the curve passing through the center of the blood vessel image 92 are matched with high accuracy. Therefore, by configuring to acquire the region 31 corresponding to the region of interest 30 in the blood vessel extraction image 12 based on the shape of the device 7 and the shape of the blood vessel image 92, for example, even when there is no feature point captured in common in the X-ray image 10 and the blood vessel extraction image 12, such as a marker, the region 31 corresponding to the region of interest 30 can be acquired. As a result, even when the region of interest 30 is set at a position desired by the operator, the X-ray image 10 and the blood vessel extraction image 12 can be aligned based on the shape of the device 7 and the shape of the blood vessel image 92 .

[0099] In addition, in the present embodiment, as described above, the X-ray image acquisition unit 20a is configured to acquire the X-ray images 10 generated sequentially as live images, and the synthetic image generation unit 20c is configured to acquire the region 31 corresponding to the region of interest 30 in the blood vessel extraction image 12 based on the device 7 captured in the region of interest 30 in each frame of the live image, and align the region 31 corresponding to the region of interest 30 in the acquired blood vessel extraction image 12 with the position of the region of interest 30 in each frame of the live image, thereby generating the second synthetic image 14. Thus, the second synthetic image 14 can be generated in the form of a moving image, and the operator can confirm the second synthetic image 14 as a moving image, so that the workload of the operator performing the operation can be reduced.

[0100] In addition, in the present embodiment, as described above, the subject includes the heart 91 of the subject 90, the X-ray image acquisition unit 20a is configured to acquire a plurality of X-ray images 10 corresponding to at least one cycle of the heart 91 as live images, the blood vessel extraction image acquisition unit 20b is configured to acquire a plurality of blood vessel extraction images 12 corresponding to at least one cycle of the heart 91 as blood vessel extraction images 12, and the synthetic image generation unit 20c is configured to acquire a region 31 corresponding to the region of interest 30 from the blood vessel extraction image 12 of the plurality of blood vessel extraction images 12 having the phase closest to the phase of the region of interest 30 in each frame of the live image, based on the shape of the device 7 captured in the region of interest 30 in each frame of the live image and the shape of the blood vessel image 92 captured in the blood vessel extraction image 12. Thus, the region 31 corresponding to the region of interest 30 can be acquired based on the phase of the heart 91 in addition to the shape of the device 7 and the shape of the blood vessel 92a. As a result, the region 31 corresponding to the region of interest 30 having a high correlation with the region of interest 30 can be acquired with high accuracy.

[0101] In addition, in the present embodiment, as described above, the input receiving unit 3 is further provided, and the input receiving unit 3 receives an operation input for setting the region of interest 30 in the X-ray image 10, and the region of interest setting unit 20d is configured to set the region of interest 30 in the X-ray image 10 based on the operation input received by the input receiving unit 3. Thus, the region of interest 30 can be set at a position desired by the operator, such as the branch portion 92b of the blood vessel 92a. As a result, the second synthetic image 14 can be generated with high accuracy in which the X-ray image 10 and the blood vessel extraction image 12 are aligned at the position desired by the operator.

[0102] In addition, in the present embodiment, as described above, the display unit 4 is further provided, and the display unit 4 displays the X-ray image 10 or the synthesized image (either the first synthesized image 13 or the second synthesized image 14), and the synthesized image generating unit 20c is configured to generate the second synthesized image 14 by aligning the X-ray image 10 and the blood vessel extraction image 12 based on the device 7 captured in the region of interest 30 when the region of interest 30 is set by the region of interest setting unit 20d that receives the operation input while the X-ray image 10 or the first synthesized image 13 is displayed on the display unit 4. Thus, the second synthesized image 14 obtained by aligning the region of interest 30 can be generated at a timing desired by the operator, such as when the blood vessel 92a into which the device 7 is to be introduced is selected for the branch portion 92b of the blood vessel 92a.

[0103] In addition, in the present embodiment, as described above, the region of interest setting unit 20d is configured to set the region of interest 30 of a size corresponding to the movement range of the device 7 when the device 7 moves with the beating of the heart 91 in the live image. Thus, even when the device 7 moves with the beating of the heart 91, it is possible to reliably suppress the device 7 from moving outside the region of interest 30. As a result, even when the device 7 moves, it is possible to generate the second synthesized image 14 in which the X-ray image 10 and the blood vessel extraction image 12 are aligned at the position of the device 7.

[0104] In addition, in the present embodiment, as described above, the region of interest setting unit 20d is configured to accept resetting of the region of interest 30 if the distal end 7a of the device 7 captured in the region of interest 30 moves outside the region of interest 30. Thus, even if the distal end 7a of the device 7 moves during surgery, the region of interest 30 can be re-set to include the distal end 7a of the device 7, thereby generating a second synthetic image 14 synthesized by accurately aligning the X-ray image 10 and the blood vessel extraction image 12 at the distal end 7a of the device 7. As a result, by resetting the region of interest 30 in accordance with the movement of the device 7, it is possible to generate a second synthetic image 14 with high accuracy at a position desired by the operator, thereby improving the convenience (usability) of the operator.

[0105] In addition, in the present embodiment, as described above, the device 7 includes at least one of the catheter, stent, and guide wire introduced into the blood vessel 92a. Thus, the operator can easily visually recognize at least one of the catheter, stent, and guide wire introduced into the blood vessel 92a in the second synthetic image 14. As a result, the operator's workload can be reduced during the operation of introducing at least one of the catheter, stent, and guide wire into the blood vessel 92a.

[0106] (Variation Example)

[0107] In addition, it should be understood that the embodiments disclosed this time are illustrative in all aspects and are not restrictive. The scope of the present invention is not indicated by the description of the above embodiments, but by the claims, and includes all changes (modifications) within the meaning and scope equivalent to the claims.

[0108] For example, in the above-mentioned embodiment, an example of a structure in which the X-ray fluoroscopy apparatus 100 includes the input receiving unit 3 is shown, but the present invention is not limited thereto. In the present invention, for example, the X-ray fluoroscopy apparatus 100 may not include the input receiving unit 3. In the case of a structure in which the X-ray fluoroscopy apparatus 100 does not include the input receiving unit 3, for example, the control unit 20 may include a device detection unit that detects the front end 7a of the device 7 by image processing or the like. The region of interest setting unit 20d may be configured to set the region of interest 30 near the front end 7a of the device 7 detected by the device detection unit.

[0109] In addition, in the above embodiment, an example of a configuration in which the X-ray fluoroscopy apparatus 100 includes the display unit 4 is shown, but the present invention is not limited thereto. In the present invention, the X-ray fluoroscopy apparatus 100 may not include the display unit 4. When the X-ray fluoroscopy apparatus 100 does not include the display unit 4, the control unit 20 may be configured to display the second synthetic image 14 on an external display device or the like.

[0110] In addition, in the above embodiment, an example of a configuration is shown in which the synthetic image generation unit 20c generates a moving image of the device 7 moving in the region of interest 30 as the second synthetic image 14, but the present invention is not limited thereto. For example, the synthetic image generation unit 20c may be configured to generate a moving image captured in a state where the device 7 is stationary in the region of interest 30 as the second synthetic image 14.

[0111] In the above embodiment, the synthesized image generating unit 20c generates the second synthesized image 14 as a moving image, but the present invention is not limited thereto. In the present invention, the synthesized image generating unit 20c may be configured to generate the second synthesized image 14 as a still image.

[0112] In the above embodiment, an example of a configuration in which the synthetic image generating unit 20 c generates the first synthetic image 13 is shown, but the present invention is not limited thereto. In the present invention, the synthetic image generating unit 20 c may not generate the first synthetic image 13 .

[0113] In addition, in the above embodiment, the blood vessels 92a of the heart 91 of the subject 90 are photographed as an example of the subject, but the present invention is not limited to this. In the present invention, blood vessels of the lungs, etc. can be photographed. When photographing, when photographing a subject that moves due to beating, breathing, etc., it is preferable to use the X-ray fluoroscopy device 100.

[0114] In addition, in the above embodiment, an example is shown in which the region of interest setting unit 20d sets a circular region as the structure of the region of interest 30, but the present invention is not limited to this. The shape of the region of interest 30 set by the region of interest setting unit 20d can be a rectangular shape or a star shape. The shape of the region of interest 30 set by the region of interest setting unit 20d can be any shape. In addition, the region of interest 30 can be set to a shape along the trajectory input by the operator through hand drawing.

[0115] In addition, in the above embodiment, an example of a configuration in which the ROI setting unit 20d sets a ROI 30 of a predetermined size is shown, but the present invention is not limited thereto. For example, in the present invention, the ROI setting unit 20d may be configured to set a ROI 30 of an arbitrary size based on an operation input by a surgeon.

[0116] [Way]

[0117] It should be understood by those skilled in the art that the above-described exemplary embodiments are specific examples of the following aspects.

[0118] (Item 1)

[0119] X-ray fluoroscopic imaging device, having:

[0120] an imaging unit including an X-ray source for irradiating an object with X-rays, and an X-ray detector for detecting the X-rays irradiated from the X-ray source;

[0121] An X-ray image acquisition unit that acquires the X-ray image captured by the imaging unit;

[0122] a blood vessel extraction image acquisition unit that acquires a blood vessel extraction image that is generated in advance based on a contrast image and extracts a blood vessel image of the subject, wherein the contrast image is the X-ray image captured in a state where a contrast agent is administered to the subject;

[0123] a composite image generating unit that generates a composite image synthesized by aligning the X-ray image captured without administration of a contrast agent with the blood vessel extraction image; and

[0124] a region of interest setting unit that sets a region of interest that is a part of the X-ray image and captures a device introduced into the blood vessel of the subject,

[0125] The synthetic image generating unit is configured to perform position alignment between the X-ray image and the blood vessel extraction image based on the device photographed in the region of interest set by the region of interest setting unit and the blood vessel image photographed in the blood vessel extraction image, thereby generating the synthetic image.

[0126] (Item 2)

[0127] In the X-ray fluoroscopic imaging device described in item 1,

[0128] The synthetic image generating unit is configured to acquire a region corresponding to the region of interest in the blood vessel extraction image based on a shape of the device captured in the region of interest and a shape of the blood vessel image captured in the blood vessel extraction image.

[0129] (Item 3)

[0130] In the X-ray fluoroscopic imaging device described in item 2,

[0131] The X-ray image acquisition unit is configured to acquire the X-ray images generated successively as live images.

[0132] The synthetic image generation unit is configured to acquire a region corresponding to the region of interest in the blood vessel extraction image based on the device captured in the region of interest in each frame of the live image, and align the region corresponding to the region of interest in the acquired blood vessel extraction image with the position of the region of interest in each frame of the live image, thereby generating the synthetic image.

[0133] (Item 4)

[0134] X-ray fluoroscopic apparatus as mentioned in item 3,

[0135] The subject includes a heart of the subject,

[0136] The X-ray image acquisition unit is configured to acquire, as the live image, a plurality of X-ray images corresponding to at least one cycle of the heart beat.

[0137] The blood vessel extraction image acquisition unit is configured to acquire, as the blood vessel extraction image, a plurality of blood vessel extraction images corresponding to at least one cycle of the heart beat.

[0138] The synthetic image generating unit is configured to acquire a region corresponding to the region of interest from the blood vessel extraction image of a phase closest to a phase at the region of interest in each frame of the live image among the plurality of blood vessel extraction images, based on the shape of the device captured in the region of interest in each frame of the live image and the shape of the blood vessel image captured in the blood vessel extraction image.

[0139] (Item 5)

[0140] In the X-ray fluoroscopic imaging device described in any one of items 2 to 4,

[0141] The apparatus further comprises an input receiving unit configured to receive an operation input for setting the region of interest in the X-ray image.

[0142] The region of interest setting unit is configured to set the region of interest in the X-ray image based on the operation input received by the input receiving unit.

[0143] (Item 6)

[0144] In the X-ray fluoroscopic imaging device described in item 5,

[0145] further comprising a display unit for displaying the X-ray image or the synthesized image,

[0146] The synthetic image generating unit is configured to align the X-ray image with the blood vessel extraction image based on the device photographed in the region of interest when the region of interest is set by the region of interest setting unit that receives an operation input while the X-ray image or the synthetic image is displayed on the display unit, thereby generating the synthetic image.

[0147] (Item 7)

[0148] In the X-ray fluoroscopic imaging device described in item 4,

[0149] The region of interest setting unit is configured to set the region of interest having a size corresponding to a movement range of the device when the device moves with the beating of the heart in the live image.

[0150] (Item 8)

[0151] In the X-ray fluoroscopic imaging device described in any one of items 1 to 4,

[0152] The region of interest setting unit is configured to accept resetting of the region of interest if the tip of the device captured in the region of interest moves outside the region of interest.

[0153] (Item 9)

[0154] In the X-ray fluoroscopic imaging device described in any one of items 1 to 4,

[0155] The device includes at least any one of a catheter, a stent, and a guide wire introduced into the blood vessel.

[0156] (Item 10)

[0157] An X-ray image processing method comprises the following steps:

[0158] Acquiring X-ray images;

[0159] The blood vessel extraction image acquisition unit acquires a blood vessel extraction image generated in advance based on a contrast image, wherein the contrast image is the X-ray image captured in a state where a contrast agent is administered to a subject.

[0160] The synthetic image generating unit generates a synthetic image synthesized by aligning the X-ray image captured without administration of a contrast agent with the blood vessel extraction image;

[0161] a region of interest setting unit setting a region of interest that is a part of the X-ray image and captures a device introduced into a blood vessel of the subject; and

[0162] The synthesized image is generated by re-aligning the X-ray image and the blood vessel extraction image based on the device imaged in the region of interest and the blood vessel image captured in the blood vessel extraction image.

Claims

1. An X-ray fluoroscopic imaging device, comprising: an imaging unit including an X-ray source for irradiating an object with X-rays, and an X-ray detector for detecting the X-rays irradiated from the X-ray source; An X-ray image acquisition unit that acquires the X-ray image captured by the imaging unit; a blood vessel extraction image acquisition unit that acquires a blood vessel extraction image generated in advance based on a contrast image, the contrast image being the X-ray image captured in a state where a contrast agent is administered to the subject; a synthetic image generating unit that generates a synthetic image synthesized by aligning the X-ray image captured without administration of a contrast agent with the blood vessel extraction image; as well as a region of interest setting unit that sets a region of interest that is a part of the X-ray image and captures a device introduced into the blood vessel of the subject, The synthetic image generating unit is configured to generate the synthetic image by aligning the X-ray image with the blood vessel extraction image based on the device captured in the region of interest set by the region of interest setting unit and the blood vessel image captured in the blood vessel extraction image. The object to be examined includes the heart of the subject. The X-ray image acquisition unit is configured to acquire a plurality of the X-ray images corresponding to at least one cycle of the heart beat as live images. The region of interest setting unit is configured to set the region of interest having a size corresponding to a movement range of the device when the device moves with the beating of the heart in the live image.

2. The X-ray fluoroscopic imaging device according to claim 1, characterized in that: The synthetic image generating unit is configured to acquire a region corresponding to the region of interest in the blood vessel extraction image based on a shape of the device captured in the region of interest and a shape of the blood vessel image captured in the blood vessel extraction image.

3. The X-ray fluoroscopic imaging device according to claim 2, characterized in that: The X-ray image acquisition unit is configured to acquire the X-ray images generated successively as the live images. The synthetic image generation unit is configured to acquire a region corresponding to the region of interest in the blood vessel extraction image based on the device captured in the region of interest in each frame of the live image, and align the region corresponding to the region of interest in the acquired blood vessel extraction image with the position of the region of interest in each frame of the live image, thereby generating the synthetic image.

4. The X-ray fluoroscopic imaging device according to claim 3, characterized in that: The blood vessel extraction image acquisition unit is configured to acquire, as the blood vessel extraction image, a plurality of blood vessel extraction images corresponding to at least one cycle of the heart beat, The synthetic image generating unit is configured to acquire, based on the shape of the device captured in the region of interest in each frame of the live image and the shape of the blood vessel image captured in the blood vessel extraction image, a region corresponding to the region of interest from among the plurality of blood vessel extraction images the blood vessel extraction image having a phase closest to a phase at the region of interest in each frame of the live image.

5. The X-ray fluoroscopy device according to any one of claims 2 to 4, characterized in that: The apparatus further comprises an input receiving unit configured to receive an operation input for setting the region of interest in the X-ray image. The region of interest setting unit is configured to set the region of interest in the X-ray image based on the operation input received by the input receiving unit.

6. The X-ray fluoroscopic imaging device according to claim 5, characterized in that: further comprising a display unit for displaying the X-ray image or the synthesized image, The synthetic image generating unit is configured to align the X-ray image with the blood vessel extraction image based on the device photographed in the region of interest when the region of interest is set by the region of interest setting unit that receives an operation input while the X-ray image or the synthetic image is displayed on the display unit, thereby generating the synthetic image.

7. The X-ray fluoroscopy device according to any one of claims 1 to 4, characterized in that: The region of interest setting unit is configured to accept resetting of the region of interest if the tip of the device captured in the region of interest moves outside the region of interest.

8. The X-ray fluoroscopy device according to any one of claims 1 to 4, characterized in that: The device includes at least any one of a catheter, a stent, and a guide wire introduced into the blood vessel.

9. An X-ray image processing method, comprising the following steps: Acquiring X-ray images; The blood vessel extraction image acquisition unit acquires a blood vessel extraction image generated in advance based on a contrast image, wherein the contrast image is the X-ray image captured in a state where a contrast agent is administered to a subject. The synthetic image generating unit generates a synthetic image synthesized by aligning the X-ray image captured without administration of a contrast agent with the blood vessel extraction image; A region of interest setting unit sets a region of interest that is a part of the X-ray image and captures a device introduced into a blood vessel of the subject; as well as The composite image is generated by re-aligning the X-ray image with the blood vessel extraction image based on the device captured in the region of interest and the blood vessel image captured in the blood vessel extraction image, The object to be examined includes the heart of the subject. The acquiring of X-ray images includes acquiring a plurality of X-ray images corresponding to at least one cycle of the heart as live images. The region of interest setting unit sets the region of interest having a size corresponding to a movement range of the device when the device moves with the beating of the heart in the live image.

Images