X-ray imaging device, image processing device, and image processing program

Abstract

This x-ray imaging device (100) is provided with an x-ray irradiation unit (1), an x-ray detection unit (2), an x-ray image generation unit (3) and a control unit (6). The control unit includes: a highlight image generation unit (61) which, on the basis of a trained model (52), generates, as a highlight image, an output image of the trained model and / or a composite image generated on the basis of the output image and the x-ray image; and an image output unit (62) which simultaneously or switchably displays on a display unit (4) the x-ray image and at least one of the output image and the composite image.

Description

[Technical field]

[0001] The present invention relates to an X-ray imaging apparatus, an image processing apparatus, and an image processing program, and more particularly to an X-ray imaging apparatus, an image processing apparatus, and an image processing program for confirming a target substance inside a subject's body. [Background technology]

[0002] Conventionally, a radiography system (X-ray imaging device) for checking the presence or absence of a hemostatic gauze (target object) in a subject's body after an abdominal surgery is known. Such a device is described, for example, in JP 2019-180605 A.

[0003] The radiography system described in JP 2019-180605 A processes radiographic images according to a preset processing procedure depending on the purpose of the examination. In this radiography system, for example, when a processing procedure for checking the presence or absence of hemostatic gauze after abdominal surgery is set, foreign body emphasis processing is performed on the captured image. In addition, in this radiography system, an abdominal image on which foreign body emphasis processing has been performed is displayed so that a foreign body (gauze) inside the subject's body can be easily seen. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-180605 A Summary of the Invention [Problem to be solved by the invention]

[0005] Here, although it is not specified in the above Patent Document 1, when a foreign body emphasis process is performed on an X-ray image of a subject after surgery so that a doctor or the like can check the presence or absence of a foreign body (such as hemostatic gauze) in the subject's body after surgery, as in the radiography system described in the above Patent Document 1, edge emphasis process may be performed as the foreign body emphasis process. However, when edge emphasis process is performed as the foreign body emphasis process, an emphasis image is generated in which not only the foreign body but also the human body structures such as the bones of the subject are emphasized. In this case, there is a problem that the visibility of the foreign body in the emphasis image is reduced, making it difficult to confirm the foreign body (target object) included in the X-ray image.

[0006] The present invention has been made to solve the above-mentioned problems, and one object of the present invention is to provide a method for detecting a defect in an X-ray image of a subject. Remains When emphasizing the Remains The present invention provides an X-ray imaging device, an image processing device, and an image processing program that can easily check the presence or absence of a radiographic abnormality. [Means for solving the problem]

[0007] In order to achieve the above object, the X-ray imaging device in the first to third aspects of the present invention includes an X-ray irradiation unit that irradiates X-rays onto a subject, an X-ray detection unit that detects the X-rays irradiated from the X-ray irradiation unit, an X-ray image generation unit that generates an X-ray image based on an X-ray detection signal detected by the X-ray detection unit, and a control unit. The control unit includes an emphasis image generation unit that generates an output image indicating the position of the remnant based on a trained model that detects the area of ​​the remnant inside the subject's body in the X-ray image by inputting the X-ray image generated by the X-ray image generation unit, and generates an emphasis image based on the output image, and an image output unit that displays the coordination image generated by the emphasis image generation unit and the X-ray image on a display unit simultaneously or switchably. In the X-ray imaging apparatus according to the first aspect, the emphasized image generating unit generates a heat map image of the region of the remnant in the X-ray image based on the output image. Depending on the degree of match with the characteristics of the remains It is configured to generate a color enhanced image. In the X-ray imaging device of the above-mentioned second aspect, the enhanced image generating unit is configured to identify the linear structure of the remains in the output image based on the output image, obtain the density in a specified area including the location where the identified linear structure of the remains is located, and generate a colored image as a heat map image colored to change according to the density, and the image output unit is configured to display on the display unit the superimposed image on which the colored image as the heat map image is superimposed and the X-ray image simultaneously or switchably. In the X-ray imaging device of the above third aspect, the enhanced image generation unit is configured to generate a superimposed image in which an intermediate layer image, which is output from an intermediate layer of the trained model and serves as an output image in which remnants in the X-ray image are enhanced, is superimposed on the X-ray image, and the image output unit is configured to display the superimposed image in which the intermediate layer image is superimposed on the X-ray image and the X-ray image simultaneously or switchably on the display unit.

[0008] According to a fourth aspect of the present invention, there is provided an image processing device, comprising: an enhanced image generating unit that generates an output image indicating a position of a residual object based on a trained model that detects an area of ​​a residual object inside the body of the subject in the X-ray image by inputting an X-ray image generated based on a detection signal of X-rays irradiated to the subject, and generates an enhanced image based on the output image; and an image output unit that displays the enhanced image generated by the enhanced image generating unit and the X-ray image on a display unit simultaneously or switchably, and the enhanced image generating unit displays the area of ​​the residual object in the X-ray image as a heat map image based on the output image. Depending on the degree of match with the characteristics of the remains It is configured to generate a color enhanced image.

[0009] In a fifth aspect of the present invention, an image processing program causes a computer to execute a generation process of generating an output image indicating the position of a residual object based on a trained model that detects an area of ​​a residual object inside the body of a subject in an X-ray image by inputting an X-ray image generated based on a detection signal of X-rays irradiated to the subject, and generating an enhanced image based on the output image, and a display process of displaying the enhanced image and the X-ray image simultaneously or switchably on a display unit, and the generation process displays the area of ​​the residual object in the X-ray image as a heat map image based on the output image. Depending on the degree of match with the characteristics of the remains The process includes generating a color-enhanced image. Effect of the Invention

[0010] Above No. 1 ~Third The X-ray imaging device in the above aspect 4 In the above aspect, the image processing device and the 5 In this situation, the image processing program receives an X-ray image and X The location of the residual object is determined based on a trained model that detects the area of ​​the residual object inside the subject's body in the X-ray image. Show Output Image Generate and based on the output image Enhanced Image of Generate. And emphasis image and The X-ray image is displayed on the display unit simultaneously or in a switchable manner. This produces an enhanced image in which the location of the remnants is highlighted based on a trained model that directly detects the area of ​​the remnants. but Since the image is generated in a manner similar to that of the image generated by edge enhancement processing, where both the remnants and the human body structures such as the bones of the subject are enhanced, it is possible to suppress the enhancement of the human body structures such as the bones of the subject in the enhanced image. As a result, when enhancing the remnants contained in the X-ray image of the subject, the remnants contained in the X-ray image can be easily confirmed. In addition, the enhanced image andSince the emphasized image and the X-ray image are displayed simultaneously or switchably on the display unit, the residual object contained in the X-ray image can be easily confirmed by comparing the emphasized image and the X-ray image. Furthermore, since the final judgment of the presence or absence of residual object in the body of the subject by a doctor or the like is made based on the X-ray image, it is very effective to be able to easily confirm the residual object contained in the X-ray image by comparing the X-ray image and the emphasized image.

[0011] Here, image processing using the trained model is performed to extract the abnormality contained in the X-ray image of the subject. Remains When emphasizing, X-ray images Remains We also generated a trained model to remove the Remains It is conceivable to generate a removed image in which the X-ray image has been removed, and generate an enhanced image by subtracting the X-ray image from the removed image. However, when an enhanced image is generated by subtracting the X-ray image from the removed image, Remains In the weighted image, the similar structures of the subject (such as the pelvis and femur) are removed. Remains Not only Remains The X-ray image may also highlight structures of the subject that resemble those of the Remains When performing image processing using a trained model that removes Remains The visibility of the X-ray image is reduced. Remains It is difficult to confirm.

[0012] Therefore, the above No. 1 ~Third The X-ray imaging device in the above aspect 4 In the above aspect, the image processing device and the 5 In this situation, the image processing program receives an X-ray image and X The location of the residual object is determined based on a trained model that detects the area of ​​the residual object inside the subject's body in the X-ray image. Show Output Image Generate and generate a ,based on the output image Enhanced Image of Generate. And emphasis image andThe X-ray image is displayed on the display unit simultaneously or in a switchable manner. This produces an enhanced image in which the location of the remnants is highlighted based on a trained model that directly detects the area of ​​the remnants. but Since the image is generated based on the removed image generated by a trained model that removes residual objects from X-ray images, it is possible to suppress the enhancement of the structure of the subject that resembles the residual object in the enhanced image, unlike the case where an enhanced image is generated based on the difference between the X-ray image and the removed image. As a result, even when the residual object in the X-ray image of the subject is enhanced by performing image processing using the trained model, the residual object in the X-ray image can be easily confirmed. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram for explaining a configuration of an X-ray imaging apparatus according to an embodiment. [Diagram 2] 1 is a block diagram for explaining a configuration of an X-ray imaging apparatus according to an embodiment. [Diagram 3] FIG. 2 illustrates an example of an X-ray image of a subject with a target object present therein according to one embodiment. [Figure 4] FIG. 13 is a diagram for explaining image processing using a trained model according to one embodiment. [Diagram 5] FIG. 11 is a diagram for explaining an output layer image according to one embodiment. [Figure 6] FIG. 13 is a diagram for explaining an intermediate layer image according to an embodiment. [Figure 7] FIG. 13 is a diagram for explaining generation of a trained model according to one embodiment. [Figure 8] FIG. 1 is a diagram for explaining a colored image according to an embodiment. [Figure 9] FIG. 1 is a diagram for explaining a colored superimposed image according to an embodiment. [Figure 10] FIG. 13 is a diagram for explaining an intermediate layer overlay image according to an embodiment. [Figure 11] FIG. 4 is a diagram for explaining a display on a display unit according to an embodiment. [Figure 12] FIG. 1 is a flowchart illustrating an image processing method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

[0015] (Overall configuration of X-ray equipment) An X-ray imaging apparatus 100 according to an embodiment of the present invention will be described with reference to FIGS.

[0016] As shown in Fig. 1, an X-ray imaging device 100 performs X-ray imaging to identify a target object 200 inside the body of a subject 101. For example, the X-ray imaging device 100 performs X-ray imaging of a subject 101 who has undergone laparotomy in an operating room to check whether a target object 200 (remnants) remains inside the body. The X-ray imaging device 100 is, for example, a mobile X-ray imaging device in which the entire device is movable. The target object 200 is, for example, surgical gauze, a suture needle, and forceps (such as hemostatic forceps).

[0017] Generally, when a surgical operation such as an abdominal operation is performed, an operator such as a doctor takes an X-ray of the subject 101 to check that the target object 200, such as surgical gauze, a suture needle, and forceps, is not left behind (residual) inside the subject 101 after the wound is closed. The operator such as a doctor visually checks an X-ray image 10 (see FIG. 3) of the subject 101 to check whether the target object 200 has been left behind inside the subject 101.

[0018] <About X-ray equipment> 2, the X-ray imaging device 100 includes an X-ray irradiation unit 1, an X-ray detection unit 2, an X-ray image generation unit 3, a display unit 4, a storage unit 5, and a control unit 6. The control unit 6 is an example of the "image processing device" and the "computer" in the claims.

[0019] The X-ray irradiator 1 irradiates X-rays to a post-operative subject 101. The X-ray irradiator 1 includes an X-ray tube that irradiates X-rays when a voltage is applied thereto.

[0020] The X-ray detection unit 2 detects X-rays transmitted through the subject 101. The X-ray detection unit 2 outputs a detection signal based on the detected X-rays. The X-ray detection unit 2 includes, for example, an FPD (Flat Panel Detector). The X-ray detection unit 2 is configured as a wireless type X-ray detector and outputs the detection signal as a wireless signal. Specifically, the X-ray detection unit 2 is configured to be able to communicate with the X-ray image generation unit 3 by wireless connection such as wireless LAN, and outputs the detection signal to the X-ray image generation unit 3 as a wireless signal.

[0021] As shown in Fig. 3, the X-ray image generating unit 3 controls the X-ray irradiation unit 1 and the X-ray detection unit 2 to control X-ray photography. The X-ray image generating unit 3 generates an X-ray image 10 based on a detection signal of X-rays detected by the X-ray detection unit 2. The X-ray image generating unit 3 is configured to be able to communicate with the X-ray detection unit 2 by wireless connection such as wireless LAN. The X-ray image generating unit 3 includes a processor such as an FPGA (field-programmable gate array). The X-ray image generating unit 3 outputs the generated X-ray image 10 to the control unit 6.

[0022] The X-ray image 10 shown in Fig. 3 is an image obtained by X-raying the abdomen of a subject 101 after surgery. The X-ray image 10 shown in Fig. 3 includes surgical gauze as the target object 200. The surgical gauze has contrast thread woven into it that is difficult for X-rays to penetrate so that it can be viewed in the X-ray image 10 obtained by X-ray photography after surgery. The X-ray image 10 shown in Fig. 3 also includes a surgical wire and a surgical clip as artificial structures 201 other than the target object 200.

[0023] The display unit 4 includes, for example, a touch panel type liquid crystal display. The display unit 4 displays various images such as an X-ray image 10. The display unit 4 is also configured to accept an input operation for operating the X-ray imaging device 100 by an operator such as a doctor based on an operation on the touch panel.

[0024] The storage unit 5 is configured by a storage device such as a hard disk drive. The storage unit 5 stores image data such as an X-ray image 10. The storage unit 5 also stores various setting values ​​for operating the X-ray imaging device 100. The storage unit 5 also stores a program used in the control process of the X-ray imaging device 100 by the control unit 6. The storage unit 5 also stores an image processing program 51. The image processing program 51 can be stored in the storage unit 5 by reading it from a non-transient portable storage medium such as an optical disk or a USB memory, or by downloading it via a network. The storage unit 5 also stores a trained model 52, which will be described later.

[0025] The control unit 6 is a computer including, for example, a central processing unit (CPU), a graphics processing unit (GPU), a read only memory (ROM), and a random access memory (RAM). The control unit 6 includes, as functional components, an emphasis image generating unit 61 and an image output unit 62. That is, the control unit 6 executes the image processing program 51 to function as the emphasis image generating unit 61 and the image output unit 62. The emphasis image generating unit 61 and the image output unit 62 are functional blocks as software in the control unit 6, and are configured to function based on command signals from the control unit 6 as hardware.

[0026] (About image processing) 4, in this embodiment, the emphasized image generating unit 61 (control unit 6) receives the X-ray image 10 generated by the X-ray image generating unit 3, and based on the learned model 52 that detects the region of the target object 200 of the subject 101 in the X-ray image 10, generates, as emphasized images, output images (11, 12) of the learned model 52 in which the position of the target object 200 is emphasized, and composite images (14, 15) generated based on the output images (11, 12) and the X-ray image 10 so that the position of the target object 200 is emphasized. Then, the image output unit 62 (control unit 6) causes the display unit 4 to simultaneously or switchably display at least one of the output images (11, 12) and the composite images (14, 15) generated by the emphasized image generating unit 61 and the X-ray image 10.

[0027] (About generating output images) In this embodiment, as shown in FIG. 4 to FIG. 6, the emphasized image generating unit 61 (control unit 6) generates the output layer image 11 and the intermediate layer image 12 as output images of the learned model 52 based on the learned model 52 generated by machine learning. The learned model 52 is generated by machine learning using deep learning. The learned model 52 is generated, for example, based on U-Net, which is one type of Fully Convolution Network (FCN). The learned model 52 is generated by training to perform image conversion (image reconstruction) to detect a part estimated to be the target object 200 from the X-ray image 10 by converting pixels estimated to be the target object 200 from each pixel of the X-ray image 10 that is input. The output layer image 11 and the intermediate layer image 12 are examples of the "emphasized image" and "output image" in the claims.

[0028] The trained model 52 includes an input layer 52a, an intermediate layer 52b, and an output layer 52c. The input layer 52a receives an input image (X-ray image 10). The intermediate layer 52b acquires a feature component (target object 200) from the input image received by the input layer 52a. Specifically, the intermediate layer 52b has a downsampling unit that acquires the feature component (target object 200) from the input image while reducing the size of the input image, and an upsampling unit that restores an image including the feature component whose size has been reduced by the downsampling unit to its original size (the size of the input image). The intermediate layer 52b outputs an intermediate layer image 12 in which the target object 200 in the X-ray image 10 is emphasized. The output layer 52c has a sigmoid function as an activation function. The output layer 52c generates and outputs an output layer image 11 representing the region of the target object 200 in the X-ray image 10 by processing the intermediate layer image 12 output from the intermediate layer 52b using the sigmoid function. The output layer image 11 is configured so that the pixel value of each pixel represents the probability that it belongs to the region of the target object 200. In the output layer image 11, pixels that have a high probability of belonging to the region of the target object 200 (pixels whose pixel value is 1 or close to 1) are displayed in white, and pixels that have a low probability of belonging to the region of the target object 200 (pixels whose pixel value is 0 or close to 0) are displayed in black.

[0029] The output layer image 11 shown in Fig. 5 is an image acquired from the X-ray image 10 shown in Fig. 3 based on the trained model 52. In the output layer image 11 shown in Fig. 5, structures such as bones of the subject 101 are removed and the target object 200 is emphasized. In the output layer image 11 shown in Fig. 5, an artificial structure 201 having a shape (characteristics) similar to that of the target object 200 is also emphasized, but an operator such as a doctor can easily distinguish the artificial structure 201 from the target object 200 because he or she knows the position, shape, etc. of the artificial structure 201.

[0030] The intermediate layer image 12 shown in FIG. 6 is an image acquired from the X-ray image 10 shown in FIG. 3 based on the trained model 52. In the intermediate layer image 12 shown in FIG. 6, although some structures such as bones of the subject 101 remain, they are mostly removed and the target object 200 is emphasized. The remaining structures such as bones of the subject 101 are removed by processing using the sigmoid function of the output layer 52c. In addition, in the intermediate layer image 12 shown in FIG. 6, an artificial structure 201 having a shape (characteristics) similar to that of the target object 200 is also emphasized, but since an operator such as a doctor knows the position and shape of the artificial structure 201, it is possible to easily distinguish it from the target object 200.

[0031] (About generating trained models) As shown in Fig. 7, in this embodiment, the trained model 52 is generated by machine learning to detect a target object 200 such as surgical gauze, a suture needle, and forceps from an X-ray image 10. The trained model 52 is generated in advance by a learning device 300 separate from the X-ray imaging device 100. The learning device 300 is a computer including, for example, a CPU, a GPU, a ROM, and a RAM. The learning device 300 generates the trained model 52 by machine learning using deep learning, using a plurality of teacher input X-ray images 310 and a plurality of teacher output images 320 as teacher data (training set).

[0032] The teacher input X-ray image 310 is generated to simulate the X-ray image 10 captured of the subject 101 with the target object 200 left inside the body. The teacher output image 320 is generated to simulate the detection of the target object 200 from the teacher input X-ray image 310. The teacher input X-ray image 310 and the teacher output image 320 are generated to have the same conditions (size, etc.) as the X-ray image 10 used for input in inference using the trained model 52.

[0033] (About generating superimposed images) In this embodiment, as shown in FIG. 4, FIG. 8, and FIG. 9, the emphasized image generating unit 61 (control unit 6) generates a colored superimposed image 14 as a composite image, in which a colored image 13 generated based on the output layer image 11 is superimposed on the X-ray image 10, based on the X-ray image 10 and the output layer image 11 of the trained model 52. Specifically, the emphasized image generating unit 61 generates the colored image 13 by coloring a portion in the output layer image 11 corresponding to the target object 200 based on the output layer image 11. Then, the emphasized image generating unit 61 generates a colored superimposed image 14 in which the generated colored image 13 is superimposed on the X-ray image 10. The colored image 13 is an example of an "image generated based on an output image" in the claims. The colored superimposed image 14 is an example of an "emphasized image", a "synthetic image", and a "superimposed image" in the claims.

[0034] The enhanced image generation unit 61 identifies the linear structure (shape) of the target object 200 in the output layer image 11 based on the output layer image 11, obtains the density in a specified area including the area where the identified linear structure of the target object 200 is located, and generates a colored image 13 as a heat map image (color map image) that is colored to change according to the density.

[0035] For example, the enhanced image generating unit 61 performs binarization processing on the generated output layer image 11. Then, the enhanced image generating unit 61 identifies a portion (pixel) containing a linear structure by detecting the density of the linear structure in the binarized output layer image 11. Specifically, the enhanced image generating unit 61 performs pattern recognition on the binarized output layer image 11 by extracting a feature amount from the output layer image 11, thereby identifying the linear structure.

[0036] For example, the enhanced image generating unit 61 extracts a higher-order local autocorrelation (HLAC) feature as a feature amount. For example, the enhanced image generating unit 61 acquires one pixel of the output layer image 11 as a reference point. Then, the enhanced image generating unit 61 extracts a feature amount by a local autocorrelation feature of a predetermined area including (centered on) the reference point. Then, the enhanced image generating unit 61 identifies (detects) a linear structure in a predetermined area including the reference point by measuring a degree of agreement between the extracted feature amount and a feature amount of a linear structure (shape) that is set in advance. The enhanced image generating unit 61 acquires a detection value of the linear structure in a predetermined area including the reference point as a density of the linear structure in the predetermined area at the reference point. The enhanced image generating unit 61 acquires a local autocorrelation feature amount using each pixel of the output layer image 11 as a reference point, thereby acquiring a density (detection value) of the linear structure in each pixel of the output layer image 11. Here, the size of the predetermined area including the reference point may be, for example, an area of ​​3×3 pixels, or an area larger than 3×3 pixels, such as 9×9 pixels.

[0037] Then, the emphasized image generating unit 61 generates the colored image 13 by coloring each pixel based on the density (detection value) of the linear structure acquired for each pixel of the output layer image 11. For example, the emphasized image generating unit 61 generates the colored image 13 by coloring each pixel so that the hue differs according to the density value of the linear structure. For example, the colored image 13 is colored in the order of red, yellow, green, and blue from the larger density value to the smaller density value. That is, when the density value is large, the pixel is colored red, and when the density value is small, the pixel is colored blue. The emphasized image generating unit 61 sets the color in the colored image 13 by associating the range of values ​​of the acquired density (detection value) of the linear structure from 0 to 600 with each color. Note that in FIG. 8 and FIG. 9, the difference in color is represented by the difference in hatching.

[0038] As described above, the enhanced image generating unit 61 generates a colored image 13 that allows identification of the degree to which the feature amount in each pixel (each region) matches the feature amount of the linear structure corresponding to the target object 200 by the displayed color. In addition, the identification (extraction) of the linear structure (shape) when generating the colored image 13 may be performed by acquiring the feature amount for each predetermined region by pattern recognition using a feature amount extraction method other than the higher-order local autocorrelation feature, and identifying (detecting) the density of the linear structure (shape) (degree of pattern correspondence) to color it. In addition, although the above describes an example of identifying surgical gauze as the target object 200, the colored image 13 is also generated by identifying the linear structure (shape) from the output layer image 11 when the target object 200 is a suture needle or forceps.

[0039] The colored image 13 shown in FIG. 8 is an image acquired based on the output layer image 11 shown in FIG. 5. In the colored image 13 shown in FIG. 8, the position of the target object 200 is emphasized by coloring based on the linear structure of the target object 200. In addition, in the colored image 13 shown in FIG. 8, the position of the artificial structure 201, which has a similar shape (characteristics) to the target object 200, is also emphasized by coloring. However, the position of the artificial structure 201 is colored with a color (such as green) that indicates a lower pixel density than the position of the target object 200, so that a worker such as a doctor can easily distinguish it from the target object 200. Note that the artificial structure 201 has a lower pixel density than the position of the target object 200 in the output layer image 11 because the probability that it belongs to the region of the target object 200 is estimated to be lower than that of the target object 200. In addition, the colored image 13 does not include information on the shapes of the target object 200 and the artificial structure 201.

[0040] The colored superimposed image 14 shown in FIG. 9 is an image in which the colored image 13 shown in FIG. 8 is superimposed on the X-ray image 10 shown in FIG. 3. In the colored superimposed image 14 shown in FIG. 9, the position of the target object 200 is emphasized by superimposing the colored image 13 on the X-ray image 10. In the colored superimposed image 14 shown in FIG. 9, the position of the artificial structure 201, which has a similar shape (characteristics) to the target object 200, is also emphasized by superimposing the colored image 13. However, since the position of the artificial structure 201 is colored with a color (such as green) that indicates a lower pixel density than the position of the target object 200, an operator such as a doctor can easily distinguish it from the target object 200. In addition, since an operator such as a doctor knows the position and shape of the artificial structure 201, it can easily distinguish it from the target object 200.

[0041] As shown in Fig. 4 and Fig. 10, the enhanced image generating unit 61 (control unit 6) generates an intermediate layer superimposed image 15 in which the intermediate layer image 12 is superimposed on the X-ray image 10 as a composite image based on the X-ray image 10 and the intermediate layer image 12 of the trained model 52. For example, the enhanced image generating unit 61 (control unit 6) generates the intermediate layer superimposed image 15 by superimposing the intermediate layer image 12, which has been subjected to a transparency process, on the X-ray image 10. The intermediate layer superimposed image 15 is an example of a "synthetic image" and a "superimposed image" in the claims.

[0042] The intermediate layer superimposed image 15 shown in Fig. 10 is an image in which the intermediate layer image 12 shown in Fig. 6 is superimposed on the X-ray image 10 shown in Fig. 3. In the intermediate layer superimposed image 15 shown in Fig. 10, the intermediate layer image 12 is superimposed on the X-ray image 10, thereby emphasizing the position and shape of the target object 200. In addition, in the intermediate layer superimposed image 15 shown in Fig. 10, the position and shape of an artificial structure 201, which has a similar shape (characteristics) to the target object 200, are also emphasized by coloring, but since an operator such as a doctor knows the position, shape, etc. of the artificial structure 201, it is possible to easily distinguish it from the target object 200.

[0043] (About the display) As shown in FIG. 11, in this embodiment, the image output unit 62 (control unit 6) causes the display unit 4 to simultaneously or switchably display at least one of the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15, and the X-ray image 10.

[0044] For example, the image output unit 62 causes the display unit 4 to display the X-ray image 10 and the output layer image 11 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10 and the output layer image 11 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10 and the intermediate layer image 12 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10 and the intermediate layer image 12 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10 and the colored superimposed image 14 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10 and the colored superimposed image 14 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to simultaneously display the X-ray image 10 and the intermediate layer superimposed image 15 side by side. Also, for example, the image output unit 62 causes the display unit 4 to switch between the X-ray image 10 and the intermediate layer superimposed image 15.

[0045] Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, and the intermediate layer image 12 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, and the intermediate layer image 12 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, and the colored superimposed image 14 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, and the colored superimposed image 14 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, and the intermediate layer superimposed image 15 side by side at the same time. Also, for example, the image output unit 62 switches between the X-ray image 10, the output layer image 11, and the intermediate layer superimposed image 15 and displays them on the display unit 4.

[0046] Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the intermediate layer image 12, and the colored superimposed image 14 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the intermediate layer image 12, and the colored superimposed image 14 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the intermediate layer image 12, and the intermediate layer superimposed image 15 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the intermediate layer image 12, and the intermediate layer superimposed image 15 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the colored superimposed image 14, and the intermediate layer superimposed image 15 side by side at the same time. Also, for example, the image output unit 62 switches between displaying the X-ray image 10, the colored superimposed image 14, and the intermediate layer superimposed image 15 on the display unit 4.

[0047] Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, the intermediate layer image 12, and the colored superimposed image 14 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, the intermediate layer image 12, and the colored superimposed image 14 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, the intermediate layer image 12, and the intermediate layer superimposed image 15 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, the intermediate layer image 12, and the intermediate layer superimposed image 15 by switching between them.

[0048] Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, the colored superimposed image 14, and the intermediate layer superimposed image 15 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the output layer image 11, the colored superimposed image 14, and the intermediate layer superimposed image 15 by switching between them. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15 side by side at the same time. Also, for example, the image output unit 62 causes the display unit 4 to display the X-ray image 10, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15 by switching between them.

[0049] Also, for example, the image output unit 62 causes the display unit 4 to simultaneously display the X-ray image 10, the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15 side by side. Also, for example, the image output unit 62 causes the display unit 4 to switch between the X-ray image 10, the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15. Note that the switching operation of each image on the display unit 4 can be performed, for example, by an input operation on the touch panel of the display unit 4.

[0050] (Image processing method according to this embodiment) Next, a control process flow relating to the image processing method according to this embodiment will be described with reference to Fig. 12. Steps 501 to 503 indicate control processes by the X-ray image generating unit 3, and steps 504 to 507 indicate control processes by the control unit 6.

[0051] First, in step 501, X-rays are irradiated onto the subject 101 in order to identify the target object 200 remaining inside the subject 101 after surgery. Next, in step 502, the irradiated X-rays are detected. Next, in step 503, an X-ray image 10 is generated based on the detection signal of the detected X-rays.

[0052] Next, in step 504, the X-ray image 10 is input to the trained model 52 to generate an output layer image 11 and an intermediate layer image 12. Next, in step 505, a colored image 13 is generated based on the generated output layer image 11. Specifically, the colored image 13 is generated by coloring a portion of the output layer image 11 that corresponds to the target object 200.

[0053] Next, in step 506, the colored image 13 is superimposed on the X-ray image 10 to generate a colored superimposed image 14. Also, the intermediate layer image 12 is superimposed on the X-ray image 10 to generate an intermediate layer superimposed image 15. Next, in step 507, at least one of the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15 and the X-ray image 10 are displayed on the display unit 4 simultaneously or switchably.

[0054] [Effects of this embodiment] In this embodiment, the following effects can be obtained.

[0055] In the X-ray imaging apparatus 100 of this embodiment, as described above, by inputting an X-ray image 10, based on a trained model 52 that detects a region of a target object 200 inside the body of a subject 101 in the X-ray image 10, at least one of an output image (11, 12) of the trained model 52 in which the position of the target object 200 is emphasized and a composite image (14, 15) generated based on the output image (11, 12) and the X-ray image 10 so that the position of the target object 200 is emphasized is generated as an emphasized image. Then, at least one of the output image (11, 12) and the composite image (14, 15) and the X-ray image 10 are displayed on the display unit 4 simultaneously or switchably. As a result, at least one of the output images (11, 12) and the composite image (14, 15) is generated as an enhanced image in which the position of the target object 200 is enhanced based on the trained model 52 that directly detects the region of the target object 200, so that unlike a case in which an enhanced image in which both the target object and the human body structures such as the bones of the subject are enhanced is generated by edge enhancement processing, it is possible to suppress enhancement of the human body structures such as the bones of the subject 101 in the enhanced image. As a result, when the target object 200 included in the X-ray image 10 of the subject 101 is enhanced, the target object 200 included in the X-ray image 10 can be easily confirmed. In addition, at least one of the output images (11, 12) and the composite image (14, 15) as the enhanced image and the X-ray image 10 are simultaneously or switchably displayed on the display unit 4, the target object 200 included in the X-ray image 10 can be easily confirmed by comparing the enhanced image and the X-ray image 10. Furthermore, since the final judgment by a doctor or the like as to whether or not there is a target object 200 inside the body of the subject 101 is made based on the X-ray image 10, it is very useful to be able to easily confirm the target object 200 contained in the X-ray image 10 by comparing the X-ray image 10 with the enhanced image.

[0056] Here, when the target object 200 included in the X-ray image 10 of the subject 101 is emphasized by performing image processing using a trained model, it is possible to generate a trained model that removes the target object 200 from the X-ray image 10, generate a removed image in which the target object 200 is removed from the X-ray image 10 using the generated trained model, and generate an emphasized image by the difference between the X-ray image 10 and the removed image. However, when the emphasized image is generated by the difference between the X-ray image 10 and the removed image, not only the target object 200 but also the structure of the subject 101 similar to the target object 200 may be emphasized in the emphasized image due to the removal of the structure of the subject 101 similar to the target object 200 (such as the pelvis and femur) in the removed image. Therefore, when performing image processing using a trained model that removes the target object 200 from the X-ray image 10, the visibility of the target object 200 decreases in the emphasized image, making it difficult to confirm the target object 200 included in the X-ray image 10.

[0057] Therefore, in the X-ray imaging apparatus 100 of this embodiment, as described above, by inputting the X-ray image 10, based on the trained model 52 that detects the region of the target object 200 inside the subject 101 in the X-ray image 10, at least one of the output image (11, 12) of the trained model 52 in which the position of the target object 200 is emphasized and the composite image (14, 15) generated based on the output image (11, 12) and the X-ray image 10 so that the position of the target object 200 is emphasized is generated as an emphasized image. Then, at least one of the output image (11, 12) and the composite image (14, 15) and the X-ray image 10 are displayed on the display unit 4 simultaneously or switchably. As a result, at least one of the output images (11, 12) and the composite images (14, 15) is generated as an enhanced image in which the position of the target object 200 is enhanced based on the trained model 52 that directly detects the region of the target object 200, so that unlike a case in which a removed image is generated by a trained model that removes the target object 200 from the X-ray image 10 and an enhanced image is generated by the difference between the X-ray image 10 and the removed image, it is possible to suppress enhancement of the structure of the subject 101 similar to the target object 200 in the enhanced image. As a result, even when the target object 200 included in the X-ray image 10 of the subject 101 is enhanced by performing image processing using the trained model, the target object 200 included in the X-ray image 10 can be easily confirmed.

[0058] In addition, in the above embodiment, the following additional effects can be obtained by configuring as follows.

[0059] That is, in this embodiment, as described above, the emphasized image generating unit 61 is configured to generate superimposed images (14, 15) in which the output image (12) or the image (13) generated based on the output image (11) is superimposed on the X-ray image 10 as a composite image, and the image output unit 62 is configured to display the superimposed images (14, 15) and the X-ray image 10 simultaneously or switchably on the display unit 4. With this configuration, the target object 200 included in the X-ray image 10 can be confirmed by comparing the superimposed images (14, 15) and the X-ray image 10, which are images whose positional relationship can be easily grasped, and therefore the target object 200 included in the X-ray image 10 can be confirmed more easily.

[0060] In the present embodiment, as described above, the emphasized image generating unit 61 is configured to generate a colored image 13 based on the output image (11) by coloring a portion in the output image (11) corresponding to the target object 200, and to generate a superimposed image (14) in which the generated colored image 13 is superimposed on the X-ray image 10, and the image output unit 62 is configured to display the superimposed image (14) in which the colored image 13 is superimposed on the X-ray image 10, and the X-ray image 10 simultaneously or in a switchable manner, on the display unit 4. With this configuration, the target object 200 included in the X-ray image 10 can be confirmed while comparing the superimposed image (14) in which the colored image 13 is superimposed on the X-ray image 10 with the X-ray image 10, and therefore the position of the target object 200 included in the X-ray image 10 can be intuitively and easily grasped based on the color of the superimposed image (14).

[0061] In the present embodiment, as described above, the emphasized image generating unit 61 is configured to identify the linear structure of the target object 200 in the output image (11) based on the output image (11), obtain the density in a predetermined region including the portion where the identified linear structure of the target object 200 is arranged, and generate the colored image 13 as a heat map image colored to change according to the density, and the image output unit 62 is configured to display the superimposed image (14) on which the colored image 13 as a heat map image is superimposed and the X-ray image 10 simultaneously or switchably on the display unit 4. With this configuration, the superimposed image (14) is colored according to the density in a predetermined region including the portion where the linear structure of the target object 200 is arranged, so that the superimposed image (14) in which the high density portion is more emphasized can be generated. Furthermore, in the output image (11) generated to emphasize the position of the target object 200, the density of the linear structure is high in the portion corresponding to the target object 200, so that the portion corresponding to the target object 200 in the superimposed image (14) can be colored to be more emphasized. The target object 200 contained in the X-ray image 10 can be confirmed by comparing the X-ray image 10 with the superimposed image (14) on which the colored image 13 as a heat map image, which further emphasizes the portion corresponding to the target object 200, is superimposed. Therefore, the position of the target object 200 contained in the X-ray image 10 can be more intuitively and easily grasped based on the color of the superimposed image (14) on which the colored image 13 as a heat map image is superimposed.

[0062] In the present embodiment, as described above, the emphasized image generating unit 61 is configured to generate a superimposed image (15) in which the intermediate layer image 12, which is output from the intermediate layer 52b of the trained model 52 and serves as an output image in which the target object 200 in the X-ray image 10 is emphasized, is superimposed on the X-ray image 10, and the image output unit 62 is configured to display the superimposed image (15) in which the intermediate layer image 12 is superimposed on the X-ray image 10 and the X-ray image 10 simultaneously or in a switchable manner on the display unit 4. With this configuration, the target object 200 included in the X-ray image 10 can be confirmed by comparing the superimposed image (15) in which the intermediate layer image 12, which allows easy recognition of the shape of the target object 200, is superimposed on the X-ray image 10 with the X-ray image 10, and the target object 200 included in the X-ray image 10, so that the target object 200 included in the X-ray image 10 can be more easily confirmed based on the shape and position of the target object 200 in the superimposed image (15).

[0063] In addition, in this embodiment, as described above, the emphasized image generating unit 61 is configured to generate, as output images, an output layer image 11 that is output from the output layer 52c of the trained model 52 and represents the region of the target object 200 in the X-ray image 10, and an intermediate layer image 12 that is output from the intermediate layer 52b of the trained model 52 and in which the target object 200 in the X-ray image 10 is emphasized, and the image output unit 62 is configured to display at least one of the output layer image 11 and the intermediate layer image 12, and the X-ray image 10 simultaneously or switchably on the display unit 4. With this configuration, the target object 200 included in the X-ray image 10 can be confirmed by comparing the X-ray image 10 with at least one of the output layer image 11 and the intermediate layer image 12, which allows the shape of the target object 200 to be easily grasped. Therefore, the target object 200 included in the X-ray image 10 can be confirmed more easily.

[0064] [Variations] The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is indicated by the claims, not by the description of the embodiments above, and further includes all modifications (variations) within the meaning and scope of the claims.

[0065] That is, in the above embodiment, the X-ray imaging device 100 is an X-ray imaging device for mobile examinations, but the present invention is not limited to this. For example, the X-ray imaging device 100 may be a general X-ray imaging device installed in an X-ray imaging room.

[0066] In the above embodiment, the highlighted image generating unit 61 (control unit 6) is configured to generate the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15. However, the present invention is not limited to this. For example, the highlighted image generating unit 61 may generate at least one of the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15.

[0067] In the above embodiment, the highlighted image generating unit 61 (control unit 6) is configured to generate the colored image 13 based on the output layer image 11, but the present invention is not limited to this. For example, the colored image 13 may be generated based on the intermediate layer image 12.

[0068] In the above embodiment, the highlighted image generating unit 61 (control unit 6) is configured to generate the colored image 13 by identifying the linear structure of the target object 200 in the output layer image 11 and coloring the image based on the identified linear structure, but the present invention is not limited to this. For example, the colored image 13 may be generated by coloring the image based on the pixel values ​​of the output layer image 11, instead of pattern recognition of the linear structure (shape). That is, the colored image 13 may be colored based on the density of pixel values ​​in a predetermined area of ​​the output layer image 11.

[0069] In the above embodiment, the highlighted image generating unit 61 (control unit 6) is configured to generate the colored image 13 as a heat map image in which the color is changed according to the density in a predetermined region including the portion where the linear structure of the target object 200 is located, but the present invention is not limited to this. For example, by setting a threshold value for the density (detection value) of the linear structure without changing the color, a colored image 13 in which a portion (region) larger than the threshold value is colored with one color may be generated.

[0070] In the above embodiment, the highlighted image generating unit 61 (control unit 6) is configured to generate the intermediate layer superimposed image 15 in which the intermediate layer image 12 is superimposed on the X-ray image 10, but the present invention is not limited to this. For example, an output layer superimposed image in which the output layer image 11 is superimposed on the X-ray image 10 may be generated.

[0071] In the above embodiment, the target object 200 includes a surgical gauze, a suture needle, and a pair of forceps, but the present invention is not limited to this. For example, the target object 200 may include a bolt, a surgical wire, a surgical clip, and the like.

[0072] In the above embodiment, the X-ray imaging device 100 includes the display unit 4 that displays the image output by the image output unit 62 (control unit 6), but the present invention is not limited to this. For example, images output by the image output unit 62, such as the X-ray image 10, the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15, may be displayed on an external display device provided separately from the X-ray imaging device 100.

[0073] In the above embodiment, the X-ray imaging device 100 includes the control unit 6 as an image processing device, but the present invention is not limited to this. For example, the enhanced images such as the output layer image 11, the intermediate layer image 12, the colored superimposed image 14, and the intermediate layer superimposed image 15 may be generated by an image processing device provided separately from the X-ray imaging device 100.

[0074] In the above embodiment, the highlighted image generating unit 61 (control unit 6) generates the colored image 13 so that the density (detection value) of the linear structure (shape) can be identified by varying the hue, but the present invention is not limited to this. For example, the colored image 13 may be generated so that the density (detection value) of the linear structure (shape) can be identified by varying the luminance of a single hue (e.g., red). That is, the colored image 13 may be generated so that the luminance is large when the detection value is large and the luminance is small when the detection value is small.

[0075] In the above embodiment, the control process for generating the X-ray image 10 and the control process for generating the highlighted image are performed by the X-ray image generating unit 3 and the control unit 6, which are configured as separate hardware, respectively, but the present invention is not limited to this. For example, the generation of the X-ray image 10 and the generation of the highlighted image may be performed by a single common control unit (hardware).

[0076] In the above embodiment, the emphasis image generating unit 61 and the image output unit 62 are configured as functional blocks (software) in one piece of hardware (control unit 6), but the present invention is not limited to this. For example, the emphasis image generating unit 61 and the image output unit 62 may be configured as separate hardware (arithmetic circuits).

[0077] In the above embodiment, the trained model 52 is generated by the learning device 300 separate from the X-ray imaging device 100, but the present invention is not limited to this. For example, the trained model 52 may be generated by the X-ray imaging device 100.

[0078] In the above embodiment, the trained model 52 is generated based on U-Net, which is a type of fully convolutional network (FCN), but the present invention is not limited to this. For example, the trained model 52 may be generated based on a convolutional neural network (CNN) including a fully connected layer. The trained model 52 may be generated based on an Encoder-Decoder model other than U-Net, such as SegNet or PSPNet.

[0079] [Aspects] It will be appreciated by those skilled in the art that the exemplary embodiments described above are examples of the following aspects.

[0080] (Item 1) an X-ray irradiation unit that irradiates an object with X-rays; an X-ray detection unit that detects X-rays irradiated from the X-ray irradiation unit; an X-ray image generating unit that generates an X-ray image based on a detection signal of the X-ray detected by the X-ray detection unit; A control unit, The control unit is an enhanced image generating unit that receives the X-ray image generated by the X-ray image generating unit, and generates, as an enhanced image, at least one of an output image of the trained model in which a position of the target object is enhanced based on a trained model that detects a region of the target object inside the subject's body in the X-ray image, and a composite image that is generated based on the output image and the X-ray image so that the position of the target object is enhanced; an image output unit that displays at least one of the output image and the composite image generated by the enhanced image generation unit and the X-ray image on a display unit simultaneously or in a switchable manner.

[0081] (Item 2) the enhanced image generating unit is configured to generate, as the composite image, a superimposed image in which the output image or an image generated based on the output image is superimposed on the X-ray image, 2. The X-ray imaging apparatus according to item 1, wherein the image output unit is configured to cause the display unit to display the superimposed image and the X-ray image simultaneously or in a switchable manner.

[0082] (Item 3) the highlighted image generating unit is configured to generate a colored image by coloring a portion of the output image corresponding to the target object, based on the output image, and to generate the superimposed image in which the generated colored image is superimposed on the X-ray image; 3. The X-ray imaging device according to claim 2, wherein the image output unit is configured to cause the display unit to display the superimposed image in which the colored image is superimposed on the X-ray image, and the X-ray image simultaneously or in a switchable manner.

[0083] (Item 4) the highlighted image generating unit is configured to identify a linear structure of the target object in the output image based on the output image, acquire a density in a predetermined region including a portion where the identified linear structure of the target object is located, and generate the colored image as a heat map image colored according to the density; Item 4. The X-ray imaging device according to item 3, wherein the image output unit is configured to display on the display unit the superimposed image on which the colored image as the heat map image is superimposed and the X-ray image simultaneously or in a switchable manner.

[0084] (Item 5) the enhanced image generating unit is configured to generate the superimposed image in which an intermediate layer image, which is output from an intermediate layer of the trained model and in which the target object in the X-ray image is enhanced, is superimposed on the X-ray image; The X-ray imaging device according to any one of items 2 to 4, wherein the image output unit is configured to cause the display unit to display the superimposed image in which the intermediate layer image is superimposed on the X-ray image, and the X-ray image simultaneously or in a switchable manner.

[0085] (Item 6) the enhanced image generating unit is configured to generate, as the output image, at least one of an output layer image that is output from an output layer of the trained model and represents a region of the target object in the X-ray image, and an intermediate layer image that is output from an intermediate layer of the trained model and in which the target object in the X-ray image is enhanced; The X-ray imaging device according to any one of items 1 to 5, wherein the image output unit is configured to display at least one of the output layer image and the intermediate layer image, and the X-ray image, simultaneously or switchably on the display unit.

[0086] (Item 7) an enhanced image generating unit that receives an X-ray image generated based on a detection signal of X-rays irradiated to a subject, and generates, as an enhanced image, at least one of an output image of the trained model in which a position of the target object is enhanced based on a trained model that detects a region of the target object inside the subject in the X-ray image, and a composite image that is generated based on the output image and the X-ray image so that the position of the target object is enhanced; an image output unit that displays at least one of the output image and the composite image generated by the enhanced image generation unit, and the X-ray image, on a display unit simultaneously or in a switchable manner.

[0087] (Item 8) On the computer, a process of generating, as an emphasized image, at least one of an output image of the trained model in which the position of the target object is emphasized based on a trained model that detects a region of the target object inside the subject in the X-ray image by inputting the X-ray image generated based on a detection signal of the X-ray irradiated to the subject, and a composite image generated based on the output image and the X-ray image so that the position of the target object is emphasized; a process of displaying at least one of the output image and the composite image, and the X-ray image, on a display unit simultaneously or in a switchable manner; An image processing program that executes the following: [Explanation of symbols]

[0088] 1 X-ray irradiation section 2 X-ray detection unit 3 X-ray image generation section 4 Display 6 Control unit (image processing device, computer) 10 X-ray image 11 Output layer image (enhanced image, output image) 12 Intermediate layer images (enhanced image, output image) 13 Coloring Images 14 Colored superimposed images (enhanced images, composite images, superimposed images) 15 Intermediate layer superimposed images (enhanced image, composite image, superimposed image) 51 Image Processing Program 52 Pre-trained models 52b Middle layer 52c Output layer 61 Enhanced image generation unit 62 Image output section 100 X-ray equipment 101 Subject 200 Target Objects

Claims

1. an X-ray irradiation unit that irradiates an object with X-rays; an X-ray detection unit that detects X-rays irradiated from the X-ray irradiation unit; an X-ray image generating unit that generates an X-ray image based on a detection signal of the X-ray detected by the X-ray detection unit; A control unit, The control unit is an enhanced image generating unit that generates an output image showing a position of the remnant based on a trained model that detects an area of ​​the remnant inside the subject's body in the X-ray image by inputting the X-ray image generated by the X-ray image generating unit, and generates an enhanced image based on the output image; an image output unit that displays the enhanced image and the X-ray image generated by the enhanced image generating unit simultaneously or in a switchable manner on a display unit; An X-ray imaging device, wherein the enhanced image generation unit is configured to generate an enhanced image based on the output image, in which the area of ​​the remnant in the X-ray image is colored as a heat map image according to the degree of similarity with the characteristics of the remnant.

2. the enhanced image generating unit is configured to generate an output image superimposed image in which the output image is superimposed on the X-ray image, The X-ray imaging apparatus according to claim 1 , wherein the image output unit is configured to cause the display unit to display the output image superimposed image and the X-ray image simultaneously or in a switchable manner.

3. the emphasized image generating unit is configured to generate a colored image by coloring a portion of the output image corresponding to the remnant, based on the output image, and to generate a superimposed image in which the generated colored image is superimposed on the X-ray image, as the emphasized image; The X-ray imaging apparatus according to claim 1 , wherein the image output unit is configured to cause the display unit to display the superimposed image and the X-ray image simultaneously or in a switchable manner.

4. an X-ray irradiation unit that irradiates an object with X-rays; an X-ray detection unit that detects X-rays irradiated from the X-ray irradiation unit; an X-ray image generating unit that generates an X-ray image based on a detection signal of the X-ray detected by the X-ray detection unit; A control unit, The control unit is an enhanced image generating unit which, by inputting the X-ray image generated by the X-ray image generating unit, generates, as an enhanced image, at least one of an output image of the trained model in which the position of the residual object is enhanced based on a trained model which detects an area of ​​the residual object inside the body of the subject in the X-ray image, and a composite image which is generated based on the output image and the X-ray image so that the position of the residual object is enhanced; an image output unit that displays at least one of the output image and the composite image generated by the enhanced image generating unit, and the X-ray image on a display unit simultaneously or in a switchable manner; the highlighted image generating unit is configured to identify a linear structure of the remnant in the output image based on the output image, obtain a density in a predetermined area including a portion where the identified linear structure of the remnant is located, and generate a colored image as a heat map image colored according to the density; An X-ray imaging device, wherein the image output unit is configured to display, on the display unit, a superimposed image in which the colored image as the heat map image is superimposed, and the X-ray image simultaneously or in a switchable manner.

5. an X-ray irradiation unit that irradiates an object with X-rays; an X-ray detection unit that detects X-rays irradiated from the X-ray irradiation unit; an X-ray image generating unit that generates an X-ray image based on a detection signal of the X-ray detected by the X-ray detection unit; A control unit, The control unit is an enhanced image generating unit which, by inputting the X-ray image generated by the X-ray image generating unit, generates, as an enhanced image, at least one of an output image of the trained model in which the position of the residual object is enhanced based on a trained model which detects an area of ​​the residual object inside the body of the subject in the X-ray image, and a composite image which is generated based on the output image and the X-ray image so that the position of the residual object is enhanced; an image output unit that displays at least one of the output image and the composite image generated by the enhanced image generating unit, and the X-ray image on a display unit simultaneously or in a switchable manner; the enhanced image generating unit is configured to generate a superimposed image in which an intermediate layer image, which is output from an intermediate layer of the trained model and in which the remnants in the X-ray image are enhanced, is superimposed on the X-ray image; The image output unit is configured to cause the display unit to simultaneously or switchably display the superimposed image in which the intermediate layer image is superimposed on the X-ray image and the X-ray image.

6. the enhanced image generating unit is configured to generate, as the output image, at least one of an output layer image that is output from an output layer of the trained model and represents a region of the remnant in the X-ray image, and an intermediate layer image that is output from an intermediate layer of the trained model and in which the remnant in the X-ray image is enhanced; 2. The X-ray imaging device according to claim 1, wherein the image output unit is configured to display the enhanced image, at least one of the output layer image and the intermediate layer image, and the X-ray image on the display unit simultaneously or in a switchable manner.

7. an enhanced image generating unit that generates an output image showing the position of the remnant based on a trained model that detects an area of ​​the remnant inside the subject's body in the X-ray image by inputting the X-ray image generated based on a detection signal of the X-ray irradiated to the subject, and generates an enhanced image based on the output image; an image output unit that displays the enhanced image and the X-ray image generated by the enhanced image generating unit simultaneously or in a switchable manner on a display unit; The image processing device, wherein the enhanced image generation unit is configured to generate an enhanced image based on the output image, in which the area of ​​the remnant in the X-ray image is colored as a heat map image according to the degree of similarity with the characteristics of the remnant.

8. On the computer, a generation process in which an output image showing the position of the remnant is generated based on a trained model that detects an area of ​​the remnant in the subject's body in an X-ray image generated based on a detection signal of X-rays irradiated to the subject, and an enhanced image is generated based on the output image; a display process for displaying the emphasized image and the X-ray image simultaneously or switchably on a display unit; Run the command, The generation process is an image processing program that includes a process of generating an enhanced image based on the output image, in which the area of ​​the residue in the X-ray image is colored as a heat map image according to the degree of match with the characteristics of the residue.

Images