Console device, method for operating console device, and program for console device

Abstract

To provide a console device that determines a photographic failure with a certain standard and provides advice for reducing the number of times of re-imaging, and to provide a method for operating a console device and a program for a console device.SOLUTION: A console device acquires first information that is a result of determination whether imaging is failed from a radiation image after predetermined image processing. When the first information indicates that the imaging is failed, the console device acquires second information that provides advice for successful imaging and controls so as to display a radiation image (an X-ray image 30) and the second information (display to a correction information display part 96b).SELECTED DRAWING: Figure 19

Description

[Technical field]

[0001] The present invention relates to a console device, a method for operating a console device, and a program for a console device. [Background technology]

[0002] In medical settings, radiographic imaging systems are widely used to capture radiographic images. When capturing radiographic images, there are cases where the capture fails (referred to as an imaging failure) due to incorrect positioning of the patient, the patient's body movement or insufficient inhalation, incorrect settings of imaging conditions, detection of a foreign object, etc.

[0003] The radiographer checks the radiographic images obtained by the imaging to determine whether they are defective. If the radiographer determines that an image is defective, the image is retaken to obtain a radiographic image necessary for diagnosis. Even if the radiographer does not determine that an image is defective, a doctor may determine that the radiographic image is not suitable for diagnosis.

[0004] In this way, if the criteria for determining whether an image is a failure used by the radiographer differ from the criteria for determining whether an image is a failure used by the doctor who makes a diagnosis using the radiological images, re-shooting will be necessary, which will increase the effort required for re-examination. In addition, marking a radiological image that did not need to be marked as a failure may result in unnecessary re-shooting, which is undesirable from the perspective of radiation exposure, and other problems may occur.

[0005] Therefore, by judging imaging defects based on a certain standard, it is possible to reduce unnecessary imaging defects and also reduce reexaminations after examinations. As a result, medical facilities can expect to improve the efficiency of their work, and subjects can expect to reduce unnecessary exposure to radiation and reexaminations.

[0006] Regarding the determination of imaging failure based on a certain standard, a specific radiation imaging system is disclosed that detects image deterioration due to positional changes by performing regression analysis in the system (Patent Document 1). In addition, regarding the improvement of the efficiency of reexamination work, an imaging control device that can perform re-imaging in segmented imaging without resetting imaging conditions is disclosed (Patent Document 2). [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2018-202231 A [Patent Document 2] JP 2015-195832 A Summary of the Invention [Problem to be solved by the invention]

[0008] If it is determined that the image is a failure, the image is retaken, but there is still a possibility that the image will be a failure even after the retake. If the image is a failure after the retake, the image will have to be retaken again, which is not desirable in terms of increasing the number of examinations and increasing radiation exposure. Therefore, in addition to determining whether the image is a failure based on a certain standard, it is desirable to suppress the occurrence of image failures during retake.

[0009] An object of the present invention is to provide a console device that judges shooting errors based on certain criteria and provides advice for reducing the number of reshoots, a method for operating the console device, and a program for the console device. [Means for solving the problem]

[0010] The present invention is a console device equipped with a processor, which acquires a radiological image obtained by photographing a subject using radiation, performs predetermined image processing on the radiological image, acquires first information from the radiological image after image processing which is the result of determining whether the photographing was unsuccessful, and if the first information indicates that the photographing was unsuccessful, acquires second information showing advice for successful photographing, and controls to display the radiological image and the second information.

[0011] The predetermined image processing preferably includes a process of selecting an area to be used for the determination from within the radiation image, and a process of adjusting the brightness or saturation of the radiation image.

[0012] The second information preferably includes an image when the photographing is successful, and preferably includes, as advice, a direction in which to tilt the subject.

[0013] The first information preferably further includes information indicating the reason for the determination. The first information preferably includes an item indicating that there was an error in the positioning of the patient, and an amount of deviation, which is information indicating how much the patient's positioning deviated from the case where imaging was successful. The first information preferably includes information on the parts where imaging failed and the parts where imaging did not fail.

[0014] When displaying the radiographic image and the second information, the processor preferably further displays the first information. The processor preferably outputs the radiographic image and the first information in association with auxiliary information including radiation irradiation conditions. The radiographic image displayed together with the second information is preferably a radiographic image obtained by photographing a subject. The radiographic image is preferably an image of the lateral side of a knee joint.

[0015] The present invention is a method for operating a console device equipped with a processor, the processor comprising the steps of: acquiring a radiographic image obtained by photographing a subject using radiation; performing a predetermined image processing on the radiographic image; acquiring first information from the radiographic image after image processing which is the result of determining whether the photographing has failed; and, if the first information indicates that the photographing has failed, acquiring second information showing advice for successful photographing, and controlling the display of the radiographic image and the second information.

[0016] The program for a console device of the present invention causes a computer to execute the following functions: obtain a radiographic image obtained by photographing a subject using radiation; perform predetermined image processing on the radiographic image; obtain first information from the radiographic image after image processing which is the result of determining whether the photographing has failed; and, if the first information indicates that the photographing has failed, obtain second information showing advice for successful photographing, and perform control to display the radiographic image and the second information. Effect of the Invention

[0017] According to the present invention, it is possible to provide a console device that judges shooting errors based on certain criteria and provides advice for reducing the number of reshoots, a method for operating the console device, and a program for the console device. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is an external view of a medical device system. [Diagram 2] FIG. [Diagram 3] FIG. 13 is a diagram showing a menu / condition table. [Figure 4] FIG. 11 is an explanatory diagram for explaining transmission of an X-ray image. [Diagram 5] FIG. 2 is a diagram showing an image file. [Figure 6] FIG. 2 is a block diagram showing the functions of a computer that constitutes the console. [Figure 7] FIG. 2 is a block diagram showing the functions of a CPU of the console. [Figure 8] FIG. 2 is a block diagram showing functions of an image processing unit. [Figure 9] 11A and 11B are explanatory diagrams illustrating a frame and an area designation cursor. [Figure 10] FIG. 11 is an explanatory diagram for explaining reasons for rejection and correction information. [Figure 11] FIG. 11 is an explanatory diagram for explaining a display of a deviation amount. [Figure 12] 4 is a block diagram showing functions of a display instruction receiving unit; FIG. [Figure 13] FIG. 2 is a block diagram showing functions including an approval receiving unit of a CPU of the console. [Figure 14] FIG. 11 is an explanatory diagram for explaining transmission of an image file. [Figure 15] 10 is a flowchart showing a flow of operations by an operator. [Figure 16] FIG. 2 is an explanatory diagram for explaining capturing of an X-ray image. [Figure 17] 13 is a diagram showing a management screen of the X-ray imaging system displaying a notification screen. FIG. [Figure 18] FIG. 11 is an explanatory diagram illustrating a change in a notification icon. [Figure 19] FIG. 13 is a diagram showing a management screen of the X-ray imaging system that displays a correction information display screen. [Figure 20] 13 is a diagram showing a management screen of the X-ray imaging system that displays a correction information display screen including a deviation amount display. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] As shown in Fig. 1, an X-ray imaging system 10 (radiography apparatus) that uses X-rays as radiation includes an X-ray generating device (radiation generating device) 11 and an X-ray imaging device 12. The X-ray generating device 11 includes an X-ray source (radiation source) 13 and a radiation source control device 14. The radiation source generates radiation. The X-ray imaging device 12 includes an X-ray detection panel (radiography section) 15 and a console (console device) 16.

[0020] The X-ray imaging system 10 is also provided with an irradiation switch for instructing the start of irradiation of radiation, a standing imaging stand for imaging the subject Obj in an upright position, or a lying imaging stand for imaging the subject Obj in a lying position, etc. Fig. 1 shows a state in which the subject Obj stands at a position facing the X-ray source 13 in an imaging room where the X-ray imaging system 10 is installed, and the subject Obj is imaged in an upright position.

[0021] The X-ray imaging system 10 also includes, for example, an imaging failure management device that manages captured information, etc. Also, the system is connected to an image server such as a PACS (Picture Archiving and Communication System for medical application) that manages captured X-ray images and information related to the X-ray images, and an information management server such as a HIS (Hospital Information System) or a RIS (Radiology Information System) that registers and manages information such as patient information, medical care information, examination information, accounting information, and imaging orders for each patient.

[0022] The X-ray source 13 includes an X-ray tube that generates X-rays Ra, an irradiation field limiter that limits the irradiation field, which is the area irradiated with the X-rays Ra, and an irradiation field indication light source that emits irradiation field indication light that indicates the irradiation field. The X-ray source 13 may be equipped with an optical camera to check the position of the subject Obj, etc.

[0023] The radiation source control device 14 has a touch panel, a voltage generating unit, a control unit, and an irradiation switch. The touch panel is operated when setting the irradiation conditions of X-ray Ra, which include the tube voltage applied to the X-ray tube, the tube current, and the irradiation time of X-ray Ra, and the size of the irradiation aperture of the irradiation field limiter.

[0024] The voltage generating unit generates a tube voltage to be applied to the X-ray tube. The control unit controls the operation of this voltage generating unit to control the tube voltage, tube current, and irradiation time of X-rays Ra. The control unit has a timer that starts counting when X-rays Ra are generated from the X-ray tube, and stops the operation of the X-ray tube when the time counted by the timer reaches the irradiation time set in the irradiation conditions. The control unit also operates the irradiation field limiter to set the size of the irradiation opening to the size set on the touch panel.

[0025] The exposure switch is operated by an operator, such as a radiographer, who is the user of the X-ray imaging device, when starting the exposure of X-rays Ra. The exposure switch is a two-stage push-type. When the exposure switch is pushed to the first stage (half-pressed), the control unit starts the preparatory operation before generating X-rays Ra from the X-ray tube. When the exposure switch is pushed to the second stage (fully pressed), the control unit causes the X-ray tube to generate X-rays Ra. As a result, the X-rays Ra are irradiated toward the imaging area of ​​the subject Obj.

[0026] The X-ray detection panel 15 detects the X-rays Ra emitted from the X-ray source 13 and transmitted through the object Obj for each pixel, and generates an X-ray image 30. The X-ray detection panel 15 has a wireless communication unit and a battery, and operates wirelessly. The X-ray detection panel 15 wirelessly transmits the X-ray image 30 to the console 16. Note that the X-ray detection panel 15 may be configured to perform wired communication.

[0027] The console 16 is configured by installing a control program such as an operating system and various application programs on a computer such as a notebook personal computer. The console 16 has a display 17 and an input device 18 such as a touch pad and a keyboard. The display 17 displays a radiographic image obtained by imaging. The console 16 displays various operation screens provided with an operation function using a GUI (Graphical User Interface) on the display 17, and accepts input of various operation instructions from an operator from the input device 18 via the various operation screens.

[0028] The console 16 receives an input of an imaging order 21 shown in Fig. 2. The imaging order 21 is information for instructing an operator to perform X-ray imaging from an imaging requester, such as a doctor in a medical department. The imaging order 21 is distributed to the console 16 from, for example, a RIS.

[0029] The imaging order 21 has items such as an order ID (Identification Data), a subject ID, and an imaging technique. The order ID is a symbol or number that identifies each imaging order 21, and is automatically assigned by the RIS. The subject ID item describes the subject ID of the subject Obj to be imaged. The subject ID is a symbol or number that identifies each subject Obj.

[0030] The imaging technique is information on the imaging part of the subject Obj and the posture and orientation of the imaging part. The imaging part may be a knee, a head, a cervical vertebrae, a chest, an abdomen, a hand, a finger, an elbow, or the like. The posture is the posture of the subject Obj such as a standing position, a lying position, or a sitting position, and the orientation is the orientation of the subject Obj with respect to the X-ray source 13 such as a front, a side, or a back. Although not shown in the figure, the imaging order 21 is provided with subject information items such as the name, sex, age, height, or weight of the subject Obj in addition to these items. The imaging order 21 is also provided with items such as the department to which the imaging requester belongs, the imaging requester's ID, the date and time when the imaging order 21 is accepted by the RIS, the imaging purpose such as postoperative follow-up or evaluation of the effect of a therapeutic drug, or matters to be notified from the imaging requester to the operator.

[0031] The console 16 stores a menu / condition table 22 shown in Fig. 3. In the menu / condition table 22, an imaging menu that specifies an imaging technique that is a set of an imaging region, a posture, and a direction, and the corresponding irradiation conditions are registered in association with each other. Some of the imaging menu and irradiation conditions are registered as default pairs, while others are registered by an operator by editing the default pair or newly added separately from the default pair. Note that the imaging menu may specify only the imaging region, rather than the imaging technique.

[0032] The console 16, in response to an operation by an operator, displays an imaging order list, which is a list of the contents of the imaging order 21 shown in Fig. 2, on the display 17. The operator checks the imaging order list to confirm the contents of the imaging order 21. Next, the console 16 displays the contents of the menu / condition table 22 shown in Fig. 3 on the display 17 in a format in which an imaging menu can be set. The operator selects and sets an imaging menu that matches the imaging technique specified in the imaging order 21.

[0033] The console 16 wirelessly transmits to the X-ray detection panel 15 a condition setting signal including various information such as the shooting menu set by the operator, the irradiation conditions corresponding to the set shooting menu, an order ID, or a console ID which is a symbol or number for identifying the console itself.

[0034] After setting the imaging conditions, the operator positions the X-ray source 13, the X-ray detection panel 15, and the object Obj at desired positions, and then drives the X-ray source 13 to irradiate the object Obj with X-rays Ra. The X-rays Ra that have passed through the object Obj are irradiated onto the X-ray detection panel 15, and an X-ray image 30 is detected by the X-ray detection panel 15.

[0035] As shown in Fig. 4, the X-ray detection panel 15 transmits an X-ray image 30 to the console 16. The console 16 displays the X-ray image 30 on the display 17 to show it to the operator. In Fig. 4, the imaging site in the X-ray image 30 is the knee.

[0036] The console 16 converts the X-ray image 30 into an image file 31 in a format conforming to the Digital Imaging and Communication in Medicine (DICOM) standard, for example, as shown in FIG. 5, and transmits this to the PACS.

[0037] The image file 31 is an X-ray image 30 and additional information 32 associated with one image ID. The additional information 32 includes subject information, order ID, imaging menu, irradiation conditions, etc. The person requesting imaging can access the PACS with a client terminal and download the image file 31 to view the X-ray image 30 on the client terminal.

[0038] 6, the console 16 includes, in addition to the above-mentioned display 17 and input device 18, a storage device 41, a memory 42, a CPU (Central Processing Unit, processor) 43, and a communication unit 44. These are interconnected via a data bus 45.

[0039] The storage device 41 is a hard disk drive built into the console 16 or connected via a cable or a network, or a disk array consisting of multiple hard disk drives. The storage device 41 stores control programs such as an operating system, various application programs, and various data associated with these programs.

[0040] The memory 42 is a work memory for the CPU 43 to execute processing. The CPU 43 loads a program stored in the storage device 41 into the memory 42 and executes processing according to the program, thereby comprehensively controlling each part of the console 16. The communication unit 44 has a function of communicating with other devices or a network, and is responsible for communicating various data such as the X-ray image 30 with the X-ray detection panel 15, for example.

[0041] 7, the storage device 41 stores an operating program 51 and a reject reason database (hereinafter, abbreviated as DB (Database)) 52. The reject reason DB 52 will be described later. Although not shown, the menu / condition table 22 shown in FIG. 3 is also stored in the storage device 41.

[0042] When the operating program 51 is started, the CPU 43 cooperates with the memory 42 and the like to function as an image acquisition unit 61, an image processing unit 62, a display instruction receiving unit 63, a display control unit 64, and the like. Therefore, the X-ray imaging device 12 includes the image acquisition unit 61, the image processing unit 62, the display instruction receiving unit 63, and the display control unit 64. The image acquisition unit 61 acquires images such as the X-ray image 30 received by the communication unit 44 for analysis. The image acquisition unit 61 normally acquires all of the X-ray images 30 obtained by shooting and sends each of them to the image processing unit 62.

[0043] As shown in FIG. 8, the image processing unit 62 includes an imaging failure determination unit 71, an imaging failure reason determination unit 73a, and a correction information determination unit 74. The imaging failure determination unit 71 includes a learned model 72a and a judgment image adjustment unit 72b. The image processing unit 62 analyzes the X-ray image 30 sent from the image acquisition unit 61. The analysis is performed for the purpose of determining whether or not imaging has failed, and determining information on the imaging failure reason that is the reason for determining that imaging has failed. Therefore, the image processing unit 62 analyzes the X-ray image 30 to determine a radiographic image that has been determined to have failed imaging as an imaging failure, and determines the imaging failure reason that is the reason for the determination and correction information for eliminating the imaging failure reason.

[0044] The image processing unit 62 uses a trained model 72a that has learned about previously acquired X-ray images and judges whether or not the X-ray image 30 has failed to be captured, to perform a judgment on the X-ray image 30. As a result of this judgment, information on whether or not the capture has failed, and information on the reason for the failure to capture is output.

[0045] By using the trained model 72a, it is possible to perform a judgment based on a certain standard. In addition, the judgment result can be obtained in a short time. For the trained model 72a, for example, an algorithm or library that produces a good judgment result for image processing can be used. In addition, an algorithm or library that produces a good judgment result for X-ray images can be constructed and used. As the training data, an X-ray image previously acquired in advance is used to which at least information on whether or not it is a defective image is added. In addition, an X-ray image to which any information from among the shooting data, which is incidental information related to the X-ray image, or patient data, etc., is added may be used. In addition, a feature amount may be selected according to the type of X-ray image, and an X-ray image to which the feature amount information is added may be used.

[0046] In addition to the trained model 72a, other well-known machine learning techniques or image processing techniques other than machine learning techniques may be used as long as the judgment can be made based on a certain standard. In addition, there may be a plurality of trained models 72a and image processing techniques other than machine learning techniques, and the preferred ones may be used depending on the type of the part of the X-ray image 30 or the accuracy of the judgment result.

[0047] The criteria for judgment are set in advance. For example, the criteria are set stricter or looser depending on the purpose of the X-ray image 30. More specifically, for example, in the X-ray image 30, a threshold value is set in advance for the deviation of the drawing of the key part in determining whether or not the shooting is successful in response to the shooting menu, and the criteria can be set stricter by making the value of this threshold smaller, or looser by making the value of this threshold larger. Therefore, a desired judgment criterion can be set according to the medical institution. In addition, even within the same medical institution, the judgment criteria can be set differently for each medical department such as emergency department, internal medicine, or surgery, or even within the same internal medicine department, for each shooting area, or for each purpose such as education for the operator's judgment criteria for shooting failure.

[0048] The setting of the judgment criteria may be changeable. The setting can be changed by the input device 18 or the like. The setting may be changed by the image processing unit 62 by feeding back instructions from the operator by the display instruction receiving unit 63 or the approval receiving unit 81, which will be described later. The setting of the judgment criteria or the change of the judgment criteria setting is performed by a setting unit (not shown) provided in the image processing unit 62. The setting unit has a function of performing various settings related to the image processing unit 62.

[0049] The trained model 72a can distinguish between failures and non-failures in order to determine whether the X-ray image 30 has been captured successfully. Therefore, it may be determined that the capture has not failed, that is, that the capture has been successful.

[0050] The judgment image adjustment unit 72b performs adjustments on the X-ray image 30 before judgment. The adjustments are performed for the purpose of improving the accuracy of judgment. Therefore, the contents of the adjustments include, for example, trimming in the X-ray image 30 to select a part of the image as an area to be judged, deleting unnecessary areas of the image, and / or adjusting brightness or saturation. In particular, when using the trained model 72a using deep learning or the like, the X-ray image 30 may not obtain a correct analysis result due to erroneous classification due to an image area that is not related to the judgment, and it is preferable to avoid this. Therefore, in adjusting the X-ray image 30, it is preferable to perform a more accurate analysis of the area to be judged by performing trimming in advance, in which an operator or the like specifies the area to be judged of the image. Note that the adjustment may not be performed.

[0051] As shown in Fig. 9, adjustment by trimming is performed by selecting an area for judgment by using a frame 85 in the X-ray image 30 displayed on the display 17. The frame 85 is, for example, a rectangular frame, and may be set to include an area for automatic judgment by image recognition technology, or the operator may drag an area designation cursor 86 on the X-ray image 30 to adjust and set the size of the frame 85, i.e., the area for judgment on the X-ray image 30. By the judgment image adjustment unit 72b performing adjustment by trimming to select an area for judgment by using the frame 85 on the X-ray image 30, for example, as shown in Fig. 9, it is possible to perform the imaging failure judgment of the knee joint with higher accuracy.

[0052] The image reject reason determination unit 73a determines the image reject reason based on the information output by the trained model 72a in the judgment. The image reject reason determination unit 73a includes a deviation amount measurement unit 73b. The information output by the trained model 72a in the judgment is information on the cause of the trained model 72a's judgment that the image capture failed. For example, items such as incorrect positioning of the patient, body movement or insufficient inhalation of the patient, incorrect setting of the image capture conditions, or detection of a foreign object such as a warmer or necklace can be mentioned.

[0053] The reason for the failure may include information on the item, in addition to the item of information on the cause of the determination that the imaging was unsuccessful. For example, the reason for the failure may include an item that the patient was positioned incorrectly and information on where and how much the position was misaligned. The deviation amount measurement unit 73b outputs information on the location and amount of deviation using information output by the trained model 72a and an image analysis technique for the X-ray image 30 determined to be an unsuccessful imaging. The reason for the failure may also include an explanation of the failed part and the non-failed part. Therefore, the reason for the failure may include information on the part determined to be unsuccessful in imaging and information on the part determined to be successful in imaging. For example, in the case of a patient positioning error, a detailed reason for the failure may be that the angle of bending the knee is correct in the patient's height direction, but the internal rotation of the knee is insufficient.

[0054] The correction information is information showing advice for reducing the number of retakes. Therefore, it is preferably information showing advice for succeeding in imaging with one retake. The correction information is information on past X-ray images of similar parts and imaging data corresponding to the X-ray image 30 determined as a failed imaging, and is information obtained by comparing the sample image when imaging is successful with the X-ray image 30 determined as a failed imaging. As described above, the reason for failure imaging and / or the correction information includes advice for reducing the number of retakes.

[0055] The correction information determination unit 74 determines correction information for eliminating the reject reason determined by the reject reason determination unit 73a by accessing the reject reason DB 52. The reject reason DB 52 is a database that stores the reject reason and the correction information for the reject reason in association with each other. For example, more specifically, the reject reason DB 52 includes a reject reason / correction information table 52a.

[0056] In the reject reason / correction information table 52a, the reject reason and the correction information for the reject reason are described in association with each other. For example, in the case of a lateral image of the knee joint with the imaging menu set to "knee / flexed position / side" (see FIG. 5), the X-ray image 30a that was successfully captured is described as "the joint surfaces of the medial and lateral femoral condyles are almost coincident" (Keiju Ogawa, ed., "New Illustrated Simple X-ray Radiography", 2nd edition, Kanehara Publishing Co., Ltd., February 2012, p. 137). Therefore, in the case where the joint surfaces of the medial and lateral femoral condyles are not coincident, the reject reason is determined by the shape and magnitude of the deviation. Then, the correction information is, for example, how to tilt the object Obj in order to capture the deviation in a desired position.

[0057] The reject reason / correction information table 52a will be described in more detail. As shown in FIG. 10, when an X-ray image 30b in which the femoral medial condyle 75b and the femoral lateral condyle 75a do not match is obtained, the image processor 62 recognizes, by analyzing the X-ray image 30b, that the contour of the femoral medial condyle 75b and the contour of the femoral lateral condyle 75a are apart by, for example, a set threshold value. Therefore, the image processor 62 determines that this X-ray image 30b is an unsuccessful image taken as a knee joint lateral image. In the successfully taken X-ray image 30a, the contour of the femoral medial condyle 75b and the contour of the femoral lateral condyle 75a match. Then, based on the positions of the contour of the femoral medial condyle 75b and the contour of the femoral lateral condyle 75a, etc., the reject reason is determined to be "The deviation between the medial and lateral condyle edges is thought to be large." According to the reject reason / correction information table 52a, the correction information for this reject reason is "It may be better to rotate the femoral medial condyle a little more." In this way, the reject reason and corrective information for this X-ray image 30 are determined.

[0058] When the corrective information is displayed, the operator can retake the image after viewing the corrective information. For example, in retaking the X-ray image 30b, the operator is advised to tilt the thigh slightly, for example, by about 10 degrees, in the direction away from the irradiation surface of the X-rays Ra, and to leave the rest unchanged in order to successfully take the image.

[0059] More specifically, the correction information may be any information including advice for the operator to succeed in re-imaging, such as still images, videos, illustrations, icons, animations, etc., in addition to characters such as text. When images such as still images, videos, illustrations, icons, animations, etc. are used as the correction information, it is preferable that the correction information includes a sample image of a similar portion and / or a past X-ray image of similar imaging data to the X-ray image 30 that was determined to be a failure, which is a sample image of a successful imaging. In addition, the sample image may be processed to display the parts that need to be changed.

[0060] The correction information may also include the X-ray image 30b that was not photographed. It may also be a combination of these. More specifically, for example, it may be an image in which an arrow indicating the position or tilt of a part of the object Obj is superimposed on a part of the X-ray image 30b that was not photographed. It may also be an image in which the X-ray image 30b that was not photographed and the X-ray image 30a of the same part that was successfully photographed are arranged side by side. Or, in the case of animation or video, for example, it may be an animation in which a shifted line on the X-ray image 30b that was not photographed gradually moves to match the corresponding line on the X-ray image 30a that was successfully photographed, based on the image of the object Obj on the X-ray image 30b that was not photographed and the image of the object Obj on the X-ray image 30a when it was successfully photographed.

[0061] As shown in Fig. 11, the displacement measurement unit 73b outputs information on the location of displacement and the amount of displacement, for example, by displaying a displacement display 87 as an overlay when displaying the X-ray image 30 on the display 17. The displacement display 87 is a numerical display of the amount of displacement at the location where the displacement is greatest among the locations where displacement has occurred, and indicates the amount of displacement as a numerical value such as "5 mm" and the location where the numerical value was measured with an arrow or the like. This allows the operator to more accurately recognize how much internal rotation is required to perform successful imaging. Note that the displacement display 87 can be set not to be displayed as the case may be.

[0062] The display control unit 64 controls the display of the determined corrective information on the display 17. The operator can check the corrective information displayed on the display 17 of the console 16 before re-shooting, thereby reducing the possibility of another shooting error.

[0063] As described above, the X-ray imaging system 10 judges imaging errors based on certain criteria and provides advice on how to reduce the number of retakes, thereby reducing unnecessary imaging errors and reducing the need for reexaminations after an examination is completed.

[0064] In addition, when the X-ray image 30 is determined to be a failure as a result of the analysis by the image processing unit 62, the operator can be notified of the failure. The notification means may be any means capable of notifying the operator of the failure, such as display, sound, or other notification means, but a means that does not cause anxiety to the patient who is the subject Obj is preferable. After the imaging, the operator usually checks the X-ray image 30 displayed on the display 17, so a notification means by display on the display 17 is preferable. For example, when the X-ray image 30 is determined to be a failure, the display control unit 64 notifies the operator that it is the X-ray image 30b that is determined to be a failure by displaying a notification icon on the display 17, or the like.

[0065] The display method on the display 17 may be any method that allows the operator to understand that the X-ray image 30b has been determined to be a defective image. For example, the color of the screen of the display 17 may be changed, a notification icon may be displayed for an alert, or the notification icon may be constantly displayed on the display 17 and the display of the notification icon may be changed. When the operator checks the captured X-ray image 30 after capturing the image, he or she can see the display 17 and be informed that the captured X-ray image 30 has been determined to be a defective image as a result of analysis by the image processing unit 62.

[0066] In addition, depending on the operator, when an image is not determined to be a failure due to the time required for analysis, it may be unclear whether the image was not determined to be a failure because the analysis is in progress or whether the image was determined to be successful. Therefore, during the analysis, information regarding the time required for the analysis may be displayed on the display 17. For example, a time bar or the like may be displayed on the display 17 so that it is possible to determine whether the analysis is in progress or has been completed.

[0067] 12, the display instruction receiving unit 63 includes a correction information display instruction receiving unit 76 and a reject reason display instruction receiving unit 77. The display instruction receiving unit 63 receives a correction information display instruction or a reject reason display instruction, which is an instruction as to whether or not to display the correction information or the reject reason on the display 17, to give an instruction to the display control unit 64 regarding the display of the correction information or the reject reason.

[0068] The correction information display instruction receiving unit 76 receives a correction information display instruction as to whether or not to display the correction information on the display 17. The correction information display instruction is given, for example, by a medical technician via the input device 18. When the X-ray image 30 is determined to be a defective image, whether or not to display the correction information can be determined according to the correction information display instruction.

[0069] Therefore, for example, in particular, by combining with the case where the captured X-ray image 30 is notified as an error, the operator judges the X-ray image 30 as an error after the notification, and then issues an instruction to display the corrective information, after which the corrective information is displayed. This requires the operator to check the X-ray image 30 and judge whether or not to display the corrective information, compared to the case where the corrective information is displayed without an instruction, and therefore prevents the judgment of the X-ray image 30 from being left to the judgment of the image processing unit 62, or prevents a reduction in the opportunity to correct the judgment of the image error when the judgment of the image processing unit 62 of the image error is inappropriate.

[0070] Similarly, the reject reason display instruction receiving unit 77 receives an instruction to display the reject reason as to whether or not to display the reject reason on the display 17. The reject reason display instruction is given by an operator such as a medical technician via the input device 18. When the X-ray image 30 is determined to be a reject, whether or not to display the reject reason can be determined according to the reject reason display instruction. Therefore, similar to the case of the correction information display instruction, the determination of the reject of the X-ray image 30 is left solely to the reject determination by the image processing unit 62, or when the reject determination by the image processing unit 62 is inappropriate, it is possible to prevent a reduction in opportunities for correction regarding the reject determination.

[0071] More specifically, the instruction to display corrective information or the instruction to display the reason for rejection is made in a simple manner, such as by keying, clicking, or touching an icon using the input device 18 such as a keyboard, mouse, or touch panel display 17.

[0072] In accordance with instructions from the correction information display instruction receiving section 76 and the reject reason display instruction receiving section 77 of the display instruction receiving section 63, the display control section 64 has a display control function of controlling the display of the correction information or the reject reason on the display 17. The correction information display instruction or the reject reason display instruction may be issued every time shooting is performed, or the instruction may be set once and then continued until the next setting.

[0073] Since the display instruction receiving unit 63 is configured as described above, for example, a notification icon may be constantly displayed on the display 17, and when the operator is unsure whether or not to judge an X-ray image 30 to be a failure after capturing the image, the operator may click on the notification icon to issue an instruction to display corrective information or an instruction to display the reason for the failure, and the corrective information or the reason for the failure may be displayed.

[0074] In this way, when an image is judged to be a failure, the reason for the failure and / or corrective information are not automatically displayed, but the display 17 is required to operate the display instruction, so that, for example, when the operator thinks that the image has been successfully captured, unnecessary display is not displayed on the display 17, and there is no risk of interfering with the task of checking the X-ray image 30. Even in cases other than when the operator indicates advice to retake an image when the image is judged to be a failure, for example, when the operator is unsure whether to judge the image to be a failure, the X-ray imaging device 12 can issue an instruction to display corrective information and / or the reason for the failure obtained by analysis, so that the operator can correct the judgment criteria of the operator to a certain standard, and the operator can confidently judge the image to be a failure for the X-ray image 30. In addition, since the operator can confirm the judgment of the image failure by the X-ray imaging device 12, when there is a problem with the criteria for the judgment of the image failure by the X-ray imaging device 12 or when the judgment of the image failure is incorrect, it is prevented that the judgment by the X-ray imaging device 12 is used as the judgment of the operator when the operator has not actually judged the image to be a failure by the X-ray image 30.

[0075] As shown in Fig. 13, the X-ray imaging device 12 includes an approval receiving unit 81. When an X-ray image 30 is determined to be an imaging failure, the approval receiving unit 81 receives whether or not the operator approves the imaging failure. The approval is given by the operator through the input device 18. When the approval receiving unit 81 accepts the approval, the approval receiving unit 81 receives the X-ray image 30 and necessary information from the image processing unit 62, and sends this information to the communication unit 44, whereby this information is transmitted to each unit, etc. This information includes an imaging order or an image file 31, etc.

[0076] As a form of approval, for example, an approval icon and a disapproval icon are displayed on the display 17, and when the operator approves the judgment of the imaging failure made by the X-ray imaging device 12, he / she clicks on the approval icon. Note that in the following, clicking includes touching. On the other hand, when the operator does not approve the judgment of the imaging failure, he / she clicks on the disapproval icon (see FIG. 19).

[0077] When the approval icon is clicked, the X-ray image 30 that was determined to be a failure by the X-ray imaging device 12 is determined to be a failure by the operator. Therefore, when the approval receiving unit 81 receives approval from the operator, the same process as that in the case where a normal failure occurs is performed.

[0078] 14, for example, when the X-ray imaging system 10 including the X-ray imaging device 12 is equipped with a RIS 79 that manages imaging orders, an order for re-imaging is registered in the RIS 79 when the approval receiving unit 81 receives approval for the imaging failure. The contents of the order for re-imaging are obtained from information on the imaging order for the approved X-ray image 30 or information on the image file 31 including the X-ray image 30.

[0079] Furthermore, when the X-ray imaging system 10 including the X-ray imaging device 12 is connected to a PACS 78 that stores radiation images and information related to the radiation images, the approval receiving unit 81 receives approval from an operator, and in some cases obtains information from the RIS 79 and transmits the X-ray image 30 and information related to the X-ray image 30 to the PACS 78. More specifically, an image file 31 including the X-ray image 30 is automatically registered in the PACS 78. The image file 31 complies with the DICOM standard, and is registered in the PACS 78 with information related to the imaging error input by the X-ray imaging system 10.

[0080] In addition, if the X-ray imaging system 10 including the X-ray imaging device 12 is equipped with a failure management device (not shown) that manages X-ray images 30b that have been determined to be failures, when the approval receiving unit 81 receives approval of the failure of the X-ray image 30, information including the X-ray image 30b and the reason for the failure of the X-ray image 30b is transmitted to the failure management device.

[0081] When approving the rejection, the rejection reason and / or corrective information are displayed on the display 17, and when the operator approves all the items, the approval icon may be clicked. For example, when the operator approves the rejection of the X-ray image 30 itself but does not approve the rejection reason and / or corrective information, the disapproval icon is clicked. This may allow the operator to correct the revised parts of the rejection reason and / or corrective information. When the correction is completed, the approval icon is clicked, so that the information approved by the operator can be sent to each part of the RIS and / or PACS.

[0082] If the operator does not accept that the X-ray image 30b has been determined to be a failure by the X-ray imaging device 12, the operator clicks on the non-approval icon. This allows the operator to change the determination that the image has been a failure. In this case, the operator writes down the reason for changing the determination by the X-ray imaging device 12. The operator may use this reason to modify the criteria for determining failure by the image processing unit 62.

[0083] When the operator rejects the X-ray image 30 that has been rejected by the image processor 62 by clicking the reject icon, as described above, a screen appears for selecting and editing whether to cancel the reject, whether to change the reason for the reject, or whether to change the correction information. When the reject is canceled, the X-ray image 30 and information about the X-ray image 30 are sent to the PACS as a successfully captured image. More specifically, an image file 31 including the X-ray image 30 is automatically registered in the PACS.

[0084] In this way, the operation and procedure when the operator judges the X-ray image 30 to be a failure can be automatically performed by a simple operation of clicking the approval icon. Therefore, the efficiency of the work can be improved. When the final judgment is made that the X-ray image 30 is a failure or not, it is a signal that the imaging for one imaging order is completed.

[0085] Next, the operation of the above configuration will be described with reference to the flowchart in Fig. 15. First, the operator checks the contents of the imaging order 21 on the display 17, and sets a desired imaging menu according to the imaging order 21 via the input device 18. As a result, a condition setting signal including the set imaging menu and the corresponding irradiation conditions, etc. is transmitted from the console 16 to the X-ray detection panel 15. After setting the imaging menu, the operator sets the same irradiation conditions as those corresponding to the set imaging menu in the radiation source control device 14 via the touch panel. After that, the operator starts relative positioning of the X-ray source 13, the X-ray detection panel 15, and the object Obj.

[0086] For example, when the imaging menu is "knee / flexed position / side" to capture a lateral image of a knee joint, the operator places the knee, which is the subject Obj, on the bed 83 perpendicular to the X-ray source 13, as shown in FIG. 16. The X-ray detection panel 15 is set in a position directly opposite the X-ray source. At this time, the operator sets the size of the irradiation opening of the irradiation field limiter, i.e., the irradiation field, in the radiation source control device 14 via the touch panel. The operator activates the irradiation field indication light source to irradiate the irradiation field indication light toward the electronic cassette. Using this irradiation field indication light as a clue, the operator fine-tunes the positions of the X-ray source 13, the X-ray detection panel 15, and the subject Obj so that their positional relationship becomes the desired one.

[0087] After positioning, the operator operates the irradiation switch to generate X-rays Ra from the X-ray source 13. The X-rays Ra irradiated from the X-ray source 13 and transmitted through the subject are irradiated onto the front surface of the X-ray detection panel 15. The X-ray detection panel 15 detects the start of irradiation of X-rays Ra using an irradiation start detection function. As a result, an irradiation start detection signal is wirelessly transmitted from the X-ray detection panel 15 to the console 16. After detecting the start of irradiation of X-rays Ra, the X-ray detection panel 15 executes pixel charge accumulation operation and image readout operation, and an X-ray image 30 is detected. The X-ray image 30 is wirelessly transmitted from the X-ray detection panel 15 to the console 16.

[0088] When the captured X-ray image 30 is wirelessly transmitted to the console 16, the X-ray image 30 and a notification icon 91 are displayed on a management screen 90 of the X-ray imaging system on the display 17, as shown in Fig. 17. The notification icon 91 may be in the shape of, for example, a character. The notification icon 91 is always displayed.

[0089] In the console 16, by receiving the X-ray image 30, as shown in Fig. 7, the CPU 43 starts the operations of the image acquisition unit 61, the image processing unit 62, the display instruction receiving unit 63, and the display control unit 64. The image acquisition unit 61 receives the X-ray image 30 and sends it to the image processing unit 62. The image processing unit 62 analyzes the X-ray image 30. As shown in Fig. 8, the imaging failure determination unit 71 determines whether the X-ray image 30 is an imaging failure. The determination is performed using a trained model 72a.

[0090] When the analysis is completed and the analysis result indicates that the X-ray image 30 is a reject, the reject reason determination unit 73a determines the reject reason based on the information from the reject judgment unit 71 and, in some cases, the information of the radiography order 21 and / or the image file 31, etc. The reject reason determination unit 73a determines the correction information corresponding to the reject reason using the determined reason and the reject reason / correction information table 52a stored in the reject reason DB 52, and, in some cases, the information of the radiography order 21 and / or the image file 31, etc.

[0091] On the notification screen 93 of the display 17, the facial expression of the notification icon 91 is changed to notify the operator that the captured X-ray image 30 is a failure. That is, as shown in Fig. 18, if the analysis result after the X-ray shooting shows that the image is not a failure, the notification icon 91 is displayed as a no-notification notification icon 91a with a closed mouth, whereas if the analysis result shows that the image is a failure, the notification icon 91 is displayed as a notification notification icon 91b with an open mouth.

[0092] The operator checks the captured X-ray image 30 on the display 17, and also checks the notification icon 91 displayed on the display 17 (FIG. 15, step ST100). In this case, the notification icon 91 is a notification icon 91b with a notification. If the operator wants to check the corrective information or the reason for the rejection (YES in step ST110), he / she clicks on the notification icon 91 with the cursor 92 of a mouse or the like (see FIG. 17, step ST120). By this operation, as shown in FIG. 19, the management screen 90 of the X-ray imaging system changes from the notification screen 93 to a corrective information display screen 94. The corrective information display screen 94 is a screen including a rejection reason and / or corrective information display section 96. The rejection reason and / or corrective information display section 96 includes a rejection reason display section 96a and / or a corrective information display section 96b, an approval button 98, and a disapproval button 99. When it is set that the deviation amount display 87 is to be displayed, the deviation amount display 87 is displayed as shown in FIG.

[0093] After checking the reason for failure and / or the contents displayed on the correction information display unit 96, if the operator determines that the X-ray image 30 displayed on the display 17 is not a failure (NO in step ST130), he / she clicks the disapproval button of the notification icon 91 (step ST140). This allows the data in the image file 31 that was previously entered as a failure to be edited and changed. If necessary, the operator edits the image to indicate that it is not a failure (step ST160), and inputs a determination that it is not a failure (YES in step ST190).

[0094] On the other hand, if the X-ray image 30 displayed on the display 17 is judged to be a reject and there is no objection to the content displayed by the reject reason and / or corrective information display unit 96 (YES in step ST130), the approval button 98 of the notification icon 91 is clicked (step ST150). When the approval button 98 is clicked, reject processing of the X-ray image 30 is automatically performed (step ST180). On the display 17, the reject reason and / or corrective information display unit 96 disappears, the notification icon 91 becomes the no notification icon 91a, and the display returns to the standby state before shooting.

[0095] Furthermore, if the operator judges that the X-ray image 30 displayed on the display 17 is a failure and objects to the reason for failure and / or the contents displayed by the correction information display unit 96 (NO in step ST130), clicking the Disapproval button displays buttons for editing the failure judgment, the correction information, and the reason for failure. If editing is not required, editing is completed, and if editing is required, the respective edit buttons are clicked to edit the failure judgment, the correction information, and the reason for failure (step ST160). By approving the failure judgment for the X-ray image 30 (NO in step ST190), the image is sent to failure processing (step ST180), and the operator's judgment of the failure is completed.

[0096] Note that even if the notification icon 91b with notification is displayed and the image processor 62 judges that the X-ray image 30 displayed on the display 17 is a failure, the operator may click the failure button 97 (step ST170) to process the failure without clicking the notification icon 91 to display the correction information (NO in step ST110). This causes automatic failure processing (step ST180). When the operator processes the X-ray image 30 as a failure, the notification icon 91 becomes the notification icon 91a without notification, and the state returns to the standby state before shooting.

[0097] The failure processing that is automatically performed after clicking the approval button 98 or the failure button 97 includes, for example, sending data to a failure management device, registering an imaging order for re-imaging, and inputting information into the relevant portion of a DICOM format file. In this case, the approval reception unit 81 acquires necessary information from the image processing unit 62 and sends it to the communication unit 44. The communication unit 44 distributes various information to each unit. This ends the transmission to the PACS, RIS, and failure management device. In addition, the operation of each unit 80 to 84 of the CPU 67 is stopped.

[0098] In the above embodiment, the hardware structure of the processing units that execute various processes, such as the image acquisition unit 61, the image processing unit 62, the display control unit 64, the display instruction receiving unit 63, and the approval receiving unit 81, is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and a dedicated electrical circuit (Graphical Processing Unit: GPU), which is a processor having a circuit configuration designed exclusively for executing various processes.

[0099] One processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same type or different types (for example, multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a GPU and a CPU). Also, multiple processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as represented by a computer such as a client or a server, there is a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0100] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit in the form of a combination of circuit elements such as semiconductor elements.

[0101] The present invention is not limited to the above-described embodiment, and various configurations can be adopted without departing from the spirit of the present invention. Furthermore, the present invention extends to a storage medium for storing a program, in addition to the program. [Explanation of symbols]

[0102] 10 X-ray imaging system 11 X-ray generator 12 X-ray equipment 13 X-ray source 14 Radiation source control device 15 X-ray detection panel 16 Console 17 Display 18 Input Devices 21 Imaging Order 22 Menu / Condition Table 30 X-ray images 30a Successfully taken X-ray image 30b X-ray images that were deemed to be defective 31 Image files 32 Additional information 41 Storage Devices 42 Memory 43 CPU 44 Communications Department 45 Data Bus 51 Operating Program 52 Photo loss reason DB 52a Photo rejection reason / correction information table 61 Image acquisition unit 62 Image Processing Unit 63 Display Instruction Reception Department 64 Display control section 71 Image failure judgment section 72a Pre-trained model 72b Judgment image adjustment section 73a Determination of reasons for copy loss 73b Displacement measurement unit 74 Corrective Information Decision Unit 75a Lateral condyle 75b Medial condyle 76 Corrective Information Display Instruction Reception Department 77 Rejection Reason Display Instruction Reception Unit 78 PACS 79 RIS 81 Approval Reception Department 83 Bed 85 slots 86 Area specification cursor 87 Displacement amount display 90 Management screen 91 Notification Icon 91a No notification icon 91b Notification icon 92 Cursor 93 Notification screen 94 Correction information display screen 96 Rejection reason and / or correction information display section 96a Rejection reason display section 96b Correction information display section 97 Damaged button 98 Approval button 99 Reject button Obj Subject Ra X-ray ST100~ST190 Step

Claims

1. A console device including a processor, The processor, Obtaining a radiation image obtained by photographing a subject using radiation; performing predetermined image processing on the radiation image; obtaining first information indicating a result of a determination as to whether the imaging has failed from the radiation image after the image processing; A console device that, when the first information indicates that the shooting has failed, obtains second information indicating advice for succeeding in the shooting, and controls to display the radiation image and the second information.

2. The console device according to claim 1 , wherein the predetermined image processing includes a process of selecting an area to be used for the determination from within the radiation image.

3. The console device according to claim 1 , wherein the predetermined image processing includes a process for adjusting a brightness or a saturation of the radiation image.

4. The console device according to claim 1 , wherein the second information includes an image obtained when the photographing is successful.

5. The console device according to claim 1 , wherein the second information includes, as the advice, a direction in which the subject is to be tilted.

6. The console device according to claim 1 , wherein the first information further includes information indicating a reason for the determination.

7. The console device according to claim 6, wherein the first information includes an item indicating that there was an error in patient positioning and an amount of deviation, which is information indicating how much the patient's positioning deviated from the case in which the imaging was successful.

8. 8. A console device according to claim 6, wherein the first information includes information on the portion where the image capturing has failed and the portion where the image capturing has not failed.

9. The console device according to claim 1 , wherein the processor further displays the first information when displaying the radiation image and the second information.

10. The console device according to claim 1 , wherein the processor outputs supplementary information including irradiation conditions of the radiation, the radiation image, and the first information in association with each other.

11. The console device according to claim 1 , wherein the radiation image displayed together with the second information is a radiation image obtained by imaging the subject.

12. The console device according to claim 1 , wherein the radiological image is an image obtained by photographing a side of a knee joint.

13. 1. A method of operating a console device including a processor, comprising: The processor, acquiring a radiation image by photographing a subject using radiation; performing a predetermined image processing on the radiation image; acquiring first information indicating a result of a determination as to whether the imaging has been unsuccessful from the radiation image after the image processing; and if the first information indicates that the shooting has failed, obtaining second information indicating advice for succeeding in the shooting, and controlling the display of the radiation image and the second information.

14. On the computer, a function of acquiring a radiation image obtained by photographing a subject using radiation; a function of performing predetermined image processing on the radiation image; a function of acquiring first information, which is a result of determining whether the imaging has failed, from the radiation image after the image processing; and if the first information indicates that the shooting has failed, acquiring second information indicating advice for succeeding in the shooting, and controlling the display of the radiation image and the second information.

Images