Radiography control device and radiographic system

Abstract

To provide a radiography control device capable of appropriately outputting information obtained on the basis of an optical imaging device according to a state of a subject, and a system of the radiography control device.SOLUTION: A radiography control device includes: a first acquisition part that acquires an optical image related to a subject; an estimation part that estimates information related to a site of the subject from the optical image; a second acquisition part that acquires imaging site information of an imaging protocol related to the subject; and a determination part that determines matching between the information related to the site estimated by the estimation part and the imaging site information acquired by the second acquisition part on the basis of a similarity.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a radiation imaging control device and a radiation imaging system.

Background Art

[0002] As an imaging device used for medical image diagnosis and non-destructive inspection by radiation, a radiation imaging device using a flat panel detector (FPD) formed of a semiconductor material has become widespread. Such a radiation imaging device is used, for example, as a digital imaging device for still image imaging such as general imaging or moving image imaging such as fluoroscopy in medical image diagnosis.

[0003] In radiation imaging, subject alignment is performed as a pre-step of imaging, and cases where imaging failure occurs due to inappropriate alignment have also been confirmed. Recently, as a configuration for assisting this alignment, a radiation imaging system (radiation imaging system) equipped with an optical camera (optical imaging device) capable of confirming the subject situation has been proposed.

[0004] Patent Document 1 describes a technique of analyzing a subject image acquired by an optical imaging device during radiation imaging and displaying the analysis result on a display device to notify an operator.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] In the technique described in Patent Document 1, there is room for improvement in the analysis method and its notification method.

Means for Solving the Problems

[0007] To solve the above problems, a radiation imaging control apparatus according to the present invention includes a first acquisition unit that acquires an optical image related to a subject, an estimation unit that estimates information related to a part of the subject from the optical image, a second acquisition unit that acquires imaging part information of an imaging protocol related to the subject, and a determination unit that determines the consistency between the information related to the part estimated by the estimation unit and the imaging part information acquired by the second acquisition unit based on similarity.

Advantages of the Invention

[0008] According to the present invention, it is possible to support radiation imaging based on the analysis result of an optical image.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the invention according to the claims is not limited to the configurations described in the embodiments. Modifications such as replacing or omitting a part of the configuration or a part of the process with an equivalent may be made within the range where the same effects can be obtained.

[0011] (Embodiment) [Radiation Imaging System] FIG. 1 is an overall view showing the usage environment of a radiation detection device 10 (radiation imaging device, radiation imaging apparatus), and shows the radiation detection devices 10 (10A, 10B) and a control device 20 which is a radiation control device, constituting a radiation imaging system whose details will be described later. Hereinafter, the radiation imaging device will be briefly described with the control device. Further, FIG. 1 also shows a radiation generation device 30 (30A, 30B), an optical imaging device 40 (40A, 40B), a display unit 25, an operation unit 26, a RIS 55, a PACS 56, and a HIS 57.

[0012] The control device 20 is a device that relays each device connectable via the radiation detection device 10, the radiation generation unit 30, and the network 50 and performs various controls. Details of the control device 20 will be described later.

[0013] The radiation generation device 30 (radiation irradiation device) includes a radiation tube that generates radiation, and irradiates radiation to a subject such as a patient. Here, not only X-rays but also α-rays, β-rays, γ-rays, particle beams, cosmic rays, etc. are included in the radiation. The radiation generation device 30A and the radiation generation device 30B are selected and used as appropriate according to the imaging content. When there is no particular preference, these are collectively referred to as the radiation generation device 30.

[0014] The radiation detection device 10 (radiation imaging device, radiation imaging apparatus) is a device that generates an image based on the radiation irradiated from the radiation generation device 30. The radiation detection device 10 is, for example, a flat panel detector. The radiation detection device 10A and the radiation detection device 10B are selected and used as appropriate according to the imaging content. When there is no particular preference, these are collectively referred to as the radiation detection device 10.

[0015] The radiation detection device 10 detects the radiation irradiated from the radiation generation device 30 and passed through the subject, and outputs image data corresponding to the radiation. Note that the image data can also be referred to as medical images or radiation images. Specifically, the radiation detection device 10 detects the radiation transmitted through the subject as charges corresponding to the amount of transmitted radiation. For example, the radiation detection device 10 uses a direct conversion type sensor such as a-Se that directly converts radiation into charges, or an indirect type sensor using a scintillator such as CsI that converts radiation into visible light and a photoelectric conversion element such as a-Si. Further, the radiation detection device 10 generates image data by performing A / D conversion on the detected charges and outputs the image data to the control device 20.

[0016] The optical imaging device 40 is a camera device for imaging the state of a subject who is a subject for performing radiation imaging. The optical imaging device 40A and the optical imaging device 40B are selected and used according to the imaging content. When there is no particular preference, these are collectively referred to as the optical imaging device 10.

[0017] The display unit 25 is a display device including a monitor such as a liquid crystal display. It also includes an operation unit (not shown), and the operation unit is an input device including a keyboard, a pointing device (e.g., a mouse, etc.), a touch panel, and the like.

[0018] RIS55, PACS56, and HIS57 are services that cooperate with the control device 20 via a network to expand various functions related to radiography. The control device 20 is connected to RIS55, PACS56, and HIS57 via the network 50 and can exchange radiation images, patient information, etc. Although FIG. 1 depicts that RIS55, PACS56, and HIS57 are included in the radiation imaging system 1, a system that does not include at least a part of these may also be acceptable. Here, RIS is an abbreviation for Radiology Information Systems (information system within the radiology department). PACS is an abbreviation for Picture Archiving and Communication Systems (image server). HIS is an abbreviation for Hospital Information Systems (hospital information system).

[0019] The control device 20 controls radiography using the radiation detection device 10 and the radiation generation device 30.

[0020] The radiation imaging apparatus of the present embodiment is used, for example, in a sequence as shown in FIG. 4.

[0021] In step 401 (hereinafter denoted as S401, etc.), a user (radiologic technologist) who uses the radiation imaging system inputs inspection information to the radiation imaging system 1.

[0022] In S402, the radiation imaging system 1 starts preparations for radiography.

[0023] In S403, as one of the preparations for radiography, the radiation imaging system 1 monitors the subject, who is the patient, by optical imaging.

[0024] In S404, the user arranges the radiation detection device 10 and the patient.

[0025] In S405, the user checks the status of the patient displayed on the radiation imaging system 1.

[0026] In S406, if the positional relationship between the radiation detection device 10 and the subject is not appropriate, the user adjusts the positions of the radiation detection device 10 and the subject.

[0027] In S407, the user checks the state of the subject displayed on the radiation imaging system 1.

[0028] In S408, the user confirms that the positional relationship between the radiation detection device 10 and the subject is appropriate and gives an instruction for radiation imaging to the radiation imaging system.

[0029] In S409, the radiation imaging system 1 executes radiation imaging.

[0030] [Control Device] FIG. 3 is a diagram showing the configuration of the control device. The control device 20 includes a CPU 301, a RAM 302, a ROM 303, an external memory 304, a communication I / F unit 305, and a bus 306. The CPU 301, the RAM 302, the ROM 303, the external memory 304, and the communication I / F unit 305 are connected to each other so as to be communicable via the bus 306.

[0031] The CPU 301 (Central Processing Unit) comprehensively controls the operation of the control device 20 and controls each component shown in FIG. 3 via the bus 306.

[0032] The RAM 302 (writable memory) functions as the main memory, work area, etc. of the CPU 301. When executing processing, the CPU 301 loads necessary computer programs 307, data, etc. from the ROM 303 into the RAM 302, and realizes various functional operations by executing the computer programs 3031, etc. The control device 20 has an application function that operates on a computer. That is, the control device 20 has one or more processors and a memory, and the processor executes a program stored in the memory to realize each functional unit described below. However, part or all of each functional unit may be realized by dedicated hardware.

[0033] The ROM 303 (read-only memory) stores computer programs 3031, data, etc. necessary for the CPU 301 to execute processing. Note that the computer programs 3031, data, etc. may be stored in the external memory 304.

[0034] The external memory 304 is a mass storage device, and is realized by, for example, a hard disk device, an IC memory, or the like. The external memory 304 stores various data and various information necessary when the CPU 301 executes a computer program 3031, etc. and performs processing. Further, the external memory 304 stores various data and various information obtained when the CPU 301 executes a computer program 3031, etc. and performs processing.

[0035] The communication I / F (interface) unit 305 controls communication between the control device 20 and the outside. The control device 20 is connected to the radiation generator 30, the radiation detection device 10, and the optical imaging device 40 via the communication I / F unit 305 by a wired or wireless network or a dedicated line.

[0036] The bus 306 is for communicably connecting the CPU 301 to the RAM 302, the ROM 303, the external memory 304, and the communication I / F unit 305.

[0037] Next, the radiographic system and the details (functional blocks) of the control device, which is a radiographic control device, will be described with reference to FIG. 2. The radiographic system 1 includes a radiation detection device 10 and a control device 200, which is a radiographic control device. The control device 200 will be described in detail below.

[0038] The imaging control unit 211 of the control device 20 controls the generation control unit 212, the detection control unit 213, and the optical imaging control unit 214 based on the instructions from the operation control unit 210 and the inspection information managed by the inspection information management unit. The inspection information includes information such as dose, irradiation time (ms), tube current (mA), tube voltage (kV), and the light collection field, which is the area where radiation is detected. These pieces of information are transmitted to the radiation detection device 10 via the imaging control unit 211 and the detection control unit 213.

[0039] The generation control unit 212 controls the timing at which the radiation generation device 30 generates radiation and the imaging conditions of the radiation.

[0040] The generation control unit 212 outputs information such as an irradiation control signal to the radiation generation device 30 based on dose information and the like. The irradiation control signal transmitted from the generation control unit 212 to the radiation generation device 30 may include two signals: a stop signal (irradiation stop signal) for stopping the irradiation of radiation and an irradiation signal (non-irradiation stop signal) for irradiating radiation. The generation control unit 212 can control the irradiation and stop of radiation from the radiation generation device 30 by controlling the output of both the stop signal and the irradiation signal, or one of the signals.

[0041] The detection control unit 213 communicates with the radiation detection device 10 and performs various controls for radiation imaging (radiographic imaging). For example, the detection control unit 213 executes various communication processes related to radiation imaging for the radiation detection device 10. In this communication process, setting information for imaging conditions, setting information for operation control, image information, arrival dose information, etc. are exchanged.

[0042] The optical imaging control unit 214 controls the start and end of imaging by the optical imaging device 40, the conditions for acquiring an optical image, the timing, the frame rate, and functions such as zoom and focus.

[0043] The radiation image acquisition unit 201 receives image data from the radiation detection device 10. The image processing unit 202 performs image processing on the received image data as necessary and provides it to the display control unit 209 and the image storage unit 208.

[0044] The display control unit 209 provides the screen information of the imaging management application to the display unit 25. The graphical user interface of the imaging management application displayed on the display unit 25 is linked to the operations on the operation unit 26. Therefore, information related to the imaging management application can be input via the operation unit 26. For example, when a plurality of inspection information is displayed in a list format on the display unit 25, the operation unit 26 can perform an operation input to select one piece of inspection information from the list. The selected inspection information can be set as the inspection target. Note that the user may directly input inspection information from the operation unit 26. The inspection information input in the imaging management application is managed by the inspection information management unit 207. In addition, the method of obtaining and setting the inspection information is not limited to the above. For example, the inspection information management unit may directly obtain and manage the inspection information (such as a shooting protocol) set by an external device. Therefore, the inspection information management unit 207 may be referred to as an acquisition unit that acquires the imaging site information of the shooting protocol. In addition, when distinguishing from the optical image acquisition unit 203, which is the first acquisition unit for acquiring an optical image, when the inspection information management unit 207 is referred to as an acquisition unit, it is referred to as the second acquisition unit.

[0045] The optical image acquisition unit 203 acquires an optical image from the optical imaging device 40 and provides it to the image processing unit 202 and the optical image analysis unit 205. Hereinafter, the optical image acquisition unit may also be referred to as the first acquisition unit. The optical image is preferably a moving image, but may be a still image acquired sporadically. The image processing unit 202 performs image processing on the received optical image as necessary and provides it to the optical image display control unit 204 and the image storage unit 208.

[0046] The optical image analysis unit 205 makes a determination using the optical image acquired from the optical image acquisition unit 203 and the inspection information acquired from the inspection information management unit 207, specifically, the information of the imaging protocol, and more specifically, the imaging site information. Specifically, it analyzes the position, type, and posture of the human body part in the subject within the optical image, and determines whether it is consistent with the set content of the inspection information (the information of the imaging site of the imaging protocol). At that time, the consistency between the information related to the part of the subject obtained by analyzing the optical image and the information related to the imaging site of the imaging protocol from which the inspection information is obtained is determined based on the similarity between the two. Details of this will be described later. In the present embodiment, an inference processing unit 206 using machine learning is used for the determination by the optical image analysis unit 205, but the determination may be made by other methods. Therefore, hereinafter, the optical image analysis unit 205 may sometimes be simply referred to as the determination unit, and similarly, the inference processing unit 206 may sometimes be simply referred to as the estimation unit.

[0047] The optical image display control unit 204 performs display control regarding the image obtained by the optical imaging device 40. The optical image display control unit 204, for example, performs processing and information addition on the optical image, and provides it to the display control unit 209 as image information. The image information provided to the display control unit 209 is used as a part of the information displayed on the graphical user interface of the imaging management application and is displayed on the display unit 25.

[0048] In FIG. 1, for the sake of simplicity of explanation, the control device 20 is described as one device, but the control device 20 may be composed of a plurality of devices. For example, the optical imaging control unit 214, the detection control unit 213, the generation control unit 212, and the display control unit 209 may each be an independent control device, or may be a combination of control devices selectively having a plurality of these functions.

[0049] [Display of Optical Image] Next, the display of the optical image will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the display of the optical image in the imaging management application.

[0050] In this embodiment, the state of the subject during radiography is imaged by the optical imaging device 40, and the obtained optical image is used for state monitoring.

[0051] At the start of the radiography examination, the screen 500 is displayed on the GUI of the imaging management application.

[0052] The screen 500 includes a radiography state 501, subject information 502, examination information 503, a radiation image display area 504, an optical image window 550, an optical image window display change button 506, and an examination end button 507.

[0053] The radiography state 501 is information indicating whether radiography can be started. In this embodiment, radiography is started with a radiography start button (not shown), but the radiography state 501 may also serve as the radiography start button. The subject information 502 is information indicating the information of the subject to be radiographed.

[0054] The examination information 503 is information such as the imaging content in the examination and the thumbnail (reduced image) of the radiation image acquired by the radiation image acquisition unit 201. The user can select one imaging content from the imaging contents listed in the examination information 503 and make preparations for the next imaging. In the screen 500, the imaging content of "Protocol-A" is in the selected state.

[0055] The radiation image display area 504 is an area for displaying the radiation imaging image acquired by the radiation image acquisition unit 201 in the examination. Since it has not been imaged at the stage of displaying the screen 500, it is a blank area where no radiation image is arranged. Information such as the imaging date and time related to the radiation imaging may be superimposed and displayed as a character string in a free arrangement at the four corners of the radiation image display area 504.

[0056] The optical image window display change button 506 is a selection object that can manually change the display / non-display of the optical image window 550 by pressing it.

[0057] The inspection end button 507 is a selectable object that can end the inspection when pressed.

[0058] In the optical image window 550, an optical image acquired by the optical image acquisition unit 203, a display of an analysis result by the optical image analysis unit 205, control buttons for the optical image, etc. are displayed. In the optical image window 550, analysis for "Protocol-A", which is the currently selected imaging content, is performed. The optical image window 550 is displayed so as to overlap the radiation image display area 504.

[0059] The optical image window 550 includes an optical image display area 551, camera information 552, an icon 553 indicating that optical image analysis is in progress, an optical image display change button 554, an optical image rotation button 555, and an optical image analysis result 556.

[0060] In the optical image display area 551, the optical image acquired by the optical image acquisition unit 203 is displayed. In FIG. 5, no image processing is performed on the optical image, but image processing may be performed for better visibility by the user.

[0061] In the camera information 552, information on the optical imaging device 40 is displayed.

[0062] The icon 553 indicating that optical image analysis is in progress is information indicating whether image analysis is being performed by the optical image analysis unit 205. For example, when the optical image analysis process is being executed, by displaying the icon 553, the user is visually notified that the optical image analysis is in progress. When the optical image analysis process is not being executed, the icon 553 may be hidden or grayed out.

[0063] The optical image display change button 554 is a selectable object that can manually change the display / non-display of the optical image in the optical image display area 551.

[0064] The optical image rotation button 555 is a selectable object that can rotate and display the optical image in the optical image display area 551. In this embodiment, only left rotation is available, but right rotation may be added, or the rotation angle may be selectable.

[0065] The optical image analysis result 556 is a message area (notification area) that displays the image analysis result performed by the optical image analysis unit 205.

[0066] [Notification of Analysis Results] Next, the notification of the analysis results will be described in detail with reference to FIGS. 6(a) and 6(b). FIG. 6(a) is a diagram showing a first example of the notification of the analysis results in the imaging management application. FIG. 6(b) is a diagram showing a second example of the notification of the analysis results in the imaging management application.

[0067] When the analysis of the optical image is performed, first, in the screen state 10600 of the optical image window 550 described above, the optical image analysis target detection frame 10601 is displayed. The optical image analysis target detection frame 10601 is a frame indicating that a single human body has been detected and its detection area in the optical image analysis unit 205. For example, in the optical image analysis unit 205, when no human body is detected, the optical image analysis target detection frame 10601 is not displayed, and when a human body is detected, the optical image analysis target detection frame 10601 is displayed. Thereby, the human body detection result of the optical image analysis and its area can be visually notified to the user. When a human body is detected in an abnormal position, an emphasized optical image analysis target detection frame 10651 may be displayed as shown in the screen state 10650 of the optical image window 550 described above. That is, the display method of the optical image analysis target detection frame may be changed according to the detection state of the human body.

[0068] Also, in the screen state 10600, a notification 10602 is notified as the optical image analysis result 556. The notification 10602 is a notification when a human body is detected normally corresponding to the inspection information. As the notification 10602, a notification saying "It is a normal position" and information on "front of the chest", which is the current imaging content, are displayed. By this notification, it is possible to grasp that the human body is in a normal position with respect to the scheduled imaging content.

[0069] On the other hand, in the screen state 10605, a notification 10652 is notified as the optical image analysis result 556. The notification 10652 is a notification when a human body is detected at an abnormal position corresponding to the inspection information. As the notification 10652, a notification saying "Check the imaging site!" and information on "front of the chest", which is the current imaging content, are displayed. By this notification, it is possible to grasp that the human body is in an abnormal position with respect to the scheduled imaging content.

[0070] [Inspection process] Next, the inspection process will be described with reference to FIG. 7. FIG. 7 is a diagram shown as a flowchart of the inspection process. The control corresponding to this flowchart is executed in the control device 20. Specifically, the CPU 301 provided in the control device 20 expands the program 3031 stored in the ROM 303 or the like into the RAM 302 and acts as the corresponding function to realize it.

[0071] In S10701, the inspection information management unit 207 causes the user to select one of the plurality of inspection information acquired from the operation unit 26 and sets it as the inspection target. Such processing is realized, for example, by displaying the acquired plurality of inspection information in a list format and setting the selected inspection information as the inspection target in response to an operation input of the user who selects one inspection information from the list. Note that the user may directly input inspection information from the operation unit 26.

[0072] In S10702, the control device 20 starts the inspection by transmitting a signal for causing the radiation detection device 10 to transition to a ready state in accordance with the set inspection information. In response to this signal, for example, the radiation detection device 10 controls a bias power supply by a main control circuit and applies a bias voltage to a two-dimensional imaging element. Thereafter, in order to read out the dark current signal accumulated in the pixels, an initialization is performed to read out an image signal from the pixel array by a drive circuit. After the completion of the initialization, the radiation detection device 10 transmits state information indicating that it is in a state ready to obtain a radiation image to the control device 20. Further, the control device 20 (inspection information management unit 207) sets operation parameters (such as tube voltage) of the radiation generator 30 based on the inspection information selected in S10701. When the control device 20 receives a notification that the imaging preparation is complete based on the state information from the radiation detection device 10, it notifies the radiation generator 30 of exposure permission.

[0073] In S10703, the optical image acquisition unit 203 acquires an optical image captured by the optical imaging device 40.

[0074] In S10704, the optical image analysis unit 205 analyzes the optical image using the optical image acquired from the optical image acquisition unit 203 and the inspection information acquired from the inspection information management unit 207. For the analysis of the optical image, for example, an inference process using machine learning may be performed by an inference process unit 206 (see FIG. 2). As the image input to the optical image analysis unit 205, all the images acquired by the optical image acquisition unit 203 may be used, or the images used may be thinned out according to the analysis content and input to the optical image analysis unit 205. Details of S10704 will be described later.

[0075] In S10705, the control device 20 acquires the result of the determination made in S10704 and acquires information on a detection state notification corresponding thereto. Examples of the correspondence between the determination result and the detection state notification are as shown in table 10900 of FIG. 9. FIG. 9 is a diagram showing the correspondence between the determination result by image analysis and the detection result notification.

[0076] In S10706, the optical image display control unit 204 controls the display content using the optical image acquired by the optical image acquisition unit 203 and the analysis result of the optical image analysis unit 205, and provides it to the display control unit 209. As a result, the controlled display content is displayed on the display unit 25. In the optical image display control unit 204, the display of each of the optical image and the analysis result is optional, and it may be controlled according to the settings of the control device 20 or the settings of the inspection information management unit 207. For example, when optical image analysis is not performed, only the optical image may be displayed on the display unit 25.

[0077] [Optical Image Analysis Process] Next, with reference to FIG. 8, the analysis process of the optical image by the optical image analysis unit 205 (the process of S10704) will be described. FIG. 8 is a diagram showing a flowchart of the optical image analysis process. The control corresponding to this flowchart is executed in the control device 20. Specifically, the CPU 301 provided in the control device 20 expands the program 3031 stored in the ROM 303 or the like into the RAM 302 and acts as the corresponding function to realize it. The order of each step may be in any order. Also, the process of any step may not be included. Also, the storage process of the display information may not be present.

[0078] In S10801, the optical image analysis unit 205 determines whether the inspection information acquired by the inspection information management unit 207 is an inspection to be determined for optical image analysis. For example, in optical image analysis, in order to analyze whether the optical image conforms to the content of the specified inspection, if the inspection information does not contain sufficient information, it is determined as not being the target. Specifically, in the case of analysis for the purpose of part determination, when the part is not specified in the inspection information, or when a part that the optical image analysis unit 205 cannot analyze is specified, etc. If it is determined as not being the target, it transitions to the determination result of "not being the target" in S10808.

[0079] In S10802, display information is stored in the determination result so as to display an icon indicating that it is an inspection to be determined for optical image analysis during consistency determination execution.

[0080] In S10803, the optical image analysis unit 205 determines whether the optical image acquired from the optical image acquisition unit 203 contains a subject to be analyzed. As a method for detecting the subject, an image recognition method using machine learning may be used. At this time, if not only the body of the patient who is the imaging target but also the body of a person other than the patient, such as a radiological technologist who performs imaging preparation, is included in the optical image, it may be determined as undetectable on the grounds that an appropriate subject has not been detected. When it is determined as undetectable, the process transitions to the determination result of "body not detected" in S10809.

[0081] In S10804, display information is stored in the determination result so as to display an icon indicating that the inspection is the determination target inspection of the optical image analysis during the consistency determination execution.

[0082] In S10805, the optical image analysis unit 205 determines whether the part of the inspection information acquired by the inspection information management unit 207 matches the part that is the analysis result of the optical image acquired from the optical image acquisition unit 203. The conditions for determining that the parts match include cases where, in addition to the two being exactly the same, one part is included in the similar part group of the other part. The similar part group refers to a part group set in advance for each part from the perspectives of anatomy, human geometry, or system operation. For example, the part group of the arm includes the upper arm, elbow, and hand, and the part group of the hand includes the palm and fingers. Based on this part group information, the optical image analysis unit 205 determines the consistency of the parts. Therefore, if the imaging part information obtained from the inspection information management unit 207 is the arm and the information regarding the part of the analysis result of the optical image obtained from the optical image acquisition unit 203 is the elbow, since the two are in a relationship of similar parts, it is determined that they match, and the result is notified by the display unit 205 (see FIG. 9). In the case of this example, the information regarding the part of the analysis result of the optical image (elbow) is included in the imaging part information (arm) obtained from the inspection information management unit 207, and since the two are similar, it is determined that they match. Also, when there are parts with the same name but different, the optical image analysis unit 205 may target all similar part groups of these parts with the same name for determination. For example, if the imaging part information obtained from the inspection information management unit 207 is the finger and the information regarding the part of the analysis result of the optical image obtained from the optical image acquisition unit 203 is the thumb of the hand (i.e., the group of the arm), the determination of consistency may be made by targeting both the group of toes and the group of fingers of the hand. Thus, for example, when there are multiple imaging part information in the imaging protocol as parts with the same name (in this example, the finger), it is advisable to consider the similarity for all parts with the same name (in this example, all toes and fingers) and determine the consistency with the part information of the image analysis result. Also, the similar part groups set for the similar parts included in the similar part group may be further added as targets for determination. However, in this case, it is desirable to set an upper limit in advance for the number of repetitions to prevent a significant deviation from the original part. When the optical image analysis unit 205 determines that the two match because one part of the part of the inspection information and the part that is the analysis result of the optical image is included in the similar part group of the other part, it retains that information.The method for analyzing the part may use an image recognition method using machine learning. When the analysis result is determined to be inconsistent, the process transitions to the determination result that the part in S10810 is inconsistent. When the determination cannot be made as either consistent or inconsistent and the determination becomes impossible, the process transitions to the determination result of impossible determination in S10813. In this way, the optical image analysis unit 205 determines the consistency between the information related to the part estimated by the inference processing unit 206, which is an estimation unit, and the imaging part information acquired by the inspection information management unit 207, which is a second acquisition unit, based on similarity. That is, when the information related to the part estimated by analyzing the optical image matches the imaging part information of the imaging protocol, it can be said that the similarity between the two has reached the upper limit. Therefore, this can also be paraphrased as determining the consistency between the information related to the part estimated by analyzing the optical image and the imaging part information of the imaging protocol, taking into account the similarity between the two.

[0083] Furthermore, in S10806, the optical image analysis unit 205 determines whether the direction of the inspection information acquired by the inspection information management unit 207 is consistent with the direction that is the analysis result of the optical image acquired from the optical image acquisition unit 203. Depending on the inspection information, the determination may not be necessary. Also, in S10805, if it has been determined to be consistent using similar parts, the determination may not be necessary. The method for analyzing the direction may use an image recognition method using machine learning. When the analysis result is determined to be inconsistent, the process transitions to the determination result that the direction in S10811 is inconsistent. When the determination cannot be made as either consistent or inconsistent and the determination becomes impossible, the process transitions to the determination result of impossible determination in S10813.

[0084] In S10807, the optical image analysis unit 205 determines whether the laterality of the inspection information acquired by the inspection information management unit 207 matches the laterality of the analysis result of the optical image acquired from the optical image acquisition unit 203. Here, laterality refers to lateral information, which is called Laterality in English. While the site information is, for example, the hand, foot, or chest, the lateral information is four types of information: left, right, both left and right, and no lateral information. In order, taking the initials of Left, Right, Both, and Unpaired, they are often abbreviated as L, R, B, and U. Note that in the determination, depending on the inspection information, the determination may not be necessary. Also, in S10805, if it has been determined that they match using similar sites, the determination may not be necessary. As a method for analyzing laterality, an image recognition method using machine learning may be used. If the analysis result is determined to be inconsistent, it transitions to the determination result of "laterality is inconsistent" in S10812. If the determination cannot be made and it becomes undecidable, it transitions to the determination result of "undecidable" in S10813. If they match, it transitions to the determination result of "match" in S10814.

[0085] S10808 to S10814 indicate the state of the determination result of the optical image analysis unit 205. Based on each determination result and whether it has been determined in S10805 that they match using similar sites, the optical image display control unit 204 can control the display content of the optical image window 550. Specifically, the notification content can be controlled as shown in Table 10900 of FIG. 9.

[0086] Note that the notification based on the optical image analysis result 556 is not limited to a message in text. In addition to text, notifications may be made using figures, symbols, colors, etc. so that each analysis result can be distinguished.

[0087] [Effect] As described in the above embodiments, by determining and notifying the consistency between the specified shooting technique and the actual positioning of the subject, the user can be made aware in advance of the possibility of shooting damage. Therefore, it is possible to suppress the occurrence of shooting damage and improve the efficiency of the workflow.

[0088] (Other embodiments) The present invention is not limited to the above embodiments, and various modifications (including organic combinations of each embodiment) are possible based on the gist of the present invention, and they are not excluded from the scope of the present invention. That is, all configurations combining each of the above-described embodiments and their modified examples are also included in the present invention.

[0089] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0090] The processor or circuit may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a field programmable gateway (FPGA). The processor or circuit may also include a digital signal processor (DSP), a data flow processor (DFP), or a neural processing unit (NPU).

[0091] The radiation imaging system in each of the above embodiments may be realized as a single device, or may be in a form in which a plurality of devices are combined so as to be communicable with each other to execute the above-described processing, and both are included in the embodiments of the present invention. It may also be possible to execute the above-described processing using a common server device or a server group. The plurality of devices constituting the radiation imaging system only need to be able to communicate at a predetermined communication rate, and do not need to be present within the same facility or the same country.

[0092] The embodiments include a form in which a software program that realizes the functions of the above-described embodiments is supplied to a system or device, and the computer of the system or device reads and executes the code of the supplied program.

[0093] Therefore, in order to implement the processes according to the embodiments on a computer, the program code itself installed on the computer is also one of the embodiments of the present invention. Further, based on the instructions included in the program read by the computer, an operating system (OS) or the like running on the computer performs part or all of the actual processes, and the functions of the above-described embodiments can also be realized by such processes.

[0094] The disclosure of this specification includes the following radiation imaging control apparatus and radiation imaging system.

[0095] (Item 1) A first acquisition unit that acquires an optical image related to a subject; An estimation unit that estimates information related to a part of the subject from the optical image; A second acquisition unit that acquires imaging part information of an imaging protocol related to the subject; A determination unit that determines the consistency between the information related to the part estimated by the estimation unit and the imaging part information acquired by the second acquisition unit based on similarity. A radiation imaging control apparatus characterized by comprising the same.

[0096] (Item 2) The radiation imaging control apparatus according to Item 1, wherein the determination unit determines that the two are consistent when one of the information related to the part and the imaging part information is included in the other.

[0097] (Item 3) The radiation imaging control apparatus according to Item 1 or 2, wherein when there are a plurality of the information related to the part and the imaging part information as parts with the same name, the determination unit determines the consistency based on similarity for all of the parts with the same name for the other of the information related to the part and the imaging part information.

[0098] (Item 4) The radiation imaging control apparatus according to any one of Items 1 to 3, wherein the information related to the part is information on the direction of the part.

[0099] (Item 5) The radiation imaging control device according to any one of Items 1 to 4, characterized in that the information related to the site is the side information of the site.

[0100] (Item 6) A radiation imaging system comprising a radiation detection device that generates a radiation image by receiving radiation irradiation, and the radiation imaging control device according to any one of Items 1 to 5.

[0101] (Item 7) The radiation imaging system according to Item 6, further comprising a notification means for notifying the determination result of the determination unit.

[0102] (Item 8) The radiation imaging system according to Item 7, characterized in that the notification means changes the notification content according to the similarity between the information related to the site and the imaging site information.

Explanation of Signs

[0103] 20 Control device 203 Optical image acquisition unit 204 Optical image display control unit 205 Optical image analysis unit 206 Inference processing unit 207 Inspection information management unit 209 Display control unit 10 Radiation detection device 40 Optical imaging device 25 Display unit

Claims

1. A first acquisition unit that acquires an optical image related to a subject; An estimation unit that estimates information related to a part of the subject from the optical image; A second acquisition unit that acquires imaging part information of an imaging protocol related to the subject; A radiation imaging control device, comprising: a determination unit that determines the consistency between the information related to the part estimated by the estimation unit and the imaging part information acquired by the second acquisition unit based on similarity.

2. The radiation imaging control device according to claim 1, wherein the determination unit determines that the two are consistent when one of the information related to the part and the imaging part information is included in the other.

3. The radiation imaging control device according to claim 1, wherein when there are a plurality of the information related to the part and the imaging part information as parts with the same name, the determination unit determines the consistency based on similarity for all parts with the same name for the other of the information related to the part and the imaging part information.

4. The radiation imaging control device according to claim 1, wherein the information related to the part is information on the direction of the part.

5. The radiation imaging control device according to claim 1, wherein the information related to the part is information on the side of the part.

6. A radiation imaging system, comprising: a radiation detection device that generates a radiation image by receiving radiation irradiation; and the radiation imaging control device according to claim 1.

7. The radiation imaging system according to claim 6, further comprising a notification unit that notifies the determination result of the determination unit.

8. The radiation imaging system according to claim 7, wherein the notification unit changes the notification content according to the similarity between the information related to the part and the imaging part information.

Images