Radiation imaging system, information processing device, and control method and program thereof

Abstract

To provide a radiation imaging system capable of appropriately outputting information obtained on the basis of an optical imaging device in accordance with a radiation imaging process.SOLUTION: In a radiation imaging system having an optical imaging device that optically images a subject for radiation imaging, and an information processing device capable of viewing information related to radiation imaging using the radiation imaging device on a display unit, the information processing device controls the display of the optical image obtained from the optical imaging device in accordance with the progress of a predetermined process among multiple processes for performing the radiation imaging.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a radiation imaging system using optical images. The radiation imaging system includes an information processing device that displays information related to radiation imaging using a radiation imaging device, and software executed by the information processing device. The radiation imaging device is, for example, a Flat Panel Detector (FPD). The information processing device is, for example, a PC. The software is, for example, an imaging management application. [Background technology]

[0002] Radiation imaging devices using flat panel detectors (FPDs) made of semiconductor materials are widely used as imaging devices for use in medical image diagnosis and non-destructive testing using radiation. In medical image diagnosis, such radiation imaging devices are used as digital imaging devices for taking still images such as general radiography and for taking moving images such as fluoroscopy.

[0003] In radiography, the subject is aligned as a preliminary step in imaging, but there have been confirmed cases where imaging failure occurs due to improper alignment. Recently, as a configuration to assist in this alignment, a radiography system (radiography system) equipped with an optical camera (optical imaging device) capable of checking the condition of the subject has been proposed.

[0004] Patent Document 1 describes a means for guiding the positioning of a subject suitable for radiography using a subject image acquired by an optical imaging device during radiography. Patent Document 2 also describes a means for analyzing an image acquired from an optical imaging device and displaying the analysis results on a screen for radiography to notify the user. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2013-48740 A [Patent Document 2] JP 2020-199163 A Summary of the Invention [Problem to be solved by the invention]

[0006] There is room for improvement in terms of operability in the systems of Patent Documents 1 and 2. As described above, it is desirable that the images acquired from the optical imaging device or information based thereon be output with content and timing appropriate for the radiation imaging process.

[0007] The present invention has been made in consideration of the above-mentioned problems, and its object is to provide a radiation imaging system that can appropriately output information obtained based on an optical imaging device in accordance with the radiation imaging process. [Means for solving the problem]

[0008] In order to solve the above problems, in a radiation imaging system having an optical imaging device that optically images a subject for radiation imaging, and an information processing device that allows information related to radiation imaging using the radiation imaging device to be viewed on a display unit, the information processing device is characterized in that it controls the display of an optical image obtained from the optical imaging device in accordance with the progress of a predetermined process among a plurality of processes for performing the radiation imaging. Effect of the Invention

[0009] According to the present invention, it is possible to provide a radiation imaging system capable of appropriately outputting information obtained based on an optical imaging device in accordance with the radiation imaging process. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a radiation imaging system. [Diagram 2] FIG. 2 is a diagram showing functional blocks of a control device. [Diagram 3]FIG. 2 is a diagram illustrating a hardware configuration of a control device. [Figure 4] FIG. 1 is a diagram showing a usage sequence of the camera linkage system. [Diagram 5] 13A and 13B are diagrams illustrating an example of a display of an optical image in an imaging management application. [Figure 6] FIG. 13 is a diagram showing an example of a display screen immediately after radiation imaging in the imaging management application. [Figure 7] FIG. 13 is a diagram showing an example of a display screen in an imaging management application during imaging standby; [Figure 8] FIG. 13 is a flowchart showing an optical image display process. [Figure 9] 13A and 13B are diagrams illustrating an example of a display of an optical image in an imaging management application. [Figure 10] 13A and 13B are diagrams illustrating an example of a display of an optical image in an imaging management application. [Figure 11] FIG. 13 is a flowchart showing an optical image display process. [Figure 12] Fig. 12(a) is a diagram showing a state where the optical image display is turned off, and Fig. 12(b) is a diagram showing a state where the optical image is subjected to image processing. [Figure 13] FIG. 13 is a flowchart showing an optical image display process. [Figure 14] Fig. 14(a) is a diagram showing a first example of a notification of an analysis result in an imaging management application, and Fig. 14(b) is a diagram showing a second example of a notification of an analysis result in an imaging management application. [Figure 15] FIG. 13 is a flowchart showing an inspection process. [Figure 16] FIG. 13 is a flowchart showing an optical image analysis process. [Figure 17] 11A and 11B are diagrams showing the correspondence between a determination result by image analysis and a notification of a detection result. [Figure 18] FIG. 11 is a diagram showing a second display example of an optical image in the imaging management application. [Figure 19] FIG. 13 is a diagram showing a setting screen for a shooting method in the imaging management application. [Figure 20]Fig. 20(a) is a diagram showing a table for the photographing information management method (a). Fig. 20(b) is a diagram showing a table for the photographing information management method (b). Fig. 20(c) is a diagram showing a table for the photographing information management method (c). Fig. 20(d) is a diagram showing a table for the photographing information management method (d). Fig. 20(e) is a diagram showing a table for the photographing information management method (e). [Figure 21] FIG. 13 is a flowchart showing a photographing information management method (a). [Figure 22] FIG. 13 is a flowchart showing the photographing information management method (b). [Diagram 23] FIG. 13 is a flowchart showing the photographing information management method (c). [Figure 24] FIG. 13 is a flowchart showing the photographing information management method (d). [Diagram 25] FIG. 13 is a flowchart showing the photographing information management method (e). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. The invention according to the claims is not limited to the configurations described in the embodiments. As long as the same effects are obtained, some of the configurations or processes may be replaced with equivalents or omitted.

[0012] (First embodiment) [Radiation imaging system] A radiation imaging system 1, which is an environment in which a radiation detection device 10 (radiography device, radiation imaging device) is used, will be described. Fig. 1 is a diagram showing a schematic configuration of the radiation imaging system. The radiation imaging system 1 includes a radiation detection device 10 (10A, 10B), a control device 20, a radiation generation device 30 (30A, 30B), an optical imaging device 40 (40A, 40B), a display unit 25, an operation unit 26, a RIS 55, a PACS 56, and an HIS 57.

[0013] The control device 20 is an information processing device that relays the radiation detection device 10, the radiation generation device 30, and each device that can be connected via the network 50, and performs various controls. The control device 20 will be described in detail later.

[0014] The radiation generating device 30 (radiation irradiation device) is equipped with a radiation tube that generates radiation, and irradiates a subject such as a patient with radiation. Here, radiation includes not only X-rays, but also α-rays, β-rays, γ-rays, particle rays, cosmic rays, and the like. The radiation generating device 30A and the radiation generating device 30B are selected and used appropriately depending on the contents of the imaging. Unless otherwise specified, these will be collectively referred to as the radiation generating device 30.

[0015] The radiation detection device 10 (radiography device, radiation imaging device) is a device that generates an image based on radiation irradiated from a radiation generation device 30. The radiation detection device 10 is, for example, a flat panel detector. The radiation detection device 10A and the radiation detection device 10B are selected and used appropriately depending on the contents of the imaging. Unless otherwise specified, these will be collectively referred to as the radiation detection device 10.

[0016] The radiation detection device 10 detects radiation that is irradiated from the radiation generation device 30 and passes through a subject (subject), and outputs image data corresponding to the radiation. The image data can also be called a medical image or a radiological image. Specifically, the radiation detection device 10 detects the radiation that has passed through the subject as an electric charge corresponding to the amount of transmitted radiation. For example, the radiation detection device 10 uses a direct conversion sensor that directly converts radiation, such as a-Se, into electric charges, or an indirect sensor that uses a scintillator, such as CsI, that converts radiation into visible light, and a photoelectric conversion element, such as a-Si. Furthermore, the radiation detection device 10 generates image data by A / D converting the detected electric charges, and outputs the image data to the control device 20.

[0017] The optical imaging device 40 is a camera device for capturing images of the condition of the subject undergoing radiation imaging. The optical imaging device 40A and the optical imaging device 40B are selected and used appropriately depending on the content of the imaging. Unless otherwise specified, these are collectively referred to as the optical imaging device 40.

[0018] The display unit 25 is a display device that includes a monitor such as a liquid crystal display and is capable of displaying information. The operation unit 26 is an input device that includes a keyboard, a pointing device (such as a mouse), a touch panel, and the like.

[0019] The RIS 55, PACS 56, and HIS 57 are services that cooperate with the control device 20 via a network and expand various functions related to radiography. The control device 20 is also connected to the RIS 55, PACS 56, and HIS 57 via a network 50, and can exchange radiographic images, patient information, and the like. Although FIG. 1 shows the radiography system 1 as including the RIS 55, PACS 56, and HIS 57, the system may not include at least some of these. Here, RIS is an abbreviation for Radiology Information Systems. PACS is an abbreviation for Picture Archiving and Communication Systems (image server). HIS is an abbreviation for Hospital Information Systems.

[0020] The control device 20 controls radiation imaging using the radiation detection device 10 and the radiation generation device 30 .

[0021] The radiation imaging apparatus of this embodiment is used, for example, in a sequence as shown in FIG. In step 401 (hereinafter, referred to as S401, etc.), a user (radiographer) who uses the radiation imaging system inputs examination information to the radiation imaging system 1. In S402, the radiation imaging system 1 starts preparation for radiation imaging. In S403, the radiation imaging system 1 monitors the subject by optical imaging as one of the processes during the period of preparation for radiation imaging. In S404, the user positions the radiation detection device 10 and the subject. In S405, the user checks the state of the subject displayed on the radiation imaging system 1. In S406, if the positional relationship between the radiation detection device 10 and the subject is not appropriate, the user adjusts the positions of the radiation detection device 10 and the subject. In S407, the user checks the state of the subject displayed on the radiation imaging system 1. In S408, the user confirms that the positional relationship between the radiation detection device 10 and the subject is appropriate, and issues an instruction to the radiation imaging system to perform radiation imaging. In S409, the radiation imaging system 1 performs radiation imaging.

[0022] [Control device] 3 is a diagram showing the configuration of the control device 20. The control device 20 has a CPU 301, a RAM 302, a ROM 303, an external memory 304, a communication I / F unit 305, and a bus 306. The CPU 301, the RAM 302, the ROM 303, the external memory 304, and the communication I / F unit 305 are connected via the bus 306 so as to be able to communicate with each other.

[0023] A CPU 301 (Central Processing Unit) generally controls the operation of the control device 20, and controls each component shown in FIG.

[0024] The RAM 302 (writable memory) functions as the main memory, work area, etc. of the CPU 301. When executing processing, the CPU 301 loads the necessary computer program 3031, data, etc. from the ROM 303 into the RAM 302, and executes the computer program 3031, etc. to realize various functional operations. The control device 20 has an application function that operates on a computer. In other words, the control device 20 has one or more processors and memories, and realizes each of the functional units described below by the processor executing a program stored in the memory. However, some or all of the functional units may be realized by dedicated hardware.

[0025] A ROM 303 (read only memory) stores a computer program 3031, data, etc., required for the CPU 301 to execute processing. The computer program 3031, data, etc. may be stored in an external memory 304.

[0026] The external memory 304 is a large-capacity storage device, and is realized by, for example, a hard disk device, an IC memory, etc. The external memory 304 stores, for example, various data and various information required when the CPU 301 executes the computer program 3031 and performs processing. The external memory 304 also stores, for example, various data and various information obtained when the CPU 301 executes the computer program 3031 and performs processing.

[0027] The communication I / F (interface) unit 305 is responsible for communication between the control device 20 and the outside. The control device 20 is connected to the radiation generation device 30, the radiation detection device 10, and the optical imaging device 40 via the communication I / F unit 305 through a wired or wireless network or a dedicated line.

[0028] The bus 306 is for connecting the CPU 301 to the RAM 302, the ROM 303, the external memory 304, and the communication I / F unit 305 so that they can communicate with each other.

[0029] FIG. 2 is a diagram illustrating functional blocks of the control device.

[0030] The imaging control unit 211 of the control device 20 controls the generation control unit 212, the detection control unit 213, and the optical imaging control unit 214 based on instructions from the operation control unit 210 and the examination information managed by the examination information management unit. The examination information includes information such as the dose, the irradiation time (ms), the tube current (mA), the tube voltage (kV), and the irradiation field which is the area where radiation is detected. This information is transmitted to the radiation detection device 10 via the imaging control unit 211 and the detection control unit 213.

[0031] The generation control unit 212 controls the timing at which the radiation generation device 30 generates radiation and the conditions for capturing radiation.

[0032] The generation control unit 212 outputs information such as an irradiation control signal to the radiation generation device 30 based on dose information and the like. The irradiation control signal transmitted from the generation control unit 212 to the radiation generation device 30 may include two signals: a stop signal (irradiation stop signal) for stopping irradiation of radiation, and an irradiation signal (non-irradiation stop signal) for irradiating radiation. The generation control unit 212 can control the start and stop of irradiation of radiation from the radiation generation device 30 by controlling the output of both the stop signal and the irradiation signal, or one of the signals.

[0033] The detection control unit 213 performs various controls for radiation imaging (radiography) by communicating with the radiation detection apparatus 10. For example, the detection control unit 213 executes various communication processes associated with radiation imaging with the radiation detection apparatus 10. In this communication process, setting information for imaging conditions, setting information for operation control, image information, information on reaching dose, and the like are exchanged.

[0034] The optical photography control unit 214 controls the start and end of photography by the optical photography device 40, the conditions for acquiring optical images, timing, frame rate, zoom, focus, and other functions.

[0035] The radiation image acquisition unit 201 receives image data from the radiation detection device 10. The image processing unit 202 performs image processing on the received image data as necessary, and provides the processed image data to a display control unit 209 and an image storage unit 208.

[0036] The display control unit 209 provides the display unit 25 with screen information of an imaging management application that enables viewing of radiography information. The graphical user interface of the imaging management application displayed on the display unit 25 is linked to operations on the operation unit 26. Therefore, information related to the imaging management application can be input via the operation unit 26. For example, when a plurality of pieces of examination information are displayed in a list format on the display unit 25, the operation unit 26 can perform an operation input to select one piece of examination information from the list. The selected examination information can be set as the examination target. Note that the user may directly input examination information from the operation unit 26. The examination information inputted in the imaging management application is managed by the examination information management unit 207.

[0037] The optical image acquisition unit 203 acquires optical images from the optical photographing device 40, and provides them to the image processing unit 202 and the optical image analysis unit 205. The optical image acquisition unit 203 can acquire optical images from either one or both of the optical photographing devices 40A and 40B. The optical images are preferably moving images, but may be still images acquired sporadically. The image processing unit 202 performs image processing on the received optical images as necessary, and provides them to the optical image display control unit 204 and the image storage unit 208. The optical images used for analysis may be optical images with a frame rate that is thinned out from the frame rate acquired by the optical photographing device 40.

[0038] The optical image analysis unit 205 performs a judgment using the optical image acquired from the optical image acquisition unit 203 and the examination information acquired from the examination information management unit 207. Specifically, the optical image analysis unit 205 analyzes the position, type, and posture of the human body part of the subject in the optical image, and judges whether or not it matches the setting contents of the examination information. In this embodiment, the optical image analysis unit 205 uses an inference processing unit 206 that uses machine learning for its judgment, but the judgment may be performed by other methods.

[0039] The optical image display control unit 204 performs display control regarding the image obtained by the optical photographing device 40. For example, the optical image display control unit 204 processes the optical image and adds information to it, and provides it to the display control unit 209 as image information. The image information provided to the display control unit 209 is used as part of the information displayed on the graphical user interface of the photographing management application, and is displayed on the display unit 25.

[0040] 1, for simplicity of explanation, the control device 20 is illustrated as one device, but the control device 20 may be composed of multiple devices. For example, the optical photography control unit 214, the detection control unit 213, the generation control unit 212, and the display control unit 209 may each be an independent control device, or may be a combination of control devices selectively having multiple functions among them.

[0041] [Optical image display] Next, the display of an optical image will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the display of an optical image in the imaging management application.

[0042] In this embodiment, the condition of the subject during radiation imaging is captured by the optical imaging device 40, and the obtained optical image is used to monitor the condition.

[0043] At the start of a radiography examination, a screen 500 is displayed on the GUI of the imaging management application.

[0044] The screen 500 includes a radiation imaging status 501 , subject information 502 , examination information 503 , a radiation image display area 504 , an optical image window 550 , an optical image window display change button 506 , and an examination end button 507 .

[0045] The radiation imaging status 501 is information indicating whether or not radiation imaging (imaging operation) can be started (suitable or unsuitable). In this embodiment, radiation imaging is started by pressing an imaging start button (not shown), but the radiation imaging status 501 may also function as the radiation imaging start button. The subject information 502 is information indicating information about the subject who is the subject of radiation imaging.

[0046] The examination information 503 is information such as the imaging contents in the examination and thumbnails (reduced images) of the radiation images acquired by the radiation image acquisition unit 201. The user can select one imaging content from the imaging contents listed in the examination information 503 and prepare for the next imaging. By selecting the imaging content, an instruction to prepare for imaging is issued to the radiation detection device 10. This progresses one of the multiple steps for performing radiation imaging. On the screen 500, the imaging content of "Protocol-A" is selected.

[0047] The radiation image display area 504 is an area for displaying a radiation image acquired by the radiation image acquisition unit 201 during the examination. At the stage when the screen 500 is displayed, no radiation image has been captured, so the area is blank and no radiation image is arranged. Information regarding the date and time of capture of the radiation may be displayed as a character string superimposed in any desired arrangement in the four corners of the radiation image display area 504.

[0048] An optical image window display change button 506 is a selection object that allows the user to manually change the display / non-display (ON / OFF) of the optical image window 505 by pressing it.

[0049] An end of examination button 507 is a selection object that can end the examination by pressing it.

[0050] The optical image window 550 displays the optical image acquired by the optical image acquisition unit 203, the analysis results by the optical image analysis unit 205, and control buttons for the optical image. Analysis for "Protocol-A", which is the selected shooting content, is performed in the optical image window 550. The optical image window 550 is displayed so as to be superimposed on the radiation image display area 504.

[0051] The optical image window 550 includes an optical image display area 551 , camera information 552 , an optical image analysis in progress icon 553 , an optical image display change button 554 , an optical image rotation button 555 , and an optical image analysis result 556 .

[0052] The optical image acquired by the optical image acquisition unit 203 is displayed in the optical image display area 551. Although no image processing is performed on the optical image in Fig. 5, image processing may be performed on the optical image so that it is easier for the user to view.

[0053] In the camera information 552, information on the optical photographing device 40 is displayed.

[0054] The optical image analysis in progress icon 553 is information indicating whether image analysis is being performed by the optical image analysis unit 205. For example, when optical image analysis processing is being performed, the icon 553 is displayed to visually notify the user that optical image analysis is being performed. When optical image analysis processing is not being performed, the icon 553 may be hidden or grayed out.

[0055] The optical image display change button 554 is a selection object that can manually change whether the optical image in the optical image display area 551 is displayed or hidden.

[0056] The optical image rotation button 555 is a selection object that can rotate and display the optical image in the optical image display area 551. In this embodiment, only left rotation is possible, but right rotation may also be added, or a format in which the rotation angle can be selected may also be used.

[0057] The optical image analysis result 556 is a message area (notification area) that displays the image analysis result (condition information of the subject) performed by the optical image analysis unit 205.

[0058] When the process progresses from the stage in Fig. 5, the screen transitions to that in Fig. 6. Fig. 6 is a diagram showing an example of a display screen immediately after radiation imaging in the imaging management application.

[0059] When radiography is performed, a screen 600 is displayed. On the screen 600, a radiographic image 690 is displayed in the radiographic image display area 504. Accordingly, the optical image window 550 that was superimposed on the radiographic image display area 504 becomes hidden. Also, the display information of the optical image window display change button 506 switches from "Camera ON" to "Camera OFF".

[0060] Although still image shooting is given as an example here, if the shooting content is fluoroscopic shooting (video shooting), it is recommended to display the screen in Fig. 6 even during shooting. This allows you to constantly check the fluoroscopic image.

[0061] When the process progresses from the stage of Fig. 6, the screen transitions to that of Fig. 7. Fig. 7 is a diagram showing an example of a display screen in the imaging management application when waiting for imaging.

[0062] When the next imaging content is selected in the examination information 503, the apparatus is again prepared to start the examination, and the screen 700 is displayed. The screen 700 shows a state in which "Protocol-B" has been selected. On the screen 700, an optical image window 750 is displayed so as to be superimposed on the radiographic image 650 on the radiographic image display area 504. In the optical image window 750, analysis for "Protocol-B" is performed.

[0063] [Screen display control] A flow from the start of the inspection to the end of the inspection will be described with reference to Fig. 8. Fig. 8 is a diagram showing a flowchart of optical image display. The control corresponding to this flowchart is executed in the control device 20. In detail, this is realized by the CPU 301 included in the control device 20 expanding a program 3031 stored in the ROM 303 or the like in the RAM 302 and acting as a corresponding function.

[0064] In step S801, the control device 20 measures the elapsed time from when the imaging content is selected in the imaging management application. After a certain time has elapsed, the process proceeds to S802. The certain time shown here may be changed between the first imaging and the second and subsequent imaging in the examination. It is advisable to set a time that is more suitable for the workflow, such as setting a time for checking patient information in the first imaging and a time for checking radiation images in the second and subsequent imaging.

[0065] In S802, the optical image acquisition unit 203 acquires an optical image captured by the optical imaging device 40. Then, the optical image display control unit 204 provides image information to the display control unit 209, thereby causing the optical image to be displayed on the display unit 25. As a result, a screen such as screen 500 is displayed.

[0066] In S803, the control device 20 checks whether radiation imaging has started. The control device 20 waits until radiation imaging has started (NO), and when radiation imaging has started (YES), the process proceeds to S804. The start of radiation imaging refers to, for example, the radiation detection device 10 starting a radiation accumulation operation. The start may be defined as the radiation generation device 30 starting to irradiate radiation to the radiation detection device 10, the control device 20 starting to receive an image from the radiation detection device 10, the control device 20 completing preparation of an image to be displayed on the display unit 25, etc.

[0067] In S804, the display control unit 209 automatically hides the optical image being displayed on the display unit 25, and displays a screen such as that shown in screen 600.

[0068] In S805, the image storage unit 208 stores the optical image. When storing the optical image, the image storage unit 208 stores the optical image in association with the radiation image acquired by the radiation image acquisition unit 201 and the examination information managed by the examination information management unit 207.

[0069] The above steps complete the radiation photography of the subject, and the next photography will proceed. If the examination involves multiple photography, the next photography content is selected and a screen for the next photography content is displayed, as in screen 700. This process is repeated the number of times that the number of photography contents registered is the same.

[0070] [effect] As described above in the first embodiment, the optical image can be displayed when the user wants to check it, and hidden when the user wants to check other displays such as the radiographic image, thereby enabling a display suitable for the workflow. Furthermore, by displaying the optical image in a size smaller than the radiographic image, the information to be checked, such as additional information at the four corners of the radiographic image, is not hidden by superimposition, and a display suitable for the workflow can be achieved. Furthermore, even if contents that are not checked in the normal workflow are hidden, the display can be switched between display and non-display later, making it possible to adapt to flows that are not normal workflows. Furthermore, by saving the optical image at the start of imaging and saving it in association with the radiographic image and examination information, the state of the imaging can be kept as a record.

[0071] Second Embodiment In the first embodiment, an example was shown in which the optical image window 550 was superimposed on a portion of the radiation image display area 504. In contrast, the second embodiment is characterized in that the entire radiation image display area 504 is used as the optical image window 550. The configuration for realizing the second embodiment is similar to that of the first embodiment, except for the portions related to the above-mentioned characteristic portions. Therefore, similar configurations are described with the same reference numerals, and detailed description thereof will be omitted.

[0072] [Optical image display] Display of an optical image will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of display of an optical image in the imaging management application.

[0073] In this embodiment, the condition of the subject during radiation imaging is captured by the optical imaging device 40, and the obtained optical image is used to monitor the condition.

[0074] At the start of a radiography examination, a screen 900 is displayed on the GUI of the imaging management application. Screen 900 differs from screen 500 in that an optical image window 950 corresponding to optical image window 550 extends over the entire radiographic image display area 504. By making the window larger, the optical image is easier to see, making it easier to check the imaging status.

[0075] During and immediately after radiation imaging, a screen 1000 is displayed on the GUI of the imaging management application. The screen 1000 differs from the screen 600 in that an optical image window 1050 is displayed outside the area (outside) of the radiation image display area 504. By displaying in this manner, it is possible to monitor the condition of the subject using the optical image while checking the radiation image during and immediately after radiation imaging.

[0076] [Screen display control] A flow from the start of the inspection to the end of the inspection will be described with reference to Fig. 11. Fig. 11 is a diagram showing a flowchart of optical image display. The control corresponding to this flowchart is executed in the control device 20. In detail, this is realized by the CPU 301 included in the control device 20 expanding a program 3031 stored in the ROM 303 or the like in the RAM 302 and acting as a corresponding function.

[0077] In S601, the control device 20 measures the time that has elapsed since the previous process. After a certain period of time has elapsed, the process proceeds to S602.

[0078] In S602, the control device 20 displays an optical image in the radiation image display area 504.

[0079] In S603, the control device 20 checks whether radiation imaging has started. If radiation imaging has started, the process proceeds to S604.

[0080] In S604, the control device 20 displays the optical image outside the radiation image display area 504.

[0081] In S605, the control device 20 checks whether the test has been completed. If the test has not been completed, the process proceeds to S601. If the test has been completed, the process proceeds to S606.

[0082] In S606, the control device 20 stops displaying the optical image and ends the inspection.

[0083] According to this flow, the optical image is displayed from the start of the examination until the end of the examination. The fixed time in S601 may be changed between the first imaging and the second imaging or later in the examination, as in the first embodiment. The fixed time in S601 may be set to 0 seconds. As shown in the display example in FIG. 10, the optical image window 1050 is displayed outside the area (outside) of the radiation image display area 504, so that the radiation image can be visually confirmed. Furthermore, since the subject information can be confirmed by the character strings in the four corners of the radiation image display area 504, the subject information 502 may be hidden even when the examination starts and the subject is confirmed. Furthermore, since the operator is not prevented from confirming the radiation image after radiation imaging, the display state can be continued even after radiation imaging.

[0084] [effect] As described above in the second embodiment, by switching the display position, size, and so on of the optical image depending on the process, it is possible to achieve output more suited to the workflow.

[0085] (Third embodiment) In the first and second embodiments, the image captured by the optical imaging device 40 itself is displayed as the optical image. The third embodiment is characterized in that image processing is performed on the optical image to be displayed. The configuration for realizing the third embodiment is similar to that of the first embodiment, except for the parts related to the above-mentioned characteristic parts. Therefore, similar configurations are described with the same reference numerals, and detailed description thereof is omitted.

[0086] [Optical image display] The display of the optical image will be described with reference to Fig. 12(b), which shows the state of the optical image after image processing.

[0087] An image 1251 that has been subjected to mosaic processing (image processing) is displayed as the optical image in the optical image window 1250. This image processing is performed by the image processing unit 202.

[0088] In the image 1251, mosaic processing is performed as processing of the optical image, but the image may be processed based on the optical image by using shapes such as curves and rectangles to make it impossible to distinguish the subject. Alternatively, the processing target may be limited to areas related to privacy, or may be processed by cutting out the image or masking. Also, the image may be replaced with an image of the same color all over, without being based on the optical image. Alternatively, as shown in FIG. 12(a), the optical image 1201 in the optical image window 1200 may be hidden. FIG. 12(a) is a diagram showing a state in which the optical image display is turned off. When the optical image 1201 is turned off, the optical image display change button 1202 switches from "ON" to "OFF". Even if the optical image 1201 is not displayed, the optical image is analyzed and the result is notified, so the user can understand the situation.

[0089] [Screen display control] A detailed flow of the optical image display process (S802, S1102) will be described with reference to Fig. 13. Fig. 13 is a diagram showing a flowchart of the optical image display. The control corresponding to this flowchart is executed in the control device 20. In detail, this is realized by the CPU 301 included in the control device 20 expanding the program 3031 stored in the ROM 303 or the like in the RAM 302 and acting as a corresponding function.

[0090] In S1101, the control device 20 acquires an optical image for privacy determination, and advances the process to S1102.

[0091] In S1102, the control device 20 analyzes the optical image, and advances the process to S1103.

[0092] In S1103, the control device 20 judges whether the actual photography is photography related to privacy. For example, it judges that it is photography with light clothing or undressed, or photography is performed with the part of the subject to be photographed being a hip joint or the like, and private parts (genitals, pubic area) may be reflected in the optical image. If it is photography related to privacy (YES), proceed to S1104, and if not, proceed to S1105 (NO).

[0093] In S1104, the control device 20 processes the optical image for privacy reasons.

[0094] In S1105, the control device 20 determines an optical image to be displayed. If S1104 has been executed, the processed optical image is determined. The image determined here becomes the image to be displayed in the optical image display process (S802, S1102).

[0095] In the present embodiment, the analysis result of the optical image is used for the privacy judgment, but other information may be used for the privacy judgment. For example, it may be determined whether or not optical photography related to privacy is performed based on examination information (photography content) input in advance by the user.

[0096] [effect] As described above in the third embodiment, by taking measures regarding privacy, it becomes possible to provide an output that is more suitable for a workflow.

[0097] (Fourth embodiment) In the first embodiment, an example of simply notifying the analysis result of an optical image is described. In the fourth embodiment, an example of simply notifying the analysis result of an optical image is described. Note that the configuration for realizing the fourth embodiment is similar to that of the first embodiment except for the parts related to the above-mentioned characteristic parts. Therefore, the same components are denoted by the same reference numerals and the detailed description thereof is omitted.

[0098] [Notification of analysis results] Next, the notification of the analysis result will be described in detail with reference to Fig. 14(a) and Fig. 14(b). Fig. 14(a) is a diagram showing a first example of the notification of the analysis result in the imaging management application. Fig. 14(b) is a diagram showing a second example of the notification of the analysis result in the imaging management application.

[0099] When an optical image is analyzed, first, an optical image analysis target detection frame 10601 is displayed in a screen state 10600 of the optical image window 550 described above. The optical image analysis target detection frame 10601 is a frame indicating that a single human body has been detected in the optical image analysis unit 205 and the detection area (target area for judgment). For example, in the optical image analysis unit 205, when a human body has not been detected, the optical image analysis target detection frame 10601 is hidden, and when a human body is detected, the optical image analysis target detection frame 10601 is displayed. This makes it possible to visually notify the user of the human body detection result of the optical image analysis and its area. When a human body is detected in an abnormal position, an emphasized optical image analysis target detection frame 10651 may be displayed as shown in a screen state 10650 of the optical image window 550 described above. In other words, the manner in which the optical image analysis target detection frame is displayed may be changed according to the detection state of the human body.

[0100] Furthermore, in the screen state 10600, a notification 10602 is displayed as the optical image analysis result 556. The notification 10602 is displayed when a human body is detected normally in accordance with the examination information. The notification 10602 displays a message saying "Normal position" and information about the current imaging content (imaging position), "Front chest". This notification allows the user to know that the human body is in a normal position for the planned imaging content.

[0101] On the other hand, in the screen state 10650, a notification 10652 is displayed as the optical image analysis result 556. The notification 10652 is displayed when a human body is detected in an abnormal position corresponding to the examination information. The notification 10652 displays a notification saying "Please check the body part to be photographed" and information on the current imaging content, "front of chest." This notification allows the user to know that the human body is in an abnormal position (inconsistency, error) for the planned imaging content.

[0102] [Inspection process] Next, the inspection process will be described with reference to Fig. 15. Fig. 15 is a diagram showing a flowchart of the inspection process. Control corresponding to this flowchart is executed in the control device 20. In detail, the control device 20 has a CPU 301 that expands a program 3031 stored in a ROM 303 or the like into a RAM 302, and the program is realized by acting as a corresponding function.

[0103] In S10701, the test information management unit 207 allows the user to select one of the multiple pieces of test information acquired from the operation unit 26, and sets it as the test target. This process is realized, for example, by displaying the acquired multiple pieces of test information in a list format, and setting the selected test information as the test target in response to a user's operation input to select one piece of test information from the list. Note that the user may directly input the test information from the operation unit 26.

[0104] In S10702, the control device 20 starts the examination by transmitting a signal to the radiation detection device 10 to transition to a preparation state according to the set examination information. In response to this signal, for example, the radiation detection device 10 controls the bias power supply by the main control circuit and applies a bias voltage to the two-dimensional imaging element. Thereafter, in order to read out dark current signals accumulated in the pixels, initialization is performed in which an image signal is read out from the pixel array by the drive circuit. After the initialization is completed, the radiation detection device 10 transmits status information indicating that the radiation detection device 10 is ready to obtain a radiographic image to the control device 20. In addition, the control device 20 (examination information management unit 207) sets the operation parameters (tube voltage, etc.) of the radiation detection device 10 based on the examination information selected in S10701. When the control device 20 is notified by the status information from the radiation detection device 10 that the imaging preparation is complete, it notifies the radiation detection device 10 of permission for exposure.

[0105] In S10703, the optical image acquisition unit 203 acquires an optical image captured by the optical imaging device 40.

[0106] In S10704, the optical image analysis unit 205 analyzes the optical image using the optical image acquired from the optical image acquisition unit 203 and the inspection information acquired from the inspection information management unit 207. For the analysis of the optical image, for example, an inference process using machine learning may be performed by the inference processing unit 206. All images acquired by the optical image acquisition unit 203 may be used as the images to be input to the optical image analysis unit 205, or images to be used may be thinned out according to the analysis content and input to the optical image analysis unit 205. Details of S10704 will be described later.

[0107] In S10705, the control device 20 acquires the result of the judgment made in S10704, and acquires information on the corresponding detection state notification. An example of the correspondence between the judgment result and the detection state notification is shown in table 10900 in Fig. 17. Fig. 17 is a diagram showing the correspondence between the judgment result by image analysis and the detection result notification.

[0108] In S10706, the optical image display control unit 204 controls the display contents using the optical image acquired by the optical image acquisition unit 203 and the analysis results of the optical image analysis unit 205, and provides the contents to the display control unit 209. As a result, the controlled display contents are displayed on the display unit 25. In the optical image display control unit 204, the display of the optical image and the analysis results is optional, and may be controlled according to the settings of the control device 20 and the settings of the examination information management unit 207. For example, when no optical image analysis is performed, only the optical image may be displayed on the display unit 25.

[0109] [Optical image analysis processing] Next, the optical image analysis process (processing of S10704) by the optical image analysis unit 205 will be described with reference to Fig. 16. Fig. 16 is a diagram showing a flowchart of the optical image analysis process. The control corresponding to this flowchart is executed in the control device 20. In detail, it is realized by the CPU 301 provided in the control device 20 expanding the program 3031 stored in the ROM 303 or the like in the RAM 302 and acting as the corresponding function. The order of each step may be arbitrary. Also, the processing of any step may not be included. Also, the processing of storing the display information may not be required.

[0110] In S10801, the optical image analysis unit 205 judges whether the examination information acquired by the examination information management unit 207 is an examination to be judged in the optical image analysis. For example, in the optical image analysis, in order to analyze whether the optical image conforms to the contents of the specified examination, if the examination information does not contain sufficient information, it is judged as being out of target. Specifically, in the case of analysis aimed at determining the part, if the part is not specified in the examination information, or if a part that the optical image analysis unit 205 cannot analyze is specified, this is the case. If it is judged as being out of target, the process transitions to a judgment result of being out of target in S10808.

[0111] In S10802, display information is stored in the judgment result so as to display a consistency judgment in progress icon, which indicates that the inspection is a judgment target of optical image analysis.

[0112] In S10803, the optical image analysis unit 205 judges whether the optical image acquired from the optical image acquisition unit 203 includes the subject to be analyzed. An image recognition method using machine learning may be used to detect the subject. At this time, if not only the patient's body to be imaged but also a human body other than the patient, such as a radiologist preparing for image capture, is included in the optical image, it may be judged that the subject is not detectable because an appropriate subject has not been detected. If it is judged that the subject is not detectable, the process transitions to a judgment result of human body not detected in S10809.

[0113] In S10804, display information is stored in the judgment result so as to display a consistency judgment in progress icon, which indicates that the inspection is a judgment target of optical image analysis.

[0114] In S10805, the optical image analysis unit 205 determines whether the part of the examination information acquired by the examination information management unit 207 matches the part that is the analysis result of the optical image acquired from the optical image acquisition unit 203. The method for analyzing the part may be an image recognition method using machine learning. If the analysis result is determined to be a mismatch, the process transitions to a determination result of S10810 that the parts do not match. If it is not possible to determine whether the parts match or do not match and it is impossible to determine, the process transitions to a determination result of S10813 that it is impossible to determine.

[0115] In S10806, the optical image analysis unit 205 judges whether the direction of the inspection information acquired by the inspection information management unit 207 matches the direction that is the analysis result of the optical image acquired from the optical image acquisition unit 203. Depending on the inspection information, the judgment may not be necessary. An image recognition method using machine learning may be used as a method for analyzing the direction. If it is judged that the analysis result does not match, the process transitions to a judgment result of S10811 that the directions do not match. If it is not possible to judge whether they match or do not match and it is impossible to judge, the process transitions to a judgment result of S10813 that it is impossible to judge.

[0116] In S10807, the optical image analysis unit 205 judges whether the laterality of the examination information acquired by the examination information management unit 207 matches the laterality of the analysis result of the optical image acquired from the optical image acquisition unit 203. Depending on the examination information, the judgment may not be necessary. The method for analyzing the laterality may be an image recognition method using machine learning. If the analysis result is judged to be a mismatch, the process transitions to a judgment result of laterality mismatch in S10812. If it is not possible to judge whether the laterality is a match or a mismatch and it is impossible to judge, the process transitions to a judgment result of indeterminable in S10813. If the laterality is a match, the process transitions to a judgment result of consistency in S10814.

[0117] S10808 to S10814 indicate the state of the determination result of the optical image analysis unit 205. Depending on each determination result, the optical image display control unit 204 can control the display contents of the optical image window 550. Specifically, the notification contents can be controlled as shown in table 10900 in FIG.

[0118] The notification of the optical image analysis result 556 is not limited to a text message. Notification may be made using figures, symbols, colors, or the like other than text so that each analysis result can be distinguished.

[0119] [effect] As described above in the embodiment, by determining and notifying the user of the consistency between the designated imaging technique and the actual positioning of the subject, the user can be made aware of the possibility of an imaging error in advance, which makes it possible to prevent the occurrence of imaging errors and to improve the efficiency of the workflow.

[0120] Fifth embodiment In the first embodiment, an example in which a plurality of optical imaging devices, a plurality of radiation generating devices, and a plurality of radiation detecting devices are not distinguished is described. In the fifth embodiment, an example in which a plurality of radiation generating devices and a plurality of radiation detecting devices are distinguished is described. Note that the configuration for realizing the fifth embodiment is similar to that of the first embodiment, except for the parts related to the above-mentioned characteristic parts. Therefore, similar configurations are described with the same reference numerals, and detailed description thereof is omitted.

[0121] Display of an optical image will be described with reference to Fig. 18. Fig. 18 is a diagram showing a second display example of an optical image in the imaging management application.

[0122] In the screen 20600, imaging information of "Protocol-A" is registered in the examination information 20603. This imaging information is different from the examination information 503 in that the imaging target is not the "chest" but the "hands and feet". In addition, in the examination information 20603, the descriptions "camera-A", "tube-A", and "sensor-A" in the examination information 503 are changed to "camera-B", "tube-B", and "sensor-B". "Camera-A", "tube-A", and "sensor-A" correspond to the optical imaging device 40A, the radiation generating device 30A, and the radiation detecting device 10A, respectively. "Camera-B", "tube-B", and "sensor-B" correspond to the optical imaging device 40B, the radiation generating device 30B, and the radiation detecting device 10B, respectively.

[0123] The devices used for radiography are automatically changed as linked objects in accordance with the imaging contents selected in the examination information 503 or the examination information 20603. In this embodiment, these linked objects are displayed as part of the examination information so that the user can confirm them. Also, the optical image 20655 displayed in the optical image display area 551 is the one captured by camera-B, and the camera information 20652 is also switched to "camera-B".

[0124] The imaging information registered in the examination information 503 and the examination information 20603 is designated in advance before radiation imaging on a screen 20700 in Fig. 19. Fig. 19 is a diagram showing a setting screen for an imaging method in the imaging management application.

[0125] The screen 20700 includes an imaging method list area 20701 and an examination start button 20702. The user can display a screen in which imaging information is registered, such as the screen 500 or the screen 20600, by selecting an imaging method from the list and selecting the examination start button 20702. When an imaging method is selected from the imaging method list area 20701, an apparatus to be used is determined based on a combination of the apparatus configuration information of the radiation imaging system 1 and the imaging method. Information on the determined apparatus to be used is displayed as imaging information. In addition, the image orientation (angle information) of the optical imaging device 40 is also registered in the imaging information. Since geometric transformation of the image and the like are automatically performed based on the registered image orientation information, the optical image is displayed in an appropriate orientation in the optical image display area 551 in the default state.

[0126] [Determination of the equipment and optical imaging geometry] Next, the control relating to the determination of the device to be used and the image orientation will be described with reference to FIG.

[0127] FIG. 21 is a flowchart showing the photographing information management method (a).

[0128] In S20900, the control device 20 accepts input of shooting information from the user and acquires the shooting information.

[0129] In S20901, the control device 20 judges the inputted imaging region. Here, for simplicity of explanation, the judgment is made for four regions, "head", "limbs", "abdomen" and "chest", but the imaging region may be classified more finely. If the imaging region is "chest", the process proceeds to S20902. If the imaging region is "abdomen", the process proceeds to S20903.

[0130] If the imaging part is the "hands and feet", the process proceeds to S20904. If the imaging part is the "head", the process proceeds to S20905.

[0131] In S20902, the control device 20 determines the devices to be used as "Camera A," "Tube A," and "Sensor A" based on the table of the photography information management method (a), and determines the optical image geometry (geometric information) as "Rotation 0 degrees," "Magnification rate 100%," and "Height 120 cm." "Rotation 0 degrees" is rotation information, "Magnification rate 100%" is magnification / reduction information, and "Height 120 cm" is center coordinate information.

[0132] In S20903, the control device 20 determines the devices to be used as “Camera B”, “Tube B”, and “Sensor B” based on the table of the shooting information management method (a), and determines the optical image geometry as “Rotation 0 degrees”, “Magnification 50%”, and “Height 80 cm”.

[0133] In S20904, the control device 20 determines the devices to be used as “Camera B”, “Tube B”, and “Sensor B” based on the table of the shooting information management method (a), and determines the optical image geometry as “Rotation 0 degrees”, “Magnification 200%”, and “Height 0 cm”.

[0134] In S20905, the control device 20 determines the devices to be used as “Camera B”, “Tube B”, and “Sensor A” based on the table of the shooting information management method (a), and determines the optical image geometry as “Rotation 90 degrees”, “Magnification 100%”, and “Height 50 cm”.

[0135] Although the imaging region is given as an example here, the device to be used and the optical image geometric transformation may be determined using patient information such as gender, physique, weight, height, and age.

[0136] [effect] As described above, according to the fifth embodiment, the device to be used and the optical image geometry can be determined by selecting the imaging region. Therefore, the optical image from the appropriate optical imaging device can be displayed at an appropriate angle and magnification in the optical image display area 551 of the optical image window 550.

[0137] In addition, position information such as coordinate information from the ground can also be specified as optical image geometric information. Therefore, in the case of an optical imaging device that can be rotated or an optical imaging device that captures images at a wide angle, it is also possible to capture the imaging site at the center of the optical image.

[0138] Sixth embodiment In the fifth embodiment, the imaging region is selected to determine the device to be used and the optical image geometry. In contrast, in the sixth embodiment, the imaging type is selected to determine the device to be used and the optical image geometry. The configuration for realizing the sixth embodiment is the same as that of the fifth embodiment, except for the parts related to the above-mentioned characteristic parts. Therefore, the same components are described with the same reference numerals, and detailed description thereof is omitted.

[0139] FIG. 22 is a flowchart showing the photographing information management method (b).

[0140] In S21001, the control device 20 accepts input of imaging information from the user and acquires the imaging information. Unlike the fifth embodiment in which an imaging region is acquired, the sixth embodiment acquires an imaging type. That is, it is assumed that an imaging type has been selected in advance on an imaging type selection screen (not shown).

[0141] In S21002, the control device 20 judges the input imaging type. Here, for simplicity of explanation, the judgment is made for four imaging types: "portable," "sitting position," "supine position," and "standing position," but the imaging types may be classified more finely. If the imaging type is "standing position," the process proceeds to S21003. If the imaging part is "supine position," the process proceeds to S21004. If the imaging type is "sitting position," the process proceeds to S21005. If the imaging type is "portable," the process proceeds to S21006.

[0142] In S21003, the control device 20 determines the devices to be used as "camera A," "tube A," and "sensor A" based on the table of the shooting information management method (b), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%."

[0143] In S21004, the control device 20 determines the devices to be used as "camera B," "tube B," and "sensor B" based on the table of the shooting information management method (b), and determines the optical image geometry as "rotation 90 degrees" and "magnification ratio 50%."

[0144] In S21005, the control device 20 determines the devices to be used as "camera B," "tube B," and "sensor B" based on the table of the shooting information management method (b), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%."

[0145] In S21006, the control device 20 determines the devices to be used as "camera B," "tube B," and "sensor A" based on the table of the shooting information management method (b), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%."

[0146] [effect] As described above, according to the sixth embodiment, the imaging type can be selected to determine the device to be used and the optical image geometry, and therefore, the optical image from the appropriate optical imaging device can be displayed at an appropriate angle and magnification in the optical image display area 551 of the optical image window 550.

[0147] Seventh embodiment In the sixth embodiment, the imaging type is selected to determine the device to be used and the optical image geometry. In the seventh embodiment, an imaging information management method is described in an environment in which "Tube A" and "Camera A" are always used as a set, and "Tube B" and "Camera B" are always used as a set. This is an embodiment used in cases where it is desired to closely link the optical imaging device with the X-ray tube, such as when the optical imaging device is installed near the X-ray tube. The configuration for realizing the seventh embodiment is the same as that of the sixth embodiment, except for the parts related to the above-mentioned characteristic parts. Therefore, the same components are denoted by the same reference numerals and will not be described in detail.

[0148] FIG. 23 is a flowchart showing the photographing information management method (c).

[0149] In S21001, the control device 20 acquires shooting information in the same manner as in the sixth embodiment.

[0150] In S21002, the control device 20 determines the imaging type in the same manner as in the sixth embodiment. If the imaging type is "standing position", the process proceeds to S21101. If the imaging part is "supine position", the process proceeds to S21102. If the imaging type is "sitting position", the process proceeds to S21003. If the imaging type is "portable", the process proceeds to S21004.

[0151] In S21001, the control device 20 determines the devices to be used as "camera A," "tube A," and "sensor A" based on the table of the photographing information management method (c).

[0152] In S21002, the control device 20 determines the devices to be used as "camera B," "bulb B," and "sensor B" based on the table of the imaging information management method (c).

[0153] In S21003, the control device 20 determines the devices to be used as "camera B," "bulb B," and "sensor B" based on the table of the imaging information management method (c).

[0154] In S21004, the control device 20 determines the devices to be used as "camera B," "bulb B," and "sensor A" based on the table of the imaging information management method (c).

[0155] In S21005, the control device 20 determines the radiation tube to be used. If the radiation tube to be used is "Tube B", the process proceeds to S21006. If the radiation tube to be used is "Tube A", the process proceeds to S21007.

[0156] In S21006, the control device 20 determines the device to be used as "camera B" based on the table of the photographing information management method (c), and determines the optical image geometry as "rotation 180 degrees" and "magnification rate 50%."

[0157] In S21007, the control device 20 determines the device to be used as "camera B" based on the table of the photographing information management method (c), and determines the optical image geometry as "rotation 0 degrees" and "magnification ratio 100%."

[0158] [effect] As described above, according to the seventh embodiment, the imaging type is selected, so that the device to be used and the optical image geometry can be determined. Therefore, the optical image from the appropriate optical imaging device can be displayed at an appropriate angle and magnification in the optical image display area 551 of the optical image window 550.

[0159] Eighth embodiment In the sixth embodiment, the imaging type is selected to determine the device to be used and the optical image geometry. In the eighth embodiment, an imaging information management method in an environment in which "sensor A" and "camera A" are always used as a set, and "sensor B" and "camera B" are always used as a set, will be described. This is an embodiment used in cases where it is desired to closely link the optical imaging device with the radiation detection device, such as when it is desired to display a radiation image and an optical image in the same way, or when it is desired to match the scanning direction or reading direction of the radiation detection device with the optical image. The configuration for realizing the eighth embodiment is the same as that of the sixth embodiment, except for the parts related to the above-mentioned characteristic parts. Therefore, the same components are denoted by the same reference numerals and will not be described in detail.

[0160] FIG. 24 is a flowchart showing the photographing information management method (d).

[0161] In S21001, the control device 20 acquires shooting information in the same manner as in the sixth embodiment.

[0162] In S21002, the control device 20 determines the imaging type in the same manner as in the sixth embodiment. If the imaging type is "standing position", the process proceeds to S21201. If the imaging part is "supine position", the process proceeds to S21202. If the imaging type is "sitting position", the process proceeds to S21203. If the imaging type is "portable", the process proceeds to S21204.

[0163] In S21201, the control device 20 determines the devices to be used as "bulb A" and "sensor A" based on the table of the imaging information management method (d).

[0164] In S21202, the control device 20 determines the devices to be used as "bulb B" and "sensor B" based on the table of the imaging information management method (d).

[0165] In S21203, the control device 20 determines the devices to be used as "bulb B" and "sensor B" based on the table of the imaging information management method (d).

[0166] In S21204, the control device 20 determines the devices to be used as "bulb B" and "sensor A" based on the table of the imaging information management method (d).

[0167] In S21205, the control device 20 determines the radiation detection device to be used. If the radiation detection device to be used is "sensor B", the process proceeds to S21006. If the radiation tube to be used is "sensor A", the process proceeds to S21007.

[0168] In S21006, the control device 20 determines the device to be used as "camera B" based on the table of the photographing information management method (d), and determines the optical image geometry as "rotation 270 degrees" and "magnification rate 50%."

[0169] In S21007, the control device 20 determines the device to be used as "camera A" based on the table of the photographing information management method (d), and determines the optical image geometry as "rotation 0 degrees" and "magnification ratio 100%."

[0170] [effect] As described above, according to the eighth embodiment, the imaging type is selected, so that the device to be used and the optical image geometry can be determined. Therefore, the optical image from the appropriate optical imaging device can be displayed at an appropriate angle and magnification in the optical image display area 551 of the optical image window 550.

[0171] Ninth embodiment In the sixth embodiment, the imaging type is selected to determine the device to be used and the optical image geometry. In the ninth embodiment, a case where multiple optical imaging devices are selected and a case where the optical imaging device to be selected is "none" are described. The configuration for realizing the ninth embodiment is the same as that of the sixth embodiment except for the parts related to the above-mentioned characteristic parts. Therefore, the same components are described with the same reference numerals, and detailed description thereof is omitted.

[0172] FIG. 25 is a flowchart showing the photographing information management method (e).

[0173] In S21001, the control device 20 acquires shooting information in the same manner as in the sixth embodiment.

[0174] In S21002, the control device 20 determines the imaging type in the same manner as in the sixth embodiment. If the imaging type is "standing position", the process proceeds to S21301. If the imaging part is "supine position", the process proceeds to S21302. If the imaging type is "sitting position", the process proceeds to S21303. If the imaging type is "portable", the process proceeds to S21304.

[0175] In S21301, the control device 20 determines the devices to be used as "camera A," "tube A," and "sensor A" based on the table of the shooting information management method (d), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%."

[0176] In S21302, the control device 20 determines the devices to be used as "Camera A: Analysis only", "Tube B", and "Sensor B" based on the table of the imaging information management method (d). Here, "Camera A: Analysis only" indicates that it is used only for analysis and is not used for optical image display. In other words, only information based on the analysis results from the optical image analysis unit 205 is displayed in the optical image window 550. This is because, depending on the imaging type or imaging site, there may be cases where the optical images do not want to be displayed due to privacy concerns, but the analysis results of the optical images want to be displayed.

[0177] In S21303, the control device 20 determines the devices to be used as "camera: none", "tube B", and "sensor B" based on the table of the imaging information management method (d). Here, "camera: none" means that an optical imaging device is not used. This is because the imaging technique and imaging region are limited depending on the imaging type and imaging region, and it is assumed that an optical imaging device will not be used when confirmation with the optical imaging device is not essential.

[0178] In S21304, the control device 20 determines the devices to be used as "Camera A, Camera B," "Tube B," and "Sensor A" based on the table of the shooting information management method (d), and determines the optical image geometry as "Camera A: 0 degrees, 100%" and "Camera B: 90 degrees, 50%."

[0179] This assumes the use of various types of optical imaging devices, such as an optical imaging device installed on a ceiling or the like. When displaying optical images obtained from a plurality of optical imaging devices, the acquired images may be analyzed and an image to be displayed may be automatically selected. For example, it is advisable to use the optical imaging device that is closest to the optical imaging device or that shows the largest image of the subject. Also, a configuration may be used in which an optical image of an optical imaging device with few obstructions between the subject and the image is used. Also, optical images taken by a plurality of optical imaging devices may be synthesized and displayed in the optical image display area 551 of the optical image window 550.

[0180] [effect] As described above, according to the ninth embodiment, the imaging type is selected, so that the device to be used and the optical image geometry can be determined. Therefore, the optical image from the appropriate optical imaging device can be displayed at an appropriate angle and magnification in the optical image display area 551 of the optical image window 550.

[0181] (Other Examples) The present invention is not limited to the above-mentioned embodiments, and various modifications (including organic combinations of the embodiments) are possible based on the spirit of the present invention, and are not excluded from the scope of the present invention. In other words, the present invention includes all configurations that combine the above-mentioned embodiments and their modifications.

[0182] FIG. 1 illustrates a system having two of each of the following devices: radiation detection device 10 (10A, 10B), control device 20, radiation generation device 30 (30A, 30B), and optical imaging device 40 (40A, 40B). However, the number of devices may be three or more.

[0183] The information on the device used and the optical image geometry linked to the imaging information is not limited to those shown in Figs. 20(a) to (e). Various environments are assumed for radiation imaging. For example, it is assumed that the optical imaging device is not installed near the radiation tube, but is installed on the ceiling of the radiation imaging room. Therefore, the information on the device used and the optical image geometry linked to the imaging information such as the imaging part and the imaging type may be editable by the user. By determining the information on the device used and the optical image geometry linked to specific imaging information in advance, the user can call up the similar information on the device used and the optical image geometry by selecting the imaging information thereafter.

[0184] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0185] The processor or circuitry may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gateway (FPGA), a digital signal processor (DSP), a data flow processor (DFP), or a neural processing unit (NPU).

[0186] The radiation imaging system in each of the above-mentioned embodiments may be realized as a single device, or may be realized as a combination of multiple devices capable of communicating with each other to execute the above-mentioned processing, and either form is included in the embodiments of the present invention. The above-mentioned processing may be executed by a common server device or a group of servers. The multiple devices constituting the radiation imaging system need only be capable of communicating at a predetermined communication rate, and do not need to be located in the same facility or the same country.

[0187] The embodiments include a form in which a software program that realizes the functions of the above-described embodiments is supplied to a system or device, and the computer of the system or device reads and executes the code of the supplied program.

[0188] Therefore, the program code itself installed in a computer to realize the processing according to the embodiment is also one embodiment of the present invention. Also, the OS or the like running on the computer performs part or all of the actual processing based on the instructions contained in the program read by the computer, and the functions of the above-mentioned embodiment can also be realized by that processing.

[0189] (Additional Note) The disclosure of this embodiment includes the following configurations and methods.

[0190] [Appendix 1] A radiation imaging system including a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on radiation that has passed through a subject, an optical imaging device that optically images the subject, and an information processing device that allows information related to radiation imaging using the radiation imaging device to be viewed on a display unit, The radiation imaging system is characterized in that the information processing device controls the display of the optical image acquired from the optical imaging device in accordance with the progress of a predetermined step among a plurality of steps for performing the radiation imaging.

[0191] [Appendix 2] 2. The radiation imaging system according to claim 1, wherein the predetermined step is a step of issuing an imaging preparation instruction to the radiation imaging device.

[0192] [Appendix 3] 3. The radiation imaging system according to claim 1, wherein the predetermined step is a step in which the radiation imaging device starts an imaging operation.

[0193] [Appendix 4] the information processing device is capable of superimposing a radiation image acquired by the radiation imaging and the optical image, 4. The radiation imaging system according to claim 1, wherein in the superimposed display, the optical image is displayed in a size smaller than the radiation image.

[0194] [Appendix 5] 5. The radiation imaging system according to claim 1, wherein the screen displayed by the information processing device includes a selection object for turning on or off the display of the optical image.

[0195] [Appendix 6] the information processing device executes a predetermined process as a display process of the optical image on the display unit based on information about a state of the subject; 6. The radiation imaging system according to claim 1, wherein the predetermined process is any one of displaying, not displaying, and processing the image before displaying.

[0196] [Appendix 7] 6. The radiation imaging system according to claim 1, wherein the information processing device displays status information relating to the subject on the display unit based on an analysis result of the optical image.

[0197] [Appendix 8] 6. The radiation imaging system according to claim 1, wherein the information processing device displays the status information and the optical image on the same screen of the display unit.

[0198] [Appendix 9] 6. The radiation imaging system according to claim 1, wherein the information processing device displays the status information on a screen of the display unit without displaying the optical image.

[0199] [Appendix 10] 8. The radiation imaging system according to claim 1, wherein the information processing device stores the optical image in association with examination information related to the radiation imaging.

[0200] [Appendix 11] The radiation imaging system of claim 10, wherein the information processing device determines whether to store, not store, or process the optical information and store it, based on information regarding the condition of the subject.

[0201] [Appendix 12] The radiation imaging system according to claim 6, wherein the image processing is image processing in which a mosaic process is performed on a part or all of an optical image, or image processing in which the optical image is replaced with a figure or the like.

[0202] [Appendix 13] The radiation imaging system according to claim 9, wherein the image processing is image processing in which a mosaic process is performed on a part or all of an optical image, or image processing in which the optical image is replaced with a figure or the like.

[0203] [Appendix 14] An information processing device for use in a radiation imaging system including a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on the radiation that has passed through a subject, and an optical imaging device that optically images the subject, 2. An information processing apparatus comprising: a display control unit for controlling a display of an optical image acquired from the optical imaging device in accordance with progress of a predetermined step among a plurality of steps for performing the radiation imaging.

[0204] [Appendix 15] 1. A method for controlling an information processing device used in a radiation imaging system including a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on radiation that has passed through a subject, and an optical imaging device that optically images the subject, comprising: A control method comprising the step of controlling display of an optical image acquired from the optical imaging device in accordance with progress of a predetermined step among a plurality of steps for performing the radiation imaging.

[0205] [Appendix 16] A program for causing a computer to execute the control method described in appendix 15.

[0206] [Appendix 17] A radiation imaging system including a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on radiation that has passed through a subject, an optical imaging device that optically images the subject, and an information processing device that allows information related to radiation imaging using the radiation imaging device to be viewed on a display unit, The information processing device includes: means for acquiring an optical image from the optical imaging device; A means for obtaining information regarding a photographing position; and means for notifying information regarding suitability of said imaging based on said optical image and information on said imaging position.

[0207] [Appendix 18] An information processing device for use in a radiation imaging system having a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on radiation that has passed through a subject, and an optical imaging device that optically images the subject, comprising: means for acquiring an optical image from the optical imaging device; A means for obtaining information regarding a photographing position; and means for notifying information regarding suitability of said photographing based on said optical image and information on said photographing position.

[0208] [Appendix 19] A display unit for displaying information; and a means for displaying information regarding the suitability of the photographing on the display unit.

[0209] [Appendix 20] 20. The information processing device according to claim 19, further comprising a means for displaying on the display unit whether or not a human body has been detected from the optical image.

[0210] [Appendix 21] 21. The information processing device according to claim 20, further comprising a means for displaying, on the display unit, a target area for consistency determination identified by the human body detection, superimposed on the optical image.

[0211] [Appendix 22] 22. The information processing device according to any one of claims 19 to 21, further comprising a means for displaying a notification on the display unit when the position, type, and posture of a human body part obtained from the optical image are consistent with information regarding the photographing position.

[0212] [Appendix 23] 23. The information processing device according to any one of appendices 19 to 22, further comprising a means for displaying, on the display unit, an inconsistency when any of information regarding the position, type, and posture of a human body part obtained from the optical image does not match information regarding the photographing position.

[0213] [Appendix 24] An information processing device as described in any one of appendices 19 to 23, characterized in that it has a means for displaying on the display unit that a determination is impossible when a consistency with information regarding the photographing position cannot be confirmed from information obtained from the optical image.

[0214] [Appendix 25] 19. The information processing device according to claim 18, further comprising a determination means for making a determination based on information on the subject's posture obtained from the optical image and information on the photographing posture.

[0215] [Appendix 26] The information processing device according to claim 25, wherein the determination means detects a human body to be determined when performing a consistency determination.

[0216] [Appendix 27] The information processing device described in Appendix 26, characterized in that the judgment means judges that there is a match when the position, type, and posture of the human body part that is the subject of the consistency judgment match the information regarding the shooting position.

[0217] [Appendix 28] The information processing device described in Appendix 26 or 27, characterized in that the judgment means judges that there is an inconsistency when at least one of the position, type, and posture of the human body part that is the subject of the consistency judgment differs from the information of the shooting position.

[0218] [Appendix 29] The information processing device described in any one of Appendices 26 to 28, characterized in that the judgment means judges that the judgment is impossible when it is not possible to make a consistency judgment on at least one of the position, type, and posture of the human body part that is the subject of the consistency judgment.

[0219] [Appendix 30] 30. The information processing device according to any one of claims 26 to 29, wherein the determination means inputs the optical image at a frame rate that is thinned out lower than the frame rate of the image acquisition means to execute the determination means.

[0220] [Appendix 31] 1. A method for controlling an information processing device used in a radiation imaging system having a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on radiation that has passed through a subject, and an optical imaging device that optically images the subject, comprising: acquiring an optical image from the optical imaging device; acquiring information regarding the photographing position; and notifying information regarding whether or not the imaging is appropriate based on the optical image and information on the imaging position.

[0221] [Appendix 32] A radiation imaging system including a radiation irradiation device which irradiates radiation, a radiation imaging device which obtains a radiation image based on radiation which has passed through a subject, a plurality of optical imaging devices which optically image the subject, the plurality of optical imaging devices including at least a first optical imaging device and a second optical imaging device, and an information processing device which allows information related to radiation imaging using the radiation imaging devices to be viewed on a display unit, The information processing device includes: A means for acquiring imaging information for the next radiography; a means for determining, based on the imaging information, an optical image to be displayed on the display unit during a period until the next radiation imaging, from among optical images obtainable from the first optical imaging device and the second optical imaging device; A radiation imaging system comprising:

[0222] [Appendix 33] An information processing device for use in a radiation imaging system having a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on radiation that has passed through a subject, and a plurality of optical imaging devices that optically image the subject, the plurality of optical imaging devices including at least a first optical imaging device and a second optical imaging device, A display unit capable of displaying information; A means for acquiring imaging information regarding the next radiation imaging; and a means for determining, based on the imaging information, an optical image to be displayed on the display unit during a period until the next radiation imaging, from among the optical images obtainable from the first optical imaging device and the second optical imaging device.

[0223] [Appendix 34] The information processing device described in Appendix 33, characterized in that during the period until the next radiation imaging, an optical image is acquired using only one of the first optical imaging device and the second optical imaging device, and the acquired optical image is displayed on the display unit.

[0224] [Appendix 35] The information processing device according to claim 34, wherein the information processing device determines an optical photographing device to be used for acquiring an optical image from among the plurality of optical photographing devices based on predetermined conditions, the predetermined conditions including any one of the following conditions: a short distance between the subject and the optical photographing device; few obstructions between the subject and the optical photographing device; and a large image of the subject.

[0225] [Appendix 36] The information processing device described in Appendix 33, characterized in that, during the period until the next radiation imaging, a first optical image acquired from the first optical imaging device and a second optical image acquired from the second optical imaging device are synthesized and displayed on the display unit.

[0226] [Appendix 37] the radiation imaging system includes a plurality of radiation irradiation devices including the radiation irradiation device, The information processing device according to any one of appendices 33 to 36, characterized in that the information processing device has a means for setting one of the plurality of radiation irradiation devices as a device to be used based on the shooting information.

[0227] [Appendix 38] the radiation imaging system includes a plurality of radiation imaging devices including the radiation imaging device, The information processing device according to any one of appendices 33 to 37, characterized in that the information processing device sets one of the plurality of radiation imaging devices as a device to be used based on the shooting information.

[0228] [Appendix 39] The information processing device according to any one of appendices 33 to 38, further comprising a means for controlling a screen to be displayed on the display unit based on any one of information on a radiation image obtained from the radiation imaging device, an optical image obtained from the optical imaging device, and an analysis result obtained by analyzing the optical image.

[0229] [Appendix 40] The information processing device according to any one of appendices 33 to 39, characterized in that the information processing device controls ON / OFF of a display of an optical image obtained from the optical photographing device based on the photographing information.

[0230] [Appendix 41] The information processing device according to any one of appendices 33 to 40, characterized in that the information processing device controls ON / OFF of a display of an analysis result based on an optical image obtained from the optical photographing device based on the photographing information.

[0231] [Appendix 42] The information processing device according to any one of appendices 33 to 41, characterized in that the information processing device performs image processing on an optical image acquired from the optical photographing device based on geometric information obtained based on the photographing information.

[0232] [Appendix 43] 43. The radiation imaging system of claim 42, wherein the geometric information includes any one of rotation information, enlargement / reduction information, and center coordinate information of an optical image.

[0233] [Appendix 44] 44. The information processing device according to any one of appendices 33 to 43, wherein the imaging information includes any one of an imaging technique (standing, lying, sitting, portable), an imaging region, and patient information.

[0234] [Appendix 45] A method for controlling an information processing device used in a radiation imaging system having a radiation irradiation device that irradiates radiation, a radiation imaging device that obtains a radiation image based on radiation that has passed through a subject, and a plurality of optical imaging devices that optically image the subject, the plurality of optical imaging devices including at least a first optical imaging device and a second optical imaging device, comprising: acquiring imaging information for a next radiography; and determining, based on the imaging information, an optical image to be displayed on a display unit during a period until the next radiation imaging, from among the optical images obtainable from the first optical imaging device and the second optical imaging device.

[0235] [Appendix 46] A program for causing a computer to execute the control method described in appendix 45. [Explanation of symbols]

[0236] 20 Control device 201 Radiation image acquisition unit 202 Image processing section 203 Optical image acquisition unit 204 Optical image display control unit 205 Optical Image Analysis Department 206 Inference Processing Unit 207 Test Information Management Department 208 Image Storage Unit 209 Display control section 30 Radiation Generator 10 Radiation detection equipment 40 Optical photographing device 25 Display section 26 Control section

Claims

1. A radiation imaging system having an optical imaging device that optically images a subject to be radiographed, and an information processing device that allows information related to the radiation imaging to be viewed on a display unit, The radiation imaging system is characterized in that the information processing device controls the display of the optical image acquired from the optical imaging device in accordance with the progress of a predetermined step among a plurality of steps for performing the radiation imaging.

2. 1. An information processing device for use in a radiation imaging system including an optical imaging device for optically imaging a subject for radiation imaging, 1. An information processing apparatus comprising: a display control unit that controls display of an optical image acquired from an optical imaging device in accordance with progress of a predetermined step among a plurality of steps for performing radiation imaging.

3. 3. The information processing apparatus according to claim 2, wherein the predetermined step is a step of issuing an imaging preparation instruction to a radiation imaging apparatus.

4. 3. The information processing apparatus according to claim 2, wherein the predetermined step is a step in which a radiation imaging apparatus starts an imaging operation.

5. A superimposed display is possible in which a radiation image acquired by the radiation photography and the optical image are superimposed, The information processing apparatus according to claim 2 , wherein, in the superimposed display, the optical image is displayed in a size smaller than the radiation image.

6. 3. The information processing apparatus according to claim 2, wherein the screen displayed includes a selection object for turning on or off the display of the optical image.

7. the information processing device executes a predetermined process as a display process of the optical image on a display unit based on information about a state of the subject; 3. The information processing apparatus according to claim 2, wherein the predetermined process is any one of displaying, not displaying, and processing the image before displaying.

8. The information processing apparatus according to claim 2 , wherein the information processing apparatus displays, on a display unit, status information relating to the subject based on an analysis result of the optical image.

9. The information processing apparatus according to claim 8 , wherein the information processing apparatus displays the status information and the optical image on the same screen of the display unit.

10. The information processing apparatus according to claim 8 , wherein the information processing apparatus displays the status information on a screen of the display unit without displaying the optical image.

11. The information processing apparatus according to claim 2 , wherein the information processing apparatus stores the optical image in association with examination information related to the radiation imaging.

12. The information processing apparatus according to claim 10 , wherein the information processing apparatus determines whether to store the optical image, not store the optical image, or process the image before storing the image, based on information about a state of the subject.

13. 8. The information processing apparatus according to claim 7, wherein the image processing is image processing for performing mosaic processing on a part or all of an optical image, or image processing for replacing the optical image with a figure or the like.

14. 1. A method for controlling an information processing device used in a radiation imaging system including an optical imaging device that optically images a subject for radiation imaging, comprising: A control method comprising the step of controlling the display of an optical image acquired from the optical imaging device in accordance with progress of a predetermined step among a plurality of steps for performing radiation imaging.

15. A program for causing a computer to execute the control method according to claim 14.

16. A radiation imaging system having an optical imaging device that optically images a subject to be radiographed, and an information processing device that allows information related to the radiation imaging to be viewed on a display unit, The information processing device includes: means for acquiring an optical image from the optical imaging device; A means for obtaining information regarding a photographing position; and means for notifying information regarding suitability of said imaging based on said optical image and information on said imaging position.

17. 1. An information processing device for use in a radiation imaging system having an optical imaging device for optically imaging a subject for radiation imaging, means for acquiring an optical image from the optical imaging device; A means for obtaining information regarding a photographing position; and means for notifying information regarding whether or not the photographing is appropriate based on the optical image and information on the photographing position.

18. A radiation imaging system including a plurality of optical imaging devices for optically imaging a subject for radiation imaging, the plurality of optical imaging devices including at least a first optical imaging device and a second optical imaging device, and an information processing device capable of viewing information related to the radiation imaging on a display unit, The information processing device includes: A means for acquiring imaging information for the next radiography; a means for determining, based on the imaging information, an optical image to be displayed on the display unit during a period until the next radiation imaging, from among optical images obtainable from the first optical imaging device and the second optical imaging device; A radiation imaging system comprising:

19. An information processing device for use in a radiation imaging system having a plurality of optical imaging devices for optically imaging a subject for radiation imaging, the plurality of optical imaging devices including at least a first optical imaging device and a second optical imaging device, comprising: A display unit capable of displaying information; A means for acquiring imaging information regarding the next radiography; and a means for determining, based on the imaging information, an optical image to be displayed on the display unit during a period until the next radiation imaging, from among the optical images obtainable from the first optical imaging device and the second optical imaging device.

Images