Radiation imaging system, information processing device, and control method and program thereof.

Abstract

To provide a radiation imaging system capable of appropriately outputting information obtained on the basis of an optical imaging device in accordance with a radiation imaging process.SOLUTION: In a radiation imaging system having an optical imaging device that optically images a subject for radiation imaging, and an information processing device capable of viewing information related to radiation imaging using the radiation imaging device on a display unit, the information processing device controls the display of the optical image obtained from the optical imaging device in accordance with the progress of a predetermined process among multiple processes for performing the radiation imaging.SELECTED DRAWING: Figure 2

Description

Technical Field

[0002] , , ,

[0004] , , , , , , , , , , , , ,

[0005] ,

[0003]

[0001] The present invention relates to a radiation imaging system using an optical image. This radiation imaging system includes an information processing device for displaying information related to radiation imaging using a radiation imaging device, and software executed by this information processing device. The radiation imaging device is, for example, a (Flat Panel Detector: FPD). The information processing device is, for example, a PC. The software is, for example, an imaging management application.

Background Art

[0002] As an imaging device used for medical image diagnosis and non-destructive inspection by radiation, a radiation imaging device using a flat panel detector (Flat Panel Detector: FPD) formed of a semiconductor material has become widespread. Such a radiation imaging device is used, for example, as a digital imaging device for still image imaging such as general photography or moving image imaging such as fluoroscopy in medical image diagnosis.

[0003] In radiation imaging, subject alignment is performed as a pre-step of imaging, and cases where imaging failure occurs due to inappropriate alignment have also been confirmed. Recently, as a configuration for assisting this alignment, a radiation imaging system (radiation imaging system) equipped with an optical camera (optical imaging device) capable of confirming the subject's situation has been proposed.

[0004] In Patent Document 1, means for guiding the positioning of a subject suitable for imaging using a subject image acquired by an optical imaging device during radiation imaging is described. Further, in Patent Document 2, an image acquired from an optical imaging device can be analyzed, and the analysis result can be displayed on a screen for radiation imaging to notify the user.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

[0006] The systems described in Patent Documents 1 and 2 have room for improvement in terms of operability. Ideally, images acquired from an optical imaging device, or information based thereon, should be output in a format and timing suitable for the radiography process.

[0007] The present invention has been made in view of the above-mentioned problems, and its objective is to provide a radiation imaging system that can appropriately output information obtained based on an optical imaging device in accordance with the radiation imaging process. [Means for solving the problem]

[0008] To solve the above problems, a radiation imaging system is provided, comprising: a radiation imaging device for acquiring radiation images by radiation imaging; an optical imaging device for optically imaging the subject of the radiation imaging; and an information processing device for displaying the optical images acquired by the optical imaging on a display unit, wherein the information processing device is configured to display the information processing device at a time before the start of the radiation imaging. from The optical image is displayed in a predetermined display area of ​​the display unit, and the start time of the radiography is set. In The system includes means for controlling the display so that the optical image is not displayed in the predetermined display area. The start time of the radiographic imaging is characterized by being the time after the instruction to start the radiographic imaging and before the information processing device completes the acquisition of the radiographic image. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a radiation imaging system that can appropriately output information obtained from an optical imaging device in accordance with the radiation imaging process. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram showing the configuration of a radiation imaging system. [Figure 2] This diagram shows the functional blocks of the control unit. [Figure 3] This diagram shows the hardware configuration of the control unit. [Figure 4] This diagram shows the usage sequence of the camera integration system. [Figure 5] This figure shows an example of how optical images are displayed in an imaging management application. [Figure 6] This figure shows an example of the display screen immediately after radiography in an imaging management application. [Figure 7] This figure shows an example of the display screen when the image is in standby mode in an image management application. [Figure 8] This is a flowchart of optical image display. [Figure 9] This figure shows an example of how optical images are displayed in an imaging management application. [Figure 10] This figure shows an example of how optical images are displayed in an imaging management application. [Figure 11] This is a flowchart of optical image display. [Figure 12] Figure 12(a) shows the optical image display with the optical image display turned OFF. Figure 12(b) shows the optical image after image processing has been applied. [Figure 13] This is a flowchart of optical image display. [Figure 14] Figure 14(a) shows an example of notification of analysis results in the imaging management application, Figure 14(ba) shows an example of notification of analysis results in the imaging management application, Figure [Figure 15] This is a diagram illustrating the inspection process using a flowchart. [Figure 16] This is a flowchart of the optical image analysis process. [Figure 17]It is a diagram showing the correspondence between the determination result by image analysis and the detection result notification. [Figure 18] It is a diagram showing an example 2 of the display of an optical image in an imaging management application. [Figure 19] It is a diagram showing the setting screen of the shooting method in the imaging management application. [Figure 20] Figure 20(a) is a diagram showing the table of the shooting information management method (a). Figure 20(b) is a diagram showing the table of the shooting information management method (b). Figure 20(c) is a diagram showing the table of the shooting information management method (c). Figure 20(d) is a diagram showing the table of the shooting information management method (d). Figure 20(e) is a diagram showing the table of the shooting information management method (e). [Figure 21] It is a diagram showing the flowchart of the shooting information management method (a). [Figure 22] It is a diagram showing the flowchart of the shooting information management method (b). [Figure 23] It is a diagram showing the flowchart of the shooting information management method (c). [Figure 24] It is a diagram showing the flowchart of the shooting information management method (d). [Figure 25] It is a diagram showing the flowchart of the shooting information management method (e).

Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the invention according to the claims is not limited to the configurations described in the embodiments. Modifications such as replacing or omitting a part of the configuration or a part of the processing with an equivalent within a range where the same effect can be obtained may be made.

[0012] (First Embodiment) [Radiation Imaging System] This section describes the radiation imaging system 1, which is the operating environment for the radiation detection device 10 (radiography device, radiation imaging device). Figure 1 shows a schematic configuration of the radiation imaging system. The radiation imaging system 1 includes radiation detection devices 10 (10A, 10B), a control device 20, radiation generators 30 (30A, 30B), optical imaging devices 40 (40A, 40B), a display unit 25, an operation unit 26, RIS 55, PACS 56, and HIS 57.

[0013] The control device 20 is an information processing device that relays information from the radiation detection device 10, the radiation generator 30, and each device that can be connected via the network 50, and performs various controls. Details of the control device 20 will be described later.

[0014] The radiation generator 30 (radiation irradiation device) is equipped with a radiation tube that generates radiation and irradiates the subject, such as a patient, with radiation. Here, radiation is defined not only as X-rays, but also as alpha rays, beta rays, gamma rays, particle beams, and cosmic rays. Radiation generators 30A and 30B should be selected and used according to the content of the imaging. Unless otherwise specified, these will be collectively referred to as radiation generator 30.

[0015] The radiation detection device 10 (radiography device, radiation imaging device) is a device that generates an image based on the radiation emitted from the radiation generator 30. The radiation detection device 10 is, for example, a flat panel detector. The radiation detection device 10A and the radiation detection device 10B should be selected and used according to the content of the imaging. Unless otherwise specified, these are collectively referred to as the radiation detection device 10.

[0016] The radiation detection device 10 detects radiation emitted from the radiation generator 30 and passed through the subject (test subject), and outputs image data corresponding to the radiation. Note that image data can also be referred to as medical images or radiation images. Specifically, the radiation detection device 10 detects the radiation that has passed through the subject as an electric charge equivalent to the amount of transmitted radiation. For example, the radiation detection device 10 may use a direct conversion sensor such as a-Se, which directly converts radiation into electric charge, or an indirect sensor using a scintillator such as CsI and a photoelectric conversion element such as a-Si, which convert radiation into visible light. Furthermore, the radiation detection device 10 generates image data by performing A / D conversion on the detected charge and outputs it to the control device 20.

[0017] The optical imaging device 40 is a camera device used to photograph the condition of a patient undergoing radiography. The optical imaging device 40A and the optical imaging device 40B should be selected and used according to the content of the imaging. Unless otherwise specified, these are collectively referred to as the optical imaging device 40.

[0018] The display unit 25 is a display device equipped with a monitor such as a liquid crystal display and capable of displaying information. The operation unit 26 is an input device equipped with a keyboard, a pointing device (e.g., a mouse), a touch panel, etc.

[0019] RIS55, PACS56, and HIS57 are services that extend various functions related to radiography by coordinating with the control unit 20 via a network. The control unit 20 is also connected to RIS55, PACS56, and HIS57 via the network 50, and can exchange radiographic images, patient information, etc. In Figure 1, RIS55, PACS56, and HIS57 are shown as being included in the radiographic imaging system 1, but the system may not include at least some of these. Here, RIS is an abbreviation for Radiology Information Systems. PACS is an abbreviation for Picture Archiving and Communication Systems. HIS is an abbreviation for Hospital Information Systems.

[0020] The control device 20 controls radiography using the radiation detection device 10 and the radiation generator 30.

[0021] The radiation imaging device of this embodiment is used, for example, in a sequence as shown in Figure 4. In step 401 (hereinafter referred to as S401, etc.), the user (radiologist) using the radiographic imaging system inputs examination information into the radiographic imaging system 1. In S402, the radiography system 1 begins preparing for radiography. In S403, the radiography system 1 monitors the subject by optical imaging as one of the processes during the preparation period for radiography. In S404, the user positions the radiation detection device 10 and the subject. In S405, the user checks the patient's status displayed on the radiographic imaging system 1. In S406, if the relative positions of the radiation detection device 10 and the subject are not appropriate, the user adjusts the positions of the radiation detection device 10 and the subject. In S407, the user checks the patient's status displayed on the radiation imaging system 1. In S408, the user confirms that the positional relationship between the radiation detection device 10 and the subject is appropriate and instructs the radiation imaging system to perform radiography. In S409, the radiography system 1 performs radiography.

[0022] [Control device] Figure 3 shows the configuration of the control device. The control device 20 includes a CPU 301, a RAM 302, a ROM 303, an external memory 304, a communication I / F unit 305, and a bus 306. The CPU 301, RAM 302, ROM 303, external memory 304, and communication I / F unit 305 are interconnected via the bus 306 so that they can communicate with each other.

[0023] The CPU 301 (Central Processing Unit) comprehensively controls the operation of the control unit 20, and controls each of the configurations shown in Figure 3 via the bus 306.

[0024] RAM 302 (writable memory) functions as the main memory, work area, etc., of the CPU 301. When executing processing, the CPU 301 loads necessary computer programs 3031 and data, etc., from ROM 303 into RAM 302 and executes the computer programs 3031, etc., to realize various functional operations. The control device 20 has application functions that run on the computer. That is, the control device 20 has one or more processors and memory, and the processors realize each of the functional units described below by executing programs stored in memory. However, some or all of each functional unit may be realized by dedicated hardware.

[0025] The ROM 303 (read-only memory) stores the computer program 3031 and data necessary for the CPU 301 to execute processing. The computer program 3031 and data may also be stored in the external memory 304.

[0026] The external memory 304 is a large-capacity storage device, which can be implemented as a hard disk drive or IC memory, for example. The external memory 304 stores various data and information necessary for the CPU 301 to execute and process the computer program 3031, for example. The external memory 304 also stores various data and information obtained as a result of the CPU 301 executing and processing the computer program 3031, for example.

[0027] The communication interface unit 305 is responsible for communication between the control device 20 and the outside world. The control device 20 is connected to the radiation generator 30, radiation detection device 10, and optical imaging device 40 via the communication interface unit 305 using a wired or wireless network or a dedicated line.

[0028] Bus 306 is for enabling communication between the CPU 301, RAM 302, ROM 303, external memory 304, and communication interface unit 305.

[0029] Figure 2 shows the functional block of the control unit.

[0030] The imaging control unit 211 of the control device 20 controls the generation control unit 212, the detection control unit 213, and the optical imaging control unit 214 based on instructions from the operation control unit 210 and inspection information managed by the inspection information management unit. The inspection information includes information such as dose, irradiation time (ms), tube current (mA), tube voltage (kV), and the light field, which is the area where radiation is detected. This information is transmitted to the radiation detection device 10 via the imaging control unit 211 and the detection control unit 213.

[0031] The radiation generation control unit 212 controls the timing of radiation generation by the radiation generator 30 and the radiation imaging conditions.

[0032] The generation control unit 212 outputs information such as irradiation control signals to the radiation generator 30 based on dose information, etc. The irradiation control signals transmitted from the generation control unit 212 to the radiation generator 30 may include two signals: a stop signal (irradiation stop signal) for stopping radiation irradiation and an irradiation signal (non-irradiation stop signal) for irradiating radiation. The generation control unit 212 can control the irradiation and stopping of radiation from the radiation generator 30 by controlling the output of either the stop signal or the irradiation signal.

[0033] The detection control unit 213 communicates with the radiation detection device 10 to perform various controls for radiation imaging (radiography). For example, the detection control unit 213 performs various communication processes with the radiation detection device 10 related to radiation imaging. In this communication process, information such as imaging condition settings, operation control settings, image information, and received dose information is exchanged.

[0034] The optical imaging control unit 214 controls functions such as the start and end of imaging by the optical imaging device 40, the conditions for acquiring optical images, timing, frame rate, zoom, and focus.

[0035] The radiation image acquisition unit 201 receives image data from the radiation detection device 10. The image processing unit 202 performs image processing on the received image data as needed and provides it to the display control unit 209 and the image storage unit 208.

[0036] The display control unit 209 provides the display unit 25 with screen information for the imaging management application, which allows viewing of radiography information. The graphical user interface of the imaging management application displayed on the display unit 25 is linked to operations on the operation unit 26. Therefore, information related to the imaging management application can be input via the operation unit 26. For example, if multiple inspection information items are displayed in a list format on the display unit 25, the operation unit 26 can input an operation to select one inspection information item from the list. The selected inspection information can then be set as the inspection target. Alternatively, the user may directly input inspection information from the operation unit 26. The inspection information entered in the imaging management application is managed by the inspection information management unit 207.

[0037] The optical image acquisition unit 203 acquires optical images from the optical imaging device 40 and provides them to the image processing unit 202 and the optical image analysis unit 205. The optical image acquisition unit 203 can acquire optical images from either or both of the optical imaging devices 40A and 40B. The optical images are preferably moving images, but they may also be still images acquired sporadically. The image processing unit 202 performs image processing on the received optical images as needed and provides them to the optical image display control unit 204 and the image storage unit 208. In addition, the optical images used for analysis may be optical images with a frame rate lower than the acquisition frame rate of the optical imaging device 40.

[0038] The optical image analysis unit 205 performs a determination using the optical image acquired from the optical image acquisition unit 203 and the inspection information acquired from the inspection information management unit 207. Specifically, it analyzes the position, type, and posture of the human body parts in the subject within the optical image and determines whether they match the settings in the inspection information. In this embodiment, the optical image analysis unit 205 uses an inference processing unit 206 that uses machine learning for its determination, but the determination may be performed by other methods.

[0039] The optical image display control unit 204 performs display control for images obtained by the optical imaging device 40. The optical image display control unit 204 performs, for example, processing and adding information to the optical image and provides it to the display control unit 209 as image information. The image information provided to the display control unit 209 is used as part of the information displayed in the graphical user interface of the imaging management application and is displayed on the display unit 25.

[0040] In Figure 1, the control device 20 is shown as a single device for simplicity of explanation, but the control device 20 may be composed of multiple devices. For example, the optical imaging control unit 214, the detection control unit 213, the generation control unit 212, and the display control unit 209 may each be independent control devices, or they may be a combination of control devices that selectively possess multiple functions from among them.

[0041] [Display of optical images] Next, we will explain the display of optical images using Figure 5. Figure 5 shows an example of how optical images are displayed in an imaging management application.

[0042] In this embodiment, the patient's condition during radiography is captured by the optical imaging device 40, and the obtained optical image is used to monitor the patient's condition.

[0043] At the start of a radiographic examination, screen 500 is displayed on the GUI of the imaging management application.

[0044] The screen 500 includes a radiography status 501, patient information 502, examination information 503, radiography image display area 504, optical image window 550, optical image window display change button 506, and examination end button 507.

[0045] The radiography status 501 is information indicating whether or not radiography (imaging operation) can be started. In this embodiment, radiography is started by pressing the start button (not shown), but the radiography status 501 may also serve as the start button. The subject information 502 is information indicating the subject to be radiographed.

[0046] The inspection information 503 contains information such as the content of the imaging in the inspection and thumbnails (reduced images) of the radiographic images acquired by the radiographic image acquisition unit 201. The user can select one imaging content from the list of imaging content in the inspection information 503 and prepare for the next imaging. Upon selection of imaging content, an instruction to prepare for imaging is sent to the radiation detection device 10. This advances one of several steps required for radiographic imaging. On screen 500, the imaging content "Protocol-A" is selected.

[0047] The radiographic image display area 504 is the area where the radiographic images acquired by the radiographic image acquisition unit 201 during the examination are displayed. At the stage when screen 500 is displayed, no images have been taken, so it is a blank area where no radiographic images are placed. Information such as the date and time of the radiographic examination may be superimposed as text in any arrangement at the four corners of the radiographic image display area 504.

[0048] The optical image window display change button 506 is a selection object that allows you to manually change the display / hide (ON / OFF) of the optical image window 505 by pressing it.

[0049] The "End Inspection" button 507 is a selection object that, when pressed, can terminate the inspection.

[0050] The optical image window 550 displays the optical image acquired by the optical image acquisition unit 203, the analysis results from the optical image analysis unit 205, and control buttons for the optical image. The optical image window 550 performs analysis for the currently selected imaging content, "Protocol-A". The optical image window 550 is displayed superimposed on the radiographic image display area 504.

[0051] The optical image window 550 includes an optical image display area 551, camera information 552, an icon 553 indicating that optical image analysis is in progress, an optical image display change button 554, an optical image rotation button 555, and an optical image analysis result 556.

[0052] The optical image display area 551 displays the optical image acquired by the optical image acquisition unit 203. In Figure 5, no image processing has been applied to the optical image, but image processing may be applied to make it easier for the user to view.

[0053] Camera information 552 displays information about the optical imaging device 40.

[0054] The optical image analysis in progress icon 553 indicates whether image analysis is being performed by the optical image analysis unit 205. For example, if optical image analysis is being performed, displaying the icon 553 visually notifies the user that optical image analysis is in progress. If optical image analysis is not being performed, the icon 553 should be hidden or grayed out.

[0055] The optical image display change button 554 is a selection object that allows you to manually change the display or hiding of the optical image in the optical image display area 551.

[0056] The optical image rotation button 555 is a selection object that allows the optical image in the optical image display area 551 to be rotated and displayed. In this embodiment, only left rotation is available, but right rotation may also be added, or the rotation angle may be selected.

[0057] The optical image analysis result 556 is a message area (notification area) that displays the image analysis results (subject status information) performed by the optical image analysis unit 205.

[0058] As the process progresses from the stage shown in Figure 5, the screen transitions to the one shown in Figure 6. Figure 6 shows an example of the display screen immediately after radiographic imaging in the imaging management application.

[0059] When radiography is performed, screen 600 is displayed. On screen 600, the radiographic image 690 is displayed in the radiographic image display area 504. Consequently, the optical image window 550, which was superimposed on the radiographic image display area 504, becomes invisible. Also, the display information of the optical image window display change button 506 switches from "Camera ON" to "Camera OFF".

[0060] Although still image capture is used as an example here, if the content being captured is fluoroscopic imaging (video recording), it is advisable to display the screen shown in Figure 6 during recording. This allows you to constantly check the fluoroscopic images.

[0061] As the process progresses from the stage shown in Figure 6, the screen transitions to the one shown in Figure 7. Figure 7 shows an example of the display screen during the image acquisition standby phase in the image acquisition management application.

[0062] When the next imaging content is selected in the examination information 503, the system returns to a state of readiness to begin the examination and screen 700 is displayed. Screen 700 shows that "Protocol-B" has been selected. On screen 700, the optical image window 750 is superimposed on the radiographic image 650 on the radiographic image display area 504. Analysis for "Protocol-B" is performed in the optical image window 750.

[0063] [Screen display control] Figure 8 illustrates the flow from the start to the end of the inspection. Figure 8 is a flowchart of the optical image display. The control corresponding to this flowchart is executed in the control device 20. In detail, this is achieved when the CPU 301 of the control device 20 loads the program 3031 stored in the ROM 303, etc., into the RAM 302 and acts as the corresponding function.

[0064] In step S801, the control device 20 measures the elapsed time since the imaging content was selected in the imaging management application. After a certain period of time has elapsed, the process proceeds to S802. The time specified here may be changed for the first imaging and subsequent imaging in the examination. It is advisable to set times that are more suitable for the workflow, such as setting time to check patient information for the first imaging and time to check radiographic images for subsequent imaging.

[0065] In step S802, the optical image acquisition unit 203 acquires the optical image captured by the optical imaging device 40. The optical image display control unit 204 then provides image information to the display control unit 209, causing the optical image to be displayed on the display unit 25. As a result, a screen like screen 500 is displayed.

[0066] In S803, the control device 20 checks whether radiography has started. It waits until radiography starts (NO), and if radiography has started (YES), it proceeds to S804. The start of radiography refers, for example, to the radiation detection device 10 starting the radiation accumulation operation. The start may also be defined as the radiation generator 30 starting to irradiate the radiation detection device 10 with radiation, the control device 20 starting to receive images from the radiation detection device 10, or the control device 20 completing the preparation of an image that can be displayed on the display unit 25.

[0067] In S804, the display control unit 209 automatically hides the optical image displayed on the display unit 25 and displays a screen as shown in screen 600.

[0068] In S805, the image storage unit 208 stores optical images. When storing optical images, they are stored in association with radiographic images acquired by the radiographic image acquisition unit 201 and inspection information managed by the inspection information management unit 207.

[0069] The above steps complete the radiographic imaging of the target object, and the process moves on to the next imaging. If there are multiple imaging options within the examination, the next imaging option is selected, and a screen for the next imaging option is displayed, as shown in screen 700. This process is repeated for each registered imaging option.

[0070] [effect] As described in the first embodiment, by displaying the optical image at the user's desired time and hiding it when other displays such as radiographic images are desired, a display suitable for the workflow can be achieved. Furthermore, by displaying the optical image at a smaller size than the radiographic image, additional information such as the corners of the radiographic image, which should be viewed through superimposition, is not hidden, allowing for a display even more suitable for the workflow. In addition, even if content that is not normally viewed is hidden, it can be switched on and off later, making it adaptable to flows other than the normal workflow. Moreover, by saving the optical image at the start of shooting, and saving it in association with radiographic images and inspection information, the circumstances of that shooting can be recorded.

[0071] (Second embodiment) In the first embodiment, an example was shown in which the optical image window 550 is superimposed on a part of the radiation image display area 504. In contrast, the second embodiment is characterized in that the entire radiation image display area 504 is used as the optical image window 550. The configuration for realizing the second embodiment is the same as that of the first embodiment, except for the parts related to the features described above. Therefore, similar components are denoted by the same reference numerals and their detailed descriptions are omitted.

[0072] [Display of optical images] The display of optical images will be explained using Figure 9. Figure 9 shows an example of how optical images are displayed in an imaging management application.

[0073] In this embodiment, the patient's condition during radiography is captured by the optical imaging device 40, and the obtained optical image is used to monitor the patient's condition.

[0074] At the start of a radiographic examination, screen 900 is displayed on the GUI of the imaging management application. Screen 900 differs from screen 500 in that the optical image window 950, which corresponds to the optical image window 550, extends across the entire radiographic image display area 504. By making the window larger, the optical image is made easier to view, and the status of the imaging is made easier to check.

[0075] During and immediately after radiography, screen 1000 is displayed on the GUI of the imaging management application. Screen 1000 differs from screen 600 in that it displays the optical image window 1050 outside the radiography image display area 504. This display allows monitoring of the patient's condition using optical images while simultaneously checking the radiography image during and immediately after radiography.

[0076] [Screen display control] Figure 11 illustrates the flow from the start to the end of the inspection. Figure 11 is a flowchart of the optical image display. The control corresponding to this flowchart is executed in the control device 20. In detail, this is achieved when the CPU 301 of the control device 20 loads the program 3031 stored in the ROM 303, etc., into the RAM 302 and acts as the corresponding function.

[0077] In S601, the control device 20 measures the elapsed time since the previous process. After a certain amount of time has elapsed, the process proceeds to S602.

[0078] In S602, the control device 20 displays an optical image in the radiation image display area 504.

[0079] In S603, the control device 20 checks whether radiography has started. If radiography has started, the process proceeds to S604.

[0080] In S604, the control device 20 displays an optical image outside the radiation image display area 504.

[0081] In S605, the control device 20 checks whether the inspection has been completed. If the inspection has not been completed, the process proceeds to S601. If the inspection has been completed, the process proceeds to S606.

[0082] In S606, the control device 20 hides the optical image and terminates the inspection.

[0083] According to this flow, the optical image is displayed from the start of the examination until it is completed. The fixed time in S601 may be changed for the first and subsequent imaging in the examination, as in the first embodiment. Alternatively, the fixed time in S601 may be set to 0 seconds. As shown in the display example in Figure 10, the optical image window 1050 is displayed outside the area of ​​the radiographic image display area 504, allowing the radiographic image to be viewed. Furthermore, since the subject information can be confirmed by the text at the four corners of the radiographic image display area 504, the subject information 502 may be hidden even when the subject is identified at the start of the examination. In addition, the display can be continued after radiographic imaging so as not to hinder the operator from reviewing the radiographic image after the radiograph.

[0084] [effect] As described in the second embodiment, by switching the display position and size of the optical image according to the process, it becomes possible to produce output that is more suitable for the workflow.

[0085] (Third embodiment) In the first and second embodiments, the optical image displayed was the image itself captured by the optical imaging device 40. The third embodiment is characterized by applying image processing to the displayed optical image. The configuration for realizing the third embodiment is the same as that of the first embodiment, except for the parts related to the features described above. Therefore, similar components are denoted by the same reference numerals and their detailed descriptions are omitted.

[0086] [Display of optical images] The display of optical images will be explained using Figure 12(b). Figure 12(b) shows the optical image after image processing has been applied.

[0087] In the optical image window 1250, an image 1251 that has been subjected to mosaic processing (image processing) is displayed as an optical image. This image processing is performed by the image processing unit 202.

[0088] In Image 1251, mosaic processing is performed as an optical image processing technique. However, the optical image may be processed using shapes such as curves and rectangles to create an image that cannot be identified as the subject. Alternatively, the processing may be limited to areas related to privacy, or the image may be processed by cropping or masking. Furthermore, the image may be replaced with an image of a uniform color, etc., without being based on an optical image. Alternatively, as shown in Figure 12(a), the optical image 1201 in the optical image window 1200 may be hidden. Figure 12(a) shows the state when the optical image display is turned OFF. When the optical image 1201 is hidden, the optical image display change button 1202 switches from displaying "ON" to "OFF". Even if the optical image 1201 is hidden, the optical image analysis is performed and the results are notified, so the user can understand the situation.

[0089] [Screen display control] The detailed flow of the optical image display process (S802, S1102) will be explained using Figure 13. Figure 13 is a flowchart of the optical image display process. The control corresponding to this flowchart is executed in the control device 20. In detail, this is achieved when the CPU 301 of the control device 20 loads the program 3031 stored in the ROM 303, etc., into the RAM 302 and acts as the corresponding function.

[0090] In S1101, the control device 20 acquires an optical image for privacy determination and proceeds to processing in S1102.

[0091] In S1102, the control device 20 performs an analysis of the optical image and proceeds to processing in S1103.

[0092] In S1103, the control device 20 determines whether the current shooting involves privacy. For example, it determines whether the shooting involves light clothing or undressing, or whether the subject of the shooting is the hip joint, and there is a possibility that private parts (genitals, genitals) may be captured in the optical image. If the shooting involves privacy (YES), the process proceeds to S1104; otherwise, it proceeds to S1105 (NO).

[0093] In S1104, the control device 20 processes the optical image because it relates to privacy.

[0094] In S1105, the control device 20 determines the optical image to be displayed. If S1104 has been performed, the processed optical image is determined. The image determined here becomes the image to be displayed in the optical image display processing (S802, S1102).

[0095] In this embodiment, the results of optical image analysis were used for privacy determination, but other information may also be used for privacy determination. For example, whether or not optical imaging related to privacy is performed may be determined from inspection information (image content) entered in advance by the user.

[0096] [effect] As described in the third embodiment above, by implementing privacy-related measures, it becomes possible to produce output that is more suitable for the workflow.

[0097] (Fourth embodiment) In the first embodiment, an example of simply notifying the results of optical image analysis was described. In the fourth embodiment, an example of simply notifying the results of optical image analysis will be described. The configuration for realizing the fourth embodiment is the same as that of the first embodiment, except for the parts related to the features described above. Therefore, similar components are denoted by the same reference numerals and their detailed descriptions are omitted.

[0098] [Notification of analysis results] Next, we will explain in detail how to notify users of the analysis results using Figures 14(a) and 14(b). Figure 14(a) shows an example of analysis result notification 1 in the imaging management application. Figure 14(b) shows an example of analysis result notification 2 in the imaging management application.

[0099] When optical image analysis is performed, first, the optical image analysis target detection frame 10601 is displayed in the screen state 10600 of the optical image window 550 described above. The optical image analysis target detection frame 10601 is a frame that indicates that a single human body has been detected by the optical image analysis unit 205 and shows the detection area (the area to be judged). For example, if no human body is detected in the optical image analysis unit 205, the optical image analysis target detection frame 10601 is hidden, and if a human body is detected, the optical image analysis target detection frame 10601 is displayed. This makes it possible to visually notify the user of the human body detection result and its area in the optical image analysis. If a human body is detected in an abnormal position, an enhanced optical image analysis target detection frame 10651 may be displayed, as shown in the screen state 10650 of the optical image window 550 described above. In other words, the way the optical image analysis target detection frame is displayed may be changed according to the human body detection status.

[0100] Furthermore, in screen state 10600, notification 10602 is displayed as optical image analysis result 556. Notification 10602 is a notification issued when a human body is detected normally in accordance with the examination information. Notification 10602 displays the message "Normal position" and information about the current shooting content (shooting position), which is "frontal chest". This notification allows the user to understand that the human body is in a normal position for the planned shooting content.

[0101] On the other hand, in screen state 10650, notification 10652 is issued as optical image analysis result 556. Notification 10652 is issued when a human body is detected in an abnormal position corresponding to the examination information. Notification 10652 displays the message "Please check the shooting area" and the information of the current shooting content, "front chest". This notification allows the user to understand that the human body is in an abnormal position (inconsistency, error) relative to the planned shooting content.

[0102] [Inspection process] Next, the inspection process will be explained using Figure 15. Figure 15 is a flowchart showing the inspection process. The control corresponding to this flowchart is executed in the control device 20. In detail, this is achieved when the CPU 301 of the control device 20 loads the program 3031 stored in the ROM 303, etc., into the RAM 302 and acts as the corresponding function.

[0103] In S10701, the inspection information management unit 207 prompts the user to select one of several inspection information items obtained from the operation unit 26 and sets it as the inspection target. This process is achieved, for example, by displaying the multiple acquired inspection information items in a list format and setting the selected inspection information as the inspection target in response to the user's input of selecting one inspection information item from the list. Alternatively, the user may directly input the inspection information from the operation unit 26.

[0104] In S10702, the control device 20 starts the inspection by sending a signal to the radiation detection device 10 to transition to a ready state according to the set inspection information. In response to this signal, the radiation detection device 10, for example, controls the bias power supply with the main control circuit and applies a bias voltage to the two-dimensional image sensor. Subsequently, it performs initialization by reading the image signal from the pixel array with the drive circuit in order to read the dark current signal accumulated in the pixels. After initialization is complete, the radiation detection device 10 sends status information to the control device 20 indicating that it is ready to obtain a radiation image. The control device 20 (inspection information management unit 207) also sets the operating parameters (such as tube voltage) of the radiation detection device 10 based on the inspection information selected in S10701. When the control device 20 receives notification from the radiation detection device 10 that it is ready to take images based on the status information, it notifies the radiation detection device 10 of permission to expose.

[0105] In S10703, the optical image acquisition unit 203 acquires the optical image captured by the optical imaging device 40.

[0106] In S10704, the optical image analysis unit 205 analyzes the optical image using the optical image acquired from the optical image acquisition unit 203 and the inspection information acquired from the inspection information management unit 207. For the analysis of the optical image, for example, inference processing using machine learning may be performed by the inference processing unit 206. The images input to the optical image analysis unit 205 may be all images acquired by the optical image acquisition unit 203, or the images to be used may be selected according to the content of the analysis and input to the optical image analysis unit 205. Details of S10704 will be described later.

[0107] In S10705, the control device 20 obtains the result of the determination performed in S10704 and the corresponding detection status notification information. An example of the correspondence between the determination result and the detection status notification is shown in Table 10900 in Figure 17. Figure 17 is a diagram showing the correspondence between the determination result obtained by image analysis and the detection result notification.

[0108] In S10706, the optical image display control unit 204 controls the display content using the optical image acquired by the optical image acquisition unit 203 and the analysis results of the optical image analysis unit 205, and provides it to the display control unit 209. As a result, the controlled display content is displayed on the display unit 25. The optical image display control unit 204 can choose to display the optical image and the analysis results separately, and may control them according to the settings of the control device 20 or the inspection information management unit 207. For example, if optical image analysis is not performed, only the optical image may be displayed on the display unit 25.

[0109] [Optical Image Analysis Processing] Next, with reference to Figure 16, the optical image analysis process (processing of S10704) by the optical image analysis unit 205 will be explained. Figure 16 is a flowchart of the optical image analysis process. The control corresponding to this flowchart is executed in the control device 20. In detail, this is achieved by the CPU 301 of the control device 20 loading the program 3031 stored in the ROM 303, etc., into the RAM 302 and acting as the corresponding function. The order of each step can be any order. Also, the processing of any step may be omitted. Furthermore, the processing of storing display information may be omitted.

[0110] In S10801, the optical image analysis unit 205 determines whether the inspection information acquired by the inspection information management unit 207 is an inspection subject to judgment in optical image analysis. For example, in optical image analysis, the unit analyzes whether the optical image conforms to the content of the specified inspection, so if the inspection information does not contain sufficient information, it is determined to be ineligible. Specifically, this includes cases where, in the case of analysis for the purpose of part determination, the part is not specified in the inspection information, or the part specified is one that the optical image analysis unit 205 cannot analyze. If it is determined to be ineligible, the result transitions to S10808, which indicates that it is ineligible.

[0111] In S10802, display information is stored in the judgment result so that an icon indicating that the inspection is subject to judgment for optical image analysis is displayed, indicating that consistency judgment is being performed.

[0112] In S10803, the optical image analysis unit 205 determines whether the optical image acquired from the optical image acquisition unit 203 contains the subject to be analyzed. A machine learning-based image recognition method may be used to detect the subject. In this case, if the optical image contains not only the patient's body but also other human bodies such as the radiographer preparing for the imaging, the system may determine that the appropriate subject has not been detected and that detection is impossible. If detection is impossible, the system proceeds to the determination result of "no human body detected" in S10809.

[0113] In S10804, display information is stored in the judgment result so that an icon indicating that the inspection is subject to judgment for optical image analysis is displayed, indicating that consistency judgment is being performed.

[0114] In S10805, the optical image analysis unit 205 determines whether the part of the inspection information acquired by the inspection information management unit 207 matches the part of the optical image obtained from the optical image acquisition unit 203. The method for analyzing the part may be an image recognition method using machine learning. If the analysis result is determined to be a mismatch, the process transitions to the determination result of S10810, which indicates a mismatch. If it is not possible to determine whether the part matches or not, the process transitions to the determination result of S10813, which indicates an undetermined result.

[0115] In S10806, the optical image analysis unit 205 determines whether the direction of the inspection information acquired by the inspection information management unit 207 matches the direction of the optical image obtained from the optical image acquisition unit 203. Depending on the inspection information, this determination may not be necessary. The method for analyzing the direction may be an image recognition method using machine learning. If the analysis result is determined to be a mismatch, the system transitions to the determination result of S10811, indicating that the direction does not match. If it is not possible to determine whether the direction matches or does not match, the system transitions to the determination result of S10813, indicating that the determination is not possible.

[0116] In S10807, the optical image analysis unit 205 determines whether the laterality of the inspection information acquired by the inspection information management unit 207 matches the laterality of the optical image obtained from the optical image acquisition unit 203. Depending on the inspection information, this determination may not be necessary. The method for analyzing laterality may be an image recognition method using machine learning. If the analysis result is determined to be inconsistent, the system transitions to the determination result of S10812, indicating that the laterality does not match. If it is not possible to determine whether they match or not, the system transitions to the determination result of S10813, indicating that the determination is not possible. If they match, the system transitions to the determination result of S10814, indicating that they match.

[0117] S10808 to S10814 indicate the status of the judgment result of the optical image analysis unit 205. Depending on each judgment result, the optical image display control unit 204 can control the display content of the optical image window 550. Specifically, the notification content can be controlled as shown in Table 10900 in Figure 17.

[0118] Furthermore, notifications based on optical image analysis results 556 are not limited to text messages. In addition to text, diagrams, symbols, colors, etc., may be used to ensure that each analysis result is distinguishable.

[0119] [effect] As described in the embodiments above, by determining and notifying the user of the consistency between the specified shooting technique and the actual positioning of the subject, the user can become aware of the possibility of image loss in advance. This makes it possible to suppress the occurrence of image loss and improve the efficiency of the workflow.

[0120] (Fifth embodiment) In the first embodiment, an example was described in which multiple optical imaging devices, multiple radiation generators, and multiple radiation detection devices were not distinguished. In the fifth embodiment, an example is described in which multiple radiation generators and multiple radiation detection devices are distinguished. The configuration for realizing the fifth embodiment is the same as that of the first embodiment, except for the parts related to the features described above. Therefore, similar components are denoted by the same reference numerals and their detailed descriptions are omitted.

[0121] The display of optical images will be explained using Figure 18. Figure 18 shows example 2 of the display of optical images in an imaging management application.

[0122] On screen 20600, the imaging information for "Protocol-A" is registered in examination information 20603. This imaging information differs from examination information 503 in that the target of imaging is the "arms and legs" instead of the "chest". Consequently, the descriptions "Camera-A", "Tube-A", and "Sensor-A" in examination information 503 are replaced with "Camera-B", "Tube-B", and "Sensor-B" in examination information 20603. "Camera-A", "Tube-A", and "Sensor-A" correspond to optical imaging device 40A, radiation generator 30A, and radiation detection device 10A, respectively. "Camera-B", "Tube-B", and "Sensor-B" correspond to optical imaging device 40B, radiation generator 30B, and radiation detection device 10B, respectively.

[0123] These devices used for radiography automatically change their linked targets according to the imaging content selected in inspection information 503 and inspection information 20603. In this embodiment, these linked targets are displayed as part of the inspection information so that the user can confirm them. Also, the optical image 20655 displayed in the optical image display area 551 is captured by camera-B, and the camera information 20652 is also switched to "camera-B".

[0124] The imaging information registered in examination information 503 and examination information 20603 is pre-specified in screen 20700 of Figure 19 before radiography. Figure 19 shows the setting screen for the imaging method in the imaging management application.

[0125] Screen 20700 includes a list of imaging methods 20701 and a start examination button 20702. The user can select an imaging method from the list and then select the start examination button 20702 to display a screen with registered imaging information, similar to screens 500 and 20600. When an imaging method is selected from the list of imaging methods 20701, the equipment to be used is determined based on the combination of the equipment configuration information of the radiation imaging system 1 and the imaging method. The information of the determined equipment to be used is displayed as imaging information. The imaging information also includes the image orientation (angle information) of the optical imaging device 40. Because geometric transformations of the image are automatically performed based on the registered image orientation information, the optical image is displayed in the optical image display area 551 with the appropriate orientation by default.

[0126] [Determination of equipment and optical image geometry] Next, we will explain the control involved in determining the device used and image orientation using Figure 21.

[0127] Figure 21 is a flowchart of the shooting information management method (a).

[0128] In S20900, the control device 20 receives input of shooting information from the user and acquires the shooting information.

[0129] In S20901, the control device 20 determines the input imaging area. For simplicity, the determination is made using four areas: "head," "limbs," "abdomen," and "chest," but the imaging area may be classified more finely. If the imaging area is "chest," the process proceeds to S20902. If the imaging area is "abdomen," the process proceeds to S20903.

[0130] If the area being scanned is the "arms or feet," proceed to S20904. If the area being scanned is the "head," proceed to S20905.

[0131] In S20902, the control device 20 determines the devices to be used as "camera A", "tube A", and "sensor A" based on the table of the imaging information management method (a), and determines the optical image geometry (geometric information) as "rotation 0 degrees", "magnification 100%", and "height 120 cm". "Rotation 0 degrees" is rotation information, "magnification 100%" is scaling information, and "height 120 cm" is center coordinate information.

[0132] In S20903, the control device 20 determines the devices to be used as "camera B", "tube B", and "sensor B" based on the table of the shooting information management method (a), and determines the optical image geometry as "rotation 0 degrees", "magnification 50%", and "height 80 cm".

[0133] In S20904, the control device 20 determines the devices to be used as "camera B", "tube B", and "sensor B" based on the table of the imaging information management method (a), and determines the optical image geometry as "rotation 0 degrees", "magnification 200%", and "height 0 cm".

[0134] In S20905, the control device 20 determines the devices to be used as "camera B", "tube B", and "sensor A" based on the table of the imaging information management method (a), and determines the optical image geometry as "rotation 90 degrees", "magnification 100%", and "height 50 cm".

[0135] While the imaging area was used as an example here, the equipment to be used and the optical image geometric transformation may also be determined using patient information such as gender, build, weight, height, and age.

[0136] [effect] As described above, according to the fifth embodiment, the equipment to be used and the optical image geometry can be determined by selecting the imaging area. Therefore, an optical image from an appropriate optical imaging device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0137] Furthermore, positional information, such as coordinates from the ground, can also be indicated as part of the optical image geometry. Therefore, in the case of optical imaging devices that can pan or pan, or optical imaging devices that shoot at a wide angle, it is possible to center the area being photographed in the optical image.

[0138] (Sixth embodiment) In the fifth embodiment, the device to be used and the optical image geometry were determined by selecting the imaging area. In contrast, in the sixth embodiment, the device to be used and the optical image geometry are determined by selecting the imaging type. The configuration for realizing the sixth embodiment is the same as that of the fifth embodiment, except for the parts related to the features described above. Therefore, similar components are denoted by the same reference numerals and their detailed descriptions are omitted.

[0139] Figure 22 is a flowchart of the shooting information management method (b).

[0140] In S21001, the control device 20 receives input of imaging information from the user and acquires the imaging information. Unlike the fifth embodiment in which the imaging area is acquired, in the sixth embodiment the imaging type is acquired. That is, it is assumed that the imaging type has been selected in advance on the imaging type selection screen (not shown).

[0141] In S21002, the control device 20 determines the input imaging type. For simplicity of explanation, here the determination is made using four imaging types: "portable," "sitting," "lying down," and "standing," but imaging types may be classified more finely. If the imaging type is "standing," the process proceeds to S21003. If the imaging area is "lying down," the process proceeds to S21004. If the imaging type is "sitting," the process proceeds to S21005. If the imaging type is "portable," the process proceeds to S21006.

[0142] In S21003, the control device 20 determines the devices to be used as "camera A", "tube A", and "sensor A" based on the table of the imaging information management method (b), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%".

[0143] In S21004, the control device 20 determines the devices to be used as "camera B", "tube B", and "sensor B" based on the table of the shooting information management method (b), and determines the optical image geometry as "rotation 90 degrees" and "magnification 50%".

[0144] In S21005, the control device 20 determines the devices to be used as "camera B", "tube B", and "sensor B" based on the table of the imaging information management method (b), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%".

[0145] In S21006, the control device 20 determines the devices to be used as "camera B", "tube B", and "sensor A" based on the table of the imaging information management method (b), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%".

[0146] [effect] As described above, according to the sixth embodiment, the equipment to be used and the optical image geometry can be determined by selecting the shooting type. Therefore, an optical image from an appropriate optical shooting device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0147] (Seventh Embodiment) In the sixth embodiment, the device to be used and the optical image geometry were determined by selecting the shooting type. In the seventh embodiment, a method for managing shooting information in an environment where "Tube A" and "Camera A" are always operated as a set, and "Tube B" and "Camera B" are always operated as a set, will be described. This embodiment is used when it is desired to have close coordination with the radiation tube, such as when the optical shooting device is installed near the radiation tube. The configuration for realizing the seventh embodiment is the same as that of the sixth embodiment, except for the parts related to the features described above. Therefore, the same reference numerals are used to describe the same configuration, and their detailed explanation is omitted.

[0148] Figure 23 is a flowchart of the shooting information management method (c).

[0149] In S21001, the control device 20 acquires imaging information in the same manner as in the sixth embodiment.

[0150] In S21002, the control device 20 determines the imaging type in the same manner as in the sixth embodiment. If the imaging type is "standing," the process proceeds to S21101. If the imaging area is "lying down," the process proceeds to S21102. If the imaging type is "sitting," the process proceeds to S21003. If the imaging type is "portable," the process proceeds to S21004.

[0151] In S21001, the control device 20 determines the devices to be used to be "camera A", "tube A", and "sensor A" based on the table of the shooting information management method (c).

[0152] In S21002, the control device 20 determines the devices to be used to be "camera B", "tube B", and "sensor B" based on the table of the shooting information management method (c).

[0153] In S21003, the control device 20 determines the devices to be used to be "camera B", "tube B", and "sensor B" based on the table of the shooting information management method (c).

[0154] In S21004, the control device 20 determines the devices to be used to be "camera B", "tube B", and "sensor A" based on the table of the shooting information management method (c).

[0155] In S21005, the control device 20 determines which radiation tube to use. If the radiation tube to be used is "Tube B", the process proceeds to S21006. If the radiation tube to be used is "Tube A", the process proceeds to S21007.

[0156] In S21006, the control device 20 determines the device to be used as "Camera B" based on the table of the shooting information management method (c), and determines the optical image geometry as "rotation 180 degrees" and "magnification 50%".

[0157] In S21007, the control device 20 determines the device to be used as "Camera B" based on the table of the shooting information management method (c), and determines the optical image geometry as "Rotation 0 degrees" and "Magnification 100%".

[0158] [effect] As described above, according to the seventh embodiment, the equipment to be used and the optical image geometry can be determined by selecting the shooting type. Therefore, an optical image from an appropriate optical shooting device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0159] (Eighth embodiment) In the sixth embodiment, the device to be used and the optical image geometry were determined by selecting the shooting type. In the eighth embodiment, a method for managing shooting information in an environment where "Sensor A" and "Camera A" are always operated as a set, and "Sensor B" and "Camera B" are always operated as a set will be described. This embodiment is used when it is desired to display radiation images and optical images in the same way, or to match the scanning direction and reading direction of the radiation detection device with the optical image, or when it is desired to closely coordinate the optical shooting device with the radiation detection device. The configuration for realizing the eighth embodiment is the same as that of the sixth embodiment, except for the parts related to the features described above. Therefore, similar configurations are denoted by the same reference numerals and their detailed explanations are omitted.

[0160] Figure 24 is a flowchart illustrating the shooting information management method (d).

[0161] In S21001, the control device 20 acquires imaging information in the same manner as in the sixth embodiment.

[0162] In S21002, the control device 20 determines the imaging type in the same manner as in the sixth embodiment. If the imaging type is "standing," the process proceeds to S21201. If the imaging area is "lying down," the process proceeds to S21202. If the imaging type is "sitting," the process proceeds to S21203. If the imaging type is "portable," the process proceeds to S21204.

[0163] In S21201, the control device 20 determines the devices to be used as "tube A" and "sensor A" based on the table of the imaging information management method (d).

[0164] In S21202, the control device 20 determines the devices to be used as "tube B" and "sensor B" based on the table of the imaging information management method (d).

[0165] In S21203, the control device 20 determines the devices to be used as "tube B" and "sensor B" based on the table of the imaging information management method (d).

[0166] In S21204, the control device 20 determines the devices to be used as "tube B" and "sensor A" based on the table of the imaging information management method (d).

[0167] In S21205, the control device 20 determines which radiation detection device to use. If the radiation detection device to be used is "Sensor B", the process proceeds to S21006. If the radiation tube to be used is "Sensor A", the process proceeds to S21007.

[0168] In S21006, the control device 20 determines the device to be used as "Camera B" based on the table of the shooting information management method (d), and determines the optical image geometry as "rotation 270 degrees" and "magnification 50%".

[0169] In S21007, the control device 20 determines the device to be used as "Camera A" based on the table of the shooting information management method (d), and determines the optical image geometry as "Rotation 0 degrees" and "Magnification 100%".

[0170] [effect] As described above, according to the eighth embodiment, the equipment to be used and the optical image geometry can be determined by selecting the shooting type. Therefore, an optical image from an appropriate optical shooting device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0171] (Ninth embodiment) In the sixth embodiment, the device to be used and the optical image geometry were determined by selecting the shooting type. In the ninth embodiment, the cases in which multiple optical shooting devices are selected and the cases in which "none" optical shooting devices are selected will be described. The configuration for realizing the ninth embodiment is the same as that of the sixth embodiment, except for the parts related to the features described above. Therefore, similar components are denoted by the same reference numerals and their detailed descriptions are omitted.

[0172] Figure 25 is a flowchart of the shooting information management method (e).

[0173] In S21001, the control device 20 acquires imaging information in the same manner as in the sixth embodiment.

[0174] In S21002, the control device 20 determines the imaging type in the same manner as in the sixth embodiment. If the imaging type is "standing," the process proceeds to S21301. If the imaging area is "lying down," the process proceeds to S21302. If the imaging type is "sitting," the process proceeds to S21303. If the imaging type is "portable," the process proceeds to S21304.

[0175] In S21301, the control device 20 determines the devices to be used as "camera A", "tube A", and "sensor A" based on the table of the imaging information management method (d), and determines the optical image geometry as "rotation 0 degrees" and "magnification 100%".

[0176] In S21302, the control device 20 determines the devices to be used as "Camera A: Analysis Only," "Tube B," and "Sensor B" based on the table of the shooting information management method (d). Here, "Camera A: Analysis Only" indicates that it is used only for analysis and not for optical image display. In other words, only information based on the analysis results from the optical image analysis unit 205 is displayed in the optical image window 550. This is because, depending on the shooting type and shooting area, there may be cases where the optical image does not want to be displayed due to privacy concerns, but the analysis results of the optical image do want to be displayed.

[0177] In S21303, the control device 20 determines the equipment to be used to be "Camera: None", "Tube B", and "Sensor B" based on the table of the imaging information management method (d). Here, "Camera: None" means that an optical imaging device will not be used. This is because, depending on the type of imaging and the area to be imaged, the imaging procedure and the area to be imaged may be limited, and in cases where confirmation with an optical imaging device is not essential, it is conceivable that an optical imaging device will not be used.

[0178] In S21304, the control device 20 determines the devices to be used as "Camera A, Camera B", "Tube B", and "Sensor A" based on the table of the imaging information management method (d), and determines the optical image geometry as "Camera A: 0 degrees, 100%" and "Camera B: 90 degrees, 50%".

[0179] This assumes the use of various types of optical imaging devices, such as optical imaging devices installed on the ceiling. When displaying optical images obtained from multiple optical imaging devices, the system may automatically select the image to display by analyzing the acquired images. For example, it is advisable to use the optical imaging device that is closest or the one that captures the subject most prominently. Alternatively, the system may use the optical image from the optical imaging device with the fewest obstructions between it and the subject. Furthermore, optical images captured by multiple optical imaging devices may be combined and displayed in the optical image display area 551 of the optical image window 550.

[0180] [effect] As described above, according to the ninth embodiment, the equipment to be used and the optical image geometry can be determined by selecting the shooting type. Therefore, an optical image from an appropriate optical shooting device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0181] (Other examples) The present invention is not limited to the embodiments described above, and various modifications (including organic combinations of each embodiment) are possible based on the spirit of the invention, and these are not excluded from the scope of the invention. In other words, all configurations that combine the above-described embodiments and their modified forms are included in the present invention.

[0182] Figure 1 illustrates a system with two of each device, such as radiation detection devices 10 (10A, 10B), control devices 20, radiation generators 30 (30A, 30B), and optical imaging devices 40 (40A, 40B). However, the number of devices can be three or more.

[0183] The information on the devices used and the optical image geometry associated with the imaging information is not limited to those listed in Figures 20(a) to (e). Various environments are expected for radiography. For example, the optical imaging device may not be mounted close to the radiograph tube, but rather on the ceiling of the radiography room. Therefore, the information on the devices used and the optical image geometry associated with imaging information such as the imaging area and type may be editable by the user. By pre-determining the information on the devices used and the optical image geometry associated with specific imaging information, the user can then retrieve similar information by selecting the imaging information.

[0184] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0185] A processor or circuit may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), or a field-programmable gateway (FPGA). It may also include a digital signal processor (DSP), a dataflow processor (DFP), or a neural processing unit (NPU).

[0186] The radiography system in each of the embodiments described above may be implemented as a single device, or as a combination of multiple devices that can communicate with each other to perform the above-described processing; both are included in the embodiments of the present invention. The above-described processing may also be performed using a common server device or group of servers. The multiple devices constituting the radiography system only need to be able to communicate at a predetermined communication rate, and do not need to be located in the same facility or in the same country.

[0187] The embodiment includes a configuration in which a software program that realizes the functions of the embodiment described above is supplied to a system or device, and the computer of the system or device reads and executes the code of the supplied program.

[0188] Therefore, the program code installed on the computer to implement the processing according to the embodiment is itself one of the embodiments of the present invention. Furthermore, based on the instructions contained in the program read by the computer, the operating system running on the computer may perform part or all of the actual processing, and the functions of the above-described embodiment can also be realized through that processing.

[0189] (Note) This embodiment includes the following configurations and methods.

[0190] [Note 1] A radiation imaging system comprising: a radiation irradiation device for irradiating a subject with radiation; a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject; an optical imaging device for optically photographing the subject; and an information processing device that allows information related to radiation imaging using the radiation imaging device to be viewed on a display unit, The information processing device is characterized by performing display control of an optical image acquired from the optical imaging device in accordance with the progress of a predetermined step among a plurality of steps for performing the radiographic imaging.

[0191] [Note 2] The radiation imaging system according to Appendix 1, characterized in that the predetermined step is a step of giving an imaging preparation instruction to the radiation imaging device.

[0192] [Note 3] The radiation imaging system according to Appendix 1 or 2, characterized in that the predetermined step is a step in which the radiation imaging device starts an imaging operation.

[0193] [Note 4] The information processing device is capable of superimposing the radiographic image acquired by the radiographic imaging and the optical image, The radiation imaging system according to any one of the appendices 1 to 3, characterized in that, in the superimposed display, the optical image is displayed at a smaller size than the radiation image.

[0194] [Note 5] The radiation imaging system according to any one of appendices 1 to 4, characterized in that the screen displayed by the information processing device includes a selection object for turning the display of the optical image ON or OFF.

[0195] [Note 6] The information processing device performs a predetermined process as a display process of the optical image on the display unit based on information regarding the state of the subject, The radiation imaging system according to any one of the appendices 1 to 5, characterized in that the predetermined processing is one of displaying, not displaying, or processing the image and then displaying.

[0196] [Note 7] The radiation imaging system according to any one of appendices 1 to 5, characterized in that the information processing device displays state information relating to the subject on the display unit based on the analysis results of the optical image.

[0197] [Note 8] The radiation imaging system according to any one of appendices 1 to 5, characterized in that the information processing device displays the state information and the optical image on the same screen of the display unit.

[0198] [Note 9] The radiation imaging system according to any one of appendices 1 to 5, characterized in that the information processing device displays the state information on the screen of the display unit without displaying the optical image.

[0199] [Note 10] The radiography imaging system according to any one of the appendices 1 to 7, characterized in that the information processing device stores the optical image in association with the inspection information relating to the radiography.

[0200] [Note 11] The radiation imaging system according to Appendix 10, characterized in that the information processing device determines, based on information regarding the state of the subject, whether to save, not save, or process and save the optical information.

[0201] [Note 12] The aforementioned image processing is characterized by image processing that applies mosaic processing to part or all of an optical image, or image processing that replaces it with a figure or the like, as described in Appendix 6 of the Radiation Imaging System.

[0202] [Note 13] The aforementioned image processing is characterized by image processing that applies mosaic processing to part or all of an optical image, or image processing that replaces it with a figure or the like, as described in Appendix 9 of the radiation imaging system.

[0203] [Note 14] An information processing device used in a radiation imaging system comprising a radiation irradiation device for irradiating a subject with radiation, a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject, and an optical imaging device for optically photographing the subject, An information processing device characterized by having means for controlling the display of an optical image acquired from an optical imaging device in accordance with the progress of a predetermined step among a plurality of steps for performing the aforementioned radiographic imaging.

[0204] [Note 15] A control method for an information processing device used in a radiation imaging system comprising a radiation irradiation device for irradiating a subject with radiation, a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject, and an optical imaging device for optically photographing the subject, A control method characterized by having a step of controlling the display of an optical image acquired from an optical imaging device in accordance with the progress of a predetermined step among a plurality of steps for performing the aforementioned radiographic imaging.

[0205] [Note 16] A program to cause a computer to execute the control method described in Appendix 15.

[0206] [Note 17] A radiation imaging system comprising: a radiation irradiation device for irradiating a subject with radiation; a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject; an optical imaging device for optically photographing the subject; and an information processing device that allows information related to radiation imaging using the radiation imaging device to be viewed on a display unit, The aforementioned information processing device is Means for acquiring an optical image from the aforementioned optical imaging device, A means of obtaining information regarding the shooting position, A radiation imaging system characterized by having means for notifying information regarding the suitability of the imaging based on the optical image and the information regarding the imaging position.

[0207] [Note 18] An information processing device used in a radiation imaging system comprising a radiation irradiation device for irradiating a subject with radiation, a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject, and an optical imaging device for optically photographing the subject, Means for acquiring an optical image from the aforementioned optical imaging device, A means of obtaining information regarding the shooting position, An information processing device characterized by having means for notifying information regarding the suitability of the shooting based on the optical image and the information of the shooting position.

[0208] [Note 19] A display unit that displays information, The information processing apparatus according to Appendix 18, characterized by having means for displaying information regarding the suitability of the aforementioned photograph on the display unit.

[0209] [Note 20] The information processing apparatus according to Appendix 19, characterized in that it has means for displaying on the display unit whether or not a human body can be detected from the optical image.

[0210] [Note 21] The information processing apparatus according to Appendix 20, characterized in that it has means for displaying the area of ​​integrity determination identified by the human body detection on the display unit by superimposing it on the optical image.

[0211] [Note 22] The information processing device according to any one of appendices 19 to 21, characterized in that it has means for displaying a notification on the display unit that the position, type, and posture of the human body part obtained from the optical image are consistent with the information regarding the shooting position.

[0212] [Note 23] The information processing device according to any one of the appendices 19 to 22, characterized in that it has means for displaying on the display unit that there is a mismatch between the information on the position, type, and posture of a human body part obtained from the optical image and the information on the shooting position.

[0213] [Note 24] The information processing apparatus according to any one of appendices 19 to 23, characterized in that it has means for displaying on the display unit that a determination is impossible when consistency with the information regarding the shooting position cannot be confirmed from the information obtained from the optical image.

[0214] [Note 25] The information processing apparatus according to Appendix 18, characterized by having a determination means for making a determination based on the information of the subject's body position obtained from the optical image and the information of the shooting position.

[0215] [Note 26] The information processing device according to Appendix 25, characterized in that the determination means detects a human body to be determined when performing consistency determination.

[0216] [Note 27] The information processing device according to Appendix 26, characterized in that the determination means determines that consistency exists when the position, type, and posture of the human body part that is the subject of the consistency determination match the information regarding the shooting position.

[0217] [Note 28] The information processing device according to Appendix 26 or 27, characterized in that the determination means determines that there is a mismatch when at least one of the position, type, and posture of the human body part that is the subject of the consistency determination differs from the information of the shooting position.

[0218] [Note 29] The information processing device according to any one of Appendix 26 to 28, characterized in that the determination means determines that determination is impossible when it is not possible to determine the consistency of at least one of the position, type, and posture of the human body part that is the subject of the consistency determination.

[0219] [Note 30] The information processing apparatus according to any one of appendices 26 to 29, characterized in that the determination means performs the determination means by inputting the optical image at a frame rate lowered from the acquisition frame rate of the image acquisition means.

[0220] [Note 31] A control method for an information processing device used in a radiation imaging system comprising a radiation irradiation device for irradiating a subject with radiation, a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject, and an optical imaging device for optically photographing the subject, The process of acquiring an optical image from the aforementioned optical imaging device, The process of obtaining information regarding the shooting position, A control method characterized by comprising the step of notifying information regarding the suitability of the shooting based on the optical image and the information regarding the shooting position.

[0221] [Note 32] A radiation imaging system comprising: a radiation irradiation device for irradiating a subject with radiation; a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject; a plurality of optical imaging devices for optically photographing the subject, each comprising at least a first optical imaging device and a second optical imaging device; and an information processing device that allows information relating to radiation imaging using the radiation imaging device to be viewed on a display unit, The aforementioned information processing device is A means for obtaining the imaging information for the next radiographic image, A means for determining, based on the aforementioned imaging information, which optical image can be obtained from the first optical imaging apparatus and the second optical imaging apparatus to be displayed on the display unit during the period until the next radiographic imaging, A radiation imaging system characterized by having the following features.

[0222] [Note 33] An information processing device used in a radiation imaging system having a radiation irradiation device for irradiating a subject with radiation, a radiation imaging device for acquiring a radiation image based on the radiation that has passed through the subject, and a plurality of optical imaging devices for optically photographing the subject, the plurality of optical imaging devices comprising at least a first optical imaging device and a second optical imaging device, A display unit capable of displaying information, A means of obtaining imaging information related to the following radiography, An information processing apparatus characterized by having means for determining, based on the aforementioned imaging information, an optical image to be displayed on the display unit during the period until the next radiographic imaging, from among the optical images obtainable from the first optical imaging apparatus and the second optical imaging apparatus.

[0223] [Note 34] The information processing device according to Appendix 33, characterized in that, during the period until the next radiographic imaging, it acquires an optical image using only one of the first optical imaging device and the second optical imaging device, and displays the acquired optical image on the display unit.

[0224] [Note 35] The information processing device described in Appendix 34 is characterized in that it determines which optical imaging device to be used to acquire an optical image from among the plurality of optical imaging devices based on predetermined conditions, and the predetermined conditions include one of the following conditions: the distance between the subject and the optical imaging device is short, there are few obstructions between the subject and the optical imaging device, or the subject is large in the image.

[0225] [Note 36] The information processing device according to Appendix 33, characterized in that, during the period until the next radiographic imaging, it combines a first optical image acquired from the first optical imaging device and a second optical image acquired from the second optical imaging device and displays them on the display unit.

[0226] [Note 37] The radiation imaging system comprises a plurality of radiation irradiation devices, including the radiation irradiation device. The information processing device according to any one of appendices 33 to 36, characterized in that the information processing device has means for setting one of the plurality of radiation irradiation devices to be a device that uses radiation irradiation devices based on the imaging information.

[0227] [Note 38] The aforementioned radiation imaging system comprises a plurality of radiation imaging devices, including the aforementioned radiation imaging device. The information processing device according to any one of appendices 33 to 37, characterized in that the information processing device is set to a device that uses one of the plurality of radiation imaging devices based on the imaging information.

[0228] [Note 39] The information processing device according to any one of appendices 33 to 38, characterized in that the information processing device has means for controlling a screen to be displayed on the display unit based on information from any one of the following: a radiation image obtained from the radiation imaging device, an optical image obtained from the optical imaging device, or an analysis result obtained by analyzing the optical image.

[0229] [Note 40] The information processing device according to any one of appendices 33 to 39, characterized in that the information processing device controls the ON / OFF of the display of the optical image obtained from the optical imaging device based on the imaging information.

[0230] [Note 41] The information processing device according to any one of appendices 33 to 40, characterized in that the information processing device controls the ON / OFF of the display of analysis results based on the optical image obtained from the optical imaging device based on the imaging information.

[0231] [Note 42] The information processing device according to any one of appendices 33 to 41, characterized in that it performs image processing on an optical image acquired from an optical imaging device based on geometric information obtained based on the imaging information.

[0232] [Note 43] The radiation imaging system according to Appendix 42, characterized in that the geometric information includes one of the following: rotation information, scaling information, or center coordinate information of the optical image.

[0233] [Note 44] The information processing device according to any one of appendices 33 to 43, characterized in that the aforementioned imaging information includes one of the following: imaging technique (standing, supine, sitting, portable), imaging site, and patient information.

[0234] [Note 45] A control method for an information processing device used in a radiation imaging system comprising: a radiation irradiation device for irradiating a subject with radiation; a radiation imaging device for acquiring a radiation image based on radiation that has passed through a subject; and a plurality of optical imaging devices for optically photographing the subject, each comprising at least a first optical imaging device and a second optical imaging device, wherein The next step is to obtain imaging information related to radiography, A control method, comprising: determining an optical image to be displayed on a display unit during a period until the next radiographic imaging among optical images that can be acquired from the first optical imaging device and the second optical imaging device based on the imaging information.

[0235] [Appendix 46] A program for causing a computer to execute the control method according to Appendix 45.

Explanation of Signs

[0236] 20 Control device 201 Radiation image acquisition unit 202 Image processing unit 203 Optical image acquisition unit 204 Optical image display control unit 205 Optical image analysis unit 206 Inference processing unit 207 Inspection information management unit 208 Image storage unit 209 Display control unit 30 Radiation generator 10 Radiation detection device 40 Optical imaging device 25 Display unit 26 Operation unit

Claims

1. A radiography system comprising: a radiography apparatus for acquiring radiographic images by radiography; an optical imaging apparatus for optically photographing a subject for radiography; and an information processing apparatus for displaying the optical images acquired by the optical imaging on a display unit, The information processing device has means for displaying the optical image in a predetermined display area of ​​the display unit from a time before the start of the radiography, and for controlling the display so that the optical image is not displayed in the predetermined display area at the time the radiography starts. The radiography system is characterized in that the start time of the radiography is after the instruction to start the radiography and before the information processing device has completed acquiring the radiographic image.

2. An information processing device used in a radiography system comprising a radiography apparatus for acquiring radiographic images by radiography and an optical imaging apparatus for optically photographing a subject of radiography and acquiring an optical image, The system includes means for displaying the optical image in a predetermined display area of ​​the display unit from a point before the start of the radiography, and for controlling the display so that the optical image is not displayed in the predetermined display area at the start of the radiography. The information processing device is characterized in that the start time of the radiographic imaging is the time after the instruction to start the radiographic imaging and before the information processing device completes the acquisition of the radiographic image.

3. The information processing device according to claim 2, characterized in that the start time of the radiography is the time when the radiography apparatus starts the accumulation operation for obtaining the radiographic image.

4. The information processing device according to claim 2, characterized in that the start time of the aforementioned radiographic imaging corresponds to the start time of radiation irradiation by the radiation irradiation device.

5. The optical image in the predetermined display area is arranged to be superimposed on the display area of ​​the radiation image. The information processing apparatus according to claim 2, characterized in that the predetermined display area is smaller than the display area of ​​the radiation image.

6. The information processing apparatus according to claim 2, characterized in that the screen displayed on the display unit includes a selection object for turning the display of the optical image ON or OFF.

7. The information processing device performs a predetermined process as a display process for the optical image based on the information regarding the state of the subject, The information processing apparatus according to claim 2, characterized in that the predetermined processing is one of the following: display, not display, or process the image and then display.

8. The information processing device according to claim 2, characterized in that it displays status information relating to the subject on the display unit based on the detection processing result of the subject using the optical image.

9. The information processing apparatus according to claim 8, characterized in that the information processing apparatus displays the state information and the optical image on the same screen of the display unit.

10. The information processing device according to claim 8, characterized in that, when the analysis result of the optical image is a predetermined result, the information processing device displays the status information on the screen of the display unit without displaying the optical image.

11. The information processing device according to claim 2, characterized in that it stores the optical image in association with the inspection information relating to the radiography.

12. The information processing device according to claim 10, characterized in that, based on information regarding the state of the subject, it determines, as processing the optical image, to save, not save, or process the image and save.

13. The information processing apparatus according to claim 7, characterized in that the image processing is a mosaic process or a figure replacement process applied to part or all of the optical image.

14. A control method for an information processing device used in a radiography system comprising a radiography apparatus for acquiring radiographic images by radiography and an optical imaging apparatus for optically photographing a subject of radiography and acquiring an optical image, The process includes a step of displaying the optical image in a predetermined display area of ​​the display unit from a point before the start of the radiography, and controlling the display so that the optical image is not displayed in the predetermined display area at the start of the radiography, The control method is characterized in that the start time of the radiographic imaging is after the instruction to start the radiographic imaging and before the information processing device has completed acquiring the radiographic image.

15. A program for causing a computer to execute the control method described in claim 14.

16. A radiography system comprising: a radiography apparatus for acquiring radiographic images by radiography; an optical imaging apparatus for optically photographing a subject for radiography; and an information processing apparatus that allows viewing of information related to radiography on a display unit, The information processing device has means for displaying screen information on the display unit such that a second display area, which includes an optical image acquired from the optical imaging device, is superimposed on a first display area for displaying the radiation image. The radiography system is characterized in that the second display area separately provides notification information corresponding to the detection processing result of a subject based on the optical image, in addition to the optical image.

17. In an information processing device used in a radiography system having a radiography apparatus for acquiring radiographic images by radiography and an optical imaging apparatus for optically photographing the subject of the radiography, Means for displaying screen information on a display unit such that a second display area containing an optical image acquired from the optical imaging device is superimposed on a first display area for displaying the aforementioned radiographic image, The information processing apparatus is characterized in that the second display area separately provides notification information corresponding to the detection processing result of a subject based on the optical image, in addition to the optical image.

18. The information processing device according to claim 17, characterized in that the notification information is information regarding the suitability of taking a photograph.

19. The information processing device according to claim 17, characterized in that the notification information is information relating to whether or not the subject can be detected.

20. The information processing apparatus according to claim 17, characterized in that the notification information is information indicating the detection status of the subject and is displayed superimposed on the optical image.

21. A control method for an information processing device used in a radiography system comprising a radiography apparatus for acquiring radiographic images by radiography and an optical imaging apparatus for optically photographing a subject of radiography and acquiring an optical image, The process includes displaying screen information on a display unit such that a second display area, which includes an optical image acquired from the optical imaging device, is superimposed on a first display area for displaying the aforementioned radiation image. The control method is characterized in that the second display area separately provides notification information corresponding to the detection processing result of a subject based on the optical image, in addition to the optical image.

22. A program for causing a computer to execute the control method described in claim 21.

23. A radiography system comprising: a radiography apparatus for acquiring radiographic images by radiography; a plurality of optical imaging apparatuses for optically photographing a subject of radiography, each comprising at least a first optical imaging apparatus and a second optical imaging apparatus; and an information processing apparatus on which information relating to the radiography can be viewed on a display unit, The aforementioned information processing device is A registration means for registering first imaging information and second imaging information as imaging information for multiple sequentially executed radiographic imaging, If the next radiography performed corresponds to the first radiography information, the means for displaying the first optical image acquired from the first optical imaging device on the display unit, and if the next radiography performed corresponds to the second radiography information, the means for displaying the second optical image acquired from the second optical imaging device on the display unit, It has, A radiography system characterized in that the first optical image is rotated or scaled and displayed based on the information set in the first imaging information, and the second optical image is rotated or scaled and displayed based on the information set in the second imaging information.

24. An information processing device used in a radiography system having a radiography apparatus for acquiring radiographic images by radiography and a plurality of optical imaging apparatuses for optically photographing a subject of radiography, the plurality of optical imaging apparatuses comprising at least a first optical imaging apparatus and a second optical imaging apparatus, A means for registering first imaging information and second imaging information as imaging information for multiple sequentially executed radiographic imaging, The system includes means for displaying a first optical image acquired from the first optical imaging device on the display unit if the next radiography performed corresponds to the first imaging information, and for displaying a second optical image acquired from the second optical imaging device on the display unit if the next radiography performed corresponds to the second imaging information. An information processing device characterized in that the first optical image is rotated or scaled and displayed based on the information set in the first shooting information, and the second optical image is rotated or scaled and displayed based on the information set in the second shooting information.

25. The information processing device according to claim 24, further comprising means for displaying a list of multiple shooting information, including the first shooting information and the second shooting information, on the display unit, wherein in the list, the item for the first shooting information includes identification information of the first optical shooting device, and the item for the second shooting information includes identification information of the second optical shooting device.

26. The information processing apparatus according to claim 24, characterized in that the first optical image is rotated or scaled and displayed based on the information set in the first shooting information, and the second optical image is rotated or scaled and displayed based on the information set in the second shooting information.

27. The information processing device according to claim 24, characterized in that the imaging information includes at least one of the imaging procedure (standing, lying down, sitting, portable), imaging site, or patient information.

28. A control method for an information processing device used in a radiography system comprising a radiography apparatus for acquiring radiographic images by radiography and a plurality of optical imaging devices for optically photographing a subject of radiography, the plurality of optical imaging devices comprising at least a first optical imaging device and a second optical imaging device, wherein the system comprises a radiography apparatus for acquiring radiographic images by radiography and a plurality of optical imaging devices for optically photographing the subject of radiography, the plurality of optical imaging devices comprising at least a first optical imaging device and a second optical imaging device, The process involves registering the first and second imaging information as imaging information for multiple sequentially executed radiographic imagings, The process includes the steps of: displaying a first optical image acquired from the first optical imaging device on the display unit if the next radiography performed corresponds to the first imaging information; and displaying a second optical image acquired from the second optical imaging device on the display unit if the next radiography performed corresponds to the second imaging information. A control method characterized in that the first optical image is rotated or scaled and displayed based on the information set in the first shooting information, and the second optical image is rotated or scaled and displayed based on the information set in the second shooting information.

29. A program for causing a computer to execute the control method described in claim 28.

Images