Radiographic imaging system, information processing apparatus, control method therefor, and program

Abstract

The invention relates to a radiographic imaging system, an information processing apparatus, a control method therefor, and a program. The radiographic imaging apparatus includes: an optical image capturing apparatus that captures an optical image of a radiographic subject; and an information processing device that causes a display unit to display the optical image acquired by the optical image capturing device. The information processing apparatus acquires information on steps according to progress from among a plurality of steps related to radiography. The information processing apparatus stops displaying the optical image on the display unit based on the step indicated by the information being a predetermined step among the plurality of steps.

Description

Technical Field

[0001] The present disclosure relates to a radiographic imaging system using an optical image. The radiographic imaging system includes an information processing device that displays information related to radiographic imaging performed using a radiographic imaging device, and software executed by the information processing device. For example, the radiographic imaging device is a flat panel detector (FPD). For example, the information processing device is a PC. For example, the software is an imaging management application. Background Art

[0002] Radiographic imaging devices using a flat panel detector (FPD) formed of a semiconductor material are widely used as imaging devices for diagnostic medical imaging and nondestructive testing based on radiation. For example, in diagnostic medical imaging, such radiographic imaging devices are used as digital imaging devices for static imaging (such as ordinary radiography) and dynamic imaging (such as fluoroscopy).

[0003] In radiography, subject positioning is performed as an initial step, and it has been observed that in some cases, incorrect positioning may lead to rejection. Recently, a radiographic imaging system (radiography system) equipped with an optical camera (optical image capture device) that allows the condition of the subject to be checked has been proposed as a configuration for assisting positioning.

[0004] Japanese Patent Laid-Open No. 2013-48740 describes a component for guiding the positioning of a subject suitable for radiography by using a subject image acquired by an optical image capture device during radiography. In addition, in Japanese Unexamined Patent Application Publication No. 2020-199163, an image acquired from an optical image capture device can be analyzed, and the analysis result can be displayed on a radiography screen to notify the user.

[0005] The systems described in Japanese Patent Laid-Open No. 2013-48740 and Japanese Patent Laid-Open No. 2020-199163 have room for improvement in terms of ease of use. It is desirable that an image acquired from an optical image capture device in this manner or information based on the image be outputted with content and timing appropriate to the radiographic process step. Summary of the invention

[0006] The present disclosure has been devised in view of the above-mentioned problems, and one object thereof is to provide a radiographic imaging system in which output information obtained based on an optical image capturing device can be appropriately output to be suitable for the steps of a radiographic process.

[0007] The present disclosure provides a radiographic imaging device, which includes: an optical image capturing device that captures an optical image of a radiographic subject; and an information processing device that causes a display unit to display the optical image acquired by the optical image capturing device, wherein the information processing device acquires information about a step from a plurality of steps related to the radiography according to progress, and wherein the information processing device stops displaying the optical image on the display unit based on the step indicated by the information being a predetermined step among the plurality of steps.

[0008] Further features of the present disclosure will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a diagram illustrating the configuration of a radiographic imaging system.

[0010] Figure 2 is a diagram illustrating functional blocks of a control device.

[0011] Figure 3 is a diagram illustrating a hardware configuration of a control device.

[0012] Figure 4 is a diagram illustrating a usage sequence of a camera coordination system.

[0013] Figure 5 is a diagram illustrating an example of optical image display in an imaging management application.

[0014] Figure 6 is a diagram illustrating an example of a display screen immediately after radiography in an imaging management application.

[0015] Figure 7 is a diagram illustrating an example of a display screen during imaging standby in an imaging management application.

[0016] Figure 8 is a diagram illustrating a flowchart of optical image display.

[0017] Fig. 9 is a diagram illustrating an example of optical image display in an imaging management application.

[0018] Fig.10 is a diagram illustrating an example of optical image display in an imaging management application.

[0019] Fig.11 is a diagram illustrating a flowchart of optical image display.

[0020] Fig. 12A is a diagram illustrating a situation when the display of an optical image is turned off, and Fig. 12Bis a diagram illustrating a situation when image processing is applied to an optical image.

[0021] Fig.13 is a diagram illustrating a flowchart of optical image display.

[0022] Fig.14A is a diagram illustrating an analysis result notification example 1 in an imaging management application, and Fig. 14B is a diagram illustrating analysis result notification example 2 in the imaging management application.

[0023] Fig.15 is a diagram illustrating a flow chart of an inspection process.

[0024] Fig.16 is a diagram illustrating a flow chart of an optical image analysis process.

[0025] Fig.17 is a diagram illustrating a correspondence relationship between a determination result according to image analysis and a detection result notification.

[0026] Fig.18 is a diagram illustrating optical image display example 2 in an imaging management application.

[0027] Fig.19 is a diagram illustrating a radiography method setting screen in the imaging management application.

[0028] Fig. 20A is a diagram illustrating a table of a radiographic information management method (a), Fig. 20B is a diagram illustrating a table of a radiographic information management method (b), Fig. 20C is a diagram illustrating a table of a radiographic information management method (c), Fig.20D is a diagram illustrating a table of a radiographic information management method (d), and Fig.20E It is a diagram illustrating a table of the radiographic information management method (e).

[0029] Fig.21 is a diagram illustrating a flowchart of a radiographic information management method (a).

[0030] Fig. 22 is a diagram illustrating a flowchart of the radiographic information management method (b).

[0031] Fig.23 is a diagram illustrating a flowchart of the radiographic information management method (c).

[0032] Fig.24 is a diagram illustrating a flowchart of the radiographic information management method (d).

[0033] Fig.25 is a diagram illustrating a flowchart of the radiographic information management method (e). DETAILED DESCRIPTION

[0034] Hereinafter, embodiments of the present disclosure are described in detail using the accompanying drawings. Note that the disclosure described in the claims is not limited to the configurations described in the embodiments. Parts of the configurations and parts of the processes may be replaced with equivalent forms, omitted, or modified within the scope of obtaining similar effects.

[0035] First embodiment

[0036] Radiographic imaging systems

[0037] The following describes a radiographic imaging system 1 as a usage environment of the radiation detection apparatus 10 (radiographic apparatus, radiographic imaging apparatus). Figure 1 is a diagram illustrating a schematic configuration of a radiographic imaging system.

[0038] The radiographic imaging system 1 includes a radiographic line detection device 10 (10A, 10B), a control device 20, a radiation generation device 30 (30A, 30B), an optical image capture device 40 (40A, 40B), a display unit 25, an operation unit 26, a RIS 55, a PACS 56, and a HIS 57.

[0039] The control device 20 is an information processing device that functions as a repeater for the radiation detection device 10, the radiation generation device 30, and each device connectable via the network 50, and performs various controls. Details of the control device 20 will be described later.

[0040] The radiation generating device 30 (radiation emitting device) has a radiation tube that generates radiation and uses the radiation to irradiate a patient or other subject. In this article, it is assumed that the radiation includes not only X-rays but also alpha rays, beta rays, gamma rays, particle rays, cosmic rays, etc. It is assumed that a suitable device among the radiation generating device 30A and the radiation generating device 30B is selected and used according to the radiography details.

[0041] Unless otherwise specifically stated, these are collectively referred to as the radiation generating device 30 .

[0042] The radiation detection device 10 (radiation device, radiographic imaging device) is a device that generates images based on radiation emitted from the radiation generation device 30. The radiation detection device 10 is, for example, a flat panel detector. It is assumed that appropriate devices of the radiation detection device 10A and the radiation detection device 10B are selected and used according to the radiographic details. Unless otherwise specified, these are collectively referred to as the radiation detection device 10.

[0043] The radiation detection device 10 detects radiation that has been emitted from the radiation generation device 30 and passed through the subject (object). Note that image data may also be referred to as a medical image or a radiograph. Specifically, the radiation detection device 10 detects the radiation that has passed through the subject as an electric charge corresponding to the transmitted radiation dose. For example, a direct conversion sensor that directly converts radiation into an electric charge (such as a-Se that converts radiation into an electric charge) or an indirect sensor that utilizes a scintillator (such as CsI) and a photoelectric conversion element (such as a-Si) that converts radiation into visible light may be used in the radiation detection device 10. In addition, the radiation detection device 10 generates image data by performing A / D conversion on the detected electric charge, and outputs the generated image data to the control device 20.

[0044] The optical image capturing device 40 is a camera device for capturing the condition of a subject undergoing radiography. It is assumed that an appropriate device among the optical image capturing device 40A and the optical image capturing device 40B is selected and used according to the radiography details. Unless otherwise specifically stated, these are collectively referred to as the optical image capturing device 40.

[0045] The display unit 25 is a display device having a monitor such as a liquid crystal display and capable of displaying information. The operation unit 26 is an input device having a keyboard, a pointing device such as a mouse, a touch panel, and the like.

[0046] RIS 55, PACS 56 and HIS 57 are services that cooperate with the control device 20 through a network to expand various functions related to radiography. In addition, the control device 20 is connected to RIS 55, PACS 56 and HIS 57 through the network 50, and radiographs, patient information, etc. can be exchanged. Figure 1 The RIS 55, PACS 56, and HIS 57 are shown as included in the radiographic imaging system 1, but a system that does not include at least one of the above is also possible. In this document, RIS is an abbreviation for radiology information system. PACS is an abbreviation for picture archiving and communication system. HIS is an abbreviation for hospital information system.

[0047] The control device 20 controls radiography using the radiation detection device 10 and the radiation generation device 30 .

[0048] For example, according to Figure 4 The radiographic imaging apparatus according to the present embodiment is used in the sequence shown in FIG.

[0049] In step 401 (hereinafter indicated as S401 , and so on), a user (radiologist) who uses the radiographic imaging system inputs examination information into the radiographic imaging system 1 .

[0050] In S402 , the radiographic imaging system 1 starts preparation for radiography.

[0051] In S403 , the radiographic imaging system 1 monitors the subject by optical image capturing as one of the processes during the radiographic preparation period.

[0052] In S404 , the user arranges the radiation detection apparatus 10 and the subject.

[0053] In S405 , the user checks the condition of the subject displayed in the radiographic imaging system 1 .

[0054] In S406 , if the positional relationship between the radiation detection apparatus 10 and the subject is not appropriate, the user adjusts the positions of the radiation detection apparatus 10 and the subject.

[0055] In S407 , the user checks the condition of the subject displayed in the radiographic imaging system 1 .

[0056] In S408 , the user confirms that the positional relationship between the radiation detection apparatus 10 and the subject is appropriate, and instructs the radiographic imaging system to perform radiography.

[0057] In S409 , the radiographic imaging system 1 performs radiography.

[0058] Control Equipment

[0059] Figure 3 The control device 20 includes a CPU 301, a RAM 302, a ROM 303, an external memory 304, a communication I / F unit 305, and a bus 306. The CPU 301, the RAM 302, the ROM 303, the external memory 304, and the communication I / F unit 305 are communicatively interconnected via the bus 306.

[0060] The CPU 301 (central processing unit) centrally controls the operation of the control device 20 and controls the Figure 3 Each of the components shown in .

[0061] RAM 302 (writable memory) is used as a main memory, a work area, etc. of CPU 301. When executing processing, CPU 301 loads the required computer program 3031, data, etc. from ROM 303 into RAM 302 and executes the computer program 3031, etc., thereby realizing various functional operations. The control device 20 has an application function running on a computer. That is, the control device 20 has at least one processor and a memory, and the functional units described below are realized by causing the processor to execute the program stored in the memory. However, some or all of the functional units can also be realized by dedicated hardware.

[0062] The ROM 303 (Read Only Memory) stores a computer program 3031 , data, and the like necessary for the CPU 301 to execute processing. Note that the computer program 3031 , data, and the like may also be stored in the external memory 304 .

[0063] The external memory 304 is a large-capacity storage device, and is implemented by a hard disk device, an IC memory, etc. For example, the external memory 304 stores various data, various information, etc. required when the CPU 301 executes the computer program 3031, etc. to perform processing. In addition, for example, the external memory 304 stores various data, various information, etc. obtained as a result of the CPU 301 executing the computer program 3031, etc. to perform processing.

[0064] The communication I / F (interface) unit 305 is responsible for the communication between the control device 20 and external equipment. Through the communication I / F unit 305, the control device 20 is connected to the radiation generation device 30, the radiation detection device 10, and the optical image capture device 40 through a wired or wireless network, or on a dedicated line.

[0065] The bus 306 is used to communicatively connect the CPU 301 with the RAM 302 , the ROM 303 , the external memory 304 , and the communication I / F unit 305 .

[0066] Figure 2 is a diagram illustrating functional blocks of a control device.

[0067] The imaging control unit 211 of the control device 20 controls the generation control unit 212, the detection control unit 213, and the optical image capture control unit 214 based on the instruction from the operation control unit 210 and the inspection information managed by the inspection information management unit. The inspection information includes information such as dose, irradiation time (ms), tube current (mA), tube voltage (kV), and receptor field (i.e., the area where the radiation is detected). This information is transmitted to the radiation detection device 10 via the image capture control unit 211 and the detection control unit 213.

[0068] The generation control unit 212 controls the timing of generating radiation by the radiation generation device 30 and the radiography conditions.

[0069] The generation control unit 212 outputs information such as an irradiation control signal to the radiation generation device 30 based on the dose information, etc. The irradiation control signal transmitted from the generation control unit 212 to the radiation generation device 30 may include two signals, namely, a stop signal (irradiation stop signal) for stopping the emission of radiation and an irradiation signal (non-irradiation stop signal) for emitting radiation. By controlling the output of one or both of the stop signal and the irradiation signal, the generation control unit 212 can control the emission and stop of radiation from the radiation generation device 30.

[0070] The detection control unit 213 communicates with the radiation detection device 10 to perform various controls for radiographic imaging (radiography). For example, the detection control unit 213 performs various communication processing associated with radiographic imaging on the radiation detection device 10. In this communication processing, imaging condition setting information, operation control setting information, image information, body surface dose information, etc. are exchanged.

[0071] The optical image capturing control unit 214 controls the start and end of image capturing by the optical image capturing device 40 , conditions for acquiring an optical image, timing, frame rate, zoom, focus, and other functions.

[0072] The radiograph acquisition unit 201 receives image data from the radiation detection apparatus 10. The image processing unit 202 performs image processing on the received image data as necessary, and supplies the processed image data to the display control unit 209 and the image storage unit 208.

[0073] The display control unit 209 provides the display unit 25 with screen information of the imaging management application, which enables viewing of information about radiography. The graphical user interface of the imaging management application displayed on the display unit 25 is linked to operations performed using the operation unit 26. Therefore, information related to the imaging management application can be input via the operation unit 26. For example, in the case where multiple pieces of examination information are displayed in a list form on the display unit 25, an operation input can be provided using the operation unit 26 to select a piece of examination information from the list. The selected examination information can be set as an examination target. Note that the user can also input the examination information directly from the operation unit 26. The examination information input on the imaging management application is managed by the examination information management unit 207.

[0074] The optical image acquisition unit 203 acquires an optical image from the optical image capture device 40, and provides the acquired optical image to the image processing unit 202 and the optical image analysis unit 205. The optical image acquisition unit 203 can acquire an optical image from one or both of the optical image capture devices 40A, 40B. The optical image is preferably a dynamic image, but it can also be a still image acquired occasionally. The image processing unit 202 performs image processing on the received image data as needed, and provides the processed image data to the optical image display control unit 204 and the image storage unit 208. In addition, the optical image used for analysis can also be an optical image with a decimation frame rate lower than the acquisition frame rate of the optical image capture device 40.

[0075] The optical image analyzing unit 205 makes a determination using the optical image acquired from the optical image acquiring unit 203 and the inspection information acquired from the inspection information managing unit 207. Specifically, the position, type, and posture of the human body region of the subject in the optical image are analyzed to determine whether the above items match the settings in the inspection information. In the present embodiment, the inference processing unit 206 using machine learning is used in the determination made by the optical image analyzing unit 205, but the determination may also be made according to other methods.

[0076] The optical image display control unit 204 controls the display related to the image obtained by the optical image capturing device 40. The optical image display control unit 204 changes and adds information to the optical image, for example, and supplies the result as image information to the display control unit 209. The image information supplied to the display control unit 209 is used as a part of the information to be displayed on the graphical user interface of the imaging management application, and is displayed on the display unit 25.

[0077] Note that in Figure 1 In the figure, for the convenience of explanation, the control device 20 is illustrated as a single device, but the control device 20 may also be formed of a plurality of devices. For example, the optical image capturing control unit 214, the detection control unit 213, the generation control unit 212, and the display control unit 209 may also be respective independent control devices, and may also be a combination of control devices selectively provided with a plurality of functions from these units.

[0078] Optical image display

[0079] Next, we will use Figure 5 To describe the display of optical images. Figure 5 is a diagram illustrating an example of optical image display in an imaging management application.

[0080] In the present embodiment, the condition of the subject during radiography is captured in an image by the optical image acquisition device 40, and the condition monitoring is performed using the optical image thus obtained.

[0081] When a radiographic examination starts, a screen 500 is displayed on the GUI of the imaging management application.

[0082] The screen 500 includes a radiography status 501 , subject information 502 , examination information 503 , a radiograph display area 504 , an optical image window 550 , an optical image window display switching button 506 , and an end examination button 507 .

[0083] The radiography status 501 is information indicating the availability (suitability) of starting radiography (imaging operation). In the present embodiment, radiography is started by a start radiography button (not shown), but the radiography status 501 may also double as a start radiography button. The subject information 502 is information about the subject to be subjected to radiography.

[0084] The inspection information 503 is information such as the details of the currently inspected radiograph and a thumbnail (reduced image) of the radiograph acquired by the radiograph acquisition unit 201. The user can select a set of radiography details from the radiography details listed in the inspection information 503 to prepare for the next instance of radiography. By selecting a set of radiography details, the radiation detection device 10 is instructed to prepare for radiography. This allows one of the multiple steps of performing radiography to proceed. On the screen 500, the "Protocol-A" radiography details are in a selected state.

[0085] The radiograph display area 504 is an area that displays the radiograph acquired by the radiograph acquisition unit 201 in the current examination. At the stage of displaying the screen 500, radiography has not yet been performed, so the radiograph display area 504 is blank, and no radiograph is placed therein. Information such as the date and time related to the current radiography session can also be freely placed and superimposed as a character string in any of the four corners of the radiograph display area 504.

[0086] The optical image window display switching button 506 is a selection object that can be pressed to manually switch the display or hide (on / off) state of the optical image window 550 .

[0087] The end examination button 507 is a selection object that can be pressed to end the current examination.

[0088] In the optical image window 550 , the optical image acquired by the optical image acquisition unit 203 and the result analyzed by the optical image analysis unit 205 are displayed together with buttons and the like for controlling the optical image.

[0089] In the optical image window 550 , analysis is performed on the currently selected “Protocol-A” radiographic details. The optical image window 550 is superimposed onto the radiograph display area 504 .

[0090] The optical image window 550 includes an optical image display area 551 , camera information 552 , an optical image analysis in progress icon 553 , an optical image display switching button 554 , a rotate optical image button 555 , and an optical image analysis result 556 .

[0091] In the optical image display area 551, the optical image acquired by the optical image acquisition unit 203 is displayed. Figure 5 Image processing is not performed on the optical image in the present invention, but image processing may be performed to make the optical image easier for the user to see.

[0092] In the camera information 552 , information on the optical image capturing device 40 is displayed.

[0093] The optical image analysis in progress icon 553 is information indicating whether the optical image analysis unit 205 is performing image analysis. For example, by displaying the optical image analysis in progress icon 553 while the optical image analysis process is being performed, the icon 553 is displayed to visually notify the user that the optical image analysis is in progress. When the optical image analysis process is not in progress, the icon 553 may be hidden or grayed out.

[0094] The optical image display switching button 554 is a selection object that can be used to manually switch the display or hiding state of the optical image in the optical image display area 551 .

[0095] The rotate optical image button 555 is a selection object that can be used to rotate the optical image displayed in the optical image display area 551. In the present embodiment, only left rotation is available, but right rotation can also be added, and a form of selecting a rotation angle can also be implemented.

[0096] The optical image analysis result 556 is a message area (notification area) for displaying the image analysis result (condition information on the subject) provided by the optical image analysis unit 205 .

[0097] When from Figure 5 When the stage shown in the figure proceeds to the next step, the display changes to Figure 6 The screen in . Figure 6 is a diagram illustrating an example of a display screen immediately after radiography in an imaging management application.

[0098] When radiography is performed, a screen 600 is displayed. On the screen 600, a radiograph 690 is displayed in the radiograph display area 504. Therefore, the optical image window 550 that has been superimposed on the radiograph display area 504 is hidden. In addition, the display information of the optical image window display switching button 506 is changed from "camera on" to "camera off".

[0099] Note that static imaging is given herein as an example, but in the case where the radiographic details include fluoroscopy (dynamic imaging), it is also possible to display the radiographic details while the radiography is in progress. Figure 6 This allows for continuous verification of the fluoroscopic image.

[0100] When from Figure 6 When the stage shown in the figure proceeds to the next step, the display changes to Figure 7 The screen in . Figure 7 is a diagram illustrating an example of a display screen during imaging standby in an imaging management application.

[0101] When the next set of radiographic details is selected in the examination information 503, the system is ready to start the examination again, and displays a screen 700. On the screen 700, "Protocol-B" is in a selected state. On the screen 700, an optical image window 750 is superimposed on the radiograph 690 in the radiograph display area 504. In the optical image window 750, analysis is performed on "Protocol-B".

[0102] Screen display control

[0103] Will use Figure 8 To describe the process from the beginning of the inspection to the end of the inspection. Figure 8 3 is a diagram illustrating a flowchart of optical image display. Control corresponding to the flowchart is performed in the control device 20. Specifically, the control is realized by causing the CPU 301 provided in the control device 20 to load a computer program 3031 stored in the ROM 303 or the like into the RAM 302 and function as a corresponding function.

[0104] In step S801, the control device 20 measures the time that has elapsed since the radiography details were selected in the imaging management application. When the fixed time has elapsed, the flow proceeds to S802.

[0105] The fixed time indicated herein can be changed between the first instance of the radiography currently being examined and the second and subsequent instances of the radiography. A time that is more suitable for the workflow can be set, such as setting a time to check patient information in the first instance of the radiography and setting a time to check the radiograph in the second and subsequent instances.

[0106] In S802, the optical image acquisition unit 203 acquires an optical image captured by the optical image capture device 40. The optical image display control unit 204 then supplies image information to the display control unit 209, causing the optical image to be displayed on the display unit 25. This causes a screen like the screen 500 to be displayed.

[0107] In S803, the control device 20 checks whether the radiography has started. The process waits (no) until the radiography starts, and when the radiography starts (yes), the process proceeds to S804. For example, the start of radiography means that the radiation detection device 10 has started the radiation accumulation operation. The start can be defined as the radiation generation device 30 has started to emit radiation to the radiation detection device 10, defined as the control device 20 has started to receive images from the radiation detection device 10, defined as the control device 20 has completed preparations so that the image can be displayed on the display unit 25, and so on.

[0108] In S804 , the display control unit 209 automatically hides the optical image displayed on the display unit 25 , and displays a screen like the screen 600 .

[0109] In S805, the image storage unit 208 saves the optical image. When the optical image is saved, the optical image is saved in association with the radiograph acquired by the radiograph acquisition unit 201 and the examination information managed by the examination information management unit 207.

[0110] Through the above steps, the radiography of the imaging target ends, and the flow proceeds to the next instance of radiography. If the current examination includes multiple instances of radiography, the next set of radiography details is selected and a screen similar to the screen 700 for the next set of radiography details is displayed. This process is repeated a number of times equal to the number of groups of registered radiography details.

[0111] Effect

[0112] As described in the first embodiment above, by displaying the optical image when the user wants to check the optical image, and by hiding the optical image when the user wants to check the radiograph or other display, the display can be adapted to the workflow. By displaying the optical image at a smaller size than the radiograph, the superposition of the optical image does not block the information that the user wants to check, such as the additional information in the four corners of the radiograph, so the display can be further adapted to the workflow. Even if the content that the user does not check in the general workflow is blocked, the optical image can be switched to display or hide, thereby also adapting to workflows other than the general workflow. In addition, by saving the optical image at the start of radiography, and by saving the optical image in association with the radiograph and the inspection information, a record of the situation at the time of radiography can be left.

[0113] Second embodiment

[0114] The first embodiment illustrates an example in which the optical image window 550 is superimposed on a portion of the radiograph display area 504. In contrast, the second embodiment is characterized in that the entire radiograph display area 504 is used as the optical image window 550. Note that the configuration for implementing the second embodiment is similar to that of the first embodiment except for the portions related to the above-described characteristic portions. Therefore, similar portions of the configuration are indicated and described using similar symbols, and detailed descriptions of these portions are omitted.

[0115] Optical image display

[0116] Will use Fig. 9 To describe the display of optical images. Fig. 9 is a diagram illustrating an example of optical image display in an imaging management application.

[0117] In the present embodiment, the condition of the subject during radiography is captured in an image by the optical image acquisition device 40 , and condition monitoring is performed using the optical image thus obtained.

[0118] When a radiographic examination is started, a screen 900 is displayed on the GUI of the imaging management application. Screen 900 is different from screen 500 in that an optical image window 950 corresponding to optical image window 550 extends over the entire radiograph display area 504. The enlarged window makes it easier to see the optical image, which is helpful for checking the radiographic condition.

[0119] During and immediately after radiography, a screen 1000 is displayed on the GUI of the imaging management application. The screen 1000 is different from the screen 600 in that an optical image window 1050 is displayed outside (outside) the radiograph display area 504. Displaying the optical image in this manner makes it possible to monitor the condition of the subject via the optical image while also checking the radiograph during and immediately after radiography.

[0120] Screen display control

[0121] Will use Fig.11 To describe the process from the beginning of the inspection to the end of the inspection. Fig.11 3 is a diagram illustrating a flowchart of optical image display. Control corresponding to the flowchart is performed in the control device 20. Specifically, the control is realized by causing the CPU 301 provided in the control device 20 to load a computer program 3031 stored in the ROM 303 or the like into the RAM 302 and function as a corresponding function.

[0122] In S1101, the control device 20 measures the time that has passed since the previous process. When the fixed time has passed, the flow proceeds to S1102.

[0123] In S1102 , the control device 20 displays the optical image in the radiograph display area 504 .

[0124] In S1103, the control device 20 checks whether radiography has started. If radiography has started, the flow proceeds to S1104.

[0125] In S1104 , the control device 20 displays the optical image outside the radiograph display area 504 .

[0126] In S1105, the control device 20 checks whether the current inspection has been completed. If the inspection has not been completed, the flow proceeds to S1101. If the inspection has been completed, the flow proceeds to S1106.

[0127] In S1106 , the control device 20 hides the optical image and ends the inspection.

[0128] According to this flow, the optical image is set to the display state from the start of the examination to the end of the examination. Note that, similar to the first embodiment, the fixed time in S1101 can be changed between the first instance of radiography in the current examination and the second and subsequent instances of radiography. The fixed time in S1101 can also be set to 0 seconds. Fig.10As in the display example shown in , since the optical image window 1050 is displayed outside (outside) the radiograph display area 504, the radiograph can be viewed. In addition, since the subject information can be checked via the character strings in the four corners of the radiograph display area 504, the subject information 502 can be blocked even when checking the subject after the current examination starts. In addition, since the optical image does not interfere with the operator's ability to check the radiograph after radiography, the display state of the optical image can be continued even after radiography.

[0129] Effect

[0130] As described in the above second embodiment, by switching the display position, size, etc. of the optical image according to the steps of the process, the output can be further adapted to the workflow.

[0131] Third embodiment

[0132] In the first and second embodiments, the image itself captured by the optical image capturing device 40 is displayed as an optical image. The third embodiment is characterized in that image processing is performed on the optical image to be displayed. It is noted that the configuration for implementing the third embodiment is similar to that of the first embodiment except for the parts related to the above-mentioned characteristic parts. Therefore, similar symbols are used to represent and describe similar parts of the configuration, and detailed descriptions of these parts are omitted.

[0133] Optical image display

[0134] Will use Fig. 12B To describe the display of optical images. Fig. 12B is a diagram illustrating a case where image processing is applied to an optical image.

[0135] In the optical image window 1250 , an image 1251 obtained by performing a mosaic process (image modification) is displayed as an optical image. This image processing is performed by the image processing unit 202 .

[0136] In image 1251, a mosaic process is performed as a change of the optical image, but the optical image can also be changed using graphics such as curves and rectangles so that the subject cannot be identified. The change can also be limited to privacy-related parts, and the change can also be performed via image cropping, masking or other processing. These parts can also be replaced with images that are not based on the optical image, such as a solid color surface. Alternatively, the optical image 1201 in the optical image window 1200 can be set to be hidden, such as Fig. 12A as shown in . Fig. 12A1 is a diagram illustrating a case where the display of the optical image is turned off. When the optical image 1201 is set to be hidden, the display of the optical image display switching button 1202 changes from "ON" to "OFF". Note that even if the optical image 1201 is hidden, the analysis of the optical image is performed and the result is notified to the user, so that the user can grasp the situation.

[0137] Screen display control

[0138] Will use Fig.13 To describe the detailed flow of the optical image display process (S802, S1102).

[0139] Fig.13 3 is a diagram illustrating a flowchart of optical image display. Control corresponding to the flowchart is performed in the control device 20. Specifically, the control is realized by causing the CPU 301 provided in the control device 20 to load a computer program 3031 stored in the ROM 303 or the like into the RAM 302 and function as a corresponding function.

[0140] In S1301 , the control device 20 acquires an optical image for determining privacy, and then advances the process to S1302 .

[0141] In S1302 , the control device 20 analyzes the optical image, and then advances the process to S1303 .

[0142] In S1303, the control device 20 determines whether the current image capture is related to privacy. For example, the determination can be based on whether the image capture is performed with the subject partially or completely undressed, whether the body area to be imaged is a hip joint, etc., or whether the image capture causes a private part (genitals, pubic area) to be visible in the optical image. If the image capture is related to privacy (yes), the process proceeds to S1304, otherwise the process proceeds to S1305 (no).

[0143] In S1304 , the control device 20 changes the optical image due to privacy concerns.

[0144] In S1305, the control device 20 determines the optical image to be displayed. If the process has passed S1304, then the modified optical image is determined. The image determined at this time becomes the image displayed in the optical image display process (S802, S1102).

[0145] Note that in this embodiment, the analysis result about the optical image is used to determine privacy, but other information may be used to determine privacy. For example, it is also possible to use the examination information (radiography details) input in advance by the user to determine whether to perform optical image capture related to privacy.

[0146] Effect

[0147] As described in the third embodiment above, by performing privacy-related processing, the output can be further adapted to the workflow.

[0148] Fourth embodiment

[0149] The first embodiment describes an example in which the analysis result about the optical image is provided as a brief notification. The fourth embodiment describes an example in which the analysis result about the optical image is provided as a detailed notification. Note that the configuration for implementing the fourth embodiment is similar to that of the first embodiment except for the parts related to the above-mentioned characteristic parts. Therefore, similar parts of the configuration are represented and described using similar symbols, and detailed descriptions of these parts are omitted.

[0150] Notification of analysis results

[0151] Next, we will use Fig.14A and Fig. 14B A notification detailing the results of the analysis.

[0152] Fig.14A is a diagram illustrating analysis result notification example 1 in an imaging management application.

[0153] Fig. 14B is a diagram illustrating analysis result notification example 2 in the imaging management application.

[0154] When analyzing the optical image, first, an optical image analysis target detection frame 10601 is displayed in the screen state 10600 of the aforementioned optical image window 550. The optical image analysis target detection frame 10601 is a frame indicating that a single human body is successfully detected in the optical image analysis unit 205 and also indicating its detection area (determined target area). For example, in the optical image analysis unit 205, the optical image analysis target detection frame 10601 is hidden when a human body is not detected, and the optical image analysis target detection frame 10601 is displayed when a human body is detected. With this arrangement, the user can receive a visual notification of the human body detection result and its area in the optical image analysis. If a human body is detected in an erroneous position, an emphasized optical image analysis target detection frame 10651 can be displayed in the screen state 10650 of the aforementioned optical image window 550 to indicate this. That is, the way of displaying the optical image analysis target detection frame can be changed depending on the situation of human body detection.

[0155] Furthermore, in the screen state 10600, a notification 10602 is provided as the optical image analysis result 556. The notification 10602 is a notification in the case where the human body is correctly detected corresponding to the examination information. A message stating "This is the correct position" and information "front view of the chest" as the current radiographic details (imaging posture) are displayed as the notification 10602. Through this notification, the user can understand that the human body is in the correct position with respect to the prearranged radiographic details.

[0156] On the other hand, in the screen state 10650, a notification 10652 is provided as the optical image analysis result 556. The notification 10652 is a notification in the case where the human body is detected to be in an incorrect position corresponding to the examination information. A message stating "Please check the body area to be imaged" and information "front side of chest" as the current radiography details are displayed as the notification 10652. Through this notification, the user can understand that the human body is not in the correct position (inconsistency, error) with respect to the prearranged radiography details.

[0157] Inspection process

[0158] Next, we will use Fig.15 Describe the inspection process. Fig.15 2 is a diagram illustrating a flowchart of the inspection process. A control corresponding to the flowchart is executed in the control device 20.

[0159] Specifically, the control is realized by causing the CPU 301 provided in the control device 20 to load the computer program 3031 stored in the ROM 303 or the like into the RAM 302 and function as a corresponding function.

[0160] In S10701, the inspection information management unit 207 prompts the user to select one from the multiple inspection information acquired by the operation unit 26, and sets the selected inspection information as the inspection target. This process is implemented by, for example, displaying the acquired multiple inspection information in a list form, accepting the user's operation input to select one inspection information from the list, and setting the selected inspection information as the inspection target. Note that the user can also directly input the inspection information from the operation unit 26.

[0161] In S10702 , the control apparatus 20 starts inspection by transmitting a signal causing the radiation detection apparatus 10 to shift to the ready state according to the set inspection information.

[0162] In response to the signal, for example, the radiation detection device 10 uses the main control circuit to control the bias power supply, and applies the bias voltage to the two-dimensional image sensor. After this, initialization is performed, in which the image signal is read out from the pixel array using the drive circuit to read out the dark current signal accumulated in the pixel. After the initialization is completed, the radiation detection device 10 transmits status information to the control device 20, indicating that the preparation for obtaining the radiograph is completed. In addition, the control device 20 (inspection information management unit 207) sets the operating parameters (such as tube voltage) of the radiation detection device 10 based on the inspection information selected in S10701. After being notified of the completion of the radiographic preparation via the status information from the radiation detection device 10, the control device 20 gives exposure permission to the radiation detection device 10 in the notification.

[0163] In S10703 , the optical image acquisition unit 203 acquires the optical image captured by the optical image capturing device 40 .

[0164] In S10704, the optical image analysis unit 205 performs optical image analysis using the optical image acquired from the optical image acquisition unit 203 and the inspection information acquired from the inspection information management unit 207. In order to analyze the optical image, for example, an inference process using machine learning may be performed by the inference processing unit 206. The images to be input into the optical image analysis unit 205 may be all images that have been acquired by the optical image acquisition unit 203, or may be images extracted according to analysis details before being input into the optical image analysis unit 205. The details of S10704 will be described later.

[0165] In S10705, the control device 20 obtains the determination result performed in S10704, and obtains information corresponding to the detection status notification. An example of the correspondence between the determination result and the detection status notification is as follows: Fig.17 As shown in Table 10900. Fig.17 is a diagram illustrating the correspondence between the determination result from the image analysis and the detection result notification.

[0166] In S10706, the optical image display control unit 204 controls display contents using the optical image acquired by the optical image acquisition unit 203 and the analysis result of the optical image analysis unit 205 and supplies the display contents to the display control unit 209. This causes the controlled display contents to be displayed on the display unit 25. In the optical image display control unit 204, the optical image and the analysis result can each be displayed in any manner, and the display can be controlled according to the setting of the control device 20 and the setting of the inspection information management unit 207. For example, without performing the optical image analysis, only the optical image can be displayed on the display unit 25.

[0167] Optical image analysis process

[0168] Next, we will refer to Fig.16 The optical image analysis process (process in S10704 ) by the optical image analysis unit 205 is described. Fig.16 is a diagram illustrating a flow chart of an optical image analysis process.

[0169] The control corresponding to the flowchart is performed in the control device 20. Specifically, the control is realized by causing the CPU 301 provided in the control device 20 to load the computer program 3031 stored in the ROM 303 or the like into the RAM 302 and act as a corresponding function. The order of the steps can be freely rearranged. In addition, the processing in some steps can be omitted. In addition, the processing of storing display information can be omitted.

[0170] In S10801, the optical image analysis unit 205 determines whether the examination information acquired by the examination information management unit 207 is examination information suitable for optical image analysis. For example, if the examination information does not contain information sufficient to analyze whether the optical image conforms to the details of the examination specified in the optical image analysis, the examination information is determined to be unsuitable. Specifically, in a case such as an analysis for determining a body region is to be performed but the examination information does not specify a body region, or it specifies a body region that the optical image analysis unit 205 cannot analyze, the examination information is determined to be unsuitable. If the examination information is determined to be unsuitable, the flow proceeds to a "unsuitable" determination result in S10808.

[0171] In S10802, display information is stored in the determination result to display a consistency determination in progress icon indicating that the inspection is suitable for optical image analysis.

[0172] In S10803, the optical image analysis unit 205 determines whether the subject to be analyzed is included in the optical image acquired from the optical image acquisition unit 203. The method of detecting the subject can use an image recognition technology involving machine learning. At this time, if the optical image contains not only the body of the patient to be imaged, but also the body of other people other than the patient (such as a radiologist preparing for radiography), it can be considered that the appropriate subject cannot be detected, and a "non-detectable" result can be determined. If the non-detectable result is determined, the process transitions to the "no human body detected" determination result in S10809.

[0173] In S10804, display information is stored in the determination result to display a human body detection frame indicating that the inspection is suitable for optical image analysis.

[0174] In S10805, the optical image analysis unit 205 determines whether the body region in the examination information acquired by the examination information management unit 207 matches the body region in the analysis result regarding the optical image acquired from the optical image acquisition unit 203. The method of analyzing the body region may use an image recognition technology involving machine learning. If the analysis result is determined to be a mismatch, the flow transitions to a "body region mismatch" determination result in S10810. In an uncertain case where it cannot be determined whether the analysis result is a match or a mismatch, the flow transitions to an "uncertain" determination result in S10813.

[0175] In S10806, the optical image analysis unit 205 determines whether the direction in the inspection information acquired by the inspection information management unit 207 matches the direction in the analysis result about the optical image acquired from the optical image acquisition unit 203. Depending on the inspection information, this determination may be unnecessary. The method of analyzing the direction may use image recognition technology involving machine learning. If the analysis result is determined to be a mismatch, the process transitions to the "direction mismatch" determination result in S10811. In an uncertain case where it cannot be determined whether the analysis result is a match or a mismatch, the process transitions to the "uncertain" determination result in S10813.

[0176] In S10807, the optical image analysis unit 205 determines whether the laterality of the body in the examination information acquired by the examination information management unit 207 matches the laterality in the analysis result regarding the optical image acquired from the optical image acquisition unit 203. Depending on the examination information, this determination may be unnecessary. The method of analyzing the laterality may use image recognition technology involving machine learning. If the analysis result is determined to be a mismatch, the process transitions to the "laterality mismatch" determination result in S10812. In an uncertain case where it cannot be determined whether the analysis result is a match or a mismatch, the process transitions to the "uncertain" determination result in S10813.

[0177] If the analysis result is a match, the flow shifts to the "match" determination result in S10814.

[0178] S10808 to S10814 illustrate the status of the determination result from the optical image analysis unit 205 .

[0179] The optical image display control unit 204 may control the display content in the optical image window 550 according to each determination result. Specifically, the optical image display control unit 204 may control the display content in the optical image window 550 according to each determination result. Fig.17 The control notification content is shown in Table 10900.

[0180] Note that the notification provided by the optical image analysis result 556 is not limited to a text message. In addition to text, a notification may also be provided using graphics, symbols, colors, etc., so that the analysis results can be distinguished from each other.

[0181] Effect

[0182] As described in the above embodiments, by determining the consistency between the specified radiography protocol and the actual positioning of the subject, the user can be made aware of possible rejections in advance. Therefore, rejections can be reduced and the efficiency of the workflow can be improved.

[0183] Fifth embodiment

[0184] The first embodiment describes an example in which a plurality of optical image capturing devices, a plurality of radiation generating devices, and a plurality of radiation detecting devices are not distinguished. The fifth embodiment describes an example in which a plurality of radiation generating devices and a plurality of radiation detecting devices are distinguished. It is noted that the configuration for implementing the fifth embodiment is similar to the configuration of the first embodiment except for the parts related to the above-mentioned characteristic parts. Therefore, similar parts of the configuration are represented and described using similar symbols, and detailed descriptions of these parts are omitted.

[0185] Will use Fig.18 To describe the display of optical images. Fig.18 is a diagram illustrating optical image display example 2 in an imaging management application.

[0186] On screen 20600, "Protocol-A" radiographic information is registered in inspection information 20603. Comparison between inspection information 20603 and inspection information 503 shows that the difference in the radiographic information is that the imaging target is "limb" instead of "chest". In association with the above situation, "camera-A", "tube-A" and "sensor-A" written in inspection information 503 are changed to "camera-B", "tube-B" and "sensor-B" in inspection information 20603. "Camera-A", "tube-A" and "sensor-A" correspond to the optical image capturing device 40A, the radiation generating device 30A and the radiation detecting device 10A, respectively. "Camera-B", "tube-B" and "sensor-B" correspond to the optical image capturing device 40B, the radiation generating device 30B and the radiation detecting device 10B, respectively.

[0187] These devices to be used in radiography are automatically changed in coordination with the radiography details selected in the examination information 503 or the examination information 20603. In addition, in the present embodiment, these coordinated devices are displayed as part of the examination information to allow confirmation by the user. In addition, since the optical image 20655 displayed in the optical image display area 551 is captured by the camera-B, the camera information 20652 is also switched to "camera-B".

[0188] Before radiography, Fig.19 On the screen 20700 shown in , the examination information 503 or the radiographic information registered in the examination information 20603 is pre-specified. Fig.19 is a diagram illustrating a radiography method setting screen in the imaging management application.

[0189] Screen 20700 includes a radiographic method list area 20701 and a start check button 20702. By selecting a radiographic method from the list and then selecting the start check button 20702, the user can display a screen with registered check information, such as screen 500 or screen 20600. When a radiographic method is selected from the radiographic method list area 20701, the device to be used is determined based on a combination of device configuration information about the radiographic imaging system 1 and the imaging method. Information about the device to be used is displayed as radiographic information. In addition, the image orientation (angle information) of the optical image capturing device 40 is also registered in the radiographic information. Geometric transformation of the image, etc. is automatically applied based on the registered image orientation information, so that in the default state, the optical image is displayed in the optical image display area 551 with an appropriate orientation.

[0190] Determine the equipment and optical image geometry to be used

[0191] Next, we will use Fig.21 Describes controls related to determining the device and image orientation to use

[0192] Fig.21 is a flowchart illustrating a radiographic information management method (a).

[0193] In S20900 , the control device 20 accepts input of radiographic information from the user and acquires the radiographic information.

[0194] In S20901, the control device 20 determines the input body region to be imaged. For simplicity, the following describes the determination for the following four body regions: "head", "limbs", "abdomen" and "chest". However, the body region to be imaged can also be classified more finely. If the body region to be imaged is the "chest", the process proceeds to S20902. If the body region to be imaged is the "abdomen", the process proceeds to S20903.

[0195] If the body region to be imaged is a "limb", the process proceeds to S20904. If the body region to be imaged is a "head", the process proceeds to S20905.

[0196] In S20902, the control device 20 determines "camera A", "tube A" and "sensor A" as devices to be used, and "rotation 0 degrees", "scaling 100%" and "height 120 cm" as optical image geometry (geometry information) based on the table of the radiographic information management method (a). "Rotation 0 degrees" is rotation information, "scaling 100%" is enlargement or reduction information, and "height 120 cm" is center coordinate information.

[0197] In S20903, the control device 20 determines "camera B", "tube B" and "sensor B" as the devices to be used, and determines "rotation 0 degrees", "zoom 50%" and "height 80 cm" as the optical image geometry based on the table of the radiographic information management method (a).

[0198] In S20904, the control device 20 determines "camera B", "tube B" and "sensor B" as the devices to be used, and determines "rotation 0 degrees", "zoom 200%" and "height 0 cm" as the optical image geometry based on the table of the radiographic information management method (a).

[0199] In S20905, the control device 20 determines "camera B", "tube B" and "sensor A" as the devices to be used, and determines "rotate 90 degrees", "zoom 100%" and "height 50 cm" as the optical image geometry based on the table of the radiographic information management method (a).

[0200] In the above, the body region to be imaged is given as an example, but the device to be used and the optical image geometric transformation can also be determined by using patient information such as gender, body shape, weight, height, age.

[0201] Effect

[0202] According to the fifth embodiment described above, the device to be used and the optical image geometry can be determined by selecting the body region to be imaged. Therefore, the optical image from the appropriate optical image capturing device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0203] In addition, position information such as coordinate information relative to the ground can also be specified as information on the geometry of the optical image. Therefore, in the case of an optical image capture device capable of panning or an optical image capture device that captures wide-angle images, the body area to be imaged can also be captured in the center of the optical image.

[0204] Sixth embodiment

[0205] In the fifth embodiment, the device to be used and the optical image geometry are determined by selecting the body region to be imaged. In contrast, in the sixth embodiment, the device to be used and the optical image geometry are determined by selecting the imaging type. It is noted that the configuration for implementing the sixth embodiment is similar to that of the fifth embodiment except for the parts related to the above-mentioned characteristic parts. Therefore, similar symbols are used to represent and describe similar parts of the configuration, and detailed descriptions of these parts are omitted.

[0206] Fig. 22 is a diagram illustrating a flowchart of the radiographic information management method (b).

[0207] In S21001, the control device 20 accepts input of radiographic information from the user and acquires the radiographic information. Unlike the fifth embodiment in which the body region to be imaged is acquired, in the sixth embodiment, it is assumed that the imaging type is acquired. That is, it is assumed that the imaging type is pre-selected on an imaging type selection screen (not shown).

[0208] In S21002, the control device 20 determines the input imaging type. For simplicity, the following describes the determination for the following four imaging types: "portable", "sitting", "supine", and "upright". However, the imaging types can also be classified more finely. If the imaging type is "upright", the process proceeds to S21003. If the imaging type is "supine", the process proceeds to S21004. If the imaging type is "sitting", the process proceeds to S21005. If the imaging type is "portable", the process proceeds to S21006.

[0209] In S21003, the control device 20 determines "camera A", "tube A" and "sensor A" as the devices to be used, and determines "rotation 0 degrees" and "zoom 100%" as the optical image geometry based on the table of the radiographic information management method (b).

[0210] In S21004, the control device 20 determines "camera B", "tube B" and "sensor B" as the devices to be used, and determines "rotate 90 degrees" and "zoom 50%" as the optical image geometry based on the table of the radiographic information management method (b).

[0211] In S21005, the control device 20 determines "camera B", "tube B" and "sensor B" as the devices to be used, and determines "rotation 0 degrees" and "zoom 100%" as the optical image geometry based on the table of the radiographic information management method (b).

[0212] In S21006, the control device 20 determines "camera B", "tube B" and "sensor A" as the devices to be used, and determines "rotation 0 degrees" and "zoom 100%" as the optical image geometry based on the table of the radiographic information management method (b).

[0213] Effect

[0214] According to the sixth embodiment, the device and optical image geometry to be used can be determined by selecting the imaging type. Therefore, the optical image from the appropriate optical image capturing device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0215] Seventh embodiment

[0216] In the sixth embodiment, the device to be used and the optical image geometry are determined by selecting the imaging type. The seventh embodiment describes a radiographic information management method for an environment in which "tube A" and "camera A" always operate together as a group and "tube B" and "camera B" always operate together as a group. This embodiment is used in situations where close coordination with a radiation tube is desired, such as when the optical image capture device is installed near the radiation tube. Note that the configuration for implementing the seventh embodiment is similar to the configuration of the sixth embodiment, except for the parts related to the above-mentioned characteristic parts. Therefore, similar symbols are used to represent and describe similar parts of the configuration, and detailed descriptions of these parts are omitted.

[0217] Fig.23 is a diagram illustrating a flowchart of the radiographic information management method (c).

[0218] In S21001 , the control apparatus 20 acquires radiographic information in a manner similar to the sixth embodiment.

[0219] In S21002, the control device 20 acquires the imaging type in a manner similar to the sixth embodiment. If the imaging type is "upright", the process proceeds to S21101. If the imaging type is "supine", the process proceeds to S21102. If the imaging type is "sitting", the process proceeds to S21103. If the imaging type is "portable", the process proceeds to S21104.

[0220] In S21101 , the control device 20 determines “camera A”, “tube A”, and “sensor A” as devices to be used based on the table of the radiographic information management method (c).

[0221] In S21102 , the control apparatus 20 determines “camera B”, “tube B”, and “sensor B” as the apparatuses to be used based on the table of the radiographic information management method (c).

[0222] In S21103 , the control device 20 determines “camera B”, “tube B”, and “sensor B” as devices to be used based on the table of the radiographic information management method (c).

[0223] In S21104, the control device 20 determines "camera B", "tube B", and "sensor A" as devices to be used based on the table of the radiographic information management method (c).

[0224] In S21105, the control device 20 determines the radiation tube to be used. If the radiation tube to be used is "tube B", the process proceeds to S21106. If the radiation tube to be used is "tube A", the process proceeds to S21107.

[0225] In S21106, the control device 20 determines "Camera B" as the device to be used, and "Rotate 180 degrees" and "Zoom 50%" as the optical image geometry, based on the table of the radiographic information management method (c).

[0226] In S21107, the control device 20 determines "Camera B" as the device to be used, and "Rotation 0 degrees" and "Zoom 100%" as the optical image geometry, based on the table of the radiographic information management method (c).

[0227] Effect

[0228] According to the seventh embodiment, the device and optical image geometry to be used can be determined by selecting the imaging type. Therefore, the optical image from the appropriate optical image capturing device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0229] Eighth embodiment

[0230] In the sixth embodiment, the device to be used and the optical image geometry are determined by selecting the imaging type. The eighth embodiment describes a radiographic management method for an environment in which "sensor A" and "camera A" always operate together as a group and "sensor B" and "camera B" always operate together as a group. This embodiment is used in situations where the optical image capture device is expected to be closely coordinated with the radiation detection device, such as when it is expected that the radiograph and the optical image are displayed in the same manner, or when it is expected that the optical image is aligned with the scanning or reading direction of the radiation detection device. It is noted that the configuration for implementing the eighth embodiment is similar to the configuration of the sixth embodiment, except for the parts related to the above-mentioned characteristic parts. Therefore, similar symbols are used to represent and describe similar parts of the configuration, and detailed descriptions of these parts are omitted.

[0231] Fig.24 is a diagram illustrating a flowchart of the radiographic information management method (d).

[0232] In S21001 , the control apparatus 20 acquires radiographic information in a manner similar to the sixth embodiment.

[0233] In S21002, the control device 20 acquires the imaging type in a manner similar to the sixth embodiment. If the imaging type is "upright", the process proceeds to S21201. If the imaging type is "supine", the process proceeds to S21202. If the imaging type is "sitting", the process proceeds to S21203. If the imaging type is "portable", the process proceeds to S21204.

[0234] In S21201, the control apparatus 20 determines "tube A" and "sensor A" as the apparatus to be used based on the table of the radiographic information management method (d).

[0235] In S21202, the control apparatus 20 determines "tube B" and "sensor B" as the apparatus to be used based on the table of the radiographic information management method (d).

[0236] In S21203, the control apparatus 20 determines "tube B" and "sensor B" as the apparatus to be used based on the table of the radiographic information management method (d).

[0237] In S21204, the control apparatus 20 determines "tube B" and "sensor A" as the apparatus to be used based on the table of the radiographic information management method (d).

[0238] In S21205, the control device 20 determines the radiation detection device to be used. If the radiation detection device to be used is "Sensor B", the process proceeds to S21206. If the radiation detection device to be used is "Sensor A", the process proceeds to S21207.

[0239] In S21206, the control device 20 determines "Camera B" as the device to be used, and "Rotate 270 degrees" and "Zoom 50%" as the optical image geometry, based on the table of the radiographic information management method (d).

[0240] In S21207, the control device 20 determines "Camera A" as the device to be used, and "Rotation 0 degrees" and "Zoom 100%" as the optical image geometry, based on the table of the radiographic information management method (d).

[0241] Effect

[0242] According to the eighth embodiment, the device and optical image geometry to be used can be determined by selecting the imaging type. Therefore, the optical image from the appropriate optical image capturing device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0243] Ninth embodiment

[0244] In the sixth embodiment, the device to be used and the optical image geometry are determined by selecting the imaging type. The ninth embodiment describes the case where a plurality of optical image capturing devices are selected and the case where the optical image capturing device to be selected is "N / A". Note that the configuration for implementing the ninth embodiment is similar to that of the sixth embodiment except for the parts related to the above-mentioned characteristic parts. Therefore, similar parts of the configuration are indicated and described using similar symbols, and detailed descriptions of these parts are omitted.

[0245] Fig.25 is a diagram illustrating a flowchart of the radiographic information management method (e).

[0246] In S21001 , the control apparatus 20 acquires radiographic information in a manner similar to the sixth embodiment.

[0247] In S21002, the control device 20 acquires the imaging type in a manner similar to the sixth embodiment. If the imaging type is "upright", the process proceeds to S21301. If the imaging type is "supine", the process proceeds to S21302. If the imaging type is "sitting", the process proceeds to S21303. If the imaging type is "portable", the process proceeds to S21304.

[0248] In S21301, the control device 20 determines "camera A", "tube A" and "sensor A" as the devices to be used, and determines "rotation 0 degrees" and "zoom 100%" as the optical image geometry based on the table of the radiographic information management method (e).

[0249] In S21302, the control device 20 determines "Camera A: Analysis Only", "Tube B", and "Sensor B" as devices to be used based on the table of the radiographic information management method (e). Here, "Camera A: Analysis Only" indicates that the device is used only for analysis and not for optical image display. That is, only information based on the analysis result from the optical image analysis unit 205 is displayed in the optical image window 550. This is because, depending on the imaging type and the body area to be imaged, there may be a case where it is not desired to display the optical image due to privacy issues or the like, but it is desired to display the analysis result about the optical image.

[0250] In S21303, the control device 20 determines "Camera: N / A", "Tube B", and "Sensor B" as devices to be used based on the table of the radiographic information management method (e). Here, "Camera: N / A" means that the optical image capturing device is not used. This is because, depending on the imaging type and the body area to be imaged, there may be a case where the radiographic procedure and the body area to be imaged are restricted, and the optical image capturing device is not used when confirmation of using the optical image capturing device is not necessary.

[0251] In S21304, the control device 20 determines "camera A, camera B", "tube A" and "sensor A" as the devices to be used based on the table of the radiographic information management method (e), and determines "camera A: 0 degrees, 100%" and "camera B: 90 degrees, 50%" as the optical image geometry.

[0252] This assumes the use of multiple types of optical image capture devices, such as optical image capture devices mounted on a ceiling or the like. In the case of displaying optical images obtained from multiple optical image capture devices, the image to be displayed can be automatically selected by analyzing the acquired images. For example, an optical image capture device at the closest distance to the subject or a maximum image of the subject can be used. It can also be a configuration that uses optical images from an optical image capture device with few obstacles between the optical image capture device and the subject. It is also possible to combine and display optical images captured by multiple optical image capture devices in the optical image display area 551 of the optical image window 550.

[0253] Effect

[0254] According to the ninth embodiment, the device and optical image geometry to be used can be determined by selecting the imaging type. Therefore, the optical image from the appropriate optical image capturing device can be displayed in the optical image display area 551 of the optical image window 550 at an appropriate angle and magnification.

[0255] Other Examples

[0256] The present disclosure is not limited to the above examples. Based on the subject matter of the present disclosure, various modifications (including organic combinations of the examples) can be made, and these modifications are not excluded from the scope of the present disclosure. That is, all configurations obtained by combining the above examples and their modifications are also included in the present disclosure.

[0257] Figure 1 An example of a system in which there are two of each device is illustrated, such as having the radiation detection device 10 (10A, 10B), the radiation generation device 30 (30A, 30B), and the optical image capture device 40 (40A, 40B), but each device may also have three or more.

[0258] The information associated with the radiographic information includes the equipment to be used and the information on the optical image geometry, not limited to Figures 20A to 20E The radiographic environment is expected to be a variety of environments. For example, it is assumed that in some cases the optical image capture device may be mounted on the ceiling of a radiographic room, etc., rather than being mounted near a radiation tube. Therefore, the user may also be able to edit information about the equipment to be used and the optical image geometry associated with the radiographic information, such as the body area to be imaged and the type of imaging. By predetermining specific information about the equipment to be used and the optical image geometry associated with the radiographic information, the user can later select the radiographic information to call up similar information about the equipment to be used and the optical image geometry.

[0259] The (one or more) embodiments of the present disclosure may also be implemented by reading out and executing computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more completely referred to as a "non-transitory computer-readable storage medium") to perform the functions of one or more of the above (one or more) embodiments and / or a system or device including one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing the functions of one or more of the above (one or more) embodiments, and by, for example, reading out and executing computer executable instructions from a storage medium to perform the functions of one or more of the above (one or more) embodiments and / or controlling one or more circuits to perform the functions of one or more of the above (one or more) embodiments and implemented by a computer of a system or device. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and a network that may include separate computers or separate processors to read out and execute computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or a storage medium. The storage medium may include, for example, one or more of a hard disk, a random access memory (RAM), a read-only memory (ROM), a storage device of a distributed computing system, an optical disk (such as a compact disk (CD), a digital versatile disk (DVD), or a Blu-ray disk (BD)), a flash memory device, a memory card, etc.

[0260] Other embodiments

[0261] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0262] The processor or circuit may include a graphics processing unit (GPU) or a field programmable gate array (FPGA). The processor or circuit may also include a digital signal processor (DSP), a data flow processor (DFP) or a neural processing unit (NPU).

[0263] The radiographic system in each of the above-described embodiments may be implemented in the form of an independent device or in the form of a combination of multiple devices that can communicate with each other to perform the above-described processing, both of which are included in the embodiments of the present disclosure. A general-purpose server device or a server cluster may also perform the above-described processing. It is sufficient if the multiple devices constituting the radiographic system can communicate at a prescribed communication rate, and the multiple devices do not need to exist in the same facility or the same country.

[0264] The embodiments include a mode in which a software program for realizing the functions of the above-described embodiments is supplied to a system or an apparatus, and a computer of the system or apparatus reads out and executes the code of the supplied program.

[0265] Therefore, the program code itself installed in the computer to implement the processing related to the embodiment on the computer is also one of the embodiments of the present disclosure. In addition, the OS etc. running on the computer can perform some or all of the actual processing based on the instructions contained in the program read out by the computer, and the functions of the above-mentioned embodiments can also be implemented by such processing.

[0266] appendix

[0267] The disclosure of the embodiments includes the following configurations and methods.

[0268] Appendix 1

[0269] A radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; an optical image capturing device that captures an optical image of the subject; and an information processing device that enables information related to radiography using the radiographic imaging device to be viewed on a display unit, the radiographic imaging system being characterized in that

[0270] The information processing apparatus controls display of an optical image acquired from the optical image capturing apparatus in association with the progress of a predetermined step among a plurality of steps of performing radiography.

[0271] Appendix 2

[0272] The radiographic imaging system according to Appendix 1 is characterized in that the predetermined step is a step of instructing the radiographic imaging device to prepare for imaging.

[0273] Appendix 3

[0274] The radiographic imaging system according to Appendix 1 or 2 is characterized in that the predetermined step is a step in which the radiographic imaging device starts an imaging operation.

[0275] Appendix 4

[0276] The radiographic imaging system according to any one of Appendixes 1 to 3, characterized in that

[0277] The information processing apparatus is capable of superimposed display in which a radiograph and an optical image acquired by radiographic imaging are superimposed on each other, and

[0278] In the superimposed display, the optical image is displayed at a smaller size than the radiograph.

[0279] Appendix 5

[0280] The radiographic imaging system according to any one of Appendices 1 to 4, characterized in that the screen displayed by the information processing device includes a selection object for turning on or off display of the optical image.

[0281] Appendix 6

[0282] The radiographic imaging system according to any one of Appendixes 1 to 5, characterized in that

[0283] The information processing device performs predetermined processing as a process of displaying an optical image on a display unit based on information related to the condition of the subject, and

[0284] The predetermined processing is any one of: displaying; not displaying; and performing image change and displaying the changed image.

[0285] Appendix 7

[0286] A radiographic imaging system according to any one of Appendices 1 to 5, characterized in that the information processing device displays condition information related to the subject on the display unit based on the analysis result on the optical image.

[0287] Appendix 8

[0288] The radiographic imaging system according to any one of Appendices 1 to 5, characterized in that the information processing device displays the situation information and the optical image on the same screen of the display unit.

[0289] Appendix 9

[0290] A radiographic imaging system according to any one of Appendices 1 to 5, characterized in that the information processing apparatus displays the situation information on a screen of the display unit instead of displaying the optical image.

[0291] Appendix 10

[0292] The radiographic imaging system according to any one of Appendices 1 to 7, characterized in that the information processing device stores the optical image in association with examination information related to radiography.

[0293] Appendix 11

[0294] The radiographic imaging system according to Appendix 10 is characterized in that the information processing device determines whether to save the optical image, not to save the optical image, or to perform image modification on the optical image and save the modified image based on information related to the condition of the subject.

[0295] Appendix 12

[0296] The radiographic imaging system according to Appendix 6 is characterized in that the image modification is used to mosaic or replace all or part of the optical image with a graphic or the like.

[0297] Appendix 13

[0298] The radiographic imaging system according to Appendix 11 is characterized in that the image modification is used to mosaic or replace all or part of the optical image with a graphic or the like.

[0299] Appendix 14

[0300] An information processing device to be used in a radiographic imaging system, the radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; and an optical image capturing device that captures an optical image of the subject, the information processing device being characterized by comprising:

[0301] Means for controlling the display of an optical image acquired from the optical image capturing device in association with the progress of a predetermined step among a plurality of steps of performing radiography.

[0302] Appendix 15

[0303] A method of controlling an information processing device to be used in a radiographic imaging system, the radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; and an optical image capturing device that captures an optical image of the subject, the method of controlling being characterized by comprising:

[0304] A step for controlling display of an optical image acquired from the optical image capturing device in association with the progress of a predetermined step among a plurality of steps of performing radiography.

[0305] Appendix 16

[0306] A program for causing a computer to execute the control method according to Appendix 15.

[0307] Appendix 17

[0308] A radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; an optical image capturing device that captures an optical image of the subject; and an information processing device that enables information related to radiography using the radiographic imaging device to be viewed on a display unit, the radiographic imaging system being characterized in that

[0309] The information processing device comprises:

[0310] means for acquiring an optical image from an optical image capture device;

[0311] means for acquiring information related to imaging posture; and

[0312] Means for providing notification of information related to suitability of imaging based on information of the optical image and the imaging posture.

[0313] Appendix 18

[0314] An information processing device to be used in a radiographic imaging system, the radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; and an optical image capturing device that captures an optical image of the subject, the information processing device being characterized by comprising:

[0315] means for acquiring an optical image from an optical image capture device;

[0316] means for acquiring information related to imaging posture; and

[0317] Means for providing notification of information related to suitability of imaging based on information of the optical image and the imaging posture.

[0318] Appendix 19

[0319] The information processing device according to Appendix 18, characterized in that it comprises:

[0320] a display unit that displays information; and

[0321] Means for causing a display unit to display information related to suitability of imaging.

[0322] Appendix 20

[0323] The information processing device according to Appendix 19 is characterized by including a component for causing the display unit to display an indication of whether a human body is detected from the optical image.

[0324] Appendix 21

[0325] The information processing device according to Appendix 20 is characterized by including a component for causing the display unit to superimpose a target area determined by consistency specified by human body detection on the optical image.

[0326] Appendix 22

[0327] An information processing device according to any one of Appendices 19 to 21, characterized in that it includes: a component for causing a display unit to display a notification indicating consistency when the position, type and posture of a human body area obtained from an optical image are consistent with information related to an imaging posture.

[0328] Appendix 23

[0329] An information processing device according to any one of Appendices 19 to 22, characterized in that it includes a component for causing a display unit to display a notification indicating inconsistency when information on any one of the position, type and posture of a human body area obtained from an optical image is inconsistent with information related to an imaging posture.

[0330] Appendix 24

[0331] The information processing device according to any one of Appendices 19 to 23 is characterized by including a component for causing a display unit to display an indication that cannot be determined when consistency with information related to an imaging posture cannot be confirmed based on information obtained from an optical image.

[0332] Appendix 25

[0333] An information processing apparatus according to Appendix 18, characterized by comprising a determination section for making a determination based on information on the posture of the subject acquired from the optical image and information on the imaging posture.

[0334] Appendix 26

[0335] The information processing device according to Appendix 25 is characterized in that, when performing consistency determination, the determination section detects a human body to be determined.

[0336] Appendix 27

[0337] The information processing device according to Appendix 26 is characterized in that the determination component determines the consistency when the position, type and posture of the human body area to be determined in the consistency determination match the information related to the imaging posture.

[0338] Appendix 28

[0339] The information processing device according to Appendix 26 or 27 is characterized in that the determination component determines inconsistency when at least one of the position, type and posture of the human body area to be determined in the consistency determination is different from the information related to the imaging posture.

[0340] Appendix 29

[0341] The information processing device according to any one of Appendices 26 to 28 is characterized in that the determination component determines that it cannot be determined when at least one of the position, type and posture of the human body area to be determined in the consistency determination cannot be determined in terms of consistency.

[0342] Appendix 30

[0343] The information processing device according to any one of Appendices 26 to 29 is characterized in that the determination component makes consistency determination when receiving an input of an optical image having a decimation frame rate lower than an acquisition frame rate of the image acquisition component.

[0344] Appendix 31

[0345] A method of controlling an information processing device to be used in a radiographic imaging system, the radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; and an optical image capturing device that captures an optical image of the subject, the control method being characterized by comprising:

[0346] Step for acquiring an optical image from an optical image capture device;

[0347] Steps for acquiring information related to imaging posture; and

[0348] A step for providing notification of information related to suitability of imaging based on the optical image and the information of the imaging posture.

[0349] Appendix 32

[0350] A radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; a plurality of optical image capturing devices, including at least a first optical image capturing device and a second optical image capturing device, each of which captures an optical image of the subject; and an information processing device that enables information related to radiography using the radiographic imaging device to be viewed on a display unit, the radiographic imaging system being characterized in that

[0351] Information processing equipment includes:

[0352] means for acquiring radiography information about a next instance of radiography; and

[0353] Means for determining, based on radiography information, an optical image to be displayed on a display unit in a period until a next instance of radiography from among optical images that can be acquired from the first optical image capturing device and the second optical image capturing device.

[0354] Appendix 33

[0355] An information processing device to be used in a radiographic imaging system, the radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; and a plurality of optical image capturing devices, including at least a first optical image capturing device and a second optical image capturing device, each of which captures an optical image of the subject, the information processing device being characterized by comprising:

[0356] a display unit capable of displaying information;

[0357] means for acquiring radiographic information associated with a next instance of radiography; and

[0358] Means for determining, based on radiography information, an optical image to be displayed on a display unit in a period until a next instance of radiography from among optical images that can be acquired from the first optical image capturing device and the second optical image capturing device.

[0359] Appendix 34

[0360] The information processing device according to Appendix 33 is characterized in that, in a period until the next instance of radiography, the information processing device uses only one of the first optical image capturing device or the second optical image capturing device to acquire an optical image, and causes a display unit to display the acquired optical image.

[0361] Appendix 35

[0362] The information processing device according to Appendix 34 is characterized in that the information processing device determines which optical image capturing device to use in acquiring the optical image from among the multiple optical image capturing devices based on predetermined conditions, and the predetermined conditions include any one of the following: the distance between the subject and the optical image capturing device is short; there are few obstacles between the subject and the optical image capturing device; and the image of the subject is large.

[0363] Appendix 36

[0364] The information processing device according to Appendix 33 is characterized in that, in a period until the next instance of radiography, the information processing device combines a first optical image acquired from a first optical image capturing device with a second optical image acquired from a second optical image capturing device, and causes a display unit to display the combined image.

[0365] Appendix 37

[0366] The information processing device according to any one of Appendixes 33 to 36 is characterized in that

[0367] A radiographic imaging system includes a plurality of radiation emitting devices including the radiation emitting device, and

[0368] The information processing apparatus includes means for setting one radiation emitting apparatus from among the plurality of radiation emitting apparatuses as an apparatus to be used based on the radiographic information.

[0369] Appendix 38

[0370] The information processing device according to any one of Appendixes 33 to 37 is characterized in that

[0371] A radiographic imaging system includes a plurality of radiographic imaging devices including the radiographic imaging device, and

[0372] The information processing apparatus sets one radiographic imaging apparatus from among the plurality of radiographic imaging apparatuses as an apparatus to be used based on the radiographic information.

[0373] Appendix 39

[0374] An information processing device according to any one of Appendices 33 to 38, characterized in that the information processing device includes a component for controlling a screen to be displayed on a display unit based on any one of the following information: a radiographic photograph obtained from the radiographic imaging device; an optical image obtained from the optical image capturing device; and an analysis result obtained by analyzing the optical image.

[0375] Appendix 40

[0376] An information processing apparatus according to any one of Appendices 33 to 39, characterized in that the information processing apparatus controls on and off the display of the optical image obtained from the optical image capturing device based on the radiographic information.

[0377] Appendix 41

[0378] An information processing device according to any one of Appendices 33 to 40, characterized in that the information processing device controls turning on and off the display of analysis results based on the optical image obtained from the optical image capturing device based on the radiographic information.

[0379] Appendix 42

[0380] An information processing device according to any one of Appendices 33 to 41, characterized in that the information processing device performs image processing on an optical image acquired from an optical image capturing device, wherein the image processing is based on geometric shape information obtained based on radiographic information.

[0381] Appendix 43

[0382] The radiographic imaging system according to Appendix 42 is characterized in that the geometric shape information includes any of the following: rotation information; enlargement or reduction information; and information indicating the center coordinates of the optical image.

[0383] Appendix 44

[0384] The information processing device according to any one of Appendices 33 to 43 is characterized in that the radiographic information includes any one of the following: imaging procedures (upright, supine, sitting, portable); body areas to be imaged and patient information.

[0385] Appendix 45

[0386] A method of controlling an information processing device to be used in a radiographic imaging system, the radiographic imaging system comprising: a radiation emitting device that emits radiation; a radiographic imaging device that acquires a radiograph based on the radiation that has passed through a subject; and a plurality of optical image capturing devices, including at least a first optical image capturing device and a second optical image capturing device, each of which captures an optical image of the subject, the control method being characterized by comprising:

[0387] A step for acquiring radiographic information associated with a next instance of radiography; and

[0388] A step for determining, based on radiography information, an optical image to be displayed on a display unit in a period until a next instance of radiography from among optical images obtainable from the first optical image capturing device and the second optical image capturing device.

[0389] Appendix 46

[0390] A program that causes a computer to execute the control method described in Appendix 45.

[0391] While the present disclosure has been described with reference to exemplary embodiments, it is to be understood that the present disclosure is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A radiographic imaging device comprising: an optical image capturing device that captures an optical image of a radiographic subject; as well as an information processing device, causing a display unit to display an optical image acquired by the optical image capturing device, wherein the information processing device acquires information on the steps according to the progress from among a plurality of steps related to radiography, and The information processing device stops displaying the optical image on the display unit based on that the step indicated by the information is a predetermined step among the plurality of steps.

2. An information processing device capable of communicating with an optical image capturing device that captures an optical image of a radiographic subject, the information processing device comprising: One or more controllers, configured to: acquiring, from an optical image capturing device, an optical image acquired by optical image capturing; as well as According to progress to a predetermined step among a plurality of steps related to radiography, display of the optical image on the display unit is stopped.

3. The information processing device according to claim 2, The predetermined step is a step for ending the inspection.

4. The information processing device according to claim 2, The predetermined step is a step in which the radiographic imaging apparatus starts an imaging operation.

5. The information processing device according to claim 2, wherein a superimposed display in which a radiograph and an optical image acquired by radiography are superimposed on each other is enabled, and in, In the superimposed display, the optical image is displayed at a smaller size than the radiograph.

6. The information processing device according to claim 2, The picture displayed on the display unit includes a selection object for turning on or off the display of the optical image.

7. The information processing device according to claim 2, wherein the one or more controllers are further configured to perform predetermined processing based on information related to the condition of the subject as a process of displaying the optical image on the display unit, and The predetermined processing is any one of the following: display; no display; or performing image change and displaying the changed image.

8. The information processing device according to claim 7, The image modification is used to mosaic or replace all or part of the optical image with graphics or the like.

9. The information processing device according to claim 2, wherein the one or more controllers are further configured to: Based on the analysis result on the optical image, situation information related to the subject is displayed on the display unit.

10. The information processing device according to claim 9, wherein the one or more controllers are further configured to: The status information and the optical image are displayed on the same screen of the display unit.

11. The information processing device according to claim 9, The information processing device displays the situation information on a screen of a display unit instead of displaying an optical image.

12. The information processing device according to claim 11, wherein the one or more controllers are further configured to: Based on the information related to the condition of the object, it is determined whether to save the optical image, not to save the optical image, or to perform image modification on the optical image and save the modified image.

13. The information processing device according to claim 2, wherein the one or more controllers are further configured to: The optical image is stored in association with examination information related to radiography.

14. A method of controlling an information processing apparatus capable of communicating with an optical image capturing device that captures an optical image of a radiographic subject, the method comprising: acquiring, from an optical image capturing device, an optical image acquired by optical image capturing; as well as According to progress to a predetermined step among a plurality of steps related to radiography, display of the optical image on the display unit is stopped. 15 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute the control method according to claim 14 .

16. An information processing device capable of communicating with an optical image capturing device that captures an optical image of a radiographic subject, the information processing device comprising: One or more controllers, configured to: acquiring an optical image from an optical image capture device; as well as A human body is detected from the optical image and information corresponding to the result of the detection is displayed on a display unit.

17. An information processing device capable of communicating with a first optical image capturing device and a second optical image capturing device, each of which captures an optical image of a radiographic subject, the information processing device comprising: One or more controllers, configured to: obtaining radiographic information about a next instance of radiography; as well as Based on the radiographic information, a display unit is caused to display one optical image from among optical images that can be acquired from the first optical image capturing device and the second optical image capturing device.

18. An information processing device capable of communicating with a first optical image capturing device and a second optical image capturing device, each of which captures an optical image of a radiographic subject, the information processing device comprising: One or more controllers, configured to: A first display process or a second display process is performed on a display unit, wherein the display unit displays an operation screen including a first display area in which a radiographic photograph can be placed and a second display area in which radiographic information can be placed, the first display process causes an optical image to be superimposed in the first display area, and the second display process causes the optical image to be superimposed in the second display area.

Images