Information processing device, method for determining whether to continue shooting, and program

Abstract

The present invention provides an information processing device, a method for determining whether to continue shooting, and a program that can suppress the amount of radiation exposure to a subject when image loss occurs. [Solution] The information processing device includes an image acquisition unit that acquires image data including the physical movements of a subject during the acquisition of a radiation image obtained by irradiating the subject with radiation, and a determination unit that determines whether or not it is necessary to stop the acquisition of the radiation image based on the information regarding the physical movements of the subject in the image data.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, a method for determining continuous shooting, and a program.

Background Art

[0002] There is known a radiation imaging apparatus that irradiates a subject with radiation to capture a radiation image. In recent radiation imaging apparatuses, there are some that enable not only still image shooting but also dynamic shooting (moving image shooting) by continuously irradiating the subject with radiation. Dynamic shooting is generally applied when shooting the chest or the like in the field of respiratory medicine. In recent years, however, application of this dynamic shooting to the field of plastic surgery has been studied.

[0003] In the field of plastic surgery, when capturing a radiation dynamic image of a subject, in order to accurately capture the imaging target site, the subject needs to perform accurate body movements. Therefore, various proposals have been made to accurately capture a radiation dynamic image.

[0004] For example, Patent Document 1 describes an imaging apparatus that generates a guide image and causes the subject to move so that the body movement of the subject matches the guide image in order to be able to image the subject in the same position when periodically capturing a radiation image.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] By the way, when capturing a radiation image, the subject usually performs body movements according to explanations received orally from a technician or the like about specific body movements, or explanations when being shown actual body movements.

[0007] However, even when given verbal instructions or other methods to perform physical movements, subjects often have difficulty accurately reproducing detailed conditions such as bending joints to a predetermined angle. Furthermore, as described in Patent Document 1, even when subjects are instructed to perform physical movements in accordance with guide images, there is no guarantee that the subjects will perform the physical movements accurately.

[0008] Thus, if the subject is unable to perform accurate physical movements, the acquisition of the radiographic image will fail, resulting in what is known as "image loss." When image loss occurs, the radiographic image is usually re-acquired. In re-acquiring, the subject M is exposed to radiation again, so the amount of radiation exposure to the subject during the series of radiographic images acquired increases compared to when re-acquiring was not necessary.

[0009] The purpose of this disclosure is to provide an information processing device, a method for determining whether to continue shooting, and a program that can suppress the amount of radiation exposure to a subject when image loss occurs. [Means for solving the problem]

[0010] The radiography apparatus related to this disclosure is An image acquisition unit that acquires image data including the body movements of the subject during the acquisition of a radiation image obtained by irradiating the subject with radiation, A determination unit that determines whether or not it is necessary to stop taking the radiographic image based on information regarding the subject's physical movements in the image data, It holds.

[0011] The method for determining whether to continue filming related to this disclosure is: Image data including the body movements of the subject during the acquisition of a radiation image obtained by irradiating the subject with radiation, Based on the information regarding the subject's physical movements in the image data, it is determined whether or not it is necessary to stop the acquisition of the radiographic image.

[0012] The program related to this disclosure is Cause the computer to execute the above-described shooting continuation determination method.

Advantages of the Invention

[0013] According to the present disclosure, when radiation damage occurs, the exposure dose to the subject can be suppressed.

Brief Description of the Drawings

[0014] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a radiation image processing system according to the present embodiment. [Figure 2] FIG. 2 is a functional block diagram showing an example of the configuration of the radiation imaging control unit of FIG. 1. [Figure 3] FIG. 3 is a functional block diagram showing an example of the configuration of the optical imaging control unit of FIG. 1. [Figure 4] FIG. 4 is a functional block diagram showing an example of the configuration of the console device of FIG. 1. [Figure 5] FIG. 5 is a schematic diagram for explaining a checkpoint. [Figure 6] FIG. 6 is a schematic diagram showing an example of reference checkpoint information. [Figure 7] FIG. 7 is a sequence diagram showing an example of the processing flow when imaging the body movement of a subject in a radiation image processing system according to the present embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of the flow of the shooting continuation determination process of FIG. 7.

Modes for Carrying Out the Invention

[0015] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the following embodiments, and various modifications can be made without departing from the gist of the present disclosure. Also, in each figure, those denoted by the same reference numerals are the same or corresponding ones, which is common throughout the entire specification.

[0016] The radiation image processing system according to this embodiment performs radiation dynamic imaging for generating a radiation dynamic image, and performs various analysis processes on the generated radiation dynamic image. Further, the radiation image processing system performs optical dynamic imaging for generating an optical dynamic image simultaneously with the radiation dynamic imaging. Then, the radiation image processing system determines whether the body movement of the subject is correct based on the generated optical dynamic image, and determines whether to interrupt the radiation dynamic imaging based on the determination result.

[0017] In this specification, the "radiation dynamic image" is a moving image generated based on a plurality of images for each frame obtained by radiation dynamic imaging in which radiation such as X-rays is pulsed and repeatedly irradiated to a subject at a predetermined interval, or continuously irradiated without interruption. Further, the "optical dynamic image" is a moving image generated based on a plurality of images for each frame obtained by optical dynamic imaging of a subject. In the following description, radiation dynamic imaging and optical dynamic imaging may be collectively referred to as "dynamic imaging".

[0018] <Configuration of Radiation Image Processing System> FIG. 1 is a schematic diagram showing an example of the configuration of a radiation image processing system 1 according to this embodiment. The radiation image processing system 1 includes a radiation image imaging device 10, a console device 20, a radiation image analysis device 30, an image management device 40, and a client terminal 50. Note that the console device 20 corresponds to the "information processing device" of the present disclosure.

[0019] In the example shown in FIG. 1, the radiation image imaging device 10 is arranged in a imaging room. The console device 20 is arranged in an operation room. The radiation image imaging device 10, the console device 20, the radiation image analysis device 30, the image management device 40, and the client terminal 50 are connected to each other via a communication network. As the communication network, for example, a communication network conforming to the DICOM (Digital Image and Communications in Medicine) standard or the like is used.

[0020] The radiographic imaging device 10 performs radiographic dynamic imaging, which is a radiographic image, based on the control of the console device 20. The radiographic dynamic imaging generated by the radiographic imaging device 10 is transmitted to the radiographic image analysis device 30 via the console device 20.

[0021] Furthermore, in this embodiment, the radiographic imaging device 10 performs optical motion imaging, which is an optical image, based on the control of the console device 20. The optical motion image generated by the radiographic imaging device 10 is transmitted to the console device 20.

[0022] The radiographic image analysis device 30 performs dynamic analysis on the radiographic dynamic images. The radiographic dynamic images and the results of the dynamic analysis are transmitted to an image management device 40 (e.g., a PACS (Picture Archiving and Communication System)) as a medical image management system for management. The radiographic dynamic images and the results of the dynamic analysis are also transmitted to a client terminal 50 for viewing by medical professionals such as doctors.

[0023] The radiographic imaging device 10, the console device 20, and the radiographic image analysis device 30 each have a processor and memory (not shown). The radiographic imaging device 10, the console device 20, and the radiographic image analysis device 30 are each a type of computer that realizes predetermined functions by reading, expanding, and executing programs stored in memory.

[0024] (Radiation imaging device 10) As shown in Figure 1, the radiation imaging apparatus 10 comprises a radiation imaging control unit 11, a radiation irradiation unit 12, an imaging table 13, a radiation detection unit 14, a display unit 15, an audio output unit 16, an optical imaging control unit 17, and an optical imaging unit 18.

[0025] The radiography control unit 11 acquires radiation setting information related to the settings for dynamic radiography from the console device 20. Based on the radiation setting information, the radiography control unit 11 sets the radiography conditions for performing dynamic radiography, and controls the radiation irradiation unit 12 based on these radiography conditions to irradiate the subject M (e.g., a patient) with radiation and perform imaging. The radiography control unit 11 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc.

[0026] Radiation setting information refers to information regarding the settings for performing dynamic radiography on a subject M. For example, the radiation setting information includes at least one of several types of dynamic analysis that the radiography image analysis device 30 can perform on the dynamic radiography image. If multiple types of dynamic analysis are combined, the radiation setting information may also include information regarding that combination. The radiation setting information is set in the console device 20 (described later) by the operator of the radiography image processing system 1, such as a radiographer.

[0027] The radiography conditions include various factors such as pulse rate, pulse width, pulse interval, number of frames per scan, dose per unit time of radiation exposure, and the physical condition of the subject M (e.g., respiratory status). The pulse rate is the number of radiation exposures per second and corresponds to the frame rate of the image data. The pulse width is the radiation exposure time per exposure. The pulse interval is the time from the start of one radiation exposure to the start of the next and corresponds to the time interval (frame interval) between multiple image data. The radiography conditions can be automatically determined by the radiography control unit 11 of the radiography imaging device 10 based on the radiation setting information.

[0028] The radiation irradiation unit 12 is positioned opposite the radiation detection unit 14, which is fixed to the imaging table 13. The radiation irradiation unit 12 irradiates radiation (X-rays) according to the control of the radiation imaging control unit 11.

[0029] The radiation detection unit 14 is composed of a semiconductor image sensor such as an FPD (Flat Panel Detector). The radiation detection unit 14 has a substrate on which multiple detection elements (pixels) are arranged in a matrix to detect radiation irradiated from the radiation irradiation unit 12 according to its intensity, and to convert the detected radiation into an electrical signal and store it. Each pixel on the substrate is composed of a switching unit such as a TFT (Thin Film Transistor).

[0030] The radiation detection unit 14 controls the switching unit of each pixel based on the image reading conditions input from the console device 20 to read the electrical signal accumulated in each pixel and outputs intensity information for each pixel to the image generation unit 113. The image reading conditions include, for example, the frame rate, frame interval, pixel size, and image size (matrix size). The frame rate is the number of frame images acquired per second and is the same as the pulse rate. The frame interval is the time from the start of one image data acquisition operation to the start of the next frame image acquisition operation and is the same as the pulse interval.

[0031] The radiation imaging control unit 11 and the radiation detection unit 14 are connected to each other and exchange synchronization signals to synchronize the radiation irradiation operation and the image reading operation.

[0032] Thus, the radiation imaging device 10 irradiates radiation through the radiation irradiation unit 12 under the control of the radiation imaging control unit 11. The radiation imaging device 10 then performs dynamic imaging of radiation images by generating image data based on the radiation intensity of the irradiated radiation through the radiation detection unit 14. The configuration including the radiation irradiation unit 12 and the radiation detection unit 14 corresponds to the "radiation imaging unit" in this disclosure.

[0033] The display unit 15 and the audio output unit 16 provide instructions to the subject M regarding the posture and physical condition (such as respiratory status) to be maintained when performing dynamic imaging of the subject M. The display unit 15 is, for example, a display device such as a CRT (Cathode Ray Tube), liquid crystal display, or organic EL (Electro Luminescence) display placed in the imaging room. Alternatively, the display unit 15 may be a portable terminal such as a tablet.

[0034] The audio output unit 16 is, for example, an audio output device such as a speaker. The display unit 15 and the audio output unit 16 may each give the same instructions to the subject M, or only one of them may give instructions.

[0035] The optical imaging control unit 17 acquires optical setting information from the console device 20 regarding the settings for performing optical dynamic imaging on the subject M. Based on the optical setting information, the optical imaging control unit 17 sets the optical imaging conditions for performing optical dynamic imaging, and controls the optical imaging unit 18 based on these optical imaging conditions to perform optical imaging of the subject M. The optical imaging control unit 17 is composed of a CPU, RAM, ROM, etc.

[0036] Optical imaging conditions include various factors such as the frame rate during imaging, the number of frames captured per imaging session, and the state of the subject M. The frame rate is the number of frame images acquired per second. The optical imaging conditions can be automatically determined by the optical imaging control unit 17 of the radiographic imaging device 10 based on the optical setting information.

[0037] The optical imaging unit 18 is an optical camera having, for example, an optical system including a lens and a focusing mechanism (not shown), an aperture mechanism, an image sensor, a lens drive unit, and an aperture drive unit, and it photographs the subject M. For example, in this embodiment, the optical imaging unit 18 photographs the body movements of the subject M performed during radiodynamic radiography as optical images.

[0038] The optical imaging unit 18 forms an image of the incident light on the image sensor and generates optical image data, including the body movements of the subject M, frame by frame. The optical imaging unit 18 sequentially outputs the generated optical image data of multiple frames to the optical imaging control unit 17.

[0039] The optical imaging unit 18 is positioned near the radiation irradiation unit 12, for example, such that the imaging range by optical imaging includes the imaging range by radiography. However, it is not limited to this, and the optical imaging unit 18 may be positioned in a location that allows imaging of the entire imaging room.

[0040] (Radiation imaging control unit 11) Figure 2 is a functional block diagram showing an example of the configuration of the radiation imaging control unit 11 shown in Figure 1. As shown in Figure 2, the radiation imaging control unit 11 includes a setting information acquisition unit 111, a shooting condition determination unit 112, an image generation unit 113, and a storage unit 114.

[0041] The setting information acquisition unit 111 acquires radiation setting information from the console device 20.

[0042] The imaging condition determination unit 112 determines the radiography conditions for performing radiodynamic radiography of the subject M based on the radiation setting information acquired from the console device 20.

[0043] The image generation unit 113 performs dynamic radiography of the subject M based on the determined radiography conditions and generates multiple frames of radiographic images. Specifically, the image generation unit 113 controls the operation of the radiation irradiation unit 12 and the radiation detection unit 14 based on the radiography conditions, and generates image data by acquiring intensity information regarding the radiation intensity transmitted through the subject from the radiation detection unit 14 for each pixel.

[0044] The memory unit 114 has pre-stored information such as the correspondence between multiple types of dynamic analysis and the radiography conditions suitable for each dynamic analysis.

[0045] (Optical imaging control unit 17) Figure 3 is a functional block diagram showing an example of the configuration of the optical imaging control unit 17 shown in Figure 1. As shown in Figure 3, the optical imaging control unit 17 includes a setting information acquisition unit 171, an imaging condition determination unit 172, an image generation unit 173, and a storage unit 174.

[0046] The setting information acquisition unit 171 acquires optical setting information from the console device 20.

[0047] The imaging condition determination unit 172 sets the optical imaging conditions for performing optical dynamic imaging of the subject M based on the optical setting information acquired by the setting information acquisition unit 171.

[0048] The image generation unit 173 performs optical motion imaging of the subject M based on the determined optical imaging conditions. Specifically, the image generation unit 173 controls the operation of the optical imaging unit 18 based on the optical imaging conditions and generates an optical motion image of the subject M based on multiple optical image data frames received from the optical imaging unit 18.

[0049] The memory unit 174 stores optical setting information acquired from the console device 20, and optical shooting conditions set based on the optical setting information. The memory unit 174 also stores optical image data received from the optical shooting unit 18, and optical dynamic images generated based on the optical image data.

[0050] (Console device 20) The console device 20 in Figure 1 is, for example, a computer such as a PC (Personal Computer) or a workstation. The console device 20 may be a desktop computer, as in the example shown in Figure 1, or it may be a portable computer, such as a laptop or tablet computer.

[0051] The console device 20 receives examination order information from a RIS (Radiology Information System; not shown) or the like, and transmits it to the radiography imaging device 10, thereby controlling the radiodynamic and optical dynamic imaging of the radiography imaging device 10. The examination order information includes various information related to the dynamic imaging to be performed next, such as patient information, examination information, and data attributes. The examination information includes information such as examination ID, the area to be examined, and the type of analysis. Examination order information is generated, for example, when a physician requests radiodynamic or optical dynamic imaging of subject M from the radiography image processing system 1.

[0052] Furthermore, the console device 20 generates radiation setting information indicating at least one of the multiple types of dynamic analysis that the radiation image analysis device 30 can perform, based on the operator's input. When multiple types of dynamic analysis are to be combined, the console device 20 generates radiation setting information indicating the combination of multiple types of dynamic analysis. The operator recognizes which of the multiple types of dynamic analysis to combine by, for example, referring to the contents of the examination order information, and performs the input operation to generate the radiation setting information based on this. Alternatively, the operator may recognize which dynamic analysis to combine based on information conveyed by a physician or other person through another method.

[0053] Furthermore, the console device 20 generates optical setting information based on the operator's input. The operator recognizes the condition of the subject M by, for example, referring to the contents of the examination order information, and performs input operations to generate optical setting information based on this.

[0054] Figure 4 is a functional block diagram showing an example of the configuration of the console device 20 shown in Figure 1. As shown in Figure 4, the console device 20 has a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, and a communication unit 25. Each component of the console device 20 is connected to the others by a bus 26. Note that in Figure 4, only the processing unit related to the processing of optical motion images among the processing units of the control unit 21 is shown.

[0055] The console device 20 outputs radiation setting information and optical setting information generated based on input from the operator, as well as inspection order information previously obtained from the RIS, etc., to the radiation imaging device 10, and controls the imaging process by the radiation imaging device 10. The console device 20 may also display the radiation dynamic images and optical dynamic images generated by the radiation imaging device 10, for example, for the operator to review.

[0056] The control unit 21 is composed of a CPU and RAM, etc. In the control unit 21, the CPU reads system programs and various processing programs stored in the memory unit 22 in response to operations on the operation unit 23, expands them into RAM, and performs operation control and image analysis of each part of the console device 20 based on the expanded programs.

[0057] The control unit 21 includes a setting information generation unit 211, a setting information output unit 212, an image acquisition unit 213, an image analysis unit 214, and a comparison and determination unit 215.

[0058] The setting information generation unit 211 generates optical setting information based on input from the operator or other user. For example, when the operator recognizes the state of the subject M by referring to the contents of the inspection order information and performs an input operation based on this, the setting information generation unit 211 generates optical setting information.

[0059] The setting information output unit 212 outputs the optical setting information generated by the setting information generation unit 211. The output optical setting information is transmitted to the radiation imaging device 10 via the communication unit 25.

[0060] The image acquisition unit 213 acquires optical image data transmitted from the radiation imaging device 10. The acquired optical image data is supplied to the image analysis unit 214.

[0061] The image analysis unit 214 performs predetermined analysis processing on the acquired optical image data. In this embodiment, the image analysis unit 214 performs a skeleton extraction process to extract the skeleton of the subject M contained in the optical image data as part of the analysis processing. Well-known techniques can be applied to the skeleton extraction process.

[0062] Furthermore, the image analysis unit 214 sets checkpoints in the optical image data. These checkpoints are used to determine whether the subject M's physical movements are being performed correctly. Details of the checkpoints will be described later.

[0063] The comparison and determination unit 215 compares the checkpoints set in the optical image data with the reference checkpoint information associated with the motion model video, and determines whether the checkpoints in the optical image data are included in the reference checkpoint information. The motion model video is a video containing motions that serve as a standard for the physical movements that subject M should perform. The reference checkpoint information is information that serves as a standard for determining whether the physical movements performed by subject M are performed correctly. Details of the motion model video and reference checkpoint information will be described later.

[0064] Furthermore, the comparison and determination unit 215 determines whether the physical movements performed by subject M are correct or incorrect based on the checkpoint determination results. Then, the comparison and determination unit 215 determines whether or not it is necessary to interrupt the radiodynamic imaging based on the correct or incorrect determination result. The comparison and determination unit 215 corresponds to the "determination unit" in this disclosure.

[0065] The storage unit 22 is composed of a non-volatile semiconductor memory or a hard disk, etc. The storage unit 22 stores various programs executed by the control unit 21, as well as data such as parameters necessary for executing processing by the programs, or processing results. The various programs are stored in the form of readable program code, and the control unit 21 sequentially executes operations according to the program code.

[0066] Furthermore, the memory unit 22 stores image reading conditions for performing dynamic radiography. In addition, the memory unit 22 stores examination order information transmitted from the RIS, etc. When the console device 20 controls the dynamic radiography of the radiography imaging device 10, the image reading conditions and examination order information corresponding to the subject M are read from the memory unit 22 and transmitted to the radiography imaging device 10 via the communication unit 25.

[0067] The storage unit 22 is provided with a database 221. The database 221 stores reference checkpoint information obtained from motion model video, optical setting information, and checkpoints set based on the skeleton extracted from the motion model video, in association with each other. The database 221 also stores optical motion images obtained by optical motion photography in association with checkpoints set on those optical motion images.

[0068] The operation unit 23 is an operation device such as a keyboard equipped with cursor keys, numeric input keys, and various function keys, a pointing device such as a mouse or trackball, or a touch panel. The operation unit 23 generates instruction signals based on the operator's input and outputs them to the control unit 21. The operation unit 23 may also be equipped with a touch panel on the display screen of the display unit 24, in which case the operation unit 23 outputs instruction signals input via the touch panel to the control unit 21.

[0069] The display unit 24 is composed of a display device such as a CRT, liquid crystal display, or organic EL display. The display unit 24 displays input instructions from the operation unit 23 and image data generated by the radiographic imaging device 10, etc., according to the instructions of the display signals input from the control unit 21.

[0070] The communication unit 25 transmits and receives data between the radiation image acquisition device 10, the radiation image analysis device 30, and the RIS, etc.

[0071] (Radiation image analysis device 30) The radiation image analysis device 30 is, for example, a computer such as a PC or workstation. The radiation image analysis device 30 may be a desktop computer or a portable computer, such as a laptop or tablet computer.

[0072] The radiation image analysis device 30 performs various dynamic analyses on the dynamic images captured by the radiation image acquisition device 10 based on the radiation setting information set in the console device 20.

[0073] [Operation of Radiation Image Processing System 1] The operation of the radiation image processing system 1 according to this embodiment having the above configuration will be described. Here, an example of the procedure when acquiring a radiation dynamic image of a subject M will be described.

[0074] First, when taking a radiodynamic image of subject M, the console device 20 reads the previously acquired examination order information from the storage unit 22. The setting information generation unit 211 of the console device 20 generates radiation setting information based on input from the operator, etc. The console device 20 transmits the examination order information and radiation setting information to the radiation imaging device 10 via the communication unit 25.

[0075] The setting information acquisition unit 111 of the radiographic imaging device 10 receives examination order information and radiographic setting information transmitted from the console device 20. Then, the imaging condition determination unit 112 of the radiographic imaging device 10 determines the radiographic imaging conditions based on the received examination order information and radiographic setting information.

[0076] The image generation unit 113 of the radiographic imaging device 10 performs radiographic dynamic imaging using the determined radiographic imaging conditions and generates a radiographic dynamic image from multiple frames of radiographic images. The radiographic imaging device 10 transmits the generated radiographic dynamic image to the radiographic image analysis device 30 via the console device 20.

[0077] The radiation image analysis device 30 receives radiation dynamic images from the console device 20 and performs various dynamic analyses on the received radiation dynamic images.

[0078] (Regarding physical movements during dynamic radiography) In the field of orthopedics, when performing dynamic radiography, the subject M is asked to perform physical movements in order to observe the condition of the affected area, which is the target area for imaging, as the body moves. At this time, the subject M performs the physical movements according to the instructions given to them by the technician or other personnel, either verbally or by being shown the actual movements.

[0079] However, even when given verbal instructions, subject M may have difficulty accurately performing the physical movements as instructed. In such cases, when subject M is unable to perform the physical movements accurately, the dynamic radiography fails, resulting in what is known as "image loss."

[0080] If image loss occurs, the radiodynamic images are usually re-taken. In re-taking, the subject M is exposed to radiation again, so the amount of radiation exposure to the subject M in the series of radiodynamic imaging increases compared to when re-taking was not necessary.

[0081] In dynamic radiography, it is desirable to minimize the radiation exposure to the subject M. Therefore, to minimize the radiation exposure to the subject M, it is necessary to quickly interrupt any imaging that results in image loss. Consequently, if imaging that results in image loss occurs, it is necessary to quickly determine that image loss occurred during the imaging process.

[0082] In this context, the determination of image defects is generally made by visual inspection, for example, by a technician. Specifically, if subject M does not perform any physical movement or performs an obviously incorrect physical movement, the technician can visually confirm the inaccurate physical movement and interrupt the dynamic radiography at that point. The same applies if the area being photographed moves out of the field of view of the dynamic radiography image.

[0083] However, in cases of physical movements that cannot be visually confirmed, such as whether or not detailed conditions are met, like bending a joint to a predetermined angle, it is difficult for technicians to make an appropriate decision on whether or not to interrupt the dynamic radiography.

[0084] Therefore, in this embodiment, a determination process is performed to quickly determine whether or not image loss has occurred during dynamic radiography, and to determine whether or not it is necessary to interrupt the dynamic radiography based on the determination result.

[0085] (Filming of physical movements) In this embodiment, when performing dynamic radiography in the field of orthopedics, etc., optical dynamic radiography is performed simultaneously with dynamic radiography. When dynamic radiography, including dynamic radiography and optical dynamic radiography, is started, it is first determined whether the subject M is performing physical movements accurately based on the optical dynamic images obtained by optical dynamic radiography.

[0086] To determine whether a subject M's physical movements are correct or incorrect, motion model videos corresponding to the subject M's physical movements, captured by optical motion imaging, are used. These motion model videos are videos containing images of a predetermined body performing a standard physical movement that the subject M should perform. These motion model videos are prepared in advance by a physician or technician, for example, based on optical setting information.

[0087] Here, the motion model video has checkpoints set that are used in the recording continuation decision process to determine whether the subject M's body movements are being performed accurately. The checkpoints are determined according to optical setting information that indicates the conditions under which the subject M performs body movements. Such checkpoints are set, for example, based on the body's skeleton included in the motion model video. Specifically, the checkpoints are, for example, angles and coordinates at various joints formed based on the body's skeleton.

[0088] Furthermore, the skeleton of the body included in the motion model video is extracted from the image representing the body by performing a skeleton extraction process on the video. For example, well-known techniques can be used for the skeleton extraction process. Specifically, in the skeleton extraction process, feature points such as joints in the body are detected, and the skeleton of the body is extracted based on the detected feature points.

[0089] For example, let's consider the case of bending the elbow as an example of physical movement. Figure 5 is a schematic diagram to explain the checkpoints.

[0090] Generally, when bending the elbow, not only the elbow but also the wrist and shoulder joint move simultaneously, and the angles of each part are thought to change. Therefore, in this case, as shown in Figure 5, the wrist angle α, the elbow angle β, and the shoulder joint angle γ are set as checkpoints.

[0091] The wrist angle α is the internal angle formed by the skeletal structure of the wrist when the wrist is bent inward. The elbow angle β is the internal angle formed by the skeletal structure of the elbow when the elbow is bent inward. The shoulder joint angle γ is the internal angle formed by the skeletal structure of the shoulder joint.

[0092] Furthermore, since the position of the elbow is thought to change in accordance with body movements, the coordinates (X,Y) of the elbow may also be set as a checkpoint.

[0093] Checkpoints are set at multiple predetermined timings between the start and end of the body's movement in the motion model video. This is because the angles of each part that constitute the checkpoints differ depending on the elapsed time since the start of the body's movement.

[0094] Checkpoints are set at predetermined intervals while playing back pre-prepared motion model videos. For example, checkpoints may be set at the start of a physical movement, after a predetermined amount of time has elapsed since the start of the physical movement, and when the physical movement ends.

[0095] Here, the radiographic region, which is the imaging area in radiodynamic radiography, and the optical imaging region, which is the imaging area in optical dynamic radiography, are different. For example, in the example in Figure 5, in order to observe the state of the elbow, the radiographic region is the area around the elbow, as shown by the dashed line region A. On the other hand, the optical imaging region is the entire arm, including the shoulder, as shown by the dashed line region B. The optical imaging region is set to, for example, the region that includes the radiographic region.

[0096] Checkpoints are set not only for areas included in the radiographic field, but also for areas not included in the radiographic field but included in the optical field. This is because, as mentioned above, when observing an area included in the radiographic field (elbow), not only that area but also other areas (wrist and shoulder joint) move simultaneously, and this movement affects the movement of the area being observed (elbow).

[0097] Once checkpoints are set for the motion model video in this manner, reference checkpoint information is generated based on the set checkpoints. This reference checkpoint information is used to determine whether the subject M's physical movements are correct or incorrect, and it has a checkpoint range that includes a reference value for determining whether the physical movements are correct or incorrect.

[0098] Figure 6 is a schematic diagram showing an example of reference checkpoint information. In this example, the reference checkpoint information includes the wrist angle α, the elbow angle β, the shoulder joint angle γ, and the elbow coordinates (X,Y).

[0099] As shown in Figure 6, the checkpoints included in the reference checkpoint information are set for multiple predetermined timings between the start and end of body movement in the optical motion image. In this example, the checkpoints are set for the start of body movement, intermediate point #1 and intermediate point #2 after a predetermined time has elapsed from the start, and the end of the movement. These checkpoints are set to values ​​within a predetermined range, including the checkpoint values ​​in the motion model motion image, taking into account acceptable errors, etc.

[0100] When reference checkpoint information is generated, the motion model video is associated with the optical setting information and the reference checkpoint information shown in Figure 6, and registered in the database 221 of the storage unit 22 in the console device 20.

[0101] Although it was explained that motion model videos are prepared in advance based on optical setting information, this is not limited to this example. When subject M is regularly subjected to dynamic radiography, it is easier to observe the progress of the affected area if subject M's physical movements are always the same. Therefore, in this case, past optical dynamic images or dynamic radiography images may be used as motion model videos.

[0102] Furthermore, while motion model videos are prepared according to the body part being observed, it is preferable to prepare multiple different motion model videos depending on the body type and age of subject M, even if the body part being observed is the same, in order to compare them with the subject M's physical movements. This is to reduce the error during comparison by using a motion model video that is close to the state of subject M when comparing the optical dynamic image of subject M with the motion model video.

[0103] (Process to determine whether to continue shooting) Next, when a predetermined timing included in the reference checkpoint information is reached after motion imaging has started, the optical image data constituting the optical motion image obtained by optical motion imaging is subjected to skeletal extraction processing, similar to that performed on motion model motion images. Then, the skeleton of subject M is extracted through skeletal extraction processing.

[0104] Then, once the skeleton is extracted, checkpoints are set based on the extracted skeleton, similar to the motion model video. The set checkpoints are associated with the optical image data along with the optical setting information and registered in the database 221 of the storage unit 22 in the console device 20.

[0105] Next, the values ​​of the reference checkpoint information associated with the motion model video are compared with the checkpoint values ​​set in the optical image data. Specifically, first, based on the optical setting information at the time the optical motion image was captured, the reference checkpoint information corresponding to the motion model video associated with that optical setting information is read from database 221. Also, based on this optical setting information, the checkpoints of the optical image data associated with that optical setting information are read from database 221.

[0106] Next, the reference checkpoint information of the motion model video read from database 221 and the checkpoint values ​​of the optical image data are compared. Based on the results of this comparison, it is determined whether the subject M's physical movement is correct or not, that is, whether the physical movement is being performed accurately.

[0107] Specifically, it is determined whether the checkpoint values ​​set in the optical image data fall within the checkpoint range of the motion model video. If the checkpoint values ​​fall within the checkpoint range, it is determined that the subject M's body movements are being performed accurately. If it is determined that the subject M's body movements are being performed accurately, motion recording continues until the series of body movements is completed.

[0108] On the other hand, if the checkpoint value is not within the checkpoint range, it is determined that the subject M's physical movements are not being performed correctly. If it is determined that the subject M's physical movements are not being performed correctly, the motion imaging is interrupted. If motion imaging is interrupted, the motion imaging will be restarted after the subject M confirms that the physical movements are being performed correctly.

[0109] In this embodiment, the above-described process is performed based on optical image data corresponding to all timings included in the reference checkpoint information.

[0110] In this embodiment, checkpoints are set on the optical image data, and the correctness of the subject M's physical movements is determined based on the values ​​of the set checkpoints. This makes it possible to appropriately determine whether the subject M's physical movements are being performed correctly, such as whether the subject M did not perform any physical movements or performed clearly incorrect physical movements. Furthermore, if the subject M moves out of the field of view, it is not possible to set checkpoints, so it is also possible to appropriately detect that the subject M is not performing physical movements correctly.

[0111] Furthermore, if the dynamic radiography is interrupted at a predetermined time, one possible reason for the subject's physical movements being judged as inaccurate is that pain or other factors may limit the subject M's range of motion, preventing them from performing the physical movements shown in the motion model video. Therefore, even if the dynamic radiography images are retaken, there is a possibility that the physical movements will again be judged as inaccurate. In this case, for example, the checkpoint range value, which is the criterion for judging physical movements, may be changed to a value lowered from the current value within a range that does not affect the dynamic radiography.

[0112] This allows for a reassessment of the correctness of body movements based on the modified criteria during recapture of dynamic images, thereby preventing unnecessary interruptions to dynamic imaging. Furthermore, by preventing unnecessary interruptions to recapture, it is possible to suppress an increase in the radiation exposure of subject M.

[0113] (Process flow) Figure 7 is a sequence diagram showing an example of the processing flow when capturing the physical movements of a subject M in the radiation image processing system 1 according to this embodiment. Here, the processing flow in the radiation image acquisition device 10 and console device 20 when performing radiodynamic and optical dynamic imaging of the subject M is shown. In this example, only the processing related to optical dynamic imaging is described, and the processing related to radiodynamic imaging, which is performed simultaneously with optical dynamic imaging, is omitted from the explanation.

[0114] First, in step S1, the setting information generation unit 211 of the console device 20 generates optical setting information based on input from the operator or the like. Then, the setting information output unit 212 outputs the generated optical setting information to the radiographic imaging device 10 along with the examination order information received from the RIS or the like (SEQ1).

[0115] In step S2, the setting information acquisition unit 171 of the radiographic imaging device 10 acquires optical setting information and inspection order information output from the console device 20.

[0116] In step S3, the imaging condition determination unit 172 of the radiographic imaging device 10 sets the optical imaging conditions for performing optical dynamic imaging based on the acquired optical setting information.

[0117] In step S4, the image generation unit 173 of the radiographic imaging apparatus 10 controls the optical imaging unit 18 based on the set optical imaging conditions to perform optical dynamic imaging of the subject M's body movements and acquire multiple optical image data. The image generation unit 173 then transmits the acquired optical image data to the console device 20 each time it acquires optical image data through optical dynamic imaging (SEQ2). In this case, the transmission interval of the optical image data is, for example, in frames.

[0118] Although not explained here, the image generation unit 173 may generate an optical motion image based on the multiple optical image data acquired in step S4 and transmit the generated optical motion image to the console device 20.

[0119] When optical image data is transmitted from the radiography imaging device 10 to the console device 20, in step S5, the image acquisition unit 213 of the console device 20 acquires the optical image data transmitted from the radiography imaging device 10. Then, in step S6, the image analysis unit 214 of the console device 20 performs a determination process to continue imaging based on the acquired optical image data.

[0120] Figure 8 is a flowchart showing an example of the process for determining whether to continue shooting, as shown in Figure 7.

[0121] In step S11, the control unit 21 of the console device 20 determines whether the optical image data acquired from the radiographic imaging device 10 is subject to a determination to continue imaging. Specifically, for example, the control unit 21 reads reference checkpoint information from the database 221. Then, the control unit 21 compares the imaging (acquisition) timing of the acquired optical image data with the timing of the checkpoints included in the reference checkpoint information. Based on this, the control unit 21 determines whether the optical image data is subject to a determination to continue imaging.

[0122] If the optical image data is subject to a determination of whether to continue shooting (step S11: Yes), the image analysis unit 214 of the control unit 21 performs a skeleton extraction process on the optical image data in step S12 to extract the skeleton of the subject M.

[0123] On the other hand, if the optical image data is not subject to the decision to continue shooting (step S11: No), the process returns to step S11, and the process in step S11 is repeated until optical image data subject to the decision to continue shooting is acquired.

[0124] In step S13, the image analysis unit 214 of the control unit 21 sets checkpoints on the optical image data based on the extracted skeleton. The image analysis unit 214 then associates the optical image data with the checkpoints set on the optical image data and registers this information in the database 221 of the storage unit 22.

[0125] Next, in step S14, the comparison and determination unit 215 compares the value of the checkpoint in the optical image data at a predetermined timing with the value of the reference checkpoint information.

[0126] If the comparison results show that the checkpoint value falls within the checkpoint range of the reference checkpoint information (step S14: Yes), the comparison determination unit 215 determines that the subject M's physical movements are accurate. Subsequently, in step S15, the radiodynamic imaging continues.

[0127] In step S16, the control unit 21 determines whether the above-described process was performed at all timings included in the reference checkpoint information. If the process was performed at all timings (step S16: Yes), the series of processes ends. If the process was not performed at all timings (step S16: No), the process returns to step S11.

[0128] On the other hand, in step S14, if the checkpoint value is not within the checkpoint range of the reference checkpoint information (step S14: No), the comparison and determination unit 215 determines that the subject M's physical movements are inaccurate. Subsequently, in step S17, the radiodynamic imaging is interrupted, and the series of processes ends.

[0129] As described above, in the imaging continuation determination process according to this embodiment, the correctness of body movements is determined at predetermined intervals based on optical image data obtained by optical dynamic imaging. When the body movements of the subject M are not performed accurately, the radiodynamic imaging is interrupted, thereby suppressing the amount of radiation exposure to the subject M during times of image loss caused by the subject M's inability to perform body movements accurately.

[0130] [Differentiation] A modified version of this embodiment will now be described. In the embodiment described above, optical dynamic imaging of the subject M was described when radiographic dynamic imaging was performed, but similarly, optical dynamic imaging of the subject M is also performed when radiographic imaging of still images is performed.

[0131] For example, when taking still images using radiography, it may be necessary for the subject M to perform the actions leading up to the radiography image in the correct position. This is because, in taking still images using radiography, the series of actions taken by the subject M leading up to the radiography image affects the position at the time of the image.

[0132] For example, consider the case where the area to be photographed is the knee of subject M, and the knee is photographed from the side. When photographing the knee, subject M generally flexes the knee joint and then bends the inside of the knee downwards so that it is aligned with the panel which is the radiation detection unit 14.

[0133] At this time, the technician checks the condition of the area being scanned, such as whether the knee is separated from the radiation detection unit 14, whether the distal thigh is elevated, and whether the ankle is lowered. Specifically, for example, if the distal thigh is elevated, the knee will rise along with the elevation of the distal thigh and move away from the radiation detection unit 14. Similarly, if the ankle is lowered, the knee will rise in conjunction and move away from the radiation detection unit 14.

[0134] Thus, even when performing still image radiography on the target area of ​​subject M, the actions leading up to the image affect the radiography. Therefore, in a modified version of this embodiment, even when performing still image radiography, subject M is instructed to perform actions leading up to the radiography position based on the body movements shown in the motion model video. Then, the body movements of subject M are optically captured using dynamic imaging, and it is determined whether or not the body movements are accurate based on checkpoints set in the optical image data.

[0135] Thus, even when performing still image radiography, by using optical dynamic imaging to capture the movements leading up to the image, it is possible to ensure that the subject performs accurate body movements during still image radiography. Furthermore, because the subject M performs the movements leading up to the image according to the body movements shown in the motion model video, it is possible to effectively assist technicians who have relatively little experience with radiography and are unfamiliar with the procedure.

[0136] Although embodiments and modifications have been described above, this disclosure is not limited to the embodiments and modifications described above, and various modifications and applications are possible without departing from the spirit of this disclosure. For example, the database 221 in which various videos such as motion model videos and optical motion images, as well as checkpoints associated with these videos, are registered, is not limited to the console device 20, but may be provided in other devices. Specifically, for example, a dedicated database device equipped with the database 221 may be placed in the radiation image processing system 1.

[0137] Furthermore, although this embodiment describes the shooting continuation determination process as being performed by the console device 20, it is not limited to this, and the shooting continuation determination process may be performed by a device other than the console device 20.

[0138] Furthermore, when optical dynamic images are captured within the same imaging range as radiodynamic images, the optical imaging unit 18 is positioned near the radiation irradiation unit 12. However, the position of the optical imaging unit 18 is not limited to this example. For example, the optical imaging unit 18 may be positioned differently from the radiation irradiation unit 12 so that images can be taken from an angle that allows for easy determination of the state of checkpoints or the state of the target area when the subject M performs physical movements. [Explanation of symbols]

[0139] 1. Radiation Image Processing System 10. Radiation imaging device 11. Radiography Control Unit 12 Radiation irradiation area 13 Shooting platform 14. Radiation detection unit 15 Display 16 Audio output section 17 Optical imaging control unit 18 Optical Imaging Section 20 Console device 21 Control Unit 22 Memory section 23 Control section 24 Display 25 Communications Department 26 bus 30. Radiation Image Analysis Device 40 Image management device 50 client terminals 111 Configuration Information Acquisition Unit 112 Shooting Condition Determination Unit 113 Image generation unit 114 Storage section 171 Configuration Information Acquisition Unit 172 Shooting Condition Determination Unit 173 Image generation unit 174 Memory section 211 Configuration Information Generation Unit 212 Configuration Information Output Section 213 Image acquisition unit 214 Image Analysis Department 215 Comparison / judgment section 221 Databases

Claims

1. An image acquisition unit that acquires image data including the body movements of the subject during the acquisition of a radiation image obtained by irradiating the subject with radiation, A determination unit that determines whether or not it is necessary to stop taking the radiographic image based on information regarding the subject's physical movements in the image data, An information processing device having

2. The determination unit, If the subject's physical movements are not performed correctly, it is determined that the acquisition of the radiographic image needs to be stopped. The information processing apparatus according to claim 1.

3. The system further includes an image analysis unit that analyzes the image data and sets checkpoints for the image data. The determination unit, Based on the checkpoints set in the image data, it is determined whether or not it is necessary to stop the shooting. The information processing apparatus according to claim 1.

4. The image acquisition unit, An optical image including the body movements of the subject during the acquisition of the aforementioned radiographic image is obtained. The determination unit, Based on the optical image data constituting the aforementioned optical image, it is determined whether or not it is necessary to stop the shooting. The information processing apparatus according to claim 1.

5. The image acquisition unit, An optical image including the body movements of the subject during the acquisition of the aforementioned radiographic image is obtained. The optical imaging region of the aforementioned optical image is a region that includes the radiographic imaging region of the aforementioned radiographic image. The aforementioned image analysis unit, The checkpoints are set for the parts included in the radiographic imaging area and the parts not included in the radiographic imaging area but included in the optical imaging area. The information processing apparatus according to claim 3.

6. The aforementioned image analysis unit, The skeleton of the subject is extracted from the aforementioned image data. Based on the extracted skeleton, the checkpoints are set. The information processing apparatus according to claim 3.

7. The system further includes a database for registering the set checkpoints and the image data in association. The information processing apparatus according to claim 3.

8. The aforementioned database has pre-registered motion model videos associated with reference checkpoint information corresponding to the aforementioned checkpoints. The determination unit, The system compares the reference checkpoint information associated with the motion model video with the checkpoint associated with the image data to determine whether or not it is necessary to stop the shooting. The information processing apparatus according to claim 7.

9. The aforementioned image analysis unit, Set the checkpoints for the body included in the motion model video, Based on the set checkpoints, the standard checkpoint information is generated. The motion model video and the generated reference checkpoint information are associated and registered in the database. The information processing apparatus according to claim 8.

10. The information regarding the physical movements of the subject is as follows: Including at least one of the angles or coordinates of the joints of the subject, The information processing apparatus according to claim 1.

11. The system further includes a radiography unit that performs motion imaging to capture motion images as radiographic images. The information processing apparatus according to claim 1.

12. Image data including the body movements of the subject during the acquisition of a radiation image obtained by irradiating the subject with radiation, Based on the information regarding the subject's physical movements in the image data, it is determined whether or not it is necessary to stop the acquisition of the radiographic image. Method for determining whether to continue filming.

13. A program that causes a computer to execute the method for determining whether to continue shooting as described in claim 12.

Images