Practice device, radiation imaging apparatus, practice motion determination method, and program

Abstract

To provide a practice device, a radiation imaging apparatus, a practice motion determination method, and a program that enable a subject to perform accurate body motions when capturing radiation dynamic images.SOLUTION: A practice device that enables a subject to practice body motions of the subject during capturing of a radiation image, before capturing of the radiation image, includes: an image acquisition unit that acquires a practice video obtained by capturing, without radiation irradiation, body motions executed by the subject as practice; and a determination unit that determines correctness of the practice on the basis of the practice video.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a practice device, a radiographic device, a practice motion determination method, and a program. [Background technology]

[0002] Radiography devices are known that irradiate a subject with radiation to capture a radiographic image. Some modern radiation imaging devices are capable of capturing not only still images but also dynamic images (moving images) by continuously irradiating the subject with radiation. Dynamic imaging is generally applied to imaging the chest and other areas in the respiratory field, but in recent years, application of this dynamic imaging to the orthopedic field has been considered.

[0003] In the field of orthopedics, when capturing radiological dynamic images of a subject, the subject must perform accurate body movements in order to accurately capture the target area. Therefore, various proposals have been made to accurately capture radiological dynamic images.

[0004] For example, Patent Document 1 describes an imaging device that generates a guide image so that the subject can be imaged in the same position when taking radiographic images periodically, and uses an optical camera to make the subject move so that the subject's physical movements match the guide image. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-117368 Summary of the Invention [Problem to be solved by the invention]

[0006] When capturing a radiological image, the subject usually performs physical movements in accordance with the explanation given by a technician or the like, or when the subject is shown actual physical movements.

[0007] However, even if a subject is instructed to move his / her body verbally, it is difficult for the subject to accurately reproduce detailed conditions such as bending a joint to a predetermined angle and perform the body movement. Furthermore, as described in Patent Document 1, even if the subject is made to move his / her body in accordance with a guide image, the subject's body movement is not necessarily performed accurately.

[0008] An object of the present disclosure is to provide a training device, a radiographic device, a training movement determination method, and a program that enable a subject to perform accurate body movements when capturing a radiological dynamic image. [Means for solving the problem]

[0009] The practice device according to the present disclosure comprises: 1. A training device for allowing a subject to practice body movements of the subject during radiographic imaging before the radiographic imaging, comprising: an image acquisition unit that acquires a practice video that captures the body movements performed by the subject as the practice without irradiation with radiation; a determination unit that determines whether the practice is successful or not based on the practice video; Equipped with.

[0010] The radiation imaging apparatus according to the present disclosure comprises: A radiographic imaging device that irradiates a subject with radiation from a tube to capture a radiographic image, The training device is provided as described above.

[0011] The practice motion determination method according to the present disclosure includes: A practice movement determination method using a practice device for allowing a subject to practice a body movement of the subject during radiographic image capture before the radiographic image capture, comprising: acquiring a practice video in which the subject's physical movements performed as the practice are filmed without irradiation with radiation; Based on the practice video, the success or failure of the practice is determined.

[0012] The program according to the present disclosure is The above practice movement determination method is executed by a computer. [Effects of the Invention]

[0013] According to the present disclosure, it is possible to have the subject perform accurate body movements when capturing a radiological dynamic image. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a radiation image processing system according to the present embodiment. [Figure 2] FIG. 2 is a functional block diagram showing an example of the configuration of the radiation imaging control unit in FIG. [Figure 3] FIG. 3 is a functional block diagram showing an example of the configuration of the optical photography control unit in FIG. [Figure 4] FIG. 4 is a functional block diagram showing an example of the configuration of the console device of FIG. [Figure 5] FIG. 5 is a schematic diagram for explaining the checkpoint. [Figure 6] FIG. 6 is a schematic diagram showing an example of the reference checkpoint information. [Figure 7] FIG. 7 is a sequence diagram showing an example of the processing flow when a practice movement is photographed in the image processing system according to the present embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of the flow of the practice movement determination process of FIG. [Figure 9] FIG. 9 is a flowchart showing an example of the flow of the practice movement determination process in the first modification. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the following embodiments, and various modifications are possible without departing from the spirit of the present disclosure. In addition, in each drawing, the same reference numerals are used to denote the same or equivalent parts, and this is common throughout the entire specification.

[0016] The radiation image processing system according to this embodiment performs radiographic dynamic imaging to generate a radiographic dynamic image, and performs various analytical processes on the generated radiographic dynamic image. The radiation image processing system also performs optical dynamic imaging to generate an optical dynamic image prior to the radiographic dynamic imaging, and allows the subject to practice in advance the body movements that will be made when the subject is irradiated with radiation based on the generated optical dynamic image.

[0017] In this specification, a "radiation dynamic image" refers to a moving image generated based on multiple frame images obtained by radiographic dynamic imaging, in which a subject is repeatedly irradiated with pulsed radiation such as X-rays at predetermined intervals or continuously irradiated with low dose rates. An "optical dynamic image" refers to a moving image generated based on multiple frame images obtained by optical dynamic imaging of a subject. In the following description, radiographic dynamic imaging and optical dynamic imaging may be collectively referred to as "dynamic imaging."

[0018] <Configuration of Radiation Image Processing System> 1 is a schematic diagram showing an example of the configuration of a radiological image processing system 1 according to the present embodiment. The radiological image processing system 1 includes a radiological image capturing device 10, a console device 20, a radiological image analyzing device 30, an image management device 40, and a client terminal 50.

[0019] In the example shown in Fig. 1, the radiographic imaging device 10 is placed in an imaging room. The console device 20 is placed in an operation room. The radiographic imaging device 10, the console device 20, the radiographic image analysis device 30, the image management device 40, and the client terminal 50 are connected to each other via a communication network. As the communication network, for example, a communication network conforming to the DICOM (Digital Image and Communications in Medicine) standard or the like is used.

[0020] The radiographic imaging device 10 captures a radiological dynamic image, which is a radiological image, under the control of the console device 20. The radiological dynamic image generated by the radiographic imaging device 10 is transmitted to the radiological image analysis device 30 via the console device 20.

[0021] In the present embodiment, the radiographic imaging device 10 captures an optical dynamic image, which is an optical image, under the control of the console device 20. The optical dynamic image generated by the radiographic imaging device 10 is transmitted to the console device 20.

[0022] The radiological image analysis device 30 performs dynamic analysis on the radiological dynamic image. The radiological dynamic image and the results of the dynamic analysis are transmitted to and managed by an image management device 40 (e.g., a PACS (Picture Archiving and Communication System)) serving as a medical image management system. The radiological dynamic image and the results of the dynamic analysis are transmitted to a client terminal 50 and viewed by medical personnel such as doctors.

[0023] The radiographic imaging device 10, the console device 20, and the radiographic image analysis device 30 each have a processor and memory (not shown). The radiographic imaging device 10, the console device 20, and the radiographic image analysis device 30 are each a type of computer that implements predetermined functions by reading, expanding, and executing programs stored in the memory.

[0024] (Radiation imaging device 10) As shown in FIG. 1, the radiographic imaging device 10 includes a radiographic imaging control unit 11, a radiation irradiation unit 12, an imaging table 13, a radiation detection unit 14, a display unit 15, an audio output unit 16, an optical imaging control unit 17, and an optical imaging unit 18.

[0025] The radiography control unit 11 acquires radiation setting information relating to the settings of dynamic radiography from the console device 20. Based on the radiation setting information, the radiography control unit 11 sets radiography conditions for performing dynamic radiography, and controls the radiation irradiator 12 based on the radiography conditions to irradiate radiation to the subject M (e.g., a patient) and perform radiography. The radiography control unit 11 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc.

[0026] The radiation setting information is information relating to settings for performing radiographic dynamic imaging on the subject M. The radiation setting information includes, for example, at least one of multiple types of dynamic analysis that the radiographic image analysis device 30 can perform on a radiographic dynamic image. When multiple types of dynamic analysis are combined, the radiation setting information may include information relating to the combination. The radiation setting information is set by an operator of the radiation image processing system 1, for example, a radiographer, in the console device 20 described below.

[0027] The radiation imaging conditions include various conditions such as the pulse rate, pulse width, pulse interval, number of frames captured per imaging, radiation dose per unit time, and the physical condition of the subject M (such as respiratory state). The pulse rate is the number of radiation exposures per second and corresponds to the frame rate of the image data. The pulse width is the radiation exposure time per radiation exposure. The pulse interval is the time from the start of one radiation exposure to the start of the next radiation exposure and corresponds to the time interval (frame interval) between multiple image data. The radiation imaging conditions may be automatically determined by the radiation imaging control unit 11 of the radiation imaging device 10 based on the radiation setting information.

[0028] The radiation emitting unit 12 is disposed at a position facing the radiation detecting unit 14 fixed to the imaging table 13. The radiation emitting unit 12 irradiates radiation (X-rays) under the control of the radiation imaging control unit 11.

[0029] The radiation detection unit 14 is composed of a semiconductor image sensor such as an FPD (Flat Panel Detector). The radiation detection unit 14 has a substrate on which a plurality of detection elements (pixels) are arranged in a matrix, which detect radiation irradiated from the radiation irradiation unit 12 according to its intensity, convert the detected radiation into an electrical signal, and store the electrical signal. Each pixel on the substrate is configured to include a switching unit such as a TFT (Thin Film Transistor).

[0030] The radiation detection unit 14 controls the switching unit of each pixel based on the image reading conditions input from the console device 20 to read the electrical signals accumulated in each pixel and output intensity information for each pixel to the image generation unit 113. The image reading conditions include, for example, the frame rate, frame interval, pixel size, and image size (matrix size). The frame rate is the number of frame images acquired per second and coincides with the pulse rate. The frame interval is the time from the start of one image data acquisition operation to the start of the next frame image acquisition operation and coincides with the pulse interval.

[0031] The radiation imaging control unit 11 and the radiation detection unit 14 are connected to each other and exchange synchronization signals with each other to synchronize the radiation irradiation operation and the image reading operation.

[0032] In this way, in the radiographic imaging device 10, the radiation irradiation unit 12 irradiates radiation under the control of the radiographic imaging control unit 11. Then, the radiographic imaging device 10 performs dynamic radiographic imaging by generating image data based on the intensity of the irradiated radiation using the radiation detection unit 14.

[0033] The display unit 15 and the audio output unit 16 give instructions to the subject M regarding the posture and physical condition (such as respiratory state) that the subject M should assume when performing dynamic imaging of the subject M. The display unit 15 is, for example, a display device such as a CRT (Cathode Ray Tube), a liquid crystal display (Liquid Crystal Display), or an organic EL (Electro Luminescence) display arranged in an imaging room. The display unit 15 may also be, for example, a portable terminal such as a tablet.

[0034] The audio output unit 16 is, for example, an audio output device such as a speaker. The display unit 15 and the audio output unit 16 may each give the same instructions to the subject M, or only one of them may give an instruction.

[0035] The optical imaging control unit 17 acquires optical setting information relating to settings for performing optical dynamic imaging of the subject M from the console device 20. Based on the optical setting information, the optical imaging control unit 17 sets optical imaging conditions for performing optical dynamic imaging, and controls the optical imaging unit 18 based on the optical imaging conditions to perform optical imaging of the subject M. The optical imaging control unit 17 is composed of a CPU, RAM, ROM, etc.

[0036] The optical imaging conditions include various conditions such as the frame rate during imaging, the number of imaging frames per imaging, and the state of the subject M. The frame rate is the number of frame images acquired per second. The optical imaging conditions may be automatically determined by the optical imaging control unit 17 of the radiographic imaging device 10 based on the optical setting information.

[0037] The optical imaging unit 18 is, for example, an optical camera having an optical system including a lens and a focus mechanism (not shown), an aperture mechanism, an image sensor, a lens drive unit, an aperture drive unit, etc., and images the subject M. For example, in this embodiment, the optical imaging unit 18 captures, as optical images, body movements performed by the subject M as practice before dynamic radiography.

[0038] The optical photographing unit 18 forms an image of the incident light on the image sensor and generates optical image data for each frame. The optical photographing unit 18 sequentially outputs the generated optical image data for multiple frames to the optical photographing control unit 17.

[0039] The optical imaging unit 18 is disposed, for example, near the radiation irradiation unit 12 so that the imaging range by optical imaging includes the imaging range by radiography. However, the optical imaging unit 18 is not limited to this, and may be disposed in a position where it can image the entire imaging room.

[0040] (Radiography control unit 11) Fig. 2 is a functional block diagram showing an example of the configuration of the radiation imaging control unit 11 in Fig. 1. As shown in Fig. 2, the radiation imaging control unit 11 has a setting information acquisition unit 111, an imaging condition determination unit 112, an image generation unit 113, and a storage unit 114.

[0041] The setting information acquisition unit 111 acquires radiation setting information from the console device 20 .

[0042] The imaging condition determination unit 112 determines the radiation imaging conditions when performing dynamic radiation imaging of the subject M based on the radiation setting information acquired from the console device 20.

[0043] The image generation unit 113 performs dynamic radiography of the subject M based on the determined radiography conditions and generates multiple frames of radiographic images. Specifically, the image generation unit 113 controls the operations of the radiation irradiator 12 and the radiation detector 14 based on the radiography conditions, and generates image data by acquiring intensity information on the intensity of radiation that has passed through the subject from the radiation detector 14 for each pixel.

[0044] The storage unit 114 stores in advance information indicating the correspondence between a plurality of types of dynamic analysis and radiation imaging conditions suitable for each dynamic analysis.

[0045] (Optical photography control unit 17) Fig. 3 is a functional block diagram showing an example of the configuration of the optical photography control unit 17 in Fig. 1. As shown in Fig. 3, the optical photography control unit 17 has a setting information acquisition unit 171, a photography condition determination unit 172, an image generation unit 173, and a storage unit 174.

[0046] The setting information acquisition unit 171 acquires optical setting information from the console device 20 .

[0047] The imaging condition determination unit 172 sets optical imaging conditions for performing optical dynamic imaging of the subject M based on the optical setting information acquired by the setting information acquisition unit 171.

[0048] The image generation unit 173 performs optical dynamic imaging of the subject M based on the determined optical imaging conditions. Specifically, the image generation unit 173 controls the operation of the optical imaging unit 18 based on the optical imaging conditions, and generates an optical dynamic image of the subject M based on multiple optical image data for each frame received from the optical imaging unit 18.

[0049] The storage unit 174 stores the optical setting information acquired from the console device 20, and the optical imaging conditions set based on the optical setting information. The storage unit 174 also stores the optical image data received from the optical imaging unit 18, and the optical dynamic image generated based on the optical image data.

[0050] (Console device 20) The console device 20 in Fig. 1 is, for example, a computer such as a PC (Personal Computer) or a workstation. The console device 20 may be a desktop computer as in the example shown in Fig. 1, or may be a portable computer such as a notebook computer or a tablet computer.

[0051] The console device 20 receives examination order information from a RIS (Radiology Information System; not shown) or the like, and transmits it to the radiographic imaging device 10, thereby controlling the radiographic dynamic imaging and optical dynamic imaging of the radiographic imaging device 10. The examination order information includes various information related to the next dynamic imaging to be performed, such as patient information, examination information, and data attributes. The examination information includes information such as the examination ID, the area to be examined, and the type of analysis. The examination order information is generated, for example, when a doctor or the like requests the radiographic image processing system 1 to perform radiographic dynamic imaging or optical dynamic imaging of a subject M.

[0052] Furthermore, the console device 20 generates radiation setting information indicating at least one of the multiple types of dynamic analyses that can be performed by the radiation image analyzer 30, based on input from the operator. When multiple types of dynamic analyses are to be combined, the console device 20 generates radiation setting information indicating a combination of the multiple types of dynamic analyses. The operator, for example, refers to the contents of the examination order information to determine which of the multiple types of dynamic analyses to combine, and performs input operations to generate radiation setting information based on this. Alternatively, the operator may determine which dynamic analyses to combine based on information provided by a doctor or the like in another manner.

[0053] Furthermore, the console device 20 generates optical setting information based on input from the operator. The operator recognizes the condition of the subject M, for example, by referring to the contents of the examination order information, and performs an input operation to generate optical setting information based on this.

[0054] Fig. 4 is a functional block diagram showing an example of the configuration of the console device 20 of Fig. 1. As shown in Fig. 4, the console device 20 has a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, and a communication unit 25. The components of the console device 20 are connected to one another via a bus 26. Note that Fig. 4 shows only the processing units related to the processing of optical dynamic images among the processing units of the control unit 21.

[0055] The console device 20 outputs radiation setting information and optical setting information generated based on input from an operator or the like, as well as examination order information previously acquired from a RIS or the like, to the radiographic imaging device 10, and controls the imaging process by the radiographic imaging device 10. The console device 20 may, for example, display the radiographic dynamic images and optical dynamic images generated by the radiographic imaging device 10 so that the operator can check them.

[0056] The control unit 21 is configured with a CPU, RAM, etc. In the control unit 21, the CPU reads out the system program and various processing programs stored in the storage unit 22 in response to an operation of the operation unit 23, expands them in the RAM, and performs operation control of each unit of the console device 20, image analysis, etc. based on the expanded programs.

[0057] The control unit 21 includes a setting information generation unit 211 , a setting information output unit 212 , an image acquisition unit 213 , an image analysis unit 214 , a comparison and determination unit 215 , and a presentation unit 216 .

[0058] The setting information generating unit 211 generates optical setting information based on input from an operator, etc. For example, the operator refers to the contents of the examination order information to recognize the condition of the subject M, and performs an input operation based on this, whereby the setting information generating unit 211 generates optical setting information.

[0059] The setting information output unit 212 outputs the optical setting information generated by the setting information generation unit 211. The output optical setting information is transmitted to the radiographic image capturing apparatus 10 via the communication unit 25.

[0060] The image acquisition unit 213 acquires the optical dynamic image transmitted from the radiation image capturing apparatus 10. The acquired optical dynamic image is supplied to the image analysis unit 214.

[0061] The image analysis unit 214 performs a predetermined analysis process on the acquired optical dynamic image. In this embodiment, the image analysis unit 214 performs a skeleton extraction process to extract the skeleton of the subject M included in the image as the analysis process. Well-known techniques can be applied to the skeleton extraction process.

[0062] Furthermore, the image analysis unit 214 sets checkpoints in the optical dynamic image. The checkpoints are used to determine whether the body movements of the subject M are being performed correctly during practice. Details of the checkpoints will be described later.

[0063] The comparison / determination unit 215 compares the checkpoints set in the optical dynamic image with the reference checkpoint information associated with the model video, and determines whether the checkpoints in the optical dynamic image are included in the reference checkpoint information. The model video is a dynamic image that is referenced when practicing a physical movement performed by the subject M. The reference checkpoint information is information that serves as a reference for determining whether the physical movement performed by the subject M during practice is performed accurately. Details of the model video and the reference checkpoint information will be described later.

[0064] Furthermore, the comparison and determination unit 215 determines whether the practice by the subject M is correct or not based on the determination result of the checkpoint. Then, the comparison and determination unit 215 determines whether to proceed to dynamic radiography or not based on the determination result of correct or not. The comparison and determination unit 215 corresponds to the "determination unit" in the present disclosure.

[0065] The presentation unit 216 causes the display unit 24 to display the judgment result based on the judgment result of the comparison / judgment unit 215 as to whether the practice is successful or not.

[0066] Furthermore, the presentation unit 216 may display the result of the judgment as to whether the practice is successful on the display unit 15 of the radiographic imaging device 10 instead of the display unit 24, or may display the result on both the display unit 24 and the display unit 15. In this case, the presentation unit 216 generates a signal indicating the result of the judgment as to whether the practice is successful and transmits the generated signal to the radiographic imaging device 10. Then, the display unit 15 of the radiographic imaging device 10 displays the result of the judgment as to whether the practice is successful based on the received signal.

[0067] The storage unit 22 is configured with a non-volatile semiconductor memory, a hard disk, etc. The storage unit 22 stores various programs executed by the control unit 21, as well as parameters required for executing processing by the programs, data such as processing results, etc. The various programs are stored in the form of readable program code, and the control unit 21 sequentially executes operations in accordance with the program code.

[0068] The memory unit 22 also stores image reading conditions for performing dynamic radiography. Furthermore, the memory unit 22 stores examination order information transmitted from the RIS, etc. When the console device 20 controls dynamic radiography of the radiographic imaging device 10, the image reading conditions and examination order information corresponding to the subject M are read from the memory unit 22 and transmitted to the radiographic imaging device 10 via the communication unit 25.

[0069] The storage unit 22 is provided with a database 221. The database 221 stores a model video used when performing optical dynamic imaging, optical setting information, and reference checkpoint information obtained from checkpoints set based on a skeleton extracted from the model video, in association with one another. The database 221 also stores optical dynamic images obtained by optical dynamic imaging and checkpoints set in the optical dynamic images, in association with one another.

[0070] The operation unit 23 is an operation device such as a keyboard equipped with cursor keys, numeric input keys, and various function keys, a pointing device such as a mouse or a trackball, and a touch panel. The operation unit 23 generates an instruction signal based on an input from the operator and outputs it to the control unit 21. The operation unit 23 may also be equipped with a touch panel on the display screen of the display unit 24, in which case the operation unit 23 outputs an instruction signal input via the touch panel to the control unit 21.

[0071] The display unit 24 is configured with a display device such as a CRT, a liquid crystal display, an organic EL display, etc. The display unit 24 displays input instructions from the operation unit 23 and image data generated by the radiographic imaging device 10, etc., in accordance with instructions of a display signal input from the control unit 21.

[0072] The communication unit 25 transmits and receives data to and from the radiation image capturing device 10, the radiation image analyzing device 30, the RIS, and the like.

[0073] In this embodiment, the display unit 15, audio output unit 16, optical imaging control unit 17, and optical imaging unit 18 of the radiographic imaging device 10, together with the console device 20, constitute the "practice device" of the present disclosure.

[0074] (Radiation image analyzer 30) The radiation image analysis device 30 is, for example, a computer such as a PC or a workstation. The radiation image analysis device 30 may be a desktop computer or a portable computer such as a notebook computer or a tablet computer.

[0075] The radiation image analyzer 30 performs various dynamic analyses on the dynamic images captured by the radiation image capturing device 10 based on the radiation setting information set in the console device 20 .

[0076] [Operation of Radiation Image Processing System 1] The operation of the radiation image processing system 1 according to this embodiment having the above configuration will be described. Here, an example of the flow when capturing a dynamic radiation image of the subject M will be described.

[0077] First, when capturing a radiological dynamic image of the subject M, the console device 20 reads out previously acquired examination order information from the storage unit 22. Furthermore, the setting information generation unit 211 of the console device 20 generates radiation setting information based on input from the operator, etc. The console device 20 transmits the examination order information and the radiation setting information to the radiological image capturing device 10 via the communication unit 25.

[0078] The setting information acquisition unit 111 of the radiographic imaging device 10 receives the examination order information and radiation setting information transmitted from the console device 20. Then, the imaging condition determination unit 112 of the radiographic imaging device 10 determines the radiation imaging conditions based on the received examination order information and radiation setting information.

[0079] The image generating unit 113 of the radiographic imaging device 10 performs radiographic dynamic imaging using the determined radiographic imaging conditions and generates a radiographic dynamic image from the multiple frames of radiographic images. The radiographic imaging device 10 transmits the generated radiographic dynamic image to the radiographic image analyzing device 30 via the console device 20.

[0080] The radiation image analysis device 30 receives the radiation dynamic image from the console device 20 and performs various dynamic analyses on the received radiation dynamic image.

[0081] (Physical movements during dynamic radiography) When performing dynamic radiography in the field of orthopedics, the subject M is required to perform physical movements in order to observe the state of the affected area, which is the imaging target site, when the subject M moves his or her body. If the subject M cannot move his or her body accurately, the state of the affected area cannot be properly observed. Therefore, the subject M practices physical movements before the dynamic radiography so that he or she can perform accurate physical movements during the dynamic radiography.

[0082] In physical movement practice, the subject M generally performs the physical movement according to the explanation given by a technician or the like when the technician or the like verbally explains the specific physical movement or when the subject M is shown the actual physical movement. However, even if the physical movement is instructed verbally, it is difficult to reproduce the detailed conditions, such as bending the joints to a predetermined angle, and it is difficult to make the subject M perform the physical movement accurately.

[0083] Therefore, in this embodiment, a practice movement determination process is performed in which the subject M's practice of body movements is imaged before dynamic radiation imaging, and it is determined whether the body movements are being performed correctly.

[0084] (Filming of physical movements during practice) When the subject M practices a body movement, for example, optical dynamic imaging is performed using the optical imaging unit 18. In the following description, the body movement of the subject M during practice will be referred to as a "practice movement," and the optical dynamic image obtained by capturing the practice movement will be referred to as a "practice video."

[0085] When imaging the practice movements of the subject M, the subject M first performs the practice movements according to the instructions of the technician, etc. At this time, the radiation image processing system 1 displays a model video on the display unit 15. Then, the subject M practices the body movements to be performed during dynamic radiation imaging, referring to the displayed model video.

[0086] The model video is a dynamic image that is referred to when the subject M practices a physical movement, and includes a predetermined image of the body performing a movement that serves as a reference for the physical movement that the subject M should perform. The model video is prepared in advance by a doctor, technician, or the like based on the optical setting information.

[0087] Here, checkpoints are set in the model video to be used in the practice movement judgment process to determine whether or not the practice movement of the subject M is being performed accurately. The checkpoints are determined according to optical setting information indicating the conditions under which the subject M performs the body movement. Such checkpoints are set, for example, based on the body skeleton that is included in the model video and performs the movement for practice. Specifically, the checkpoints are, for example, angles and coordinates of various joints formed based on the body skeleton.

[0088] The body skeleton included in the model video is extracted from the image showing the body by performing a skeleton extraction process on the video. The skeleton extraction process can be performed using, for example, a well-known technique. Specifically, in the skeleton extraction process, feature points such as joints in the body are detected, and the body skeleton is extracted based on the detected feature points.

[0089] For example, consider bending an elbow as an example of a physical movement. Figure 5 is a schematic diagram for explaining checkpoints.

[0090] Generally, when bending an elbow, not only the elbow but also the wrist and shoulder joint move simultaneously, and it is thought that the angles of each part change. Therefore, in this case, as shown in Figure 5, wrist angle α, elbow angle β, and shoulder joint angle γ are set as checkpoints.

[0091] The wrist angle α is the internal angle formed by the skeleton that forms the wrist when the wrist is bent inward. The elbow angle β is the internal angle formed by the skeleton that forms the elbow when the elbow is bent inward. The shoulder joint angle γ is the internal angle formed by the skeleton that forms the shoulder joint.

[0092] Furthermore, since the position of the elbow is considered to change depending on the body movement, the coordinates (X, Y) of the elbow may also be set as a checkpoint.

[0093] Such checkpoints are set at a plurality of predetermined timings between the start and end of the body movement in the model video, because the angles of each part, which are the checkpoints, vary depending on the time elapsed from the start of the body movement.

[0094] Checkpoints are set at predetermined times while the recorded model video is being played back, such as when a practice movement starts, when a predetermined time has elapsed since the start of the practice movement, and when the practice movement ends.

[0095] When checkpoints are set for the model video in this way, reference checkpoint information is generated based on the set checkpoints. The reference checkpoint information is information for determining whether the subject M is performing the practice movement correctly, and serves as a reference for the practice movement determination process.

[0096] 6 is a schematic diagram showing an example of reference checkpoint information. In this example, the reference checkpoint information includes wrist angle α, elbow angle β, shoulder joint angle γ, and elbow coordinates (X, Y) set as checkpoints.

[0097] As shown in Fig. 6, the checkpoints included in the reference checkpoint information are set at a plurality of predetermined timings between the start and end of the physical movement in the model video. In this example, checkpoints are set at the start of the physical movement, midpoints #1 and #2 that are a predetermined time after the start, and the end. These checkpoints are set within a predetermined range of values, including the values ​​of the checkpoints in the model video, taking into account allowable errors, etc.

[0098] When the reference checkpoint information is generated, the model video is associated with the optical setting information and the reference checkpoint information shown in FIG. 6, and is registered in the database 221 of the storage unit 22 in the console device 20.

[0099] Although the example video is described as being prepared in advance based on the optical setting information, this is not limited to this example. When radiographic dynamic imaging is performed periodically on the subject M, it is easier to observe the progress of the affected area if the body movements of the subject M are always the same. Therefore, in this case, a past optical dynamic image or radiographic dynamic image may be used as the example video.

[0100] Furthermore, model videos are prepared according to the body part to be observed, but in order to compare with the practice movements of the subject M, it is preferable to prepare multiple model videos that differ according to the body type, age, etc. of the subject M, even if the body part to be observed is the same. This is because, when comparing the optical dynamic image of the subject M with the model video, errors during comparison can be reduced by using a model video that is close to the state of the subject M.

[0101] (Practice motion judgment processing) Next, when the subject M practices the body movements during practice with reference to the model video, the state of the subject M practicing is photographed by the optical photographing unit 18. At this time, the model video may be displayed on the display unit 15 in accordance with the body movements of the subject M.

[0102] When an optical dynamic image is generated by optical dynamic photography, a skeleton extraction process is performed on the generated optical dynamic image in the same manner as the model video, and the skeleton of the subject M is extracted. Then, when the skeleton is extracted, checkpoints are set based on the extracted skeleton in the same manner as the model video. The optical dynamic image with the set checkpoints is associated with the optical setting information and the checkpoints, and is registered in the database 221 of the storage unit 22 in the console device 20.

[0103] Next, the values ​​of the reference checkpoint information associated with the model video are compared with the values ​​of the checkpoints set in the optical dynamic image. Specifically, first, based on the optical setting information when the optical dynamic image was captured, reference checkpoint information corresponding to the model video associated with the optical setting information is read from database 221. Furthermore, based on this optical setting information, the checkpoints of the optical dynamic image associated with the optical setting information are read from database 221. Then, the values ​​of both the reference checkpoint information of the model video read from database 221 and the checkpoints of the optical dynamic image are compared.

[0104] In the practice movement determination process, the corresponding values ​​at the two checkpoints are compared at the same timing (elapsed time), and based on the comparison result, it is determined whether the subject M is performing the practice movement correctly.

[0105] Specifically, it is determined for each elapsed time and for each corresponding checkpoint whether the values ​​of the checkpoints in the practice movement of the subject M are within the checkpoint range of the model video. If the comparison result shows that the values ​​of all the checkpoints are within the checkpoint range, it is determined that the practice movement of the subject M is being performed correctly. However, without being limited to this, it may also be determined that the practice movement of the subject M is being performed correctly if, for example, the values ​​of a preset proportion of the checkpoints, such as 80%, of all the checkpoints are within the checkpoint range.

[0106] When it is determined whether the subject M's body movements during practice are performed accurately, the determination result is displayed. The determination result may be displayed on the display unit 24 of the console device 20, or on the display unit 15 of the radiographic image capturing device 10. The determination result may also be displayed on both the display unit 24 and the display unit 15.

[0107] If it is determined that the subject M's practice movement is being performed correctly, the process proceeds to capturing a radiological dynamic image. On the other hand, if it is determined that the subject M's practice movement is not being performed correctly, the practice movement is re-captured.

[0108] (Processing flow) 7 is a sequence diagram showing an example of the processing flow when capturing a practice movement in the image processing system 1 according to the present embodiment. Here, the processing flow in the radiographic image capturing device 10 and the console device 20 when capturing an optical dynamic image of a practice movement before capturing a radiological dynamic image of the subject M is shown.

[0109] First, in step S1, the setting information generation unit 211 of the console device 20 generates optical setting information based on input by an operator, etc. Then, the setting information output unit 212 outputs the generated optical setting information to the radiographic imaging device 10 (SEQ1).

[0110] At this time, the setting information output unit 212 reads out the model video associated with the generated optical setting information from the database 221 of the storage unit 22. Then, the setting information output unit 212 outputs the generated optical setting information, the examination order information received from the RIS or the like, and the model video read out from the database 221 to the radiographic imaging device 10.

[0111] In step S2, the setting information acquisition unit 171 of the radiographic imaging apparatus 10 acquires the optical setting information, the examination order information, and the model video output from the console device 20.

[0112] In step S3, the imaging condition determination unit 172 of the radiographic imaging device 10 sets the optical imaging conditions for performing optical dynamic imaging based on the acquired optical setting information. In step S4, the optical imaging control unit 17 of the radiographic imaging device 10 causes the display unit 15 to display the model video acquired from the console device 20.

[0113] In step S5, the image generating unit 173 of the radiographic imaging device 10 controls the optical imaging unit 18 based on the set optical imaging conditions, performs optical dynamic imaging of the practice movements of the subject M, and acquires a plurality of optical image data. During optical dynamic imaging, the model video displayed in step S4 may or may not be displayed as is during the practice movements of the subject M.

[0114] Next, in step S6, the image generating unit 173 generates an optical dynamic image based on the plurality of optical image data, and then transmits the generated optical dynamic image to the console device 20 (SEQ2).

[0115] When the optical dynamic image is transmitted from the radiographic imaging device 10 to the console device 20, in step S7, the image acquisition unit 213 of the console device 20 acquires the optical dynamic image transmitted from the radiographic imaging device 10. Then, in step S8, the image analysis unit 214 of the console device 20 performs a practice movement determination process on the acquired optical dynamic image.

[0116] FIG. 8 is a flowchart showing an example of the flow of the practice movement determination process of FIG.

[0117] In step S11, the image analysis unit 214 of the console device 20 performs a skeleton extraction process on the optical dynamic image acquired from the radiographic imaging device 10 to extract the skeleton of the subject M. In step S12, the image analysis unit 214 sets checkpoints based on the extracted skeleton. Then, the image analysis unit 214 associates the optical dynamic image with the checkpoints set in the optical dynamic image, and registers them in the database 221 of the storage unit 22.

[0118] In step S13, the comparison and determination unit 215 of the console device 20 reads out the checkpoints of the optical dynamic image registered in step S12 and the reference checkpoint information of the model video corresponding to the optical dynamic image from the database 221. Then, in step S14, the comparison and determination unit 215 compares the value of the reference checkpoint information with the value of the checkpoint.

[0119] If the comparison result shows that all checkpoint values ​​are included in the checkpoint ranges of the reference checkpoint information (step S14: Yes), the comparison / determination unit 215 determines that the practice movements of the subject M are accurate. Then, the process proceeds to step S15.

[0120] In step S15, the presentation unit 216 of the console device 20 displays a display indicating that the practice movement is accurate as a result of the determination on the display unit 24. Then, in step S16, radiological dynamic images are captured.

[0121] On the other hand, in step S14, if there is a checkpoint value that is not included in the checkpoint range of the reference checkpoint information (step S14: No), the comparison / determination unit 215 determines that the practice movement of the subject M is not accurate. Then, the process proceeds to step S17.

[0122] In step S17, the presenting unit 216 displays a message indicating that the practice movement is not accurate as a result of the determination on the display unit 24. Then, in step S18, the optical dynamic image is captured again.

[0123] As described above, the radiation image processing system 1 according to this embodiment judges whether the subject M has performed a practice exercise based on optical dynamic images of the body movements performed by the subject M without irradiation. This allows the subject M to perform accurate body movements during practice before capturing the radiation dynamic images. This reduces imaging errors during radiation dynamic imaging. Furthermore, reducing imaging errors can prevent an increase in the amount of radiation exposure to the subject M during radiation dynamic imaging.

[0124] [Variation 1] A first modification of this embodiment will be described. In the practice movement determination process, a possible reason for determining that the practice movement of the subject M is inaccurate is that the subject M's range of motion is limited due to pain or the like, and the subject M is unable to perform the body movement according to the model video. In this case, even if the optical dynamic image is recaptured, the subject M may not be able to perform the body movement according to the model video, and the practice movement may again be determined to be inaccurate.

[0125] Therefore, in the first modification of the present embodiment, when it is determined that the practice motion is not accurate, it is determined whether or not to change the judgment criteria for the practice motion. If the judgment criteria are changed, re-evaluation is performed using the changed judgment criteria.

[0126] Specifically, when a practice movement is determined to be inaccurate, the items that are not included in the checkpoint range of the reference checkpoint information, which is the determination criterion, and the actual values ​​of those items are displayed as the determination result on the display unit 24. Also, the display unit 24 displays a message for confirming whether or not to change the checkpoint range value so as to lower it from the current value.

[0127] At this time, the change in the value of the checkpoint range is considered by, for example, a technician or the like who is instructing the practice movements of the subject M, and the change is made at the discretion of the technician or the like. Note that the present invention is not limited to this, and the value of the checkpoint range may be changed, for example, by preparing reference checkpoint information having the changed value in advance and applying this reference checkpoint information.

[0128] When the value of the checkpoint range is changed, the practice action determination process is performed again using the changed value, or the image may be re-photographed using the changed value.

[0129] As a specific example, consider the case where the "elbow angle" is "β2+4[°]" at midpoint #1 of the practice movement.

[0130] In the reference checkpoint information shown in Figure 6, the checkpoint range at midpoint #1 is "β2±2 [°]", so the elbow angle value at this time is not included in the checkpoint range. Therefore, the display unit 24 displays "elbow angle" as a checkpoint that does not satisfy the judgment criterion, and the elbow angle value "β2+4 [°]". In addition, the display unit 24 displays a message such as "Do you want to change the judgment criterion?" to confirm whether or not to change the checkpoint range, which is the judgment criterion.

[0131] Here, a technician or other worker instructing the subject M on the practice movement considers whether the value of the checkpoint range, which is the judgment criterion, can be changed. For example, if a technician or other worker determines that the value of the checkpoint range can be changed to "β2±5[°]" in consideration of the range of motion of the subject M or the effect on radiography, the worker operates the console device 20 to change the judgment criterion. Then, when the judgment criterion is changed, the practice movement is judged again based on the changed judgment criterion.

[0132] Fig. 9 is a flowchart showing an example of the flow of practice movement determination processing in Modification 1. In Fig. 9, the same processes as those in Fig. 8 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0133] In the practice movement determination process, steps S11 to S16 are the same as the example shown in Fig. 8. That is, it is determined whether the practice movement of the subject M is correct or not based on the optical dynamic image. Then, if it is determined that the practice movement is correct, a radiological dynamic image of the subject M is captured.

[0134] On the other hand, if it is determined that the practice movement of the subject M is not accurate, the presentation unit 216 of the console device 20 causes the display unit 24 to display a message indicating that the practice movement is not accurate in step S17. At this time, the display unit 24 displays items (checkpoints) that are not included in the checkpoint ranges and the actual values ​​of the items. The display unit 24 also displays a message for confirming whether or not to change the value of the checkpoint range, which is the judgment criterion.

[0135] Next, in step S21, the control unit 21 determines whether or not to change the value of the checkpoint range, which is the determination criterion.

[0136] When the value of the judgment criterion is changed (step S21: Yes), the control unit 21 changes the value of the checkpoint range in step S22. The change is made, for example, based on the operation of the console device 20 by an operator such as a technician. Then, the process returns to step S14, and the practice movement of the subject M is judged again using the changed value of the checkpoint range.

[0137] On the other hand, if it is determined in step S21 that the value of the judgment criterion is not to be changed (step S21: No), the process proceeds to step S18. Then, optical dynamic images of the subject M are recaptured using the checkpoint range of the reference checkpoint information, which is the current judgment criterion.

[0138] In this example, the value of the checkpoint range is changed in step S22, and then the practice motion is re-evaluated. However, this is not limited to this example. For example, after the value of the checkpoint range is changed in step S22, the process may proceed to step S18, and an optical dynamic image of the subject M may be re-captured.

[0139] In this way, in Modification 1, when it is determined that the practice movement of the subject M is not accurate, the checkpoint range of the reference checkpoint information, which is the judgment criterion, is changed. As a result, the correctness of the practice movement is re-determined based on the changed judgment criterion, which makes it possible to prevent unnecessary re-capture of optical dynamic images and reduce the burden on the subject M caused by repeating the practice movement.

[0140] [Variation 2] A second modification of the present embodiment will be described. In the above-described first and second modifications, optical dynamic imaging of the subject M when radiographic imaging is performed has been described. However, optical dynamic imaging of the subject M is also performed in the same manner when radiographic imaging of a still image is performed.

[0141] For example, when radiography of a still image is performed, in order for the subject M to be in the correct position for radiography, it may be necessary for the subject M to accurately perform the movements leading up to that position. This is because, when radiography of a still image is performed, the series of movements of the subject M leading up to radiography affects the position at the time of radiography.

[0142] For example, consider a case where the imaging target part is the knee of subject M and the knee is imaged from the side. When imaging the knee, subject M generally bends the knee joint, then bends the inside of the knee downward and positions it along the panel that is the radiation detection unit 14.

[0143] At this time, the technician or the like checks the state of the part to be imaged, such as whether the knee is moving away from the radiation detection unit 14, whether the distal thigh is raised, and whether the ankle is lowered. Specifically, for example, if the distal thigh is raised, the knee will rise in conjunction with the raising of the distal thigh and move away from the radiation detection unit 14. Also, if the ankle is lowered, the knee will rise in conjunction with the raising of the distal thigh and move away from the radiation detection unit 14.

[0144] In this way, even when performing still-image radiography of the target region of the subject M, the movements leading up to the radiography affect the radiography. Therefore, in a second modification of this embodiment, even when performing still-image radiography, the subject M is made to perform movements leading up to the position for radiography based on a model video. Then, optical dynamic imaging is performed on the practice movements of the subject M, and it is determined whether the practice movements are accurate based on checkpoints set in the optical dynamic image.

[0145] In this way, even when performing radiography of a still image, by performing optical dynamic imaging of the movements leading up to the imaging, the subject M can be positioned correctly when radiography of a still image is performed. Furthermore, since the subject M is made to perform the movements leading up to the imaging according to the model video, it is possible to effectively assist technicians who have relatively little experience in radiography and are unfamiliar with radiography.

[0146] Although the present embodiment has been described above, the present disclosure is not limited to the above-described embodiment, and various modifications and applications are possible within the scope of the gist of the present disclosure. For example, the database 221 in which various videos such as model videos and optical dynamic images, as well as checkpoints associated with these videos, are registered may be provided in other devices, not limited to the console device 20. Specifically, for example, a dedicated database device including the database 221 may be provided in the radiation image processing system.

[0147] Furthermore, in this embodiment, the practice movement determination process is described as being performed by the console device 20, but this is not limiting, and the practice movement determination process may be performed by a device other than the console device 20.

[0148] Furthermore, optical imaging by the optical imaging unit 18 is usually performed so as to include the imaging range of radiography, but the imaging range at this time is not limited to the imaging range of radiography. This is because, for example, even when imaging the elbow as the imaging target part, the angle of the wrist, which is outside the imaging range of radiography, can be a checkpoint during practice movements.

[0149] Furthermore, when an optical image is captured in the same capturing range as a radiographic image, the optical imaging unit 18 is disposed near the radiation irradiator 12, but the location of the optical imaging unit 18 is not limited to this example. For example, when the subject M performs a practice movement, the optical imaging unit 18 may be disposed at a position different from the radiation irradiator 12 so that imaging can be performed from an angle at which the state of the checkpoint or the state of the imaging target region can be easily determined. [Explanation of symbols]

[0150] 1. Radiation image processing system 10 Radiation imaging device 11 Radiography Control Unit 12 Radiation irradiation unit 13 Photo stand 14 Radiation detection unit 15 Display section 16 Audio output section 17 Optical photography control unit 18 Optical photography section 20 Console device 21 Control section 22 Memory section 23 Control section 24 Display section 25 Communications Department 26 Bus 30 Radiation image analysis device 40 Image management device 50 client terminals 111 Setting information acquisition unit 112 Shooting condition determination unit 113 Image Generation Unit 114 Storage section 171 Setting information acquisition unit 172 Shooting condition determination unit 173 Image Generation Unit 174 Memory section 211 Setting information generation unit 212 Setting information output section 213 Image Acquisition Unit 214 Image Analysis Unit 215 Comparison and Judgment Section 216 Presentation section 221 databases

Claims

1. 1. A training device for allowing a subject to practice body movements of the subject during radiographic imaging before the radiographic imaging, comprising: an image acquisition unit that acquires a practice video that captures the body movements performed by the subject as the practice without irradiating the subject with radiation; a determination unit that determines whether the practice is successful or not based on the practice video; A training device comprising:

2. further comprising an image analysis unit that analyzes the practice video and sets checkpoints for the practice video; The determination unit determining whether the practice is successful or not based on the checkpoints set in the practice video; 10. The training device of claim 1.

3. The image analysis unit Extracting the subject's skeleton from the training video; setting the checkpoints based on the extracted skeleton; 3. The training device of claim 2.

4. The system further includes a database for registering the set checkpoints and the practice video in association with each other.

3. The training device of claim 2.

5. The database has registered in advance a model video associated with reference checkpoint information corresponding to the checkpoint, The determination unit comparing the reference checkpoint information associated with the model video with the checkpoints associated with the practice video to determine whether the practice is correct; 5. The training device of claim 4.

6. The image analysis unit Set the checkpoints for the body included in the model video, generating the reference checkpoint information based on the set checkpoint; The model video and the generated reference checkpoint information are associated with each other and registered in the database.

6. The training device of claim 5.

7. a control unit that changes the reference checkpoint information when the practice is determined to be inaccurate; 6. The training device of claim 5.

8. The checkpoint is including at least one of the angle and coordinate of the joint of the subject; 3. The training device of claim 2.

9. Further, a presentation unit is provided to present a result of the judgment of whether the practice is successful or not.

10. The training device of claim 1.

10. A radiographic imaging device that irradiates a subject with radiation from a tube to capture a radiographic image, A radiographic apparatus comprising the training device according to any one of claims 1 to 9.

11. Further comprising a filming unit that films the practice video. The radiographic imaging apparatus according to claim 10.

12. The photographing unit is an optical camera. The radiographic imaging apparatus according to claim 11.

13. The imaging unit is disposed near the tube. The radiographic imaging apparatus according to claim 11.

14. The imaging unit is Located in an imaging room for capturing the radiation image, The entire imaging room is placed in a position where it can be imaged. The radiographic imaging apparatus according to claim 11.

15. performing dynamic radiography to capture a dynamic image as the radiation image; The radiographic imaging apparatus according to claim 10.

16. A practice movement determination method using a practice device for allowing a subject to practice a body movement of the subject during radiographic image capture before the radiographic image capture, comprising: acquiring a practice video in which the subject's physical movements performed as the practice are captured without irradiation with radiation; A practice motion judgment method for judging whether the practice is correct or not based on the practice video.

17. A program that causes a computer to execute the practice movement determination method according to claim 16.

Images