Positioning guidance device, positioning guidance system, positioning guidance method, and program

Abstract

To provide a positioning guidance device and the like that can give specific instructions to a subject when positioning is executed during imaging.SOLUTION: An imaging control device 2 includes: a first acquisition unit that acquires an optical image of a subject S which is imaged by an optical camera 34; a generation unit that generates a plurality of nodes indicating a skeleton from the acquired optical image of the subject S; a second acquisition unit that acquires an ideal positioning image 40 having a plurality of nodes indicating a skeleton at an ideal position; a calculation unit that calculates the difference between each node of the optical image and each node of the ideal positioning image 40; and an output unit that outputs guidance information Ia for correcting the positioning according to the difference.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a positioning guidance device, a positioning guidance system, a positioning guidance method, and a program. [Background technology]

[0002] In the medical field, radiography devices are used to capture radiological images of subjects using radiation such as X-rays. When taking radiographs, the subject needs to take a specific position according to the part to be photographed and the direction of photography specified in the order information. At this time, the subject may not know how to change his / her position. On the other hand, the person taking the radiograph, such as a radiologist, may have to spend a lot of time explaining to the patient how to position themselves correctly.

[0003] To address these problems, the following technology is known. Patent Document 1 describes a radiography system that displays information indicating a skeleton, etc., superimposed on an optical image of a patient. The radiography system displays information indicating a skeleton, etc., related to a previous image captured in the same position in the past, superimposed on the optical image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-78692 Summary of the Invention [Problem to be solved by the invention]

[0005] In conventional technology, the patient is informed of the positioning deviation by displaying information showing the bone structure and angle. However, in conventional technology, it is not possible to give specific instructions such as how to move in order to correct the positioning to the correct position. Therefore, there are cases where the patient does not fully understand the positioning movement (correction direction) during imaging.

[0006] Therefore, in order to solve the above problem, the present invention aims to provide a positioning guidance device, a positioning guidance system, a positioning guidance method, and a program that can give specific instructions to the subject when positioning during imaging. [Means for solving the problem]

[0007] The positioning guidance device according to the present invention comprises: a first acquisition unit that acquires a first image of the subject captured by the imaging unit; a generating unit that generates first positioning information from the acquired first image of the subject; a second acquisition unit that acquires a second image having ideal second positioning information; a calculation unit that calculates a difference between first positioning information of the first image and second positioning information of the second image; an output unit that outputs guidance information for correcting a positioning based on the difference; Equipped with.

[0008] The positioning guidance system according to the present invention comprises: an imaging unit that captures an image of a subject to obtain a first image; a first acquisition unit that acquires a first image of the subject acquired by the imaging unit; a generating unit that generates first positioning information from the acquired first image of the subject; a second acquisition unit that acquires a second image having ideal second positioning information; a calculation unit that calculates a difference between first positioning information of the first image and second positioning information of the second image; an output unit that outputs guidance information for correcting a positioning based on the difference; Positioning guidance system.

[0009] The positioning guidance method according to the present invention includes: A first acquisition step of acquiring a first image of the subject captured by an imaging unit; generating first positioning information from the acquired first image of the subject; a second acquisition step of acquiring a second image having ideal second positioning information; a calculating step of calculating a difference between first positioning information of the first image and second positioning information of the second image; an output step of outputting guidance information for correcting positioning based on the difference; has.

[0010] The program according to the present invention comprises: Computer, a first acquisition unit that acquires a first image of the subject captured by the imaging unit; a generating unit that generates first positioning information from the acquired first image of the subject; a second acquisition unit that acquires a second image having ideal second positioning information; a calculation unit that calculates a difference between first positioning information of the first image and second positioning information of the second image; an output unit that outputs guidance information for correcting the positioning based on the difference; Function as. Effect of the Invention

[0011] According to the present invention, the subject can clearly understand how to position himself / herself during imaging by obtaining guidance information. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram showing a schematic configuration of a radiation imaging system according to an embodiment of the present invention. [Figure 2A] FIG. 2 is a block diagram of an imaging control device according to the present embodiment. [Figure 2B] 5 is a diagram showing an example of a configuration of a table stored in a storage unit according to the embodiment; FIG. [Diagram 3] 10 is a flowchart showing an example of the operation of the imaging control device when checking the positioning of a subject using an optical image before capturing a radiological image according to the present embodiment. [Figure 4A] 11A and 11B are diagrams showing an example of a positioning guidance screen displayed on the display device and the display unit according to the embodiment; [Figure 4B] 11A and 11B are diagrams showing an example of a positioning guidance screen displayed on the display device and the display unit according to the embodiment; [Figure 4C] 11A and 11B are diagrams showing an example of a positioning guidance screen displayed on the display device and the display unit according to the embodiment; [Figure 4D] 11A and 11B are diagrams showing an example of a positioning guidance screen displayed on the display device and the display unit according to the embodiment; [Diagram 5] 13A and 13B are diagrams illustrating an example of other guidance information displayed on a guidance screen of a display device or the like according to the embodiment. [Figure 6A] FIG. 13 is a diagram showing an example of a positioning guidance screen displayed on a display device or the like in a case where an optical image according to a modified example of the present embodiment is a moving image. [Figure 6B] FIG. 13 is a diagram showing an example of a positioning guidance screen displayed on a display device or the like in a case where an optical image according to a modified example of the present embodiment is a moving image. [Figure 6C] FIG. 13 is a diagram showing an example of a positioning guidance screen displayed on a display device or the like in a case where an optical image according to a modified example of the present embodiment is a moving image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0014] [Example of configuration of radiation imaging system 10] FIG. 1 is a diagram showing a schematic configuration of a radiation imaging system 10 according to this embodiment. The radiation imaging system 10 includes a radiation image capturing device 1, an imaging control device 2, a radiation generating device 3, an image management device 4, an HIS / RIS 5, and a display device 6. In the following, the radiation image capturing device may be referred to as an imaging device 1, and the radiation generating device may be referred to as a generator 3. HIS is an abbreviation for Hospital Information System, which is a hospital information system. RIS is an abbreviation for Radiology Information System, which is a radiology department information system. The radiation imaging system 10 is an example of a positioning guidance system. The imaging control device 2 is an example of a positioning guidance device.

[0015] The photographing device 1, the photographing control device 2, the generating device 3, the image management device 4, the HIS / RIS 5, and the display device 6 are connected to each other so as to be able to communicate with each other via a network N. Examples of the network N include a LAN, a WAN, and the Internet. LAN is an abbreviation for Local Area Network. WAN is an abbreviation for Wide Area Network. The communication method of the network N may be wired communication or wireless communication.

[0016] The generating device 3 includes a generator 31, an exposure switch 32, a radiation source 33, and an optical camera . The generator 31 applies a voltage according to preset imaging conditions to a radiation source 33 including, for example, a tube, based on the operation of an exposure switch 32. The generator 31 may have an operation unit that accepts input of irradiation conditions and the like.

[0017] When a voltage is applied from the generator 31 to the radiation source 33, the radiation source 33 generates radiation R with a dose corresponding to the applied voltage. The radiation R is, for example, an X-ray.

[0018] The optical camera 34 is disposed, for example, next to the radiation source 33. The radiation source 33 and the optical camera 34 may be integrally mounted in a housing. The optical camera 34 optically photographs the subject S at a timing before capturing a radiation image of the subject S. The optical camera 34 transmits an optical image of the subject S at the time of positioning that has been captured to the imaging control device 2. The optical image includes a still image or a moving image captured continuously.

[0019] The generating device 3 generates radiation R in a manner corresponding to the type of radiation image, for example, a still image or a moving image. Specifically, in the case of a still image, the generating device 3 irradiates radiation R only once per pressing of the exposure switch 32. In the case of a moving image, the generating device 3 repeatedly irradiates pulsed radiation R multiple times per predetermined time per pressing of the exposure switch 32, for example.

[0020] The imaging device 1 generates digital image data showing the imaging site of the subject S. For example, a portable FPD is used as the imaging device 1. FPD is an abbreviation for Flat Panel Detector. The imaging device 1 may be configured integrally with the generating device 3.

[0021] Although not shown, the imaging device 1 includes, for example, an imaging element, a sensor board, a scanning unit, a readout unit, a control unit, and a communication unit. The imaging element generates an electric charge according to the dose of radiation R when it receives the radiation R. The sensor board has switch elements arranged two-dimensionally (in a matrix) and stores and releases electric charge. The scanning unit switches each switch element on / off. The readout unit reads out the amount of electric charge released from each pixel as a signal value. The control unit generates image data of the radiation image from the multiple signal values ​​read out by the readout unit. The image data includes still image data or moving image data. The communication unit transmits the generated image data and various signals to other devices such as the imaging control device 2, and receives various information and various signals from other devices.

[0022] The imaging control device 2 sets imaging conditions for the imaging device 1 and the generator 3, etc., and controls the reading operation of the radiation image captured by the imaging device 1. The imaging control device 2 is also called a console, and is constituted by, for example, a personal computer, etc.

[0023] The imaging conditions include, for example, patient conditions related to the subject S, irradiation conditions related to the irradiation of radiation R, and image reading conditions related to the image reading of the imaging device 1. The patient conditions include, for example, the imaging part, imaging direction, and physique. The irradiation conditions include, for example, tube voltage (kV), tube current (mA), irradiation time (ms), and current-time product (mAs value). The image reading conditions include, for example, pixel size, image size, and frame rate. The imaging control device 2 may automatically set the imaging conditions based on order information acquired from the HIS / RIS 5, etc. Alternatively, the imaging control device 2 may allow a user, such as a radiologist, to manually set the imaging conditions by operating an operation unit 21, which will be described later.

[0024] A display device 6 is installed in the imaging room where the imaging device 1 and the generating device 3 are arranged. The display device 6 is connected to the imaging control device 2 using an interface such as HDMI (registered trademark). HDMI is an abbreviation for High-Definition Multimedia Interface. The communication method may be wired or wireless. The display device 6 is, for example, configured with a general-purpose monitor such as a liquid crystal display, as described later. For example, the display device 6 displays an optical image of the subject S captured by the optical camera 34, guidance information Ia for guiding the subject S to an ideal position, and the like. This allows the subject S and users such as radiologists to efficiently correct their positioning by referring to the guidance information Ia, etc. before capturing a radiation image. The display device 6 may be mirrored with the imaging control device 2 so that the same image as the image displayed on the display unit 22 of the imaging control device 2 can be displayed. The display device 6 may also be configured to be movable to a position where the screen is easy to view depending on the posture of the subject S, etc.

[0025] The image management device 4 manages the image data generated by the imaging device 1. The image management device 4 is an image archiving and communication system, an image diagnosis workstation, etc. The image archiving and communication system is sometimes called PACS. PACS is an abbreviation for Picture Archiving and Communication System.

[0026] The HIS / RIS 5 receives order information regarding radiography of a patient from, for example, a doctor, and transmits the received order information to the radiography control device 2. The order information includes various information such as the patient's ID, the body part to be radiographed, the radiography direction, and the physique.

[0027] [Example of block diagram of imaging control device 2] FIG. 2A is a block diagram of the imaging control device 2. The imaging control device 2 includes a control unit 20, an operation unit 21, a display unit 22, a storage unit 23, and a communication unit 24. The control unit 20, the operation unit 21, the display unit 22, the storage unit 23, and the communication unit 24 are connected to each other so as to be able to communicate with each other via a bus 25, for example.

[0028] The control unit 20 includes, for example, a processor such as a CPU. CPU is an abbreviation for Central Processing Unit. The processor executes programs stored in a memory such as a RAM to realize various processes including imaging control processing and positioning guidance processing. The control unit 20 may include electronic circuits such as ASIC and FPGA. ASIC is an abbreviation for Application Specific Integrated Circuit. FPGA is an abbreviation for Field Programmable Gate Array.

[0029] The operation unit 21 receives instructions according to various input operations from the user, converts the received instructions into operation signals, and outputs the operation signals to the control unit 20. The operation unit 21 includes, for example, a mouse, a keyboard, a switch, a button, and the like. The operation unit 21 may be, for example, a touch panel integrally combined with a display. The operation unit 21 may be, for example, a user interface that receives voice input from a microphone or the like.

[0030] The display unit 22 displays a radiographic image based on image data received from the imaging device 1, a GUI for receiving various input operations from the user, and the like. GUI is an abbreviation for Graphical User Interface. The display unit 22 is, for example, a display such as a liquid crystal display or an organic EL display. EL is an abbreviation for Electro Luminescence. Specifically, in addition to the radiographic image, the display unit 22 can display an optical image of the subject S captured by the optical camera 34, guidance information Ia for guiding the subject S to an ideal positioning, and the like. This allows the user on the imaging side to check the state of the positioning of the subject S.

[0031] The storage unit 23 stores, for example, a system program, an application program, and various data. The storage unit 23 includes any storage module, for example, an HDD, an SSD, a ROM, and a RAM. HDD is an abbreviation for Hard Disk Drive. SSD is an abbreviation for Solid State Drive. ROM is an abbreviation for Read Only Memory. Specifically, the storage unit 23 stores a table 30 and a machine learning model 70.

[0032] FIG. 2B shows an example of the configuration of table 30 stored in storage unit 23. As shown in FIG. The table 30 stores the patient's radiographic imaging conditions, the ideal positioning image 40, deviation information indicating the deviation between the skeletal position of the patient image and the ideal skeletal position of the ideal positioning image 40, and guidance information Ia indicating the positioning correction direction in association with each other. For the sake of convenience, the ideal positioning image 40 is shown by a dashed line in the following drawings.

[0033] The ideal positioning image 40 is used as a reference image when determining whether the positioning of the subject S is correct. The ideal positioning image 40 is, for example, a schematic representation of a person using wires, but may be a representation other than wire display. The ideal positioning image 40 may be prepared for each imaging condition, such as the imaging part and imaging direction, and for each positioning. The ideal positioning image 40 includes a plurality of nodes that define a skeleton in an ideal position in each positioning. The number of nodes can be set to any number, and may be, for example, 18, similar to the patient image 50 described later. The ideal positioning image 40 may be, for example, an optical image captured in the same posture (imaging direction) of the same patient in the past. The ideal positioning image 40 may be estimated by a machine learning model. In addition, the ideal positioning image 40 may be acquired from, for example, an external device other than the storage unit 23. Note that the ideal positioning image 40 is an example of a first image, and the nodes that define the skeleton are an example of skeleton information.

[0034] Specifically, when the imaging condition is chest standing front PA, the ideal positioning image 40 corresponding to the imaging condition is acquired from the table 30. The positioning of the ideal positioning image 40 is, for example, a state in which the left and right arms are stretched horizontally to the sides in a standing posture (standing position). Next, the optical image captured by the optical camera 34 is compared with the acquired ideal positioning image 40. For example, when the position of the left wrist, etc. in the patient image is lower than the ideal position of the left wrist, etc. in the ideal positioning image 40, the guidance information Ia of "Please raise your right arm" and "Please raise your left arm" is acquired from the table 30. When the position of the left wrist, etc. in the patient image is higher than the ideal position of the left wrist, etc. in the ideal positioning image 40, the guidance information Ia of "Please lower your right arm" and "Please lower your left arm" is acquired from the table 30. When the position of the left wrist etc. in the patient image coincides with the ideal position of the left wrist etc. in the ideal positioning image 40, guidance information Ia stating "maintain that posture" is acquired from the table 30. Although FIG. 2B illustrates only a part of the imaging region, the guide information Ia is associated with other imaging regions and imaging directions according to deviation information indicating deviations from the ideal positioning image 40.

[0035] The machine learning model 70 is a model obtained by machine learning using an image of a subject as input data and nodes indicating each skeleton of the subject at each positioning as correct answer data (labels). The machine learning model 70 may be a regression model such as polynomial regression, multiple regression, support vector regression, or random forest regression. The machine learning model 70 may also be another model such as a neural network. The control unit 20 inputs an optical image of the subject S captured by the optical camera 34 to the machine learning model 70, thereby estimating and generating nodes that define each skeleton of the patient image in the optical image. The machine learning model 70 may be provided in an external device different from the imaging control device 2.

[0036] 2A, the communication unit 24 includes, for example, a communication module including a NIC, a receiver, and a transmitter. NIC is an abbreviation for Network Interface Card. The communication unit 24 communicates various data such as image data between the photographing device 1 and the image management device 4 via the network N.

[0037] In the configuration of the imaging control device 2 described above, the control unit 20 functions as a first acquisition unit, a generation unit, a second acquisition unit, a calculation unit, and an output unit. The functions of the first acquisition unit, the generation unit, the second acquisition unit, the calculation unit, and the output unit are realized by the processor of the control unit 20 executing a program stored in the storage unit 23 or the like. The first acquisition unit acquires optical images including a patient image of the subject S captured by the optical camera 34 by executing the first acquisition step. The generating unit generates a plurality of nodes that define the skeleton of the patient image from the optical image of the subject S acquired by the first acquiring unit, by executing the generating step. The second acquisition unit acquires an ideal positioning image 40 having nodes indicating the skeleton in an ideal position by executing the second acquisition step. The calculation unit calculates the difference, which is the deviation between each node of the patient image in the optical image and each node of the ideal positioning image 40, by executing the calculation step. By executing the output step, the output unit outputs, to the display device 6, the display unit 22, etc., guide information Ia for correcting the positioning according to the difference calculated by the calculation unit.

[0038] [Example of operation of the imaging control device 2] Next, a procedure for capturing a radiological image of a subject S according to this embodiment will be described. Fig. 3 is a flow chart showing an example of the operation of the imaging control device 2 when checking the positioning of the subject S using an optical image before capturing a radiographic image. Figs. 4A to 4D show an example of a positioning guidance screen 60 displayed on the display device 6 and the display unit 22. Note that, hereinafter, the positioning guidance screen 60 may be referred to as the guidance screen 60. Also, the display device 6 and the display unit 22 may be collectively referred to as the display device 6, etc.

[0039] In this embodiment, a case will be described in which the imaging direction of the radiation image is such that the abdomen side of the subject S is brought into contact with the imaging device 1 and radiation R passes from the rear to the front of the subject S. In addition, in order to make it easier for the subject S to view the guidance screen 60, the display device 6 is disposed, for example, in front of the subject S.

[0040] Before capturing a radiological image, an optical image of the subject S is captured by the optical camera 34. In the following, a case where the optical image is a still image will be described. The control unit 20 acquires the optical image of the subject S captured by the optical camera 34 (step S1).

[0041] The control unit 20 generates and acquires skeletal information from the acquired optical image of the subject S (step S2). Specifically, the control unit 20 inputs the acquired optical image of the subject S to the machine learning model 70. The machine learning model 70 estimates nodes that define each skeleton of the patient image 50 in the input optical image. In this embodiment, for example, 18 nodes of the subject S are estimated as skeletal information. The 18 nodes include the nose, neck, right shoulder, right elbow, right wrist, right hip, right knee, right ankle, right eye, right ear, left shoulder, left elbow, left wrist, left hip, left knee, left ankle, left eye, and left ear. A reliability indicating the certainty may be estimated for each node. The reliability is quantified from 0.0 to 1.0. The closer to 1.0, the higher the reliability. The control unit 20 acquires the skeletal information and reliability of the subject S in the optical image output from the machine learning model 70. The control unit 20 superimposes the acquired skeleton information and reliability on the optical image and displays them on the display device 6 or the like. Note that the number of nodes is an example and is not limited to the number of nodes in this embodiment. Also, the patient image 50 in the optical image is an example of a second image, and the nodes that define the skeleton of the patient image 50 are an example of second positioning information.

[0042] The control unit 20 determines the imaging part and imaging direction in the optical image based on the skeletal information (nodes) and reliability of the acquired patient image 50 (step S3). The bones that can be imaged by the optical camera 34 vary depending on the orientation of the subject S relative to the imaging device 1, and the reliability of the estimated skeletal information of the patient image 50 also varies. Therefore, by considering the reliability of the skeletal information, it is possible to identify the imaging part and the like according to the orientation of the subject S. For example, the imaging part and imaging direction are determined to be chest front standing position, chest front sitting position, chest side RL, chest side, abdominal front standing position, etc. The photographed part and photographing direction of the optical image may be determined without using skeletal information, etc., of the patient image 50. Specifically, the photographed part, etc. of the optical image may be determined by inputting the optical image photographed by the optical camera 34 directly into a machine learning model, which is a general image classification model, such as ResNet. ResNet is an abbreviation for Residual neural network.

[0043] The control unit 20 judges whether the photographing part and the photographing direction of the judgment result match the photographing part and the photographing direction of the order information (step S4). If the control unit 20 judges that the photographing part and the photographing direction of the judgment result do not match the photographing part and the photographing direction of the order information, the control unit 20 proceeds to step S5.

[0044] In this case, the control unit 20 notifies warning information indicating that the imaging region and imaging direction of the subject S do not match the order information (step S5). The warning information may be, for example, text, images, etc. for calling the attention of the user or the subject S. Furthermore, if an output unit such as a speaker is provided, the warning information may be voice or warning sound output from the output unit. Furthermore, the warning information may be a combination of text, images, voice, etc. After notifying the warning information, the control unit 20 returns to step S4. On the other hand, if the control unit 20 determines that the imaging region and imaging direction, which are the determination results, match the imaging region and imaging direction of the order information, it proceeds to step S6.

[0045] The control unit 20 acquires from the storage unit 23 an ideal positioning image 40 that serves as a reference corresponding to the imaging site and imaging direction of the acquired optical image (step S6). Next, as shown in FIG. 4A, the control unit 20 displays the acquired ideal positioning image 40 superimposed on the optical image displayed on the guidance screen 60 of the display device 6 or the like. The ideal positioning image 40 is displayed approximately at the center of the guidance screen 60, and is ideally positioned according to the order information. The positioning is, for example, a state in which the patient is in a standing posture (standing position) with both arms stretched horizontally to the sides. A plurality of nodes that define the skeleton are displayed on the wire-displayed person in the ideal positioning image 40. Note that, in FIG. 4A and the like, only a portion of the nodes is displayed for the sake of simplicity of explanation. Regarding the display of the subsequent nodes, only a portion of the nodes is also displayed unless otherwise specified. In addition, although objects such as the imaging device 1 are actually reflected behind the patient image 50 in the optical image, these objects are omitted for the sake of simplicity of explanation. Furthermore, the patient image 50 in the optical image is actually a photographic image, but for ease of explanation, the subject S is shown diagrammatically.

[0046] The control unit 20 compares the position of each node of the patient image 50 in the optical image with the position of each node of the ideal positioning image 40, and calculates the positioning deviation (difference) from the comparison result (step S7). Specifically, the control unit 20 compares the coordinates of a predetermined node of the patient image 50 in the optical image with the coordinates of a corresponding predetermined node of the ideal positioning image 40. In this embodiment, as shown in FIG. 4B, the coordinates of the neck N1 of the patient image 50 in the optical image are shifted to the right side from the coordinates of the neck M1 of the ideal positioning image 40. In this case, the control unit 20 determines that the patient image 50 in the optical image is shifted to the right side with respect to the ideal positioning image 40 from the comparison result of each node, and proceeds to step S8. Here, the coordinates are positions defined by points on the X-axis and points on the Y-axis when the horizontal direction (left-right direction) of the guidance screen 60 is the X-axis and the vertical direction (up-down direction) of the guidance screen 60 is the Y-axis. For convenience, the nodes in one location of the patient image 50 and the ideal positioning image 40 are compared, but the nodes in multiple locations may be compared. The same applies to the comparison between the nodes of the patient image 50 and the nodes of the ideal positioning image 40 described below.

[0047] The control unit 20 displays guidance information Ia on the guidance screen 60 of the display device 6 to assist in correcting the positioning corresponding to the judgment result (step S8). As shown in FIG. 4B, the guidance screen 60 of the display device 6 displays the text "Please move left" as the guidance information Ia, and an arrow indicating the moving direction of the subject S. Note that the guidance information Ia may be other than text information such as text and images such as arrows. For example, an output unit such as a speaker may be provided to output the above-mentioned text by voice or the like. The guidance information Ia may also be a combination of text information, image information, and sound information. The subject S corrects his / her standing position to match the ideal positioning image 40 of the display device 6 while looking at the guidance information Ia on the display device 6. After displaying the guidance information Ia, the control unit 20 returns to step S7.

[0048] The control unit 20 acquires an optical image again, and judges whether or not there is still a deviation in the positioning based on the acquired optical image. Specifically, the control unit 20 compares the coordinates of a predetermined node of the patient image 50 in the optical image with the coordinates of a corresponding predetermined node of the ideal positioning image 40. In this embodiment, as shown in FIG. 4C, the coordinates of the left wrist N2 of the patient image 50 in the optical image are located lower than the coordinates of the left wrist M2 of the ideal positioning image 40. Similarly, the coordinates of the right wrist N3 of the patient image 50 in the optical image are located lower than the coordinates of the right wrist M3 of the ideal positioning image 40. In these cases, the control unit 20 judges that the left and right wrists of the patient image 50 are lower than the left and right wrists of the ideal positioning image 40 based on the comparison result of each node, and proceeds to step S8.

[0049] The control unit 20 displays guidance information Ia on the guidance screen 60 of the display device 6 to assist in correcting the positioning corresponding to the judgment result (step S8). As shown in FIG. 4C, the guidance screen 60 of the display device 6 displays the sentences "Raise your left arm" and "Raise your right arm" as the guidance information Ia, and an arrow indicating the direction of arm movement. The guidance information Ia may be other than text information such as text and images such as arrows. For example, an output unit such as a speaker may be provided to output the above-mentioned sentences by voice or the like. The guidance information Ia may be a combination of text information, image information, and sound information. The subject S corrects the positioning (arm position) while looking at the guidance information Ia on the display device 6 so that it matches the ideal positioning image 40 on the display device 6.

[0050] After displaying the guidance information Ia, the control unit 20 returns to step S7. The control unit 20 acquires an optical image again, and judges whether or not there is still a deviation in the positioning based on the acquired optical image. Specifically, the control unit 20 compares the coordinates of a predetermined node of the patient image 50 in the optical image with the coordinates of a corresponding predetermined node of the ideal positioning image 40. In this embodiment, as shown in FIG. 4D, the coordinates of the left wrist N2 of the patient image 50 in the optical image are at substantially the same position as the coordinates of the left wrist M2 of the ideal positioning image 40. Similarly, the coordinates of the right wrist N3 of the patient image 50 in the optical image are at substantially the same position as the coordinates of the right wrist M3 of the ideal positioning image 40. In these cases, the control unit 20 judges that the coordinates of each node of the patient image 50 match the coordinates of each node of the ideal positioning image 40 based on the comparison result of each node, and proceeds to step S9. The coincidence of coordinates also includes a case where the deviation of the coordinates is within a certain range.

[0051] The control unit 20 displays guidance information Ia on the guidance screen 60 of the display device 6 to notify that the positioning corresponding to the judgment result is correct (step S9). As shown in FIG. 4D, the guidance screen 60 of the display device 6 displays a sentence, "Keep that position → Shooting OK", as the guidance information Ia. Note that the guidance information Ia may be other than text information such as text and images such as arrows. For example, an output unit such as a speaker may be provided to output the above-mentioned sentence by voice or the like. Furthermore, the guidance information Ia may be a combination of text information, image information, and sound information.

[0052] When a user such as a radiologist confirms that "imaging OK" is displayed in the guidance information Ia displayed on the display unit 22 or the like of the imaging control device 2, the user proceeds to the next step of imaging a radiographic image.

[0053] The control unit 20 determines whether or not an image capturing instruction has been received in response to the user's turning on of the exposure switch 32 (step S10). If the control unit 20 determines that an image capturing instruction has not been received in response to the user's turning on of the exposure switch 32, the process returns to step S10. On the other hand, if the control unit 20 determines that an image capturing instruction has been received in response to the user's turning on of the exposure switch 32, the process proceeds to step S11.

[0054] The control unit 20 controls the imaging device 1, the generating device 3, etc. to capture a radiological image of the subject S (step S11). The generating device 3 irradiates radiation R to the imaging site of the subject S. The imaging device 1 detects the radiation R that has passed through the subject S from the generating device 3, and generates image data showing the imaging site based on the detected radiation R. The imaging device 1 transmits the generated image data to the imaging control device 2. The control unit 20 of the imaging control device 2 displays the radiological image based on the image data received from the imaging device 1 on an imaging screen such as the display unit 22.

[0055] [Example of display of other guidance information Ib] 5 shows an example of the other guide information Ib displayed on the guide screen 60 of the display device 6. Hereinafter, the above-mentioned guide information Ia will be referred to as first guide information Ia, and the other guide information Ib will be referred to as second guide information Ib.

[0056] On the left side of the guidance screen 60 of the display device 6 or the like, an optical image including the above-mentioned patient image 50 and the ideal positioning image 40 are displayed. Below the patient image 50 and the ideal positioning image 40, for example, a sentence such as "Raise your left arm" is displayed as the first guidance information Ia. Note that the first guidance information Ia is the same as the guidance information Ia shown in FIG. 4C or the like described above, and therefore a detailed description thereof will be omitted.

[0057] The second guide information Ib is displayed on the right side of the guidance screen 60 of the display device 6. The second guide information Ib is composed of a list Ic and correction possibility information Id. The list Ic includes skeletal information corresponding to each node of the patient image 50 and guide information for supporting the correction direction for the deviation of each skeletal information. That is, the list Ic displays guide information in association with each skeletal information of the patient image 50. Specifically, when the skeletal information is "right shoulder", the guidance screen 60 of the display device 6 displays the sentence "Below the ideal position" as the list Ic. Above the list Ic on the guidance screen 60 of the display device 6, the sentence "Positioning needs to be corrected" indicating that positioning needs to be corrected is displayed as the correction possibility information Id.

[0058] As described above, according to this embodiment, information including guidance information Ia for supporting the correction direction of positioning is displayed on the display device 6 installed in the radiography room. Specifically, for example, an ideal positioning image 40 visually showing a sample of which direction the arm should be moved is displayed on the display device 6. Also, for example, guidance information Ia visually showing in a sentence which direction the arm should be moved is displayed on the display device 6. This allows the subject S to spontaneously check the ideal positioning image 40 and guidance information Ia displayed on the display device 6. As a result, the subject S can clearly understand what kind of positioning he or she should take in the future. In addition, the user on the radiographer side can efficiently give the positioning instructions to the subject S by checking the ideal positioning image 40 and the guidance information Ia displayed on the display unit 22 or the like installed in the diagnostic room, for example. This can shorten the explanation time when correcting the positioning, and reduce the number of retakes.

[0059] [Variation (for video recording)] Next, a case where moving image capturing with positioning movement is performed as radiography according to a modified example of this embodiment will be described. The operation of the imaging control device 2 and the like when the optical image is a moving image is substantially the same as each process of the flowchart in the case of still image capturing shown in Fig. 3. Therefore, in this modified example, differences from the above embodiment will be mainly described, and the description of the points in common with the above embodiment will be omitted. Also, parts in common with the above embodiment will be described with the same reference numerals.

[0060] 6A to 6C show an example of a positioning guidance screen 60 displayed on the display device 6 and the display unit 22 in the case of moving image shooting. The positioning movement that serves as the reference in the case of moving image shooting is, for example, the movement of moving the left arm up and down with the left shoulder as the fulcrum.

[0061] First, the control unit 20 acquires an optical image of a moving image of the subject S captured by the optical camera 34. The optical image has a plurality of frames according to the movement of the subject S. The control unit 20 estimates nodes that define the skeleton of a patient image 50 from within the acquired optical image. The optical image is displayed on a guidance screen 60 of the display device 6 or the like. The estimated plurality of nodes are displayed on the patient image 50.

[0062] The control unit 20 acquires an ideal positioning image 40 corresponding to the acquired optical image from the storage unit 23 (step S6). The ideal positioning image 40 has a plurality of frames according to the above-mentioned reference positioning movement. The acquired ideal positioning image 40 is displayed on a guidance screen 60 of the display device 6 or the like. A plurality of nodes defining a skeleton are displayed on the ideal positioning image 40. As shown in FIG. 6A, the control unit 20 displays a patient image 50 of an optical image on the right side of the guidance screen 60, and displays the ideal positioning image 40 on the left side of the guidance screen 60. That is, in the case of a moving image, the patient image 50 and the ideal positioning image 40 are displayed side by side on the left and right sides of the guidance screen 60. Note that the display method of the patient image 50 and the ideal positioning image 40 may be other layouts.

[0063] The control unit 20 compares the patient image 50 in the optical image with the ideal positioning image 40, and calculates the positioning deviation from the comparison result (step S7). Specifically, the control unit 20 uses multiple frames of the optical image to determine the movement range (trajectory) of the left arm of the patient image 50 relative to the ideal positioning image 40. Here, the left arm of the ideal positioning image 40 moves in the vertical direction with the left shoulder as the fulcrum. For example, in the case of FIG. 6A, the left wrist N2 of the patient image 50 does not move between multiple frames. In this case, the control unit 20 determines that the left arm of the subject S does not move from the comparison result of each node.

[0064] Based on the determination result, the control unit 20 displays guidance information Ia for alerting the subject S to move his / her left arm up and down on the guidance screen 60 of the display device 6. For example, as shown in Fig. 6A, the guidance screen 60 of the display device 6 displays the text "Please move your left arm up and down" as the guidance information Ia along with an arrow indicating the direction of arm movement.

[0065] After displaying the guidance information Ia, the control unit 20 again obtains an optical image from the optical camera 34 and determines whether there is a deviation in the positioning of the subject S based on the obtained optical image. Specifically, the control unit 20 determines the movement range of the left arm of the patient image 50 relative to the ideal positioning image 40 using multiple frames of the optical image. For example, in the case of FIG. 6B, the lowest position of the left wrist N2 of the patient image 50 is located above the lowest position of the left wrist M2 of the ideal positioning image 40. The highest position of the left wrist N2 of the patient image 50 is located below the highest position of the left wrist M2 of the ideal positioning image 40. In these cases, the control unit 20 determines that the movement range of the left arm of the subject S between multiple frames is smaller than the movement range of the ideal positioning image 40 based on the comparison result of each node.

[0066] Based on the determination result, the control unit 20 displays guidance information Ia for alerting the subject S to move his / her left arm up and down more widely on the guidance screen 60 of the display device 6. For example, as shown in Fig. 6B, the guidance screen 60 of the display device 6 displays, as the guidance information Ia, a sentence saying "Please move your left arm up and down more widely" and an arrow indicating the direction of arm movement.

[0067] After displaying the guide information Ia, the control unit 20 again obtains an optical image from the optical camera 34, and determines whether or not there is a deviation in the positioning of the subject S based on the obtained optical image. Specifically, the control unit 20 uses multiple frames of the optical image to determine the movement range of the left arm of the patient image 50 relative to the ideal positioning image 40. For example, in the case of FIG. 6C, the lowest position of the left wrist N2 of the patient image 50 is approximately the same as the lowest position of the left wrist M2 of the ideal positioning image 40. Also, the highest position of the left wrist N2 of the patient image 50 is approximately the same as the highest position of the left wrist M2 of the ideal positioning image 40. In these cases, the control unit 20 determines that the movement of the left arm of the patient image 50 between multiple frames matches the movement of the ideal positioning image 40 from the comparison result of each node.

[0068] Based on the determination result, the control unit 20 causes guidance information Ia indicating that the left arm movement is ideal for the subject S to be displayed on the guidance screen 60 of the display device 6. For example, as shown in Fig. 6C, the guidance screen 60 of the display device 6 displays a sentence "Please maintain that movement ⇒ Shooting OK" as the guidance information Ia.

[0069] When a user such as a radiologist confirms that "imaging OK" is displayed in the guidance information Ia displayed on the guidance screen 60 of the display device 6 or the like, the user proceeds to the next step of capturing a radiographic image.

[0070] According to a modified example of this embodiment, even in the case of capturing a moving image with positioning movement, an optical image of the moving image is captured by the optical camera 34, and the optical image is compared with an ideal positioning image 40 corresponding to the moving image. The difference resulting from the comparison is displayed as guidance information Ia on the display device 6. As a result, even in the case of capturing an optical image that is a moving image, the subject S can accurately understand how to move a body part such as an arm by checking the guidance information Ia, etc.

[0071] Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. Furthermore, various modifications and improvements will naturally fall within the technical scope of the present disclosure within the scope of the technical ideas described in the claims of those skilled in the art. [Explanation of symbols]

[0072] 2. Shooting control device (positioning guidance device) 10 Radiography system (positioning guidance system) 20 Control section 34 Optical camera (photography unit) 40 Ideal positioning image (2nd image) 50 Patient image in optical image (first image) 60 Positioning Guidance Screen (Guidance Screen)

Claims

1. a first acquisition unit that acquires a first image of the subject captured by the imaging unit; a generating unit that generates first positioning information from the acquired first image of the subject; a second acquisition unit that acquires a second image having ideal second positioning information; a calculation unit that calculates a difference between first positioning information of the first image and second positioning information of the second image; an output unit that outputs guidance information for correcting a positioning according to the difference; A positioning guidance device comprising:

2. The first positioning information and the second positioning information include skeletal information of the subject. The positioning guidance device according to claim 1 .

3. the first image and the second image are moving images; The positioning guidance device according to claim 1 .

4. The guidance information is information to prompt the subject to move a part of the subject in a correction direction to correct the deviation, which is the difference, or information to prompt the subject to maintain positioning. The positioning guidance device according to claim 1 .

5. The guidance information is at least one of text information including text, image information including image, and sound information including sound. The positioning guidance device according to claim 1 .

6. an imaging unit that captures an image of a subject to obtain a first image; a first acquisition unit that acquires a first image of the subject acquired by the imaging unit; a generating unit that generates first positioning information from the acquired first image of the subject; a second acquisition unit that acquires a second image having ideal second positioning information; a calculation unit that calculates a difference between first positioning information of the first image and second positioning information of the second image; an output unit that outputs guidance information for correcting a positioning based on the difference; A positioning guidance system comprising:

7. a first acquisition step of acquiring a first image of the subject captured by an imaging unit; generating first positioning information from the acquired first image of the subject; a second acquisition step of acquiring a second image having ideal second positioning information; a calculating step of calculating a difference between first positioning information of the first image and second positioning information of the second image; an output step of outputting guidance information for correcting positioning based on the difference; A positioning guidance method comprising:

8. Computer, a first acquisition unit that acquires a first image of the subject captured by the imaging unit; a generating unit that generates first positioning information from the acquired first image of the subject; a second acquisition unit that acquires a second image having ideal second positioning information; a calculation unit that calculates a difference between first positioning information of the first image and second positioning information of the second image; an output unit that outputs guidance information for correcting the positioning based on the difference; A program that functions as a

Images