Imaging support device, program, imaging support method and imaging support system

Abstract

To provide an imaging support device and the like, which enable a user to select information for supporting a correction direction of positioning.SOLUTION: An imaging control device 2 comprises: an acquisition part for acquiring first imaging support information that is first information for changing a position of a subject or an imaging apparatus for taking a medical image of the subject; a change part for changing the first imaging support information to second imaging support information Ib that is second information for changing the position of the subject or the imaging apparatus; and an output part for outputting the second imaging support information Ib.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] The present invention relates to a photography support device, a program, a photography support method, and a photography support system. [Background technology]

[0002] When a patient's positioning is misaligned during radiography, the patient is corrected to the correct position. When correcting the positioning, technical terms such as internal rotation, external rotation, adduction, and abduction are generally used to indicate the direction of the positioning correction. However, even for experts such as radiologists, when they see or hear technical terms such as internal rotation, external rotation, adduction, and abduction, it can be difficult to instantly understand the terms.

[0003] Conventionally, techniques for converting terms into other expressions have been disclosed. Patent Document 1 discloses a text processing device as shown below. The text processing device converts words extracted from a text using a dictionary accessed according to environmental information, and displays the converted words alongside the words in the text. Patent Document 2 describes the following text processing program. The text processing program selects words included in a technical term list as replacement target words from among words obtained by dividing text data. Next, the text processing program replaces each of the selected replacement target words with a word included in a general-purpose word list. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-36333 A [Patent Document 2] JP 2005-338970 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the conventional technology, the converted words, etc. may not be expressions, etc. that the user is accustomed to. In addition, there has been a problem that there has been no technology in the field of radiography that can convert technical terms into expressions preferred by the user.

[0006] Therefore, an object of the present invention is to provide a photography support device, a program, a photography support method, and a photography support system that allow a user to select information that supports the direction in which positioning is corrected. [Means for solving the problem]

[0007] The photography support device according to the present invention comprises: an acquisition unit that acquires first imaging support information, which is first information for changing a position of a subject or an imaging device that captures a medical image of the subject; A change unit that changes the first photographing support information to second photographing support information, which is second information for changing a position of the subject or the photographing device; an output unit that outputs the second photographing support information; Equipped with.

[0008] The program according to the present invention comprises: Computer, an acquisition unit that acquires first imaging support information, which is first information for changing a position of a subject or an imaging device that captures a medical image of the subject; a change unit that changes the first photographing support information to second photographing support information that is second information for changing a position of the subject or the photographing device; an output unit that outputs the second photographing support information; Function as.

[0009] A photography support method according to the present invention comprises: an acquisition step of acquiring first imaging support information, which is first information for changing a position of a subject or an imaging device that captures a medical image of the subject; A change step of changing the first photographing support information to second photographing support information which is second information for changing a position of the subject or the photographing device; an output step of outputting the second photographing support information; has.

[0010] The photography support system according to the present invention comprises: An imaging device that captures a subject or a medical image of the subject; The photography support device is provided. Effect of the Invention

[0011] According to the present invention, since the first photographing support information can be changed to the second photographing support information, the user can correct the positioning using information that is easy to understand. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram showing a schematic configuration of a photography support system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram of an imaging control device according to the present embodiment. [Diagram 3] 5 is a diagram showing an example of the configuration of a candidate table stored in a storage unit according to the embodiment; FIG. [Figure 4A] FIG. 1 is a diagram for explaining the movements of external rotation and internal rotation. [Figure 4B] FIG. 1 is a diagram for explaining abduction and adduction movements. [Figure 5A] FIG. 13 is a diagram showing an example of the configuration of a shooting support information setting screen according to the embodiment. [Figure 5B] 13 is a diagram showing an example of a state in which a selection section is expanded on the shooting support information setting screen according to the embodiment. FIG. [Figure 6] 5 is a diagram showing an example of the configuration of a list stored in a storage unit according to the embodiment; FIG. [Figure 7] FIG. 13 is a diagram showing an example of a conventional analysis result of positioning deviation in a radiological image of the “lateral surface of the knee (right knee) joint.” [Figure 8A] FIG. 2 is a diagram illustrating an example of input data used when training a machine learning model according to the present embodiment. [Figure 8B]FIG. 1 is a diagram showing an example of correct answer data used when training a machine learning model according to an embodiment of the present invention. [Figure 9] FIG. 13 is a diagram showing an example of other correct answer data used when training the machine learning model according to the present embodiment. [Figure 10] 5 is a flowchart showing an example of the operation of the imaging control device when capturing a radiation image of a subject according to the present embodiment. [Figure 11] FIG. 4 is a diagram showing an example of the configuration of a shooting screen displayed on a display unit according to the embodiment. [Figure 12] 10 is a flowchart showing an example of an operation of the shooting control device during re-shooting determination processing according to the present embodiment. [Figure 13A] FIG. 11 is a diagram showing an example of three-dimensional information of a radiological image estimated by the machine learning model according to the present embodiment. [Figure 13B] FIG. 11 is a diagram showing an example of three-dimensional information of a radiological image estimated by the machine learning model according to the present embodiment. [Figure 14] 5 is a flowchart showing an example of a first determination process according to the embodiment. [Figure 15] 10 is a flowchart showing an example of a second determination process according to the embodiment. [Figure 16] 13A to 13C are diagrams showing an example of second photographing support information and three-dimensional structure information displayed on a photographing screen according to the present embodiment. [Figure 17] 11A to 11C are diagrams showing an example of first photographing support information and three-dimensional structure information displayed on a photographing screen according to the present embodiment. [Figure 18] 13A to 13C are diagrams showing an example of second photographing support information and three-dimensional structure information in the case where deviation in positioning in one direction displayed on the photographing screen according to the present embodiment is corrected. [Figure 19] 13A to 13C are diagrams showing an example of second photographing support information and three-dimensional structure information for changing the position of the photographing device side displayed on the photographing screen according to the present embodiment. [Figure 20] FIG. 13 is a diagram showing a schematic configuration of a photography support system according to another embodiment 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0014] [Example of configuration of the imaging support system 10A] FIG. 1 is a diagram showing a schematic configuration of a photography support system 10A according to this embodiment. The imaging support system 10A includes a radiographic imaging device 1, an imaging control device 2, a radiation generating device 3, an image management device 4, and an HIS / RIS 5. In the following, the radiographic imaging device may be referred to as an imaging device 1, and the radiation generating device may be referred to as a generating device 3. HIS is an abbreviation for Hospital Information System, which is a hospital information system. RIS is an abbreviation for Radiology Information System, which is a radiology department information system. A radiographic image is an example of a medical image. The imaging control device 2 is an example of an imaging support device.

[0015] The photographing device 1, the photographing control device 2, the generating device 3, the image management device 4, and the HIS / RIS 5 are connected to each other so as to be able to communicate with each other via a network N. Examples of the network N include a LAN, a WAN, and the Internet. LAN is an abbreviation for Local Area Network. WAN is an abbreviation for Wide Area Network. The communication method of the network N may be wired communication or wireless communication. Examples of wireless communication include Wi-Fi (registered trademark).

[0016] The generating device 3 includes a generator 31 , a switch 32 and a radiation source 33 . The generator 31 applies a voltage according to preset imaging conditions to a radiation source 33 including, for example, a tube, based on the operation of the switch 32. The generator 31 may have an operation unit that accepts input of irradiation conditions and the like.

[0017] When a voltage is applied from the generator 31 to the radiation source 33, the radiation source 33 generates radiation R with a dose corresponding to the applied voltage. The radiation R is, for example, an X-ray.

[0018] The generating device 3 generates radiation R in a manner corresponding to the type of radiation image, for example, a still image or a dynamic image. Specifically, in the case of a still image, the generating device 3 irradiates radiation R only once per pressing of the switch 32. In the case of a dynamic image, the generating device 3 irradiates pulsed radiation R repeatedly multiple times per predetermined time per pressing of the switch 32, for example.

[0019] The imaging device 1 generates digital image data showing the imaging region of the subject S. For example, a portable FPD is used as the imaging device 1. FPD is an abbreviation for Flat Panel Detector. The imaging device 1 may be configured integrally with the generating device 3.

[0020] Although not shown, the imaging device 1 includes, for example, an imaging element, a sensor board, a scanning unit, a readout unit, a control unit, and a communication unit. The imaging element generates an electric charge according to the dose when exposed to radiation R. The sensor board has switch elements arranged two-dimensionally (in a matrix) and stores and releases electric charge. The scanning unit switches each switch element on / off. The readout unit reads out the amount of electric charge released from each pixel as a signal value. The control unit generates image data of the radiation image from the multiple signal values ​​read out by the readout unit. The image data includes still image data or dynamic image data. The communication unit transmits the generated image data and various signals to other devices such as the imaging control device 2, and receives various information and various signals from other devices.

[0021] The imaging control device 2 sets imaging conditions for the imaging device 1 and the generator 3, and controls the reading operation of the radiation image captured by the imaging device 1. The imaging control device 2 is also called a console, and is configured by, for example, a personal computer. The imaging control device 2 determines whether reimaging is necessary depending on the positioning deviation of the radiation image obtained by imaging. Here, the positioning means, for example, the way the patient is positioned during imaging. When the imaging control device 2 determines that reimaging is necessary, it displays imaging support information I and three-dimensional structure information T on the screen of the display unit 22 described later. The imaging support information I assists in correcting the positioning by presenting the direction of correction of the positioning by words or sentences. Note that the imaging support information I includes first imaging support information Ia and second imaging support information Ib, as described later. The three-dimensional structure information T presents grounds information for changing the positioning by indicating the three-dimensional positional relationship of the deviation area where the deviation of the radiation image occurs.

[0022] The imaging conditions include, for example, patient conditions related to the subject S, irradiation conditions related to the irradiation of radiation R, and image reading conditions related to the image reading of the imaging device 1. The patient conditions include, for example, the imaging part, imaging direction, physique, etc. The irradiation conditions include, for example, tube voltage (kV), tube current (mA), irradiation time (ms), current-time product (mAs value), etc. The image reading conditions include, for example, pixel size, image size, frame rate, etc. The imaging control device 2 may automatically set the imaging conditions based on order information acquired from the HIS / RIS 5, etc. Alternatively, the imaging control device 2 may allow a user, such as a radiologist, to manually set the imaging conditions by operating an operation unit 21, which will be described later.

[0023] The image management device 4 manages the image data generated by the imaging device 1. The image management device 4 is an image archiving and communication system, an image diagnosis workstation, etc. The image archiving and communication system is sometimes called PACS. PACS is an abbreviation for Picture Archiving and Communication System.

[0024] The HIS / RIS 5 receives order information regarding radiography of a patient from, for example, a doctor, and transmits the received order information to the radiography control device 2. The order information includes various information such as the patient's ID, the body part to be radiographed, the radiography direction, and the physique.

[0025] [Example of block diagram of imaging control device 2] FIG. 2 is a block diagram of the imaging control device 2. The imaging control device 2 includes a control unit 20, an operation unit 21, a display unit 22, a storage unit 23, and a communication unit 24. The control unit 20, the operation unit 21, the display unit 22, the storage unit 23, and the communication unit 24 are connected to each other so as to be able to communicate with each other via a bus 25, for example.

[0026] The control unit 20 includes a processor such as a CPU and a semiconductor memory. CPU is an abbreviation for Central Processing Unit. The processor executes programs stored in a semiconductor memory such as a RAM (which may be the storage unit 23) to realize various processes including shooting control and re-shooting determination. The control unit 20 may include electronic circuits such as ASIC and FPGA. ASIC is an abbreviation for Application Specific Integrated Circuit. FPGA is an abbreviation for Field Programmable Gate Array.

[0027] The control unit 20 functions as an acquisition unit (acquisition step), a change unit (change step), and an output unit (output step). The control unit 20 also functions as a setting unit and a determination unit. The functions of the acquisition unit, change unit, output unit, setting unit, and determination unit are realized by the processor of the control unit 20 executing a program stored in the storage unit 23 or the like.

[0028] The acquisition unit acquires first image capture support information Ia, which is first information for changing the position of the subject S or the image capture device 1. The first image capture support information Ia is information for supporting re-imaging of a radiological image (first re-imaging support information). The first image capture support information Ia is composed of, for example, words or sentences including technical terms. Specifically, the words or sentences included in the first image capture support information Ia are at least one of adduction, abduction, internal rotation, and external rotation. The first image capture support information Ia may be set in advance by initial settings, or may be set by an input operation on a setting screen 70 described later. The first image capture support information Ia includes information for changing the position of at least one of the radiation source 33 and the image capture device 1, in addition to information for correcting the positioning of the patient.

[0029] The setting unit sets a replacement word or sentence from among a plurality of replacement candidates corresponding to the word or sentence before replacement included in the first photographing support information. The replacement word or sentence, which is the second photographing support information Ib described later, may be set, for example, by an input operation on a setting screen described later. The change unit changes the first photographing support information Ia to second photographing support information Ib, which is second information for changing the position of the subject S or the photographing device 1. The change unit changes the first photographing support information Ia to the second photographing support information Ib based on the replaced words or sentences set by the setting unit. The second photographing support information Ib is information for supporting re-photographing of a radiological image (second re-photographing support information) and is information obtained by changing the expression of the first photographing support information Ia. The second photographing support information Ib does not include technical terms and is composed of words or sentences that are easy for the user to understand. The second photographing support information Ib also includes information for changing the position of at least one of the radiation source 33 and the photographing device 1, in addition to information for correcting the positioning of the patient.

[0030] The output unit outputs the first shooting support information Ia or the second shooting support information Ib. Specifically, when the first shooting support information Ia is set by the user, the output unit outputs the first shooting support information Ia to the display unit 22. When the second shooting support information Ib is set by the user, the output unit outputs the second shooting support information Ib to the display unit 22.

[0031] The determination unit determines a deviation in a predetermined area of ​​a radiographic image obtained by imaging with the imaging device 1. The determination unit may include a first determination unit that determines a first deviation in the predetermined area of ​​the radiographic image, and a second determination unit that determines a second deviation in the predetermined area of ​​the radiographic image. The first deviation and the second deviation correspond to each of the correction directions of the positioning. The derivation unit derives the first photographing support information Ia or the second photographing support information Ib based on the determination of the deviation made by the determination unit.

[0032] The operation unit 21 receives instructions according to various input operations from the user, converts the received instructions into operation signals, and outputs the operation signals to the control unit 20. The operation unit 21 includes, for example, a mouse, a keyboard, a switch, a button, and the like. The operation unit 21 may be, for example, a touch panel integrally combined with a display. The operation unit 21 may be, for example, a user interface that receives voice input from a microphone or the like. Specifically, the operation unit 21 receives a change instruction or the like for changing the assist information of the positioning correction direction from the first photographing support information to the second photographing support information.

[0033] The display unit 22 displays a radiographic image based on image data received from the imaging device 1, a GUI for receiving various input operations from the user, and the like. GUI is an abbreviation for Graphical User Interface. The display unit 22 is, for example, a display such as a liquid crystal display or an organic EL display. EL is an abbreviation for Electro Luminescence. Specifically, the display unit 22 displays a radiographic image obtained by imaging with the imaging device 1, and also displays imaging support information I and three-dimensional structure information T according to the result of the re-imaging determination process.

[0034] The storage unit 23 stores, for example, a system program, an application program, and various data. The storage unit 23 includes any storage module, for example, an HDD, an SSD, a ROM, and a RAM. HDD is an abbreviation for Hard Disk Drive. SSD is an abbreviation for Solid State Drive. ROM is an abbreviation for Read Only Memory. Specifically, the storage unit 23 stores a shooting support information candidate table 23a, a shooting support information output table 23b, and a machine learning model (trained model) 23c. The machine learning model 23c and the like may be stored in an external storage device or the like. Details of the shooting support information candidate table 23a, the shooting support information output table 23b, and the machine learning model (trained model) 23c will be described later.

[0035] The communication unit 24 includes, for example, a communication module including a NIC, a receiver, and a transmitter. NIC is an abbreviation for Network Interface Card. The communication unit 24 communicates various data such as image data between the photographing device 1 and the image management device 4 via the network N.

[0036] The imaging control device 2 may be configured not to include the operation unit 21 and the display unit 22. In this case, the imaging control device 2 may receive a control signal from an operation unit provided in an external device connected via the communication unit 24. The imaging control device 2 may also output an image signal to a display unit provided in the external device to display a radiation image or the like. The external device may be an image management device 4 or the like, or may be another device.

[0037] [Example of configuration of shooting support information candidate table 23a] Next, there will be described an example of the configuration of the shooting support information candidate table 23a stored in the storage unit 23. Hereinafter, the shooting support information candidate table 23a may be referred to as the candidate table 23a.

[0038] FIG. 3 shows an example of the configuration of the candidate table 23a. In the candidate table 23a, a body part to be photographed, a direction to be photographed, a direction to be corrected when a positioning deviation is corrected, and a group of candidates of the photographing support information I for presenting a specific direction to be corrected for the positioning are stored in association with each other. Examples of the body part to be photographed and the direction to be photographed include a "side surface of the knee joint," a "side surface of the leg," and a "side surface of the elbow."

[0039] Examples of the types of correction directions when correcting positioning deviation include "external rotation", "internal rotation", "abduction", and "adduction". FIG. 4A is a diagram for explaining the movements of external rotation and internal rotation. FIG. 4B is a diagram for explaining the movements of abduction and adduction. External rotation is a movement in which the femur is rotated outward with respect to the long axis of the bone as a reference, as shown on the left side of FIG. 4A. Internal rotation is a movement in which the femur is rotated inward with respect to the long axis of the bone as a reference, as shown on the right side of FIG. 4A. Abduction is a movement in which the femur is moved away from the central axis of the body as shown in FIG. 4B. Adduction is a movement in which the femur is moved closer to the central axis of the body as shown in FIG. 4B.

[0040] The candidate group of the photographing support information I includes first photographing support information Ia including a word or sentence before replacement, and second photographing support information Ib including a word or sentence after replacement corresponding to the first photographing support information Ia. Specifically, when the photographing part and photographing direction are "lateral side of knee joint" and the positioning correction direction is "external rotation", any sentence can be selected from the four candidate group of the photographing support information I. An example of a candidate of the first photographing support information Ia is "External rotation of the knee". An example of a candidate group of the second photographing support information Ib is "Bow your knee", "Bow your thigh (thigh)", and "Spread your knees wide apart".

[0041] When the imaging part and imaging direction are "lateral side of knee joint" and the positioning correction direction is "internal rotation", any sentence can be selected from the four candidate groups of imaging support information I. An example of a candidate for the first imaging support information Ia is "Please internally rotate your knee". Candidate groups for the second imaging support information Ib are "Please raise your knee", "Please raise your thigh (thigh)", and "Please close your knee with your legs inward".

[0042] The candidate table 23a may be configured in a plurality of tables. For example, a user dictionary in which assist information of the positioning correction direction frequently used by the user is registered may be stored as a table in the storage unit 23. For example, a table may be created for each region, such as a Kansai area dictionary in which assist information used in the Kansai area is registered, a Kanto area dictionary in which assist information used in the Kanto area is registered, etc. Also, a table may be created for each hospital or facility, such as a university hospital dictionary in which assist information used in each university hospital is registered. The plurality of candidate tables 23a constitute an example of the first replacement candidate and the second replacement candidate. For example, a post-replacement sentence corresponding to a sentence before replacement can be set from the plurality of candidate tables 23a, and the first photographing support information can be changed to the second photographing support information based on the set sentence.

[0043] [Example of the configuration of the shooting support information setting screen 70] Next, a shooting support information setting screen 70 for setting any of the first shooting support information Ia and the second shooting support information Ib from a candidate group of a plurality of pieces of shooting support information I will be described.

[0044] 5A shows an example of the configuration of the shooting support information setting screen 70. Note that hereinafter, the shooting support information setting screen 70 may be referred to as the setting screen 70.

[0045] The control unit 20 refers to the candidate table 23a in the storage unit 23 and causes the display unit 22 to display the setting screen 70. The control unit 20 sets the imaging support information I selected from the plurality of replacement candidates on the setting screen 70 as basis information that serves as a basis for a correction direction when correcting a positioning deviation. Note that the imaging support information on the setting screen 70 may be set at any timing, such as before capturing a radiological image.

[0046] The setting screen 70 is provided with a selection section 71 for selecting the imaging site for which the method of expressing the positioning correction direction is to be changed and the correction direction. Fig. 5A shows a case where, for example, "Knee joint lateral surface: internal rotation / external rotation direction" is selected in the selection section 71. The selection section 71 is configured, for example, in a pull-down format. The selection section 71 is provided with, for example, a button 72 for opening the pull-down.

[0047] 5B shows an example of a state in which selection section 71 is expanded on setting screen 70. When a user presses button 72, pull-down list 73 is expanded and displayed. In addition to "Knee joint lateral surface: internal rotation / external rotation direction," pull-down list 73 displays multiple selection items such as "Knee joint lateral surface: adduction / abduction direction." The user can select any item from pull-down list 73 that indicates the imaging area and correction direction.

[0048] A box 74 for selecting a specific replacement candidate from among a group of multiple candidates for shooting support information I is displayed in the display area below the selection unit 71. For example, when "Knee joint lateral surface: internal rotation / external rotation direction" is selected in the selection unit 71, multiple replacement candidates corresponding to the shooting support information I of the correction direction of internal rotation and external rotation are displayed in the box 74. As candidates for the shooting support information I of the correction direction of internal rotation, "Please internally rotate your knee", "Please raise your knee", "Please raise your thigh (thigh)", and "Please close your knee with your legs inward". As replacement candidates for the expression method of the correction direction of external rotation, "Please externally rotate your knee", "Please lower your knee", "Please lower your thigh (thigh)", and "Please open your knee with your legs apart".

[0049] When a predetermined piece of photographing support information I is selected by the user on the setting screen 70, the control unit 20 associates the selected piece of photographing support information I with the photographing body part and stores it in the storage unit 23. In this embodiment, the selected piece of photographing support information I and the photographing body part are associated with each other and stored in the photographing support information output table 23b. Note that, in the initial setting of the photographing support information I, that is, at the stage before selection on the setting screen 70, the first photographing support information Ia may be set in advance as a default.

[0050] An input section that allows the user to input new candidates for shooting support information I may be provided on the setting screen 70. That is, new first shooting support information Ia and second shooting support information Ib that are not displayed in the box 74 on the setting screen 70 may be registered in a group of assist information candidates. Candidates for shooting support information I inputted through the input section on the setting screen 70 are stored in the candidate table 23a of the storage section 23 in association with each shooting part. When new shooting support information I is selected on the setting screen 70, the control section 20 sets the selected shooting support information I as assist information for the positioning correction direction.

[0051] [Example of configuration of shooting support information output table 23b] Next, a description will be given of an example of the configuration of the shooting support information output table 23b stored in the storage unit 23. Hereinafter, the shooting support information output table 23b may be referred to as the output table 23b.

[0052] FIG. 6 shows an example of the configuration of the output table 23b. In the output table 23b, the imaging part, the positioning correction direction, and imaging support information I set as the assist information of the positioning correction direction are stored in association with each other. The imaging support information I may be set to any assist information by default. In this case, for example, the first imaging support information Ia including a technical term or a sentence may be set as the default setting.

[0053] For example, when the imaging part and imaging direction are "lateral side of knee joint," the positioning correction directions include four directions: external rotation, internal rotation, abduction, and adduction. In this embodiment, the assist information for the correction direction of external rotation is set as "lower your knee" in the second support information Ib. The assist information for the correction direction of internal rotation is set as "raise your knee" in the second support information Ib. The assist information for the correction direction of abduction is set as "abduct your knee" in the first support information Ia. The assist information for the correction direction of adduction is set as "adduct your knee" in the first support information Ia.

[0054] 6 shows an example of a part of the imaging region. As for the other imaging regions, imaging support information I is set in association with each positioning correction direction, similar to "knee lateral surface". When imaging support information I for a positioning correction direction of a specific imaging region is changed on the setting screen 70, imaging support information I for the corresponding portion of the output table 23b is also changed.

[0055] [About machine learning] Fig. 7 shows an example of a conventional analysis result of positioning deviation in a radiological image Ga of a "side of a right knee joint". In Fig. 7, the horizontal direction (left-right direction) of the radiological image Ga is the X direction, and the vertical direction (up-down direction) of the radiological image Ga is the Y direction. The direction perpendicular to the X direction and Y direction of the radiological image Ga and the direction of irradiation of radiation R is the Z direction. The orthogonal coordinate system including the above-mentioned X direction, Y direction, and Z direction is also applied to the radiological images and the imaging screen 80 that displays the radiological images described below.

[0056] When there is a positioning deviation in the radiographic image Ga of the "side of the right knee joint", a deviation occurs in the medial condyle and the lateral condyle, which are located in the Z direction of the epiphysis, which is a structure inside the subject. In this case, since the radiographic image Ga is constructed in two dimensions, the line indicating the medial condyle and the line indicating the lateral condyle of the "femoral condyle" are displayed on the same plane. Therefore, as shown in FIG. 7, the medial condyle and the lateral condyle are displayed by two lines in the "femoral condyle" of the radiographic image Ga. These two lines are called the first epiphysis Tx and the second epiphysis Ty. In the conventional image analysis, it was not possible to specify which of the first epiphysis Tx and the second epiphysis Ty is the line indicating the medial condyle side located on the near side and which is the line indicating the lateral condyle side located on the far side. In other words, it was not possible to specify the three-dimensional positional relationship in the Z direction of the two first epiphysis Tx and the second epiphysis Ty.

[0057] In this embodiment, the machine learning model 23c is trained by machine learning using machine learning data by a learning device. The learning device is, for example, configured by a computer and has a processor such as a CPU and a GPU. GPU is an abbreviation for Graphics Processing Unit. The processor realizes a predetermined machine learning function by executing a program stored in a memory such as a RAM. The learning device may be a client device or a server device.

[0058] The machine learning model 23c outputs, as estimated data, each of the lines on the medial condyle side and the lateral condyle side of the "femoral condyle" in the radiographic image Ga shown in Fig. 7. The machine learning model 23c may be, for example, a regression model such as polynomial regression, multiple regression, support vector regression, or random forest regression. The machine learning model 23c may also be another model such as a neural network.

[0059] Fig. 8A shows an example of input data Gb used when training the machine learning model 23c. Fig. 8B shows an example of answer data Gc used when training the machine learning model 23c.

[0060] The machine learning data includes input data Gb input to the machine learning model 23c and answer data Gc output from the machine learning model 23c. For example, the input data Gb is radiation image data of the "lateral side of the knee joint" when the outer side of the patient's right knee is photographed in a state where the outer side is in contact with the imaging device 1, as shown in FIG. 8A. The input data Gb has a positioning deviation in, for example, the "femoral condyle." The input data Gb may be a past radiation image of the patient obtained by actual imaging.

[0061] The correct answer data Gc is radiation image data of the "lateral side of the knee joint" when the outside of the patient's right knee is photographed in contact with the photographing device 1 as shown in FIG. 8B. The correct answer data Gc has information T1 of the medial condyle side line indicating the medial condyle region and information T2 of the lateral condyle side line indicating the lateral condyle region, which are correct for the input data Gb. Here, the medial condyle side line is the boundary between the medial condyle side of the femoral condyle and the knee soft tissue. Also, the lateral condyle side line is the boundary between the lateral condyle side of the femoral condyle and the knee soft tissue. Hereinafter, the information T1 of the medial condyle side line is referred to as the medial condyle side line information T1, and the information T2 of the lateral condyle side line is referred to as the lateral condyle side line information T2. ​​The correct answer data Gc may be created by a user such as a radiologist, for example. The user may specify the medial condyle side line information T1 and the lateral condyle side line information T2 from the radiation image and tag the line information thereto. This allows the attenuated correct answer data Gc to be created. The medial condyle side line information T1 and the lateral condyle side line information T2 according to this embodiment correspond to the three-dimensional structure information T.

[0062] The learning device performs machine learning using a data set including the above-mentioned input data Gb and correct answer data Gc, and creates a trained machine learning model 23c. When the input data Gb of the "right knee joint side" is input, the machine learning model 23c outputs the medial condyle side line information T1 and the lateral condyle side line information T2, which are correct answers, if there is a positioning deviation in the "femoral condyle". In other words, the medial condyle and the lateral condyle of the "femoral condyle", which is the epiphysis, are distinguished into the medial condyle side line information T1 located on the near side and the lateral condyle side line information T2 located on the far side. The trained machine learning model 23c is stored in, for example, the storage unit 23 of the imaging control device 2. The imaging control device 2 can identify the type of positioning deviation based on the medial condyle side line information T1 and the lateral condyle side line information T2 output from the machine learning model 23c. In this case, the imaging control device 2 can identify whether the "femoral condyle" is internally rotated or externally rotated as the type of positioning deviation.

[0063] Although the positional relationship in the Z direction between the medial condyle and the medial condyle of the femoral condyle is learned using the medial condyle side line information T1 and the like actually specified by the user, the learning method is not limited to this. For example, as another learning method, the coordinate points of the medial condyle and the lateral condyle of the femoral condyle may be extracted, and the positional relationship in the Z axis direction between the medial condyle and the medial condyle may be estimated by, for example, regressing the extracted consecutive coordinate points.

[0064] Next, a case will be described in which the "femoral condyle" is determined to be inverted or abducted as a type of positioning deviation. In this case, the machine learning model 23c is trained by machine learning using the correct answer data Gd different from the correct answer data Gc shown in FIG.

[0065] Fig. 9 shows an example of another correct answer data Gd used when training the machine learning model 23c. Note that, since the input data Gb can use the radiation image shown in Fig. 8A, a detailed description thereof will be omitted.

[0066] The machine learning data includes input data Gb input to the machine learning model 23c and correct answer data Gd indicating the correct answer of the output of the machine learning model 23c. As shown in FIG. 9, the correct answer data Gd includes information C1 indicating the femoral condyle center and information C2 indicating the crus condyle center, which are correct answers for the input data Gb. Hereinafter, the information C1 indicating the femoral condyle center is referred to as femoral condyle center information C1, and the information C2 indicating the crus condyle center is referred to as crus condyle center information C2. The correct answer data Gd also includes joint information for identifying whether the radiographic image of the input data Gb is a right knee joint or a left knee joint. The correct answer data Gd may be created by a user such as a radiologist. For example, the coordinates of the femoral condyle center information C1 and the coordinates of the crus condyle center information C2, which are correct answers for the "femoral condyle", are determined by the user by visual inspection or the like. Next, two heat maps are created according to the accuracy of the determined coordinates of the femoral condyle center information C1 and the crural condyle center information C2. The created heat maps are used as the correct answer data Gd.

[0067] When the input data Gb of the "side of the knee joint" is input, the machine learning model 23c estimates the femoral condyle center information C1, the crural condyle center information C2, and joint information indicating whether the knee joint is left or right, which are correct answers. The trained machine learning model 23c is stored, for example, in the memory unit 23 of the imaging control device 2. The imaging control device 2 identifies the type of positioning deviation based on the femoral condyle center information C1, etc. output from the machine learning model 23c. In this case, the imaging control device 2 can identify whether the "femoral condyle" is adduced or abducted as the type of positioning deviation.

[0068] Although the femoral condyle center information C1 of the femoral condyle and the like are learned using a heat map, other learning methods may be used. As another learning method, learning may be performed using the center coordinates of the femoral condyle themselves. In addition, although the knee joint is specified by choosing between the right knee and the left knee, the knee joint may be specified using other information such as the positional relationship between the femur and the patella. Moreover, all of the above-mentioned medial condyle side line information T1, femoral condyle center information C1, etc. may be estimated using one machine learning model 23c. Moreover, a plurality of machine learning models 23c may be used. In this case, the medial condyle side line information T1, etc. may be estimated using one machine learning model 23c, and the femoral condyle center information C1, etc. may be estimated using another machine learning model 23c.

[0069] In the above example, the 3D structure of the femoral condyle in the "side of the right knee joint" when the outside of the patient's right knee is photographed in a state where it is in contact with the imaging device 1 is learned, but the present invention is not limited to this. For example, the 3D structure of the femoral condyle in the "side of the right knee joint" may be learned using a radiographic image of the "side of the right knee joint" when the inside of the patient's right knee is photographed in a state where it is in contact with the imaging device 1. In this case, the medial condyle side line information T1 is located at the back side in the Z direction, and the lateral condyle side line information T2 is located at the front side in the Z direction. In addition, the imaging site to be the subject of machine learning may be other than the "side of the right knee joint". For example, the imaging site to be the subject of machine learning may be the side of the left knee joint, or may be another site such as an ankle joint or an elbow joint.

[0070] [Example of operation of the imaging control device 2] Next, a flow of operations for capturing a radiation image of the subject S will be described. 10 is a flow chart showing an example of the operation of the imaging control device 2 when capturing a radiographic image of the subject S. In the following, a case where the imaging part and imaging direction of the radiographic image are to be captured on the "lateral surface of the knee (right knee) joint" will be described. Also, it is assumed that the first imaging support information Ia or the second imaging support information Ib is set by the user on the above-mentioned setting screen 70 or the like as assist information for the positioning correction direction.

[0071] The communication unit 24 of the imaging control device 2 receives the order information transmitted from the HIS / RIS 5 or the like. For example, the user selects predetermined order information from the examination list displayed on the screen of the display unit 22 of the imaging control device 2. The control unit 20 acquires the order information selected by the user (step S10).

[0072] When the control unit 20 acquires predetermined order information, it causes the display unit 22 to display the photographing screen 80 (step S11).

[0073] Fig. 11 shows an example of the configuration of the shooting screen 80 displayed on the display unit 22 of the shooting control device 2. In Fig. 11, the horizontal direction (left-right direction) of the shooting screen 80 is defined as the X direction, and the vertical direction (up-down direction) of the shooting screen 80 is defined as the Y direction. The direction perpendicular to the X direction and Y direction of the shooting screen 80 and the irradiation direction of the radiation R is defined as the Z direction. The shooting screen 80 and a screen for displaying a radiation image G and the like described below also use the orthogonal coordinate system including the X direction, Y direction, and Z direction described above.

[0074] The imaging screen 80 is provided with an imaging selection section 81, a condition setting section 82, an image display area 83, a patient information display area 84, and an examination end button 85. The imaging selection section 81 displays, for example, order information selected in the examination list. The order information includes, for example, imaging details such as the imaging part and imaging direction, and a thumbnail image showing the captured radiation image. The condition setting section 82 is provided with, for example, a button for setting imaging conditions for the radiation image, a button for adjusting the image of the captured radiation image, and the like. The image display area 83 displays a radiation image captured by the imaging device 1 based on the set imaging conditions, etc. In FIG. 11, since the radiation image has not yet been captured, no radiation image is displayed in the image display area 83.

[0075] When predetermined order information is selected by the photography selection unit 81 or the like, the control unit 20 sets photography conditions for each of the photography device 1 and the generation device 3 (step S12). The photography conditions include image reading conditions to be set for the photography device 1 and irradiation conditions to be set for the generation device 3. For example, the control unit 20 sets image reading conditions for the photography device 1 based on the body part to be photographed, the photography direction, etc. of the selected order information. The control unit 20 also sets irradiation conditions for the generation device 3 based on the body part to be photographed, the photography direction, etc. of the selected order information.

[0076] The photographing conditions may be manually set by the user. Specifically, the control unit 20 may set the image reading conditions received by the user's input operation on the condition setting unit 82 to the photographing device 1. The control unit 20 may set the radiation irradiation conditions received by the user's input operation on the operation panel of the generator 3 to the generator 3.

[0077] Subsequently, when the user turns on the switch 32, the control unit 20 controls the imaging device 1, the generator 3, etc. to capture a radiographic image of the subject S (step S13). The generator 3 irradiates radiation R to the imaging region of the subject S. The imaging device 1 detects the radiation R that has passed through the subject S from the generator 3, and generates image data showing the imaging region based on the detected radiation R. The imaging device 1 transmits the generated image data to the imaging control device 2. The control unit 20 acquires a radiographic image based on the image data transmitted from the imaging device 1 (step S13).

[0078] When step S13 is completed, the process branches to steps S14 and S15. In this embodiment, an example in which the process of step S14 and the process of step S15 are performed in parallel will be described, but the present invention is not limited to this. For example, the process of step S14 and the process of step S15 may be performed in series in order. In this case, step S15 may be the first process, and step S14 may be combined with step S16, which will be described later.

[0079] First, the process of step S14 will be described. The control unit 20 displays the acquired radiographic image in the image display area 83 of the imaging screen 80 (step S14). In this embodiment, a radiographic image of "lateral side of right knee joint" is displayed in the image display area 83 as the imaging part and imaging direction. A thumbnail image showing the radiographic image that has been captured is displayed in the order information 81a of the imaging selection unit 81. When step S14 is completed, the process proceeds to step S16.

[0080] Next, the process of step S15 branched from step S13 will be described. The control unit 20 executes a re-photographing determination process for obtaining information for determining whether or not re-photographing is necessary, using the obtained radiographic image. The control unit 20 proceeds to a subroutine shown in FIG.

[0081] Fig. 12 is a flowchart showing an example of the operation of the imaging control device 2 during the re-imaging determination process. Fig. 13A and Fig. 13B show an example of three-dimensional structure information T of the femoral condyle of the radiographic image G estimated by the machine learning model 23c.

[0082] The control unit 20 uses the machine learning model 23c to estimate the medial condyle side line information T1 and the lateral condyle side line information T2 of the femoral condyle from the radiographic image G obtained by imaging (step S20). Specifically, the control unit 20 inputs the radiographic image G of the "knee joint side" to the machine learning model 23c. The machine learning model 23c outputs the medial condyle side line information T1 and the lateral condyle side line information T2 of the femoral condyle, which are the correct answers, as estimated data based on the input radiographic image G. In FIG. 13A and the like, the medial condyle side line information T1 is indicated by a thin line, and the lateral condyle side line information T2 is indicated by a thick line. In this way, the control unit 20 acquires the three-dimensional structure information T that is distinguished into the medial condyle side line information T1 located on the near side and the lateral condyle side line information T2 located on the far side.

[0083] Next, the control unit 20 uses the machine learning model 23c to estimate femoral condyle center information C1, crus condyle center information C2, and joint information from the radiographic image G obtained by imaging (step S21). Specifically, the control unit 20 inputs a radiographic image of the "knee joint lateral surface" to the machine learning model 23c. Based on the input radiographic image G, the machine learning model 23c outputs femoral condyle center information C1 and crus condyle center information C2 of the femoral condyle as estimated data. Based on the input radiographic image G, the machine learning model 23c also outputs joint information indicating that the radiographic image G is a right knee joint. In this way, the control unit 20 acquires femoral condyle center information C1, crus condyle center information C2, and joint information. The joint information may be acquired from the examination order information transmitted from the HIS / RIS5.

[0084] In this embodiment, steps S20 and S21 are described separately, but steps S20 and S21 may be combined into one step. Specifically, the machine learning model 23c may output all of the medial condyle side line information T1, the lateral condyle side line information T2, the femoral condyle center information C1, the crus condyle center information C2, and the joint information based on the input radiographic image G. After step S21 is completed, the process proceeds to step S22.

[0085] The control unit 20 judges whether the positioning deviation is internal rotation or external rotation based on the intersection pattern between the lines radially extending from the femoral condyle center information C1 and the medial condyle side line information T1, etc. (Step S22). In this embodiment, the process of judging whether the positioning deviation is internal rotation or external rotation is referred to as a first judgment process.

[0086] The control unit 20 proceeds to a subroutine shown in Fig. 14 and executes the first determination process by functioning as a first determination unit. Fig. 14 is a flowchart showing an example of the first determination process.

[0087] The control unit 20 extends a plurality of lines L radially from the estimated femoral condyle center information C1 (step S30). Specifically, as shown in FIG. 13A, six lines L are extended radially from the femoral condyle center information C1 at equal intervals in the circumferential direction. The line L that does not intersect with either the medial condyle side line information T1 or the lateral condyle side line information T2 is called the first line L1. In FIG. 13A, the first line L1 is shown by a dashed line. The line L that intersects with the medial condyle side line information T1 and the lateral condyle side line information T2 in this order is called the second line L2. In FIG. 13A, the second line L2 is shown by a dashed line. The line L that intersects with the lateral condyle side line information T2 and the medial condyle side line information T1 in this order is called the third line L3. In FIG. 13A, the third line L3 is shown by a two-dot chain line. Note that the first line L1, the second line L2, and the third line L3 may be collectively called the line L.

[0088] The control unit 20 judges whether the order of the multiple lines L is to be viewed clockwise or counterclockwise based on the estimated joint information. For example, the "right knee joint" in the joint information is associated with the counterclockwise direction, and the "left knee joint" in the joint information is associated with the clockwise direction. In this embodiment, since the joint information is the "right knee joint", the order of the multiple lines L is to be viewed counterclockwise. The control unit 20 judges whether the order is the first line L1, the second line L2, and the third line L3 when viewed counterclockwise based on the first line L1 in the center of FIG. 13A (step S31). If the control unit 20 judges that the condition of step S31 is satisfied, the process proceeds to step S32.

[0089] When the order is the first line L1, the second line L2, and the third line L3, the control unit 20 determines that the femoral condyle is internally rotated (step S32). That is, the control unit 20 determines that the femoral condyle should be externally rotated in order to correct the positioning in the correct direction. Note that FIG. 13A shows an example in which the femoral condyle in the radiographic image G is externally rotated, and step S32 does not apply to FIG. 13A.

[0090] On the other hand, if the control unit 20 determines that the condition of step S31 is not satisfied, the process proceeds to step S33. The control unit 20 determines whether the order is the first line L1, the third line L3, and the second line L2 when viewed counterclockwise from the first line L1 in the center of FIG. 13A (step S33). If the control unit 20 determines that the condition of step S33 is satisfied, the process proceeds to step S34.

[0091] When the order is the first line L1, the third line L3, and the second line L2, the control unit 20 determines that the femoral condyle is externally rotated (step S34). That is, the control unit 20 determines that the femoral condyle should be internally rotated in order to correct the positioning to the correct direction. Note that Fig. 13A shows an example in which the femoral condyle in the radiographic image G is externally rotated, and step S34 corresponds to Fig. 13A.

[0092] On the other hand, when the control unit 20 determines that the condition of step S33 is not satisfied, the control unit 20 proceeds to step S35. In this case, the control unit 20 determines that the medial condyle side line information T1 and the lateral condyle side line information T2 of the femoral condyle overlap, and that no deviation of the femoral condyle has occurred (step S35). Note that the determination that no deviation of the femoral condyle has occurred is not limited to the case where the medial condyle side line information T1 and the lateral condyle side line information T2 completely overlap. When the amount of deviation of the overlap between the medial condyle side line information T1 and the lateral condyle side line information T2 is within the allowable range, it may be determined that no deviation of the femoral condyle has occurred. When step S35 ends, the control unit 20 ends the subroutine of the first determination process, and proceeds to step S23 in FIG.

[0093] In the first determination process, the case of the right knee joint has been described, but the type of positioning deviation can be determined in the case of the left knee joint, etc., by the same process. In the case of the left knee joint, the intersections of the multiple lines L radially extending from the femoral condyle center information C1 and the medial condyle side line information T1, etc. are viewed clockwise in the radiographic image G. If the order is the first line L1, the second line L2, and the third line L3, the control unit 20 determines that the femoral condyle is internally rotated. If the order is the first line L1, the third line L3, and the second line L2, the control unit 20 determines that the femoral condyle is externally rotated.

[0094] Next, the control unit 20 judges whether the positioning deviation is adduction or abduction based on the intersection pattern of the line connecting the femoral condyle center information C1 and the femoral condyle center information C2 with the medial condyle side line information T1, etc. (Step S23). In this embodiment, the process of judging whether the positioning deviation is adduction or abduction is called the second judgment process.

[0095] The control unit 20 proceeds to a subroutine shown in Fig. 15 and functions as a second determination unit to execute the second determination process. Fig. 15 is a flowchart showing an example of the second determination process.

[0096] As shown in FIG. 13B, the control unit 20 connects the estimated femoral condyle center information C1 and the tibia condyle center information C2 with a fourth line L4 (step S40).

[0097] When the fourth line L4 is viewed from the femoral condyle center information C1 toward the tibia condyle center information C2, the control unit 20 determines whether the fourth line L4 intersects with the medial condyle side line information T1 and the lateral condyle side line information T2 in that order (step S41). If the control unit 20 determines that the condition of step S41 is satisfied, the process proceeds to step S42.

[0098] When the fourth line L4 intersects with the medial condyle side line information T1 and then with the lateral condyle side line information T2, the control unit 20 determines that the femoral condyle is adducted (step S42). That is, the control unit 20 determines that the femoral condyle should be abducted in order to correct the positioning in the correct direction. Note that FIG. 13B shows an example of the femoral condyle in the radiographic image G, and step S42 does not correspond to FIG. 13B.

[0099] On the other hand, when the control unit 20 determines that the condition of step S41 is not satisfied, the control unit 20 proceeds to step S43. When the fourth line L4 is viewed from the femoral condyle center information C1 toward the tibia condyle center information C2, the control unit 20 determines whether the fourth line L4 intersects with the lateral condyle side line information T2 and the medial condyle side line information T1 in this order (step S43). When the control unit 20 determines that the condition of step S43 is satisfied, the control unit 20 proceeds to step S44.

[0100] When the fourth line L4 intersects with the lateral condyle side line information T2 and then with the medial condyle side line information T1, the control unit 20 determines that the femoral condyle is abducted (step S44). That is, the control unit 20 determines that the femoral condyle should be adducted in order to correct the positioning to the correct direction. Note that FIG. 13B shows an example of the femoral condyle in radiographic image G being abducted, and step S44 corresponds to FIG. 13B.

[0101] On the other hand, when the control unit 20 determines that the condition of step S43 is not satisfied, the control unit 20 proceeds to step S45. In this case, the control unit 20 determines that the medial condyle side line information T1 and the lateral condyle side line information T2 of the femoral condyle overlap, and that no misalignment has occurred (step S45). The determination that no misalignment has occurred also includes the case where the amount of misalignment of the medial condyle side line information T1 and the lateral condyle side line information T2 is within the allowable range. Note that step S45 is a process common to step S35 in FIG. 14, and may be omitted. When step S45 ends, the control unit 20 ends the subroutine of the second determination process, and proceeds to step S24 in FIG.

[0102] In the second determination process, the case where the imaging part is the lateral side of the right knee joint has been described, but the type of positioning deviation can be determined by the same process even in the case of the lateral side of the left knee joint, etc. The specific determination method is the same as in the case of the lateral side of the right knee joint, so a detailed description will be omitted. In addition, whether the femoral condyle is adducted or not is determined using the fourth line L4 connecting the femoral condyle center information C1 and the tibia condyle center information C2 shown in FIG. 13B, but is not limited to this. The following determination method may be used. For example, a triangular virtual area R shown by a broken line in FIG. 13B is assumed between the femoral condyle center information C1 and the tibia condyle center information C2. Next, multiple lines are drawn in the virtual area R in a direction from the femoral condyle center information C1 toward the tibia condyle center information C2. At this time, the number of lines that cross the medial condyle side line information T1 and the lateral condyle side line information T2 in this order is compared with the number of lines that cross the lateral condyle side line information T2 and the medial condyle side line information T1 in this order. Finally, whether the femoral condyle is adducted or abducted may be determined based on which number is larger.

[0103] Next, the control unit 20 derives the first photographing support information Ia or the second photographing support information Ib associated with the positioning correction direction determined based on the three-dimensional structure information T in steps S22 and S23 (step S24). Specifically, when the second photographing support information Ib is set as photographing support information corresponding to the determination result of the positioning correction direction, the control unit 20 derives the second photographing support information Ib from the storage unit 23. For example, when the determination result of the first determination process is external rotation, the control unit 20 refers to the output table 23b to acquire a sentence such as "Please raise your knees." When the determination result of the second determination process is external rotation, the control unit 20 refers to the output table 23b to acquire a sentence such as "Please lower your ankles."

[0104] On the other hand, when the first photographing support information Ia is set as the photographing support information I corresponding to the determination result of the positioning correction direction, the control unit 20 derives the first photographing support information Ia from the storage unit 23. For example, when the determination result of the first determination process is that the knee is externally rotated, the control unit 20 refers to the output table 23b and acquires a sentence such as "Please internally rotate your knee." When the determination result of the second determination process is that the knee is abducted, the control unit 20 refers to the output table 23b and acquires a sentence such as "Please internally adduct your knee."

[0105] If the determination result in steps S22 and S23 is that there is no deviation in positioning, the control unit 20 may obtain instruction information that the positioning is normal. When the re-photographing determination process in step S24 is completed, the control unit 20 ends the subroutine and returns to step S16 shown in FIG.

[0106] The control unit 20 displays the obtained determination result of the re-photographing determination process in the image display area 83 of the display unit 22 (step S16). Specifically, when the control unit 20 derives the second photographing support information Ib, the control unit 20 displays the second photographing support information Ib and three-dimensional structure information T indicating the deviation area on the photographing screen 80.

[0107] FIG. 16 shows an example of the second photographing support information Ib and the three-dimensional structure information T displayed on the photographing screen 80. In the image display area 83 of the imaging screen 80, the three-dimensional structure information T is displayed superimposed on the radiographic image G. Here, if there is a positioning deviation in the radiographic image G of the "lateral side of the right knee joint", a deviation occurs in the medial condyle and the lateral condyle located in the Z direction of the epiphysis of the femoral condyle. In this case, since the radiographic image G is constructed in two dimensions, the line indicating the medial condyle and the line indicating the lateral condyle of the "femoral condyle" are displayed on the same plane. Therefore, in the "femoral condyle" of the radiographic image G, the medial condyle and the lateral condyle are displayed by two lines.

[0108] The three-dimensional structure information T includes medial condyle side line information T1 indicating the medial condyle region and lateral condyle side line information T2 indicating the lateral condyle region in the femoral condyle of the radiographic image G. In the image display area 83 of the photographing screen 80, the medial condyle side line information T1 and lateral condyle side line information T2, which are correct in the femoral condyle, are displayed superimposed on the radiographic image G. The medial condyle side line information T1 and lateral condyle side line information T2 may be displayed in different colors. Specifically, the medial condyle side line information T1 may be displayed in red (thin line in FIG. 16), and the lateral condyle side line information T2 may be displayed in blue (thick line in FIG. 16). In addition, the medial condyle side line information T1 and lateral condyle side line information T2 may be displayed with different line thicknesses, or may be displayed with a solid line and a dashed line. In this case, it is preferable to set in advance a correspondence table or the like showing the correspondence between the "medial condyle side line information T1" and the "lateral condyle side line information T2" and the "color, thickness, line pattern (solid line, broken line)". The correspondence may be a default setting, or may be set by the user as appropriate after shipment. The user can quickly identify the three-dimensional positional relationship between the medial condyle side line information T1 and the lateral condyle side line information T2 by memorizing the correspondence in advance or by checking a correspondence table or the like showing the correspondence. The correspondence table or the like showing the correspondence may be displayed on the shooting screen 80.

[0109] In the image display area 83 of the imaging screen 80, in addition to the radiographic image G obtained by imaging, the second imaging support information Ib based on the three-dimensional structure information T is displayed. The second photographing support information Ib is composed of, for example, words or sentences that do not include technical terms and are easy for the user to understand. Specifically, as shown in Fig. 16, when the positioning correction direction is internal rotation, the sentence "Please lift your knee" is displayed as the second photographing support information Ib in the image display area 83. When the positioning correction direction is adduction, the sentence "Please lift your ankle" is displayed as the second photographing support information Ib in the image display area 83.

[0110] Rank information Ic and deviation amount information Id are displayed above the imaging support information I. The rank information Ic and deviation amount information Id are information for alerting the user that correction of positioning is necessary and presenting detailed correction contents. In this embodiment, the imaging support information I and the like are displayed in an empty space other than the radiation image G in the image display area 83, but the present invention is not limited to this.

[0111] The rank information Ic is information that indicates the degree of the positioning deviation by rank. For example, when there is no positioning deviation and re-imaging is not required, "positioning: A" is displayed as the rank information Ic. When the positioning deviation is within the allowable range and re-imaging is not required, "positioning: B" is displayed as the rank information Ic. When the positioning deviation exceeds the allowable range and re-imaging is required, "positioning: C" is displayed as the rank information Ic. FIG. 16 illustrates an example of the rank information Ic being "positioning: C."

[0112] The deviation amount information Id is information indicating the distance (deviation width) in a predetermined direction between the estimated medial condyle side line information T1 and lateral condyle side line information T2 of the femoral condyle. For example, when the deviation amount D in the X direction in the three-dimensional structure information T between the medial condyle side line information T1 and lateral condyle side line information T2 is "4 mm", "deviation amount: 4.0 mm" is displayed in the image display area 83 as the deviation amount information Id. Note that, although the deviation amount D in the X direction is displayed as the deviation amount information Id in FIG. 16, this is not limiting. For example, the deviation amount D in the Y direction may be displayed, or the deviation amounts in both the X direction and the Y direction may be displayed.

[0113] In step S16, when the control unit 20 derives the first photographing support information Ia in the re-photographing determination process shown in FIG.

[0114] FIG. 17 shows an example of the first photographing support information Ia and the three-dimensional structure information T displayed on the photographing screen 80. In the image display area 83 of the photographing screen 80, the three-dimensional structure information T is displayed superimposed on the radiation image G. The three-dimensional structure information T includes medial condyle side line information T1 indicating the medial condyle region and lateral condyle side line information T2 indicating the lateral condyle region in the femoral condyle of the radiation image G. In the image display area 83 of the photographing screen 80, the medial condyle side line information T1 and lateral condyle side line information T2, which are correct in the femoral condyle, are displayed superimposed on the radiation image G. The medial condyle side line information T1 and lateral condyle side line information T2 may be displayed in different colors. The details of the display method of the three-dimensional structure information T can be applied to the same display method as that of FIG. 16, so a detailed description will be omitted.

[0115] In addition to the radiographic image G obtained by imaging, the first imaging support information Ia based on the three-dimensional structure information T is displayed in the image display area 83 of the imaging screen 80. The rank information Ic and the deviation amount information Id are displayed above the first imaging support information Ia. The rank information Ic and the deviation amount information Id have the same configuration and function as the rank information Ic and the deviation amount information Id described in the second imaging support information Ib above, and therefore detailed description thereof will be omitted.

[0116] The first photographing support information Ia is composed of, for example, words or sentences including technical terms. Specifically, when the positioning correction direction is internal rotation, a sentence such as "Please internally rotate your knee" is displayed as the first photographing support information Ia in the image display area 83. When the positioning correction direction is adduction, a sentence such as "Please internally adduct your knee" is displayed as the first photographing support information Ia in the image display area 83.

[0117] The user checks the first photographing support information Ia or the second photographing support information Ib and the three-dimensional structure information T displayed on the photographing screen 80. The first photographing support information Ia or the second photographing support information Ib displayed on the photographing screen 80 is a terminology that the user is familiar with or an expression that the user prefers. This allows the user to accurately guide the patient and correct any deviation in positioning based on the first photographing support information Ia or the second photographing support information Ib displayed on the photographing screen 80. Once the deviation in positioning has been eliminated, a radiographic image is re-captured.

[0118] On the other hand, when the control unit 20 determines that there is no deviation in the positioning of the femoral condyle, it may display only the radiation image G in the image display area 83 of the imaging screen 80. Furthermore, when the control unit 20 determines that there is no deviation in the positioning, it may display "Positioning: A" as the rank information Ic and "Deviation: 0 mm" as the deviation amount information Id in the image display area 83. Furthermore, the control unit 20 may display a sentence, word, or the like indicating that there is no deviation in the positioning as the imaging support information I in the image display area 83.

[0119] In this embodiment, the photographing support information I in two directions for supporting the correction of each deviation amount is displayed on the photographing screen 80 as assist information for the positioning correction direction, but the present invention is not limited to this. For example, the photographing support information I according to the deviation amount in one direction may be displayed on the photographing screen 80. This is because the positioning correction standard may differ depending on the hospital or facility. Also, depending on the patient, positioning correction in one direction may be sufficient, and positioning correction in two directions may be required. The selection of one direction or two directions for the positioning correction direction may be made on the above-mentioned setting screen 70, etc.

[0120] FIG. 18 shows an example of the second photographing support information Ib and the three-dimensional structure information T in the case where a deviation in positioning in one direction displayed on the photographing screen 80 is corrected. In the image display area 83 of the photographing screen 80, three-dimensional structural information T indicating the positioning deviation is displayed superimposed on the radiation image G. As the three-dimensional structural information T, as shown in Fig. 18, medial condyle side line information T1 indicating the medial condyle region and lateral condyle side line information T2 indicating the lateral condyle region are displayed.

[0121] In addition to the radiographic image G obtained by imaging, second imaging support information Ib for correcting a positioning deviation is displayed in the image display area 83 of the imaging screen 80. Specifically, when the positioning correction direction is internal rotation, a sentence saying "Please lift your knees" is displayed as the second imaging support information Ib in the image display area 83. Rank information Ic and deviation amount information Id are displayed above the second imaging support information Ib.

[0122] In the above embodiment, the positioning is corrected by changing the posture of the patient, who is the subject S, but the present invention is not limited to this. For example, the positioning may be corrected by changing the position of the imaging device 1 side using the imaging support information I for changing the position of the imaging device 1 side. As described above, the imaging support information I includes the first imaging support information Ia and the second imaging support information Ib. The first imaging support information Ia is composed of, for example, words or sentences including technical terms. Specifically, the first imaging support information Ia may be a sentence such as "Please move the radiation source (tube) toward the patella." The second imaging support information Ib is information obtained by changing the expression of the first imaging support information Ia, and is composed of words or sentences that do not include technical terms and are easy for the user to understand. Specifically, the second imaging support information Ib may be a sentence such as "Please move the radiation source (tube) to the front and above the joint."

[0123] FIG. 19 shows an example of the second photographing support information Ib and the three-dimensional structure information T for changing the position on the photographing device 1 side displayed on the photographing screen 80. In addition to the radiographic image G obtained by imaging, the image display area 83 of the imaging screen 80 displays the second imaging support information Ib for changing the position of the imaging device 1. Specifically, when the positioning needs to be corrected, the image display area 83 displays a sentence "Please move the radiation source (tube) to the front and top of the joint" as the second imaging support information Ib. Above the second imaging support information Ib, the rank information Ic and the deviation amount information Id are displayed. This allows the user to change the imaging position with respect to the subject S by adjusting the position of the imaging device 1, so that the positioning can be indirectly corrected. Furthermore, when the first imaging support information Ia is selected as the imaging support information I, the image display area 83 displays a sentence "Please move the radiation source (tube) toward the patella" (not shown).

[0124] As described above, according to this embodiment, for example, from among a plurality of candidate groups on the setting screen 70, the user can select the second imaging support information Ib that is familiar to the user or that matches the user's preferred expression. In addition, some users may be more familiar with the first imaging support information Ia that includes technical terms. In this case, the first imaging support information Ia can also be selected on the setting screen 70. That is, in this embodiment, each user can freely select the assist information for the positioning correction direction. This allows the user to correct the positioning with assistance from words or sentences that are easier to understand, and therefore the patient can be guided appropriately. As a result, the radiation imaging can be performed more quickly, and the burden on the patient during positioning can be reduced.

[0125] [Another embodiment 1] In another embodiment 1, positioning support is performed using an optical camera image captured by an optical camera. In the following, differences from the above embodiment will be mainly described, and explanations of points in common with the above embodiment will be omitted. In addition, in the explanation of the other embodiment 1, parts in common with the above embodiment will be described with the same reference numerals.

[0126] FIG. 20 is a diagram showing a schematic configuration of a photography support system 10B according to another embodiment 1. As shown in FIG. The radiography support system 10B includes a radiographic image radiography device 1, an radiography control device 2, a radiation generation device 3, an image management device 4, and an HIS / RIS 5. The generation device 3 includes a generator 31, a switch 32, a radiation source 33, and an optical camera 34. The optical camera 34 and the like are connected to the radiography control device 2 via a network N.

[0127] The optical camera 34 is disposed, for example, next to the radiation source 33. The radiation source 33 and the optical camera 34 may be integrally mounted in one housing. The optical camera 34 optically captures an image of the subject S at a timing before capturing a radiation image of the subject S. The optical camera 34 transmits the captured optical camera image according to the positioning of the patient to the imaging control device 2. The optical camera image includes a still image or a dynamic image captured continuously.

[0128] The imaging control device 2 judges the presence or absence, type, etc. of positioning deviation based on the optical camera image acquired from the optical camera 34. For example, the imaging control device 2 estimates three-dimensional structural information T such as the medial condyle line T1 indicating the deviation area of ​​the structure of the subject S by inputting the acquired optical camera image to the machine learning model 23c. The imaging control device 2 identifies the type of positioning deviation based on the three-dimensional structural information T, etc., and acquires imaging support information I corresponding to the type of deviation. The imaging support information I is the first imaging support information Ia or the second imaging support information Ib as described above. The imaging control device 2 displays the acquired imaging support information I and three-dimensional structural information T, etc., on, for example, the display unit 22. A user such as a radiologist can recognize the three-dimensional positional relationship of the deviation area from the three-dimensional structural information T, and can easily understand the correction direction of the positioning from the imaging support information I. If the positioning deviation is resolved, the user proceeds to the next step of capturing a radiographic image of the subject S.

[0129] According to the other embodiment 1, as in the above-mentioned embodiment, a user such as a radiologist can identify the three-dimensional positional relationship in the "femoral condyle" by checking the three-dimensional structure information T displayed on the imaging screen 80. This allows the user to accurately grasp the direction of positioning correction. As a result, the radiography can be performed quickly and the burden on the patient during positioning can be reduced. Furthermore, according to the other embodiment 1, the positioning of the patient is photographed using the optical camera 34 before radiography. Therefore, if there is a positioning deviation in the optical camera image, the positioning can be corrected before radiography. This reduces the number of re-imagings, and reduces the burden on the patient by reducing the total radiation exposure of the patient.

[0130] Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. In addition, various modifications and improvements will naturally belong to the technical scope of the present disclosure within the scope of the technical ideas described in the claims of those skilled in the art. [Explanation of symbols]

[0131] 1. Radiation imaging device (imaging device) 10A, 10B Photography Support System 2. Shooting control device (shooting support device) 20 Control section 23 Memory section 23a Shooting support information candidate table I. Shooting support information Ia 1st Shooting Support Information Ib 2nd Shooting Support Information

Claims

1. an acquisition unit that acquires first imaging support information, which is first information for changing a position of a subject or an imaging device that captures a medical image of the subject; a change unit that changes the first photographing support information to second photographing support information, which is second information for changing a position of the subject or the photographing device; An output unit that outputs the second photographing support information; A photography support device comprising:

2. The medical image is a radiological image. The photographing support device according to claim 1 .

3. The medical image is an optical camera image. The photographing support device according to claim 1 .

4. The change unit changes the expression of the first photographing support information to generate the second photographing support information. The photographing support device according to claim 1 .

5. A storage unit that stores a plurality of replacement candidates corresponding to words or sentences before replacement included in the first photographing support information; a setting unit that sets a replacement word or sentence corresponding to the word or sentence before replacement included in the first photographing support information from among the plurality of replacement candidates, The change unit changes the first photographing support information to the second photographing support information based on the set replaced word or sentence, The output unit outputs the second photographing support information. The photographing support device according to claim 1 .

6. an input unit through which a user inputs a replacement candidate corresponding to a word or a sentence included in the first photographing support information, The storage unit stores the replacement candidate inputted to the input unit. The photographing support device according to claim 5.

7. an input unit through which a user inputs a replacement candidate corresponding to a word or a sentence included in the first photographing support information, The change unit changes the first photographing support information to the second photographing support information based on the replacement candidate input to the input unit. The photographing support device according to claim 5.

8. The word or sentence included in the first photographing support information is at least one of adduction, abduction, internal rotation, and external rotation.

7. The photographing support device according to claim 5.

9. a storage unit configured to store a first plurality of replacement candidates and a second plurality of replacement candidates corresponding to words or sentences before replacement included in the first photographing support information; a setting unit that sets a first replaced word or sentence corresponding to the first pre-replacement word or sentence included in the first photographing support information from among the first plurality of replacement candidates; a setting unit that sets a second replaced word or sentence corresponding to the word or sentence before the second replacement included in the first photographing support information from among the second plurality of replacement candidates, The change unit changes the first photographing support information to the second photographing support information based on the set first replaced word or sentence, and changes the first photographing support information to the second photographing support information based on the set second replaced word or sentence. The photographing support device according to claim 5.

10. the first imaging support information is first re-imaging support information that is information that supports re-imaging of the radiological image, The second imaging support information is second re-imaging support information which is information for supporting re-imaging of the radiological image. The photographing support device according to claim 2.

11. a determination unit for determining a deviation of a predetermined region of the radiation image; a derivation unit that derives the first re-photographing support information or the second re-photographing support information based on the determination of the deviation. The photographing support device according to claim 10.

12. outputting, as the second re-photographing support information, information for changing a position of a part of a subject related to the deviation or a position of an imaging device related to the deviation; The photographing support device according to claim 11.

13. The determination unit includes a first determination unit that determines a first deviation of a predetermined area of ​​the radiographic image; a second determination unit that determines a second deviation of a predetermined region of the radiographic image, the derivation unit is configured to derive the first re-photographing support information or the second re-photographing support information based on the determination of the first deviation and the determination of the second deviation. The photographing support device according to claim 11.

14. a storage unit configured to store a first replacement candidate associated with the first deviation and a second replacement candidate associated with the second deviation; The photographing support device according to claim 13.

15. Computer, an acquisition unit that acquires first imaging support information, which is first information for changing a position of a subject or an imaging device that captures a medical image of the subject; a change unit that changes the first photographing support information to second photographing support information, which is second information for changing a position of the subject or the photographing device; an output unit that outputs the second photographing support information; A program that functions as a

16. The change unit changes the expression of the first photographing support information to generate the second photographing support information. The program according to claim 15.

17. a setting unit that sets a replacement word or sentence corresponding to the word or sentence before replacement included in the first photographing support information from among a plurality of replacement candidates corresponding to the word or sentence before replacement included in the first photographing support information, The change unit changes the first photographing support information to the second photographing support information based on the set replaced word or sentence, The output unit outputs the second photographing support information. The program according to claim 15.

18. an acquisition step of acquiring first imaging support information, which is first information for changing a position of a subject or an imaging device that captures a medical image of the subject; a changing step of changing the first photographing support information to second photographing support information which is second information for changing a position of the subject or the photographing device; an output step of outputting the second photographing support information; A photography support method comprising the steps of:

19. An imaging device that captures a subject or a medical image of the subject; A photographing support device according to any one of claims 1 to 14, A photography support system comprising:

Images