Medical imaging device, medical imaging support method, and program

Abstract

This invention provides a medical imaging device, a medical imaging support method, and a program that can send multiple notifications from the subject to the user. [Solution] The medical imaging device according to this disclosure is a medical imaging device that captures medical images of a subject, and identifies a first action performed by the subject inserted into the bore of a gantry based on information acquired by an motion sensor, compares the identified first action with a plurality of second actions registered in memory, and notifies the user of a notification content corresponding to the second action that matches the identified first action from among the plurality of second actions registered in memory.

Description

Technical Field

[0001] The present invention relates to a medical imaging device, a medical imaging support method, and a program, and particularly relates to a technique for detecting the movement of a subject.

Background Art

[0002] A magnetic resonance imaging (MRI) device is known as a device that images and displays internal tissues of a subject such as a human body.

[0003] Patent Document 1 describes an MRI device that detects the movement of a subject and calculates body movement using video from a camera installed in the examination space of the MRI device.

[0004] In addition, Patent Document 2 discloses a body movement detector that is attached to a subject to sense the body movement of the subject and generate a sensing signal, and compares a predetermined standard pattern with the sensing signal generated by the body movement detector to determine whether the body movement sensed by the body movement detector is a predetermined body movement. When it is determined that the body movement is a predetermined body movement, a body movement determination device that generates a body movement detection signal is described.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] During an MRI scan, the patient can press an emergency call button, which sounds a buzzer to notify the operator in the control room. The patient can press the buzzer if they feel unwell or have any health problems, but the buzzer only indicates whether the notification is on or off. Some patients may also have difficulty pressing the buzzer.

[0007] Furthermore, while the MRI apparatus described in Patent Document 1 and the body movement detection device described in Patent Document 2 detect the body movements of the subject, the subject cannot communicate their intentions.

[0008] This invention has been made in view of these circumstances, and aims to provide a medical imaging device, a medical imaging support method, and a program that can send multiple notifications from the subject to the user. [Means for solving the problem]

[0009] To achieve the above objective, a medical imaging device according to a first aspect of this disclosure is a medical imaging device for capturing medical images of a subject, comprising: a gantry having a bore into which a subject placed on a bed is inserted; an motion sensor for acquiring information used to identify a first action performed by the subject; a memory in which a plurality of second actions and notification content corresponding to each of the plurality of second actions are registered; and a processor, wherein the processor identifies a first action performed by the subject inserted into the bore based on the information acquired by the motion sensor, compares the identified first action with a plurality of second actions registered in the memory, and notifies the user of the notification content corresponding to the second action that matches the identified first action among the plurality of second actions registered in the memory.

[0010] In the medical imaging apparatus according to the second aspect of this disclosure, it is preferable that the multiple second operations in the medical imaging apparatus according to the first aspect include operations of the same type but of different magnitudes.

[0011] In a third aspect of the present disclosure, the medical imaging device according to either the first or second aspect preferably includes a plurality of second operations of the same type, each with a different duration.

[0012] A medical imaging device according to a fourth aspect of this disclosure is a medical imaging device according to any one of the first to third aspects, wherein the motion sensor preferably includes one of the following: an optical camera for photographing a subject, a sensor placed on a bed, and a sensor attached to the subject's body.

[0013] In the fifth aspect of this disclosure, the medical imaging device is preferably such that the sensor placed on the bed includes a touch sensor or a pressure sensor, as is the case in the medical imaging device according to the fourth aspect.

[0014] A medical imaging device according to a sixth aspect of this disclosure is preferably a medical imaging device according to a fourth aspect, wherein the sensors attached to the subject's body preferably include at least one of an acceleration sensor, a gyroscope, and a pressure sensor.

[0015] In the seventh aspect of this disclosure, the medical imaging device, in any one aspect of the first to sixth aspects, preferably has a processor that identifies a first operation by combining information obtained by at least one of the following: part identification by skeletal extraction technology, motion tracking, and pattern recognition by a trained model, with information obtained by a motion sensor.

[0016] In the eighth aspect of this disclosure, the medical imaging device is preferably a medical imaging device according to any one of the first to seventh aspects, wherein the processor acquires vital information of the subject and notifies the user of predetermined notification content according to the acquired vital information.

[0017] In the ninth aspect of this disclosure, the medical imaging device is a medical imaging device according to any one of the first to eighth aspects, wherein the processor preferably causes the notification content to be displayed as a pop-up on the display device.

[0018] A medical imaging apparatus according to the tenth aspect of this disclosure preferably comprises, in a medical imaging apparatus according to any one aspect of the first to ninth aspects, a static magnetic field generator for generating a static magnetic field, a transmitting device for irradiating a subject placed in a static magnetic field space with high-frequency magnetic field pulses, and a gradient magnetic field generator for generating a gradient magnetic field in a static magnetic field space.

[0019] To achieve the above objective, the medical imaging support method according to the 11th aspect of this disclosure is a medical imaging support method that supports the acquisition of a medical image of a subject by a medical imaging device, wherein the medical imaging device comprises a gantry having a bore into which a subject placed on a bed is inserted, an motion sensor that acquires information used to identify a first action performed by the subject, a memory in which a plurality of second actions and notification content corresponding to each of the plurality of second actions are registered, and a processor, wherein the processor identifies a first action performed by the subject inserted into the bore based on the information acquired by the motion sensor, compares the identified first action with a plurality of second actions registered in the memory, and notifies the user of the notification content corresponding to the second action that matches the identified first action from among the plurality of second actions registered in the memory.

[0020] To achieve the above objective, the program relating to the 12th aspect of this disclosure is a program that causes a computer to execute the medical imaging support method relating to the 11th aspect. A non-temporary and computer-readable storage medium on which the program relating to the 11th aspect is stored is also included in this disclosure.

[0021] The medical imaging support method according to the 10th embodiment and the program according to the 11th embodiment can be configured to include specific embodiments similar to those of the medical imaging device described above. [Effects of the Invention]

[0022] According to the present invention, multiple notifications can be sent from the subject to the user. [Brief explanation of the drawing]

[0023] [Figure 1] Figure 1 is a perspective view showing the appearance of the MRI apparatus. [Figure 2] Figure 2 is a diagram showing a schematic configuration inside the MRI apparatus. [Figure 3] Figure 3 is a diagram showing another example of the arrangement of the cameras. [Figure 4] Figure 4 is a block diagram showing an example of the hardware configuration of the information processing apparatus. [Figure 5] Figure 5 is a diagram showing an example of the registered contents in the database. [Figure 6] Figure 6 is a diagram showing an example of the subject's movement. [Figure 7] Figure 7 is a flowchart showing the medical imaging support method according to the first embodiment. [Figure 8] Figure 8 is a diagram showing an example of the display on the display device. [Figure 9] Figure 9 is a diagram showing an example of the registered contents in the database according to the second embodiment. [Figure 10] Figure 10 is a flowchart showing the medical imaging support method according to the second embodiment. [Figure 11] Figure 11 is a block diagram showing the functional configuration of the information processing apparatus.

Embodiments for Carrying Out the Invention

[0024] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification, the same reference numerals are assigned to the same components, and duplicate explanations are omitted as appropriate.

[0025] 〔Outline of the MRI Apparatus〕 Figure 1 is a perspective view showing the external appearance of an MRI device 10, which is an example of a medical imaging device. The MRI device 10 comprises a gantry 12, which is the main imaging device body for capturing MRI images, which are an example of medical images, and a patient table 14. The gantry 12 has a cylindrical imaging space 18 called a bore. The gantry 12 is equipped with a static magnetic field generating magnet, a gradient magnetic field coil, and various other coils for generating a magnetic field in the imaging space 18. The static magnetic field generating magnet is an example of a static magnetic field generating device that generates a static magnetic field. The gradient magnetic field coil is an example of a gradient magnetic field generating device that generates a gradient magnetic field in the static magnetic field space.

[0026] The bed 14 comprises a top plate 15 and legs 16 that support the top plate 15, and is positioned on the front side of the gantry 12. The top plate 15 can enter and exit the imaging space 18 by a drive mechanism (not shown) provided on the legs 16. The bed 14 may be fixed to the gantry 12, or it may be a movable, dockable bed that can be attached to and detached from the gantry 12.

[0027] In the MRI apparatus 10, three apparatus axes are defined, which are three-dimensional orthogonal coordinate axes in real space including the imaging space 18. The direction of each axis of the apparatus three axes is uniquely determined by the gantry 12 and the patient table 14. In Figure 1, the Z direction is the direction of the static magnetic field, the Y direction is the vertical direction, and the X direction is perpendicular to the Y and Z directions.

[0028] Figure 2 shows a schematic diagram of the internal configuration of the MRI device 10. The MRI device 10 comprises a static magnetic field generating magnet 102, a gradient magnetic field coil 104, an RF (Radio Frequency) transmitting coil 106, a receiving coil 110, a receiver 112, a gradient magnetic field power supply 114, a high-frequency magnetic field generator 116, a sequencer 118, a control unit 120, and an operation unit 122. The MRI device 10 also includes a camera 140 for detecting the movements of the patient 130.

[0029] The static magnetic field generating magnet 102 generates a uniform static magnetic field in the imaging space 18. The static magnetic field generating magnet 102 includes a static magnetic field source of the permanent magnet type, normal conducting type, or superconducting type. The gradient magnetic field coil 104 generates a gradient magnetic field in the imaging space 18. The gradient magnetic field coil 104 consists of gradient magnetic field coils in the three axes of X, Y, and Z, which are real-space coordinate systems (stationary coordinate systems). Each gradient magnetic field coil is connected to the gradient magnetic field power supply 114 and supplied with current. This generates gradient magnetic fields in the three axes of X, Y, and Z.

[0030] The subject 130 is placed on the top plate 15 of the bed 14, and a receiving coil 110 corresponding to the area being examined is attached. By inserting the top plate 15 on which the subject 130 is placed into the imaging space 18, the area being examined of the subject 130 is positioned at the center of the static magnetic field in the imaging space 18.

[0031] Camera 140 is an example of a motion sensor that detects the movements of the subject 130. Camera 140 is an optical camera that optically captures a series of images at a frame rate equal to or greater than a predetermined frame rate. For example, it is desirable that camera 140 be able to capture a video consisting of 30 or more images per second. Camera 140 may also be configured to capture still images.

[0032] The camera 140 typically includes an imaging optical system including a lens and an image sensor that captures the optical image formed by the imaging optical system and converts it into an electrical signal. The image sensor is, for example, a CMOS (Complementary Metal-Oxide Semiconductor) type color image sensor. However, the image sensor is not limited to a CMOS type; a CCD (Charge Coupled Device) type image sensor may also be used. The camera 140 may also include an image processing circuit that processes the electrical signal obtained from the image sensor to create a digital image. The camera 140 captures images of the subject 130 on the bed 14, and the subject's movements are identified based on the images acquired via the camera 140. In this specification, the images acquired via the camera 140 are referred to as "camera images." An infrared camera or a millimeter-wave camera may be used instead of, or in combination with, the camera 140.

[0033] The RF transmitting coil 106 is a coil that irradiates the subject 130 with RF pulses, which are high-frequency magnetic field pulses, and is an example of a transmitting device. The RF transmitting coil 106 is connected to a high-frequency magnetic field generator 116, and a high-frequency pulse current is supplied from the high-frequency magnetic field generator 116.

[0034] The sequencer 118 sends commands to the high-frequency magnetic field generator 116 and the gradient magnetic field power supply 114 according to the imaging pulse sequence. As a result, appropriately amplified signals are sent to the RF transmission coil 106 and the gradient magnetic field coil 104, respectively.

[0035] The high-frequency magnetic field generator 116 is driven according to commands from the sequencer 118 to amplitude modulate high-frequency pulses and supply the amplified high-frequency pulse current to the RF transmitting coil 106. The RF transmitting coil 106 applies a pulsed high-frequency magnetic field (RF pulse) to the subject 130 in response to the signal from the high-frequency magnetic field generator 116. Preferably, the sequencer 118 sends a command to the receiving coil 110 according to the imaging pulse sequence, turning off the receiving coil 110 during the period when the RF pulse is applied.

[0036] The application of a high-frequency magnetic field induces a nuclear magnetic resonance (NMR) phenomenon in the spins of atoms constituting the biological tissue of the subject 130. The receiving coil 110 is a multi-channel RF coil unit containing multiple coil elements for receiving the nuclear magnetic resonance signal (NMR signal) generated in the subject 130. Figure 2 shows an example of a blanket-type receiving coil 110 applied to imaging of the chest and abdomen, but the form of the receiving coil 110 can vary depending on the examination site. For example, receiving coils can be used for imaging various parts such as the head, spine, abdomen, legs, and arms.

[0037] The NMR signal generated from the subject 130 is detected by the receiving coil 110, amplified by a preamplifier (not shown) within the receiving coil 110, and transmitted to the receiver 112. In the receiver 112, the amplified NMR signal is subjected to AD (analog-to-digital) conversion and necessary signal processing to generate data. The generated data is transmitted to the control unit 120. This data is also called the received signal or measurement data.

[0038] A receiving coil 110 is connected to a receiving cable (not shown) that outputs the NMR signal received by the receiving coil 110. Although not shown in Figure 2, a receiving connector is connected to the end of this receiving cable. The receiving connector is connected to a bed-side connector provided on the bed 14. The bed-side connector is connected to a bed-side cable located inside the bed 14, and the bed-side cable is connected to the control unit 120. This enables communication between the receiving coil 110, the control unit 120, and the sequencer 118.

[0039] The connection between the receiving coil 110, the control unit 120, and the sequencer 118 is not limited to a wired connection such as a cable, but can also be made wirelessly. In this case, the receiving coil 110 or bed 14 further includes at least an AD conversion module and a wireless communication module.

[0040] The sequencer 118 controls each component to operate at pre-programmed timings and intensities. The program, in particular, describes the timings and intensities of RF pulses, gradient magnetic fields, and signal reception; this is called a pulse sequence. Various types of pulse sequences are known depending on the purpose, but a detailed explanation is omitted here.

[0041] The control unit 120 receives various instruction inputs from the operation unit 122, and comprehensively controls each part of the MRI device 10 via the sequencer 118 to perform MRI imaging.

[0042] In other words, the control unit 120 performs processing such as inverse Fourier transforming the spatial frequency domain received signal from the receiver 112 to convert it into a real-space image, thereby generating an MRI image.

[0043] Furthermore, the control unit 120 causes the camera 140 to capture images along with the MRI imaging, and acquires camera images. Based on the camera images, the control unit 120 detects the movements of the subject 130 and notifies the user of predetermined notification content.

[0044] The operation unit 122 includes an input device such as a mouse or keyboard, and a display device such as a liquid crystal display. The operation unit 122 functions as a user interface (UI) for users such as technicians to input the startup, stop, pause, pulse sequence selection, imaging conditions, and processing conditions of the MRI device 10.

[0045] The sequencer 118 and the control unit 120 can be configured using a computer. Furthermore, the processing functions of the sequencer 118 and the control unit 120 may be implemented by a computer system including multiple computers.

[0046] 〔camera〕 The camera 140 shown in Figure 2 is positioned to capture images of the subject 130 inserted into the imaging space 18. For example, the camera 140 is positioned to capture an oblique image of the subject 130 from above within the bore, obtaining an image of a relatively wide area including the subject's chest. It is desirable that the camera 140 be configured to capture the entire body of the subject 130. It is desirable that the camera 140 be equipped with a wide-angle lens or a fisheye lens for its imaging optical system.

[0047] Because the imaging space 18 of the gantry 12 is structured in such a way that light, such as the interior lighting of the shield room, does not easily penetrate it, when using a camera 140 to photograph the inside of the bore, it is desirable to place an illumination device that irradiates light into the imaging space 18 in order to improve the signal-to-noise ratio (SNR) of the image captured by the camera 140.

[0048] Furthermore, the camera 140 is equipped with a structure that shields against electromagnetic noise so that the gantry 12 does not generate noise due to the electromagnetic noise generated by the camera 140. The structure that shields against electromagnetic noise may be, for example, a shielded box.

[0049] Furthermore, the camera 140 is equipped with a structure to shield against magnetic fields and high frequencies so that it can function as a camera even when it is subjected to a static magnetic field generated by a static magnetic field generating magnet 102, a gradient magnetic field with a large temporal variation applied by a gradient magnetic field coil 104, and high-frequency magnetic field pulses (RF pulses) irradiated from an RF transmitting coil 106. The structure to shield against magnetic fields and high frequencies may be, for example, a shielded box. Preferably, the camera 140 may be positioned to avoid the irradiation area of ​​the RF pulses.

[0050] Figure 2 shows an example of attaching a camera 140 to the entrance side when inserting the subject 130 into the bore in the gantry 12, but the placement and number of cameras 140 are not limited to the example in Figure 2. Figure 3 shows another example of the placement of cameras 140. As shown in Figure 3, the cameras 140 may be configured with cameras 140A and 140B positioned on the entrance side and the back side of the bore, respectively, or with camera 140B positioned only on the back side of the bore. By using multiple cameras to photograph the subject 130 from multiple directions, it becomes possible to accurately identify the movements of the subject 130.

[0051] Camera 140 may be positioned outside the bore to photograph the inside of the bore. Alternatively, a camera may be positioned to photograph the outside of the bore, either in place of or in combination with camera 140 that photographs the inside of the bore. For example, a camera may be positioned above the front (bed side) of the gantry 12 to photograph the subject 130 before or while the subject 130 is being moved into the bore. The camera may also be mounted on the ceiling or wall of the shielded room.

[0052] [Example of hardware configuration for information processing equipment] Figure 4 is a block diagram showing an example of the hardware configuration of an information processing device 200 used in an MRI device 10. The information processing device 200 may be a personal computer, a workstation, or a server computer. The computer may be a virtual machine. The information processing device 200 is applied to the console of the MRI device 10 and can function as a control unit 120 and an operation unit 122 (see Figure 2). The information processing device 200 may also function as a sequencer 118.

[0053] The information processing device 200 comprises a processor 202, a main memory 204, an auxiliary storage 206, an input / output interface 208, and a bus 210.

[0054] Processor 202 includes a CPU (Central Processing Unit). Processor 202 may also include a GPU (Graphics Processing Unit). Furthermore, processor 202 may be configured to include one or more hardware components such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), and a PLD (Programmable Logic Device).

[0055] The processor 202 is connected to the memory 204, storage 206, input / output interface 208, input device 212, and display device 214 via the bus 210.

[0056] Memory 204 includes RAM (Random Access Memory). Memory 204 may also include ROM (Read Only Memory). Storage 206 may be, for example, a Hard Disk Drive (HDD), a Solid State Drive (SSD), or a combination of these. Storage 206 may also include external storage devices such as removable media.

[0057] The memory 204 and storage 206, among other storage devices, store programs and data that enable the various functions of the MRI device 10. The processor 202 enables the various functions by executing the programs stored in the memory 204. The processor 202 comprehensively controls each part of the information processing device 200 and the various devices and units provided in the MRI device 10, and performs various processes.

[0058] The input / output interface 208 includes a communication interface that can connect to telecommunications lines such as a local area network, and a connection interface that can connect to external devices. Examples of connection interfaces that can connect to external devices include the Universal Serial Bus and HDMI (High-Definition Multimedia Interface) (HDMI is a registered trademark).

[0059] The processor 202 communicates with various devices of the MRI apparatus 10 via the input / output interface 208, thereby sending and receiving necessary information.

[0060] The input device 212 may consist of, for example, a keyboard, a pointing device such as a mouse, a numeric keypad, and various switch buttons. The input device 212 may also include an audio input device. Alternatively, the input device 212 may be a touch panel type input device integrated with the display screen of the display device 214.

[0061] The display device 214 is composed of, for example, a liquid crystal display, an organic electro-luminescence (OEL) display, a projector, or an appropriate combination thereof. The display device 214 displays various information, including MRI images captured by the MRI device 10, camera images, and coil information. The display device 214 is used as part of the user interface when receiving input from the input device 212. Note that the display device 214 is not limited to one; a multi-display configuration with multiple display devices is also possible.

[0062] [Overview of MRI imaging procedure] The typical imaging procedure using the MRI device 10 is generally as follows:

[0063] [Procedure 1] The user, such as a technician, uses an input device 212 such as a mouse and keyboard to register information necessary for the examination, such as patient information, imaging site, patient position 130, and imaging protocol, on the patient registration screen. The term "registration" includes the concept of "setting." The term "user" includes the concepts of technician, operator, and other related terms.

[0064] The subject information includes the subject's name and subject code. The subject's position includes the insertion direction of the subject 130 into the gantry 12 and the subject's posture. The imaging protocol includes the imaging type and sequence. Some or all of this information necessary for the examination may be manually entered by the operator via the input device 212, or it may be read from information pre-stored on a recording medium or the like. Parameters that are set or entered automatically are ultimately confirmed by the operator, and manually set via the input device 212 as needed.

[0065] [Procedure 2] The subject 130 is placed on the top plate 15 of the bed 14, and the receiving coil 110 is attached to the subject 130. The user connects the receiving connector of the receiving cable connected to the receiving coil 110 to the bed-side connector on the top plate 15. The top plate 15 is provided with multiple bed-side connectors, and the receiving connector is connected to the nearest bed-side connector depending on the type of receiving coil 110 used and the position of the subject 130. The position of the bed-side connector to which the receiving connector can be connected is restricted by the combination of the type of receiving coil 110 and the position of the subject 130.

[0066] [Procedure 3] After connecting the receiving coil 110 to the bed-side connector, the top plate 15 is moved to the imaging space 18 using a gantry operation panel or foot switch (not shown), and the area of ​​the subject 130 is moved to the center of the static magnetic field of the gantry 12.

[0067] [Step 4] Subsequently, the user presses the start button to instruct the start of imaging, and scanogram imaging is performed to acquire a positioning image. In scanogram imaging, multiple slices are acquired for one or more cross-sections from the axial, coronal, and sagittal sections. Note that the slice thickness in scanogram imaging may be set to a value greater than the slice thickness in the main imaging. When the instruction to start imaging is received, the inspection window screen is displayed on the display device 214 of the operation unit 122.

[0068] [Step 5] After the scanogram acquisition is complete, a positioning image is reconstructed and displayed on the display device 214.

[0069] [Procedure 6] The user sets the imaging position for the main image based on the scanogram image. The MRI device 10 automatically calculates the imaging position, including the slice position (cross-sectional position) to be measured during the main image, from the scanogram image, and presents the recommended imaging position to the user. The user confirms the presented slice position, etc., and adjusts the imaging position manually using the input device 212 of the control unit 122 as needed. The user also sets the imaging parameters to be applied to the main image. Some or all of the imaging parameters may be entered by the user via the control unit 122, or they may be set or entered automatically. The operator confirms the parameters that are set (automatically entered) and sets them manually using the input device 212 of the control unit 122 as needed.

[0070] [Step 7] Perform the imaging according to the imaging parameters and imaging position set in this way.

[0071] [Step 8] After the image is captured, the image is reconstructed and displayed on the display device 214.

[0072] [Step 9] For the displayed reconstructed image, the user sets a window value of a value suitable for diagnosis using the input device 212 to obtain the image to be used for diagnosis.

[0073] [Procedure 10] Once imaging is complete, remove the tabletop 15 from the imaging space 18 and remove the subject 130 from the gantry 12. Then, lower the subject 130 from the bed 14 and end the MRI examination.

[0074] [Medical imaging support method: First embodiment] The medical imaging support method relating to this disclosure is a method of notifying the user from the patient by having the MRI device 10 perform actions according to the content that the patient wishes to notify the user on the control room side.

[0075] Figure 5 shows an example of the contents registered in a database DB used in a medical imaging support method. The database DB is stored in memory 204 or storage 206. The database DB registers multiple actions (an example of "multiple second actions") and the notification content that the user is notified by those actions in association with each other. An action is when the subject moves at least a part of their body for the purpose of communicating their will or feelings to the user, and is also called a motion pattern, signal, or gesture. Actions may include actions that are not conscious of the subject, such as coughing, sneezing, swallowing, and vomiting. The notification content may be about feeling unwell.

[0076] The database shown in Figure 5 has registered actions such as "clench your fist," "raise your right hand," "raise your left hand," "shake your head from side to side," etc. The database also has registered notifications corresponding to these actions, such as "no problems, everything is fine," "continuing the examination is difficult due to worsening health," "...the room is hot," and so on.

[0077] The pairs of actions and notification content registered in the database DB may, for example, be pairs that have been manually registered in advance by a user or the like. Alternatively, the pairs of actions and notification content may be pairs of the subject's past actions and notification content corresponding to the trends shown by those past actions, and may be pairs that have been automatically extracted and registered by the system.

[0078] For example, the information processing device 200 may automatically register in a database DB the actions that subjects generally perform as signs during MRI examinations by extracting them from empirical rules of subject movements in the bore in the past. This allows the information processing device 200 to register "increased number of swallows per unit time" as an action and "tendency to be unwell" as a corresponding notification.

[0079] As yet another example, the database DB could be a pre-trained model trained using machine learning (e.g., deep learning). In this case, the pre-trained model is trained using pairs of the subject's past actions and notification content corresponding to the trends shown by those past actions as inputs and outputs, respectively. As a result, the pre-trained model outputs notification content when the actions of a new subject 130 are input.

[0080] Figure 6 shows an example of the actions of subject 130. F6A in Figure 6 shows subject 130 performing the action of "shaking his head from side to side". By shaking his head from side to side as in F6A, subject 130 communicates to the user that "the room is hot".

[0081] Furthermore, F6B in Figure 6 shows subject 130 performing the action of "raising his right hand." By raising his right hand as in F6B, subject 130 communicates to the user that "it is difficult to continue the examination due to a deterioration in his physical condition."

[0082] Figure 7 is a flowchart showing a medical imaging support method according to the first embodiment. The medical imaging support method is realized by the processor 202 executing a medical imaging support program stored in memory 204. The processor 202 may also read and execute a medical imaging support program stored in a temporary, computer-readable storage medium.

[0083] The medical imaging support method is primarily performed while the subject 130 is inserted into the bore. The medical imaging support method may also be performed while the subject 130 is placed on the tabletop 15 of the bed 14. Here, it is assumed that the processing in this flowchart begins after the subject 130 is placed on the tabletop 15 of the bed 14.

[0084] In step S1, the processor 202 acquires the detection result from the motion sensor. For example, it acquires a camera image from the camera 140.

[0085] In step S2, the processor 202 identifies the first action performed by the subject 130 based on the detection results of the motion sensor acquired in step S1.

[0086] In step S3, the processor 202 compares the first operation identified in step S2 with the second operation of each of the multiple second operations registered in the database DB stored in memory 204 or storage 206.

[0087] In step S4, the processor 202 determines whether the first operation identified in step S2 matches one of the second operations registered in the database DB.

[0088] If, in step S4, it is determined that the first action matches one of the second actions stored in the database DB, the processor 202 proceeds to step S5. In step S5, the processor 202 retrieves the notification content corresponding to the second action that matched the first action from the database DB.

[0089] Furthermore, if the database DB is configured as a trained model, the processor 202 may have the database DB perform the processing in steps S3 to S5. That is, the processor 202 may input the first action identified in step S2 to the trained model and obtain the notification content corresponding to the first action from the trained model.

[0090] In step S6, the processor 202 issues a notification based on the notification content acquired in step S5. For example, the processor 202 displays the acquired notification content as a pop-up screen on the display device 214 (an example of "pop-up display").

[0091] If it is determined in step S4 that the actions of the subject 130 do not match any of the actions stored in the database, and if a notification is issued in step S6, the processor 202 proceeds to the processing in step S7. In step S7, the processor 202 determines whether the MRI examination has been completed.

[0092] If it is determined in step S7 that the MRI examination has finished, the processor 202 terminates the processing of this flowchart. On the other hand, if it is determined in step S7 that the MRI examination has not finished, the processor 202 returns to step S1 and repeats the same process.

[0093] For example, if subject 130 feels that it is difficult to continue the examination due to a deterioration in their physical condition, subject 130 will perform the action of raising their right hand. In step S1, a camera image of subject 130 raising their right hand is acquired. In step S2, it is identified that the first action performed by subject 130 was the action of raising their right hand. In step S3, the action of raising the right hand identified in step S2 is compared with the second action of each of the multiple second actions registered in the database DB. In step S4, it is determined that the action of raising the right hand matches the action of raising the right hand registered in the database DB. In step S5, the notification content corresponding to the action of raising the right hand is acquired from the database DB. In step S6, a notification is issued based on the notification content acquired in step S5.

[0094] Figure 8 shows an example of the display on the display device 214. In the example shown in Figure 8, the display device 214 displays the examination window screen 500 for the MRI examination. In addition, the display device 214 displays a pop-up screen 502, which is smaller than the examination window screen 500, overlaid on the examination window screen 500. The pop-up screen 502 indicates that the notification in step S6 has been made, and in the example shown in Figure 8, it displays, "The subject has indicated that it is difficult to continue the examination due to a deterioration in their physical condition."

[0095] As described above, by performing actions according to what the subject 130 wants to notify the user of, the subject 130 can communicate their intentions or feelings to the user.

[0096] Note that the notification in step S6 is not limited to the example shown in Figure 8. For example, the position and size of the pop-up screen 502 can be in various configurations. For example, the pop-up screen 502 may be displayed in the center of the inspection window screen 500, or it may be larger than the example shown in Figure 8.

[0097] Furthermore, while the database DB shown in Figure 5 has one notification corresponding to one action, the level of notification to the operator may be changed depending on the magnitude (amplitude) and duration of the action, even for the same type of action.

[0098] In other words, the database (DB) may register multiple sizes for a single type of action, and multiple notification contents corresponding to each size. For example, the actions registered may be "shake head slightly from side to side" and "shake head widely from side to side," and the notification contents corresponding to "shake head slightly from side to side" and "shake head widely from side to side" may be "notify as information that the room is hot but tolerable" and "notify as a warning that the room is too hot to tolerate."

[0099] Furthermore, the database (DB) may register multiple durations for a single type of action, and corresponding notification content for each of these durations. For example, if actions such as "shake head from side to side for 2 seconds" and "shake head from side to side for 5 seconds" are registered, the corresponding notification content may be "notify that the room is hot but tolerable" and "notify as a warning that the room is too hot to tolerate."

[0100] [Medical imaging support method: Second embodiment] The medical imaging support method according to the second embodiment notifies the user of predetermined notification content according to vital information. Here, an example is described in which the state of the subject 130 based on the subject 130's movements (state A) and the vital information of the subject 130 (state B) are combined to comprehensively determine the state of the subject 130 and notify the user.

[0101] Figure 9 shows an example of the registered contents of the database DB used in the medical imaging support method according to the second embodiment. The database DB stores multiple actions, vital information, and notification content that is sent to the user based on the presence or absence of abnormalities in the actions and vital information.

[0102] The vital signs of subject 130 include at least one of the following: body temperature, blood pressure, pulse rate, heart rate, respiratory rate, presence or absence of sweating, number of yawns, and number of blinks. Here, the vital signs are classified into normal and abnormal. Normal vital signs mean that the values ​​are within the normal range. Abnormal vital signs mean that the values ​​are outside the normal range. If there is a change in the vital signs of subject 130 before the examination and during the examination, the vital signs may be classified as abnormal.

[0103] The database shown in Figure 9 has registered actions such as "raise right hand," "raise left hand," "shake head from side to side," etc. For each action, the vital information is combined with "no abnormality (normal)" or "abnormality" and a corresponding notification content is assigned. For example, in the database shown in Figure 9, when the action is "raise right hand," the notification content registered for when the vital information is "no abnormality (normal)" is "no problem and safe," and the notification content registered for when the vital information is "abnormal" is "no problem and safe, but needs to be spoken to."

[0104] Furthermore, in the database shown in Figure 9, when the action is "raise left hand," the notification content registered for when vital information is "no abnormalities (normal)" is "difficult to continue the examination due to worsening condition," and the notification content registered for when vital information is "abnormal" is "terminate the examination immediately due to worsening condition."

[0105] Furthermore, in the database shown in Figure 9, when the action is "shaking head from side to side," the notification content registered for when vital information is "no abnormality (normal)" is "the room is hot," and the notification content registered for when vital information is "abnormal" is "the room is hot and the user's condition is deteriorating."

[0106] The pairs of behavior and vital information and notification content registered in the database DB may be pairs that have been manually registered in advance by the user, or they may be pairs of the subject's past behavior and past vital information and notification content that corresponds to the trends shown in the past behavior and past vital information, and which are automatically extracted and registered by the system.

[0107] The database DB may be a pre-trained model trained using machine learning. In this case, the pre-trained model is trained using pairs of the subject's past behavior and vital information and notification content corresponding to the trends shown in that past behavior and vital information as input and output, respectively. As a result, the pre-trained model outputs notification content when new subject 130 behavior and vital information is input.

[0108] Figure 10 is a flowchart showing a medical imaging support method according to the second embodiment.

[0109] In step S1, the processor 202 acquires the detection result from the motion sensor. In step S2, the processor 202 identifies the first action performed by the subject 130 based on the detection result from the motion sensor acquired in step S1.

[0110] In step S11, the processor 202 acquires vital information of the subject 130. In step S12, the processor 202 evaluates the vital information acquired in step S11. Here, the processor 202 determines whether or not there are any abnormalities in the vital information.

[0111] In step S13, the processor 202 integrates the first operation identified in step S2 with the vital information determined in step S12. In step S14, the processor 202 compares the first operation and vital information integrated in step S13 with the second operation and vital information of each of the multiple second operations registered in the database DB.

[0112] In step S4, the processor 202 determines whether the first operation and vital information integrated in step S13 matches any of the second operation and vital information from the plurality of second operation and vital information.

[0113] If, in step S4, it is determined that the first operation and vital information matches one of the multiple second operation and vital information sets, the processor 202 proceeds to the processing in step S5.

[0114] In step S5, the processor 202 retrieves notification content from the database DB that corresponds to the combination of second action and vital information that matches the first action and vital information. Furthermore, in step S6, the processor 202 issues a notification based on the notification content retrieved in step S5.

[0115] If it is determined in step S4 that there is no match, and if a notification is issued in step S6, the processor 202 proceeds to the process in step S7. In step S7, the processor 202 determines whether the MRI examination has been completed or not.

[0116] If it is determined in step S7 that the MRI examination has finished, the processor 202 terminates the processing of this flowchart. On the other hand, if it is determined in step S7 that the MRI examination has not finished, the processor 202 returns to step S1 and repeats the same process.

[0117] For example, suppose a user in the control room asks subject 130 a question via microphone about how they are feeling, and subject 130 raises their right hand. This indicates that state A is "no problem and everything is fine." On the other hand, if abnormalities in vital signs such as sweating, increased blood pressure, or increased respiratory rate are also detected in subject 130, then state B would indicate that subject 130 is actually "experiencing mental distress (anxiety)."

[0118] Therefore, in this case, the processor 202 retrieves the notification content "Everything is fine, but you need to be spoken to" from the database DB shown in Figure 9 for the combination of the action "Raise right hand" and the vital information "Abnormal," and notifies the user accordingly, so the user can speak to the subject 130, saying, "We will continue the examination, but you may be a little nervous, so let's relax, take a deep breath, and make yourself feel at ease."

[0119] [Medical imaging support method: Third embodiment] In an MRI examination, the imaging area is specified by the user. In the third embodiment, the processor 202 detects the movement of the subject 130 and compares it with the imaging area. If, as a result of identifying the movement of the subject 130, the area where movement occurred is not the imaging area, it is determined that the subject moved to communicate an intention, and notification is given in the same manner as in the first and second embodiments.

[0120] On the other hand, if the area where movement occurred is the area being imaged, it is determined that the movement was not caused by the subject to communicate an intention, and the user is notified that the subject 130 has moved. This notification may also be made by displaying a pop-up screen on the display device 214. This allows the MRI device 10 to prompt the user to retake the image. [Functional configuration of information processing equipment] Figure 11 is a block diagram showing the functional configuration of an information processing device 200 that implements a medical imaging support method. The MRI device 10 includes a motion sensor 150 and a vital sensor 152, each of which is connected to the information processing device 200 in a communicative manner.

[0121] The motion sensor 150 detects the movements of the subject 130 and acquires information used to identify the movements of the subject 130. The motion sensor 150 may include any of the following: a camera 140 that photographs the subject 130, an embedded sensor placed on the bed 14, and a sensor (not shown) attached to the body of the subject 130. The embedded sensor placed on the bed 14 is a sensor that can detect changes in the position and pressure of contact between the subject 130 and the bed 14 when the subject 130 moves on the bed 14, and may be a touch sensor or a pressure sensor. The sensor attached to the body of the subject 130 is a sensor that can detect the movement of the subject 130, and may be at least one of an accelerometer, a gyroscope, a pressure sensor, or a wearable sensor.

[0122] The vital sensor 152 detects vital information from the subject 130, such as body temperature, blood pressure, pulse rate, heart rate, respiratory rate, presence or absence of sweating, number of yawns, and number of blinks.

[0123] The information processing device 200 includes an MRI image generation unit 220, an examination window generation unit 222, a sensor information acquisition unit 224, an operation identification unit 228, a comparison unit 230, a vital information acquisition unit 232, a determination unit 234, a pop-up generation unit 236, a display control unit 238, and a database DB.

[0124] The functions of each processing unit in the information processing device 200 may be realized by the processor 202 executing a program stored in the memory 204.

[0125] The MRI image generation unit 220 performs image reconstruction processing from measurement data obtained by imaging the subject 130 and generates an MRI image. The examination window generation unit 222 reads the MRI image generated by the MRI image generation unit 220 and generates an examination window screen 500 that includes the MRI image.

[0126] The sensor information acquisition unit 224 acquires the detection result of the motion sensor 150. The sensor information acquisition unit 224 includes a camera image acquisition unit 226. The camera image acquisition unit 226 acquires the camera image captured by the camera 140.

[0127] The motion identification unit 228 identifies the subject's actions based on sensor information acquired by the sensor information acquisition unit 224. For example, the motion identification unit 228 identifies the subject's actions from information acquired from a touch sensor or a pressure sensor.

[0128] Furthermore, the motion identification unit 228 may include an image recognition processing unit that analyzes the camera image acquired by the camera image acquisition unit 226 to identify the motion of the subject 130. For example, machine learning algorithms can be applied to the image recognition technology that identifies the motion of the subject 130 from the camera image. That is, the motion identification unit 228 may be configured to include a trained model that has been trained by machine learning to identify the motion of the subject 130 from the camera image. The trained model may be, for example, a classification model that uses a convolutional neural network to classify motions. The trained model is not limited to a classification model; for example, it may be a model that performs an object detection task or a region classification (semantic segmentation) task, and may recognize parts of the subject 130 such as the head, abdomen, arms, and legs from the camera image and identify motions based on body structure. In substance, the trained model is a program.

[0129] Alternatively, the motion identification unit 228 may calculate an optical flow indicating the movement of the subject 130 between frames based on the camera image, and identify the movement of the subject 130 based on the calculation result of the optical flow.

[0130] The motion identification unit 228 may identify the movements of the subject 130 by combining information obtained by at least one of the following: part identification using skeletal extraction technology, motion tracking, and pattern recognition using a trained model, with information obtained by the motion sensor 150.

[0131] The comparison unit 230 compares the actions of the subject 130 identified by the action identification unit 228 with the actions registered in the database DB, determines whether the actions of the subject 130 and the actions registered in the database DB match, and obtains the notification content if they match. If multiple actions are registered in the database DB, the comparison unit 230 extracts the actions from the multiple actions registered in the database DB that match the actions of the subject 130 identified by the action identification unit 228, and obtains the notification content corresponding to the extracted actions. Note that if the database DB is configured as a trained model, the functions of the comparison unit 230 may be included in the database DB.

[0132] The vital information acquisition unit 232 acquires the vital information of the subject 130 detected by the vital sensor 152.

[0133] The determination unit 234 determines the vital information acquired by the vital information acquisition unit 232. For example, the determination unit 234 determines whether or not there is an abnormality in the vital information. The determination result is input to the comparison unit 230.

[0134] If a judgment result is input from the judgment unit 234, the comparison unit 230 integrates the actions of the subject 130 identified by the action identification unit 228 and the vital information determined by the judgment unit 234, compares the integrated actions and vital information with the actions and vital information registered in the database DB, determines whether they match, and if they match, obtains the notification content. If multiple actions and vital information are registered in the database DB, the comparison unit 230 extracts the actions and vital information from the multiple actions and vital information registered in the database DB that match the actions of the subject 130 identified by the action identification unit 228 and the vital information determined by the judgment unit 234, and obtains the notification content corresponding to the extracted actions and vital information.

[0135] The popup generation unit 236 generates a popup screen to notify the user according to the comparison result of the comparison unit 230. The popup generation unit 236 generates a popup screen to notify the user of the notification content acquired by the comparison unit 230.

[0136] The display control unit 238 generates data for display on the display device 214. The display control unit 238 displays the inspection window screen 500 generated by the inspection window generation unit 222 on the display device 214. The display control unit 238 also displays the pop-up screen generated by the pop-up generation unit 236 on the display device 214, overlaid on the inspection window screen 500.

[0137] [Processor] In this embodiment, each process is performed on any computer. Furthermore, any computer may perform these processes using a processor, a program, or a combination thereof. Any computer may be a general-purpose computer, a computer designed for a specific purpose, a workstation, or any other hardware element capable of running a program.

[0138] A processor may consist of one or more hardware components, and the type of hardware is not limited. For example, a processor may consist of hardware such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), FPGA (Field Programmable Gate Array) or other programmable logic devices, ASIC (Application Specific Integrated Circuit) or other dedicated circuits for performing specific processing, GPU (Graphic Processing Unit), or NPU (Neural Processing Unit).

[0139] Furthermore, the processor has various units or means that perform the various processes in this embodiment. The hardware may also be a combination of different types of hardware. When multiple hardware components are configured to perform one or more processes of a processor, these components may reside in physically separate devices or in the same device. In any embodiment, the order of the processes performed by the processor is not limited to the order described above and may be changed as appropriate. The hardware is composed of electrical circuits (circuitry) and other components, such as semiconductor elements.

[0140] Furthermore, this embodiment may be implemented by hardware, software, firmware, microcode, or a combination thereof. The software, firmware, and microcode are composed of a program. The program may also be, for example, a group of program modules, each of which may be implemented by a processor configured to perform its respective function. The program may be program code or multiple code segments stored on one or more non-temporary computer-readable media (e.g., storage media or other storage). The program may be divided and stored on multiple non-temporary computer-readable media located on devices that are physically separated from each other. The program code or code segment may represent any combination of procedures, functions, subprograms, routines, subroutines, modules, software packages, classes, or instructions, data structures, or program statements. The program code or code segment may be connected to other code segments or hardware circuits by sending and receiving information, data, arguments, parameters, or memory contents.

[0141] [Examples of application to programs and program products] The medical imaging support method according to the embodiment may be configured as a program or program product on a processor or a computer including a processor, which realizes the functions of each step. A program product is a computer-readable medium, which is a tangible, non-temporary information storage medium on which the program is recorded.

[0142] It is possible to record a program that enables a computer to implement some or all of the processing functions of the information processing device 200 on an optical disk, magnetic disk, semiconductor memory, or other tangible, non-temporary storage medium that is computer-readable, and to provide the program through this storage medium.

[0143] Alternatively, instead of providing programs by storing them on tangible, non-temporary computer-readable media, it is also possible to provide program signals as a download service using telecommunication lines such as the Internet.

[0144] Furthermore, some or all of the processing functions of the information processing device 200 may be implemented by cloud computing, and it is also possible to provide them as SaaS (Software as a Service).

[0145] 〔others〕 The medical imaging device is not limited to the MRI device 10, but may be various devices such as an X-ray CT (Computed Tomography) device. This disclosure is suitable for devices in which imaging is performed while the subject is not in the user's field of view, and for devices that generate relatively loud noises during imaging, making verbal communication difficult.

[0146] The technical scope of the present invention is not limited to the scope described in the embodiments above. The configurations and other elements in each embodiment can be appropriately combined with those in each embodiment without departing from the spirit of the present invention. [Explanation of Symbols]

[0147] 10...MRI device 12...Gantry 14...Bed 15…Tabletop 16...legs 18…IMPORTANT space 102... Static magnetic field generating magnet 104...Gradient coil 106...RF Transmitter Coil 110... Receiving coil 112... Receiver 114...Gradient magnetic field power supply 116... High-frequency magnetic field generator 118... Sequencer 120... Control Unit 122...Operation unit 130... Subject 140... Camera 140A...Camera 140B...Camera 150… Motion sensor 152…Vital Sensors 200… Information Processing Device 202… Processor 204...memory 206... Storage 208… Input / Output Interface 210... Bus 212...Input device 214...Display device 220...MRI Image Generation Unit 222... Inspection window generation unit 224...Sensor information acquisition unit 226...Camera image acquisition unit 228... Operation identification unit 230...Comparison section 232... Vital Information Acquisition Department 234...Judgment section 236... Pop-up generation section 238...Display Control Unit 500... Inspection window screen 502…Popup screen DB...Database F6A... Subject's condition F6B... Subject's condition S1-S7...Steps in the imaging support method S11-S14...Steps for imaging support methods

Claims

1. A medical imaging device for capturing medical images of a subject, A gantry having a bore into which the subject, placed on a bed, is inserted, An motion sensor that acquires information used to identify the first action performed by the subject, A memory in which multiple second actions and notification content corresponding to each of the multiple second actions are registered, Processor and Equipped with, The aforementioned processor, Based on the information obtained by the motion sensor, the first action performed by the subject inserted into the bore is identified. The identified first operation is compared with the plurality of second operations registered in the memory, The notification content corresponding to the second operation that matches the identified first operation among a plurality of second operations registered in the memory is notified to the user. Medical imaging device.

2. The plurality of the above-mentioned second operations each include the same type of operation, with different magnitudes. The medical imaging apparatus according to claim 1.

3. The plurality of the above-mentioned second operations each include the same type of operation with different durations, The medical imaging apparatus according to claim 1.

4. The motion sensor includes any of the following: an optical camera for photographing the subject, a sensor placed on the bed, and a sensor attached to the subject's body. The medical imaging apparatus according to claim 1.

5. The sensors placed on the bed include touch sensors or pressure sensors. The medical imaging apparatus according to claim 4.

6. The sensor attached to the subject's body includes at least one of an acceleration sensor, a gyroscope, and a pressure sensor. The medical imaging apparatus according to claim 4.

7. The processor identifies the first operation by combining information obtained by at least one of the following: part identification using skeletal extraction technology, motion tracking, and pattern recognition using a trained model, with information obtained by the motion sensor. The medical imaging apparatus according to claim 1.

8. The aforementioned processor, The vital information of the subject is obtained, The system notifies the user of predetermined notification content based on the acquired vital information. The medical imaging apparatus according to claim 1.

9. The processor causes the notification content to be displayed as a pop-up on the display device. The medical imaging apparatus according to claim 1.

10. A static magnetic field generator that generates a static magnetic field, A transmitting device that irradiates the subject, who is placed in a static magnetic field space, with high-frequency magnetic field pulses, A gradient magnetic field generator that generates a gradient magnetic field in the aforementioned static magnetic field space, Equipped with, A medical imaging apparatus according to any one of claims 1 to 9.

11. A medical imaging support method that assists in acquiring medical images of a subject using a medical imaging device, The aforementioned medical imaging device is A gantry having a bore into which the subject, placed on a bed, is inserted, An motion sensor that acquires information used to identify the first action performed by the subject, A memory in which multiple second actions and notification content corresponding to each of the multiple second actions are registered, Processor and Equipped with, The aforementioned processor, Based on the information obtained by the motion sensor, the first action performed by the subject inserted into the bore is identified. The identified first operation is compared with the plurality of second operations registered in the memory, The notification content corresponding to the second operation that matches the identified first operation among a plurality of second operations registered in the memory is notified to the user. Medical imaging support methods.

12. A program that causes a computer to execute the medical imaging support method described in claim 11.

Images