Medical image diagnostic system, operation method of medical image diagnostic system, and image display system

JP2024165198A5Pending Publication Date: 2026-07-17FUJIFILM CORP

Patent Information

Authority / Receiving Office: JP · JP
Patent Type: Applications
Current Assignee / Owner: FUJIFILM CORP
Filing Date: 2023-05-16
Publication Date: 2026-07-17

AI Technical Summary

Technical Problem

Existing medical image diagnostic systems do not effectively display images for subjects based on their vital information during examinations, leading to increased psychological stress and potential health issues due to prolonged confinement and movement suppression.

Method used

A medical image diagnostic system that includes a video display device to show images to subjects based on their vital information, such as heart rate, oxygen concentration, and temperature, and adjusts the display based on threshold values to reduce stress and anxiety.

Benefits of technology

The system reduces psychological burden on subjects by displaying relevant images and allowing communication with operators, thereby enhancing examination safety and comfort.

✦ Generated by Eureka AI based on patent content.

Smart Images

Figure 00000000_0000_ABST

Patent Text Reader

Abstract

To provide a medical image diagnostic system capable of displaying an image for a subject under examination by an image diagnostic device on the basis of vital information on the subject, an operation method of the medical image diagnostic system, and an image display system.SOLUTION: A medical image diagnostic system includes: a projector 17 for displaying an image in a mode that enables a subject under MRI examination to visually recognize it in a bore; a vital information detector 19 for detecting vital information on the subject under examination; and a processor. The processor acquires vital information from the vital information detector 18, and performs projection display for a predetermined image by the projector 17 on the basis of the acquired vital information.SELECTED DRAWING: Figure 8

Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a medical image diagnostic system, an operating method of a medical image diagnostic system, and an image display system, and more particularly to a technique for displaying an image that can be viewed by a subject undergoing an examination by an image diagnostic apparatus. [Background technology]

[0002] The time it takes to examine a subject using imaging diagnostic equipment such as a magnetic resonance imaging (MRI) device or an X-ray computed tomography (CT) device is relatively long, with an MRI device taking around 20 to 30 minutes, an X-ray CT device taking around 5 to 10 minutes for a simple test, and around 5 to 20 minutes for a contrast test.

[0003] In addition, imaging using MRI devices and other equipment is performed in a cylindrical imaging space called a "bore," and because bodily movement during the examination can cause image artifacts, it is necessary to minimize bodily movement, including breathing. Being examined for long periods of time in a closed space called a "bore," while suppressing bodily movement, is stressful for the subject.

[0004] As a result, subjects may feel anxious, or become unwell due to an increase in body temperature (fever), an increase in heart rate, or after drug injection. Subjects may be provided with an emergency switch, but as subjects may not want to stop the examination, they may end up not pressing the emergency switch (without sounding the emergency buzzer). Furthermore, during emergency examinations, etc., operators of MRI devices, etc., must keep a close eye on subjects who are not fully conscious while conducting the examination, but because they are also concentrating on the operation screen, they may not be able to keep an eye on changes in the subject.

[0005] Patent Document 1 describes a medical image diagnostic system that acquires vital information of a patient during an examination of the patient using an X-ray CT scanner. When controlling the transition of each of a plurality of steps included in a workflow for examining a patient, the medical image diagnostic system described in Patent Document 1 acquires first information representing a patient's preparation status in a first step among the plurality of steps, acquires second information representing permission of a transition from the first step to a second step, and controls the transition from the first step to the second step based on the first information and the second information.

[0006] Here, the vital information is used to determine the patient's posture and movements, such as whether the patient has closed the door to the CT room or whether the patient has lay down on the top of the bed device, among the multiple steps included in the workflow.

[0007] Patent Document 2 describes a medical image diagnostic system that projects two images with different purposes at different positions. The medical image diagnostic system described in Patent Document 2 projects a first image from one projector onto the inner wall of a bore in a medical image diagnostic device, the first image being intended to relieve stress on the patient during an examination, and projects a second image showing information related to imaging for the patient onto a surface (rear surface) of the exterior of the gantry that has an opening to the bore.

[0008] Here, the second image is an image that contains information such as the patient's electrocardiogram information, body temperature, respiratory rate, pulse rate, etc., as well as the operation screen of the medical image diagnostic system, reconstructed images, imaging conditions, etc., and is an image required by medical professionals. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] JP 2022-94 A [Patent Document 2] JP 2018-29763 A Summary of the Invention [Problem to be solved by the invention]

[0010] Patent Documents 1 and 2 disclose obtaining vital information of a subject undergoing an examination using an image diagnostic device, but do not disclose displaying a predetermined image for the subject based on the vital information.

[0011] The present invention has been made in consideration of the above circumstances, and has an object to provide a medical image diagnostic system, an operating method for a medical image diagnostic system, and an image display system that can display an image for a subject undergoing an examination by an image diagnostic device based on the subject's vital information. [Means for solving the problem]

[0012] The invention according to a first aspect is a medical image diagnostic system comprising an image display device that displays an image in a manner visible to a subject during examination of the subject by an image diagnostic device, a vital information detector that detects vital information of the subject during examination, and a processor, wherein the processor acquires the vital information from the vital information detector and causes the image display device to display a predetermined image based on the acquired vital information.

[0013] According to the first aspect of the present invention, a predetermined image for the subject can be displayed on the image display device based on vital information of the subject under examination.

[0014] In the medical image diagnostic system according to the second aspect of the present invention, in the first aspect, the processor determines whether or not the vital information or a change in the vital information has exceeded a first threshold, and if it is determined that the vital information has exceeded the first threshold, causes an image display to display an image confirming the subject's intention as to whether or not the examination using the imaging diagnostic device can be continued.

[0015] When the vital information or the amount of change in the vital information of the subject during the examination exceeds a first threshold, it is considered that the subject feels unwell. According to the second aspect of the present invention, when the vital information or the amount of change in the vital information of the subject during the examination exceeds a first threshold, an image is displayed on the image display device to confirm the subject's intention as to whether or not the examination can be continued.

[0016] In the medical image diagnostic system according to the third aspect of the present invention, in the first or second aspect, it is preferable that the system further includes a first camera that captures an image of an operator operating the image diagnostic device, and the processor determines whether or not the vital information or a change in the vital information has exceeded a second threshold, and when it determines that the vital information or the change in the vital information has exceeded the second threshold, causes an image of the operator captured by the first camera to be displayed on the image display.

[0017] When the vital information of the subject during the examination exceeds a first threshold, it is considered that the subject feels unwell. According to a third aspect of the present invention, when the vital information of the subject during the examination exceeds a second threshold, an image of the operator is displayed on the image display device, thereby reducing the psychological burden on the subject.

[0018] The medical image diagnostic system according to the fourth aspect of the present invention, in any one of the first to third aspects, preferably further comprises a second speaker for transmitting the voice detected by the first microphone, which is generated by an operator who operates the image diagnostic device, or an automated voice, to a subject under examination. This makes it possible to reduce the psychological burden on the subject through the voice.

[0019] The medical image diagnostic system according to the fifth aspect of the present invention, in the second aspect, preferably includes an intention detector for detecting the intention of the subject with respect to the image for confirming the intention of the subject, and an intention confirmer for transmitting the detection result detected by the intention detector to an operator who operates the image diagnostic device. This allows communication between the subject and the operator, and reduces the psychological burden on the subject.

[0020] A medical image diagnostic system according to a sixth aspect of the present invention, in the fifth aspect, the intention detector is a second microphone that detects the voice of the subject during the examination, a second camera that images the subject, or an operating device operated by the subject, and the intention confirmer is a first speaker that transmits the voice detected by the second microphone to an operator operating the image diagnostic apparatus, a speech recognizer that analyzes the movement of the subject's lips from the image of the subject captured by the second camera to recognize the content of the subject's words, a detector that detects the subject's intention by analyzing the movement of the subject's hands or fingers from the image of the subject captured by the second camera, or an alarm that outputs the result of the operation of the operating device.

[0021] In the medical image diagnostic system according to the seventh aspect of the present invention, in any one of the first to seventh aspects, it is preferable that the vital information of the subject is one or more of electrocardiogram information, heart rate, blood oxygen concentration, respiratory rate, blood pressure, and body temperature.

[0022] In the medical image diagnostic system according to an eighth aspect of the present invention, in any one of the first to seventh aspects, it is preferable that the vital information detector includes a third camera that images the subject during the examination, and detects at least one of the subject's heart rate and respiratory rate by analyzing the image captured by the third camera.

[0023] In the medical image diagnostic system according to the ninth aspect of the present invention, in any of the first to eighth aspects, it is preferable that the vital information detector includes at least one of an ECG sensor that detects electrocardiogram information and / or heart rate, an SpO2 sensor that measures blood oxygen concentration, a bellows that detects respiratory rate, a pressure sensor that detects blood pressure, an optical camera capable of detecting body temperature, an infrared camera or a thermograph.

[0024] A medical image diagnostic system according to a tenth aspect of the present invention is any one of the first to ninth aspects, wherein the vital information detector is a signal processing device that detects vital information based on an image captured by an imaging diagnostic device, an NMR signal obtained from the magnetic resonance imaging device when the imaging diagnostic device is a magnetic resonance imaging device, or a pulse sequence.

[0025] In the medical image diagnostic system according to an eleventh aspect of the present invention, in any one of the first to tenth aspects, the image display is preferably a projector that projects onto a screen visible to the subject, a head-up display, a head-mounted display, a liquid crystal display, or an organic electroluminescence display.

[0026] In a medical image diagnostic system according to a twelfth aspect of the present invention, in any one of the first to eleventh aspects, the image diagnostic apparatus preferably includes a magnetic resonance imaging apparatus, an X-ray CT apparatus, a PET apparatus, a radiation therapy apparatus, or a particle beam therapy apparatus.

[0027] The invention according to a thirteenth aspect is a method for operating a medical image diagnostic system including an image display that displays an image in a manner visible to a subject during examination of the subject by an image diagnostic device, a vital information detector that detects vital information of the subject during examination, and a processor, the method including the steps of the processor acquiring the vital information of the subject from the vital information detector, and the processor causing the image display to display a predetermined image based on the acquired vital information.

[0028] A method of operating a medical image diagnostic system according to a fourteenth aspect of the present invention preferably includes, in the thirteenth aspect, a step in which the processor determines whether or not the acquired vital information or a change in the vital information exceeds a first threshold value, and, when it is determined that the vital information or the change in the vital information exceeds the first threshold value, causes an image display device to display an image confirming the subject's intention as to whether or not the examination using the imaging diagnostic device can be continued.

[0029] A method for operating a medical image diagnostic system according to a 15th aspect of the present invention, in the 13th or 14th aspect, preferably further comprises a first camera for capturing an image of an operator operating an image diagnostic device, and includes a step of a processor determining whether or not the vital information or a change in the vital information exceeds a second threshold, and a step of displaying an image of the operator captured by the first camera on an image display when the processor determines that the vital information or the change in the vital information has exceeded the second threshold.

[0030] The invention of a 16th aspect is a video display system comprising: a video display device that displays an image in a manner visible to a subject during examination of the subject by an imaging diagnostic device; a vital information detector that detects vital information of the subject during examination; and a processor, wherein the processor acquires the vital information from the vital information detector and causes the video display device to display a predetermined image based on the acquired vital information. Effect of the Invention

[0031] According to the present invention, a predetermined image for the subject can be displayed on the image display device based on the vital information of the subject during an examination by an imaging diagnostic device, thereby reducing the psychological burden on the subject. [Brief description of the drawings]

[0032] [Figure 1] FIG. 1 is a perspective view showing an example of an image diagnostic apparatus to which a medical image diagnostic system according to the present invention is applied. [Diagram 2] FIG. 2 is a schematic cross-sectional view of the MRI apparatus shown in FIG. [Diagram 3] FIG. 3 is a diagram showing how the subject's body is turned relative to the MRI apparatus. [Figure 4] FIG. 4 shows the inside of an operation room where the MRI apparatus is operated. [Diagram 5] FIG. 5 is a diagram showing an example of a display screen of a display device that displays vital sign information and the like. [Figure 6]FIG. 6 is a diagram showing another example of the display screen of the display device that displays vital sign information and the like. [Figure 7] FIG. 7 is a diagram showing still another example of the display screen of the display device that displays vital sign information and the like. [Figure 8] FIG. 8 is a configuration diagram of a medical image diagnostic system according to the present invention. [Figure 9] FIG. 9 is a block diagram showing an embodiment of the hardware of a signal processing device which is a main device constituting a medical image diagnostic system. [Figure 10] FIG. 10 is a diagram showing a first example of an image displayed on the subject side. [Figure 11] FIG. 11 is a diagram showing a second example of an image displayed on the subject side. [Figure 12] FIG. 12 is a diagram showing a third example of an image displayed on the subject side. [Figure 13] FIG. 13 is a diagram showing a fourth example of an image displayed on the subject side. [Figure 14] FIG. 14 is a diagram showing a fifth example of an image displayed on the subject side. [Figure 15] FIG. 15 is a conceptual diagram illustrating an embodiment of an utterance recognizer. [Figure 16] FIG. 16 is a perspective view of a main part of an example of an operating device operated by a subject. [Figure 17] FIG. 17 is a perspective view showing another example of an operating device operated by a subject. [Figure 18] FIG. 18 is a diagram showing another embodiment of the image display device that displays images in a manner that can be visually recognized by the subject during an examination using an MRI apparatus. [Figure 19] FIG. 19 is a chart showing an example of detection of vital information, and the relationship between the subject's condition and the display content of the image displayed on the subject's side. [Figure 20] FIG. 20 is a flow chart showing another embodiment of a method for operating a medical image diagnostic system according to the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0033] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of a medical image diagnostic system, an operating method of the medical image diagnostic system, and an image display system according to the present invention will now be described with reference to the accompanying drawings.

[0034] FIG. 1 is a perspective view showing an example of an image diagnostic apparatus to which a medical image diagnostic system according to the present invention is applied.

[0035] The imaging diagnostic device shown in FIG. 1 is a magnetic resonance imaging device (MRI device) 10, and includes a gantry 11 and a bed 13 with a tabletop 13A arranged on the front side of a bore 12, which is a cylindrical imaging space provided in the gantry 11.

[0036] The image diagnostic device in this example is an MRI device 10, but the present invention is not limited to this and includes an X-ray CT device, a PET (Positron Emission Tomography) device, a radiation therapy device, or a particle beam therapy device. The present invention is suitable for devices with relatively long examination and treatment times.

[0037] FIG. 2 is a schematic cross-sectional view of the MRI apparatus shown in FIG.

[0038] 2, an MRI magnet 10A and various other coils are arranged in a gantry 11, and a subject 5 lying on a top board 13A is moved to a bore 12 so that an examination site of the subject 5 is located at the center of a static magnetic field in the bore 12 by moving the top board 13A to a bore 12. An RF (Radio Frequency) coil 10B for receiving FID (Free Induction Decay) from the human body is arranged at the examination site of the subject 5. In this example, the abdomen of the subject 5 is the examination site, and the RF coil 10B is arranged on the abdomen.

[0039] A second camera 15 (15A, 15B) which is a visible light camera and a second microphone 16 (16A, 16B) are disposed at the upper part of both ends of the bore 12. In addition, in FIG. 2, the second camera 15A and the second microphone 16A are disposed at the upper part of the left end of the bore 12, and the second camera 15B and the second microphone 16B are disposed at the upper part of the right end of the bore 12.

[0040] The two second cameras 15A, 15B each capture an image of the subject 5 and output a video (image), and at least one of the two second cameras 15A, 15B captures an image including the face area of the subject 5.

[0041] The two second microphones 16A and 16B each detect the voice emitted by the subject 5. The second microphones 16A and 16B are preferably non-magnetic microphones that use piezoelectric ceramic, which is a non-magnetic material, in the sound receiving portion.

[0042] A projector 17 is disposed at one end (the left end in FIG. 2) of the top board 13A, and the projector 17 projects an image onto a screen 17A disposed on the ceiling inside the bore 12. This projector 17 functions as an image display device that displays an image in a manner that is visible to the subject 5 during an examination using the MRI device 10, and the subject 5 can view the image projected onto the screen 17A during the examination. Note that the screen 17A may not be provided, and the ceiling inside the bore 12 may be used as the screen.

[0043] 2, 18 is a vital information detector that measures one or more of electrocardiogram information, heart rate (pulse rate), blood oxygen concentration, respiratory rate, blood pressure, and body temperature of the subject 5. The vital information detector 18 is not limited to being placed on the back of the subject 5.

[0044] Specific examples of vital information detector 18 include at least one of an ECG (electrocardiogram) sensor that detects electrocardiogram information and / or heart rate, an SpO2 sensor that measures blood oxygen concentration, a bellows that detects respiratory rate, a pressure sensor that detects blood pressure, and an optical camera, infrared camera, or thermography capable of detecting body temperature.

[0045] The vital information detector may be a signal processing device that detects vital information based on an MRI image captured by the image diagnostic device (MRI device 10), an NMR (Nuclear Magnetic Resonance) signal (the signal itself acquired by an MRI examination) obtained from the MRI device when the image diagnostic device is an MRI device, or a pulse sequence. Other sensors (optical sensors, ultrasonic sensors, etc.) and combinations of these may also be used as the vital information detector.

[0046] For example, the respiration rate and heart rate can be detected by detecting the movement of the diaphragm and the movement of the heart from the MRI image. Note that these movement detections are used to reduce artifacts in the MRI image. Vital information may also be detected using a machine learning model that inputs images of the subject, MRI images, etc.

[0047] FIG. 3 is a diagram showing how the subject's body is turned relative to the MRI apparatus.

[0048] FIG. 3(A) shows the case where the subject 5 enters the bore 12 head first (head first), and FIG. 3(B) shows the case where the subject 5 enters the bore 12 feet first (foot first).

[0049] Head-first or feet-first is selected depending on the examination site of the subject 5. In this example, second cameras 15A, 15B and second microphones 16A, 16B are disposed at both ends of the bore 12 so that the facial region of the subject 5 can be photographed and the voice can be detected regardless of whether head-first or feet-first is selected.

[0050] In this example, there are two second cameras 15 (15A, 15B) and two second microphones 16 (16A, 16B), but the number is not limited to this and may be one, or three or more. Also, the second camera 15 and the second microphone 16 are not limited to being placed in the MRI device 10, and may be placed near the MRI device 10.

[0051] FIG. 4 shows the inside of an operation room where the MRI apparatus is operated.

[0052] As shown in FIG. 4, the operation room 2 is equipped with a signal processing device 20 that controls the MRI device 10 installed in the examination room, processes the NMR signals output from the MRI device 10, and generates MRI images.

[0053] The signal processing device 20 can be configured using a computer. The computer applied to the signal processing device 20 may be a personal computer or a workstation. An operator 32 can control the operation of the MRI apparatus 10 through the signal processing device 20 by using an operation unit 28 such as a keyboard and a mouse.

[0054] In addition, the signal processing device 20 in this example has some of the functions of the medical image diagnostic system according to the present invention (i.e., the function as an "image display system" that displays images, etc. for the subject), the details of which will be described later.

[0055] The signal processing device 20 includes a display 24 for displaying MRI images and the like, a first microphone 25 for detecting the voice of an operator 32, and a first speaker 26 for generating voices and the like uttered by a subject 5 during an examination.

[0056] 4, 2A is a window through which an operator 32 can view the state of the examination room. 29 is a display that displays images captured by the second cameras 15A and 15B, vital sign information, and the like. 30 is a first camera that captures an image of the operator 32.

[0057] FIG. 5 is a diagram showing an example of a display screen of a display device that displays vital information and the like, and is an enlarged view of the display screen of display device 29 shown in FIG.

[0058] As shown in FIG. 5, the display screen of display 29 displays images of subject 5 captured by second cameras 15A and 15B. In this example, an image of the upper body of subject 5 captured by second camera 15A and an image of the lower body of subject 5 captured by second camera 15B are displayed.

[0059] Also displayed as vital information of the subject 5 during the examination are blood oxygen concentration (SpO2) 29A, pulse rate 29B, respiratory rate 29C, body movement (vibration waveform) 29D, and the like.

[0060] The operator 32 can observe the state of the subject 5 during the examination (for example, facial pallor, facial stiffness, eye movement, etc.) from the display screen of the display 29, and can also check the vital information of the subject 5. Note that Fig. 5 shows the vital information of the subject 5 at the start of the examination.

[0061] 6 and 7 are diagrams showing other examples of the display screen of the display device displaying vital information and the like, and show a case where the vital information has changed from the vital information at the start of the examination shown in FIG. 5.

[0062] In the example shown in FIG. 6, the subject 5 has an increased pulse rate 29B and an increased respiratory rate 29C.

[0063] In the example shown in FIG. 7, the blood oxygen concentration (SpO2) 29A of the subject 5 has decreased, and the respiratory rate 29C is unmeasurable ("-"), indicating that breathing has stopped.

[0064] It is preferable that any significant change in vital information be displayed on the display screen of the display device 29 with a change in color or brightness, for example, so that the operator 32 can notice the change.

[0065] [Medical image diagnostic system configuration] FIG. 8 is a configuration diagram of a medical image diagnostic system according to the present invention.

[0066] The medical image diagnostic system shown in FIG. 8 is configured by connecting a second camera 15, a second microphone 16, a second speaker 16-1 (see FIG. 18), a projector 17, a vital information detector 18, an operator 19 described later, and an imaging section (not shown) including a pulse sequence section of the MRI apparatus 10, etc., which are arranged in the MRI apparatus 10, with a signal processing device 20 in the operation room 2 via a network 50 such as a LAN (Local area network).

[0067] FIG. 9 is a block diagram showing an embodiment of the hardware of a signal processing device which is a main device constituting a medical image diagnostic system.

[0068] The signal processing device 20 shown in FIG. 9 is configured by a computer or the like as described above, and includes a processor 21, a memory 22, an input / output interface 23, displays 24 and 29, a first speaker 26, an operation unit 28, a first camera 30, and the like.

[0069] The processor 21 is composed of a CPU (Central Processing Unit) etc., and controls each part of the signal processing device 20 and various devices arranged in the MRI device 10, and realizes various functions described later by executing a signal processing program stored in the memory 22.

[0070] The memory 22 is one or more memories including a flash memory, a read-only memory (ROM), a random access memory (RAM), a hard disk drive, etc. The flash memory, the ROM, and the hard disk drive are non-volatile memories that store an operation system, a signal processing program that causes the processor 21 to function as the signal processing device 20, various programs including a machine learning model, and images projected by the projector 17, etc.

[0071] The RAM functions as a working area for processing by the processor 21, and also temporarily stores programs and the like stored in the non-volatile memory. Note that the processor 21 may incorporate a part of the memory 22 (RAM).

[0072] The input / output interface 23 includes a communication unit connectable to the network 50, and a connection unit connectable to an external device. As the connection unit connectable to an external device, a Universal Serial Bus (USB), a High-Definition Multimedia Interface (HDMI) (HDMI is a registered trademark), etc. can be applied.

[0073] The processor 21 communicates with various devices provided in the MRI apparatus 10 via the input / output interface 23 and the network 50, thereby transmitting and receiving necessary information.

[0074] The display 24 displays MRI images, text indicating what the subject 5 says during the examination, MRI images, etc., and is used as part of a GUI (Graphical User Interface) when accepting input from the operation unit 28.

[0075] Furthermore, the display 29 displays an image of the subject, vital information, and the like, as shown in Fig. 5. In this example, two displays 24, 29 are provided, but the information displayed by these displays 24, 29 may be displayed by dividing the display screen of one display into two screens, or may be displayed by switching the screen.

[0076] The first microphone 25 detects the voice uttered by the operator 32 and outputs a voice signal indicating the detected voice to the processor 21. The processor 21 performs voice recognition on the voice signal input from the first microphone 25 and projects and displays the recognized characters as part of an image for the subject, or generates the recognized characters as the voice uttered by the operator 32 from a speaker for the subject (the second speaker 16-1 shown in FIG. 18).

[0077] The first speaker 26 generates the voice uttered by the subject 5 during the examination, and when the processor 21 inputs an audio signal indicating the voice uttered by the subject 5 from the second microphone 16, the processor 21 outputs the audio signal to the first speaker 26 and generates the voice uttered by the subject 5 from the first speaker 26. It is preferable that the processor 21 performs a filter process on the audio signal input from the second microphone 16 to reduce noise generated by the MRI apparatus 10.

[0078] The operation unit 28 includes a mouse, a keyboard, etc., and functions as a part of a GUI that uses the display operation window of the display 24 and receives input from the operator 32 .

[0079] The first camera 30 photographs an operator 32 as shown in FIG. 4, and the processor 21 can cause the projector 17 to display the image of the operator 32 photographed by the first camera 30.

[0080] [Outline of medical imaging diagnostic systems] The medical image diagnostic system having the above configuration detects vital information of the subject 5 under examination, and displays a predetermined image for the subject on the image display device based on the detected vital information. In this example, the predetermined image is projected onto the screen 17A by the projector 17.

[0081] In a specific embodiment, the medical image diagnostic system judges whether the detected vital information or the amount of change in the vital information exceeds a first threshold, and if so, causes the projector 17 to project and display an image for confirming the subject's intention as to whether the examination by the MRI apparatus 10 can be continued or not. This allows the medical image diagnostic system or the operator 32 to confirm the subject's intention as to whether the examination can be continued or not, and also reduces the psychological burden on the subject 5.

[0082] In another specific embodiment, the medical image diagnostic system determines whether the detected vital information or the amount of change in the vital information exceeds a second threshold, and if so, projects and displays an image of the operator 32 by the projector 17. The subject 5 feels reassured by seeing the image of the operator 32, and this reduces the psychological burden on the subject 5.

[0083] The first threshold and the second threshold may be the same threshold or different thresholds. The first threshold and the second threshold may be set arbitrarily by the operator 32. Needless to say, these thresholds differ depending on the type of vital information.

[0084] [Medical imaging diagnostic system functions] The processor 21 of the signal processing device 20 acquires vital information from the vital information detector 18, compares the vital information or the amount of change in the vital information with a threshold value (first threshold value or second threshold value), and when it determines that the vital information or the amount of change in the vital information exceeds the threshold value, causes the projector 17 to project and display an image for the subject.

[0085] <First example of image displayed on the patient's side> FIG. 10 is a diagram showing a first example of an image displayed on the subject side.

[0086] The image shown in FIG. 10 is displayed, for example, in the following cases.

[0087] The image 170 shown in FIG. 10 is an image that is displayed when an abnormality is detected in the subject's body based on vital information or changes in vital information (e.g., heart rate or pulse, changes in electrocardiogram information, changes in facial expression) in order to prevent abnormalities in the internal device (such as an MR-compatible pacemaker) or the body from worsening during the examination.

[0088] When the heart rate (pulse rate) or electrocardiogram information of subject 5 becomes irregular or the subject's facial expression becomes stiff during the examination, it is possible that the subject is conscious and alert, but that the MR-compatible pacemaker may be malfunctioning or that something abnormal is happening to his or her body.

[0089] Therefore, when the processor 21 determines the state of the subject 5 based on the vital information or the amount of change in the vital information, it displays an image 170 shown in FIG.

[0090] The image 170 shown in FIG. 10 includes text information 171 stating "An abnormality has been detected in the vital signs," and an icon 172 indicating "continue examination" and an icon 173 indicating "stop examination," as images to confirm the subject's intention as to whether or not the examination can be continued.

[0091] The subject 5 can convey to the medical image diagnostic system or the operator 32 his / her intention as to whether or not the examination can be continued by selecting the icon 172 or 173 as described later.

[0092] According to the example shown in FIG. 10, it is possible to perform safer MRI examinations on subjects into whom MR-compatible devices are inserted, the number of which is expected to increase in the future.

[0093] In addition, in addition to the heart rate (pulse rate) and electrocardiogram information, the vital information in this example also includes "changes in facial expression" as one of the amounts of change in vital information, but is not limited to these.

[0094] <Second example of image displayed on the patient's side> FIG. 11 is a diagram showing a second example of an image displayed on the subject side.

[0095] The image shown in FIG. 11 is displayed, for example, in the following cases.

[0096] Image 170 shown in FIG. 11 is an image that is displayed to inform subject 5 and operator 32 of suspected side effects and to assist in ensuring the safety of the examination when changes in blood oxygen concentration (SpO2), pulse rate, respiratory rate, and in some cases facial changes indicate that subject 5 is experiencing side effects from the medication.

[0097] When subject 5 experiences a sudden change in SpO2, a drop in blood pressure (including facial pallor), and an increase in respiratory rate after the injection of a contrast agent, subject 5 may be conscious or may be unconscious, and it is possible that side effects from the contrast agent are occurring.

[0098] Therefore, when the processor 21 determines the state of the subject 5 based on the vital information or the amount of change in the vital information, it displays an image 170 shown in FIG.

[0099] The image 170 shown in FIG. 11 includes text information 171 saying "There may be side effects from the contrast agent," an icon 172 indicating "Continue the examination," an icon 173 indicating "Stop the examination," and an image 174 (small image size) showing the operator 32 being photographed by the first camera 30.

[0100] By selecting the icon 172 or 173, the subject 5 can convey to the medical image diagnostic system or the operator 32 the subject's intention as to whether or not the examination can be continued.

[0101] According to the example shown in FIG. 11, it is possible to carry out an examination without forcing the subject 5 to do something unreasonable, and it is also possible to provide a rapid first aid.

[0102] <Third example of image displayed on the patient's side> FIG. 12 is a diagram showing a third example of an image displayed on the subject side.

[0103] The image shown in FIG. 12 is displayed, for example, in the following cases.

[0104] Image 170 shown in FIG. 12 is an image that is displayed when a fever state of subject 5 and the accompanying increased anxiety are detected due to a change in temperature or body temperature caused by MR imaging, in order to alleviate the anxiety of subject 5 by checking the level of fever with subject 5 and informing him / her of the remaining test status.

[0105] During the examination, depending on the type of imaging sequence, the subject's 5 body temperature may rise suddenly (increase in SAR (specific absorption ratio)), and as the temperature accumulates over time, the subject may feel heat around the examination site. The subject's 5 state may be clear-headed, but may be enduring the heat, or may be so stressed or anxious that he or she does not want to undergo an MRI examination in the future. In extreme cases, the subject may even suffer from mild burns.

[0106] Therefore, when the processor 21 determines the state of the subject 5 based on the vital information or the amount of change in the vital information, it displays an image 170 shown in FIG.

[0107] The image 170 shown in FIG. 12 includes text information 171 saying "Do you feel a high temperature?", an icon 172 indicating "Continue the test", an icon 173 indicating "Stop the test", and an icon 175 indicating an estimate of the remaining time of the test.

[0108] By selecting the icon 172 or 173, the subject 5 can convey to the medical image diagnostic system or the operator 32 the subject's intention as to whether or not the examination can be continued.

[0109] According to the example shown in FIG. 12, it is possible to perform an examination that does not put strain on the subject 5, and as a result, the psychological burden on the subject 5 can be reduced and the examination can be always performed safely.

[0110] <Fourth example of image displayed on the patient's side> FIG. 13 is a diagram showing a fourth example of an image displayed on the subject side.

[0111] The image shown in FIG. 13 is displayed, for example, in the following cases.

[0112] Image 170 shown in FIG. 13 is an image that is displayed in order to reduce the anxiety of subject 5 by informing subject 5 of an image of operator 32 and the remaining test status when increasing anxiety of subject 5 is detected due to changes in heart rate, pulse rate, or respiratory rate.

[0113] When the subject 5 experiences a significant increase in heart rate, pulse rate, or respiratory rate during the examination, the subject 5 may be psychologically alert, but may gradually become unable to tolerate the long duration of the examination or the confined space, which may cause anxiety or increased tension.

[0114] Therefore, when the processor 21 determines the state of the subject 5 based on the vital information or the amount of change in the vital information, it displays an image 170 shown in FIG.

[0115] The image 170 shown in FIG. 13 includes text information 171 stating "Vital signs are increasing significantly", an icon 172 indicating "Continue testing", an icon 173 indicating "Stop testing", an image 174 showing the operator 32 being photographed by the first camera 30, and an indication of the remaining time of the test 175.

[0116] By selecting the icon 172 or 173, the subject 5 can convey to the medical image diagnostic system or the operator 32 the subject's intention as to whether or not the examination can be continued.

[0117] According to the example shown in FIG. 13, it is possible to perform an examination that does not put strain on the subject 5, and as a result, the psychological burden on the subject 5 can be reduced and a safe examination can always be performed.

[0118] <Fifth example of image displayed on the patient's side> FIG. 14 is a diagram showing a fifth example of an image displayed on the subject side.

[0119] The image shown in FIG. 14 is displayed, for example, in the following cases.

[0120] Image 170 shown in FIG. 14 is an image that is displayed to rescue subject 5 through communication between subject 5 and operator 32 when it is detected that subject 5 is in a critical condition due to changes in SpO2 and respiratory rate (see FIG. 7).

[0121] When a significant drop in SpO2 or respiratory arrest occurs in subject 5 during an examination, it is possible that subject 5's condition is deteriorating and undergoing a sudden change in vital signs, and that he or she may be semi-conscious or have lost consciousness.

[0122] Therefore, when the processor 21 determines the state of the subject 5 based on the vital information or the amount of change in the vital information, it displays an image 170 shown in FIG.

[0123] An image 170 shown in FIG. 14 includes an image 176 showing the operator 32 captured by the first camera 30, and text information 177 saying "Can you hear me?".

[0124] In this case, the voice generated by the operator 32 is detected by the first microphone 25 and played by the second speaker 16-1 for the subject, and conversely, the voice generated by the subject 5 is detected by the second microphone 16 and played by the first speaker 26 for the operator, thereby enabling communication by voice between the subject 5 and the operator 32. Also, the second speaker 16-1 may be configured to play a preset automatic voice according to the displayed image, etc.

[0125] Also, the voice generated by the operator 32 may be recognized and converted into text information to be displayed on the projected image 170, and similarly the voice generated by the subject 5 may be recognized or the contents of what the subject 5 says may be recognized from the movement of the subject's lips, and the recognized information may be displayed on the display 24 or 29 for the operator. In this way, the subject 5 and the operator 32 can communicate with each other using the displayed text information.

[0126] According to the example shown in FIG. 14, it is possible to carry out an examination without forcing the subject 5 to do something unreasonable, and it is also possible to provide a rapid first aid.

[0127] [Embodiments of an intention detector and an intention confirmer] Possible intention detectors for detecting the intention of subject 5 with respect to image 170 that confirms the intention of subject 5 include a second microphone 16 that detects the sound produced by subject 5, a second camera 15 that functions as a third camera that captures the facial area or hand area of subject 5, and an operator 19 that accepts manual operation by subject 5.

[0128] On the other hand, the intention confirmer transmits the detection result detected by the intention detector to the operator 32. The intention confirmer for the second microphone 16 which is an intention detector is a first speaker for the operator which transmits the voice detected by the second microphone 16 to the operator 32.

[0129] In addition, the intention confirmation device for the second camera 15 is a speech recognition device that analyzes the image captured by the second camera 15 and recognizes the content of the speech of the subject 5 based on the movement of the subject's 5 lips (so-called "lip syncing"), or a detector that analyzes the image captured by the second camera 15 and detects the intention of the subject 5 based on the movement of the subject's 5 hands or fingers.

[0130] Furthermore, the intention recognizer for the operating device 19 is an annunciator that outputs the operation result of the operating device 19.

[0131] <Utterance Recognizer> FIG. 15 is a conceptual diagram illustrating an embodiment of an utterance recognizer.

[0132] As shown in FIG. 15, the processor 21 functions as an utterance recognizer 21A.

[0133] The utterance recognizer 21A is a lip reading section that reads characters from the movement of the lips of the subject 5, and in this example, a trained machine learning model is used, and an image including the facial area of the subject 5 captured by the second camera 15 is input.

[0134] The processor 21 can read and use a trained machine learning model stored in advance in the memory 22. As the machine learning model, various learning models such as an end-to-end deep learning network, a convolutional neural network, and a support vector machine can be used.

[0135] The utterance recognizer 21A in this example outputs multiple characters (a string of characters indicating the content of the utterance) uttered by the subject 5 one by one from an input video showing the lip movement of the subject 5, but it is preferable that the utterance recognizer 21A further has a function of performing natural language processing on the string of characters output from the utterance recognizer 21A to determine whether the string of characters is a meaningful utterance, and, if there is an error as a result of the natural language processing on the string of characters, correcting it to make it the correct utterance content.

[0136] The utterance recognizer 21A is effective when the voice of the subject 5 detected by the second microphone 16 cannot be heard (when the subject's voice is quiet or when there is a lot of noise during the MRI examination).

[0137] <Detector> The processor 21 functions as a detector that detects the intention of the subject 5 by analyzing the movement of the hand or fingers of the subject 5 from the image of the subject 5 captured by the second camera 15.

[0138] This detector acquires a video (image) captured by the second camera 15, and detects the hand movement of the subject 5 in the image. For example, the detector combines a hand icon with the image 170 shown in Fig. 10, and moves the hand icon according to the hand movement.

[0139] The subject 5 moves his / her hand while watching the image 170 to move the hand icon onto the “Continue Examination” icon 172 or onto the “Stop Examination” icon 173 .

[0140] The subject 5 moves the hand icon onto the "continue examination" icon 172 or onto the "stop examination" icon 173, and then transmits the intention to "continue examination" or "stop examination" by, for example, tapping with the index finger. The detector detects the above-mentioned hand movement of the subject 5 from the image captured by the second camera 15, thereby detecting the subject's 5 intention to "continue examination" or "stop examination."

[0141] <Operator> FIG. 16 is a perspective view of a main part of an example of an operating device operated by a subject.

[0142] The operating device 19 shown in FIG. 16 is, for example, a rubber bulb switch 190 that also serves as an emergency switch.

[0143] The rubber bulb switch 190 is carried by the subject 5 for emergency use, and the subject 5 during the examination presses (tightly grips) the rubber bulb switch 190 in the event of an emergency. The pressure change caused by the operation of this rubber bulb switch 190 is detected by a pressure switch (not shown) via a tube 190B.

[0144] In this example, the rubber bulb switch 190 also serves as an intention detector for detecting the intention of the subject 5 as to whether or not the examination can be continued.

[0145] For example, the subject 5 presses the rubber bulb switch 190 for a long time when using it for normal emergency use, presses the rubber bulb switch 190 once briefly when selecting "continue test", and presses the rubber bulb switch 190 twice briefly when selecting "stop test". Note that the pressing pattern of the rubber bulb switch 190 is not limited to this.

[0146] When the processor 21 detects that the rubber bulb switch 190 has been pressed and held, the processor 21 performs processing such as stopping the MRI apparatus 10.

[0147] On the other hand, when the processor 21 detects that the rubber ball switch 190 has been pressed with a pressing pattern indicating "continue inspection" or "stop inspection," it functions as a detector that outputs the operation result assigned according to that pressing pattern ("continue inspection" or "stop inspection").

[0148] FIG. 17 is a perspective view showing another example of an operating device operated by a subject.

[0149] The operating device 19 shown in FIG. 17 is a push button switch 192 having push button portions 192A and 192B made up of two air balloons.

[0150] Push button switch 192 has two tubes 192C whose internal pressure changes in response to pressing of push button portion 192A or 192B, and the pressure change within tube 192C is detected by a pressure sensor (not shown).

[0151] For example, when processor 21 detects that push button unit 192A has been pressed, it functions as an alarm that outputs an operation result indicating “Continue inspection” assigned to push button unit 192A, and when processor 21 detects that push button unit 192B has been pressed, it functions as an alarm that outputs an operation result indicating “Stop inspection” assigned to push button unit 192B.

[0152] <Another embodiment of the image display device> FIG. 18 is a diagram showing another embodiment of the image display device that displays images in a manner that can be visually recognized by the subject during an examination using an MRI apparatus.

[0153] The image display shown in Figure 18 is composed of a projector (not shown), a rear projection screen 60 onto which an image is projected from the projector, and a reflecting mirror 62 that allows the rear projection screen 60 to be viewed by the subject 5 lying on his / her back on the tabletop 13A.

[0154] The rear projection screen 60 and the reflecting mirror 62 are disposed on a support member 63 attached to the top plate 13A.

[0155] When an image is projected from the projector onto the rear projection screen 60 , the subject 5 can view the image projected onto the rear projection screen 60 via the reflecting mirror 62 .

[0156] A camera for capturing an image of the face region of the subject 5 can be attached to the outer periphery of the reflecting mirror 62. A second speaker 16-1 for the subject can be embedded in a head holder 70 for holding the head of the subject 5 so as not to move. This second speaker 16-1 can generate the voice of the operator 32 when communicating with the operator 32. The second speaker 16-1 is preferably a non-magnetic speaker that uses piezoelectric ceramic, which is a non-magnetic material, in its sound-producing portion.

[0157] Other embodiments of the image display that displays images in a manner that can be seen by the subject during examination using the MRI apparatus are not limited to the one shown in FIG. 18, and may include a head-up display that displays a virtual image (aerial image), a head-mounted display that is worn on the subject's head, a liquid crystal display, or an organic EL display.

[0158] <Display contents such as images shown to the subject> FIG. 19 is a chart showing an example of detection of vital information, and the relationship between the subject's condition and the display content of the image displayed on the subject's side.

[0159] We have used Figures 10 to 14 to explain the first to fifth examples of images displayed on the subject side, and the diagram shown in Figure 19 includes the display contents of the images corresponding to Figures 10 to 14.

[0160] That is, the vital information, the subject's condition, and the display contents of the image when the image shown in FIG. 10 is displayed correspond to the third chart shown in FIG.

[0161] Similarly, Figure 11 corresponds to the fourth diagram shown in Figure 19, Figure 12 corresponds to the fifth diagram shown in Figure 19, Figure 13 corresponds to the first diagram shown in Figure 19, and Figure 14 corresponds to the second diagram shown in Figure 19.

[0162] Incidentally, the images displayed on the subject side based on the vital information are not limited to the images shown in FIGS. 10 to 14 and the display contents shown in the chart of FIG. 19, but various images can be displayed.

[0163] [Operation method of medical image diagnostic system] FIG. 20 is a flow chart illustrating an embodiment of a method of operating a medical image diagnostic system according to the present invention.

[0164] The processing of each step of the operating method of the medical image diagnostic system shown in FIG. 20 corresponds to the processing performed by the processor 21 of the signal processing device 20 shown in FIG.

[0165] In FIG. 20, the processor 21 determines whether or not the examination of the subject 5 by the MRI apparatus 10 has been completed (step S10), and if not, executes the processing of the following steps.

[0166] First, the processor 21 acquires vital information of the subject 5 during the examination from the vital information detector 18 (step S12). Note that the processor 21 preferably temporarily stores the vital information of the subject 5 before the start of the examination or immediately after the start of the examination. This is to use it as a reference when determining the amount of change in the vital information during the examination.

[0167] Next, the processor 21 judges the condition of the subject 5 based on the vital information acquired in step S12 (step S14, see the table of FIG. 19).

[0168] The processor 21 determines whether or not it is necessary to confirm the subject 5's intention to continue the test or to stop the test (step S16). This determination can be made according to the state of the subject 5 determined in step S14. Specifically, the processor 21 compares the vital information with preset thresholds (first threshold, second threshold), or compares the amount of change in the vital information with a threshold set for that amount of change, determines whether the vital information or the amount of change in the vital information exceeds the corresponding threshold, and confirms the subject's intention to continue the test or to stop the test based on the determination result.

[0169] In step S16, if it is determined that it is necessary to confirm the intention of the subject 5, the processor 21 displays an image for confirming the intention, an image of the operator, and the like (step S18, see FIGS. 10 to 14).

[0170] Next, the processor 21 determines whether or not the subject 5 has expressed an intention to continue the test (step S20). This intention can be confirmed based on the subject's voice detected by the second microphone 16 for the subject, the movement of the subject's lips, the movement of the hands or fingers captured by the second camera 15 that captures the subject 5, or the manual operation of the operating device 19, as described above.

[0171] In step S20, if the subject 5 indicates his / her intention to continue the test (if "Yes"), the processor 21 makes the image displayed in step S18 non-displayable, and then transitions to step S10 (step S22). In this case, in step S16, it is determined again whether or not it is necessary to confirm the subject 5's intention to continue or stop the test, and it is preferable that the determination criterion (threshold) at this time is set to be larger than that of the previous determination. This is to prevent the image that has been made non-displayable from being displayed repeatedly.

[0172] In step S20, if the subject 5 has not expressed an intention to continue the test, the process proceeds to step S24, where the processor 21 determines whether or not the subject 5 has expressed an intention to stop the test.

[0173] In step S24, if the subject 5 expresses an intention to stop the examination (if "Yes"), the processor 21 causes the display 24 and / or display 29 visible to the operator 32 to display a message indicating that the subject 5 has expressed an intention to stop the examination and an option to continue / stop the examination (step S28).

[0174] The operator 32 decides whether to continue or stop the MRI examination based on the subject 5's intention to stop the examination displayed on the display 24 and / or the display 29, and on the subject's vital information, etc., and selects whether to continue or stop the examination by operating the operating unit 28, such as a mouse (step S30).

[0175] In step S30, when the operator 32 selects to continue the examination, the processor 21 displays a message indicating that the examination will continue (for example, a message saying "The examination will continue") as an image for the subject (step S32), and then transitions to step S10.

[0176] In step S32, a message such as "There are xx minutes left in the examination" may also be displayed. The remaining time may be calculated automatically from the progress of the examination, or may be manually input by the operator 32. Furthermore, the message may be manually input by the operator 32, or may be selected from a set of standard messages.

[0177] On the other hand, when the operator 32 selects to stop the examination in step S30, the processor 21 stops the examination by the MRI apparatus 10 (step S34).

[0178] Furthermore, in step S24, if the subject 5 does not express an intention to stop the examination (if "No"), the processor 21 determines whether or not a certain time has passed since the image was displayed (step S26).

[0179] If a certain time has not passed since the image was displayed, the process transitions to step S20. If a certain time has passed since the image was displayed, the process transitions to step S30. In this case, in step S30, since the subject 5 does not respond to the image displayed to confirm the intention to continue or stop the examination, the operator 32 determines whether to continue or stop the examination by operating the operation unit 28 such as a mouse, taking into consideration whether the subject 5 is drowsy or unconscious and / or vital information, and thus selects whether to continue or stop the examination.

[0180] [others] In this embodiment, when there is no need to display an image to confirm the subject 5's intention to continue or stop the examination (for example, when vital information is below a threshold value or when the subject 5 expresses an intention to continue the examination), an image may be displayed to relax the subject 5 during the examination.

[0181] In this embodiment, the hardware structure of a processing unit that executes various processes, such as a CPU, is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacture, and a dedicated electric circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor having a circuit configuration designed specifically for executing specific processes.

[0182] One processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as represented by a computer such as a client or server, there is a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0183] Moreover, the hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.

[0184] Furthermore, the present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention. [Explanation of symbols]

[0185] 10...MRI device 15…Second camera 16…Second microphone 17...Projector 18...Vital Signs Detector 19...Operator 20...Signal processing device 24...Indicator 25…1st microphone 26…1st speaker 30…1st camera 50…Network

Claims

1. an image display that displays an image in a manner that is visible to a subject during an examination of the subject by the image diagnostic device; a vital information detector for detecting vital information of the subject during the examination; a processor; The processor, Acquiring vital information from the vital information detector; displaying a predetermined image on the image display device based on the acquired vital information; Medical imaging diagnostic system.

2. The processor, determining whether the vital information or a change in the vital information exceeds a first threshold; When it is determined that the vital information or the amount of change in the vital information exceeds the first threshold, an image is displayed on the image display device to confirm the subject's intention as to whether or not the examination using the image diagnostic apparatus can be continued. The medical image diagnostic system according to claim 1 .

3. A first camera is provided for capturing an image of an operator who operates the diagnostic imaging apparatus. The processor, determining whether the vital information or a change in the vital information exceeds a second threshold; when it is determined that the vital information or the amount of change in the vital information exceeds the second threshold, an image of the operator captured by the first camera is displayed on the image display device.