Medical image diagnostic system, method for operating medical image diagnostic system and image display system
By detecting and displaying the vital sign information of the subject and the operator's images in the medical image diagnosis system, the physical discomfort caused by physical movement and closed space pressure during the examination and the emergency switch was not pressed. The problem has improved the safety of the inspection and the communication skills of the examined person.
Patent Information
- Application Number
- CN202410605621.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-16
- Filing Date
- 2024-05-15
- Publication Date
- 2024-11-26
AI Technical Summary
In medical image diagnosis systems, the subject's pressure caused by body movement and long-term enclosing space during the MRI or X-ray CT device inspection may lead to physical discomfort and the emergency switch is not pressed, making it difficult for the operator to observe and receive timely Changes in the inspector will affect the safety of the inspection.
By detecting the subject's vital sign information, such as electrocardiogram information, respiratory rate, blood oxygen concentration, blood pressure and body temperature, the imaging display is used to display images facing the subject, including the operator's image and voice information, to alleviate the examination by using the image display. The psychological burden of the person and providing emergency communication channels.
Effectively reduce the psychological burden of the examinee, improve the safety of the examination, ensure that the examinee can promptly convey the willingness to continue the examination, and promptly respond to potential physical discomfort through vital sign information monitoring.
Smart Images

Figure CN119014850A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a medical image diagnosis system, a working method of the medical image diagnosis system and an image display system, and in particular to a technology for displaying an image that can be visually recognized by a subject being examined using an image diagnosis device. Background Art
[0002] The examination time of the subject using imaging diagnostic equipment such as magnetic resonance imaging equipment (MRI) and X-ray CT (Computed Tomography) equipment is relatively long. In the case of MRI equipment, it takes about 20 minutes to 30 minutes. In the case of X-ray CT equipment, a simple examination takes about 5 to 10 minutes, and a contrast examination takes about 5 to 20 minutes.
[0003] Furthermore, imaging using MRI equipment is performed in a cylindrical imaging space called a "bore", and body movement during the examination may become an image artifact, so body movement including breathing must be suppressed as much as possible. It is stressful for the examinee to suppress body movement for a long time in a closed space called a "bore" while undergoing an examination.
[0004] As a result, the examinee may feel uneasy or feel unwell due to a rise in body temperature (fever), an increase in heart rate, or after a drug injection. The examinee may be asked to hold the emergency switch, but because the examinee does not want to stop the examination, he or she may not press the emergency switch (or the emergency buzzer) but endure it. In addition, during an emergency examination, the operator of the MRI device may perform the examination while looking at the unconscious examinee, but may not observe any changes in the examinee because he or she is also focused on the operation screen.
[0005] Patent document 1 discloses a medical image diagnosis system that obtains vital sign information of a patient when examining the patient using an X-ray CT device. The medical image diagnosis system disclosed in Patent document 1 obtains first information indicating the patient's preparation status in step 1 of the plurality of steps, and obtains second information indicating that the transition from step 1 to step 2 is permitted, and controls the transition from step 1 to step 2 based on the first information and the second information, when controlling the transition of each of the plurality of steps included in a workflow for examining the patient.
[0006] Here, the vital sign information is used as information for determining the patient's posture or action, such as whether the patient has closed the door of the CT room or has laid on the top board of the bed device in the plurality of steps included in the workflow.
[0007] Furthermore, Patent Document 2 describes a medical image diagnosis system that projects two images with different purposes to different positions. The medical image diagnosis system described in Patent Document 2 projects a first image for relieving stress on a patient during an examination from a projector onto the inner wall of a hole in a medical image diagnosis device, and projects a second image for indicating information related to imaging of the patient onto the surface (back surface) having an opening of the hole in the housing of a gantry.
[0008] Here, the second image is an image containing the patient's electrocardiogram information, body temperature, respiratory rate, pulse rate and other living body information, operation screen in the medical image diagnosis system, reconstructed image, imaging conditions and other information, and is an image required by medical practitioners.
[0009] Patent Document 1: Japanese Patent Application Publication No. 2022-94
[0010] Patent Document 2: Japanese Patent Application Publication No. 2018-29763
[0011] Patent Documents 1 and 2 describe obtaining vital sign information of a subject being examined by an image diagnostic apparatus, but do not describe displaying a predetermined image for the subject based on the vital sign information. Summary of the invention
[0012] The present invention is completed in view of such a situation, and its purpose is to provide a medical image diagnosis system, a working method of the medical image diagnosis system and an image display system that can display images of a subject being examined using an image diagnosis device based on the subject's vital sign information.
[0013] The invention involved in the first embodiment is a medical image diagnosis system, which comprises: an image display, which displays images in a manner that is visually recognizable to the subject during examination of the subject using an image diagnosis device; a vital sign information detector, which detects the vital sign information of the subject being examined; and a processor, which performs the following processes: acquiring vital sign information from the vital sign information detector; and displaying a specified image on the image display based on the acquired vital sign information.
[0014] According to the first aspect of the present invention, a predetermined image for a subject under examination can be displayed on an image display based on the vital sign information of the subject under examination.
[0015] The medical image diagnosis system involved in the second embodiment of the present invention is preferably as follows in the first embodiment: the processor determines whether the vital sign information or the change in the vital sign information exceeds the first threshold value, and when it is determined that the vital sign information exceeds the first threshold value, an image of the subject's intention to confirm whether the examination by the image diagnosis device can continue is displayed on the image display.
[0016] When the vital sign information of the subject being examined or the amount of change in the vital sign information exceeds the first threshold, it is considered that the subject feels unwell. According to the second aspect of the present invention, when the vital sign information of the subject being examined or the amount of change in the vital sign information exceeds the first threshold, an image of the subject's intention to confirm whether the examination can be continued is displayed on the image display.
[0017] The medical image diagnosis system involved in the third embodiment of the present invention is preferably as follows in the first embodiment or the second embodiment: it also includes: a first camera for photographing an operator operating the image diagnosis device, a processor for determining whether the vital sign information or the amount of change in the vital sign information exceeds the second threshold value, and when it is determined that the vital sign information or the amount of change in the vital sign information exceeds the second threshold value, the image of the operator photographed by the first camera is displayed on the image display.
[0018] When the vital sign information of the subject under examination exceeds the first threshold, it is considered that the subject feels unwell. According to the third aspect of the present invention, when the vital sign information of the subject under examination exceeds the second threshold, the psychological burden of the subject is reduced by displaying the image of the operator on the image display.
[0019] The medical image diagnosis system according to the fourth aspect of the present invention is preferably as follows in any of the first to third aspects: it further comprises: a second speaker that transmits the sound detected by the first microphone, that is, the sound emitted by the operator operating the image diagnosis device, or the automatic voice to the subject being examined. Thus, the psychological burden of the subject can be reduced by the sound.
[0020] The medical image diagnosis system according to the fifth aspect of the present invention is preferably as follows in the second aspect: it comprises: a meaning detector for detecting the meaning of the subject with respect to the image for confirming the meaning of the subject; and a meaning confirmer for transmitting the detection result detected by the meaning detector to an operator who operates the image diagnosis device. Thus, communication can be achieved between the subject and the operator, and the psychological burden of the subject can be reduced.
[0021] The medical image diagnosis system involved in the sixth embodiment of the present invention is preferably as follows in the fifth embodiment: the intention detector is a second microphone that detects the voice of the subject under examination, a second camera that photographs the subject, or an operator operated by the subject, and the intention confirmer is a first speaker that transmits the sound detected by the second microphone to the operator who operates the image diagnosis device, a speech recognizer that analyzes the movement of the subject's lips based on the image of the subject photographed by the second camera and recognizes the content of the subject's speech, a detector that analyzes the movement of the subject's hands or fingers based on the image of the subject photographed by the second camera and detects the subject's intention, or a notifier that outputs the operation result of the operator.
[0022] The medical image diagnosis system involved in the 7th mode of the present invention is preferably as follows in any one of the 1st to 7th modes: the vital sign information of the subject is one or more of electrocardiogram information, heart rate, blood oxygen concentration, respiratory rate, blood pressure and body temperature.
[0023] The medical image diagnosis system involved in the 8th mode of the present invention is preferably as follows in any one of the 1st to 7th modes: the vital sign information detector includes a third camera for photographing the subject during the examination, and analyzes the image taken by the third camera to detect at least one of the heart rate and respiratory rate of the subject.
[0024] The medical image diagnostic system involved in the 9th mode of the present invention is preferably as follows in any one of the 1st to 8th modes: the vital sign information detector includes an ECG sensor for detecting electrocardiographic information and / or heart rate, an SpO2 sensor for measuring blood oxygen concentration, a bellows for detecting respiratory rate, a pressure sensor for detecting blood pressure, an optical camera capable of detecting body temperature, an infrared camera or a thermal imager.
[0025] In the medical image diagnosis system involved in the tenth embodiment of the present invention, in any one of the first to ninth embodiments, the vital sign information detector is a signal processing device that detects vital sign information based on an image taken by an image diagnosis device, an NMR signal obtained from a magnetic resonance imaging device when the image diagnosis device is a magnetic resonance imaging device, or a pulse sequence.
[0026] The medical image diagnosis system involved in the 11th mode of the present invention is preferably as follows in any mode from the 1st mode to the 10th mode: the image display is a projector, a head-up display, a head-mounted display, a liquid crystal display or an organic EL display projected onto a screen that can be visually recognized by the subject.
[0027] The medical image diagnosis system according to the twelfth aspect of the present invention is preferably as follows in any one of the first to eleventh aspects: the image diagnosis device includes a magnetic resonance imaging device, an X-ray CT device, a PET device, a radiotherapy device, or a particle beam therapy device.
[0028] The invention involved in the 13th embodiment is a working method of a medical image diagnosis system, which comprises: an image display, which displays images in a manner that is visually recognizable to the subject when the subject is examined using an image diagnosis device; a vital sign information detector, which detects the vital sign information of the subject being examined; and a processor, and the working method of the medical image diagnosis system includes the following steps: the processor obtains the vital sign information of the subject from the vital sign information detector; and the processor displays a specified image on the image display based on the obtained vital sign information.
[0029] The working method of the medical image diagnosis system involved in the 14th mode of the present invention is preferably as follows in the 13th mode: it includes the following steps: the processor determines whether the acquired vital signs information or the change in the vital signs information exceeds the first threshold; and when it is determined that the vital signs information or the change in the vital signs information exceeds the first threshold, an image of the subject's intention to confirm whether the examination of the image diagnosis device can continue is displayed on the image display.
[0030] The working method of the medical image diagnosis system involved in the 15th mode of the present invention is preferably as follows in the 13th mode or the 14th mode: the medical image diagnosis system also includes: a first camera, which captures an operator operating the image diagnosis device, and the working method of the medical image diagnosis system includes the following steps: the processor determines whether the vital sign information or the change in the vital sign information exceeds the second threshold; and when it is determined that the vital sign information or the change in the vital sign information exceeds the second threshold, the processor displays the image of the operator captured by the first camera on the image display.
[0031] The invention involved in the 16th embodiment is an image display system, which comprises: an image display, which displays images in a manner that is visually recognizable to the subject when the subject is examined using an image diagnostic device; a vital sign information detector, which detects the vital sign information of the subject being examined; and a processor, which performs the following processes: acquiring vital sign information from the vital sign information detector; and displaying a specified image on the image display based on the acquired vital sign information.
[0032] Effects of the Invention
[0033] According to the present invention, a predetermined image for a subject being examined by an image diagnostic apparatus can be displayed on an image display based on the subject's vital sign information, thereby alleviating the subject's psychological burden. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 It is a perspective view showing an example of an image diagnosis apparatus to which the medical image diagnosis system according to the present invention is applied.
[0035] Figure 2 yes Figure 1 A schematic cross-sectional view of an MRI apparatus is shown.
[0036] Figure 3 The diagram shows the change in orientation of the subject's body relative to the MRI apparatus.
[0037] Figure 4 This is a diagram showing the interior of an operation room where the MRI apparatus is operated.
[0038] Figure 5 This is a diagram showing an example of a display screen of a display that displays vital sign information and the like.
[0039] Figure 6 This is a diagram showing another example of a display screen of a display that displays vital sign information and the like.
[0040] Figure 7 This is a diagram showing another example of a display screen of a display that displays vital sign information and the like.
[0041] Figure 8 It is a structural diagram of the medical image diagnosis system involved in the present invention.
[0042] Fig. 9 This is a block diagram showing an embodiment of hardware of a signal processing device which is a main device constituting a medical image diagnosis system.
[0043] Fig.10 This is a diagram showing a first example of an image displayed on the subject's side.
[0044] Fig.11 This is a diagram showing a second example of an image displayed on the subject's side.
[0045] Fig.12 This is a diagram showing a third example of an image displayed on the subject's side.
[0046] Fig.13 This is a diagram showing a fourth example of an image displayed on the subject's side.
[0047] Fig.14 This is a diagram showing a fifth example of an image displayed on the subject's side.
[0048] Fig.15 This is a conceptual diagram showing an embodiment of a speech recognizer.
[0049] Fig.16 This is a diagram showing the appearance of main parts of an example of an operating device operated by a subject.
[0050] Fig.17 This is a diagram showing the appearance of main parts of another example of an operating device operated by a subject.
[0051] Fig.18 This is a diagram showing another embodiment of an image display that displays images in a manner that is visually recognizable to a subject during an examination using an MRI apparatus.
[0052] Fig.19 This is a graph showing the relationship between a detection example of vital sign information, the condition of the subject, and the display content of an image displayed on the subject's side.
[0053] Fig. 20 This is a flowchart showing another embodiment of the operating method of the medical image diagnosis system according to the present invention.
[0054] Explanation of symbols
[0055] 10-MRI device, 15-second camera, 16-second microphone, 17-projector, 18-vital sign information detector, 19-operator, 20-signal processing device, 24-display, 25-first microphone, 26-first speaker, 30-first camera, 50-network. DETAILED DESCRIPTION
[0056] Hereinafter, preferred embodiments of the medical image diagnosis system, the operating method of the medical image diagnosis system, and the image display system according to the present invention will be described with reference to the accompanying drawings.
[0057] Figure 1 It is a perspective view showing an example of an image diagnosis apparatus to which the medical image diagnosis system according to the present invention is applied.
[0058] Figure 1 The image diagnosis apparatus shown is a magnetic resonance imaging apparatus (MRI apparatus) 10 , and includes a gantry 11 and a bed 13 including a top plate 13A disposed in front of a hole 12 which is a cylindrical imaging space provided in the gantry 11 .
[0059] The image diagnosis device in this example is an MRI device 10, but the present invention is not limited thereto, and includes an X-ray CT device, a PET (Positron Emission Tomography) device, a radiotherapy device, or a particle beam therapy device. The present invention is suitable for devices with relatively long inspection and treatment times.
[0060] Figure 2 yes Figure 1 A schematic cross-sectional view of an MRI apparatus is shown.
[0061] exist Figure 2 In the embodiment, an MRI magnet 10A and various other coils are arranged on a gantry 11, and a subject 5 lying on a top plate 13A is moved so that the examination part of the subject 5 is located at the center of the static magnetic field in the hole 12 by moving the top plate 13A to the hole 12. An RF (Radio Frequency) coil 10B for receiving FID (Free Induction Decay) from the human body is arranged at the examination part of the subject 5. In this example, the abdomen of the subject 5 is the examination part, and the RF coil 10B is arranged on the abdomen.
[0062] A second camera 15 (15A, 15B) as a visible light camera and a second microphone 16 (16A, 16B) are arranged at the upper part of both ends of the hole 12. Figure 2 In the embodiment, the second camera 15A and the second microphone 16A are arranged above the left end of the hole 12, and the second camera 15B and the second microphone 16B are arranged above the right end of the hole 12.
[0063] The two second cameras 15A and 15B are used to capture images of the subject 5 and output dynamic images (videos), respectively. At least one of the two second cameras 15A and 15B captures an image including a facial region of the subject 5 .
[0064] The two second microphones 16A and 16B respectively detect sounds uttered by the subject 5. The second microphones 16A and 16B are preferably non-magnetic microphones using piezoelectric ceramics which are non-magnetic bodies for the sound receiving body.
[0065] At one end of the top plate 13A ( Figure 2 A projector 17 is disposed at the left end of the hole 12, and the projector 17 projects an image onto a screen 17A disposed on the ceiling portion of the hole 12. The projector 17 functions as an image display that displays an image in a manner that can be visually recognized by the subject 5 during the examination using the MRI apparatus 10, and the subject 5 can visually recognize the image projected on the screen 17A during the examination. In addition, the ceiling portion of the hole 12 may be used as a screen without providing the screen 17A.
[0066] And, in Figure 2 In the figure, 18 is a vital sign information detector, which measures one or more of the electrocardiogram information, heart rate (pulse rate), blood oxygen concentration, respiratory rate, blood pressure and body temperature of the subject 5. The vital sign information detector 18 is not limited to being arranged on the back of the subject 5.
[0067] As a specific vital sign information detector 18, it includes an ECG (electrocardiogram) sensor for detecting electrocardiogram information and / or heart rate, an SpO2 sensor for measuring blood oxygen concentration, a bellows for detecting respiratory rate, a pressure sensor for detecting blood pressure, an optical camera for detecting body temperature, an infrared camera or a thermal imager.
[0068] Furthermore, a signal processing device that detects vital sign information based on an MRI image captured by an image diagnostic device (MRI device 10), an NMR (Nuclear Magnetic Resonance) signal (the signal itself obtained in an MRI examination) obtained from the MRI device when the image diagnostic device is an MRI device, or a pulse sequence may be used as a vital sign information detector. Other sensors (optical sensors, ultrasonic sensors, etc.) and combinations thereof may be used as vital sign information detectors.
[0069] For example, by detecting the movement of the diaphragm and the heart from the MRI image, the respiratory rate or heart rate can be detected. In addition, these motion detections are used to reduce artifacts in the MRI image. In addition, a machine learning model that inputs images of the subject, MRI images, etc., can also be used to detect vital sign information.
[0070] Figure 3 The diagram shows the change in orientation of the subject's body relative to the MRI apparatus.
[0071] Figure 3 (A) shows the situation where the subject 5 enters the hole 12 from the head (head priority), Figure 3 (B) shows a case where the subject 5 enters the hole 12 from the feet (feet first).
[0072] The head priority or the foot priority is selected according to the inspection part of the subject 5. In this example, the second cameras 15A, 15B and the second microphones 16A, 16B are respectively arranged at the two ends of the hole 12, so that the facial area of the subject 5 can be photographed and the sound can be detected regardless of whether the head priority or the foot priority is selected.
[0073] In this example, there are two second cameras 15 (15A, 15B) and two second microphones 16 (16A, 16B), but the present invention is not limited thereto and the number may be one or more than three. Furthermore, the second camera 15 and the second microphone 16 are not limited to being disposed in the MRI apparatus 10 and may be disposed near the MRI apparatus 10.
[0074] Figure 4 This is a diagram showing the interior of an operation room where the MRI apparatus is operated.
[0075] like Figure 4 As shown, a signal processing device 20 is installed in the operation room 2. The signal processing device 20 controls the MRI device 10 installed in the examination room, processes the NMR signals output from the MRI device 10, and generates an MRI image.
[0076] The signal processing device 20 can be configured using a computer. The computer suitable for the signal processing device 20 may be a personal computer or a workstation. The operator 32 can control the operation of the MRI apparatus 10 through the signal processing device 20 using the operation unit 28 such as a keyboard and a mouse.
[0077] Furthermore, the signal processing device 20 of this example has a part of the functions of the medical image diagnosis system involved in the present invention (that is, the function of an "image display system" for displaying images for the subject, etc.), but the details will be described later.
[0078] The signal processing device 20 includes a display 24 that displays MRI images and the like, a first microphone 25 that detects the voice of the operator 32, and a first speaker 26 that generates the voice and the like uttered by the subject 5 during the examination.
[0079] And, in Figure 4 In the figure, 2A is a window for the operator 32 to observe the situation in the examination room. 29 is a display for displaying the images taken by the second cameras 15A and 15B, vital sign information, etc., and 30 is a first camera for photographing the operator 32.
[0080] Figure 5 is a diagram showing an example of a display screen of a display showing vital sign information, etc. Figure 4 An enlarged view of the display screen of the display 29 is shown.
[0081] like Figure 5 As shown, the display screen of the display 29 displays images of the subject 5 captured by the second cameras 15A and 15B. In this example, images of the upper body of the subject 5 captured by the second camera 15A and images of the lower body of the subject 5 captured by the second camera 15B are displayed.
[0082] Furthermore, as vital sign information of the subject 5 being examined, blood oxygen concentration (SpO2) 29A, pulse rate 29B, respiratory rate 29C, body movement (oscillation waveform) 29D, and the like are displayed.
[0083] The operator 32 can observe the condition of the subject 5 under examination (for example, pale complexion, stiff facial expression, eye movement, etc.) from the display screen of the display 29, and can confirm the vital sign information of the subject 5. Figure 5 The vital sign information and the like at the start of the examination of the subject 5 are shown.
[0084] Figure 6 and Figure 7 is a diagram showing another example of a display screen of a display for displaying vital sign information, etc., showing the relative position of vital sign information to Figure 5 Shown is a change in vital sign information at the start of the exam.
[0085] exist Figure 6 In the example shown, a state in which the pulse rate 29B of the subject 5 rises and the respiratory rate 29C increases is shown.
[0086] And, in Figure 7 In the example shown, the blood oxygen concentration SpO2) 29A of the subject 5 is reduced, and the respiratory rate 29C cannot be measured "-", indicating a state of respiratory arrest.
[0087] For example, regarding vital sign information that has significantly changed, it is preferable to change the color or brightness on the display screen of the display 29 so that the operator 32 can pay attention to it.
[0088] [Structural diagram of medical image diagnosis system]
[0089] Figure 8 It is a structural diagram of the medical image diagnosis system involved in the present invention.
[0090] Figure 8 The medical image diagnosis system shown in FIG. 1 includes a second camera 15, a second microphone 16, and a second speaker 16-1 (see FIG. 1 ). Fig.18 ), a projector 17, a vital sign information detector 18, an operator 19 to be described later, and an imaging unit (not shown) of a pulse sequence unit of the MRI apparatus 10 are connected to a signal processing device 20 in the operating room 2 via a network 50 such as a LAN (Local area network).
[0091] Fig. 9 This is a block diagram showing an embodiment of hardware of a signal processing device which is a main device constituting a medical image diagnosis system.
[0092] Fig. 9 The signal processing device 20 shown is constituted by a computer or the like as described above, and includes a processor 21 , a memory 22 , an input / output interface 23 , displays 24 , 29 , a first speaker 26 , an operation unit 28 , a first camera 30 , and the like.
[0093] The processor 21 is composed of a CPU (Central Processing Unit) and the like, and centrally controls each unit of the signal processing device 20 and various devices provided in the MRI apparatus 10 , and executes a signal processing program stored in the memory 22 , thereby realizing various functions described below.
[0094] The memory 22 is one or more memories including a flash memory, a ROM (Read-only Memory), a RAM (Random Access Memory), a hard disk device, etc. The flash memory, the ROM, and the hard disk device are non-volatile memories that store an operating system, a signal processing program that enables the processor 21 to function as the signal processing device 20, various programs including a machine learning model, and an image projected by the projector 17.
[0095] The RAM functions as a work area for processing by the processor 21 and temporarily stores programs stored in the nonvolatile memory, etc. The processor 21 may also incorporate a part of the memory 22 (RAM).
[0096] The input / output interface 23 includes a communication unit that can be connected to the network 50 and a connection unit that can be connected to an external device. As the connection unit that can be connected to the external device, USB (Universal Serial Bus), HDMI (High-Definition Multimedia Interface) (HDMI is a registered trademark), etc. can be used.
[0097] The processor 21 communicates with various devices provided in the MRI apparatus 10 via the input / output interface 23 and the network 50 , thereby transmitting and receiving necessary information.
[0098] The display 24 is used as a part of a GUI (Graphical User Interface) for displaying MRI images, characters indicating the content of speech uttered by the subject 5 during the examination, MRI images, etc., and receiving input from the operation unit 28 .
[0099] And, if Figure 5As shown, the display 29 displays images of the subject, vital signs information, etc. In this example, two displays 24 and 29 are provided, but the display screen of one display may be divided into two screens to display the information displayed by these displays 24 and 29, or the screens may be switched to display.
[0100] The first microphone 25 detects the sound made by the operator 32, and outputs a sound signal representing the detected sound to the processor 21. The processor 21 performs sound recognition on the sound signal input from the first microphone 25, and projects and displays the recognized characters as part of the image facing the subject, or outputs the recognized characters from the subject through the speaker ( Fig.18 The second speaker 16-1) shown produces.
[0101] The first speaker 26 is used to generate the sound emitted by the subject 5 under examination. When the sound signal representing the sound emitted by the subject 5 is input from the second microphone 16, the processor 21 outputs the sound signal to the first speaker 26, and the sound is generated from the first speaker 26 as the sound emitted by the subject 5. In addition, it is preferable that the processor 21 performs filtering processing on the sound signal input from the second microphone 16 to reduce the noise generated by the MRI apparatus 10.
[0102] The operation unit 28 includes a mouse, a keyboard, and the like, and functions as a part of a GUI that uses a display operation window of the display 24 to receive input from the operator 32 .
[0103] The first camera 30 is used as Figure 4 As shown, the operator 32 is photographed, and the processor 21 can display the image of the operator 32 photographed by the first camera 30 via the projector 17 .
[0104] [Overview of Medical Image Diagnosis System]
[0105] The medical image diagnosis system of the above structure detects the vital sign information of the examinee 5 under examination, and displays a predetermined image facing the examinee on the image display based on the detected vital sign information. In this example, the predetermined image is projected onto a screen 17A by a projector 17 .
[0106] In a specific embodiment, the medical image diagnosis system determines whether the detected vital sign information or the amount of change in the vital sign information exceeds the first threshold value, and if so, projects an image through the projector 17 to confirm the examinee's intention of whether the examination by the MRI apparatus 10 can be continued. Thus, the medical image diagnosis system or the operator 32 can confirm the examinee's intention of whether the examination can be continued, and the psychological burden of the examinee 5 can be reduced.
[0107] Furthermore, in another specific embodiment, the medical image diagnosis system determines whether the detected vital sign information or the amount of change in the vital sign information exceeds the second threshold value, and if so, displays the image of the operator 32 through the projector 17. The examinee 5 can feel at ease by viewing the image of the operator 32, thereby reducing the psychological burden of the examinee 5.
[0108] In addition, the first threshold value and the second threshold value may be the same threshold value or different threshold values. Furthermore, the first threshold value and the second threshold value may be arbitrarily set by the operator 32. Moreover, of course, these threshold values differ depending on the type of vital sign information.
[0109] [The role of medical image diagnosis system]
[0110] The processor 21 of the signal processing device 20 obtains vital sign information from the vital sign information detector 18, compares the vital sign information or the change in the vital sign information with a threshold value (the first threshold value or the second threshold value), and when the vital sign information or the change in the vital sign information exceeds the threshold value, an image facing the subject is projected from the projector 17.
[0111] <First example of an image displayed on the subject's side>
[0112] Fig.10 This is a diagram showing a first example of an image displayed on the subject's side.
[0113] For example, Fig.10 The images shown are displayed in the following situations.
[0114] Fig.10 The image 170 shown is an image displayed in order to avoid worsening of abnormalities in in-body devices (MR-compatible pacemakers, etc.) or the body during examination when abnormalities are detected in the body of the subject based on vital sign information or changes in vital sign information (for example, changes in heart rate or pulse, electrocardiogram information, changes in facial expressions).
[0115] If the heart rate (pulse rate) or electrocardiographic information of the subject 5 being examined becomes disordered or the expression becomes stiff, the subject is conscious but there is a possibility of malfunction of the MR-compatible pacemaker or physical abnormality.
[0116] Therefore, when the state of the subject 5 is determined based on the vital sign information or the amount of change in the vital sign information, the processor 21 displays Fig.10 Image 170 is shown.
[0117] Fig.10The image 170 shown includes text information 171 such as “Abnormality detected in the values representing vital signs”, and an icon 172 indicating “Continue examination” and an icon 173 indicating “Stop examination” as images of the subject confirming whether the examination can be continued.
[0118] The subject 5 can convey the subject's intention of whether the examination can be continued to the medical image diagnosis system or the operator 32 by selecting the icon 172 or 173 as described later.
[0119] according to Fig.10 The example shown enables safer MRI examinations to be performed on subjects who have MR-compatible devices inserted that may be added in the future.
[0120] In addition, as the vital sign information in this example, in addition to the heart rate (pulse rate) and electrocardiogram information, "changes in facial expressions" are used as one of the amounts of change in the vital sign information, but the present invention is not limited to these vital sign information.
[0121] <Second example of an image displayed on the subject's side>
[0122] Fig.11 This is a diagram showing a second example of an image displayed on the subject's side.
[0123] For example, Fig.11 The images shown are displayed in the following situations.
[0124] Fig.11 The image 170 shown is an image displayed to notify the subject 5 and the operator 32 of the suspicion of side effects and to assist in the safety of the examination when it is detected that the subject 5 has side effects caused by drugs based on the blood oxygen concentration (SpO2), pulse, respiratory rate and facial changes in some cases.
[0125] When the SpO2 of the subject 5 changes drastically, the blood pressure drops (including pale face), and the respiratory rate increases after the injection of contrast agent, the subject 5 is sometimes conscious and sometimes unconscious, and it is considered that side effects caused by the contrast agent may have occurred.
[0126] Therefore, when the state of the subject 5 is determined based on the vital sign information or the amount of change in the vital sign information, the processor 21 displays Fig.11 Image 170 is shown.
[0127] Fig.11The image 170 shown includes text information 171 such as "There is a possibility of side effects caused by contrast agent", an icon 172 indicating "Continue examination" and an icon 173 indicating "Stop examination", and an image 174 of the operator 32 taken by the first camera 30 (an image with a small image size).
[0128] The subject 5 can convey the subject's intention as to whether the examination can be continued to the medical image diagnosis system or the operator 32 by selecting the icon 172 or 173 .
[0129] according to Fig.11 The example shown enables examination without placing a burden on the subject 5 and enables prompt response to emergency measures.
[0130] <Third example of an image displayed on the subject's side>
[0131] Fig.12 This is a diagram showing a third example of an image displayed on the subject's side.
[0132] For example, Fig.12 The images shown are displayed in the following situations.
[0133] Fig.12 The image 170 shown is an image displayed in order to reduce the anxiety of the subject 5 by confirming the fever condition of the subject 5 and notifying the subject 5 of the remaining examination status when the fever condition of the subject 5 and the possible increase in anxiety caused by it are detected based on the temperature or change in body temperature imparted to the body of the subject 5 by MR imaging.
[0134] During the examination, depending on the type of imaging sequence, the body temperature of the subject 5 may rise sharply (SAR (specific absorption ratio) rises) or accumulates over time, causing the body around the examination site to feel hot. As for the state of the subject 5, although the subject is conscious, it is considered that he may be unable to tolerate the heat sensation or suffer from stress or anxiety to the extent that he does not want to undergo MRI examinations in the future. In extreme cases, it is considered that mild burns may also be caused.
[0135] Therefore, when the state of the subject 5 is determined based on the vital sign information or the amount of change in the vital sign information, the processor 21 displays Fig.12 Image 170 is shown.
[0136] Fig.12 The image 170 shown includes text information 171 such as “Don’t you feel the high temperature?”, an icon 172 indicating “Continue examination”, an icon 173 indicating “Stop examination”, and an icon 175 indicating the estimated remaining time of the examination.
[0137] The subject 5 can convey the subject's intention as to whether the examination can be continued to the medical image diagnosis system or the operator 32 by selecting the icon 172 or 173 .
[0138] according to Fig.12 The example shown enables an examination that does not impose a burden on the subject 5 , and as a result, the psychological burden on the subject 5 can be reduced and a safe examination can be always performed.
[0139] <Example 4 of the image displayed on the subject's side>
[0140] Fig.13 This is a diagram showing a fourth example of an image displayed on the subject's side.
[0141] For example, Fig.13 The images shown are displayed in the following situations.
[0142] Fig.13 The image 170 shown is an image displayed to alleviate the anxiety of the subject 5 by notifying the subject 5 of the image and the remaining examination status of the operator 32 when an increase in the anxiety of the subject 5 is detected based on changes in the heart rate, pulse, or respiratory rate.
[0143] When the heart rate, pulse rate or respiratory rate of the subject 5 increases significantly during the examination, the subject 5, although conscious, may feel uneasy or tense because he or she gradually cannot tolerate the long-term examination or the closed space.
[0144] Therefore, when the state of the subject 5 is determined based on the vital sign information or the amount of change in the vital sign information, the processor 21 displays Fig.13 Image 170 is shown.
[0145] Fig.13 The image 170 shown includes text information 171 such as "The values of vital signs have increased significantly", an icon 172 indicating "Continue examination" and an icon 173 indicating "Stop examination", an image 174 of the operator 32 taken by the first camera 30, and 175 indicating the estimated remaining time of the examination.
[0146] The subject 5 can convey the subject's intention as to whether the examination can be continued to the medical image diagnosis system or the operator 32 by selecting the icon 172 or 173 .
[0147] according to Fig.13 The example shown enables an examination that does not impose a burden on the subject 5 , and as a result, the psychological burden on the subject 5 can be reduced and a safe examination can be always performed.
[0148] <Example 5 of the image displayed on the subject's side>
[0149] Fig.14 This is a diagram showing a fifth example of an image displayed on the subject's side.
[0150] For example, Fig.14 The images shown are displayed in the following situations.
[0151] Fig.14 The image 170 shown is based on the changes in SpO2 and respiratory rate (reference Figure 7 ) When it is detected that the subject 5 is in a critical condition, an image is displayed in order to help the subject 5 through communication between the subject 5 and the operator 32.
[0152] When a significant decrease in SpO2 or respiratory arrest occurs in the subject 5 during the examination of the subject 5 , the subject 5 's vital signs deteriorate and change rapidly, and it is considered that the subject 5 may become confused or lose consciousness.
[0153] Therefore, when the state of the subject 5 is determined based on the vital sign information or the amount of change in the vital sign information, the processor 21 displays Fig.14 Image 170 is shown.
[0154] Fig.14 The video 170 shown includes a video 176 showing the operator 32 captured by the first camera 30 and text information 177 such as “Can you hear my voice?”.
[0155] In this case, the sound produced by the operator 32 is detected by the first microphone 25 and reproduced by the subject using the second speaker 16-1, and conversely, the sound produced by the subject 5 is detected by the second microphone 16 and reproduced by the operator using the first speaker 26, thereby enabling the subject 5 and the operator 32 to communicate by sound. In addition, the second speaker 16-1 may also reproduce a preset automatic voice based on a displayed image or the like.
[0156] Furthermore, the voice generated by the operator 32 may be recognized, converted into character information, and displayed on the projected image 170. Similarly, the voice generated by the subject 5 may be recognized, or the speech content of the subject 5 may be recognized based on the lip movement of the subject 5, and the recognized information may be displayed on the operator display 24 or 29. Thus, the subject 5 and the operator 32 can communicate based on the displayed character information.
[0157] according to Fig.14 The example shown enables examination without placing a burden on the subject 5 and enables prompt response to emergency measures.
[0158] [Implementation Methods of Intention Detector and Intention Confirmer]
[0159] As an intention detector for detecting the intention of the subject 5 with respect to the image 170 for confirming the intention of the subject 5, a second microphone 16 for detecting the sound generated by the subject 5, a second camera 15 that functions as a third camera for photographing the facial area or hand area of the subject 5, and an operator 19 that receives manual operation of the subject 5 can be considered.
[0160] On the other hand, the intention confirmer is used to transmit the detection result of the intention detector to the operator 32 . The intention confirmer for the second microphone 16 as the intention detector is a first speaker for the operator that transmits the sound detected by the second microphone 16 to the operator 32 .
[0161] Furthermore, the intention confirmer for the second camera 15 is a speech recognizer that analyzes the image taken by the second camera 15 and recognizes the speech content of the subject 5 based on the movement of the subject 5's lips (the so-called "lip shape"), or a detector that analyzes the image taken by the second camera 15 and detects the intention of the subject 5 based on the movement of the subject's 5 hands or fingers.
[0162] Furthermore, the intention confirmer for the operator 19 is a notifier that outputs the operation result of the operator 19 .
[0163] <Speech Recognizer>
[0164] Fig.15 This is a conceptual diagram showing an embodiment of a speech recognizer.
[0165] like Fig.15 As shown, the processor 21 functions as a speech recognizer 21A.
[0166] The speech recognizer 21A is a lip reading part that reads characters from the movement of the lips of the subject 5 . In this example, the image including the face area of the subject 5 captured by the second camera 15 is input using a learned machine learning model.
[0167] In addition, the processor 21 can read and use the machine learning model that has been learned and stored in advance in the memory 22. In addition, various learning models such as an end-to-end deep learning network, a convolutional neural network, and a support vector machine can be used as the machine learning model.
[0168] The speech recognizer 21A in this example outputs multiple characters uttered by the subject 5 (a character string representing the speech content) character by character from an image representing the movement of the subject 5's lips during input, but preferably also has the following function: performing natural language processing on the character string output from the speech recognizer 21A to determine whether the character string is a meaningful speech, or if the result of the natural language processing of the character string is erroneous, correcting it to make it the correct speech content.
[0169] The speech identifier 21A is effective when the voice of the subject 5 detected by the second microphone 16 cannot be heard (when the voice is small or when the noise during MRI examination is large).
[0170] <Detector>
[0171] The processor 21 functions as a detector that analyzes the movement of the hand or finger of the subject 5 based on the image of the subject 5 captured by the second camera 15 and detects the intention of the subject 5 .
[0172] The detector acquires a dynamic image (video) taken by the second camera 15 and detects the movement of the hand of the subject 5 in the video. For example, the detector compares the hand icon with the Fig.10 The images 170 shown are synthesized and the hand icon is moved according to the movement of the hand.
[0173] The examinee 5 moves his or her hand while viewing the image 170 to move the hand icon to the “continue examination” icon 172 or the “stop examination” icon 173 .
[0174] After moving the hand icon to the "continue examination" icon 172 or the "stop examination" icon 173, the examinee 5 sends the intention of "continue examination" or "stop examination" by, for example, clicking with the index finger. The detector detects the above-mentioned movement of the examinee's 5 hand from the image taken by the second camera 15 to detect the examinee's 5 intention of "continue examination" or "stop examination".
[0175] <Operator>
[0176] Fig.16 This is a diagram showing the appearance of main parts of an example of an operating device operated by a subject.
[0177] Fig.16 The operating device 19 shown is, for example, a rubber ball switch 190 which also serves as an emergency switch.
[0178] The rubber ball switch 190 is carried by the examinee 5 for emergency use. The examinee 5 during examination presses (holds firmly) the rubber ball switch 190 in an emergency. The pressure change accompanying the operation of the rubber ball switch 190 is detected by a pressure switch (not shown) via the hose 190B.
[0179] In this example, the rubber ball switch 190 also serves as an intention detector for detecting the intention of the subject 5 as to whether the examination can be continued.
[0180] For example, when the examinee 5 uses the rubber ball switch 190 for a normal emergency purpose, he long presses the rubber ball switch 190, when he selects "continue examination", he short presses the rubber ball switch 190 once, and when he selects "stop examination", he short presses the rubber ball switch 190 twice. The pressing pattern of the rubber ball switch 190 is not limited to this.
[0181] When detecting that the rubber ball switch 190 is long pressed, the processor 21 performs processing such as stopping the MRI apparatus 10 .
[0182] On the other hand, when it is detected that the rubber ball switch 190 is pressed in a pressing mode indicating "continue checking" or "stop checking", the processor 21 functions as a detector that outputs the operation result ("continue checking" or "stop checking") assigned according to the pressing mode.
[0183] Fig.17 This is a diagram showing the appearance of main parts of another example of an operating device operated by a subject.
[0184] Fig.17 The illustrated operating device 19 is a push button switch 192 having button portions 192A and 192B formed of two air cells.
[0185] The push button switch 192 includes two hoses 192C whose internal pressure changes when the button portion 192A or 192B is pressed, and the pressure change in the hose 192C is detected by a pressure sensor (not shown).
[0186] For example, when it is detected that button portion 192A is pressed, processor 21 functions as a notifier that outputs an operation result indicating "continue inspection" assigned to button portion 192A, and when it is detected that button portion 192B is pressed, processor 21 functions as a notifier that outputs an operation result indicating "stop inspection" assigned to button portion 192B.
[0187] <Another Embodiment of Image Display>
[0188] Fig.18 This is a diagram showing another embodiment of an image display that displays images in a manner that is visually recognizable to a subject during an examination using an MRI apparatus.
[0189] Fig.18The image display shown is composed of a projector (not shown), a rear projection screen 60 on which an image is projected from the projector, and a reflection mirror 62 for allowing the subject 5 lying supinely on the top plate 13A to visually recognize the rear projection screen 60 .
[0190] The rear projection screen 60 and the reflector 62 are disposed on a support member 63 attached to the top plate 13A.
[0191] When an image is projected from the projector onto the rear projection screen 60 , the subject 5 can visually recognize the image projected onto the rear projection screen 60 via the reflection mirror 62 .
[0192] Furthermore, a camera for photographing the facial area of the subject 5 can be mounted on the outer periphery of the reflector 62. Furthermore, a second speaker 16-1 for the subject can be embedded in a head holder 70 for holding the head of the subject 5 so that it does not move. The second speaker 16-1 can produce the voice of the operator 32 when talking to the operator 32. Furthermore, the second speaker 16-1 is preferably a non-magnetic speaker using piezoelectric ceramics as a non-magnetic body for the sound-generating body.
[0193] In addition, another embodiment of the image display device that displays images in a manner that the subject can visually recognize during the examination using the MRI apparatus is not limited to Fig.18 As the display shown, a head-up display that displays a virtual image (an aerial image), a head-mounted display that is worn on the head of the subject, a liquid crystal display, or an organic EL display can be used.
[0194] <Display Contents Such as Images Displayed on the Subject's Side>
[0195] Fig.19 This is a graph showing the relationship between a detection example of vital sign information, the condition of the subject, and the display content of an image displayed on the subject's side.
[0196] use Figures 10 to 14 , the first to fifth examples of images displayed on the subject's side are described, but Fig.19 The diagram shown contains Figures 10 to 14 The display content of the corresponding image.
[0197] That is, display Fig.10 The vital signs information, the subject's condition and the image display content are equivalent to Fig.19 The 3rd of the diagrams shown.
[0198] Likewise, Fig.11 Equivalent to Fig.19 The 4th one of the graphs shown, Fig.12 Equivalent to Fig.19 The fifth of the graphs shown, Fig.13 Equivalent to Fig.19 The first of the graphs shown, Fig.14 Equivalent to Fig.19 2nd of the diagrams shown.
[0199] In addition, the image displayed on the subject's side based on the vital sign information is not limited to Figures 10 to 14 The images shown and Fig.19 The display contents shown in the diagram can display various images.
[0200] [Working method of medical image diagnosis system]
[0201] Fig. 20 It is a flowchart showing an embodiment of an operation method of the medical image diagnosis system according to the present invention.
[0202] Fig. 20 The processing of each step of the working method of the medical image diagnosis system shown corresponds to the processing of each step of the working method of the medical image diagnosis system shown in FIG. Fig. 9 The processing is performed by the processor 21 of the signal processing device 20 shown.
[0203] exist Fig. 20 In step S10 , the processor 21 determines whether the examination of the subject 5 by the MRI apparatus 10 is completed or not. If it is not completed, the processor 21 performs the following steps.
[0204] First, the processor 21 obtains the vital sign information of the subject being examined from the vital sign information detector 18 (step S12). In addition, the processor 21 preferably temporarily stores the vital sign information of the subject 5 before or immediately after the examination. This is to serve as a reference when determining the amount of change in the vital sign information during the examination.
[0205] Next, the processor 21 determines the state of the subject 5 based on the vital sign information acquired in step S12 (step S14, refer to Fig.19 ).
[0206] The processor 21 determines whether it is necessary to confirm with the examinee 5 whether to continue the examination or stop the examination (step S16). This determination can be made based on the state of the examinee 5 determined in step S14. Specifically, the processor 21 compares the vital sign information with a preset threshold value (first threshold value, second threshold value), or compares the amount of change in the vital sign information with a threshold value set for the amount of change, determines whether the vital sign information or the amount of change in the vital sign information exceeds the corresponding threshold value, and confirms the intention to continue the examination or stop the examination based on the determination result.
[0207] In step S16, when it is determined that the intention of the subject 5 needs to be confirmed, the processor 21 displays an image for confirming the intention, an image of the operator, etc. (step S18, see Figure 10 to Figure 14 ).
[0208] Next, the processor 21 determines whether the subject 5 has expressed the intention to continue the examination (step S20). As described above, the confirmation of the intention can be performed based on the subject's voice detected by the subject's second microphone 16, the movement of the subject's lips, the movement of the hand or fingers captured by the second camera 15 for capturing the subject 5, or the manual operation of the operator 19.
[0209] In step S20, when the examinee 5 indicates that he / she wants to continue the examination (when "yes"), the processor 21 sets the image displayed in step S18 to non-display, and then transfers to step S10 (step S22). In this case, in step S16, it is determined again whether it is necessary to confirm with the examinee 5 whether to continue the examination or stop the examination, but at this time, the judgment standard (threshold) is preferably set to be larger than the last judgment. This is to avoid the image set to be non-display from being repeatedly displayed.
[0210] In step S20 , if the subject 5 has not expressed the intention to continue the examination, the process proceeds to step S24 , where the processor 21 determines whether the subject 5 has expressed the intention to stop the examination.
[0211] In step S24, when the subject 5 expresses the intention to stop the examination ("Yes"), the processor 21 displays the content of the subject 5's intention to stop the examination and the options of continuing the examination / stopping the examination on the display 24 and / or the display 29 that can be visually recognized by the operator 32 (step S28).
[0212] The operator 32 determines whether to continue or stop the MRI examination based on the subject 5's intention to stop the examination displayed on the display 24 and / or the display 29 and the subject 5's vital sign information, and makes the choice of continuing or stopping the examination by operating the operating unit 28 such as a mouse (step S30).
[0213] In step S30 , when the operator 32 selects to continue the examination, the processor 21 displays a message indicating the continuation of the examination (eg, a message such as “Continue the examination”) on an image facing the subject (step S32 ), and then moves to step S10 .
[0214] Furthermore, in step S32, a message such as "The remaining inspection time is ○ minutes." may also be displayed. The remaining time may be automatically calculated according to the progress of the inspection, or may be manually input by the operator 32. Furthermore, the message may be manually input by the operator 32, or may be selected from fixed phrases.
[0215] On the other hand, when the operator 32 selects to stop the examination in step S30, the processor 21 stops the examination by the MRI apparatus 10 (step S34).
[0216] Then, in step S24 , when the subject 5 does not express an intention to stop the examination (in the case of “NO”), the processor 21 determines whether a certain time has passed since the image was displayed (step S26 ).
[0217] If a certain time has not passed since the image was displayed, the process proceeds to step S20. If a certain time has passed since the image was displayed, the process proceeds to step S30. In this case, in step S30, even if the image for confirming the intention to continue or stop the examination is displayed, the subject 5 does not respond, so the operator 32 determines whether to continue or stop the examination, taking into account the subject 5's confusion or loss of consciousness and / or considering the vital signs information, and selects whether to continue or stop the examination by operating the operating unit 28 such as a mouse.
[0218] [other]
[0219] In this embodiment, in a case where it is not necessary to display an image to confirm the subject 5's intention to continue or stop the examination (for example, when the vital sign information is below a threshold or when the intention to continue the examination is expressed), an image for relaxing the subject 5 undergoing the examination may be displayed.
[0220] Furthermore, in the present embodiment, for example, the hardware structure of the processing unit that executes various processes such as a CPU is various processors as shown below. The various processors include a general-purpose processor that executes software (programs) and functions as various processing units, namely a CPU (Central Processing Unit), a processor whose circuit structure can be changed after manufacturing, such as an FPGA (Field Programmable Gate Array), a processor having a circuit structure specially designed for executing specific processes, such as a programmable logic device (PLD), and an ASIC (Application Specific Integrated Circuit), namely a dedicated circuit.
[0221] One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Furthermore, multiple processing units may be composed of one processor. As an example of multiple processing units composed of one processor, first, there is the following method: as represented by computers such as clients or servers, one processor is composed of a combination of one or more CPUs and software, and the processor functions as multiple processing units. Second, there is the following method: as represented by a system on chip (SoC), a processor that implements the functions of the entire system including multiple processing units using one IC (Integrated Circuit) chip is used. In this way, as a hardware structure, various processing units are composed of one or more of the above-mentioned various processors.
[0222] Furthermore, more specifically, the hardware structure of these various processors is a circuit (circuitry) formed by combining circuit elements such as semiconductor elements.
[0223] Furthermore, the present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention.
Claims
1. A medical image diagnosis system comprising: An image display for displaying images in a manner that is visually recognizable to a subject during examination of the subject using an image diagnostic device; a vital sign information detector for detecting vital sign information of the subject being examined; and processor, The processor performs the following processing: Acquiring vital sign information from the vital sign information detector; and Based on the acquired vital sign information, a prescribed image is displayed on the image display.
2. The medical image diagnosis system according to claim 1, in, The processor performs the following processing: determining whether the vital sign information or the amount of change in the vital sign information exceeds a first threshold; and When it is determined that the vital sign information or the amount of change in the vital sign information exceeds the first threshold, an image confirming the subject's intention as to whether the examination by the image diagnostic apparatus can be continued is displayed on the image display.
3. The medical image diagnosis system according to claim 1 or 2, further comprising: a first camera for photographing an operator operating the image diagnosis device; The processor performs the following processing: determining whether the vital sign information or the amount of change in the vital sign information exceeds a second threshold; and When it is determined that the vital sign information or the amount of change in the vital sign information exceeds the second threshold, the image of the operator captured by the first camera is displayed on the image display.
4. The medical image diagnosis system according to claim 1 or 2, further comprising: The second speaker transmits the sound detected by the first microphone, that is, the sound uttered by the operator operating the image diagnostic apparatus or the automatic voice to the subject being examined.
5. The medical image diagnosis system according to claim 2, comprising: a meaning detector for detecting the subject's meaning with respect to the image for confirming the subject's meaning; and The intention confirmer transmits the detection result detected by the intention detector to an operator who operates the image diagnosis device.
6. The medical image diagnosis system according to claim 5, in, The intention detector is a second microphone for detecting the voice of the subject being examined, a second camera for photographing the subject, or an operator operated by the subject. The intention confirmer is a first speaker that transmits the sound detected by the second microphone to the operator operating the image diagnostic device, a speech recognizer that analyzes the movement of the subject's lips based on the image of the subject taken by the second camera and recognizes the subject's speech content, a detector that analyzes the movement of the subject's hands or fingers based on the image of the subject taken by the second camera and detects the subject's intention, or a notifier that outputs the operation result of the operator.
7. The medical image diagnosis system according to claim 1 or 2, in, The subject's vital sign information is one or more of electrocardiogram information, heart rate, blood oxygen concentration, respiratory rate, blood pressure and body temperature.
8. The medical image diagnosis system according to claim 1 or 2, in, The vital sign information detector includes a third camera for photographing the subject during the examination, and analyzes the image photographed by the third camera to detect at least one of the heart rate and the respiratory rate of the subject.
9. The medical image diagnosis system according to claim 1 or 2, in, The vital sign information detector includes at least one of an ECG sensor for detecting electrocardiographic information and / or heart rate, an SpO2 sensor for measuring blood oxygen concentration, a bellows for detecting respiratory rate, a pressure sensor for detecting blood pressure, an optical camera capable of detecting body temperature, an infrared camera or a thermal imager.
10. The medical image diagnosis system according to claim 1 or 2, in, The vital sign information detector is a signal processing device that detects vital sign information based on an image captured by the image diagnosis device, an NMR signal obtained from the magnetic resonance imaging device when the image diagnosis device is a magnetic resonance imaging device, or a pulse sequence.
11. The medical image diagnosis system according to claim 1 or 2, in, The image display is a projector, a head-up display, a head-mounted display, a liquid crystal display, or an organic EL display that projects onto a screen that can be visually recognized by the subject.
12. The medical image diagnosis system according to claim 1 or 2, in, The image diagnosis device includes a magnetic resonance imaging device, an X-ray CT device, a PET device, a radiotherapy device or a particle beam therapy device.
13. A working method of a medical image diagnosis system, the medical image diagnosis system comprising: an image display, which displays images in a manner that is visually recognizable to the subject during examination of the subject using an image diagnosis device; a vital sign information detector, which detects vital sign information of the subject during the examination; and a processor, the working method of the medical image diagnosis system comprising the following steps: The processor acquires the vital sign information of the subject from the vital sign information detector; and The processor displays a prescribed image on the image display based on the acquired vital sign information.
14. The working method of the medical image diagnosis system according to claim 13, comprising the following steps: The processor determines whether the vital sign information or the amount of change in the vital sign information exceeds a first threshold; and When it is determined that the vital sign information or the amount of change in the vital sign information exceeds the first threshold, an image confirming the subject's intention as to whether the examination by the image diagnostic apparatus can be continued is displayed on the image display.
15. The working method of the medical image diagnosis system according to claim 13 or 14, wherein the medical image diagnosis system further comprises: a first camera for photographing an operator operating the image diagnosis device, the working method of the medical image diagnosis system comprising the following steps: The processor determines whether the vital sign information or the amount of change in the vital sign information exceeds a second threshold; and When it is determined that the vital sign information or the amount of change in the vital sign information exceeds the second threshold, the processor displays the image of the operator captured by the first camera on the image display.
16. An image display system comprising: An image display for displaying images in a manner that is visually recognizable to a subject during examination of the subject using an image diagnostic device; a vital sign information detector for detecting vital sign information of the subject being examined; and processor, The processor performs the following processing: Acquiring vital sign information from the vital sign information detector; and Based on the acquired vital sign information, a prescribed image is displayed on the image display.
