Inspection assistance device, medical inspection device, inspection assistance method, and inspection assistance program
The examination support device addresses the challenge of presenting medical examination information by using subject data to adapt the presentation, ensuring effective communication even with incomplete registration information.
Patent Information
- Application Number
- JP2023189593
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-06
- Publication Date
- 2025-05-19
AI Technical Summary
Existing medical inspection systems struggle to present examination-related information in a manner corresponding to the individual being presented with the information, particularly when information about the subject or attendant is not registered in advance or is insufficient.
An examination support device equipped with a processor that acquires subject data, including imaging and voice data, to determine presentation information for medical examination information, adapting the presentation based on recognized attributes and situations of the subject or attendant.
Enables effective presentation of medical examination information in a manner tailored to the individual, even when registration information is incomplete or absent, thereby improving understanding and reducing communication barriers.
Smart Images

Figure 2025077414000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to an inspection support device, a medical inspection device, an inspection support method, and an inspection support program.
Background Art
[0002] Patent Document 1 describes "an inspection and voice guidance corresponding storage unit that stores in advance inspection methods and voice guidance corresponding to the inspection methods for each of a plurality of languages, an inspection information acquisition unit that acquires inspection information having the inspection method of a registered patient and the language information of the patient from a reservation inspection server, and acquires the inspection method of the patient and the language information of the patient from the inspection information acquisition unit, and acquires the voice guidance corresponding to the inspection method and the language of the patient from the inspection and voice guidance corresponding storage unit, and notifies a medical image diagnostic device as inspection and voice guidance information, and an inspection information control unit."
[0003] Patent Document 2 describes "an inspection support system for a subject at the time of inspection by X-ray or the like that guides the subject to assume a posture at the time of inspection requested by an examiner between the shielded and separated examiner and subject, and guides the explanatory content related to the inspection. The inspection support system for a subject at the time of inspection by X-ray or the like includes an inspection instruction operation terminal having an operation instruction screen on which an instruction button for selecting instruction information for the posture instruction and the explanatory content related to the inspection is arranged, and an instruction information transmission unit that transmits the instruction information by the selected instruction button, and an instruction information reception unit that receives the instruction information transmitted from the instruction information transmission unit, and an inspection instruction display terminal having an instruction display screen that displays the posture instruction of the instruction information and the explanatory content related to the inspection."
[0004] Patent Document 3 describes "A method of processing executed by an image forming system having a display, the method comprising: displaying an explanation of an inspection procedure on the display; and forming a patient image by an image forming apparatus by scanning an inspection area, and displaying questions for the patient in an output area of the display at both points in time before and after the step of forming the image, and receiving answers to the questions from the patient through an input area of the display."
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Patent Document 2
Patent Document 3
Summary of the Invention
Problems to be Solved by the Invention
[0006] It is desired to present medical examination-related information in a manner corresponding to the person who is the presentation target. Here, Patent Document 1 describes acquiring language information of registered patients from a reservation examination server and making voice guidance correspond to the patients' languages. Further, Patent Document 2 describes displaying a foreign language menu in a pull-down format and, when a predetermined foreign language is selected, displaying instructions for the subject in the selected foreign language. Also, Patent Document 3 describes that when the patient is a child, displaying an anime or comic of a radiological technologist and / or another child as an assistant on the display. Here, the patient's age is obtained from information pre-registered in an electronic schedule or the like.
[0007] Thus, in the prior art, it was necessary to register in advance information regarding the subject (including those registered immediately before information presentation). However, in the medical field, there are various types of information to be registered in advance as information regarding the subject. Also, in the case of an emergency patient, the information regarding the subject may not be registered in advance, and there may be a situation where it cannot be registered immediately before information presentation due to injuries or the like. Furthermore, in fact, information regarding the attendant accompanying the subject was not registered in advance. Therefore, there were cases where the information related to medical examinations could not be presented in a manner corresponding to the subject, attendant, etc. who are the presentation destinations.
[0008] Therefore, an object of the technology of the present disclosure is to provide an apparatus, a method, and a program capable of presenting information related to medical examinations in a manner corresponding to the person who is the presentation destination even when information regarding the person who is the presentation destination is not registered in advance or the registration is insufficient.
Means for Solving the Problem
[0009] To achieve the above object, an examination support apparatus according to the technology of the present disclosure includes a processor. The processor acquires subject data including at least one of imaging data obtained by imaging a target person who is a presentation destination of information related to a medical examination and voice data obtained by collecting the voice of the target person, and determines presentation information to be presented by a presentation device that presents information related to the medical examination toward the target person based on the subject data.
[0010] The processor may recognize the attributes of the target person using the subject data and determine the presentation information based on the attributes.
[0011] When a plurality of target persons with different attributes are recognized, the processor may accept a user input for selecting for which of the plurality of target persons the presentation information is to be directed.
[0012] When a plurality of subjects with different attributes are recognized, the processor may automatically select for which of the plurality of subjects the presentation information is to be provided according to a predetermined criterion.
[0013] The processor includes a first presentation device and a second presentation device that present information related to a medical examination in different manners, and when a first subject and a second subject with different attributes are recognized, the processor may determine first presentation information presented by the first presentation device for the first subject and second presentation information presented by the second presentation device for the second subject, respectively.
[0014] When the attribute of the subject includes the language used by the subject and the used language cannot be uniquely recognized, the processor may determine presentation information for the presentation device to present information related to a medical examination to the subject in a plurality of candidate languages.
[0015] The processor may determine presentation information for the presentation device to present information related to a medical examination to the subject in a manner according to the recognition accuracy for each of a plurality of candidate languages.
[0016] The processor may recognize the situation of the subject during viewing of information related to a medical examination using subject data, and determine presentation information based on the situation of the subject.
[0017] The processor may obtain registration information registered in advance for the subject, and determine presentation information based on the registration information and the subject data.
[0018] When presentation information cannot be determined based on the registration information, the processor may instruct a photographing device that photographs the subject to perform photographing, or instruct a sound collecting device that collects the voice of the subject to perform sound collection.
[0019] When the presentation device includes an acoustic device that presents information related to a medical examination by voice, when determining the presentation information, the processor may determine at least any one of the frequency, volume, speed, and language of the voice.
[0020] When the processor includes a display device that presents information related to a medical examination by display, at least one of the color, brightness, size, speed, and language of the display may be determined when determining the presentation information.
[0021] The medical examination device according to the technology of the present disclosure is equipped with an examination support device.
[0022] In the examination support method according to the technology of the present disclosure, a computer acquires subject data including at least one of imaging data obtained by imaging a subject who is a presentation destination of information related to a medical examination and voice data obtained by collecting the voice of the subject, and based on the subject data, determines presentation information that a presentation device that presents information related to the medical examination presents to the subject.
[0023] The examination support program according to the technology of the present disclosure causes a computer to acquire subject data including at least one of imaging data obtained by imaging a subject who is a presentation destination of information related to a medical examination and voice data obtained by collecting the voice of the subject, and based on the subject data, causes the computer to determine presentation information that a presentation device that presents information related to the medical examination presents to the subject.
Advantages of the Invention
[0024] According to the technology of the present disclosure, even when the person who is the presentation destination of the information is not registered in advance or the registration is insufficient, the information related to the medical examination can be presented in a manner corresponding to the person who is the presentation destination.
Brief Description of the Drawings
[0025]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
[0026] Hereinafter, an example of an embodiment of the present disclosure will be described with reference to the drawings. In each of the drawings, the same or equivalent components and parts are denoted by the same reference numerals. Also, the dimensional ratios in the drawings are exaggerated for the convenience of explanation and may be different from the actual ratios.
[0027] FIG. 1 is a diagram showing an example of a schematic configuration of a medical examination system 1 according to the present embodiment. In this figure, a case where the medical examination system 1 is a system related to an MRI (Magnetic Resonance Imaging) examination is shown as an example. However, the present invention is not limited to this. The medical examination system 1 may be a system related to any medical examination such as CT (Computed Tomography), PET (Positron Emission Tomography), mammography, general X-ray, ultrasonic wave, or endoscope.
[0028] In this figure, in the examination room, an example is shown in which the subject 10 receives an explanation of the MRI examination and undergoes the MRI examination under the supervision of the radiological technologist 20, and in the waiting room, the attendant 30 of the subject 10 receives an explanation of the MRI examination. The medical examination system 1 includes a medical examination device 40, a camera 50, a microphone 60, headphones 70, a tablet terminal 80, and an examination support device 100.
[0029] The medical examination device 40 is a device for medically examining the subject 10. The medical examination device 40 may be, for example, an MRI device.
[0030] The camera 50 is imaging equipment provided on the ceiling of the examination room and images the inside of the examination room. Therefore, when the subject 10 and the radiological technologist 20 enter the examination room, the camera 50 can image the subject 10 and the radiological technologist 20. The camera 50 transmits the captured imaging data to the examination support device 100 via a network (not shown).
[0031] The microphone 60 is sound collection equipment provided on the ceiling of the examination room and collects the sound in the examination room. Therefore, when the subject 10 and the radiological technologist 20 enter the examination room, the microphone 60 can collect the voices of the subject 10 and the radiological technologist 20. The microphone 60 transmits the collected voice data to the examination support device 100 via the network.
[0032] The headphones 70 are an example of a presentation device that presents information related to medical examinations and are an acoustic device that presents information related to medical examinations by voice. Generally, in an MRI examination, an image is taken by passing an electric current through the magnet in the MRI device. At this time, the coil in the MRI device vibrates and generates a loud noise. Therefore, in many cases, the MRI device is provided with headphones to reduce the burden on the subject 10. The medical examination system 1 may substitute the existing headphones in the medical examination device 40 as an acoustic device that presents information related to medical examinations by voice. In the above description, the case of using headphones as the acoustic device is shown as an example, but other devices capable of outputting sound, such as a speaker (not shown), may be used as the acoustic device.
[0033] The tablet terminal 80 is an example of a presentation device that presents information related to medical examinations and is a display device that presents information related to medical examinations by display. Note that the tablet terminal 80 may be a display device that presents information related to medical examinations by display and an acoustic device that presents information related to medical examinations by voice.
[0034] The inspection support device 100 supports medical examinations by presenting information related to medical examinations in a manner corresponding to the person who is the recipient. In this figure, an example is shown where the inspection support device 100 is an independent device from the medical examination device 40, but it is not limited to this. The inspection support device 100 may be mounted on the medical examination device 40. Thereby, the function of supporting the examination and the function of performing the examination may be provided by an integrated device.
[0035] In such a medical examination system 1, when undergoing a medical examination such as an MRI examination, it may be necessary to present explanations, precautions, etc. related to the medical examination to the subject 10 and the attendant 30 in advance. Also, during the examination, it may be necessary to present instructions related to the medical examination (such as "Lie on your back, please" or "Take a deep breath and hold it, please") to the subject 10. In such cases, the inspection support device 100 according to the present embodiment presents information related to the medical examination in a manner corresponding to the person who is the recipient. This will be described in detail below.
[0036] FIG. 2 is a diagram showing an example of the hardware configuration of the inspection support device 100 according to the present embodiment. The inspection support device 100 includes a processor 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a storage 104, a communication interface 105, and a user interface 106. These components are communicably connected to each other via a bus 109.
[0037] The processor 101 executes various programs and controls each component. The ROM 102 stores various programs and various data. The RAM 103 temporarily stores programs or data as a working area. The storage 104 is composed of an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs including an operating system and various data.
[0038] The communication interface 105 is an interface for the inspection support device 100 to communicate with other devices. The user interface 106 is an input / output interface for the inspection support device 100 to exchange information with the user. The user interface 106 may include, for example, a touch panel, a keyboard, a microphone, etc. as input devices, and a monitor, a speaker, etc. as output devices.
[0039] FIG. 3 is a diagram showing an example of the functional configuration of the inspection support device 100 according to the present embodiment. The inspection support device 100 according to the present embodiment includes a registration information acquisition unit 110, a subject data acquisition unit 120, a subject recognition unit 130, an input reception unit 140, a presentation information determination unit 150, and a presentation information supply unit 160. These functional configurations are realized by the processor 101 reading the inspection support program from the ROM 102 or the storage 104 and expanding it in the RAM 103.
[0040] The registration information acquisition unit 110 acquires registration information that has been registered in advance regarding a subject who is a destination for presenting information related to a medical examination.
[0041] The subject data acquisition unit 120 acquires subject data including at least one of imaging data obtained by imaging a subject who is a destination for presenting information related to a medical examination and voice data obtained by collecting the voice of the subject.
[0042] The subject recognition unit 130 recognizes the subject using the subject data. The subject recognition unit 130 may recognize the attributes of the subject using the subject data. Further, the subject recognition unit 130 may recognize the situation of the subject during viewing of information related to a medical examination using the subject data.
[0043] When a plurality of subjects with different attributes are recognized, the input reception unit 140 receives a user input for selecting for which subject among the plurality of subjects the presentation information is to be provided.
[0044] The prompt information determination unit 150 determines the prompt information to be presented by a presentation device that presents information related to a medical examination to the subject based on the subject data.
[0045] The prompt information supply unit 160 supplies the prompt information to the presentation device.
[0046] A test support device 100 having such functional units will be described in detail regarding a method of supporting a medical examination. First, a case of presenting information related to a medical examination to the subject 10 will be described. Subsequently, a case of presenting information related to a medical examination to the attendant 30 will be described.
[0047] FIG. 4 is a diagram showing an example of a flow when presenting information related to a medical examination to the subject 10. This flow is executed when the processor 101 reads a test support program from the ROM 102 or the storage 104 and expands it in the RAM 103. The same applies to the flows described later. In this flow, the subject to whom the information related to the medical examination is to be presented is the subject 10 himself / herself.
[0048] In step S400, the processor 101 determines whether the subject 10 has entered the examination room. For example, the processor 101 may determine that the subject 10 has entered the examination room in response to the barcode printed on the wristband worn by the subject 10 being read by a barcode reader provided in the examination room. However, it is not limited to this. For example, the processor 101 may also determine that the subject 10 has entered the examination room in response to a radiation technician 20 who has confirmed the entry of the subject 10 pressing an entry confirmation button. Additionally, the processor 101 can also determine that the subject 10 has entered the examination room based on at least one of the imaging data and the audio data.
[0049] In step S410, as the registration information acquisition unit 110, the processor 101 acquires, via the communication interface 105, the registration information that has been pre-registered for the subject who is the recipient of the information related to the medical examination, here the examinee 10. For example, the processor 101 may access at least one of a hospital information system (HIS) and a radiology information system (RIS). Then, the processor 101 may search using the identification number identified from the barcode read in step S400 as a search key, and acquire the registration information that has been pre-registered for the examinee 10. As an example, the processor 101 may acquire the name, height, weight, and examination information of the examinee 10 as the registration information.
[0050] In step S420, as the subject data acquisition unit 120, the processor 101 acquires, via the communication interface 105, subject data including at least one of the imaging data obtained by imaging the subject who is the recipient of the information related to the medical examination, here the examinee 10, and the audio data obtained by collecting the voice of the subject. For example, the processor 101 may acquire the imaging data obtained by the camera 50 imaging the examinee 10 as the subject data. The imaging data acquired at this time may include, for example, data of at least one of a three-dimensional image captured by a 3D camera, an infrared image captured by an infrared camera, and a moving image captured by a video camera. Instead of or in addition to this, the processor 101 may acquire the audio data obtained by the microphone 60 collecting the voice of the examinee 10 as the subject data.
[0051] However, it is not limited to this. For example, the processor 101 may acquire, as the subject data, the imaging data captured by a camera provided on the front of the gantry in an MRI apparatus, the audio data collected by a microphone provided on the front of the gantry, or the audio data collected by a microphone configured integrally with the headphones 70, etc.
[0052] In step S425, the processor 101 determines whether the subject 10 is ready to watch. For example, the processor 101 may automatically recognize from the subject data acquired in step S420 that the subject 10 is ready to watch. However, it is not limited thereto. For example, the processor 101 may determine that the subject 10 is ready to watch in response to detecting that the headphones 70 are worn. Also, for example, the processor 101 may determine that the subject 10 is ready to watch in response to the radiation technician 20 who has confirmed that the subject 10 is ready to watch pressing the preparation confirmation button.
[0053] In step S430, the processor 101, as the subject recognition unit 130, recognizes the attributes of the subject, here the subject 10, using the subject data acquired in step S420. For example, the processor 101 may recognize the gender, age, language used, origin, and disability information, etc. of the subject 10 as the attributes of the subject 10 from the appearance, mannerisms, diction, voice quality, accent, tone of voice, and smoothness of speech, etc. of the subject 10.
[0054] At this time, when the subject data includes data related to a person other than the subject 10, for example, the imaging data or voice data of the radiation technician 20, the processor 101 may select and discard the subject data based on the registration information acquired in step S410. As an example, assume that it is known from the registration information that the subject 10 has a height of 130 cm and a weight of 25 kg. In this case, the processor 101 may exclude from the subject data data other than the estimated height = 130 cm ± 10 cm estimated from the imaging data and data other than the estimated weight = 25 kg ± 10 kg.
[0055] Further, the processor 101 may determine whether the data is related to the subject 10 or the radiologic technologist 20 based on the position of the subject in the captured data and the direction of orientation in the voice data, and select and discard the target person data according to the determination result. Further, the processor 101 may determine whether the subject 10 is speaking or the radiologic technologist 20 is speaking based on the movement of the mouth (or the movement of the mask if wearing a mask), and select and discard the target person data according to the determination result.
[0056] In step S440, as the presentation information determination unit 150, the processor 101 determines the presentation information that the presentation device for presenting information related to the medical examination presents to the target person, here the subject 10, based on the target person data. In step S440 following step S430, the processor 101 determines the presentation information based on the attributes of the subject 10 recognized in step S430.
[0057] As an example, assume that the attributes of the subject 10 are recognized as "gender = female", "age = under 12 years old", "language used = Japanese", "hometown = Kansai", "visual impairment = yes", and "hearing impairment = no". In this case, the processor 101 may first select, as the presentation device for presenting information related to the medical examination, an acoustic device, for example, the headphones 70, based on the disability information. Then, the processor 101 may determine the presentation information by determining that the voice output by the headphones 70 to the subject 10 is "frequency = high", "volume = low", "speed = slow", and "language = Japanese (Kansai dialect)". This is generally based on empirical rules such as women feel at ease with a female voice, children have sensitive ears, children have a slower understanding of information, Japanese speakers can understand Japanese, and people from Kansai feel familiar with the Kansai dialect.
[0058] In this way, when the presentation device includes an acoustic device that presents information related to the medical examination, such as the headphones 70, by voice, the processor 101 may determine at least any one of the frequency, volume, speed, and language of the voice when determining the presentation information.
[0059] In step S450, the processor 101 supplies, via the communication interface 105, the presentation information determined in step S440 to the presentation device, here the headphones 70. As a result, information related to the medical examination is output from the headphones 70 in a manner corresponding to the attributes of the subject 10. More specifically, information related to the medical examination is output as voice in Japanese using a slow Kansai dialect in a relatively soft voice of a woman.
[0060] In step S460, the processor 101, as the subject data acquisition unit 120, acquires subject data including at least one of the captured data obtained by photographing the subject, here the subject 10, during the viewing of information related to the medical examination via the communication interface 105, and the voice data obtained by collecting the voice of the subject. Since the acquisition of the subject data itself may be the same as in step S420, the description thereof is omitted here.
[0061] In step S470, the processor 101, as the subject recognition unit 130, recognizes the situation of the subject, here the subject 10, during the viewing of information related to the medical examination using the subject data acquired in step S460. For example, the processor 101 may recognize the body posture, line of sight, expression, speech, etc. of the subject 10.
[0062] In step S480, the processor 101 determines whether it is necessary to change the presentation information based on the situation of the subject 10 recognized in step S470. For example, when the processor 101 determines from the situation of the subject 10 that the subject 10 is dozing off, looking around, or making an expression or speech indicating that the meaning of the presented presentation information is not understood, the processor 101 may determine that it is necessary to change the presentation information. In this case, the processor 101 returns the process to step S440.
[0063] In step S440 following step S480, the processor 101 determines the presentation information based on the subject recognized in step S470, here the situation of the subject 10. As an example, when it is grasped that the subject 10 is dozing off, the processor 101 may determine the presentation information so that the information related to the medical examination is paused and a voice "Please wake up" is output from the headphones 70 towards the subject 10. Also, when it is grasped that the subject 10 is looking around, the processor 101 may determine the presentation information so that, in addition to the information related to the medical examination, a voice "Please concentrate on the examination information" is output from the headphones 70 towards the subject 10. Further, when it is grasped that the subject 10 makes an expression or statement indicating that they do not understand the meaning of the presented presentation information, the processor 101 may determine the presentation information so that the information related to the medical examination is output from the headphones 70 more slowly or repeatedly as voice. Thereby, the presentation information corresponding to the viewing situation of the subject 10 is output as voice from the headphones 70.
[0064] On the other hand, in step S480, when it is determined that there is no need to change the presentation information, the processor 101 proceeds to step S490. In step S490, the processor 101 determines whether the presentation of the information related to the medical examination has ended. When it is determined that the presentation of the information related to the medical examination has not ended, the processor 101 returns the process to step S460. That is, the processor 101 monitors the situation of the subject 10 until the presentation of the information related to the medical examination ends, and repeats the process of changing the presentation information as necessary.
[0065] The examination support device 100 according to this embodiment can, for example, make the information related to the medical examination in a manner corresponding to the subject 10 in this way. Subsequently, the case of presenting the information related to the medical examination to the attendant 30 will be described.
[0066] FIG. 5 is a diagram showing an example of a flow when presenting information related to a medical examination to the accompanying person 30. In this flow, the person to whom the information related to the medical examination is presented is not the subject 10 himself / herself but the accompanying person 30.
[0067] In step S500, the processor 101 determines whether the person, here the accompanying person 30, has received the tablet terminal 80. For example, the processor 101 may determine that the accompanying person 30 has received the tablet terminal 80 in response to a nurse who has confirmed that the accompanying person 30 has received the tablet terminal 80 pressing the receipt confirmation button.
[0068] In step S510, the processor, as the registration information acquisition unit 110, acquires the registration information previously registered regarding the person to whom the information related to the medical examination is presented, here the accompanying person 30, via the communication interface 105. For example, the processor 101 may access at least one of HIS and RIS. Then, the processor 101 may search for the registration information previously registered regarding the accompanying person 30 using the name of the accompanying person 30 input via the tablet terminal 80 as a search key.
[0069] However, here it is assumed that the information regarding the accompanying person 30 has not been registered in advance. In this case, the processor 101 may cause the tablet terminal 80 to display a screen prompting the input of the name of the subject 10. Then, the processor 101 may search for at least one of HIS and RIS using the name of the subject 10 input via the tablet terminal 80 as a search key and acquire the examination information of the subject 10.
[0070] In step S520, as the subject data acquisition unit 120, the processor 101 acquires subject data including at least one of the subject who is the presentation destination of information related to the medical examination, here the accompanying person 30, the captured data obtained by photographing the accompanying person 30 via the communication interface 105, and the voice data obtained by collecting the voice of the subject. For example, the processor 101 may acquire, as subject data, the captured data obtained by the in-camera built into the tablet terminal 80 photographing the accompanying person 30. Alternatively or additionally, the processor 101 may acquire, as subject data, the voice data obtained by the microphone built into the tablet terminal 80 collecting the voice of the accompanying person 30.
[0071] However, it is not limited to this. For example, the processor 101 may acquire, as subject data, the captured data obtained by the camera provided on the ceiling of the waiting room, or the voice data obtained by the microphone provided on the ceiling of the waiting room collecting sound.
[0072] In step S525, the processor 101 determines whether the accompanying person 30 is ready to view. For example, the processor 101 may automatically recognize from the subject data acquired in step S520 that the accompanying person 30 is ready to view. However, it is not limited to this. For example, the processor 101 may determine that the accompanying person 30 is ready to view in response to the accompanying person 30 pressing the play start button displayed on the screen of the tablet terminal 80.
[0073] In step S530, as the subject recognition unit 130, the processor 101 uses the subject data acquired in step S520 to recognize the attributes of the subject, here the accompanying person 30. For example, the processor 101 may recognize, as the attributes of the accompanying person 30, the gender, age, language used, origin, and disability information of the accompanying person 30 from the appearance, gestures, diction, voice quality, accent, tone of voice, and smoothness of speech of the accompanying person 30.
[0074] In step S540, the processor 101, as the presentation information determination unit 150, determines the presentation information that the presentation device for presenting information related to the medical examination presents to the subject, here the accompanying person 30, based on the subject data. In step S540 following step S530, the processor 101 determines the presentation information based on the attributes of the accompanying person 30 recognized in step S530.
[0075] As an example, assume that the attributes of the accompanying person 30 are recognized as "gender = female", "age = 65 years or older", "language used = Korean", "origin = unknown", "visual impairment = none", and "hearing impairment = yes". In this case, the processor 101 may first select, as the presentation device for presenting information related to the medical examination based on the disability information, a display device, for example, the tablet terminal 80. Then, the processor 101 may determine the presentation information by determining that the display output by the tablet terminal 80 to the accompanying person 30 is "color = black characters on a yellow background", "brightness = bright", "character size = large", "speed = slow", and "language = Korean". This is generally based on empirical rules such as that as people get older, the colors and brightness that are easy to visually recognize change, that older people have difficulty reading small characters, that older people have a slow understanding of information, and that Korean speakers can understand Korean.
[0076] In this way, when the presentation device includes a display device that presents information related to the medical examination, such as the tablet terminal 80, by display, the processor 101 may determine at least any one of the color, brightness, size, speed, and language of the display when determining the presentation information.
[0077] In step S550, the processor 101 supplies the presentation information determined in step S540 to the presentation device, here the tablet terminal 80, via the communication interface 105. As a result, information related to the medical examination is output from the tablet terminal 80 in a manner corresponding to the attributes of the accompanying person 30. More specifically, information related to the medical examination is displayed and output from the tablet terminal 80 in Korean with large black characters on a yellow background, brightly and slowly.
[0078] In step S560, as the subject data acquisition unit 120, the processor 101 acquires subject data including at least one of the subject during viewing of information related to a medical examination, here the attached person 30, the captured data obtained by photographing the attached person 30, and the voice data obtained by collecting the voice of the subject, via the communication interface 105. Since the acquisition of the subject data itself may be the same as in step S520, the description thereof is omitted here.
[0079] In step S570, as the subject recognition unit 130, the processor 101 recognizes the situation of the subject during viewing of information related to a medical examination, here the attached person 30, using the subject data acquired in step S560. For example, the processor may recognize the body posture, eye line, expression, speech, etc. of the attached person 30.
[0080] In step S580, the processor 101 determines whether it is necessary to change the presented information based on the situation of the attached person 30 recognized in step S570. For example, when it is grasped from the situation of the attached person 30 that the attached person 30 is dozing off, looking around, or showing an expression or speech indicating that the meaning of the presented information is not understood, the processor 101 may determine that it is necessary to change the presented information. In this case, the processor 101 returns the process to step S540.
[0081] In step S540 following step S580, the processor 101 determines the presentation information based on the situation of the person recognized in step S570, here the attendant 30. As an example, when it is grasped that the attendant 30 is dozing off, the processor 101 may determine the presentation information so that the information related to the medical examination is paused and a display of "Please wake up" is output from the tablet terminal 80 toward the attendant 30 while vibrating. Also, when it is grasped that the attendant 30 is looking around, the processor 101 may determine the presentation information so that in addition to the information related to the medical examination, a display of "Please concentrate on the examination information" is output while flashing the flashlight. Further, when it is grasped that the attendant 30 has an expression or makes a statement indicating that the meaning of the presented presentation information is not understood, the processor 101 may determine the presentation information so that the information related to the medical examination is displayed and output from the tablet terminal 80 more slowly or repeatedly. Thereby, the presentation information corresponding to the viewing situation of the attendant 30 is displayed and output from the tablet terminal 80.
[0082] On the other hand, in step S580, when it is determined that there is no need to change the presentation information, the processor 101 advances the process to step S590. In step S590, the processor 101 determines whether or not the presentation of the information related to the medical examination has ended. When it is determined that the presentation of the information related to the medical examination has not ended, the processor 101 returns the process to step S560. That is, the processor 101 repeatedly performs the process of recognizing the situation of the attendant 30 until the presentation of the information related to the medical examination ends and changing the presentation information as necessary.
[0083] The examination support device 100 according to the present embodiment can, for example, make the information related to the medical examination in a manner corresponding to the attendant 30 in this way.
[0084] In the prior art, when the person to whom information is to be presented is not registered in advance or the registration is insufficient, there are cases where it is not possible to present information related to a medical examination in a manner corresponding to the person to whom the information is to be presented. In this case, the flow and content of the medical examination will be presented in a general manner. However, when the person to whom the information is to be presented is a child or a foreigner, or when the languages used by the subject 10 and the attendant 30 are different, there are problems in that it takes time to convey the flow and content of the medical examination and it is difficult to convey them correctly.
[0085] Therefore, the examination support device 100 according to the present embodiment acquires subject data including at least one of imaging data obtained by imaging a subject who is the recipient of information related to a medical examination and voice data obtained by collecting the voice of the subject, and determines presentation information that the presentation device presents to the subject based on the subject data. Thus, according to the examination support device 100 according to the present embodiment, even when only information such as name, height, weight, and examination information is registered as information related to the subject 10, or when the subject 10 is an emergency patient and no information related to the subject 10 is registered, it is possible to present information related to the medical examination in a manner corresponding to the subject 10. Further, according to the examination support device 100 according to the present embodiment, even when no information related to the attendant 30 is registered, it is possible to present information related to the medical examination in a manner corresponding to the attendant 30.
[0086] Further, the examination support device 100 may recognize the attributes of the subject using the subject data and determine the presentation information based on the attributes. Thus, according to the examination support device 100, from the appearance, mannerisms, diction, voice quality, accent, tone, and smoothness of speech of the subject such as the subject 10 and the attendant 30, it is possible to automatically recognize gender, age, language used, origin, and disability information, etc., and to present information related to the medical examination in a detailed manner corresponding to these attributes.
[0087] In addition, the inspection support device 100 may recognize the viewing status of the subject using the subject data and determine the presentation information based on the viewing status. Thereby, according to the inspection support device 100, from the body posture, eye line, expression, speech, etc. of the subject such as the examinee 10 and the attendant 30, the understanding status of the information related to the medical examination can be automatically inferred, and if necessary, the subject can be alerted or the mode can be changed.
[0088] In addition, when the inspection support device 100 presents information related to the medical examination by voice, it may determine at least any one of the frequency, volume, speed, and language of the voice. Also, when the inspection support device 100 presents information related to the medical examination by display, it may determine at least any one of the color, brightness, size, speed, and language of the display. Thereby, according to the inspection support device 100, when making the information related to the medical examination in a manner corresponding to the subject, an appropriate mode can be determined from various options. Therefore, according to the inspection support device 100, for example, when the subject is elderly, since it is difficult to hear high frequencies, the frequency of the voice is lowered; when the subject has a visual impairment (including the case of having an eye injury), it can flexibly respond such as presenting by voice instead of display.
[0089] So far, one possible embodiment has been shown as an example. However, the above-described embodiment can also be modified in various forms or applied to various uses. For example, in the above description, the case where the inspection support device 100 always acquires the subject data has been shown as an example. However, the inspection support device 100 may acquire the subject data as necessary.
[0090] For example, assume that in addition to the name, height, weight, and examination information of the subject 10, the gender and age of the subject 10 are registered in advance. In this case, the examination support device 100 can determine the frequency, volume, and speed of the voice, as well as the color, brightness, size, and speed of the display, etc. from the gender and age. However, since the language used by the subject 10 is unknown only from the registered information, the examination support device 100 cannot determine in which language the information related to the medical examination should be presented. Also, since the disability information of the subject 10 is unknown only from the registered information, the examination support device 100 cannot determine whether the information related to the medical examination should be presented by voice or by display.
[0091] For example, when the presentation information cannot be determined based on the registered information as described above, the processor 101 may instruct the imaging device, here the camera 50, that captures the subject, here the subject 10, to perform imaging, or may instruct the sound collection device, here the microphone 60, that collects the voice of the subject to perform sound collection.
[0092] Then, the processor 101 may determine the presentation information based on the registered information and the subject data. In this way, the examination support device 100 may complement the information for determining the presentation information by acquiring the subject data only when the registered information is insufficient to determine the presentation information. Thereby, according to the examination support device 100, it is not always necessary to acquire the subject data, so that the power consumption of the imaging device and the sound collection device can be reduced, and the shortage of the memory capacity due to the subject data can be avoided.
[0093] Also, in the above description, the case where there is one subject is shown as an example. However, the case where there are multiple subjects is also conceivable. Examples of such cases include when the attendant 30 enters the examination room together with the subject 10, or when multiple attendants 30 enter the waiting room. Therefore, the processor 101 can recognize a plurality of subjects with different attributes from the subject data.
[0094] In this way, when a plurality of subjects with different attributes are recognized, the processor 101 may determine which of the subjects corresponds to either the subject 10, the radiological technologist 20, or the attendant 30 based on at least one of the imaging data and the audio data. In such a determination, as described above, at least one of the degree of match with the registered information, the position of the subject, the pointing direction, and the movement of the mouth may be considered. Instead of or in addition to this, the processor 101 may receive, as the input reception unit 140, a user input for selecting for which of the plurality of subjects the presentation information is to be targeted.
[0095] FIG. 6 is a diagram showing an example of a display when receiving a user input. In this figure, an example is shown in which the presentation device includes a first presentation device and a second presentation device that present information related to a medical examination in different modes. Here, the first presentation device may be, for example, a display device that presents information related to a medical examination by display, and as an example, it may be the monitor of the examination support device 100. The second presentation device may be, for example, an acoustic device that presents information related to a medical examination by voice, and as an example, it may be the headphones 70.
[0096] In this way, when two people, the subject 10 and the attendant 30, enter an examination room where there are two presentation devices, a display device and an acoustic device, the processor 101 may display a screen as shown in this figure on, for example, the monitor of the examination support device 100.
[0097] The subject 10 or the attendant 30 who sees such a screen may select whether the presentation information output from the monitor is for adults, that is, for the attendant 30, or for children, that is, for the subject 10, by operating the mouse of the examination support device 100. Similarly, the subject 10 or the attendant 30 may select whether the presentation information output from the headphones 70 is for adults or for children.
[0098] In the above description, the case of selection by mouse operation is shown as an example, but selection can also be made by other operations such as touch panel, remote control, or voice recognition via a microphone.
[0099] In this figure, an example is shown of a state where it is selected to make the display for adults and the voice for children. When selected in this way, the processor 101 may cause the monitor to display and output "Information for adults will be presented from this monitor." and cause the headphones 70 to output voice "Information for children will be presented from these headphones." In this way, the processor 101 may guide in advance which presentation device will present information for whom. Then, the processor 101 may determine the presentation information to be displayed and output for adults and the presentation information to be output as voice for children, respectively. For example, in this way, the processor 101 includes a first presentation device and a second presentation device that present information related to a medical examination in different modes, and when a first subject and a second subject with different attributes are recognized, the processor 101 may determine the first presentation information presented by the first presentation device to the first subject and the second presentation information presented by the second presentation device to the second subject, respectively.
[0100] In the above description, the case where the display is for adults and the voice is for children is shown as an example, but it can be similarly applied to various cases such as having the display in English and the voice in Japanese, or having the display for the hearing-impaired and the voice for the visually-impaired.
[0101] Accordingly, according to the inspection support device 100, even when there are a plurality of subjects, information related to a medical examination can be presented in a manner according to the wishes of the subjects. Also, according to the inspection support device 100, when there are a plurality of presentation devices capable of presenting information related to a medical examination in different modes, the presentation information presented from each of the plurality of presentation devices can be presented in a manner according to each of the plurality of subjects.
[0102] In the above description, an example was shown in which the user is allowed to select for which of a plurality of target persons the presentation information is intended. However, the inspection support device 100 may automatically select for which of a plurality of target persons the presentation information is intended.
[0103] For example, as a priority order by age, a criterion such as "for children (under 12 years old) > for the elderly (65 years old and above) > for adults (12 to 64 years old)" may be predetermined. Similarly, as a priority order by gender, a criterion such as "for women > for men" may be predetermined. Such criteria may be predetermined by the hospital side. Then, when a plurality of target persons with different attributes are recognized, the processor 101 may automatically select, for example, according to such predetermined criteria, for which of the plurality of target persons to present information regarding the medical examination. Thereby, according to the inspection support device 100, even when a plurality of target persons are recognized, intervention by the user can be made unnecessary.
[0104] Also, in the above description, an example was shown in the case where the attributes of the target person could be uniquely recognized. However, the case where the attributes of the target person cannot be uniquely recognized is also conceivable. Examples of such cases include, for example, when it can be recognized from the appearance of the target person that the target person is Asian, but it cannot be determined whether the target person is Japanese, Korean, or Chinese, and as a result, it cannot be uniquely recognized whether the language used by the target person is Japanese, Korean, or Chinese.
[0105] Thus, when the attribute of the target person includes at least the language used by the target person and the language used cannot be uniquely recognized, the processor 101 may determine the presentation information so that the presentation device presents information related to the medical examination to the target person in a plurality of candidate languages.
[0106] FIG. 7 is a diagram showing an example of a display when presenting information in a plurality of candidate languages. When the language used by the subject cannot be uniquely recognized, the processor 101 may display a screen as shown in this figure on, for example, the monitor of the inspection support device 100.
[0107] Here, an example of a display is shown in the case where the recognition accuracy that the subject is Japanese, that is, the language used is Japanese, is the highest, the recognition accuracy that the subject is Korean, that is, the language used is Korean, is the lowest, and the recognition accuracy that the subject is Chinese, that is, the language used is Chinese, is in between. In such a case, the processor 101 may determine the presentation information so that, for example, the Japanese display has a font size = 14 and is bold, the Chinese display has a font size = 12, and the Korean display has a font size = 9. That is, the processor 101 may determine the degree of emphasis of the presentation according to the recognition accuracy. Also, the processor 101 may determine the presentation information so that, for example, the Japanese display is at the beginning, the Chinese display is the second, and the Korean display is the last. That is, the processor 101 may determine the order of presentation according to the recognition accuracy. The processor 101 may thus determine the presentation information so that the presentation device presents the information related to the medical examination to the subject in a manner according to the recognition accuracy for each of the plurality of candidate languages.
[0108] Accordingly, according to the inspection support device 100, even when the language used by the subject cannot be uniquely recognized, the presentation information is determined so as to be presented in a plurality of candidate languages, so that the possibility that the subject can understand the information related to the medical examination in any language can be increased. Also, according to the inspection support device 100, since the presentation information is determined according to the recognition accuracy for each of the plurality of candidate languages, the probability that the information related to the medical examination becomes a manner according to the subject can be increased.
[0109] In the above-described embodiments explained so far, the processor refers to a processor in a broad sense, including a general-purpose processor (e.g., CPU: Central Processing Unit, etc.) and a dedicated processor (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).
[0110] Also, the operation of the processor in the above-described embodiments may be achieved not only by a single processor but also by a plurality of physically separated processors cooperating with each other. Also, the order of each operation of the processor is not limited to the order described in each of the above embodiments and may be changed as appropriate.
[0111] Also, the inspection support device 100 according to the above-described embodiments has been described as being configured by a single device as an example, but it may be configured by a plurality of devices.
[0112] Also, the processing performed by the inspection support device 100 according to the above-described embodiments may be processing performed by software, may be processing performed by hardware, or may be processing combining both. Also, the processing performed by each part of the inspection support device 100 may be stored in a storage medium as a program and distributed.
[0113] Also, the present disclosure is not limited to the above, and it goes without saying that various modifications can be made and implemented within the scope not departing from the gist thereof.
[0114] Regarding the above embodiments, the following additional remarks are disclosed. (Additional Remark 1) Comprising a processor, the processor is Obtain subject data including at least one of imaging data obtained by imaging a subject who is a recipient of information related to a medical examination and voice data obtained by collecting the voice of the subject. Based on the subject data, determine presentation information that a presentation device for presenting information related to the medical examination presents to the subject. Examination support device. (Appendix 2) The processor Recognize the attributes of the subject using the subject data. Determine the presentation information based on the attributes of the subject. The examination support device according to Appendix 1. (Appendix 3) The processor When a plurality of subjects with different attributes are recognized, receive user input for selecting for which of the plurality of subjects the presentation information is to be directed. The examination support device according to Appendix 2. (Appendix 4) The processor When a plurality of subjects with different attributes are recognized, automatically select for which of the plurality of subjects the presentation information is to be directed according to a predetermined criterion. The examination support device according to Appendix 2 or 3. (Appendix 5) The processor The presentation device includes a first presentation device and a second presentation device that present information related to the medical examination in different manners, and when a first subject and a second subject with different attributes are recognized, determine first presentation information that the first presentation device presents to the first subject and second presentation information that the second presentation device presents to the second subject, respectively. The examination support device according to any one of Appendices 2 to 4. (Appendix 6) The processor When the attributes of the subject include at least the language used by the subject and the used language cannot be uniquely recognized, the presentation device determines the presentation information for presenting the information related to the medical examination to the subject in a plurality of candidate languages. The examination support device according to any one of Appendices 2 to 5. (Appendix 7) The processor The presentation device determines the presentation information for presenting the information related to the medical examination to the subject in a manner according to the recognition accuracy for each of the plurality of candidate languages. The examination support device according to any one of Appendices 2 to 6. (Appendix 8) The processor Using the subject data, recognize the situation of the subject during viewing of the information related to the medical examination, Determine the presentation information based on the situation of the subject. The examination support device according to any one of Appendices 1 to 7. (Appendix 9) The processor Obtain the registration information pre-registered for the subject, Determine the presentation information based on the registration information and the subject data. The examination support device according to any one of Appendices 1 to 8. (Appendix 10) The processor When the presentation information cannot be determined based on the registration information, instruct the imaging device that images the subject to perform imaging, or instruct the sound collection device that collects the voice of the subject to perform sound collection. The examination support device according to Appendix 9. (Appendix 11) The processor When the presentation device includes an acoustic device that presents the information related to the medical examination by voice, when determining the presentation information, determine at least any one of the frequency, volume, speed, and language of the voice. The examination support device according to any one of Appendices 1 to 10. (Appendix 12) When the processor includes a display device that presents information related to the medical examination by display, when determining the presentation information, at least any one of the color, brightness, size, speed, and language of the display is determined. The inspection support device according to any one of Appendices 1 to 11. (Appendix 13)(Appendix 13) The medical examination device equipped with the inspection support device according to any one of Appendices 1 to 12. Medical examination device. (Appendix 14) The computer Obtains subject data including at least one of imaging data obtained by imaging a subject who is a presentation destination of information related to a medical examination and voice data obtained by collecting the voice of the subject. Based on the subject data, determines presentation information that a presentation device that presents information related to the medical examination presents to the subject. Inspection support method. (Appendix 15) To the computer Causes the computer to obtain subject data including at least one of imaging data obtained by imaging a subject who is a presentation destination of information related to a medical examination and voice data obtained by collecting the voice of the subject. Based on the subject data, causes the presentation device that presents information related to the medical examination to determine presentation information that it presents to the subject. Inspection support program.
Explanation of symbols
[0115] 1 Medical examination system 10 Subject 20 Radiologic technologist 30 Attendant 40 Medical examination device 50 Camera 60 Microphone 70 Headphones 80 Tablet terminal 100 Inspection support device 101 Processor 102 ROM 103 RAM 104 Storage 105 Communication Interface 106 User Interface 110 Registration Information Acquisition Unit 120 Target Person Data Acquisition Unit 130 Target Person Recognition Unit 140 Input Reception Unit 150 Presentation Information Determination Unit 160 Presentation Information Supply Unit
Claims
1. a processor, the processor comprising: Acquire subject data including at least one of photographed data of a subject to whom information related to a medical test is to be presented and audio data of the subject; determining presentation information to be presented to the subject by a presentation device that presents information related to the medical test based on the subject data; Inspection support equipment.
2. The processor, Recognizing attributes of the subject using the subject data; determining the presentation information based on attributes of the subject; The inspection support device according to claim 1 .
3. The processor, receiving a user input for selecting, when a plurality of targets having different attributes are recognized, one of the plurality of targets for which the presentation information is to be directed; The inspection support device according to claim 2.
4. The processor, When a plurality of subjects having different attributes are recognized, automatically selecting which of the plurality of subjects the presentation information is intended for in accordance with a predetermined criterion. The inspection support device according to claim 2.
5. The processor, the presentation device includes a first presentation device and a second presentation device which present information related to the medical test in different manners, and when a first subject and a second subject having different attributes are recognized, first presentation information to be presented by the first presentation device to the first subject and second presentation information to be presented by the second presentation device to the second subject are determined, respectively; The inspection support device according to claim 2.
6. The processor, determining, when the attributes of the subject include at least a language used by the subject and the language used cannot be uniquely recognized, the presentation device presents information related to the medical test to the subject in a plurality of candidate languages; The inspection support device according to claim 2.
7. The processor, determining presentation information, the presentation device presenting the information related to the medical examination to the subject in a manner corresponding to the recognition accuracy for each of the plurality of candidate languages; The inspection support device according to claim 6.
8. The processor, using the subject data to recognize a situation of the subject while viewing information related to the medical examination; determining the presentation information based on a situation of the subject; The inspection support device according to claim 1 .
9. The processor, Obtaining pre-registered registration information regarding the subject; determining the presentation information based on the registration information and the subject data; The inspection support device according to claim 1 .
10. The processor, When the presentation information cannot be determined based on the registration information, instructing a photographing device that photographs the subject to photograph the subject, or instructing a sound collecting device that collects the subject's sound to collect the sound. The inspection support device according to claim 9.
11. The processor, When the presentation device includes an audio device that presents the information related to the medical examination by audio, determining at least one of a frequency, a volume, a speed, and a language of the audio in determining the presentation information. The inspection support device according to claim 1 .
12. The processor, If the presentation device includes a display device that presents information related to the medical test by displaying, determining at least one of a color, a brightness, a size, a speed, and a language of the display in determining the presentation information. The inspection support device according to claim 1 .
13. A medical device equipped with the examination support device according to any one of claims 1 to 10. Medical testing equipment.
14. The computer Acquire subject data including at least one of photographed data of a subject to whom information related to a medical test is to be presented and audio data of the subject; determining presentation information to be presented to the subject by a presentation device that presents information related to the medical test based on the subject data; Inspection support methods.
15. On the computer, acquiring subject data including at least one of photographed data of a subject to be presented with information related to a medical examination and audio data of the subject; determining presentation information to be presented to the subject by a presentation device that presents information related to the medical test based on the subject data; Testing assistance program.
Citation Information
Patent Citations
Surface treatment of aluminum fin for heat exchanger
JP1983016192A
Voice guidance management server and medical image diagnostic apparatus
JP2011022740A
Examination support system for subject in x-ray examination
JP2018094209A