Biological information processing system, information processing apparatus, biological information processing method, and biological information processing program
A wearable device with voice capture and analysis capabilities allows medical professionals to record patient biometric information hands-free, addressing the inconvenience of manual operation on stationary displays.
Patent Information
- Application Number
- JP2024052728
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-28
- Publication Date
- 2025-10-09
Smart Images
Figure 2025151352000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a biological information processing system, an information processing device, a biological information processing method, and a biological information processing program that record biological information of a patient. [Background technology]
[0002] Conventionally, medical professionals such as nurses in medical settings measure the biological information of multiple hospitalized patients, such as their body temperature, blood pressure, pulse rate, and blood oxygen concentration, and then input the measurement results into electronic medical records after the fact. Recently, medical professionals have also begun to record the measurement results of biological information using portable terminals. However, in such cases, medical professionals must operate the screen with their hands or a touch pen to record the measurement results of the biological information of multiple hospitalized patients, which places a burden on medical professionals.
[0003] In this regard, Patent Document 1 discloses a method for presenting, on a display device at a medical care site, during a patient consultation, suggested consultation actions based on patient data related to the patient, presenting, during the patient consultation, the suggested consultation actions, the patient consultation, and portions of the patient data that are contextually relevant to the patient, and updating the portions of the patient data presented on the display device based on measurements generated from the suggested consultation actions. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Special Publication No. 2023-545578 Summary of the Invention [Problem to be solved by the invention]
[0005] However, the method disclosed in Patent Document 1 uses a stationary display to present various patient information, and is therefore not suitable for situations where medical personnel need to travel to the patient's location to record the patient's biometric information.
[0006] In view of the above-mentioned problems, one of the objectives of the present disclosure is to provide a biometric information processing system, an information processing device, a biometric information processing method, and a biometric information processing program that can improve convenience when recording measurement results of a patient's biometric information. [Means for solving the problem]
[0007] The biological information processing system according to the present disclosure includes: A wearable device worn by medical professionals to capture voice, an information processing device that extracts and stores biological information of the patient from the voice acquired by the wearable device; Wearable devices are a sound collection unit that collects sound; a sound acquisition unit that acquires the sound collected by the sound collection unit; a voice information transmitting unit that transmits voice information indicating the voice acquired by the voice acquiring unit to the information processing device, The information processing device a voice information analysis unit that analyzes the voice information transmitted by the voice information transmission unit and outputs text information representing words contained in the voice information; a biometric information extraction unit that extracts biometric information of the patient from the text information output by the voice information analysis unit; The system further includes a patient information storage unit that stores the patient's biological information extracted by the biological information extraction unit in a storage device.
[0008] The information processing device according to the present disclosure includes: a voice information analysis unit that analyzes voice information indicating voice acquired by a wearable device worn by a medical professional and outputs text information indicating words included in the voice information; a biometric information extraction unit that extracts biometric information of the patient from the text information output by the voice information analysis unit; The system further includes a patient information storage unit that stores the patient's biological information extracted by the biological information extraction unit in a storage device.
[0009] The biological information processing method according to the present disclosure includes: The wearable device worn by the medical professional analyzes the audio information representing the voice acquired and outputs text information representing the words contained in the audio information. Extract the patient's biometric information from the output text information, The extracted patient's biometric information is stored in a storage device.
[0010] The biological information processing program according to the present disclosure is for a computer to: The wearable device worn by the medical staff analyzes the audio information representing the voice acquired and outputs text information representing the words contained in the audio information. Extract the patient's biometric information from the output text information, The extracted patient's biological information is stored in a storage device. [Effects of the Invention]
[0011] The present disclosure can provide a biological information processing system, an information processing device, a biological information processing method, and a biological information processing program that can improve convenience when recording measurement results of a patient's biological information. [Brief explanation of the drawings]
[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of a biological information processing system according to the present disclosure. [Figure 2] FIG. 1 is a diagram illustrating an example of the configuration of a wearable terminal according to the present disclosure. [Figure 3] FIG. 1 is a diagram illustrating an example of a configuration of an information processing device according to the present disclosure. [Figure 4] FIG. 10 is a diagram illustrating an example of a patient information table according to the present disclosure. [Figure 5] 10 is a flowchart illustrating an example of processing executed in the biological information processing system according to the present disclosure. [Figure 6]10 is a flowchart illustrating another example of processing executed in the biological information processing system according to the present disclosure. [Figure 7] 10 is a flowchart illustrating another example of processing executed in the biological information processing system according to the present disclosure. [Figure 8] FIG. 1 is a diagram illustrating an example of an image according to the present disclosure. [Figure 9] 10A and 10B are diagrams illustrating an instruction to start recording of biometric information by a fingertip. [Figure 10] FIG. 10 is a diagram illustrating another example of an image according to the present disclosure. [Figure 11] FIG. 10 is a diagram illustrating another example of an image according to the present disclosure. [Figure 12] FIG. 10 is a diagram illustrating another example of an image according to the present disclosure. [Figure 13] FIG. 1 is a diagram illustrating main components of a biological information processing system according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0013] An exemplary embodiment will be described below with reference to the drawings. Fig. 1 is a diagram illustrating an example of a biometric information processing system 1 according to the present disclosure. The biometric information processing system 1 includes a wearable terminal 10 and an information processing device 20. Although Fig. 1 illustrates a single wearable terminal 10, the biometric information processing system 1 may include multiple wearable terminals 10.
[0014] The wearable terminal 10 and the information processing device 20 communicate data with each other via a network 30. The network 30 may include a narrow area network such as a local area network (LAN) and / or a wide area network such as the Internet.
[0015] The wearable terminal 10 is a terminal device worn by a medical professional and capable of acquiring the voice of the medical professional. Specific examples of the wearable terminal 10 include eyeglass-type wearable terminals such as smart glasses, and watch-type wearable terminals. The wearable terminal 10 can transmit and receive data via wireless communication. The configuration of the wearable terminal 10 will be described in detail later.
[0016] The information processing device 20 is an information processing device that extracts and stores biological information of a patient from the voice acquired by the wearable device 10. A specific example of the information processing device 20 is an information processing device such as a server. The configuration of the information processing device 20 will be described in detail later.
[0017] 2 is a schematic diagram showing the configuration of a wearable terminal 10 according to the present disclosure. The wearable terminal 10 includes a computing device 11, a communication interface (I / F) 12, a storage device 13, a display device 14, an imaging device 15, and a sound collection device 16.
[0018] The arithmetic device 11 is a device that performs overall control of the wearable terminal 10. Specific examples of the arithmetic device 11 include processors such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The arithmetic device 11 executes a program stored in the storage device 13, thereby performing a method defined by the program. Note that in other embodiments, the functions performed by the arithmetic device 11 may also be performed by an integrated circuit such as an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). These devices correspond to computers.
[0019] The communication interface 12 is an interface for performing data communication between the wearable terminal 10 and other devices.
[0020] The storage device 13 is a storage device in which various data such as programs executed by the arithmetic device 11 and data processed by the arithmetic device 11 are stored.
[0021] The display device 14 is a device that displays various images. Various pieces of information about the patient are displayed on the display device 14. When a glasses-type wearable terminal is used as the wearable terminal 10, the display device 14 is a transparent type and is placed in front of the eyes of the wearer of the wearable terminal 10. The display device 14 corresponds to a display unit.
[0022] The image capturing device 15 is a device that captures images under the control of the computing device 11. The wearable terminal 10 may include multiple image capturing devices 15. One of the image capturing devices 15 is installed so that it can capture images of the area around the wearable terminal 10. When a glasses-type wearable terminal is used as the wearable terminal 10, the other image capturing device 15 is positioned so that it can capture images of the wearer's field of vision through the transparent display device 14. Furthermore, the other image capturing device 15 can be positioned so that it can capture images of the eyes of the wearer of the wearable terminal 10.
[0023] The sound collector 16 is a device for collecting the voice of the wearer of the wearable device 10. A specific example of the sound collector 16 is a device such as a microphone. The sound collector 16 corresponds to a sound collector.
[0024] The arithmetic device 11 executes an instruction receiving unit 110, an imaging control unit 111, an image transmission unit 112, a display control unit 113, an audio acquisition unit 114, and an audio information transmission unit 115. These functional units can be realized by a program.
[0025] The instruction receiving unit 110 is a program that receives various instructions from the wearer. The instructions received by the instruction receiving unit 110 include an instruction to take a photograph, an instruction to start recording the patient's biological information, and an instruction to stop recording the patient's biological information.
[0026] The instruction to take a photograph is an instruction to take a photograph using the photographing device 15 of the wearable terminal 10. This instruction can be given by the wearer using an input device such as a button provided on the wearable terminal 10.
[0027] The instruction to start recording the patient's biometric information is intended to instruct the start of recording the patient's biometric information. The instruction to start recording the patient's biometric information is given by a predetermined movement and voice of the wearer. For example, the instruction to start recording the patient's biometric information can be given using the fingertip of the wearer of the wearable device 10. When a glasses-type wearable device is used as the wearable device 10, the instruction receiving unit 110 determines whether the position of the wearer's fingertip in the captured image generated by the image capturing device 15 is within a predetermined area of the captured image that corresponds to a predetermined area 80 of the image displayed on the display device 14, as shown in FIG. 8. The instruction receiving unit 110 can identify the wearer's fingertip in the captured image using a trained model capable of recognizing human fingertips, pattern matching, or the like.
[0028] 9, the instruction receiving unit 110 determines whether the position of the wearer's fingertip in the captured image generated by the image capturing device 15 is within a predetermined area 90 of the captured image, which corresponds to a predetermined area 80 of the image displayed on the display device 14. If it is determined that the position of the wearer's fingertip is within the predetermined area 90 of the captured image, the instruction receiving unit 110 receives an instruction to start recording the patient's biological information.
[0029] The instruction receiving unit 110 also determines whether the position of the center point of the wearer's pupil in the captured image generated by the imaging device 15 is within a predetermined area of the captured image, which corresponds to a predetermined area of the image displayed on the display device 14. The instruction receiving unit 110 can identify the pupil of the wearer in the captured image using a trained model capable of recognizing a person's pupil, pattern matching, or the like. Then, if it is determined that the position of the center point of the wearer's pupil is within the predetermined area of the captured image, the instruction receiving unit 110 receives an instruction to start recording the patient's biometric information.
[0030] The instruction to end recording of the patient's biological information is to instruct the start of recording of the patient's biological information and is given by voice of the wearer.
[0031] The imaging control unit 111 is a program that controls the imaging device 15 to generate a captured image. For example, the imaging control unit 111 causes the imaging device 15 to capture a code in which the patient's identification information is embedded, and generates a captured image containing the code (hereinafter referred to as a "code image"). The code in which the patient's identification information is embedded may be, for example, a two-dimensional code or a one-dimensional code. The code may be placed near the patient's bed.
[0032] The photographing control unit 111 can also cause the photographing device 15 to photograph the field of view of the wearer through the transmissive display device 14 placed in front of the eyes of the wearer. Furthermore, the photographing control unit 111 can also cause the photographing device 15 to photograph the eyes of the wearer of the wearable terminal 10.
[0033] The image transmission unit 112 is a program that transmits the captured image generated by the imaging control unit 111 to the information processing device 20. Specifically, the image transmission unit 112 transmits a code image to the information processing device 20.
[0034] The display control unit 113 is a program that displays various images on the display device 14. The images displayed on the display device 14 include information about the patient, including biological information.
[0035] The voice acquisition unit 114 is a program that acquires voice collected by the sound collection device 16. The voice information transmission unit 115 is a program that transmits voice information indicating the voice collected by the sound collection device 16.
[0036] 3 is a schematic diagram showing the configuration of the information processing device 20 according to the present disclosure. The information processing device 20 includes a calculation device 21, a communication interface 22, and a storage device 23.
[0037] The arithmetic device 21 is a device that performs overall control of the information processing device 20. Specific examples of the arithmetic device 21 include processors such as a CPU and a GPU (Graphics Processing Unit). The arithmetic device 21 executes a program stored in the storage device 23, thereby performing a method defined by the program.
[0038] The communication interface 22 is an interface for performing data communication between the information processing device 20 and other devices.
[0039] The storage device 23 is a storage device that stores various data such as programs executed by the arithmetic device 21 and data processed by the arithmetic device 21. The storage device 23 stores a data table (hereinafter referred to as the "patient information table") in which patient information is registered. FIG. 4 is a diagram showing an example of the patient information table. The patient information table registers patient identification information, the patient's name, the patient's admission date, the patient's hospital room, the patient's date of birth, the patient's age, the patient's height, the patient's weight, the patient's body temperature, the patient's systolic blood pressure, the patient's diastolic blood pressure, the patient's pulse rate, the patient's blood oxygen level, the last update date and time, device identification information, the name of the wearer, and the like. The last update date and time is the last date and time the patient information was updated. The device identification information is identification information of the wearable device 10 that provided the audio containing the patient's biometric information. In other embodiments, the patient information table may be created in another storage device accessible to the information processing device 20, such as a data server. Note that in FIG. 4, the patient information table is divided into sections due to space limitations.
[0040] The arithmetic unit 21 executes an image analysis unit 210, a patient information acquisition unit 211, a patient information transmission unit 212, a voice information analysis unit 213, a text information determination unit 214, a notification unit 215, a biometric information extraction unit 216, a biometric information transmission unit 217, and a patient information storage unit 218. These functional units can be realized by a program.
[0041] The image analysis unit 210 is a program that analyzes the code image. The image analysis unit 210 analyzes the code image and acquires the patient identification information embedded in the code image.
[0042] The patient information acquisition unit 211 is a program that acquires patient information from a patient information table. Specifically, the patient information acquisition unit 211 acquires, from the patient information table, patient information associated with the patient identification information acquired by the image analysis unit 210.
[0043] The patient information transmission unit 212 is a program that transmits the patient information acquired by the patient information acquisition unit 211 from the patient information table to the wearable terminal 10.
[0044] The voice information analysis unit 213 is a program that analyzes voice information provided by the wearable device 10 and outputs text information included in the voice information. In this embodiment, a trained model capable of voice recognition can be adopted as the voice information analysis unit 213. The trained model can be trained by machine learning using training data in which voice information including various human conversations is used as input information and text information that expresses the conversations in text form is used as output information.
[0045] The text information determination unit 214 is a program that determines the text information output by the audio information analysis unit 213. More specifically, the text information determination unit 214 determines whether the text information output by the audio information analysis unit 213 includes text information indicating an instruction to start recording biometric information. When the instruction receiving unit 110 of the wearable terminal 10 receives an instruction to start recording the patient's biometric information, and the text information determination unit 214 determines that the text information output by the audio information analysis unit 213 includes text information indicating an instruction to start recording biometric information, the information processing device 20 transitions to a biometric information recording mode. In the biometric information recording mode, it becomes possible to extract, transmit, and save biometric information from the text information output by the audio information analysis unit 213.
[0046] Furthermore, the character information determination unit 214 determines whether or not character information indicating an instruction to end recording of biometric information is included in the character information output by the audio information analysis unit 213. After the information processing device 20 transitions to the biometric information recording mode, if the character information determination unit 214 determines that character information indicating an instruction to end recording of biometric information is included in the character information output by the audio information analysis unit 213, the information processing device 20 ends the biometric information recording mode, and the extraction, transmission, and storage of biometric information from the character information output by the audio information analysis unit 213 are stopped.
[0047] The notification unit 215 is a program that transmits various notifications to the wearable terminal 10. The notifications transmitted by the notification unit 215 include a notification that the information processing device 20 has transitioned to a biometric information recording mode (hereinafter referred to as a "recording mode transition notification"), and a notification that the biometric information recording mode of the information processing device 20 has ended (hereinafter referred to as a "recording mode end notification").
[0048] The biometric information extraction unit 216 is a program that extracts biometric information from the text information output by the audio information analysis unit 213. In this embodiment, a language model such as a large-scale language model (LLM) can be adopted as the biometric information extraction unit 216. It is preferable that the language model specifies a condition for outputting characters indicating the type of biometric information and the numerical value of the biometric information as a prompt. The characters indicating the type of biometric information are, for example, body temperature, systolic blood pressure, diastolic blood pressure, heart rate, and blood oxygen concentration. The numerical value of the biometric information is, for example, a body temperature value, a systolic blood pressure value, a diastolic blood pressure value, a heart rate value, and a blood oxygen concentration value.
[0049] The biometric information transmitting unit 217 is a program that transmits the biometric information extracted by the biometric information extracting unit 216 to the wearable terminal 10.
[0050] The patient information storage unit 218 is a program that stores patient information in a patient information table. For example, the patient information storage unit 218 stores the biometric information extracted by the biometric information extraction unit 216 in association with the patient identification information acquired by the image analysis unit 210 in the patient information table.
[0051] 5 to 7 are sequence diagrams showing an example of processing executed in the biological information processing system 1. When a wearer of the wearable terminal 10 instructs the wearable terminal 10 to capture an image of a code in which the patient's identification information is embedded, the instruction receiving unit 110 of the wearable terminal 10 receives the image capturing instruction in step S1.
[0052] When the instruction receiving unit 110 receives a photographing instruction, in step S2 the photographing control unit 111 causes the photographing device 15 to photograph the code and generate a code image. In step S3, the image sending unit 112 sends the generated code image to the information processing device 20 together with the identification information of the wearable terminal 10.
[0053] When the information processing device 20 receives the code image transmitted by the wearable device 10, the image analysis unit 210 of the information processing device 20 analyzes the code image and acquires the patient's identification information in step S4. In step S5, the patient information acquisition unit 211 acquires the patient information associated with the patient's identification information from the patient information table. In step S6, the patient information transmission unit 212 transmits the acquired patient information to the wearable device 10.
[0054] When the wearable device 10 receives the patient information transmitted by the information processing device 20, in step S7 the display control unit 113 of the wearable device 10 displays the received patient information on the display device 14. Fig. 8 is a diagram showing an example of an image displayed in step S7. This image mainly displays patient information registered in the patient information table.
[0055] Next, when the wearer of the wearable device 10 instructs the wearable device 10 to start recording the patient's biological information, the instruction receiving unit 110 of the wearable device 10 receives the instruction to start recording the patient's biological information in step S8. When the instruction receiving unit 110 receives the instruction to start recording the patient's biological information, the audio acquiring unit 114 acquires the audio collected by the sound collecting device 16 in step S9. In step S10, the audio information transmitting unit 115 transmits audio information indicating the collected audio to the information processing device 20.
[0056] When the information processing device 20 receives the voice information transmitted by the wearable device 10, in step S11 the voice information analysis unit 213 of the information processing device 20 analyzes the received voice information and outputs text information representing words contained in the voice information. In step S12, the text information determination unit 214 determines whether the output text information includes text information indicating an instruction to start recording biometric information. If it is determined that the output text information includes text information indicating an instruction to start recording biometric information, the information processing device 20 transitions to a biometric information recording mode in step S13. In step S14, the notification unit 215 transmits a recording mode transition notification to the wearable device 10.
[0057] When the wearable terminal 10 receives the recording mode transition notification transmitted by the information processing device 20, the display control unit 113 of the wearable terminal 10 changes the display image displayed on the display device 14 in step S15. FIG. 10 is a diagram showing an example of the image displayed in step S15. This image preferably displays a message that audio including the patient's biological information is being recorded. For example, characters or a mark indicating that audio is being recorded can be used. At this time, the display control unit 113 may change the background color of the image 100 displayed in step S7.
[0058] Next, in step S16, the voice acquisition unit 114 acquires the voice collected by the sound collection device 16. In step S17, the voice information transmission unit 115 transmits voice information indicating the collected voice to the information processing device 20.
[0059] When the information processing device 20 receives the voice information transmitted by the wearable device 10, in step S18 the voice information analysis unit 213 of the information processing device 20 analyzes the received voice information and outputs text information representing words included in the voice information. In step S19, the biometric information extraction unit 216 extracts biometric information from the output text information.
[0060] In step S20, the biometric information transmitting unit 217 transmits the extracted biometric information to the wearable device 10. At this time, the biometric information transmitting unit 217 transmits characters indicating the type of biometric information included in the extracted biometric information in association with the numerical value of the biometric information. Specifically, the biometric information transmitting unit 217 transmits characters indicating the body temperature in association with the numerical value of the body temperature. Furthermore, the biometric information transmitting unit 217 transmits characters indicating the systolic blood pressure in association with the numerical value of the systolic blood pressure. Furthermore, the biometric information transmitting unit 217 transmits characters indicating the diastolic blood pressure in association with the numerical value of the diastolic blood pressure. Furthermore, the biometric information transmitting unit 217 transmits characters indicating the blood oxygen concentration in association with the numerical value of the blood oxygen concentration.
[0061] When the wearable device 10 receives the biometric information transmitted by the information processing device 20, the display control unit 113 of the wearable device 10 displays the received biometric information on the display device 14 in step S21. FIG. 11 is a diagram showing an example of an image displayed in step S21. This image displays characters indicating the type of biometric information included in the biometric information transmitted by the information processing device 20 in association with the numerical value of the biometric information. In other words, the image displays the patient's biometric information extracted from the voice of the person wearing the wearable device 10.
[0062] Next, in step S22, the voice acquisition unit 114 acquires the voice collected by the sound collection device 16. In step S23, the voice information transmission unit 115 transmits voice information indicating the collected voice to the information processing device 20.
[0063] When the information processing device 20 receives the voice information transmitted by the wearable device 10, in step S24 the voice information analysis unit 213 of the information processing device 20 analyzes the received voice information and outputs text information representing the words contained in the voice information. In step S25, the text information determination unit 214 determines whether the output text information includes text information indicating an instruction to end recording of biometric information. If it is determined that the output text information includes text information indicating an instruction to end recording of biometric information, the information processing device 20 ends the biometric information recording mode in step S26. In step S27, the notification unit 215 transmits a recording mode end notification to the wearable device 10.
[0064] In step S28, the patient information storage unit 218 associates the biometric information extracted in step S19 with the patient's identification information acquired in step S5 and stores the associated information in the patient information table. At this time, the patient information storage unit 218 stores the identification information of the wearable device 10 received from the wearable device 10 and the last update date and time corresponding to the date and time when the biometric information was saved in the patient information table, associated with the patient's identification information. Furthermore, the patient information storage unit 218 registers the name of the wearer of the wearable device 10 in association with the identification information of the wearable device 10. The patient information storage unit 218 can identify the name of the wearer to be registered in the patient information table by referring to another data table in which the identification information of the wearable device 10 and the name of the wearer are registered in association with each other.
[0065] When the wearable terminal 10 receives the recording mode end notification transmitted by the information processing device 20, in step S29 the display control unit 113 of the wearable terminal 10 changes the display image displayed on the display device 14. Fig. 12 is a diagram showing an example of the image displayed in step S29. This image displays the updated biometric information.
[0066] 13 is a diagram showing the main components of a biometric information processing system 1. The biometric information processing system 1 includes a wearable device 10 worn by a medical professional and configured to acquire voice, and an information processing device 20 configured to extract and store biometric information of a patient from the voice acquired by the wearable device 10. The wearable device 10 includes a sound collection device 16 configured to collect voice, a voice acquisition unit 114 configured to acquire the voice collected by the sound collection device 16, and a voice information transmission unit 115 configured to transmit voice information indicating the voice acquired by the voice acquisition unit 114 to the information processing device 20. The information processing device 20 includes a voice information analysis unit 213 configured to analyze the voice information transmitted by the voice information transmission unit 115 and output text information representing words contained in the voice information, a biometric information extraction unit 216 configured to extract biometric information of the patient from the text information output by the voice information analysis unit 213, and a patient information storage unit 218 configured to store the biometric information of the patient extracted by the biometric information extraction unit 216 in a storage device 23.
[0067] By adopting this configuration, a medical professional wearing the wearable device 10 can go to the patient's location and record the measurement results of the patient's biological information using voice, which improves the convenience of recording the measurement results of the patient's biological information and reduces the burden on medical professionals.
[0068] Furthermore, in the above-described embodiment, the biometric information extraction unit 216 may use a language model in which character information is used as input information and biometric information included in the character information is used as output information. This language model specifies conditions for outputting characters indicating the type of biometric information and the numerical value of the biometric information. This allows the biometric information extraction unit 216 to appropriately output the characters indicating the type of biometric information and the numerical value of the biometric information.
[0069] Furthermore, the wearable terminal 10 may include a transparent display device 14 placed in front of the eyes of the wearer of the wearable terminal 10, an image capturing device 15 capable of capturing an image of the wearer's field of view through the display device 14, and an instruction receiving unit 110 that receives instructions from the wearer. The instruction receiving unit 110 determines whether the position of the wearer's fingertip in the captured image generated by the image capturing device 15 is within a predetermined area of the captured image that corresponds to a predetermined area of the image displayed on the display device 14. If it is determined that the position of the wearer's fingertip is within the predetermined area of the captured image, the instruction receiving unit 110 receives an instruction to start recording the patient's biological information.
[0070] This allows the wearer to instruct the start of recording of the patient's biological information when the wearer's fingertip, as seen from the wearer, is within a predetermined area of the image displayed on the display device 14. This improves the convenience of recording the measurement results of the patient's biological information.
[0071] Furthermore, the wearable terminal 10 may include a photographing device capable of photographing the field of view of the wearer via the display device 14. The instruction receiving unit 110 determines whether the position of the center point of the wearer's pupil in the photographed image generated by the photographing device 15 is within a predetermined area of the photographed image that corresponds to a predetermined area of the image displayed on the display device 14. If it is determined that the position of the center point of the wearer's pupil is within the predetermined area of the photographed image, the instruction receiving unit 110 receives an instruction to start recording the patient's biological information.
[0072] This allows the wearer to instruct the start of recording of the patient's biological information by moving their line of sight so that the position of the center point of the pupil is within a predetermined area of the captured image that corresponds to the predetermined area of the image displayed on the display device 14. This improves the convenience of recording the measurement results of the patient's biological information.
[0073] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disk (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.
[0074] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.
[0075] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.
[0076] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) A wearable device worn by medical professionals to capture voice, an information processing device that extracts and stores biological information of a patient from the voice acquired by the wearable device; The wearable terminal includes: a sound collection unit that collects sound; a voice acquisition unit that acquires the voice collected by the voice collection unit; a voice information transmitting unit that transmits voice information indicating the voice acquired by the voice acquiring unit to the information processing device; The information processing device includes: a voice information analysis unit that analyzes the voice information transmitted by the voice information transmission unit and outputs text information representing words contained in the voice information; a biometric information extraction unit that extracts biometric information of a patient from the character information output by the voice information analysis unit; a patient information storage unit that stores the patient's biological information extracted by the biological information extraction unit in a storage device; Biometric information processing system. (Appendix 2) the biometric information extraction unit is a language model that uses character information as input information and biometric information included in the character information as output information, 2. The biometric information processing system according to claim 1, wherein the language model specifies a condition for outputting a character indicating the type of the biometric information and a numerical value of the biometric information. (Appendix 3) The biological information processing system according to claim 2, wherein the biological information includes at least one of the patient's body temperature, blood pressure, heart rate, and blood oxygen concentration. (Appendix 4) The wearable terminal includes: a transmission-type display unit disposed in front of the eyes of a wearer of the wearable device; an imaging device capable of capturing an image of the wearer's field of view via the display unit; an instruction receiving unit that receives an instruction from the wearer, The instruction receiving unit determining whether the position of the wearer's fingertip in the captured image generated by the imaging device is within a predetermined area of the captured image that corresponds to a predetermined area of the image displayed on the display unit; The biometric information processing system according to any one of appendices 1 to 3, wherein, when it is determined that the position of the wearer's fingertip is within a predetermined area of the captured image, an instruction to start recording the patient's biometric information is accepted. (Appendix 5) The wearable terminal includes: a transmission-type display unit disposed in front of the eyes of a wearer of the wearable device; an imaging device capable of imaging the wearer's eyes; an instruction receiving unit that receives an instruction from the wearer, The instruction receiving unit determining whether the position of the center point of the pupil of the wearer in the captured image generated by the photographing device is within a predetermined area of the captured image corresponding to a predetermined area of the image displayed on the display unit; A biometric information processing system as described in any one of Appendices 1 to 3, which accepts an instruction to start recording the patient's biometric information when it is determined that the position of the center point of the wearer's pupil is within a predetermined area of the captured image. (Appendix 6) The biometric information processing system described in Appendix 4, wherein when the instruction receiving unit receives an instruction to start recording the patient's biometric information, the biometric information extraction unit starts extracting the patient's biometric information from the text information when the text information output by the audio information analysis unit includes characters instructing the start of recording the patient's biometric information. (Appendix 7) a voice information analysis unit that analyzes voice information indicating voice acquired by a wearable device worn by a medical professional and outputs text information representing words included in the voice information; a biometric information extraction unit that extracts biometric information of a patient from the character information output by the voice information analysis unit; a patient information storage unit that stores the patient's biological information extracted by the biological information extraction unit in a storage device; An information processing device comprising: (Appendix 8) the biometric information extraction unit is a language model that uses character information as input information and biometric information included in the character information as output information, 8. The information processing device according to claim 7, wherein the language model specifies a condition for outputting a character indicating a type of the biometric information and a numerical value of the biometric information. (Appendix 9) The computer Analyzing audio information indicating speech acquired by a wearable device worn by a medical professional, and outputting text information representing words included in the audio information; Extract the patient's biometric information from the output text information, storing the extracted patient biometric information in a storage device; Biometric information processing method. (Appendix 10) For computers, Analyzing audio information indicating speech acquired by a wearable device worn by a medical professional, and outputting text information representing words included in the audio information; Extract the patient's biometric information from the output text information, storing the extracted patient's biological information in a storage device; Biometric information processing program.
[0077] Some or all of the elements described in Supplementary Notes 2 and 3 that are dependent on Supplementary Notes 1 may also be dependent on Supplementary Notes 9 and 10 in the same dependent relationship as Supplementary Notes 2 and 3. Some or all of the elements described in Supplementary Notes 3 that are dependent on Supplementary Notes 1 may also be dependent on Supplementary Notes 7 and 8 in the same dependent relationship as Supplementary Notes 3. Some or all of the elements described in any Supplementary Note may be applicable to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]
[0078] 1: Biological information processing system 10: Wearable devices 11: Arithmetic device 12: Communication interface 13:Storage device 14:Display device 15: Imaging device 16: Sound collection device 20: Information processing device 21: Arithmetic device 22: Communication interface 23: Storage device 30: Network 110: Instruction Reception Department 111: Shooting control unit 112: Image transmission unit 113: Display control unit 114: Voice acquisition unit 115: Voice information transmission unit 210: Image analysis unit 211: Patient information acquisition department 212: Patient information transmission unit 213: Audio information analysis unit 214:Character information determination section 215: Notification Department 216: Biometric information extraction unit 217: Biometric information transmission unit 218: Patient information storage department
Claims
1. A wearable device worn by medical professionals to capture voice, an information processing device that extracts and stores biological information of a patient from the voice acquired by the wearable device; The wearable terminal includes: a sound collection unit that collects sound; a voice acquisition unit that acquires the voice collected by the voice collection unit; a voice information transmitting unit that transmits voice information indicating the voice acquired by the voice acquiring unit to the information processing device; The information processing device includes: a voice information analysis unit that analyzes the voice information transmitted by the voice information transmission unit and outputs text information representing words contained in the voice information; a biometric information extraction unit that extracts biometric information of a patient from the character information output by the voice information analysis unit; a patient information storage unit that stores the patient's biological information extracted by the biological information extraction unit in a storage device; Biometric information processing system.
2. the biometric information extraction unit is a language model that uses character information as input information and biometric information included in the character information as output information, The biometric information processing system according to claim 1 , wherein the language model specifies a condition for outputting a character indicating the type of the biometric information and a numerical value of the biometric information.
3. The biological information processing system according to claim 2 , wherein the biological information includes at least one of the patient's body temperature, blood pressure, heart rate, and blood oxygen concentration.
4. The wearable terminal includes: a transmission-type display unit disposed in front of the eyes of a wearer of the wearable device; an imaging device capable of capturing an image of the wearer's field of view via the display unit; an instruction receiving unit that receives an instruction from the wearer, The instruction receiving unit determining whether the position of the wearer's fingertip in the captured image generated by the imaging device is within a predetermined area of the captured image that corresponds to a predetermined area of the image displayed on the display unit; The biometric information processing system according to any one of claims 1 to 3, wherein if it is determined that the position of the wearer's fingertip is within a predetermined area of the captured image, an instruction to start recording the patient's biometric information is accepted.
5. The wearable terminal includes: a transmission-type display unit disposed in front of the eyes of a wearer of the wearable device; an imaging device capable of imaging the wearer's eyes; an instruction receiving unit that receives an instruction from the wearer, The instruction receiving unit determining whether the position of the center point of the pupil of the wearer in the captured image generated by the photographing device is within a predetermined area of the captured image corresponding to a predetermined area of the image displayed on the display unit; A biometric information processing system according to any one of claims 1 to 3, which accepts an instruction to start recording the patient's biometric information when it is determined that the position of the center point of the wearer's pupil is within a predetermined area of the captured image.
6. 5. The biometric information processing system of claim 4, wherein when the instruction receiving unit receives an instruction to start recording the patient's biometric information, the biometric information extraction unit starts extracting the patient's biometric information from the character information when the character information output by the audio information analysis unit includes a character instructing the start of recording the patient's biometric information.
7. a voice information analysis unit that analyzes voice information indicating voice acquired by a wearable device worn by a medical professional and outputs text information representing words included in the voice information; a biometric information extraction unit that extracts biometric information of a patient from the character information output by the voice information analysis unit; a patient information storage unit that stores the patient's biological information extracted by the biological information extraction unit in a storage device; An information processing device comprising:
8. the biometric information extraction unit is a language model that uses character information as input information and biometric information included in the character information as output information, The information processing apparatus according to claim 7 , wherein the language model specifies a condition for outputting a character indicating the type of the biometric information and a numerical value of the biometric information.
9. The computer Analyzing audio information indicating speech acquired by a wearable device worn by a medical professional, and outputting text information representing words included in the audio information; Extract the patient's biometric information from the output text information, storing the extracted patient biometric information in a storage device; Biometric information processing method.
10. For computers, Analyzing audio information indicating speech acquired by a wearable device worn by a medical professional, and outputting text information representing words included in the audio information; Extract the patient's biometric information from the output text information, storing the extracted patient's biological information in a storage device; Biometric information processing program.
Citation Information
Patent Citations
Collaborative Smart Screen
JP2023545578A