Patient monitoring and nurse call systems

A self-propelled robot with face recognition and communication capabilities autonomously monitors patients, reducing nurse workload and ensuring timely emergency responses by storing and analyzing patient data.

JP7612485B2Active Publication Date: 2025-01-14AIPHONE CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021060908
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-31
Publication Date
2025-01-14
Estimated Expiration
2041-03-31

AI Technical Summary

Technical Problem

Existing patient monitoring systems require nurses to physically visit patients' rooms for data collection, which is time-consuming and inefficient, and may miss vital signs if the patient is not present.

Method used

A self-propelled robot equipped with a camera, face recognition, and communication capabilities that autonomously moves around the hospital, performs patient monitoring, and stores information in a central server, allowing remote patient assessment without nurse presence.

Benefits of technology

Reduces nurse workload by enabling remote patient monitoring, ensures consistent patient care, and allows for timely response to emergencies by storing and analyzing patient data accurately.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007612485000001
    Figure 0007612485000001
  • Figure 0007612485000002
    Figure 0007612485000002
  • Figure 0007612485000003
    Figure 0007612485000003
Patent Text Reader

Abstract

To provide a system with which it is possible to monitor a patient without the need for patrol of nurses, or even when the patient does not stay in a hospital room.SOLUTION: In a patient monitoring system, a self-propelled robot 6 includes: a self-propelled robot 6 including a subject information storage unit 63 for storing the face information of a monitoring subject, a camera 61, a face authentication unit 62, a conversion unit 65, a character conversion unit 66 for converting a patient speech into characters, a self-propelled robot communication unit 72 for wirelessly communicating with the outside, a map information storage unit 64 for storing the internal map information of a hospital, and a self-propelled robot CPU 71 for recognizing its own position and controlling monitoring; and a patient management server for accumulating monitoring information. The self-propelled robot CPU moves the self-propelled robot in a prescribed area of the hospital and carries out monitoring when the person shot by a camera in the middle of movement is a patient registered in the subject information storage unit and satisfies a prescribed condition, and transmits the acquired imaged image and text information to the patient management server where the information is accumulated.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a patient monitoring system and a nurse call system for monitoring a patient. [Background technology]

[0002] In hospitals and facilities, when checking on a patient's condition, a nurse or other staff member would make rounds to monitor the patient, check on the patient's condition, and obtain and record the patient's vital signs. Recording during rounds has become automated, reducing the hassle of transcription, but it was necessary to go to the patient or resident's location to obtain the information, which was extremely time-consuming. In order to reduce the burden on nurses, a nurse call system has been proposed that allows nurses to obtain information about patients without visiting their rooms. For example, in Patent Document 1, a camera that captures images of a patient can be operated using a portable terminal carried by a nurse, and the patient's condition can be displayed on the portable terminal for monitoring. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-162241 A Summary of the Invention [Problem to be solved by the invention]

[0004] The technology in Patent Document 1 above allows a nurse to check on the patient's condition from the video captured by the camera without having to make rounds. However, if the patient was not in bed or in the room when the patrol monitoring operation was performed, the camera could not capture the patient's image, making it impossible to confirm the patient's condition. Also, vital signs were measured by the patient themselves, so there were cases where they could not be obtained.

[0005] In view of the above problems, the present invention has an object to provide a system that allows monitoring of patients without nurses making rounds and even when the patients are not in their hospital rooms. [Means for solving the problem]

[0006] In order to solve the above problem, the patient monitoring system according to the invention of claim 1 comprises a subject information storage unit which stores facial information of a patient who is a subject of monitoring, a camera which images the patient, a face authentication unit which performs face authentication, a call unit for conversing with the patient, a character conversion unit which converts the patient's voice into character, a communication unit which wirelessly communicates with the outside, a position recognition unit which recognizes its own position based on information transmitted from a position information transmitter which is installed at an appropriate position in the hospital and transmits a position signal, a map information storage unit which stores map information within the hospital, and a monitoring control unit which controls monitoring, and a patient management server which communicates with the self-propelled robot and accumulates information about the monitoring that has been carried out, the monitoring control unit moves the self-propelled robot within the hospital, and if the face authentication unit determines that a person imaged by the camera during the process is a patient registered in the subject information storage unit and satisfies a predetermined condition, carries out monitoring, sounds a predetermined message from the call unit, and transmits the content of the response as monitoring information to the patient management server to be accumulated, while The patient management server has a time management unit that manages the monitoring interval, and when a patient has not been monitored for a first predetermined time, the time management unit instructs the monitoring control unit to find the patient and perform monitoring, and the monitoring control unit controls the movement and performs monitoring according to the instruction. It is characterized by: According to this configuration, the self-propelled robot moves around to monitor the patient and obtains information such as words uttered by the patient, so nurses do not have to go to the patient to monitor them, and monitoring can be done even if the patient is not in the hospital room. The acquired patient information is stored in the patient management server, so nurses can understand the patient's condition by viewing this information. This reduces the burden on nurses to make rounds and enables smooth response to emergency situations.

[0007] In addition,The self-propelled robot operates in such a way that no patient is left unmonitored for a long period of time, making it possible to monitor each patient equally and eliminating the need for nurses to give instructions to the self-propelled robot.

[0008] Claim 2 The invention is as follows: 1 In the configuration described above, if the patient being imaged by the camera is a patient for whom a second predetermined time period that is shorter than the first predetermined time period has not passed since the last monitoring, the time management unit instructs the monitoring control unit not to monitor the patient, and the monitoring control unit proceeds to monitoring the next patient in accordance with the instruction. According to this configuration, monitoring is not performed frequently on the same patient, which does not inconvenience the patient and prevents unnecessary monitoring.

[0009] Claim 3 The invention of claim 1 or 2 In the configuration described above, the patient management server has a text judgment unit that judges whether the patient has an abnormality from the acquired text information of the patient, and if the text judgment unit determines that an abnormality has occurred, it notifies a specified external party. According to this configuration, if a patient complains of an abnormality during monitoring, it is possible to recognize the abnormality and notify the outside. Therefore, for example, by notifying a mobile device carried by a nurse, it is possible to respond without delay.

[0010] Claim 4 The invention is as set forth in claims 1 to 3 In any of the configurations described above, the self-propelled robot has a vital information acquisition unit, and the monitoring control unit acquires vital information of the person being monitored during or after the conversation and transmits it to a patient management server. According to this configuration, vital information of the patient can be obtained through monitoring, so that the patient's condition can be managed with a high degree of accuracy.

[0011] Claim 5 The invention is as follows: 4In the configuration described above, the patient management server has a vital information judgment unit that compares the vital information transmitted from the self-propelled robot with vital information obtained in past monitoring of the same patient to determine whether or not an abnormality has occurred, and if it determines that an abnormality has occurred, notifies a specified external party. This configuration allows for highly accurate judgments, since the system compares current and past vital signs to determine whether a patient is experiencing an abnormality. If an abnormality is determined to have occurred, the system notifies the outside, for example, via a mobile device carried by a nurse, enabling prompt action.

[0012] Claim 6 The present invention relates to a nurse call system having a nurse call handset for a patient to call a nurse, a nurse call master for answering calls from the nurse call handset, and a mobile terminal carried by a nurse for answering calls from the nurse call handset, and the system is as described in claims 1 to 5 The present invention relates to a patient monitoring system comprising a self-propelled robot that communicates with a base station that constitutes a communication network of mobile terminals, and communicates with a patient management server via the base station. According to this configuration, costs can be reduced by building a patient monitoring system using a nurse call system. Effect of the Invention

[0013] According to the present invention, the self-propelled robot moves around to monitor the patient and obtains information such as words uttered by the patient, so nurses do not have to go to the patient's place to monitor them, and monitoring can be done even if the patient is not in the hospital room. The acquired patient information is stored in a patient management server, so nurses can understand the patient's condition by viewing this information. This reduces the burden on nurses to make rounds and allows for smooth response to emergencies. [Brief description of the drawings]

[0014] [Figure 1]FIG. 1 shows an example of a patient monitoring system according to the present invention, and is a configuration diagram integrated with a nurse call system. [Diagram 2] FIG. 1 is a block diagram of a self-propelled robot. [Diagram 3] FIG. 2 is a block diagram of a patient management server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Fig. 1 shows an example of a patient monitoring system according to the present invention, and shows a configuration integrated with a nurse call system. As shown in FIG. 1, the nurse call system includes a nurse call handset 1 installed at each bed so that patients can call a nurse, a corridor light 2 installed in each hospital room, a nurse call master unit 3 installed at the nurse's station to notify the nurse of calls made by the nurse call handset 1 and for the nurse to respond to, a mobile terminal 4 such as a smartphone that each nurse carries to respond to calls, a controller 5 that controls communications between the devices, a self-propelled robot 6 that moves by itself and monitors patients, a base station 7 such as an access point for communication between the mobile terminal 4 and the self-propelled robot 6 and the controller 5, a switchboard 8 consisting of an IP-PBX that controls communications between the mobile terminal 4 and the base station 7 as well as communications between the self-propelled robot 6 and the base station 7, an IMES management unit 11 that provides position information to the self-propelled robot 6, and a patient management server 9 that stores monitored information. The self-propelled robot 6, the base station 7, the IMES management unit 11, the patient management server 9, etc. constitute a patient monitoring system.

[0016] The IMES management unit 11 is made up of IMES transmitters 12 that use IMES (Indoor MEssaging System) technology to transmit IMES signals that are their own location signals, and an IMES management device 13 that manages the transmission signals of each IMES transmitter 12. The IMES transmitters 12 are installed at appropriate locations within the hospital, for example, in each patient room, the nurse's station, appropriate locations in the corridors, lounges, toilets, etc.

[0017] The corridor light 2, nurse call master unit 3, control unit 5, switchboard 8, and patient management server 9 are connected to one another by LAN wiring L1 via a HUB 15. Furthermore, the nurse call slave unit 1 is connected to the corridor light 2 for each hospital room via a transmission line L2. Meanwhile, the IMES transmitter 12 and the IMES management device 13 are connected to one another by a communication line L4. Incidentally, the communication line L4 may be integrated with the LAN wiring L1.

[0018] The main components are explained below. The nurse call handset 1 is made up of a call grip button 1a placed on the bed and a plate handset 1b that is installed on the wall and to which the call grip button 1a is connected. A call section (not shown) equipped with a microphone and speaker is built into the plate handset 1b.

[0019] The corridor light 2 has a patient information display unit 2a installed in each patient room to display the patient information of the patient room, and an indicator light 2b to display the occurrence of a call from the patient in the patient room, and relays the call signal.

[0020] The nurse call base unit 3 is equipped with a first display unit 3a that displays various information including a list of patient information, a second display unit 3b that displays caller information when a call is received from the nurse call handset 1, and a handset 3c for making calls.

[0021] 2 is a block diagram of the self-propelled robot 6. As shown in Fig. 2, the self-propelled robot 6 includes a camera 61 for capturing an image of a patient, a face authentication unit 62 for identifying a patient from the captured image, a subject information storage unit 63 for storing face images and patient information for identifying a patient to be monitored, a map information storage unit 64 for storing map information within the hospital, a communication unit 65 equipped with a microphone 65a and a speaker 65b for talking with the patient, a character conversion unit 66 for converting the voice of the patient into character information, a thermal camera 67 for acquiring body temperature data, a receiving unit 68 for receiving a signal from the IMES transmitter 12, a driving unit 69 for driving a moving means such as legs or wheels for moving, a power supply unit 70 equipped with a storage battery, a self-propelled robot CPU 71 for controlling the self-propelled robot 6, and a self-propelled robot communication unit 72 for wirelessly communicating with a patient management server 9 via a base station 7. Self-propelled robot CPU 71 recognizes its own position from the information transmitted by IMES transmitter 12, and controls its movement as well as monitoring.

[0022] Fig. 3 is a block diagram of the patient management server 9. As shown in Fig. 3, the patient management server 9 includes a monitoring information storage unit 91 that stores information about the monitoring of the patient performed by the self-propelled robot 6, a patient data storage unit 92 that stores basic data about the patient such as the patient's face image, name, hospital room, bed number, etc., a determination message storage unit 93 that stores message information for determining abnormality in the patient from messages exchanged with the patient, a patient management server CPU 95 that controls the patient management server 9, and a patient management server communication IF 96 that communicates with the self-propelled robot 6 and the outside world. The patient management server CPU 95 has functions as a text determination unit that determines abnormalities in the patient from text information, a vital information determination unit that determines abnormalities in the patient from vital information, and a time management unit that manages the monitoring interval.

[0023] The operation of the nurse call system and patient monitoring system configured as above is as follows. However, when a call is made from the nurse call handset 1, the nurse call master 3 and the mobile terminal 4 make a call and a communication path is established between the nurse call master 3 or the mobile terminal 4 that answers the call and the nurse call handset 1. This operation is the same as in the past, so a description is omitted here and the monitoring operation of the self-propelled robot 6 is mainly described here. Self-propelled robot 6 moves throughout a specific area of ​​the hospital, such as a ward, or throughout the entire hospital during a determined time period under the control of self-propelled robot CPU 71. At this time, self-propelled robot CPU 71 recognizes its own current location from map information within the hospital stored in map information storage unit 64 and location information of IMES transmitter 12 received by receiving unit 68, and controls driving unit 69 so as to move along a predetermined route.

[0024] If a person enters the angle of view of the camera 61 during this movement, the face of the person is captured and the face authentication unit 62 judges whether the person is a patient to be monitored. If the patient is a patient to be monitored, monitoring control begins. Specifically, if during the process of movement, the patient encounters a patient relaxing with a visitor in a lounge, for example, the presence of the person is recognized from the image captured by the camera 61. At this time, the face recognition unit 62 compares the multiple face images captured by the camera 61 with the face image information in the subject information storage unit 63, and if a matching face image is found, the presence of the patient to be monitored is recognized and monitoring control begins. When the monitoring control is started, it is first determined whether the identified patient is a patient for whom monitoring should be performed, and if so, monitoring is started.

[0025] At this time, the determination of whether a patient needs to be monitored or not is made as follows: When the self-propelled robot CPU 71 recognizes that a patient to be monitored is in front of it, it queries the patient management server 9 as to whether or not that patient should be monitored at this time.

[0026] In the patient management server 9 that has received the inquiry, the patient management server CPU 95 reads information on the date and time when the target patient was last monitored from the patient data storage unit 92, and makes a judgment. The patient data storage unit 92 records the time when monitoring was last performed, and if a certain time (e.g., 12 hours) that is a second predetermined time has not passed since the previous monitoring, an instruction that monitoring is not possible is issued. On the other hand, if the certain time or more has passed for the patient, an instruction that monitoring is possible is issued. Therefore, if the result of this inquiry indicates that monitoring is possible, monitoring will begin.

[0027] Monitoring that has begun after receiving an instruction that monitoring is permitted is carried out as follows: First, a message such as "You are Mr. / Ms. XX. Monitoring will begin" is announced from speaker 65b, and after confirming that the patient is a candidate for monitoring, it is announced that monitoring will begin. Next, to check the patient's physical condition, a message such as "How are you feeling?" is sounded, and the patient's condition is checked. The voice uttered by the patient in response to this question is collected by the microphone 65a, converted into text information by the text conversion unit 66, and transmitted to the patient management server 9.

[0028] In addition, the captured video (captured image) of the patient obtained during that time is transmitted to and stored in the patient management server 9. Furthermore, the thermal camera 67 is activated during or after the conversation to measure the body temperature, which is vital information, and this is similarly transmitted and stored. In this way, the captured image of the patient, the text information of the patient's response, and the body temperature data are transmitted as monitoring information to the patient management server 9 and stored in the monitoring information storage unit 91. At the same time, the date and time of monitoring are recorded in the patient data storage unit 92 in association with the monitored patient information.

[0029] In addition, if the patient responds to the self-propelled robot 6's question with words such as "I have a slight fever" or "My head hurts," the patient management server CPU 95 recognizes specific words in the response, determines that an abnormality has occurred, and notifies the nurse. Specifically, the judgment message storage unit 93 of the patient management server 9 stores messages for judging abnormalities, such as "fever," "pain," and "lazy," and the patient management server CPU 95 distinguishes such messages from the words uttered by the patient and judges that an abnormality has occurred. If it is judged that an abnormality has occurred, a notification is sent to, for example, the mobile terminal 4 carried by the nurse, and a message such as "Mr. XX in room XX is complaining of an abnormality" is displayed on the mobile terminal 4.

[0030] Furthermore, the measured body temperature data is compared with past information stored in the monitoring information storage unit 91 for judgment. The patient management server CPU95 compares the patient's body temperature data obtained by monitoring with past body temperature data, and if there is a difference of more than a specified value, it similarly determines that an abnormality has occurred. If it determines that an abnormality has occurred, a notification is sent to the mobile terminal 4 carried by the nurse in the same manner as when determining by text, and a message such as "There is a possibility that vital signs are abnormal for Ms. XX in Room XX" is displayed on the mobile terminal 4.

[0031] Here, there is a case where the self-propelled robot 6 searches for a specific patient for monitoring, and this case will be described. As described above, the patient management server CPU 95 manages the monitoring intervals, but if there is a patient for whom new monitoring has not been performed even after a certain period of time (e.g., 24 hours), which is the first predetermined time, has passed since the last monitoring, the patient management server CPU 95 issues a priority instruction to the self-propelled robot 6 to search for and monitor the patient. Upon receiving this priority command, the self-propelled robot 6 starts moving to search for and monitor the target patient. This search operation is continued for a certain period of time until the patient is found.

[0032] In this way, the self-propelled robot 6 moves around to monitor the patient and obtains the words spoken by the patient and the captured images of the patient, so the nurse does not have to go to the patient to monitor, and monitoring can be done even if the patient is not in the hospital room. The acquired patient information is stored in the patient management server 9, so the nurse can understand the patient's condition by viewing this information. This reduces the burden on the nurse to make rounds, and enables smooth response to emergency situations. Furthermore, if there is a patient who is not being monitored, the self-propelled robot 6 will locate that patient and perform monitoring operations, allowing for equal monitoring of patients and eliminating the need for nurses to give instructions to the self-propelled robot. Furthermore, since re-monitoring within a short period of time is prevented, it is possible to prevent the patient from being inconvenienced and to prevent unnecessary monitoring. In addition, if the patient complains of an abnormality during monitoring, the patient management server 9 recognizes this and notifies the mobile device carried by the nurse, allowing for a response without delay. Furthermore, vital signs can be obtained during monitoring, allowing for highly accurate management of the patient's condition. In addition, the system can make highly accurate judgments by comparing current and past vital signs to determine whether an abnormality has occurred in the patient. If an abnormality is determined to have occurred, it can be notified to an external party, for example, a mobile device carried by a nurse, allowing for a prompt response. In addition, a patient monitoring system can be built using part of the nurse call system, which helps reduce costs.

[0033] In the above embodiment, the patient monitoring system and the nurse call system are integrated into one system, but they may be constructed as separate systems. Furthermore, while body temperature is measured as vital information, a heart rate sensor and a blood pressure measuring unit may also be provided to measure both pulse and blood pressure. Furthermore, communication may be enabled between self-propelled robot 6 and portable terminal 4 of the nurse, so that a predetermined operation on portable terminal 4 enables conversation with the patient being monitored via self-propelled robot 6. [Explanation of symbols]

[0034] 1··Nurse call handset, 3··Nurse call base unit, 4··Mobile terminal, 5··Control unit, 6··Self-propelled robot, 7··Base station, 8··Switchboard, 9··Patient management server, 11··IMES management unit, 12··IMES transmitter (location information transmitter), 13··IMES management device, 61··Camera, 62··Facial recognition unit, 63··Target information storage unit, 64··Map information storage unit, 65··Call unit, 66··Character conversion unit, 67 ··Thermal camera (vital information acquisition unit), 68··Receiving unit, 69··Driving unit, 71··Self-propelled robot CPU (monitoring control unit, position recognition unit), 72··Self-propelled robot communication unit (communication unit), 91··Monitoring information storage unit, 92··Patient data storage unit, 93··Judgment message storage unit, 95··Patient management server CPU (message judgment unit, vital information judgment unit, time management unit), 96··Patient management server communication IF.

Claims

1. a self-propelled robot which monitors patients and which has a subject information storage unit which stores facial information of a patient being monitored, a camera which images the patient, a face authentication unit which performs face authentication, a communication unit which talks to the patient, a character conversion unit which converts the patient's voice into character, a communication unit which wirelessly communicates with the outside, a position recognition unit which recognizes its own position based on information transmitted from a position information transmitter which is installed in an appropriate position within the hospital and transmits a position signal, a map information storage unit which stores map information within the hospital, and a monitoring control unit which controls the monitoring; A patient management server that communicates with the self-propelled robot and accumulates information on the monitoring performed, the monitoring control unit moves the self-propelled robot within the hospital, and performs monitoring if the face authentication unit determines that a person captured by the camera during the movement is a patient registered in the subject information storage unit and satisfies a predetermined condition; A predetermined message is sounded from the communication unit, and the response content is transmitted to the patient management server as monitoring information and stored therein, The patient management server has a time management unit that manages a monitoring interval, the time management unit, when a first predetermined time has elapsed without monitoring a patient, instructs the monitoring control unit to find the patient and to monitor the patient; A patient monitoring system characterized in that the monitoring control unit controls movement and performs monitoring in accordance with the instructions.

2. the time management unit instructs the monitoring control unit not to monitor the patient if a second predetermined time, which is shorter than the first predetermined time, has not elapsed since the patient was last monitored; 2. The patient monitoring system according to claim 1, wherein the monitoring control unit proceeds to monitor a next patient in accordance with the instruction.

3. The patient management server has a text determination unit that determines an abnormality of a patient from the acquired text information of the patient, 3. The patient monitoring system according to claim 1, wherein when said message determining section determines that an abnormality has occurred, said message determining section notifies a predetermined external device.

4. the self-propelled robot has a vital information acquisition unit, 4. The patient monitoring system according to claim 1, wherein the monitoring control unit acquires vital information of the monitoring subject during or after the conversation and transmits the vital information to the patient management server.

5. the patient management server has a vital information determination unit that compares the vital information transmitted from the self-propelled robot with vital information obtained in past monitoring of the same patient to determine whether or not an abnormality has occurred; 5. A patient monitoring system according to claim 4, wherein if it is determined that an abnormality has occurred, a predetermined external notification is sent.

6. A nurse call system having a nurse call handset for a patient to call a nurse, a nurse call master for answering calls from the nurse call handset, and a mobile terminal carried by a nurse to answer calls from the nurse call handset, A patient monitoring system comprising: A nurse call system characterized in that the self-propelled robot of the patient monitoring system communicates with a base station that constitutes the communication network of the mobile terminal, and communicates with a patient management server via the base station.

Citation Information

Patent Citations

  • Self-propelled robot and information management system

    JP2007152444A

  • Service providing system

    JP2017010179A

  • Nurse call system

    JP2019162241A

  • Care system, method for managing the same, and program

    JP2020071503A

  • Reader and reading system

    JP2020155057A