Monitoring system, management device, monitoring method, and monitoring program

Abstract

When using radio waves to detect the biometric information of a person in a room, the biometric information of the person being monitored is distinguished from the biometric information of other people. [Solution] The monitoring method separates sensor data output from at least one radar-type sensor set up in a predetermined room into data for a first person who is the subject of monitoring in the room and data for a second person who is not the subject of monitoring, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room. Based on the sensor data of the first person in the room, first biometric information is generated, which is the biometric information of the first person. Based on the sensor data of the second person, second biometric information is generated, which is the biometric information of the second person. Based on the first biometric information, the biological state of the first person is determined.

Description

Technical Field

[0001] The present disclosure relates to a monitoring system, a management device, a monitoring method, and a monitoring program.

Background Art

[0002] Conventionally, a system for monitoring a person present in a room has been known. For example, Patent Document 1 discloses a radio wave detection unit constituted by a microwave Doppler sensor that emits microwaves in the 24 GHz band and receives the reflected wave that is reflected by and Doppler-shifted by the care recipient. The radio wave detection unit detects, as biological information (vital data), the breathing state (respiratory rate), sleep state (sleep or wakefulness), heart rate, etc. of the care recipient from the received reflected wave.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a room, there may be not only a person to be monitored but also other people such as staff who support the person to be monitored. However, in the case of a system that detects the biological information of a person using radio waves as in Patent Document 1, it is difficult to distinguish whether the detected biological information belongs to either the person to be monitored or other people present in the room.

[0005] An object of the present disclosure is to provide a technique for distinguishing the biological information of a person to be monitored from the biological information of other people when detecting the biological information of a person in a room using radio waves.

Means for Solving the Problems

[0006] One aspect of the present disclosure provides a monitoring system comprising: a radar-type sensor set up in a predetermined room and outputting sensor data; a person detection device that detects when a person enters the room and identifies the time of entry, which is the time the person entered the room; a biometric information detection device; and a management device, wherein the biometric information detection device separates the sensor data output by the sensor into data of a first person who is a person to be monitored in the room and data of a second person who is not a person to be monitored, based on the measurement time when the sensor data was measured and the time of entry; generates first biometric information, which is the biometric information of the first person, based on the sensor data of the first person in the room; generates second biometric information, which is the biometric information of the second person, based on the sensor data of the second person; and the management device determines the biological state of the first person based on the first biometric information.

[0007] One aspect of the present disclosure provides a management device comprising a processor and memory, wherein the processor cooperates with the memory to separate sensor data output from at least one radar-type sensor set in a predetermined room into data of a first person who is a person to be monitored in the room and data of a second person who is not a person to be monitored, based on the measurement time when the sensor data was measured and the entry time which is the time when a person entered the room; generates first biometric information which is the biometric information of the first person based on the sensor data of the first person in the room; generates second biometric information which is the biometric information of the second person based on the sensor data of the second person; and determines the biological state of the first person based on the first biometric information.

[0008] One aspect of the present disclosure provides a monitoring method that separates sensor data output from at least one radar-type sensor set up in a predetermined room into data of a first person who is to be monitored in the room and data of a second person who is not to be monitored, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room; generates first biometric information, which is the biometric information of the first person, based on the sensor data of the first person in the room; generates second biometric information, which is the biometric information of the second person, based on the sensor data of the second person; and determines the biological state of the first person based on the first biometric information.

[0009] One aspect of the present disclosure provides a monitoring program that causes a computer to perform the following actions: separate sensor data output from at least one radar-type sensor set up in a predetermined room into data of a first person who is to be monitored in the room and data of a second person who is not to be monitored, based on the measurement time when the sensor data was measured and the entry time which is the time when a person entered the room; generate first biometric information, which is the biometric information of the first person, based on the sensor data of the second person; generate second biometric information, which is the biometric information of the second person, based on the sensor data of the second person; and determine the biological state of the first person based on the first biometric information.

[0010] These comprehensive or specific embodiments may be implemented as systems, devices, methods, integrated circuits, computer programs, or recording media, or as any combination of systems, devices, methods, integrated circuits, computer programs, and recording media. [Effects of the Invention]

[0011] According to this disclosure, when detecting the biometric information of a person in a room using radio waves, it is possible to distinguish between the biometric information of the person being monitored and the biometric information of other people. [Brief explanation of the drawing]

[0012] [Figure 1] Block diagram showing an example configuration of the monitoring system according to Embodiment 1. [Figure 2] This figure shows an example of the configuration of sensor data according to Embodiment 1. [Figure 3] A diagram showing an example of the configuration of biological information according to Embodiment 1. [Figure 4] A diagram showing an example of the configuration of entry information according to Embodiment 1. [Figure 5] This figure shows an example of the setting screen for biological condition determination information according to Embodiment 1. [Figure 6] A diagram showing an example of the setting screen for action determination information according to Embodiment 1. [Figure 7] This figure shows an example of the setting screen for alarm condition information according to Embodiment 1. [Figure 8] A diagram illustrating a method for separating sensor data related to Embodiment 1 into data from the subject and data from the staff. [Figure 9] Sequence diagram showing an example of staff work record processing according to Embodiment 1 [Figure 10] Sequence diagram showing an example of monitoring processing for a target person according to Embodiment 1. [Figure 11] Sequence diagram showing an example of a process for retrospectively reviewing saved documents, etc., according to Embodiment 1. [Figure 12] This diagram shows an example of a User Interface (UI) screen for business review related to Embodiment 1. [Figure 13] This diagram shows the hardware configuration of a computer that implements the functions of each device related to this disclosure using a computer program. [Modes for carrying out the invention]

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, a more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially the same configurations may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate the understanding of those skilled in the art. Note that the attached drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims. Even if the functions of one configuration shown in this embodiment are realized by two or more physical configurations, or the functions of two or more configurations are realized by, for example, one physical configuration, it is acceptable.

[0014] (Embodiment 1) <Monitoring System> FIG. 1 is a block diagram showing a configuration example of a monitoring system 10 according to Embodiment 1. FIG. 2 is a diagram showing a configuration example of sensor data 20 according to Embodiment 1. FIG. 3 is a diagram showing a configuration example of biological information according to Embodiment 1.

[0015] The monitoring system 10 is a system for monitoring a person to be monitored (for example, an elderly person, a person requiring care, a patient, etc.) existing in a room 8 which is an example of a monitoring area.

[0016] As shown in FIG. 1, the monitoring system 10 includes a millimeter-wave sensor 11, a biological information detection device 12, a management device 13, a terminal device 14, and an authentication system 15. The millimeter-wave sensor 11, the biological information detection device 12, the management device 13, the terminal device 14, and the authentication system 15 may be able to transmit and receive data or information through a predetermined communication network N. Examples of the communication network N include a wired Local Area Network (LAN), a wireless LAN, the Internet, a mobile communication network, and the like.

[0017] At least one millimeter-wave sensor 11 is arranged in the room 8 (monitoring area). In FIG. 1, there is one room 8, but there may be a plurality of rooms 8, and the millimeter-wave sensor 11 is installed in each room 8.

[0018] The millimeter-wave sensor 11 is a radar-type sensor that emits radio waves in a predetermined frequency band (e.g., millimeter-wave band) and receives reflected waves reflected from objects (e.g., people) within the sensing range of the millimeter-wave sensor 11. The millimeter-wave sensor 11 compares the emitted radio waves with the received reflected waves to generate the sensor data 20 shown in Figure 2. The millimeter-wave sensor 11 may be a millimeter-wave radar-type sensor. Examples of millimeter-wave radar systems include the FMCW (Frequency Modulated Continuous Wave) system or the Step ICW (Interrupted Continuous Wave) system. However, millimeter waves are just an example, and radio waves in frequency bands other than the millimeter-wave band may be used.

[0019] As shown in Figure 2, the sensor data 20 associates timestamps, detection information, and signal information.

[0020] A timestamp is information indicating when the sensor data 20 was obtained. Examples of timestamps include time information (measurement time) or frame number.

[0021] The detection information includes, for example, information indicating the position in three-dimensional space where a reflected wave of a predetermined intensity or higher was obtained (hereinafter referred to as the reflection point), information indicating the distance from the millimeter-wave sensor 11 to the reflection point, and information indicating the reflection intensity at the reflection point.

[0022] The signal information includes, for example, IQ data for each receiving antenna.

[0023] In other words, the sensor data 20 is data that shows the position, shape, and temporal changes of objects in three-dimensional space within the sensing range, and does not have the resolution of video data. Therefore, the monitoring system 10 of this embodiment cannot identify the individual being monitored, and data acquisition is possible while protecting the privacy of the person using the millimeter-wave sensor 11. For this reason, even in places where monitoring with video data is difficult from a privacy perspective, such as a toilet or bathroom in room 8, millimeter-wave sensing can be performed.

[0024] The millimeter-wave sensor 11 transmits the generated sensor data 20 to the biological information detection device 12.

[0025] The biological information detection device 12 generates biological information 21 shown in Figure 3 based on sensor data 20 received from the millimeter-wave sensor 11.

[0026] In the biometric information 21, as shown in Figure 3, the timestamp, detected person information, vital sign information, and confidence level are associated.

[0027] A timestamp is information that indicates the timing when the biometric information 21 was generated. An example of a timestamp is time information. The management device 13 uses the time when the biometric information 21 was generated as the timestamp.

[0028] The detected person information is information about the detected person. The detected person information includes the person ID, the person's location, and the person's posture. The person ID is an ID used to identify the detected person. The person's location indicates the position of the person indicated by the person ID in three-dimensional space within room 8. The person's posture indicates the posture of the person indicated by the person ID. The biometric information detection device 12 identifies the person's location and posture based on the detection information from the sensor data 20.

[0029] Vital sign information refers to vital signs that indicate the activity status of the detected person. Examples of vital signs include respiratory rate, depth of breath, heart rate, and blood pressure. The biometric information detection device 12 calculates the vital signs of the detected person (e.g., respiratory rate, depth of breath, heart rate, blood pressure, etc.) based on the time changes in the detection information of the sensor data 20.

[0030] Reliability information indicates the reliability (likelihood) of vital sign information. The biological information detection device 12 calculates the reliability of the calculated vital sign information based on the detection information and signal information of the sensor data 20. The reliability information can be generated based on the noise level ratio of the radar signal, which is the source of the vital sign information, or the result of comparing the reliability information of multiple different vital sign information candidates.

[0031] Incidentally, in Room 8, there may be not only the person being monitored (hereinafter referred to as Subject 1) but also a person performing duties for Subject 1 (hereinafter referred to as Staff 2). Examples of duties performed by Staff 2 include nursing care, assistance, personal care, medical examinations, health checks, etc. Unlike video footage captured by a camera, it is difficult to identify individuals from the sensor data 20. Therefore, if Subject 1 and Staff 2 are present in Room 8, it is difficult to distinguish whether the sensor data 20 corresponds to Subject 1 or Staff 2. The biometric information detection device 12 according to this embodiment works in conjunction with the authentication system 15 to separate the sensor data 20 into that of Subject 1 and that of Staff 2. Details of the separation method will be described later. In this embodiment, persons other than Subject 1 are described as Staff 2, but persons other than Subject 1 are not limited to staff. For example, persons other than Subject 1 may be relatives, friends, visitors, cleaning staff from an external company, or medical staff such as doctors and nurses from a medical institution. Furthermore, "Person under observation 1" may be interpreted as "Person 1," and "Persons other than Person under observation 1" may be interpreted as "Person 2."

[0032] The biometric information detection device 12 generates subject biometric information 41, which is subject 1's biometric information 21, from the sensor data 20 of the separated subject 1, and generates staff biometric information 42, which is staff 2's biometric information 21, from the sensor data 20 of the separated staff 2. Subject biometric information 41 may be interpreted as the first biometric information, and staff biometric information 42 may be interpreted as the second biometric information. The biometric information detection device 12 may transmit the subject biometric information 41 and staff biometric information 42 to the management device 13. The biometric information detection device 12 may also transmit at least some of the information of the staff biometric information 42 (for example, only the detected person information) to the management device 13. Furthermore, if the management device 13 does not use the staff biometric information 42, the biometric information detection device 12 does not need to transmit the staff biometric information 42 to the management device 13.

[0033] The management device 13 generates biological status information 22 for subject 1 based on the subject's biological information 41 received from the biological information detection device 12. The biological status information 22 is information indicating the degree (level) of vital signs, which represent the activity state of subject 1. At this time, the management device 13 generates the biological status information 22 based on the biological status determination information 23. The biological status determination information 23 includes information for determining the degree from the vital signs. The user (administrator, monitor) can set the biological status determination information 23 by operating the management device 13. Details of the biological status determination information 23 will be described later (see Figure 5).

[0034] The management device 13 uses the behavior determination information 31 to estimate the behavior or state of subject 1 from the person's position and posture included in the subject's biometric information 41 and the subject's biometric status information 22. The behavior determination information 31 is information that associates the person's position and posture with the biometric status information 22 and the estimated behavior of the person at that time. Details of the behavior determination information 31 will be described later (see Figure 6).

[0035] Terminal device 14 is a device carried by staff member 2. Examples of terminal device 14 include a tablet or a smartphone. Terminal device 14 displays the actions or status of subject 1, as well as their biological status, as estimated by the management device 13. This allows staff member 2 to check the status of subject 1 through terminal device 14. Terminal device 14 issues an alert if an abnormality occurs in subject 1's biological status. This allows staff member 2 to quickly notice any abnormalities in subject 1's biological status through terminal device 14.

[0036] In this way, the monitoring system 10 uses a radar-type sensor (millimeter-wave sensor 11) that senses people using radio waves to detect the biological state of subject 1. This makes it possible to detect the biological state of subject 1 while protecting the privacy of subject 1.

[0037] Furthermore, the management device 13 records the work of staff member 2 based on the staff biometric information 42 received from the biometric information detection device 12. Since the staff biometric information 42 includes a timestamp, using the staff biometric information 42 to record work serves as evidence of staff member 2's work.

[0038] Furthermore, the management device 13 may record at least two pieces of information linked by a timestamp: the form 43 in which staff member 2 has entered the details of the work via the terminal device 14, the subject's biometric information 41, and the staff member's biometric information 42. This allows for easy later verification of the subject's biometric status and the work performed by staff member 2 at that time, using the timestamp as the key. Details will be described later (see Figure 12).

[0039] The authentication system 15 is a system for authenticating people entering room 8. Next, some examples of authentication methods will be described.

[0040] <<Facial Recognition>> For example, the authentication system 15 may be a system that authenticates the person entering room 8 by face authentication. In this case, the authentication system 15 may perform the following processes (S11) to (S14).

[0041] (S11) The authentication system 15 registers in advance in the database 16 the face image of staff 2 in association with the staff ID. (S12) The authentication system 15 captures the face of the person entering using a camera (not shown) installed near the entrance 7 of room 8, and generates a captured face image. (S13) The authentication system 15 compares the captured face image with the face images in the database 16. (S14) When there is a face image for which the comparison is successful, the authentication system 15 obtains from the database 16 the staff ID corresponding to the face image for which the comparison is successful. Using this staff ID, the entering staff 2 can be identified.

[0042] Note that the authentication system 15 may also authenticate the person leaving room 8 by performing the same process as described above.

[0043] Further, instead of face authentication, the authentication system 15 may authenticate the person entering and / or leaving by other biometric authentication such as fingerprint authentication or retina authentication.

[0044] <<IC Card Authentication>> For example, the authentication system 15 may be a system that authenticates the person entering room 8 using an IC card. In this case, the authentication system 15 may perform the following processes (S21) to (S25).

[0045] (S21) The authentication system 15 registers in advance in the database 16 the staff ID stored in the IC card held by staff 2. (S22) When entering, staff 2 touches the IC card to a card reader (not shown) installed near the entrance 7 of room 8. (S23) The card reader reads the staff ID of the IC card. (S24) The authentication system 15 compares the staff ID read by the card reader with the staff ID in the database 16. (S25) If the authentication system 15 is successful in matching, it retrieves the staff ID that was successfully matched from the database 16. This staff ID allows the system to identify the staff member 2 who entered the room.

[0046] The authentication system 15 may also authenticate the person leaving room 8 by the same process as described above.

[0047] <<Wireless Authentication>> For example, the authentication system 15 may be a system that authenticates entrants using wireless communication (e.g., BLE (Bluetooth Low Energy)). In this case, the authentication system 15 may perform the following processes (S31) to (S34).

[0048] (S31) The authentication system 15 pre-registers the staff ID stored in the terminal device 14 of staff member 2 in the database 16. (S32) A receiver (not shown) installed near the entrance 7 of room 8 communicates wirelessly with staff member 2's terminal device 14 when staff member 2 enters the room and receives the staff member ID. (S33) The authentication system 15 compares the staff ID received by the receiver with the staff ID in the database 16. (S34) If the authentication system 15 is successful in matching, it retrieves the staff ID that was successfully matched from the database 16. This staff ID allows the system to identify the staff member 2 who entered the room.

[0049] The authentication system 15 may also authenticate the person leaving room 8 by the same process as described above. Furthermore, since the authentication system 15 can also be described as a device that detects when a person enters or leaves room 8, it may be interpreted as a person detection device.

[0050] Furthermore, if the authentication system 15 successfully authenticates that the person entering the room is staff member 2, it may display information indicating successful authentication on a display device (not shown) installed near the entrance / exit 7 of room 8. If the authentication system 15 fails to authenticate that the person entering the room is staff member 2, it may display information indicating failed authentication on a display device (not shown) installed near the entrance / exit 7 of room 8. Furthermore, if the authentication system 15 successfully authenticates that the person entering the room is staff member 2, it may unlock the door to entrance / exit 7 of room 2.

[0051] <Entry Information> Figure 4 is a diagram showing an example of the configuration of the entry information 30 according to Embodiment 1.

[0052] If the authentication system 15 successfully authenticates that the person entering the room is staff member 2, it generates entry information 30 including the time staff member 2 entered the room (hereinafter referred to as entry time), the staff ID that was successfully verified, and the location of the entrance / exit 7 of room 8 (hereinafter referred to as entry location), and transmits it to the biometric information detection device 12. However, if there is only one entrance / exit 7 for room 8, the entry location may be omitted, or a predetermined location of entrance / exit 7 may be set. The method of using the entry information 30 will be described later (see Figure 8).

[0053] <Settings for Biological Condition Assessment Information> Figure 5 shows an example of the setting screen 100 for the biological condition determination information 23 according to Embodiment 1. Next, the case of manually setting the biological condition determination information 23 will be explained with reference to Figure 5.

[0054] As shown in Figure 5, the setting screen 100 for the biological condition assessment information 23 includes a threshold setting area 101 for vital values, a threshold setting area 102 for the rate of change of vital values ​​over time, a threshold setting area 103 for the depth of respiration, and a setting area 104 for the number of people to be measured.

[0055] The user adjusts the threshold bar 120 included in the vital value threshold setting area 101 to set thresholds for determining the degree of vitality related to the level of vital signs. The degree of vitality related to the level of vital signs is referred to as the vital sign level. For example, if three levels of vital sign level are set, "low," "normal," and "high," the user sets threshold 1 to distinguish between "low" and "normal," and threshold 2 to distinguish between "normal" and "high," as shown in Figure 5. For example, the user may set these thresholds lower (i.e., stricter) for elderly individuals who are being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that the number of vital sign levels is not limited to three; there may be two levels, four or more levels. Also, the name of each level of vital sign level may be changed by the user. Furthermore, each level of vital sign level may be read as a vital sign level.

[0056] The user adjusts the threshold bar 120 included in the threshold setting area 102 for the time-dependent change in vital signs to set thresholds for determining the degree of biological change related to the time-dependent change in vital signs. The degree of biological change related to the time-dependent change in vital signs includes both an upward and downward trend. The upward trend is referred to as the degree of vital sign increase. The downward trend is referred to as the degree of vital sign decrease. For example, if three stages are set for the degree of vital sign increase: "no change," "increase," and "rapid increase," then, as shown in Figure 5, threshold 1 is set to distinguish between "no change" and "increase," and threshold 2 is set to distinguish between "increase" and "rapid increase." For example, the user may set these thresholds lower (i.e., stricter) for elderly individuals who are being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that each stage of the degree of vital sign increase may be read as a vital sign increase level. For example, if three levels are set for the degree of decline in vital signs—"no change," "decline," and "rapid decline"—threshold 1 is set to distinguish between "no change" and "decline," and threshold 2 is set to distinguish between "decline" and "rapid decline," as shown in Figure 5. For example, the user may set these thresholds lower (i.e., stricter) for elderly individuals being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that each level of the degree of decline in vital signs may be read as a vital sign decline level.

[0057] The user adjusts the threshold bar 120 included in the respiratory depth threshold setting area 103 to set a threshold for determining the biological degree related to the respiratory depth of vital signs from the respiratory depth of vital signs. The biological degree related to the respiratory depth of vital signs is referred to as the respiratory depth degree. For example, if three levels of respiratory depth degree are set: "shallow," "normal," and "deep," the user sets threshold 1 to distinguish between "shallow" and "normal," and threshold 2 to distinguish between "normal" and "deep," as shown in Figure 5. For example, the user may set these thresholds lower (i.e., stricter) for elderly people who are being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that each level of respiratory depth degree may be read as a respiratory depth level.

[0058] The user sets the maximum number of people to be measured in the measurement person setting area 104. Hereinafter, the set maximum number will be referred to as the maximum measurement person. For example, if the elderly person being monitored lives alone in room 8, the user may set "1" in the measurement person setting area 104. Typically, reducing the maximum measurement person improves the reliability of the biometric information.

[0059] The management device 13 generates biological condition determination information 23, which includes each threshold and the maximum number of people to be measured, set by the user, and stores it in memory 1002 or storage 1003 (see Figure 13). This allows the management device 13 to utilize the biological condition determination information 23 in the process of generating the biological condition information 22 for subject 1 shown in Figure 10.

[0060] <Settings screen for action judgment information> Figure 6 shows an example of the setting screen for the action determination information 31 according to Embodiment 1.

[0061] The behavior determination information 31 is information that includes the determination conditions used when estimating a person's behavior. The user can input or modify the contents of the behavior determination information 31 from the settings screen 210 shown in Figure 6.

[0062] As shown in Figure 6, the setting screen 210 for the action determination information 31 has a User Interface (UI) for setting the alarm flag 211, action 212, location 213, posture 214, and duration 215 in association with each other.

[0063] For example, as shown in the first line 221 of the settings screen 210, the user sets the following associations for action 212 "washing face": alarm flag 211 "OFF", location 213 "bathroom", posture 214 "standing", and duration 215 "120 seconds". The management device 13 generates action determination information 31 that includes the set determination conditions. In this case, if the location of subject 1 detected using subject biometric information 41 is "bathroom" and subject 1's posture is "standing" for "120 seconds" or longer, then these satisfy the above determination conditions in the action determination information 31, and the management device 13 estimates that subject 1's action is "washing face". Also, since the alarm flag 211 is "OFF", when the management device 13 makes this estimation, it does not need to notify the terminal device 14 that subject 1's biometric state is abnormal (i.e., issue an alarm instruction).

[0064] For example, as shown in line 6, 226, the user sets the following associations for action 212 "fall": alarm flag 211 "ON", location 213 "toilet", posture 214 "lying down", and duration 215 "180 seconds". The management device 13 generates action determination information 31 that includes the set determination conditions. In this case, if the location of subject 1 detected using subject biometric information 41 is "toilet", and subject 1's posture is "lying down" for 180 seconds or more, then these satisfy the above determination conditions in the action determination information 31, and the management device 13 estimates subject 1's action to be "fall". Also, since alarm flag 211 is "ON", if the management device 13 makes this estimation, it may notify the terminal device 14 that subject 1's biological state is abnormal (i.e., issue an alarm instruction).

[0065] <Setting screen for alarm activation conditions> Figure 7 shows an example of the setting screen 300 for the alarm condition information 33 according to Embodiment 1.

[0066] The alarm activation condition information 33 includes information that determines whether or not to issue an alarm in response to the estimated (detected) behavior or state of subject 1.

[0067] As shown in Figure 7, the setting screen 300 for the alarm condition information 33 has a UI for setting the usage flag 301, the action 302, and the duration 303 in association with each other. Furthermore, as shown in Figure 7, the setting screen 300 for the alarm condition information 33 has a UI for setting the lower limit 304 and upper limit 305 of the respiratory rate per minute. Furthermore, as shown in Figure 7, the setting screen 300 for the alarm condition information 33 has a UI for setting the lower limit 306 and upper limit 307 of the heart rate per minute.

[0068] For example, as shown in line 311, the user sets the usage flag 301 "ON" and the duration 303 "120 seconds" in association with action 302 "respiratory arrest". In this case, if the biological condition information 22 of subject 1 shows that the state of "respiratory arrest" continues for "120 seconds" or more, the management device 13 will find that the conditions of the alarm activation condition information 33 are met, and will send a notification (i.e., an alarm activation instruction) to the terminal device 14 indicating that an abnormality has occurred in the biological condition of subject 1.

[0069] For example, the user sets a lower limit of 304 "5" and an upper limit of 305 "25" for the respiratory rate. In this case, if the respiratory rate per minute indicated by the subject's biological information 21 is less than "5" or greater than "25", the control device 13 will satisfy the conditions of the alarm activation condition information 33 and will send a notification (i.e., an alarm activation instruction) to the terminal device 14 indicating that an abnormality has occurred in the subject's biological state.

[0070] For example, a user sets a lower limit of 306 "30" and an upper limit of 307 "200" for the heart rate. In this case, if the heart rate per minute indicated by the subject's biometric information 21 is less than "30" or greater than "200", the management device 13 sends a notification (i.e., an alert command) to the terminal device 14 indicating that an abnormality has occurred in the subject's biometric condition.

[0071] <Method for separating subject biometric information from staff biometric information> Figure 8 is a diagram illustrating a method for separating the sensor data 20 according to Embodiment 1 into that of subject 1 and that of staff member 2.

[0072] The biometric information detection device 12 uses the entry information 30 received from the authentication system 15 to separate the received sensor data 20 into data for subject 1 and data for staff 2. For example, the biometric information detection device 12 separates sensor data 20 that has a timestamp corresponding to the entry time included in the entry information 30 and detection information (location) corresponding to the entry location included in the entry information 30, as detecting staff 2 who entered the room. Specifically, the biometric information detection device 12 separates sensor data 20 where the difference between the entry time and the timestamp is less than a predetermined threshold, and the distance between the entry location and the location of the detection information is less than a predetermined threshold, as detecting staff 2 who entered the room. The biometric information detection device 12 separates the remaining sensor data 20 as detecting subject 1.

[0073] Then, the biometric information detection device 12 generates staff biometric information 42 based on the sensor data 20 that was separated as having detected staff 2. Here, the biometric information detection device 12 may use the staff ID included in the entry information 30 as the person ID of the staff biometric information 42. The biometric information detection device 12 generates subject biometric information 41 based on the remaining sensor data 20 (i.e., the sensor data 20 that detected subject 1).

[0074] As a result, the biometric information detection device 12 can distinguish and generate biometric information 21 for subject 1 and staff 2 when both subject 1 and staff 2 are present in room 8.

[0075] In this embodiment, the method for separating the biometric information 21 of subject 1 and staff 2 using the biometric information detection device 12 has been described, but the biometric information 21 of subject 1 and staff 2 may also be separated using the management device 13. In this case, the management device 13 separates the biometric information 21 received from the biometric information detection device 12 into subject biometric information 41 and staff biometric information 42 using the entry time and / or entry location included in the entry information 30. For example, the management device 13 separates the biometric information 21 that has a timestamp corresponding to the entry time included in the entry information 30 and a person's location corresponding to the entry location included in the entry information 30 as the staff biometric information 42 of the entering staff 2. The biometric information detection device 12 separates the remaining biometric information 21 as subject biometric information 41 of subject 1.

[0076] <Staff work record processing> Figure 9 is a sequence diagram showing an example of staff work record processing according to Embodiment 1. Next, referring to Figure 9, the process by which the management device 13 creates and saves staff work records 44, etc., of staff 2 using staff biometric information 42 received from the biometric information detection device 12 will be described.

[0077] The authentication system 15 detects the person entering room 8 using the method described above (S401). The authentication system 15 then verifies the detected person entering the room using the method described above to determine whether or not the person entering the room is staff member 2 (S402). If the authentication system 15 determines that the person entering the room is staff member 2, it generates entry information 30 (S403). The authentication system 15 then transmits the generated entry information 30 to the biometric information detection device 12 (S404).

[0078] Meanwhile, the millimeter-wave sensor 11 scans the room 8 and generates sensor data 20 (S405). The millimeter-wave sensor 11 transmits the generated sensor data 20 to the biological information detection device 12 (S406). Steps S405 to S406 are repeated.

[0079] The biometric information detection device 12 determines whether or not staff member 2 is in room 8 (S407). For example, if the biometric information detection device 12 receives entry information 30 from the authentication system 15, it determines that staff member 2 has entered the room. Subsequently, the biometric information detection device 12 continues to determine that staff member 2 is in the room until it can no longer detect sensor data 20 corresponding to staff member 2 from inside room 8 (i.e., it determines step S407 as YES). If the biometric information detection device 12 can no longer detect sensor data 20 corresponding to staff member 2 from inside room 8, it determines that staff member 2 has left the room (i.e., it determines step S407 as NO). The biometric information detection device 12 may also detect staff member 2's departure by other means. For example, if staff member 2 performs authentication upon leaving the room in the same way as upon entering, the authentication system 15 may transmit the same exit information as the entry information to the biometric information detection device 12 when it detects a person leaving the room. In this case, if the biometric information detection device 12 receives exit information, it may determine that staff member 2 has left the room.

[0080] If the biometric information detection device 12 determines that staff member 2 is in room 8 (S407: YES), it separates the sensor data 20 into that of staff member 2 and that of subject 1 using the method described in Figure 8 (S408). The biometric information detection device 12 then generates staff biometric information 42 from the separated sensor data 20 of staff member 2. The biometric information detection device 12 transmits the staff biometric information 42 to the management device 13 (S410).

[0081] If the biometric information detection device 12 determines that staff member 2 is not staying in room 8 (S407: NO), steps S408 to S410 do not need to be executed.

[0082] When the management device 13 receives staff biometric information 42 from the biometric information detection device 12, it creates a staff work record 44 using the staff biometric information 42 and saves it to the storage 1003 (S411). For example, the management device 13 registers the timestamp and staff ID contained in the staff biometric information 42 in the staff work record 44. The management device 13 may also register at least one of the following contained in the staff biometric information 42 in the staff work record 44: person's position, person's posture, respiratory rate, respiratory depth, heart rate, blood pressure, and confidence information.

[0083] Furthermore, the biometric information detection device 12 generates subject biometric information 41 from the subject's sensor data 20 (S412). The biometric information detection device 12 transmits the subject biometric information 41 to the management device 13 (S413).

[0084] The management device 13 uses the subject's biometric information 41 received from the biometric information detection device 12 to perform monitoring processing for subject 1 (S414). Details of the monitoring processing will be described later (see Figure 10).

[0085] The management device 13 determines, through monitoring, whether or not an abnormality has occurred in the biological condition of subject 1 (S415).

[0086] If the management device 13 determines that an abnormality has occurred in the biological condition of subject 1 (S415: YES), it notifies the terminal device 14 of the abnormality (S416). If the management device 13 determines that there is no abnormality in the biological condition of subject 1 (S415: NO), it skips step S416.

[0087] When terminal device 14 receives notification of an abnormality from management device 13, it issues an alert indicating that an abnormality has occurred in the biological condition of subject 1 (S417). This allows staff 2 to quickly notice the abnormality in subject 1's biological condition and take appropriate action.

[0088] Staff member 2 creates a form 43 using terminal device 14 (S418). The form 43 may record the date and time when staff member 2 performed the work (hereinafter referred to as the work date and time) and the details of the work. The details of the work can be anything, for example, the treatment that staff member 2 performed on subject 1 when an abnormality occurred in subject 1, or the details of the care or assistance that staff member 2 provided to subject 1. Terminal device 14 transmits the created form 43 to management device 13 (S419).

[0089] The management device 13 stores the staff work record 44 created in step S411, the subject biometric information 41 received in step S413, and the form 43 received in step S419 (S420).

[0090] Since the staff work record 44, the subject's biometric information 41, and the form 43 are all assigned a timestamp (date and time), they can be linked to each other using the timestamp (date and time) as a key. For example, if the management device 13 finds that the subject's biometric information 41 at time t1 indicates an abnormality in the subject's biological state, it will retrieve and display the staff work record 44 and form 43 associated with time t1, allowing the administrator to easily confirm the actions taken by staff 2 on subject 1 at that time t1. Furthermore, the staff work record 44 serves as evidence that staff 2 was in subject 1's room 8. Therefore, the administrator can avoid the trouble of interviewing staff 2 about whether they dealt with subject 1 at that time t1. It also reduces the stress on staff 2 from being interviewed by the administrator.

[0091] <Monitoring and monitoring of the person concerned> Figure 10 is a sequence diagram showing an example of the monitoring process for a target person according to Embodiment 1. Next, step S414 in Figure 9 will be described in detail with reference to Figure 10.

[0092] The management device 13 uses the set biological condition determination information 23 (see Figure 5) to generate the biological condition information 22 of subject 1 from the subject's biological information 41 (S501).

[0093] The control device 13 identifies the location and posture of the subject 1 from the subject's biometric information 41 (S502).

[0094] The management device 13 uses the set behavior determination information 31 (see Figure 6) to estimate the behavior or state of subject 1 from the subject 1's position, posture, and biological condition information 22 (S503). The control device 13 determines whether the biological condition information 22 of the subject 1 satisfies the conditions included in the set alarm condition information 33 (see Figure 7) (S504).

[0095] If the management device 13 determines that the subject person 1's biological condition information 22 satisfies the conditions included in the alarm condition information 33 (S504: YES), it sends a notification to the terminal device 14 indicating that an abnormality has occurred in the subject person 1's biological condition (S505). The terminal device 14 receives the notification and issues an alarm indicating that an abnormality has occurred in the subject person 1's biological condition (S506). Then, the process returns to step S501.

[0096] If the control device 13 determines that the biological condition information 22 of subject 1 does not meet the conditions included in the alarm condition information 33 (S504: NO), it returns the process to step S501.

[0097] Through the above process, if an abnormality occurs in the biological condition of subject 1, terminal device 14 will issue an alert, allowing staff 2 to quickly notice the abnormality in subject 1's biological condition.

[0098] <How to review saved documents retrospectively> Figure 11 is a sequence diagram showing an example of a process for retrospectively reviewing saved documents, etc., according to Embodiment 1. The management device 13 provides a function that allows retrospectively reviewing the documents 43, etc., saved in step S420 of Figure 9. An example of this process is shown below.

[0099] The management device 13 displays a list of the stored forms 43 (S601). The administrator selects the form they want to check from the displayed list of forms 43 (S602).

[0100] The management device 13 extracts the selected form 43 and the staff work record 44 associated with that form 43 (S603).

[0101] The management device 13 displays a work review UI screen 400 (see Figure 12) based on the extracted forms 43 and staff work records 44 (S604). Next, the work review UI screen 400 will be described in detail.

[0102] <Work Review UI Screen> Figure 12 shows an example of a business review UI screen 400 according to Embodiment 1.

[0103] As shown in Figure 12, the work review UI screen 400 includes a seek bar 401, an anomaly mark 402, and a biometric information display area 403.

[0104] The start and end points of the seek bar 401 may represent the period from the start to the end of the generation of sensor data 20. In this case, for example, if the sensing time with the millimeter-wave sensor 11 is from 9:00 to 16:00, the start point of the seek bar 401 will be 9:00 and the end point will be 16:00. Alternatively, the start and end points of the seek bar 401 may represent the period from 0:00 to 24:00 on day X. In this case, for example, if the sensing time with the millimeter-wave sensor 11 is from 0:00 to 16:00, the left end of the seek bar 401 shown in Figure 12 may be the starting point at 0:00, the position where the finger is placed on the right side may be 16:00, and the right end may be 24:00. Furthermore, the seek bar 401 may display the time period that is not being sensed in a manner that distinguishes it from the time period that is being sensed. For example, the seek bar 401 shown in Figure 12 displays the time period after 16:00 that is not being sensed in a different white color from the other time periods. This allows users to easily recognize the time periods when sensing was performed and the time periods when sensing was not performed by looking at the seek bar 401.

[0105] When the administrator moves the cursor 404 on the seek bar 401, the management device 13 displays the subject's biometric information 41 at the timestamp corresponding to the cursor's position in the biometric information display area 403.

[0106] The biometric information display area 403 displays a timestamp 411, the location 412 of subject 1, respiratory rate 413, heart rate 414, and a pictogram 415 indicating subject 1's behavior or condition. The pictogram 415 may be displayed in different ways depending on subject 1's behavior or condition. For example, if subject 1's behavior or condition is abnormal, the pictogram 415 will flash or be displayed in a different color. Also, if subject 1's biological condition is abnormal, an alert to that effect will be displayed. This allows staff 2 to easily check the content of subject biometric information 41 at a desired timestamp by moving the cursor 404 on the seek bar 401.

[0107] The management device 13 may display the seek bar 401 in a manner that distinguishes between periods when staff member 2 stayed in room 8 and periods when staff member 2 did not stay in room 8. For example, the management device 13 may display the periods when staff member 2 stayed in room 8 and the periods when staff member 2 did not stay in room 8 on the seek bar 401 in different colors. This allows the manager to quickly understand which periods staff member 2 stayed in room 8.

[0108] The management device 13 displays an abnormality mark 402 on the seek bar 401 at the timestamp 411 where an abnormality occurred in the subject 1's biological state. This allows the administrator to recognize the timing of the abnormality in subject 1's biological state by looking at the seek bar 401. Furthermore, the administrator can quickly determine whether staff member 2 was in room 8 at the time the abnormality occurred in subject 1's biological state by looking at the color of the seek bar 401 and the positional relationship between the seek bar 401 and the abnormality mark 402 on the seek bar 401.

[0109] Furthermore, a staff record button 416 is displayed in the biometric information display area 403 of the seek bar 401 during the period when staff member 2 was present. When the staff record button 416 is pressed (touched), the report 43 for that time is displayed. This allows the administrator to easily check the actions taken by staff member 2 towards person 1. Therefore, the administrator can avoid the trouble of interviewing staff member 2 to determine whether they dealt with person 1 appropriately. It also reduces the stress on staff member 2 from being interviewed by the administrator.

[0110] <Hardware Configuration> As described above, embodiments relating to this disclosure have been described in detail with reference to the drawings, but the functions of the biometric information detection device 12, management device 13, terminal device 14, and authentication system 15 can be realized by computer programs.

[0111] Figure 13 is a diagram showing the hardware configuration of a computer that implements the functions of each device related to this disclosure using a computer program.

[0112] The computer 1000 comprises a processor 1001, memory 1002, storage 1003, input device 1004, display device 1005, communication device 1006, and bus 1007. The processor 1001, memory 1002, storage 1003, input device 1004, display device 1005, and communication device 1006 are connected to the bus 1007 and can send and receive data bidirectionally via the bus 1007.

[0113] The processor 1001 is a device that executes a computer program stored in memory 1002 and realizes the functional blocks described above. The processor 1001 may also be read as a Central Processing Unit (CPU), controller, or control device, etc. The processor 1001 may include a Graphics Processing Unit (GPU) and / or a Neural Network Processing Unit (NPU).

[0114] Memory 1002 is composed of a volatile storage medium and is a device for storing computer programs and data handled by the computer 1000. However, at least a portion of memory 1002 may be composed of a non-volatile storage medium.

[0115] Storage 1003 is a device composed of a non-volatile storage medium that stores computer programs and data handled by computer 1000. Examples of storage 1003 include a Hard Disk Drive (HDD) or a Solid State Drive (SSD).

[0116] The input device 1004 is a device that receives data to be input to the processor 1001. Examples of the input device 1004 include a keyboard, mouse, touchpad, or microphone.

[0117] The display device 1005 is a device that displays images, etc., generated by the processor 1001. Examples of the display device 1005 include liquid crystal displays or organic EL displays.

[0118] The communication device 1006 is a device for sending and receiving data with other devices via a communication network N. The communication device 1006 may support either wired communication or wireless communication. An example of wired communication is Ethernet®. Examples of wireless communication include IEEE 802.11, Wi-Fi®, Bluetooth®, and mobile communication networks (LTE, 4G, 5G).

[0119] (Summary of Embodiment 1) Based on the description of Embodiment 1 above, the following technology is disclosed.

[0120] <Technology 1> The monitoring system (10) according to Embodiment 1 includes at least one radar-type sensor (e.g., millimeter-wave sensor 11) set up in a predetermined room (8) and outputting sensor data (20), a person detection device (e.g., authentication system 15) that detects when a person enters the room and identifies the time of entry, which is the time when the person entered the room, a biometric information detection device (12), and a management device (13). The biometric information detection device separates the sensor data output by the sensor into data for a first person who is a person to be monitored in the room and data for a second person who is not a person to be monitored, based on the measurement time when the sensor data was measured and the time of entry, generates first biometric information which is the biometric information of the first person based on the sensor data of the first person in the room, and generates second biometric information which is the biometric information of the second person based on the sensor data of the second person, and the management device determines the biological state of the first person based on the first biometric information. This makes it possible to distinguish between the biometric information of the first person and the biometric information of the second person when both are present in the same room.

[0121] <Technology 2> In the monitoring system described in Technology 1, the person detection device identifies the entry position indicating the location where the person entered the room, and the biometric information detection device further separates the sensor data into that of the first person and that of the second person based on the location information indicated by the sensor data and the entry position. This makes it possible to distinguish between the biometric information of the first person and the biometric information of the second person with greater accuracy when both are present in the same room.

[0122] <Technology 3> In the monitoring system described in Technology 2, the management device records the first biological information and at least a portion of the second biological information in association with each other. This allows us to record the biological state of a second person present in the same room when the first person present in the room was in a certain biological state.

[0123] <Technology 4> In the monitoring system described in Technology 3, the management device identifies the period during which the second person stayed in the room based on at least a portion of the recorded second biometric information, and displays the period during which the second person stayed in the room. This allows, for example, an administrator to easily determine the period during which a second person stayed in the same room as a first person.

[0124] <Technology 5> In the monitoring system described in Technology 4, the management device displays both the period during which the second person stayed in the room and the time at which the first person's biological condition was determined to be abnormal. This allows, for example, an administrator to easily confirm whether a second person was in the room at the time when the first person's biological condition was determined to be abnormal.

[0125] <Technology 6> In the monitoring system described in any one of technologies 1 to 5, the sensor is a millimeter-wave radar system. This allows for the measurement of human sensor data using millimeter waves.

[0126] <Technology 7> The management device (13) according to Embodiment 1 comprises a processor (1001) and a memory (1002). The processor cooperates with the memory to separate sensor data output from at least one radar-type sensor set in a predetermined room into data for a first person who is a person to be monitored in the room and data for a second person who is not a person to be monitored, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room. Based on the sensor data of the first person in the room, it generates first biometric information, which is the biometric information of the first person. Based on the sensor data of the second person, it generates second biometric information, which is the biometric information of the second person. Based on the first biometric information, it determines the biological state of the first person. This makes it possible to distinguish between the biometric information of the first person and the biometric information of the second person when both are present in the same room.

[0127] <Technology 8> The monitoring method according to Embodiment 1 separates sensor data output from at least one radar-type sensor set up in a predetermined room into data of a first person who is the subject of monitoring in the room and data of a second person who is not the subject of monitoring, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room. Based on the sensor data of the first person in the room, first biometric information is generated, which is the biometric information of the first person. Based on the sensor data of the second person, second biometric information is generated, which is the biometric information of the second person. Based on the first biometric information, the biological state of the first person is determined. This makes it possible to distinguish between the biometric information of the first person and the biometric information of the second person when both are present in the same room.

[0128] <Technology 9> The monitoring program according to Embodiment 1 causes a computer (1000) to perform the following actions: separate sensor data output from at least one radar-type sensor set up in a predetermined room into data of a first person who is the subject of monitoring in the room and data of a second person who is not the subject of monitoring, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room; generate first biometric information, which is the biometric information of the first person, based on the sensor data of the second person; generate second biometric information, which is the biometric information of the second person, based on the sensor data of the second person; and determine the biological state of the first person based on the first biometric information. This makes it possible to distinguish between the biometric information of the first person and the biometric information of the second person when both are present in the same room.

[0129] While embodiments have been described above with reference to the attached drawings, this disclosure is not limited to such examples. It is clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims, and these are also understood to fall within the technical scope of this disclosure. Furthermore, the components of the embodiments described above can be combined in any way without departing from the spirit of the invention. [Industrial applicability]

[0130] The technology disclosed herein is useful for systems, devices, or methods for monitoring or supervising individuals while protecting their privacy. [Explanation of symbols]

[0131] 1. Target Persons 2 Staff 7 Entrance / exit 8 rooms 10. Monitoring System 11 millimeter wave sensor 12. Biological Information Detection Device 13 Management device 14 Terminal devices 15 Authentication System 16 Databases 20 Sensor data 21 Biometric Information 22. Biological status information 23. Biological condition assessment information 30. Entry Information 31 Action Decision Information 33. Alarm Activation Condition Information 41. Biometric information of the subject 42. Staff Biological Information 43 Forms 44 Staff work records 1000 computers 1001 Processor 1002 memory 1003 Storage 1004 Input device 1005 Display device 1006 Communication device 1007 Bus

Claims

1. A radar-type sensor is set up in a designated room and outputs sensor data, A person detection device that detects when a person enters the aforementioned room and identifies the time of entry, which is the time when the person entered the room. A biological information detection device, Equipped with a management device, The aforementioned biological information detection device is The sensor data output by the sensor is separated into data belonging to a first person who is the person being monitored in the room and data belonging to a second person who is not the person being monitored, based on the measurement time when the sensor data was measured and the time of entry into the room. Based on the sensor data of the first person in the room, first biometric information, which is the biometric information of the first person, is generated. Based on the sensor data of the second person, second biometric information, which is the biometric information of the second person, is generated. The aforementioned control device is Based on the first biological information, the biological state of the first person is determined. A monitoring system.

2. The person detection device identifies the entry position, which indicates the location from which the person entered the room. The aforementioned biological information detection device is Furthermore, based on the location information indicated by the sensor data and the entry position, the sensor data is separated into that of the first person and that of the second person. The monitoring system according to claim 1.

3. The aforementioned control device is The first biological information and at least a portion of the second biological information are recorded in association. The monitoring system according to claim 2.

4. The aforementioned control device is Based on at least a portion of the recorded second biometric information, the period during which the second person stayed in the room is determined. The period during which the second person stayed in the room is indicated. The monitoring system according to claim 3.

5. The aforementioned control device is The period during which the second person stayed in the room and the time when the first person's physical condition was determined to be abnormal are displayed together. The monitoring system according to claim 4.

6. The aforementioned sensor is a millimeter-wave radar system. The monitoring system according to claim 1.

7. A management device comprising a processor and memory, The aforementioned processor cooperates with the memory, Sensor data output from at least one radar-type sensor set up in a predetermined room is separated into data for a first person who is the person being monitored in the room and data for a second person who is not the person being monitored, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room. Based on the sensor data of the first person in the room, first biometric information, which is the biometric information of the first person, is generated. Based on the sensor data of the second person, second biometric information, which is the biometric information of the second person, is generated. Based on the first biological information, the biological state of the first person is determined. Management device.

8. Sensor data output from at least one radar-type sensor set up in a predetermined room is separated into data for a first person who is the person being monitored in the room and data for a second person who is not the person being monitored, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room. Based on the sensor data of the first person in the room, first biometric information, which is the biometric information of the first person, is generated. Based on the sensor data of the second person, second biometric information, which is the biometric information of the second person, is generated. Based on the first biological information, the biological state of the first person is determined. Methods of monitoring.

9. Sensor data output from at least one radar-type sensor set up in a predetermined room is separated into data for a first person who is the person being monitored in the room and data for a second person who is not the person being monitored, based on the measurement time when the sensor data was measured and the entry time, which is the time when a person entered the room. Based on the sensor data of the first person in the room, first biometric information, which is the biometric information of the first person, is generated. Based on the sensor data of the second person, second biometric information, which is the biometric information of the second person, is generated. Based on the first biological information, the biological state of the first person is determined. A monitoring program that has a computer perform certain actions.

Images