Detection system, detection method, and detection program

Abstract

To support installation of a sensor.SOLUTION: A detection system includes: at least one radar system sensor installed in a predetermined area; a biological information detection device for detecting biological information on a person in the area on the basis of sensor data output from the sensor; and a terminal device for generating and displaying support information for supporting the installation of the sensor using the detected biological information.SELECTED DRAWING: Figure 21

Description

Technical Field

[0001] The present disclosure relates to a detection system, a detection method, and a detection program.

Background Art

[0002] Conventionally, a vital sensor that transmits modulated waves in a microwave band or millimeter wave band, compares the transmitted waves with the received waves reflected from an object, and detects minute fluctuations such as breathing and heartbeat of a living body is known (e.g., Patent Document 2).

Prior Art Literature

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problem to be Solved by the Invention

[0004] According to the conventional technology, it is possible to achieve high-precision object detection and acquire biological information such as breathing and heartbeat while protecting privacy. However, in conventional technologies, as preparation before acquiring biological information, the installation adjustment of vital sensors has to rely on the intuition based on the experience of workers, and it is desired to construct an appropriate environment for acquiring biological information while receiving guidance for installation adjustment, but conventional technologies do not give any consideration to such demands at all.

[0005] An object of the present disclosure is to provide a technology that supports the installation of sensors.

Means for Solving the Problem

[0006] A detection system according to one aspect of the present disclosure comprises: at least one radar-type sensor installed in a predetermined area; a biometric information detection device that detects biometric information of a person in the predetermined area based on sensor data output from the sensor; and a terminal device that causes a user to input a map image showing the predetermined area, the area of ​​the monitoring area set in the predetermined area, and the installation information of the sensor temporarily installed in the predetermined area from a sensor setting screen, wherein the terminal device further allows the user to input after the temporary installation of the sensor. The walking route generated within the predetermined area is detected when the person moves. Using the acquired biometric information, the system generates and displays a first screen that assists in correcting the initial sensor installation information entered by the user to the sensor installation information corresponding to the monitoring area, and a second screen that assists in confirming the sensor range in which the biometric information can be detected, based on the acquired biometric information, by positioning the person at multiple measurement points in the monitoring area.

[0007] A detection method according to one aspect of this disclosure involves having the user input a map image showing a predetermined area, the area of ​​a monitoring area set in the predetermined area, and installation information of at least one radar-type sensor temporarily installed in the predetermined area, from a sensor setting screen; and after the temporary installation of the sensor, detecting the biometric information of a person in the predetermined area based on sensor data output from the sensor installed in the predetermined area. The walking route generated within the predetermined area is detected when the person moves. Using the acquired biometric information, the system generates and displays a first screen that assists in correcting the initial sensor installation information entered by the user to the sensor installation information corresponding to the monitoring area, and a second screen that assists in confirming the sensor range in which the biometric information can be detected, based on the acquired biometric information, by positioning the person at multiple measurement points in the monitoring area.

[0008] A detection program according to one aspect of this disclosure allows the user to input a map image showing a predetermined area, the area of ​​a monitoring area set in the predetermined area, and installation information of at least one radar-type sensor temporarily installed in the predetermined area, from a sensor setting screen, and after the temporary installation of the sensor, detects the biometric information of a person in the predetermined area based on the sensor data output from the sensor installed in the predetermined area. The walking route generated within the predetermined area is detected when the person moves. The computer is instructed to generate and display, using the acquired biometric information, a first screen that assists in correcting the initial sensor installation information entered by the user to the sensor installation information corresponding to the monitoring area, and a second screen that assists in confirming the sensor range in which the biometric information can be detected, based on the acquired biometric information, by positioning the person at multiple measurement points in the monitoring area.

[0009] These comprehensive or specific embodiments may be implemented as systems, devices, methods, integrated circuits, computer programs, or recording media, or as any combination of systems, devices, methods, integrated circuits, computer programs, and recording media. [Effects of the Invention]

[0010] According to this disclosure, High reliability can be obtained for monitoring or anomaly detection in the surveillance area. We can provide technology to support the installation of sensors. [Brief explanation of the drawing]

[0011] [Figure 1] Block diagram showing an example configuration of the detection system according to Embodiment 1. [Figure 2] This figure shows an example of the configuration of sensor data according to Embodiment 1. [Figure 3] A diagram showing an example of the configuration of biological information according to Embodiment 1. [Figure 4] A flowchart showing an example of the setting process for biological condition determination information and display setting information by the detection system according to Embodiment 1. [Figure 5]Flowchart illustrating an example of monitoring area monitoring processing by the detection system according to the first embodiment [Figure 6] Diagram showing a selection screen for the usage scene "Monitoring" according to the first embodiment [Figure 7] Diagram illustrating an example of a setting screen for biological level determination information for the usage scene "Monitoring" according to the first embodiment [Figure 8] Diagram showing a setting screen for display setting information for the usage scene "Monitoring" according to the first embodiment [Figure 9] Diagram showing a setting screen for biological level correction setting information for the usage scene "Monitoring" according to the first embodiment [Figure 10] Diagram illustrating an example of a monitoring screen when a person is sleeping in a bedroom according to the first embodiment [Figure 11] Diagram illustrating an example of a monitoring screen when a person is watching television in a living room according to the first embodiment [Figure 12] Diagram illustrating an example of a monitoring screen when a person is in an abnormal state in a bathroom according to the first embodiment [Figure 13] Diagram showing a selection screen for the usage scene "Abnormality detection" according to the first embodiment [Figure 14] Diagram illustrating an example of a setting screen for biological level determination information for the usage scene "Abnormality detection" according to the first embodiment [Figure 15] Diagram showing a setting screen for display setting information for the usage scene "Abnormality detection" according to the first embodiment [Figure 16] Diagram showing a setting screen for biological level correction setting information for the usage scene "Abnormality detection" according to the first embodiment [Figure 17] Diagram illustrating an example of a monitoring screen when two persons are in an office according to the first embodiment [Figure 18] Diagram illustrating an example of a monitoring screen when there is a person in an abnormal state in an office according to the first embodiment [Figure 19] Diagram illustrating an example of a selection screen for the usage scene "Sensor installation support" according to the second embodiment [Figure 20] Diagram illustrating an example of a setting screen for sensor installation information according to the second embodiment [Figure 21]This figure shows an example of a sensor installation confirmation support screen according to Embodiment 2. [Figure 22] This figure shows an example of a sensor range confirmation support screen according to Embodiment 2. [Figure 23] A diagram showing an example of the results confirmation screen according to Embodiment 2. [Figure 24] This diagram shows the hardware configuration of a computer that implements the functions of each device related to this disclosure using a computer program. [Modes for carrying out the invention]

[0012] Embodiments of the present disclosure will be described in detail below, with appropriate reference to the drawings. However, unnecessary details may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding by those skilled in the art. The accompanying drawings and the following explanation are provided to enable those skilled in the art to fully understand the present disclosure and are not intended to limit the subject matter of the claims.

[0013] (Embodiment 1) <System Configuration> Figure 1 is a block diagram showing an example configuration of the detection system 10 according to Embodiment 1. Figure 2 is a diagram showing an example configuration of sensor data 20 according to Embodiment 1. Figure 3 is a diagram showing an example configuration of biological information 21 according to Embodiment 1.

[0014] The detection system 10 comprises a sensor 11, a biometric information detection device 12, a management device 13, and a terminal device 14. The sensor 11, the biometric information detection device 12, the management device 13, and the terminal device 14 may transmit and receive data or information through a predetermined communication network. The communication network may be wired or wireless.

[0015] Multiple sensors 11 may be placed to monitor the entire monitoring area 8.

[0016] Sensor 11 is a radar-type sensor that emits radio waves in a predetermined frequency band and receives reflected waves reflected from an object (e.g., person 1) within the sensing range of the sensor 11. Sensor 11 compares the emitted radio waves with the received reflected waves to generate sensor data 20 as shown in Figure 2. Sensor 11 may be a millimeter-wave radar-type sensor. Examples of millimeter-wave radar-type sensors include the FMCW (Frequency Modulated Continuous Wave) method or the Step ICW (Interrupted Continuous Wave) method.

[0017] As shown in Figure 2, the sensor data 20 associates timestamps, detection information, and signal information.

[0018] A timestamp is information indicating when the sensor data 20 was obtained. Examples of timestamps include time information or frame numbers.

[0019] The detection information includes, for example, information indicating the position in three-dimensional space where a reflected wave of a predetermined intensity or higher was obtained (hereinafter referred to as the reflection point), information indicating the distance from the sensor 11 to the reflection point, and information indicating the reflection intensity at the reflection point.

[0020] The signal information includes, for example, IQ data for each receiving antenna.

[0021] In other words, the sensor data 20 is data that shows the position, shape, and temporal changes of objects in three-dimensional space within the sensing range, and does not have the resolution of video data, so it is not possible to identify individuals, and the sensor 11 makes it possible to acquire data while protecting the privacy of individuals.

[0022] Sensor 11 transmits the generated sensor data 20 to the management device 13 and terminal device 14.

[0023] The biological information detection device 12 generates the biological information 21 shown in Figure 3 based on the sensor data 20 received from each sensor 11.

[0024] In the biometric information 21, as shown in Figure 3, the timestamp, detected person information, vital sign information, and confidence level are associated.

[0025] A timestamp is information that indicates the timing when the biometric information 21 was generated. An example of a timestamp is time information. The management device 13 uses the time when the biometric information 21 was generated as the timestamp.

[0026] The detected person information is information about the detected person 1. The detected person information includes the person ID, the person's location, and the person's posture. The person ID is an ID used to identify the detected person 1. The person's location indicates the position of the person indicated by the person ID in three-dimensional space within the monitoring area 8. The person's posture indicates the posture of person 1 indicated by the person ID. The biometric information detection device 12 identifies the person's location and posture based on the detection information from the sensor data 20.

[0027] Vital sign information refers to vital signs that represent the activity status of the detected person 1. Examples of vital signs include respiratory rate, depth of respiration, heart rate, and blood pressure. The biometric information detection device 12 calculates the vital signs of the detected person 1 (e.g., respiratory rate, depth of respiration, heart rate, blood pressure, etc.) based on the time changes in the detection information of the sensor data 20.

[0028] Reliability information indicates the reliability (likelihood) of vital sign information. The biological information detection device 12 calculates the reliability of the calculated vital sign information based on the detection information and signal information of the sensor data 20. The reliability information can be generated based on the noise level ratio of the radar signal, which is the source of the vital sign information, or the result of comparing the reliability information of multiple different vital sign information candidates.

[0029] The biological information detection device 12 transmits the generated biological information 21 to the management device 13 and the terminal device 14.

[0030] The management device 13 generates biometric status information 22 for each person 1 based on the biometric information 21 received from the biometric information detection device 12. The biometric status information 22 is information indicating the degree (level) of vital values, which represent the activity state of person 1. At this time, the management device 13 generates the biometric status information 22 based on the biometric status determination information 23. The biometric status determination information 23 includes information for determining the degree from the vital values. The user can set the biometric status determination information 23 by operating the management device 13. Details of the biometric status determination information will be described later.

[0031] The management device 13 transmits the generated biological condition information 22 and biological condition determination information 23 to the terminal device 14.

[0032] The terminal device 14 estimates the behavior or state of person 1 in the monitoring area 8 based on the biometric information 21 received from the biometric information detection device 12 and the biometric status information 22 and biometric status determination information 23 received from the management device 13, and displays it on the monitoring screen. At this time, the terminal device 14 determines the display method of person 1's behavior or state based on the display setting information 24. The display setting information 24 is information that includes the setting of the display method of the person's behavior or state. The user can set the display setting information 24 by operating the terminal device 14. Details of the display setting information 24 will be described later.

[0033] In this way, the detection system 10 uses a radar-type sensor 11 that senses people using radio waves to detect the biological state of person 1. This makes it possible to detect the biological state of person 1 while protecting the privacy of person 1.

[0034] <Configuration Processing Flow> Figure 4 is a flowchart showing an example of the setting process for biological condition determination information 23 and display setting information 24 by the detection system 10 according to Embodiment 1.

[0035] The management device 13 displays a usage scenario selection screen. Specific examples of the selection screen will be described later. The user selects one usage scenario from the selection screen (S11).

[0036] The management device 13 reads and displays the default biological condition assessment information 23 for the usage scenario selected in step S11. The user sets the displayed biological condition assessment information 23 (S12). Details on how to set the biological condition assessment information 23 will be described later.

[0037] The terminal device 14 displays the default display settings information 24 for the usage scenario selected in step S11. The user configures the displayed display settings information 24 (S13). Details on how to configure the display settings information 24 will be described later.

[0038] The management device 13 associates the biological condition determination information 23 set in step S12 with the usage scene selected in step S11 and stores it in the storage 1003 (see Figure 25). The terminal device 14 associates the display setting information 24 set in step S13 with the usage scene selected in step S11 and stores it in the storage 1003 (S14).

[0039] Through the above processing, appropriate biological condition determination information 23 and display setting information 24 are associated with each usage scenario and stored in the storage 1003.

[0040] <Monitoring Process Flow> Figure 5 is a flowchart showing an example of the monitoring process of the monitoring area 8 by the detection system 10 according to Embodiment 1.

[0041] The terminal device 14 displays a usage scenario selection screen. The user selects one usage scenario from the selection screen (S21).

[0042] The management device 13 acquires the biological condition determination information 23 associated with the usage scene selected in step S21 from the storage 1003. The terminal device 14 acquires the display setting information 24 associated with the usage scene selected in step S21 from the storage 1003 (S22). As a result, the detection system 10 can perform monitoring processing using the biological condition determination information 23 and display setting information 24 that are appropriately set for the usage scene.

[0043] The management device 13 uses the biological condition determination information 23 to generate biological condition information 22 from the biological information 21 received from the biological information detection device 12 (S23). The management device 13 transmits the generated biological condition information 22 to the terminal device 14.

[0044] The terminal device 14 identifies the position and posture of person 1 from the biometric information 21 received from the biometric information detection device 12 (S24).

[0045] The terminal device 14 uses the display setting information 24 to estimate the person's behavior or state from the person's position and posture, as well as the biometric information 22 (S25).

[0046] The terminal device 14 displays information on the monitoring screen 400 indicating the location, actions, or status of the estimated person (S26). The detection system 10 then returns to step S22.

[0047] Through the above process, the user can intuitively monitor the location, actions, or state (for example, any abnormal biological condition of person 1) within the monitoring area 8 by viewing the monitoring screen.

[0048] <Usage scenario: Monitoring> Next, we will explain one example of a use case for the detection system 10: monitoring the elderly and other vulnerable individuals.

[0049] Figure 6 shows the selection screen 50A for the "monitoring" usage scenario according to Embodiment 1.

[0050] In step S11 of Figure 4, the management device 13 displays the usage scene selection screen shown in Figure 6. When the user selects "monitoring" as the usage scene, the management device 13 displays the setting screen 100A for the biological condition determination information 23 for the "monitoring" usage scene, as shown below.

[0051] <Monitoring settings screen> Figure 7 shows an example of the setting screen 100A for the "monitoring" usage scenario according to Embodiment 1.

[0052] The setting screen 100A for the "monitoring" usage scenario, which includes the vital sign threshold setting area 101, the time-dependent change threshold setting area 102, the respiratory depth threshold setting area 103, and the number of people to be measured setting area 104, is configured as shown in Figure 7.

[0053] The user adjusts the threshold bar 120 included in the vital value threshold setting area 101 to set thresholds for determining the degree of vitality related to the level of vitality. The degree of vitality related to the level of vitality is referred to as the vital high / low degree. For example, if three levels of vital high / low degrees are set, namely "low," "normal," and "high," the user sets threshold 1 to distinguish between "low" and "normal," and threshold 2 to distinguish between "normal" and "high," as shown in Figure 7. For example, the user may set these thresholds lower (i.e., stricter) for elderly individuals who are being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that the number of vital high / low degrees is not limited to three levels; there may be two levels, four levels or more. Also, the name of each level of vital high / low degrees may be changed by the user. Furthermore, each level of vital high / low degrees may be read as a vital high / low level.

[0054] The user adjusts the threshold bar 120 included in the threshold setting area 102 for the time-dependent change in vital signs to set thresholds for determining the degree of biological change related to the time-dependent change in vital signs. The degree of biological change related to the time-dependent change in vital signs includes both an upward and downward trend. The upward trend is referred to as the degree of vital sign increase. The downward trend is referred to as the degree of vital sign decrease. For example, if three stages are set for the degree of vital sign increase: "no change," "increase," and "rapid increase," then, as shown in Figure 7, threshold 1 is set to distinguish between "no change" and "increase," and threshold 2 is set to distinguish between "increase" and "rapid increase." For example, the user may set these thresholds lower (i.e., stricter) for elderly individuals who are being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that each stage of the degree of vital sign increase may be read as a vital sign increase level. For example, if three levels are set for the degree of decline in vital signs—"no change," "decline," and "rapid decline"—threshold 1 is set to distinguish between "no change" and "decline," and threshold 2 is set to distinguish between "decline" and "rapid decline," as shown in Figure 7. For example, the user may set these thresholds lower (i.e., stricter) for elderly individuals being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that each level of the degree of decline in vital signs may be read as a vital sign decline level.

[0055] The user adjusts the threshold bar 120 included in the respiratory depth threshold setting area 103 to set a threshold for determining the biological degree related to the respiratory depth of vital signs from the respiratory depth of vital signs. The biological degree related to the respiratory depth of vital signs is referred to as the respiratory depth degree. For example, if three levels of respiratory depth degree are set: "shallow," "normal," and "deep," the user sets threshold 1 to distinguish between "shallow" and "normal," and threshold 2 to distinguish between "normal" and "deep," as shown in Figure 7. For example, the user may set these thresholds lower (i.e., stricter) for elderly people who are being monitored. The set thresholds 1 and 2 may be displayed as numerical values. Note that each level of respiratory depth degree may be read as a respiratory depth level.

[0056] The user sets the maximum number of people to be measured in the measurement person setting area 104. Hereinafter, the set maximum number will be referred to as the maximum measurement person. For example, if the elderly person being monitored lives alone in the room that is the monitoring area, the user may set it to "1 person". Typically, reducing the maximum measurement person improves the reliability of the biometric information.

[0057] The management device 13 generates biometric condition determination information 23, which includes each threshold and the maximum number of people to be measured, set by the user, and stores it in storage 1003 in association with the usage scenario "monitoring". As a result, in the monitoring process shown in Figure 5, when the usage scenario "monitoring" is selected, the management device 13 can use the biometric condition determination information 23 that has been appropriately set for the usage scenario "monitoring".

[0058] <Display settings information for monitoring> Figure 8 shows the setting screen 200A for the display setting information 24 for the "monitoring" usage scenario according to Embodiment 1.

[0059] As shown in Figure 8, the setting screen 200A for the "monitoring" usage scenario displays setting information 24, and includes the following items: action or state name, setting name, and setting value.

[0060] Action or state name indicates the name of a person's action or state.

[0061] The setting name indicates the name of the setting associated with an action or state name. One or more setting names are associated with a single action or state name.

[0062] A setting value indicates the value associated with a setting name. One setting name is associated with one setting value. However, multiple setting values ​​may be associated with a single setting name. A set of setting name and setting value may be referred to as a display setting parameter.

[0063] <<Sleeping>> For example, as shown in Figure 8, the action or state name "Sleeping" is associated with the setting names "Location Condition," "Posture Condition," "Physiological Condition," and "Icon Name."

[0064] The setting named "Location Condition" specifies the range of a person's location for determining their behavior as "sleeping." This range may be defined by the X and Y intervals on the map. For example, the user might set the range of the "bedroom" on the map (floor plan of a residence) as the setting named "Location Condition" associated with the behavior "sleeping."

[0065] The setting value for the setting named "Posture Condition" indicates the posture of a person to determine that their behavior is "sleeping." This posture may be selected from a predetermined list of postures. For example, the user selects "lying down" from the predetermined list of postures as the setting value for the setting named "Posture Condition" to associate with the behavior "sleeping."

[0066] The setting value for the setting name "Biological Condition" indicates the person's biological condition and the correction amount for that biological condition, which are used to determine that the person's behavior is "sleeping". Generally, when a person is sleeping, their vital signs tend to be lower than usual because they are at rest. Therefore, the user may set a correction amount to lower the default threshold for high or low vital signs by a predetermined amount as the setting value for the setting name "Biological Condition" associated with the behavior "sleeping". This reduces the possibility that the terminal device 14 may mistakenly determine the vital signs to be "low" even though the person's vital signs are only slightly lower than usual because they are sleeping. However, it is not mandatory to associate the setting name "Biological Condition" with the behavior name "sleeping".

[0067] The setting name "Icon Name" indicates the file name of the icon to be used when the character's behavior is determined to be "sleeping".

[0068] For example, if the terminal device 14 determines that a person is "sleeping" and displays an icon of the file name indicated by the setting value of the setting name "icon name," the person's position is "lying down" as indicated by the setting value of the setting name "position condition," and the person's vital signs are "normal" as corrected by the setting value of the setting name "physiological condition condition." Details of the display method will be described later.

[0069] <<Watching TV>> For example, as shown in Figure 8, the action and state name "Watching TV" is associated with the setting names "Location Condition," "Posture Condition," "Biological Degree Condition," and "Icon Name."

[0070] The setting named "Location Condition" specifies the range of a person's location for determining that their behavior is "watching TV." This range may be defined by the X and Y intervals on the map. For example, the user might set the range of the "Living Room" on the map (floor plan of a house) as the setting named "Location Condition" to associate with the behavior "watching TV."

[0071] The setting value for the setting named "Posture Condition" indicates the posture of a person in order to determine that their action is "watching television." This posture may be selected from a predetermined list of postures. For example, the user might select "Sitting" from the predetermined list of postures as the setting value for the setting named "Posture Condition" to associate with the action "watching television."

[0072] The setting value for the setting named "Biological Condition" indicates the person's biological condition and the correction amount for that biological condition, which are used to determine that the person's behavior is "watching television." For example, a person watching television may have higher vital signs than usual due to the influence of the content. Therefore, the user may set a correction amount to raise the default threshold for high or low vital signs by a predetermined amount as the setting value for the setting named "Biological Condition" associated with the behavior "watching television." This reduces the possibility that the terminal device 14 may mistakenly determine the vital signs to be "high" even though the person's vital signs are slightly higher than usual because they are watching television. However, it is not mandatory to associate the setting named "Biological Condition" with the behavior name "watching television."

[0073] The setting name "Icon Name" indicates the file name of the icon to be used when the character's behavior is determined to be "watching TV".

[0074] For example, if the person's location is within the range indicated by the "location condition" setting (e.g., within the living room), the person's posture is "sitting" as indicated by the "posture condition" setting, and the person's vital signs are "normal" as corrected by the setting value of the "biological condition" setting, the terminal device 14 determines that the person is "watching television" and displays the icon of the file name indicated by the "icon name" setting. Details of the display method will be described later.

[0075] <<Abnormal State>> For example, as shown in Figure 8, the action or state name "abnormal state" is associated with the setting names "location condition," "posture condition," "vital sign elevation / decrease condition," "vital sign increase / decrease change condition," and "icon name."

[0076] The setting named "Location Conditions" indicates the range of a person's location for determining that their state is an "abnormal state." In Figure 8, the entire range of monitoring area 8 is set as the range for determining the abnormal state.

[0077] The setting value for the setting named "Posture Condition" indicates the posture of a person to be used to determine that their state is an "abnormal state." This posture may be selected from a predetermined list of postures. For example, the user selects "lying down" from the predetermined list of postures as the setting value for the setting named "Posture Condition" to be associated with the state "abnormal state."

[0078] The setting named "Vital Sign Level Condition" indicates the degree of vital signs required to determine if a person's condition is "abnormal." For example, a user might set "High" and "Low" as the setting values ​​for "Vital Sign Level Condition" to correspond to the "abnormal state."

[0079] The setting named "Vital Sign Increase / Decrease Change Condition" indicates the degree of vital sign increase and decrease required to determine a person's condition as "abnormal." For example, a user might set the setting named "Vital Sign Increase / Decrease Change Condition" to "Rapid Increase" and "Rapid Decrease" to correspond to the "abnormal" condition.

[0080] The setting name "Icon Name" indicates the file name of the icon to be used when a character's state is determined to be "abnormal."

[0081] For example, if the person's location is in any of the monitoring areas 8 (e.g., any of the residences), the person's posture is "lying down" as indicated by the "posture condition" setting, the person's vital signs are "high" or "low" as indicated by the "vital signs elevation / decrease condition" setting, and the person's vital signs are rapidly increasing or decreasing as indicated by the "vital signs increase / decrease condition" setting, the terminal device 14 will determine the person's condition to be "abnormal" and display an icon of the file name indicated by the setting value of the setting name "icon name". Details of the display method will be described later.

[0082] <Status check settings information for monitoring> Figure 9 shows the setting screen 300A for the "monitoring" usage scenario according to Embodiment 1, which contains settings for biometric condition correction information.

[0083] In addition to the display setting information 24 described above, the terminal device 14 displays a setting screen 300A for setting the biological condition correction setting information shown in Figure 9.

[0084] The setting screen 300A for the bio-condition correction setting information has two items: location name and correction amount. The location name indicates the name of the location in monitoring area 8. If monitoring area 8 is a residence, the location name may be, for example, "living room," "toilet," "bathroom," or "bedroom." The correction amount indicates the correction amount for the bio-condition determination information 23 when the person is located in the location indicated by the location name.

[0085] For example, as shown in the first line of the vital signs level correction setting information in Figure 9, the user may associate the location name "toilet" with a setting that increases the threshold for "high" vital signs level as a correction amount. In this case, the terminal device 14 will determine the vital signs level for a person located in the toilet, taking this correction amount into consideration. This reduces the possibility of misjudging the vital signs level as "high" even though the person's vital signs are only slightly higher than normal because they are in the toilet.

[0086] For example, as shown in the second line of the vital signs level correction setting information in Figure 9, the user may associate the location name "bathroom" with a setting that increases the threshold for "high" vital signs level as a correction amount. In this case, the terminal device 14 will determine the vital signs level for a person located in the bathroom, taking this correction amount into consideration. This reduces the possibility that the terminal device 14 may mistakenly determine the vital signs level as "high" even though the vital signs are slightly higher than normal because the person is bathing.

[0087] <Monitoring screen for monitoring> Figure 10 shows an example of the monitoring screen 400A when the person according to Embodiment 1 is sleeping in the bedroom.

[0088] As shown in Figure 10, the terminal device 14 displays the monitoring screen 400A. The monitoring screen 400A consists of a map area 401, an attitude area 402, a location area 403, and an action area 404.

[0089] The terminal device 14 displays a floor plan of a residence in the monitoring area 8 as an example of a map in the map area 401.

[0090] The terminal device 14 detects the posture of person 1 based on the biometric information 21 received from the biometric information detection device 12, and displays the name of the detected posture in the posture area 402.

[0091] The terminal device 14 detects the location of person 1 based on the biometric information 21 received from the biometric information detection device 12. The terminal device 14 maps the detected location of person 1 onto the floor plan and identifies the name of the location of person 1. The terminal device 14 displays the identified name of the location in the location area 403.

[0092] The terminal device 14 estimates the actions of person 1 based on the biometric information 21 received from the biometric information detection device 12, the biometric status information 22 received from the management device 13, and the display setting information 24. The terminal device 14 displays the estimated action name of person 1 in the action area 404.

[0093] Furthermore, the terminal device 14 displays an icon 500 corresponding to the estimated behavior and an icon 501 corresponding to the biological status at the specified location in the map area 401. Note that the icons in this embodiment may be interpreted as graphic information.

[0094] For example, if the terminal device 14 determines that the posture of person 1, as estimated from the biometric information 21, is "lying down," it displays "lying down" in the posture area 402.

[0095] For example, if the terminal device 14 determines that the location of person 1, as estimated from the biometric information 21, is "bedroom," it displays "bedroom" in the location area 403.

[0096] For example, if the terminal device 14 estimates from the display setting information 24 that person 1 is "sleeping," it displays "sleeping" in the activity area 404.

[0097] For example, if the terminal device 14 estimates that person 1 is "sleeping" based on the biometric information 22 and the display setting information 24, it displays a "sleeping" icon 500 in the "bedroom" location on the floor plan displayed in the map area 401.

[0098] For example, if the terminal device 14 determines, based on the biological condition information 22 and the display setting information 24, that the depth of breathing of person 1 is "normal" and the degree of the person's vital signs (e.g., the degree of heart rate) is "normal", it will display an icon 501 indicating a "normal" depth of breathing and an icon 502 indicating a "normal" degree of vital signs (heart rate) near icon 500.

[0099] This allows the user to intuitively confirm, by looking at the monitoring screen 400A, that person 1, who is being monitored and lives in the residence, is currently sleeping in the bedroom and that their vital signs are normal.

[0100] Figure 11 shows an example of the monitoring screen 400B when a person according to Embodiment 1 is watching television in the living room.

[0101] For example, if the terminal device 14 determines that the posture of person 1, as estimated from the biometric information 21, is "sitting," it displays "sitting" in the posture area 402.

[0102] For example, if the terminal device 14 determines that the location of person 1, as estimated from the biometric information 21, is "living room," it displays "living room" in the location area 403.

[0103] For example, if the terminal device 14 estimates that person 1 is "watching television" based on the biometric information 22 and the display setting information 24, it displays "watching television" in the activity area 404.

[0104] For example, if the terminal device 14 estimates that the location of person 1 from biometric information 21 is "living room" and that person 1's activity is "watching TV" from display setting information 24, it will display a "watching TV" icon 503 at the "living room" location on the floor plan.

[0105] For example, if the terminal device 14 determines, based on the biological condition information 22 and the display setting information 24, that the depth of breathing of person 1 is "normal" and the degree of elevation of person 1's vital signs (e.g., the degree of elevation of heart rate) is "normal", it will display an icon 501 indicating the degree of breathing depth is "normal" and an icon 504 indicating the degree of vital signs (heart rate) elevation is "normal" near icon 503.

[0106] This allows the user to intuitively confirm, by looking at the monitoring screen 400B, that person 1, who is being monitored and lives in the residence, is currently watching television in the living room and that their vital signs are normal.

[0107] Figure 12 shows an example of the monitoring screen 400C when a person in an abnormal state is in the bathroom according to Embodiment 1.

[0108] For example, if the terminal device 14 determines that the posture of person 1, as estimated from the biometric information 21, is "lying down," it displays "lying down" in the posture area 402.

[0109] For example, if the terminal device 14 determines that the location of person 1, as estimated from the biometric information 21, is "bathroom," it displays "bathroom" in the location area 403.

[0110] For example, if the terminal device 14 determines that person 1 is in an "abnormal state" based on the biometric status information 22 and the display setting information 24, it displays an icon 504 indicating "abnormal" vital signs in the "bathroom" area of ​​the floor plan. Although the display of person 1's activity area 404 is omitted here, it may also display alert information such as "safety check" or "emergency call".

[0111] This allows users to intuitively confirm, by looking at the monitoring screen 400C, that a person being monitored who lives in the residence is currently experiencing a vital sign abnormality in the bathroom.

[0112] <Usage Scenario: Anomaly Detection> Next, we will describe an example of a use case for the detection system 10: the detection of abnormalities in the biological systems of employees working in an office.

[0113] Figure 13 shows the selection screen 50B for the usage scenario "anomaly detection" according to Embodiment 1.

[0114] In step S11 of Figure 4, the management device 13 displays the usage scene selection screen 50B shown in Figure 13. When the user selects "anomaly detection" as the usage scene, the management device 13 displays the setting screen 100B for the biological condition determination information 23 for the "anomaly detection" usage scene, as shown below.

[0115] <Settings screen for anomaly detection> Figure 14 shows an example of the setting screen 100B for the biological condition determination information 23 for the "anomaly detection" usage scenario according to Embodiment 1.

[0116] The setting screen 100B for the biological condition determination information 23 for the "anomaly detection" usage scenario is composed of a vital value threshold setting area 101, a time change threshold setting area 102 for vital values, a confidence threshold setting area 105, and a measurement number setting area 104, as shown in Figure 14.

[0117] As shown in Figure 7 above, the user adjusts the threshold bar 120 in the vital value threshold setting area 101 to set thresholds for high and low vital signs. For example, if the employee being detected as abnormal is relatively healthy, the user may set the threshold higher (i.e., more lenient).

[0118] As shown in Figure 7 above, the user adjusts the threshold bar 120 in the threshold setting area 102 for the degree of change in vital signs over time to set thresholds for the degree of increase and decrease in vital signs. For example, the user may set the threshold lower (i.e., stricter) if the employee being detected for an anomaly is relatively healthy, but the user does not want to miss any sudden changes in vital signs.

[0119] The user adjusts the threshold bar 120 included in the confidence threshold setting area 105 to determine a threshold for determining the degree of reliability of the biological system based on the confidence information contained in the biological information 21. The degree of reliability is referred to as the confidence level. For example, if three levels of confidence levels are set, "low," "normal," and "high," the user sets a threshold 1 to distinguish between "low" and "normal," and a threshold 2 to distinguish between "normal" and "high," as shown in Figure 14. For example, in an office environment, if false detections of abnormal conditions occur frequently even when there are no abnormal conditions, it will disrupt operations, so the user may set the thresholds higher (i.e., stricter). The set thresholds 1 and 2 may be displayed as numerical values. Note that the number of confidence levels is not limited to three; there may be two levels, four or more levels. Also, each level of confidence level may be read as a confidence level.

[0120] The user sets the maximum number of people to be measured in the measurement person setting area 104, similar to Figure 7 described above. For example, the user may set the maximum number of people to be measured to match the number of employees working in the office.

[0121] The management device 13 generates biometric condition determination information 23, which includes each threshold and the maximum number of people to be measured, set by the user, and stores it in storage 1003 in association with the usage scenario "anomaly detection". As a result, in the monitoring process shown in Figure 5, when the usage scenario "anomaly detection" is selected, the management device 13 can use the biometric condition determination information 23 that has been appropriately set for "anomaly detection".

[0122] <Display settings information for anomaly detection> Figure 15 shows the setting screen for the display setting information 24 for the usage scenario "anomaly detection" according to Embodiment 1.

[0123] The display setting information 24 for the usage scenario "anomaly detection" has the following items, as shown in Figure 15, similar to Figure 8: an action or state name, a setting name, and a setting value.

[0124] <<Work in progress>> For example, as shown in Figure 15, the action or state name "Working" is associated with the setting names "Location Condition," "Posture Condition," "Biological Degree Condition," and "Icon Name."

[0125] The setting named "Location Condition" specifies the range of a person's location for determining their action as "working." This range may be defined by the X and Y intervals on the map. For example, the user might set the range of the "desk" on the map (e.g., an office floor plan) as the setting named "Location Condition" to associate with the action "working."

[0126] The setting value for the setting named "Posture Condition" indicates the posture of a person to be used to determine if their action is "working." This posture can be selected from a predetermined list of postures. For example, the user might select "Sitting" from the predetermined list of postures as the setting value for the setting named "Posture Condition" to associate with the action "Working."

[0127] The setting value for the setting name "Biological Condition" indicates the person's biological condition and the correction amount for that biological condition, which are used to determine that the person's behavior is "working." Generally, people who are working tend to have lower vital signs than usual because they are concentrating. Therefore, the user may set a correction amount to lower the default threshold for high or low vital signs by a predetermined amount as the setting value for the setting name "Biological Condition" associated with the behavior "working." This reduces the possibility that the management device 13 may mistakenly determine the vital signs to be "low" even though the person's vital signs are only slightly lower than usual because they are working. However, it is not mandatory to associate the setting name "Biological Condition" with the behavior name "working."

[0128] The setting name "Icon Name" indicates the file name of the icon to be used when a character's action is determined to be "working".

[0129] The terminal device 14 determines that a person is "working" if their location is within the range indicated by the "location condition" setting (e.g., a desk), their posture is "sitting" as indicated by the "posture condition" setting, and their vital signs are "normal" as corrected by the setting named "biological condition," and displays an icon of the file name indicated by the setting named "icon name." Details of the display method will be described later.

[0130] <<Abnormal State>> For example, as shown in Figure 15, the action or state name "abnormal state" is associated with the setting names "location condition," "posture condition," "vital sign elevation / decrease degree condition," "vital sign increase / decrease change degree condition," "confidence level condition," and "icon name."

[0131] The setting names "Location Condition," "Posture Condition," "Vital Sign Level Condition," "Vital Sign Increase / Decrease Change Condition," and "Icon Name" are the same as in Figure 8, so their explanation is omitted.

[0132] The setting value for the "Confidence Level Condition" indicates the level of confidence required to determine that Person 1's state is "abnormal." For example, a user might set the "Confidence Level Condition" setting to "High" when associating it with the "abnormal state" state. This is because in places like offices, where many relatively healthy individuals work, the likelihood of biological abnormalities occurring is lower compared to elderly people, and a low level of confidence could lead to frequent false positives and disrupt operations.

[0133] For example, if the terminal device 14 determines that person 1 is in an "abnormal state" and displays an icon of the file name indicated by the setting value of the setting name "Icon Name," the terminal device 14 will determine that person 1 is in an "abnormal state" if the location of person 1 is within the range indicated by the setting value of "Location Condition," the posture of person 1 is "lying down" as indicated by the setting value of "Posture Condition," the degree of elevation of person 1's vital signs is "high" or "low" as indicated by the setting value of "Vital Sign Elevation / Decrease Change Condition," and the confidence level of person 1 is "high" as indicated by the setting value of "Confidence Level Condition." Details of the display method will be described later.

[0134] <Biological condition correction settings information for anomaly detection> Figure 16 shows the setting screen for the biological condition correction setting information for the "anomaly detection" usage scenario according to Embodiment 1.

[0135] In addition to the display setting information 24 described above, the terminal device 14 displays a setting screen 300B for setting the biological condition correction setting information shown in Figure 16.

[0136] The setting screen 300B for the biological condition correction setting information has the fields for location name and correction amount. If the monitoring area 8 is an office, the location name may be, for example, "toilet" or "corridor".

[0137] For example, as shown in the first line of the vital signs correction setting information in Figure 15, the user may associate the location name "toilet" with a setting that increases the threshold for "high" in the vital signs level as a correction amount. In this case, the terminal device 14 will determine the vital signs level for person 1 located in the toilet, taking this correction amount into consideration. This reduces the possibility of misjudging the vital signs level as "high" even though person 1's vital signs are slightly higher than normal because they are in the toilet.

[0138] For example, as shown in the second line of the vital signs level correction setting information in Figure 16, the user may associate the location name "Passageway" with a setting that increases the threshold for "High" in vital signs level as a correction amount. In this case, the terminal device 14 will determine the vital signs level for person 1 located in the passageway, taking this correction amount into consideration. This reduces the possibility that the terminal device 14 may mistakenly determine the vital signs level as "High" even though the person's vital signs are only slightly higher than normal because they are moving through the passageway.

[0139] <Monitoring screen for anomaly detection> Figure 17 shows an example of the monitoring screen 400D when two people are in the office according to Embodiment 1.

[0140] As shown in Figure 17, the terminal device 14 displays the monitoring screen 400D. The monitoring screen 400D is configured to include a map area 401.

[0141] The terminal device 14 displays a floor plan of the office, which is the monitoring area 8, in the map area 401 as an example of a map.

[0142] For example, if the terminal device 14 estimates from the display setting information 24 that person A is "working," it displays a "working" icon 511 at the location of person A on the floor plan displayed in the map area 401. In addition, the terminal device 14 displays the icon 511 with a solid line, for example, to indicate that the confidence level is "high." Furthermore, the terminal device 14 displays an arrow icon (a horizontal arrow icon 512 in Figure 17) near the icon 511 to indicate that the degree of change in vital signs (heart rate) increase / decrease is "normal."

[0143] For example, if the terminal device 14 estimates from the display setting information 24 that person B is "moving," it displays an icon 513 indicating "moving" at person B's position on the floor plan displayed in the map area 401. In addition, the terminal device 14 displays the icon 513 with a dashed line, for example, to indicate that the confidence level is "low." Furthermore, the terminal device 14 displays an arrow icon (an upward-pointing arrow icon 514 in Figure 17) near the icon 513 to indicate that the degree of change in vital signs (heart rate) is "rapidly increasing."

[0144] This allows the user to intuitively confirm, by looking at the monitoring screen 400D, that person A, who is working in the office, is working, their vital signs are normal, and the reliability of those vital signs is high. Similarly, by looking at the monitoring screen 400D, the user can intuitively confirm that person B is on the move, their vital signs are rapidly increasing, but the reliability of those vital signs is low.

[0145] Figure 18 shows an example of the monitoring screen 400E when there is a person in an abnormal state in the office according to Embodiment 1.

[0146] For example, if the terminal device 14 estimates from the display setting information 24 that the state of person C is "abnormal," it displays an icon 515 indicating "abnormal state" at the location of the person on the floor plan displayed in the map area 401. In addition, the terminal device 14 displays the icon 515 with a solid line, for example, to indicate that the confidence level is "high." Furthermore, the terminal device 14 displays an icon 516 near the icon 515 indicating that the vital signs are in an "abnormal state."

[0147] This allows the user to intuitively confirm, by looking at the monitoring screen 400E, that a vital sign abnormality has occurred in person C, who is working in the office, and that the reliability of that vital sign is high. In this case, the terminal device 14 may output an alert (for example, displaying text related to safety confirmation or emitting an audio alert) indicating that person 1 has a biological abnormality.

[0148] (Embodiment 2) Embodiment 2 describes a detection system that assists in the installation of sensors in a predetermined area such as a room or office, as described in Embodiment 1. In Embodiment 2, components already described in Embodiment 1 are given common reference numerals, and their descriptions may be omitted.

[0149] <Usage scenario: Sensor installation support> Next, we will describe one example of a usage scenario for the detection system 10: sensor installation support.

[0150] Figure 19 shows an example of the selection screen 50C for the "sensor installation support" usage scenario according to Embodiment 2.

[0151] The user (for example, the worker installing the sensor 11) first temporarily installs the sensor 11 in a designated area where they want to set up the monitoring area 8. Then, when the user selects the usage scenario "Sensor Installation Support" on the selection screen 50C displayed by the terminal device 14, the terminal device 14 displays the following sensor installation information setting screen 700.

[0152] <Sensor installation information settings screen> Figure 20 shows an example of the sensor installation information setting screen 700 according to Embodiment 2. The sensor installation information setting screen 700 is an example of support information for assisting the installation of sensors 11 in an area.

[0153] The sensor installation information setting screen 700 includes a map setting area 710, a sensor installation setting area 720, a monitoring area setting area 730, and a map display area 740.

[0154] The map setting area 710 includes a map image input area 711, a horizontal input area 712, and a vertical input area 713.

[0155] The map image input area 711 receives a file of a map image (for example, an image of a room layout) 741 that shows a predetermined area where the sensor 11 is installed, which is input by the user.

[0156] In the horizontal input area 712, the user inputs the horizontal length of the area shown in the map image 741. In the vertical input area 713, the user inputs the vertical length of the area shown in the map image 741. Hereinafter, the scale of the area indicated by the values ​​entered in the horizontal input area 712 and the vertical input area 713 will be referred to as the input scale.

[0157] The sensor installation setting area 720 includes a sensor number input area 721 and a sensor installation information input area 722.

[0158] The number of sensors 11 temporarily installed in the area is entered by the user in the sensor count input area 721.

[0159] Sensor installation information is entered by the user in the sensor installation information input area 722. The sensor installation information includes a sensor ID that identifies the sensor 11, a value indicating the installation location of the sensor 11, and a value indicating the orientation of the sensor 11. The value indicating the installation location of the sensor 11 may include the horizontal (X direction) coordinates and the vertical (Y direction) coordinates on the map image 741. The value indicating the orientation of the sensor 11 may include the azimuth angle and depression angle indicating the orientation of the sensor 11. However, it is not mandatory for the sensor installation information to include both the value indicating the installation location of the sensor 11 and the value indicating the orientation of the sensor 11; it is sufficient to include either one.

[0160] In the monitoring area setting area 730, the user inputs the X, Y, and Z sections that represent the XYZ space to be set as the monitoring area 8 within area 11. The XYZ space defined by the X, Y, and Z sections set here becomes the monitoring area 8 for monitoring or anomaly detection, as described in Embodiment 1.

[0161] The map display area 740 displays the map image 741 input to the map image input area 711. In addition, the sensor image 742, which shows the position and orientation of the sensor 11 input to the sensor installation information input area 722, is superimposed on the map image 741 in the map display area 740. This allows the user to easily confirm the position and orientation of the temporarily installed sensor 11 within the area by looking at the map display area 740.

[0162] Furthermore, the horizontal length of the area entered in the horizontal input area 712 and the vertical length of the area entered in the vertical input area 713 are displayed as numerical values ​​near the map image 741 in the map display area 740.

[0163] Furthermore, in the map display area 740, a range image 743 indicating the extent of the monitoring area 8 entered in the monitoring area setting area 730 is superimposed on the map image 741.

[0164] <Sensor installation confirmation support screen> There may be a discrepancy between the input scale entered on the sensor installation information setting screen 700 and the actual scale of the area. Furthermore, there may be a discrepancy between the position and orientation of the sensor 11 entered on the sensor installation information setting screen 700 and the position and orientation of the sensor actually installed in the area. Therefore, as shown in Figure 21, the terminal device 14 displays a sensor installation confirmation support screen 800 to assist in correcting these discrepancies.

[0165] Figure 21 shows an example of the sensor installation confirmation support screen 800 according to Embodiment 2. Note that the sensor installation confirmation support screen 800 is an example of support information.

[0166] The sensor installation confirmation support screen 800 includes a sensor installation confirmation button 801, a sensor range confirmation button 802, a walking route display area 810, a walking start button 803, and a walking end button 804.

[0167] When the sensor installation confirmation button 801 is pressed, the terminal device 14 displays the sensor installation confirmation support screen 800 shown in Figure 21. When the sensor range confirmation button 802 is pressed, the terminal device 14 displays the sensor range confirmation support screen 850 shown in Figure 22, which will be described later.

[0168] The walking route display area 810 displays the map image 741 input into the map image input area 711. In addition, the sensor image 742, which shows the position and orientation input into the sensor installation information input area 722, is superimposed on the map image 741 in the walking route display area 810. Furthermore, the walking route display area 810 also superimposes on the map image 741 a walking route 811, which shows the route that the user (person) is expected to walk. For example, the walking route 811 is displayed with arrows as shown in Figure 21. In Figure 21, dotted arrows indicate walking routes 811 that the user has not yet walked, and solid arrows indicate walking routes 811 that the user has already walked.

[0169] The terminal device 14 controls the sensor 11 to detect the movement of a person within the area, thereby calculating the actual scale of the area and the actual position and orientation of the sensor 11. At this time, the terminal device 14 generates multiple walking routes 811 that can calculate the actual scale of the area and the actual position and orientation of the sensor with relatively high accuracy. For example, the terminal device 14 analyzes the map image 741 to estimate black straight lines of a predetermined width as walls and generates multiple walking routes 811 that follow the walls as closely as possible. As a result, the terminal device 14 can accurately calculate the actual scale of the area by detecting a user moving along the walking route 811 with the sensor 11 and calculating the distance traveled. In addition, the terminal device 14 can detect a user moving along the walking route 811 with the sensor 11 and determine the user's position within the detectable range of the sensor 11, thereby calculating the actual position and orientation of the sensor 11. Note that the generation of multiple walking routes 811 is not limited to this method. For example, the walking route 811 may be manually generated by the user, who specifies the starting and ending points of the walk, taking into account the arrangement of furniture and belongings in the room.

[0170] Next, the process of the user moving along the walking route 811 and the processing of the terminal device 14 during this process will be described. For example, the user and the terminal device 14 perform the following steps S101 to S108 (not shown).

[0171] (S101) The user moves to the starting point of the walking route 811 indicated by the dotted arrow while looking at the walking route display area 810 displayed on the terminal device 14, and presses the walking start button 803. When the walking start button 803 is pressed, the terminal device 14 controls the sensor 11 to start detecting the user's biometric information 21.

[0172] (S102) The user moves along the walking route 811 indicated by the dotted arrow. During this time, the sensor 11 measures the user's position, speed, and vital signs as they move, and generates biometric information 21.

[0173] (S103) The user moves to the end of the walking route 811 indicated by the dotted arrow and presses the end walking button 804. When the end walking button 804 is pressed, the terminal device 14 controls the sensor 11 to terminate detection.

[0174] (S104) The terminal device 14 changes the walking route 811 with a dotted arrow that has been detected to a walking route 811 with a solid arrow.

[0175] (S105) The user and terminal device 14 perform the operations and processes described in steps S101 to S104 for the other walking routes 811 indicated by dotted arrows.

[0176] (S107) After all the walking routes 811 with dotted arrows have been changed to walking routes 811 with solid arrows, the terminal device 14 calculates the actual scale of the area and the actual position and orientation of the sensor 11 based on the biometric information 21 obtained from the biometric information detection device 12.

[0177] (S108) The terminal device 14 corrects the deviation of the input scale based on the actual scale of the calculated area. The terminal device 14 also corrects the deviation of the position and orientation of the sensor 11 input to the sensor installation information input area 722 based on the actual position and orientation of the sensor 11 calculated. The terminal device 14 stores the corrected area scale and the position and orientation of the sensor 11 in the storage 1003 (see Figure 24).

[0178] Through the above process, the terminal device 14 can set a more accurate area scale and a more accurate position and orientation of the sensor 11.

[0179] <Sensor range confirmation support screen> If there is an area within the monitoring area 8 where human sensing is impossible, then the monitoring or anomaly detection described in Embodiment 1 cannot be achieved with high reliability. Therefore, as shown in Figure 22, the terminal device 14 displays a sensor range confirmation support screen 850 to help confirm the range in which human sensing is possible and / or impossible.

[0180] Figure 22 shows an example of the sensor range confirmation support screen 850 according to Embodiment 2. Note that the sensor range confirmation support screen 850 is an example of support information.

[0181] The sensor range confirmation support screen 850 includes a sensor installation confirmation button 801, a sensor range confirmation button 802, a measurement point display area 860, a measurement start button 851, and a measurement end button 852.

[0182] When the sensor installation confirmation button 801 is pressed, the terminal device 14 displays the sensor installation confirmation support screen 800 shown in Figure 21 above. When the sensor range confirmation button 802 is pressed, the terminal device 14 displays the sensor range confirmation support screen 850 shown in Figure 22.

[0183] The measurement point display area 860 displays the map image 741 input to the map image input area 711. In addition, the measurement point display area 860 displays a sensor image 742, which shows the position and orientation of the sensor 11 corrected through the sensor installation confirmation support screen 800, superimposed on the map image 741. Furthermore, the measurement point display area 860 displays measurement points 861, which indicate locations that the user should be positioned at, superimposed on the map image 741. For example, measurement points 861 are displayed as circles, as shown in Figure 22. In Figure 22, dotted circles indicate measurement points 861 that have not yet been measured by the user, and solid circles indicate measurement points 861 that have already been measured by the user.

[0184] For example, the terminal device 14 analyzes the floor plan map image 741 and distributes multiple measurement points 861 within the monitoring area 8. For example, the terminal device 14 estimates black lines of a predetermined width in the map image 741 as walls and places measurement points 861 near the center and corners of rooms surrounded by walls. By doing so, the terminal device 14 can determine whether a predetermined area centered on a measurement point 861 is within the sensing range by measuring the user located at that measurement point 861 with the sensor 11. Note that the generation of multiple measurement points 861 is not limited to this method. For example, measurement points 861 may be manually generated based on the user's operation, indicating the location where they will be staying, taking into account the arrangement of furniture and belongings in the room.

[0185] Next, the process of the user moving to the measurement point 861 and the processing of the terminal device 14 during this process will be described. For example, the user and the terminal device 14 perform the tasks and processes shown in steps S201 to S208 below.

[0186] (S201) The user moves to the measurement point 861 marked with a dotted circle while looking at the measurement point display area 860 displayed on the terminal device 14, and presses the measurement start button 851. When the measurement start button 851 is pressed, the terminal device 14 displays the respiratory rate, posture, and orientation that the user should perform at the measurement point 861, as well as the time the user should remain still at the measurement point 861 (hereinafter referred to as the resting time). The terminal device 14 then controls the sensor 11 to start measuring the user's vital signs, etc.

[0187] (S203) The user remains still at the measurement point 861 for the displayed resting time, maintaining the displayed respiratory rate, posture, and orientation. The sensor 11 continuously measures the vital values ​​of the user while they are resting at the measurement point 861 and generates biometric information 21.

[0188] (S204) After the displayed time has elapsed, the user presses the measurement end button 852. When the measurement end button 852 is pressed, the terminal device 14 controls the sensor 11 to terminate the measurement.

[0189] (S205) The terminal device 14 changes the measurement point 861 marked with a dotted circle to the measurement point 861 marked with a solid circle.

[0190] (S206) The user and terminal device 14 perform the operations and processes described in steps S201 to S205 for the other dotted circle marks as well.

[0191] (S207) After all dotted circles are changed to solid circles, the terminal device 14 identifies the measurement points 861 where the user was detected and the measurement points 861 where the user was not detected, based on the biometric information 21 acquired from the biometric information detection device 12. The terminal device 14 also identifies the measurement points 861 where vital values ​​were measured and the measurement points 861 where they were not measured, based on the biometric information 21 acquired from the biometric information detection device 12.

[0192] (S208) The terminal device 14 identifies a range where both can be detected 911 (see Figure 23), a range where a person can be detected 912 (see Figure 23), and a range where detection is not possible 913 (see Figure 23) based on the detection and measurement results at each measurement point 861 in step S207. The range where both can be detected 911 is the range where the presence of a person can be detected and vital values ​​indicating the activity level of the person can be measured. The range where a person can be detected 912 is the range where the presence of a person can be detected but vital values ​​indicating the activity level of the person cannot be measured. The range where detection is not possible 913 is the range where the presence of a person cannot be detected and vital values ​​indicating the activity level of the person cannot be measured.

[0193] <Result Confirmation Screen> The terminal device 14 displays the results obtained through the sensor installation confirmation support screen 800 and the sensor range confirmation support screen 950 as the result confirmation screen 900 shown in Figure 23.

[0194] Figure 23 shows an example of the result confirmation screen 900 according to Embodiment 2. Note that the result confirmation screen 900 is an example of support information.

[0195] The results confirmation screen 900 includes an explanation area 901 and a results display area 902.

[0196] The explanation area 901 displays an explanation of how to interpret the results displayed in the results display area 902.

[0197] The results display area 902 displays the map image 741 and the scale of the corrected area. In addition, the results display area 902 overlays the sensor image 742, which shows the position and orientation of the corrected sensor 11, onto the map image 741. This allows the user to view the results display area 902 and confirm a more accurate area scale and a more accurate position and orientation of the sensor 11.

[0198] In addition, the result display area 902 will superimpose the presence of the both-detectable range 911, the person-detectable range 912, and the undetectable range 913, as identified in step S208 above, onto the map image 741. This allows the user to view the result display area 902 and confirm the both-detectable range 911, the person-detectable range 912, and the undetectable range 913 in the monitoring area 8. Thus, the user can easily analyze how to adjust the position and orientation of the sensors 11 installed in the area to make the person-detectable range 912 or undetectable range 913 in the monitoring area 8 into the both-detectable range 911.

[0199] Furthermore, if a person-detectable range 912 or an undetectable range 913 exists, the terminal device 14 may calculate the position and orientation in which an additional sensor 11 should be installed to make both of these ranges detectable range 911. In calculating this installation position and orientation, the specifications of various sensors and information on the detection range of existing sensors can be used to enable the optimal installation of the additional sensor 11. The terminal device 14 may then overlay an additional sensor image 914, which shows the calculated position and orientation of the additional sensor 11, onto the map image 741. The additional sensor image 914 may also be interpreted as information recommending the addition of a new sensor 11. This allows the user to easily analyze, by looking at the results display area 902, where and in what orientation the additional sensor 11 should be installed to make both the person-detectable range 912 or the undetectable range 913 in the monitoring area 8 detectable range 911.

[0200] <Hardware Configuration> As described above, embodiments relating to this disclosure have been described in detail with reference to the drawings, but the functions of the biometric information detection device 12, management device 13, and terminal device 14 described above can be realized by a computer program.

[0201] Figure 24 is a diagram showing the hardware configuration of a computer that implements the functions of each device related to this disclosure using a computer program.

[0202] The computer 1000 comprises a processor 1001, memory 1002, storage 1003, input device 1004, output device 1005, communication device 1006, GPU (Graphics Processing Unit) 1007, reader device 1008, and bus 1009.

[0203] The processor 1001, memory 1002, storage 1003, input device 1004, output device 1005, communication device 1006, GPU 1007, and reader device 1008 are connected to the bus 1009 and can send and receive data bidirectionally via the bus 1009.

[0204] The processor 1001 is a device that executes the computer program stored in the memory 1002 and realizes the functional blocks described above. Examples of processors 1001 include CPUs (Central Processing Units), MPUs (Micro Processing Units), controllers, LSIs (Large Scale Integrations), ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), and FPGAs (Field-Programmable Gate Arrays).

[0205] Memory 1002 is composed of a volatile storage medium and is a device for storing computer programs and data handled by the computer 1000. However, at least a portion of memory 1002 may be composed of a non-volatile storage medium.

[0206] Storage 1003 is a device composed of a non-volatile storage medium that stores computer programs and data handled by computer 1000. Examples of storage 1003 include HDD (Hard Disk Drive) or SSD (Solid State Drive).

[0207] The input device 1004 is a device that receives data to be input to the processor 1001. Examples of the input device 1004 include a keyboard, mouse, touchpad, or microphone.

[0208] The output device 1005 is a device that outputs data generated by the processor 1001. Examples of the output device 1005 include a display or a speaker.

[0209] The communication device 1006 is a device that transmits and receives data with other devices via a communication network. The communication device 1006 may include a transmitting unit for transmitting data and a receiving unit for receiving data. The communication device 1006 may support either wired communication or wireless communication. An example of wired communication is Ethernet®. Examples of wireless communication include IEEE802.11, Wi-Fi®, Bluetooth®, LTE, 4G, and 5G.

[0210] The GPU1007 is a device that processes images at high speed. Furthermore, the GPU1007 may also be used for AI (artificial intelligence) processing (e.g., deep learning).

[0211] The reading device 1008 is a device that reads data from a recording medium such as a DVD-ROM (Digital Versatile Disk Read Only Memory) or a USB (Universal Serial Bus) memory.

[0212] The contents of this disclosure can be expressed as follows:

[0213] <a-1> The detection system (10) At least one radar-type sensor (11) installed in a designated area, A biometric information detection device (12) detects biometric information (21) of a person (1) in the area based on sensor data output from the aforementioned sensor, The system includes a terminal device (14) that generates and displays support information (for example, a sensor installation information setting screen 700, a sensor installation confirmation support screen 800, or a sensor range confirmation support screen 850, or a result confirmation screen 900) to assist in the installation of the sensor using the detected biological information. This allows the terminal device to display support information to assist in the installation of sensors within the area, using biometric information detected about people within the area. Therefore, users can view the displayed support information and appropriately install sensors within the area.

[0214] <a-2> In the detection system described in A-1, The terminal device uses the detected biometric information to correct the information indicating the location or direction of the sensor installation in the area, which was input by the user, and displays the support information including the corrected information indicating the location or direction of the sensor installation. This allows the terminal device to correct the information indicating the location or orientation of the sensor input by the user, and display more accurate information indicating the location or orientation of the sensor.

[0215] <a-3> In the detection system described in A-1 or A-2, The terminal device displays a map image (741) corresponding to the area and a walking route (811) superimposed on the map image, and instructs the person to move along the walking route. This allows a person to move along a walking route instructed by the terminal device.

[0216] <a-4> In the detection system described in A-3, The terminal device uses the biometric information detected for the person moving along the walking route to correct the information indicating the scale of the area entered by the user, and displays the support information including the corrected information indicating the scale of the area. This allows the terminal device to correct the information indicating the scale of the area entered by the user and display information indicating the area's scale with greater accuracy.

[0217] <a-5> In the detection system described in any one of items A-1 to A-4, The terminal device displays a map image corresponding to the area and measurement points superimposed on the map image, and instructs the person to position themselves at the measurement points. This allows a person to position themselves at a measurement point indicated by the terminal device.

[0218] <a-6> In the detection system described in A-5, The terminal device uses the biometric information detected for the person located at the measurement point to identify a range in which both the presence of the person and the activity status of the person can be detected by the sensor in the area and measured, and displays the support information including the range in which both detections can be detected. This allows the terminal device to make the user aware of the detection range for both devices within the area.

[0219] <a-7> In the detection system described in A-5 or A-6, The terminal device uses the biometric information detected for the person located at the measurement point to identify a person-detectable range, which is the range in the area where the presence of the person can be detected by the sensor but where the activity status of the person cannot be measured, and displays the support information including the person-detectable range. This allows the terminal device to make the user aware of the area within which people can be detected.

[0220] <a-8> In the detection system described in any one of items A-5 to A-7, The terminal device uses the biometric information detected for the person located at the measurement point to identify an undetectable range, which is an area in which the sensor in the area cannot measure the person's activity status, and displays the support information including the undetectable range. This allows the terminal device to make the user aware of the undetectable areas within the area.

[0221] <a-9> In the detection system described in A-8, The terminal device displays the support information, which includes information recommending the addition of a new sensor based on the undetectable range. This allows the terminal device to recommend to the user the addition of new sensors to eliminate the undetectable range.

[0222] <a-10> The detection method is, Based on sensor data output from at least one radar-type sensor (11) installed in a predetermined area, the biometric information (21) of a person (1) in the area is detected. Using the detected biometric information, support information for assisting the installation of the sensor (for example, a sensor installation information setting screen 700, a sensor installation confirmation support screen 800, or a sensor range confirmation support screen 850, or a result confirmation screen 900) is generated and displayed. By performing the above detection method, biometric information detected about people within the area can be used to display support information on a terminal device, for example, to assist in the installation of sensors within the area. Therefore, users can view the displayed support information and appropriately install sensors in the area.

[0223] <a-11> The detection program is Based on sensor data output from at least one radar-type sensor (11) installed in a predetermined area, the biometric information (21) of a person (1) in the area is detected. Using the detected biometric information, support information (for example, a sensor installation information setting screen 700, a sensor installation confirmation support screen 800, or a sensor range confirmation support screen 850, or a result confirmation screen 900) is generated and displayed to assist in the installation of the sensor. Have the computer perform the task. This allows the computer running the detection program to use the detected biometric information of people within the area to display support information to assist in the placement of sensors within the area. Therefore, users can view the displayed support information and appropriately place sensors in the area.

[0224] While embodiments have been described above with reference to the attached drawings, this disclosure is not limited to such examples. It is clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims, and these are also understood to fall within the technical scope of this disclosure. Furthermore, the components of the embodiments described above can be combined in any way without departing from the spirit of the invention. [Industrial applicability]

[0225] The technology disclosed herein is useful for systems, methods, and programs that detect the biological state of a person using radar-based sensors. [Explanation of Symbols]

[0226] 1 person 8. Surveillance Area 10 Detection Systems 11 sensors 12. Biological Information Detection Device 13 Management device 14 Terminal devices 20 Sensor data 21 Biometric Information 22. Biological status information 23. Biological condition assessment information 24 Display setting information 50A, 50B selection screen 100A, 100B Biological Condition Assessment Information Setting Screen 101 Vital Value Threshold Setting Area 102 Threshold setting area for the time-dependent change in vital values 103 Threshold setting range for respiratory depth 104 Measurement number of people setting area 105 Confidence threshold setting area 106 Monitoring Area Setting Area 107 Excitation threshold setting range 120 threshold bar 200A, 200B Display Settings Information Settings Screen 300A, 300B Biological Condition Correction Settings Information Settings Screen 400A, 400B monitoring screen 401 Map Area 402 Posture area 403 Location Area 404 Action area 500, 501, 502, 503, 504, 511, 512, 513, 514, 515, 516 icons 700 Sensor installation information settings screen 710 Map setting area 711 Map image input area 712 Horizontal input area 713 Vertical input area 720 Sensor installation setting area 721 Sensor number input area 722 Sensor installation information input area 730 Monitoring Area Setting Area 740 map display area 741 Map Images 742 Sensor Images 743 Range Image 800 Sensor Installation Confirmation Support Screen 801 Sensor Installation Confirmation Button 802 Sensor range confirmation button 803 Walking Start Button 804 Walking End Button 810 Walking route display area 811 Walking Route 850 Sensor Range Confirmation Support Screen 851 Start Measurement Button 852 Measurement End Button 860 Measurement point display area 861 measurement points 900 Result Confirmation Screen 901 Explanatory Area 902 Results display area 911 Both detectable range 912 Person detection range 913 Undetectable range 914 Additional sensor images

Claims

1. A radar-type sensor installed in a designated area, A biometric information detection device that detects the biometric information of a person within a predetermined area based on sensor data output from the aforementioned sensor, The system includes a terminal device that allows the user to input a map image showing the predetermined area, the area of ​​the monitoring area set within the predetermined area, and installation information of the sensor temporarily installed in the predetermined area, via a sensor setting screen. The terminal device further generates and displays, after the temporary installation of the sensor, a first screen that assists in correcting the initial sensor installation information entered by the user to the sensor installation information corresponding to the monitoring area, using the biometric information detected when the person moves along a walking route generated within the predetermined area, and a second screen that assists in confirming the sensor range in which the biometric information can be detected, based on the acquired biometric information, after positioning the person at multiple measurement points in the monitoring area. Detection system.

2. The terminal device corrects the information indicating the position or direction of the sensor installation in the monitoring area, which is input by the user, through operation from the first screen. The detection system according to claim 1.

3. The terminal device displays the walking route superimposed on the map image on the first screen and instructs the person to move along the walking route. The detection system according to claim 1 or 2.

4. The terminal device uses the biometric information detected for the person moving along the walking route to correct the information indicating the scale of the monitoring area entered by the user, and displays the corrected information indicating the scale of the area. The detection system according to claim 3.

5. The terminal device displays the measurement points superimposed on the map image on the second screen and instructs the person to position themselves at the measurement points. The detection system according to any one of claims 1 to 4.

6. The terminal device uses the biometric information detected for the person located at the measurement point to identify a range in the monitoring area where the presence of the person can be detected by the sensor and the activity status of the person can be measured, and displays information including the range in which both detections are possible. The detection system according to claim 5.

7. The terminal device uses the biometric information detected for the person located at the measurement point to identify a person-detectable range, which is the range in the monitoring area where the presence of the person can be detected by the sensor but where the activity status of the person cannot be measured, and displays information including the person-detectable range. The detection system according to claim 5 or 6.

8. The terminal device uses the biometric information detected for the person located at the measurement point to identify an undetectable range, which is an area in the monitoring area where the sensor cannot measure the person's activity status, and displays information including the undetectable range. The detection system according to any one of claims 5 to 7.

9. The terminal device displays and presents support information, including information recommending the addition of a new sensor based on the undetectable range. The detection system according to claim 8.

10. From the sensor settings screen, the user is prompted to input a map image showing a predetermined area, the area of ​​the monitoring area set within the predetermined area, and the installation information of at least one radar-type sensor temporarily installed within the predetermined area. After the temporary installation of the aforementioned sensors, based on the sensor data output from the sensors installed in the predetermined area, the biometric information of a person in the predetermined area is detected. The system generates and displays a first screen that assists in correcting the initial sensor installation information entered by the user to sensor installation information corresponding to the monitoring area, using the biometric information detected when the person moves along a walking route generated within the predetermined area, and a second screen that assists in confirming the sensor range in which the biometric information can be detected, based on the acquired biometric information, after positioning the person at multiple measurement points in the monitoring area. Detection method.

11. From the sensor settings screen, the user is prompted to input a map image showing a predetermined area, the area of ​​the monitoring area set within the predetermined area, and the installation information of at least one radar-type sensor temporarily installed within the predetermined area. After the temporary installation of the aforementioned sensors, based on the sensor data output from the sensors installed in the predetermined area, the biometric information of a person in the predetermined area is detected. The system generates and displays a first screen that assists in correcting the initial sensor installation information entered by the user to sensor installation information corresponding to the monitoring area, using the biometric information detected when the person moves along a walking route generated within the predetermined area, and a second screen that assists in confirming the sensor range in which the biometric information can be detected, based on the acquired biometric information, after positioning the person at multiple measurement points in the monitoring area. To have the computer perform the task. Detection program.

Images