Detection system, detection method, and detection program

Abstract

To support installation of a sensor.SOLUTION: A detection system includes: at least one radar system sensor installed in a predetermined area; a biological information detection device for detecting biological information on a person in the area on the basis of sensor data output from the sensor; and a terminal device for generating and displaying support information for supporting the installation of the sensor using the detected biological information.SELECTED DRAWING: Figure 21

Description

[Technical Field]

[0001] The present disclosure relates to a detection system, a detection method, and a detection program. [Background technology]

[0002] Conventionally, there is known a vital sensor that transmits a modulated wave in the microwave or millimeter wave band and compares the transmitted wave with a received wave reflected from an object to detect minute fluctuations in a living body's breathing, heart rate, etc. (e.g., Patent Document 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2021 / 039601 [Patent Document 2] Japanese Patent Application Publication No. 2019-152441 [Patent Document 3] Japanese Patent Application Laid-Open No. 2016-138796 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional technologies enable highly accurate object detection and acquisition of biometric information such as respiration and heart rate while maintaining privacy. However, in conventional technologies, the installation and adjustment of vital sensors as preparation before acquiring biometric information must rely on the intuition based on the worker's experience. While it is desirable to create an appropriate environment for acquiring biometric information while receiving guidance on installation and adjustment, conventional technologies do not take such demands into consideration.

[0005] An object of the present disclosure is to provide a technology that assists in the installation of sensors. [Means for solving the problem]

[0006] A detection system according to one embodiment of the present disclosure includes at least one radar-type sensor installed in a predetermined area, a biometric information detection device that detects biometric information of people within the area based on sensor data output from the sensor, and a terminal device that uses the detected biometric information to generate and display support information to assist in installing the sensor.

[0007] A detection method according to one aspect of the present disclosure detects biometric information of people within a predetermined area based on sensor data output from at least one radar-type sensor installed in the area, and uses the detected biometric information to generate and display support information to assist in installing the sensor.

[0008] A detection program according to one embodiment of the present disclosure causes a computer to detect biometric information of a person within a specified area based on sensor data output from at least one radar-type sensor installed in the area, and to generate and display support information using the detected biometric information to assist in installing the sensor.

[0009] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. [Effects of the Invention]

[0010] According to the present disclosure, a technique for assisting in the installation of sensors can be provided. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing a configuration example of a detection system according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing an example of the configuration of sensor data according to the first embodiment; [Figure 3] FIG. 1 shows an example of the configuration of biometric information according to the first embodiment. [Figure 4] 1 is a flowchart showing an example of a process for setting vitality level determination information and display setting information by the detection system according to the first embodiment. [Figure 5] 10 is a flowchart showing an example of a monitoring process of a monitoring area by the detection system according to the first embodiment. [Figure 6] FIG. 10 is a diagram showing a selection screen for the usage scene “monitoring” according to the first embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a setting screen for vitality level determination information for the usage scenario "monitoring" according to the first embodiment; [Figure 8] FIG. 10 is a diagram showing a setting screen for display setting information for the usage scene "monitoring" according to the first embodiment. [Figure 9] FIG. 10 is a diagram showing a setting screen for setting information on the vitality correction for the usage scenario "monitoring" according to the first embodiment; [Figure 10] FIG. 10 is a diagram showing an example of a monitoring screen when a person according to the first embodiment is asleep in a bedroom; [Figure 11] FIG. 10 is a diagram showing an example of a monitoring screen when a person is watching television in a living room according to the first embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a monitoring screen when a person is in an abnormal state in a bathroom according to the first embodiment. [Figure 13] FIG. 10 is a diagram showing a selection screen for the usage scenario "anomaly detection" according to the first embodiment. [Figure 14] FIG. 10 is a diagram showing an example of a setting screen for determining the vitality level for the usage scenario “abnormality detection” according to the first embodiment; [Figure 15] FIG. 10 is a diagram showing a setting screen for display setting information for the usage scenario “anomaly detection” according to the first embodiment. [Figure 16] FIG. 10 is a diagram showing a setting screen for setting information on the life degree correction for the usage scenario “abnormality detection” according to the first embodiment; [Figure 17] FIG. 10 is a diagram showing an example of a monitoring screen when two people are in an office according to the first embodiment. [Figure 18] FIG. 10 is a diagram showing an example of a monitoring screen when a person in an abnormal state is present in an office according to the first embodiment. [Figure 19]FIG. 10 is a diagram showing an example of a selection screen for a usage scenario “sensor installation support” according to the second embodiment. [Figure 20] FIG. 10 is a diagram showing an example of a setting screen for sensor installation information according to the second embodiment; [Figure 21] FIG. 10 is a diagram showing an example of a sensor installation confirmation support screen according to the second embodiment; [Figure 22] FIG. 10 is a diagram showing an example of a sensor range confirmation support screen according to the second embodiment; [Figure 23] FIG. 10 is a diagram showing an example of a result confirmation screen according to the second embodiment. [Figure 24] FIG. 1 is a diagram showing the hardware configuration of a computer that implements the functions of each device according to the present disclosure using a computer program. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0013] (Embodiment 1) <System configuration> Fig. 1 is a block diagram showing a configuration example of a detection system 10 according to embodiment 1. Fig. 2 is a diagram showing a configuration example of sensor data 20 according to embodiment 1. Fig. 3 is a diagram showing a configuration example of biological information 21 according to embodiment 1.

[0014] The detection system 10 includes a sensor 11, a biological information detection device 12, a management device 13, and a terminal device 14. The sensor 11, the biological information detection device 12, the management device 13, and the terminal device 14 may be able to transmit and receive data or information through a predetermined communication network. The communication network may be either wired or wireless.

[0015] A plurality of sensors 11 may be arranged so that the entire monitoring area 8 can be monitored.

[0016] The sensor 11 is a radar-type sensor that emits radio waves in a predetermined frequency band and receives reflected waves reflected from an object (e.g., person 1) present within the sensing range of the sensor 11. The sensor 11 compares the emitted radio waves with the received reflected waves to generate sensor data 20 shown in FIG. 2. The sensor 11 may be a millimeter-wave radar-type sensor. Examples of millimeter-wave radar types include an FMCW (Frequency Modulated Continuous Wave) type and a stepped ICW (Interrupted Continuous Wave) type.

[0017] As shown in FIG. 2, the sensor data 20 associates a timestamp with detection information and signal information.

[0018] The timestamp is information indicating the timing of obtaining the sensor data 20. Examples of the timestamp include time information or a frame number.

[0019] The detection information includes, for example, information indicating a position in three-dimensional space where a reflected wave of a predetermined intensity or greater is obtained (hereinafter referred to as a reflection point), information indicating the distance from the sensor 11 to the reflection point, and information indicating the reflection intensity at the reflection point.

[0020] The signal information includes, for example, IQ data for each receiving antenna.

[0021] In other words, the sensor data 20 is data that indicates the position, shape, and temporal changes in three-dimensional space of objects present in the sensing range, and since it does not have the resolution of video data, it is not possible to identify each individual person, and the sensor 11 makes it possible to acquire data while protecting the privacy of people.

[0022] The sensor 11 transmits the generated sensor data 20 to the management device 13 and the terminal device 14.

[0023] The biological information detection device 12 generates biological information 21 shown in FIG.

[0024] As shown in FIG. 3, the biometric information 21 includes a time stamp, detected person information, vital value information, and reliability associated with each other.

[0025] The timestamp is information indicating the timing at which the biometric information 21 was generated. An example of the timestamp is time information. The management device 13 sets the time at which the biometric information 21 was generated as the timestamp.

[0026] The detected person information is information related to the detected person 1. The detected person information includes a person ID, a person position, and a person posture. The person ID is an ID for identifying the detected person 1. The person position indicates the position in three-dimensional space in the monitoring area 8 of the person indicated by the person ID. The person posture indicates the posture of the person 1 indicated by the person ID. The biometric information detection device 12 identifies the person position and the person posture based on the detection information of the sensor data 20.

[0027] The vital value information is information about vital values ​​that indicate the activity state of the detected person 1. Examples of vital values ​​include respiratory rate, respiratory depth, heart rate, and blood pressure. The biological information detection device 12 calculates the vital values ​​(e.g., respiratory rate, respiratory depth, heart rate, blood pressure, etc.) of the detected person 1 based on the change over time in the detection information of the sensor data 20.

[0028] The reliability information is information indicating the reliability (likelihood) of the vital value information. The biological information detection device 12 calculates the reliability of the calculated vital value information based on the detection information and signal information of the sensor data 20. The reliability information can be generated based on the noise level ratio of the radar signal, which is the calculation source of the vital value information, or the result of comparing the reliability information of multiple different vital value information candidates.

[0029] The biological information detection device 12 transmits the generated biological information 21 to the management device 13 and the terminal device 14.

[0030] The management device 13 generates vitality level information 22 for each person 1 based on the vital information 21 received from the vital information detection device 12. The vitality level information 22 is information indicating the level of a vital value, which is the activity state of the person 1. At this time, the management device 13 generates the vitality level information 22 based on vitality level determination information 23. The vitality level determination information 23 includes information for determining the level from the vital value. The user can set the vitality level determination information 23 by operating the management device 13. The vitality level determination information will be described in detail later.

[0031] The management device 13 transmits the generated vitality level information 22 and vitality level determination information 23 to the terminal device 14.

[0032] The terminal device 14 estimates the behavior or state of the person 1 in the monitoring area 8 based on the biometric information 21 received from the biometric information detection device 12 and the biometric level information 22 and biometric level determination information 23 received from the management device 13, and displays the estimated behavior or state on the monitoring screen. At this time, the terminal device 14 determines the display mode of the behavior or state of the person 1 based on the display setting information 24. The display setting information 24 is information including settings for the display mode of the person's behavior or state. The user can set the display setting information 24 by operating the terminal device 14. Details of the display setting information 24 will be described later.

[0033] In this way, the detection system 10 uses the radar sensor 11 that senses a person using radio waves to detect the biological condition of the person 1. This makes it possible to detect the biological condition of the person 1 while protecting the privacy of the person 1.

[0034] <Settings process flow> FIG. 4 is a flowchart showing an example of a process for setting the liveness level determination information 23 and the display setting information 24 by the detection system 10 according to the first embodiment.

[0035] The management device 13 displays a selection screen for the usage scenario. A specific example of the selection screen will be described later. The user selects one usage scenario from the selection screen (S11).

[0036] The management device 13 reads and displays the default liveness level determination information 23 for the usage scenario selected in step S11. The user sets the displayed liveness level determination information 23 (S12). The method for setting the liveness level determination information 23 will be described in detail later.

[0037] The terminal device 14 displays the default display setting information 24 for the usage scenario selected in step S11. The user sets the displayed display setting information 24 (S13). The method for setting the display setting information 24 will be described in detail later.

[0038] The management device 13 associates the living body level determination information 23 set in step S12 with the usage scene selected in step S11 and stores the associated information in the storage 1003 (see FIG. 25). The terminal device 14 associates the display setting information 24 set in step S13 with the usage scene selected in step S11 and stores the associated information in the storage 1003 (S14).

[0039] Through the above processing, the appropriate liveness level determination information 23 and display setting information 24 are associated with each other and stored in the storage 1003 for each usage scenario.

[0040] <Monitoring process flow> FIG. 5 is a flowchart showing an example of a monitoring process of the monitoring area 8 by the detection system 10 according to the first embodiment.

[0041] The terminal device 14 displays a usage scenario selection screen, and the user selects one usage scenario from the selection screen (S21).

[0042] The management device 13 acquires the biometric degree determination information 23 associated with the usage scene selected in step S21 from the storage 1003. The terminal device 14 acquires the display setting information 24 associated with the usage scene selected in step S21 from the storage 1003 (S22). This allows the detection system 10 to perform monitoring processing using the biometric degree determination information 23 and display setting information 24 that are appropriately set for the usage scene.

[0043] The management device 13 generates the biometric degree information 22 from the biometric information 21 received from the biometric information detection device 12 using the biometric degree determination information 23 (S23). The management device 13 transmits the generated biometric degree information 22 to the terminal device 14.

[0044] The terminal device 14 identifies the position and posture of the person 1 from the biometric information 21 received from the biometric information detection device 12 (S24).

[0045] The terminal device 14 uses the display setting information 24 to estimate the behavior or state of the person from the position and posture of the person and the vitality level information 22 (S25).

[0046] The terminal device 14 displays information indicating the estimated position, behavior, or state of the person on the monitoring screen 400 (S26). Then, the detection system 10 returns the process to step S22.

[0047] By the above process, the user can intuitively monitor the position, behavior or state (for example, abnormal state related to the living body of the person 1) of the person 1 in the monitoring area 8 by looking at the monitoring screen.

[0048] <Usage scenario: Monitoring> Next, an example of a scenario in which the detection system 10 is used, namely, watching over elderly people, will be described.

[0049] FIG. 6 is a diagram showing a selection screen 50A for the usage scene "watching" according to the first embodiment.

[0050] In step S11 of Fig. 4, the management device 13 displays a selection screen for a usage scenario shown in Fig. 6. When the user selects "monitoring" as the usage scenario, the management device 13 displays a setting screen 100A for the vitality level determination information 23 for the usage scenario "monitoring", as shown below.

[0051] <Monitoring settings screen> FIG. 7 is a diagram showing an example of a setting screen 100A for setting the vitality level determination information 23 for the usage scenario "monitoring" according to the first embodiment.

[0052] As shown in Figure 7, the setting screen 100A for the vitality level determination information 23 for the usage scenario "monitoring" is composed of a vital value threshold setting area 101, a vital value time change threshold setting area 102, a breathing depth threshold setting area 103, and a measurement number setting area 104.

[0053] The user adjusts the threshold bar 120 included in the vital value threshold setting area 101 to set a threshold for determining a vital level, related to whether the vital value is high or low, from the vital value. The vital level, related to whether the vital value is high or low, is referred to as a vital value high / low level. For example, when setting three levels of the vital value high / low level, namely, "low," "normal," and "high," the user sets a threshold 1 that distinguishes between "low" and "normal" and a threshold 2 that distinguishes between "normal" and "high," as shown in FIG. 7. For example, the user may set the thresholds lower (i.e., stricter) for elderly people who are the target of monitoring. The set thresholds 1 and 2 may be displayed as numerical values. Note that the number of levels of the vital value high / low level is not limited to three, and may be two, four, or more. The names of the levels of the vital value high / low level may be changed by the user. The levels of the vital value high / low level may also be read as "vital high / low level."

[0054] The user adjusts the threshold bar 120 included in the threshold setting area 102 for the time change rate of the vital value to set a threshold for determining the vitality level related to the time change rate of the vital value from the time change rate of the vital value. The vitality level related to the time change rate of the vital value includes the degree of upward movement and the degree of downward movement. The degree of upward movement is referred to as the vital value upward change degree. The degree of downward movement is referred to as the vital value downward change degree. For example, when three levels of the vital value upward change degree are set, namely, "no change," "increase," and "rapid increase," as shown in FIG. 7, a threshold 1 is set to distinguish between "no change" and "increase," and a threshold 2 is set to distinguish between "increase" and "rapid increase." For example, the user may set the thresholds lower (i.e., stricter) for elderly people who are the target of monitoring. The set thresholds 1 and 2 may be displayed as numerical values. Note that each level of the vital value upward change degree may be interpreted as a vital value upward change level. For example, when three levels of "no change," "decline," and "sudden decline" are set as the degree of decline in vital signs, threshold 1 is set to distinguish between "no change" and "decline," and threshold 2 is set to distinguish between "decline" and "sudden decline," as shown in FIG. 7. For example, the user may set the threshold lower (i.e., stricter) for elderly people who are the target of monitoring. The set thresholds 1 and 2 may be displayed as numerical values. Note that each level of the degree of decline in vital signs may be interpreted as the level of decline in vital signs.

[0055] The user adjusts the threshold bar 120 included in the breathing depth threshold setting area 103 to set a threshold for determining the vital level related to the breathing depth of the vital value from the breathing depth of the vital value. The vital level related to the breathing depth of the vital value is referred to as the breathing depth level. For example, when setting three levels of breathing depth, namely "shallow," "normal," and "deep," the user sets a threshold 1 that distinguishes between "shallow" and "normal," and a threshold 2 that distinguishes between "normal" and "deep," as shown in FIG. 7. For example, the user may set the thresholds lower (i.e., stricter) for elderly people who are the target of monitoring. The set thresholds 1 and 2 may be displayed as numerical values. Note that each level of breathing depth level may be interpreted as a breathing depth level.

[0056] The user sets the maximum number of people to be measured in the number-of-people setting area 104. Hereinafter, the set maximum number of people will be referred to as the maximum number of people to be measured. For example, if an elderly person to be monitored lives alone in a room that is the monitoring area, the user may set it to "1 person." Typically, the reliability of the biometric information improves when the maximum number of people to be measured is reduced.

[0057] The management device 13 generates vitality degree determination information 23 including each threshold value and the maximum number of people to be measured set by the user, and stores the information in association with the usage scene "monitoring" in the storage 1003. As a result, when the usage scene "monitoring" is selected in the monitoring process shown in Fig. 5, the management device 13 can use vitality degree determination information 23 that is appropriately set for the usage scene "monitoring."

[0058] <Display setting information for monitoring> FIG. 8 is a diagram showing a setting screen 200A of the display setting information 24 for the usage scene "watching" according to the first embodiment.

[0059] As shown in FIG. 8, the setting screen 200A of the display setting information 24 for the usage scenario "watching" has items such as an action or state name, a setting name, and a setting value.

[0060] The action or state name indicates the name of the person's action or state.

[0061] The setting name indicates the name of the setting associated with the action or state name. One or more setting names are associated with one action or state name.

[0062] A setting value indicates a value associated with a setting name. One setting name is associated with one setting value. However, one setting name may be associated with multiple setting values. A set of a setting name and a setting value may be referred to as a display setting parameter.

[0063] <<Sleeping>> For example, as shown in FIG. 8, the action or state name "sleeping" is associated with the setting names "location condition," "posture condition," "living state condition," and "icon name."

[0064] The setting value of the setting name "location condition" indicates the range of a person's location for determining the person's behavior as "sleeping." This range may be determined by an X section and a Y section on the map. For example, the user sets the range of the "bedroom" on the map (floor plan of the residence) as the setting value of the setting name "location condition" associated with the behavior "sleeping."

[0065] The setting value of the setting name "posture condition" indicates the posture of a person for determining the person's behavior as "sleeping." The posture may be selected from a predetermined posture list. For example, the user selects "lying down" from the predetermined posture list as the setting value of the setting name "posture condition" to be associated with the behavior "sleeping."

[0066] The setting value of the setting name "vital level condition" indicates the vital level of a person and the correction amount of the vital level for determining the person's behavior as "sleeping." Generally, a sleeping person tends to have lower vital signs than usual because they are resting. Therefore, the user may set a correction amount that lowers the default threshold value of the vital sign level by a predetermined amount as the setting value of the setting name "vital level condition" associated with the behavior "sleeping." This reduces the possibility that the terminal device 14 will erroneously determine the vital sign level as "low" even when the vital sign is only slightly lower than usual because the person is sleeping. However, it is not necessary to associate the setting name "vital level condition" with the behavior name "sleeping."

[0067] The setting value of the setting name "icon name" indicates the file name of the icon to be used when the person's behavior is determined to be "sleeping."

[0068] For example, if the position of a person is within the range indicated by the setting value of the setting name "location condition" (for example, in a bedroom), the person's posture is "lying down" indicated by the setting value of the setting name "posture condition", and the level of the person's vital signs is "normal" corrected by the setting value of the setting name "vital level condition", the terminal device 14 determines that the person is "sleeping" and displays an icon with the file name indicated by the setting value of the setting name "icon name". Details of the display method will be described later.

[0069] <<Watching TV>> For example, as shown in FIG. 8, the action and state name "watching television" is associated with the setting names "location condition," "posture condition," "life level condition," and "icon name."

[0070] The setting value of the setting name "location condition" indicates the range of a person's location for determining that the person's behavior is "watching TV." This range may be determined by an X section and a Y section on the map. For example, the user sets the range of the "living room" on the map (floor plan of the home) as the setting value of the setting name "location condition" associated with the behavior "watching TV."

[0071] The setting value of the setting name "posture condition" indicates the posture of a person for determining that the person's behavior is "watching television." The posture may be selected from a predetermined posture list. For example, the user selects "sitting" from the predetermined posture list as the setting value of the setting name "posture condition" to be associated with the behavior "watching television."

[0072] The setting value of the setting name "life level condition" indicates the life level of a person and the correction amount of the life level for determining the person's behavior as "watching television." For example, a person watching television may be affected by the content and have higher vital signs than usual. Therefore, the user may set a correction amount that increases the default threshold for the vital signs level by a predetermined amount as the setting value of the setting name "life level condition" associated with the behavior "watching television." This reduces the possibility that the terminal device 14 will erroneously determine the vital signs level as "high" even when the person's vital signs are slightly higher than usual because they are watching television. However, it is not necessary to associate the setting name "life level condition" with the behavior name "watching television."

[0073] The setting value of the setting name "icon name" indicates the file name of the icon to be used when the person's behavior is determined to be "watching television."

[0074] For example, if the person's position is within the range indicated by the setting value of "location condition" (for example, in the living room), the person's posture is "sitting" indicated by the setting value of "posture condition", and the level of the person's vital signs is "normal" corrected by the setting value of the setting name "vital level condition", the terminal device 14 determines that the person's behavior is "watching TV" and displays an icon with the file name indicated by the setting value of "icon name". The display method will be described in detail later.

[0075] <<Abnormal condition>> For example, as shown in FIG. 8, the action or state name "abnormal state" is associated with the setting names "location condition," "posture condition," "vital level condition," "vital level increase / decrease change condition," and "icon name."

[0076] The setting value of the setting name “location condition” indicates the range of a person's position for determining that the person's state is “abnormal state.” In Fig. 8, the entire range of the monitoring area 8 is set as the range for determining the abnormal state.

[0077] The setting value of the setting name "posture condition" indicates the posture of the person for determining that the person's condition is an "abnormal state." One posture may be selected from a predetermined posture list. For example, the user selects "supine position" from the predetermined posture list as the setting value of the setting name "posture condition" to be associated with the state "abnormal state."

[0078] The setting value of the setting name “Vital Sign High / Low Level Condition” indicates the level of vital sign high / low for determining the person’s condition as an “abnormal state.” For example, the user sets “high” and “low” as the setting values ​​of the setting name “Vital Sign High / Low Level Condition” associated with the state “abnormal state.”

[0079] The setting value of the setting name “condition for degree of change in vital signs rising / falling” indicates the degree of change in vital signs rising / falling for determining the person's condition as “abnormal state.” For example, the user sets “rapid rise” and “rapid fall” as the setting values ​​of the setting name “condition for degree of change in vital signs rising / falling” associated with the state “abnormal state.”

[0080] The setting value of the setting name "icon name" indicates the file name of the icon to be used when the state of the person is determined to be "abnormal state."

[0081] For example, if a person is located in one of the monitoring areas 8 (for example, one of their residences), the person's posture is "lying down" as indicated by the setting value of "posture condition", the level of the person's vital sign is "high" or "low" as indicated by the setting value of "vital sign level condition", and the level of the person's vital sign increase or decrease is "rapid increase" or "rapid decrease" as indicated by the setting value of "vital sign increase / decrease change level condition", the terminal device 14 determines that the person's condition is "abnormal" and displays an icon with the file name indicated by the setting value of the setting name "icon name". Details of the display method will be described later.

[0082] <Vitality level correction setting information for monitoring> FIG. 9 is a diagram showing a setting screen 300A for setting information on vitality level correction for the usage scenario "monitoring" according to the first embodiment.

[0083] The terminal device 14 displays a setting screen 300A for setting the biological degree correction setting information shown in FIG. 9 in addition to the display setting information 24 described above.

[0084] The setting screen 300A for the liveness degree correction setting information has the fields of a place name and a correction amount. The place name indicates the name of a place in the monitoring area 8. If the monitoring area 8 is a residence, the place name may be, for example, a "living room," a "toilet," a "bathroom," or a "bedroom." The correction amount indicates the amount of correction to be made to the liveness degree determination information 23 when a person is located at the place indicated by the place name.

[0085] For example, as shown in the first line of the vital sign correction setting information in FIG. 9, the user may associate a setting that increases the threshold value for "high" in the vital sign level as the amount of correction with the location name "toilet." In this case, the terminal device 14 determines the vital sign level for a person located in the toilet by taking the amount of correction into consideration. This reduces the possibility of erroneously determining the vital sign level as "high" even when the person's vital sign value is only slightly higher than normal because they are using a tray.

[0086] For example, as shown in the second line of the vital sign level correction setting information in FIG. 9 , the user may associate a setting that increases the threshold value for "high" in the vital sign level as the amount of correction with the location name "bathroom." In this case, terminal device 14 determines the vital sign level for a person located in the bathroom by taking the amount of correction into consideration. This reduces the possibility that terminal device 14 will erroneously determine the vital sign level as "high" even when the person's vital sign value is slightly higher than usual because they are taking a bath.

[0087] <Monitoring screen for monitoring> FIG. 10 is a diagram showing an example of a monitoring screen 400A when a person according to the first embodiment is asleep in a bedroom.

[0088] The terminal device 14 displays a monitoring screen 400A as shown in Fig. 10. The monitoring screen 400A includes a map area 401, a posture area 402, a location area 403, and a behavior area 404.

[0089] The terminal device 14 displays in the map area 401 a floor plan of a residence in the monitoring area 8 as an example of a map.

[0090] The terminal device 14 detects the posture of the person 1 based on the biometric information 21 received from the biometric information detection device 12, and displays the detected posture name in the posture area 402.

[0091] The terminal device 14 detects the position of the person 1 based on the biometric information 21 received from the biometric information detection device 12. The terminal device 14 maps the detected position of the person on the floor plan and identifies the name of the place where the person 1 is located. The terminal device 14 displays the identified name of the place in the place area 403.

[0092] The terminal device 14 estimates the behavior of the person 1 based on the biometric information 21 received from the biometric information detection device 12, the biometric level information 22 received from the management device 13, and the display setting information 24. The terminal device 14 displays the estimated behavior name of the person 1 in the behavior area 404.

[0093] Furthermore, the terminal device 14 displays an icon 500 corresponding to the estimated behavior and an icon 501 corresponding to the level of vitality at the specified location in the map area 401. Note that the icon in this embodiment may be interpreted as graphic information.

[0094] For example, if the posture of the person 1 estimated from the biometric information 21 is “lying down”, the terminal device 14 displays “lying down” in the posture area 402.

[0095] For example, if the location of person 1 estimated from the biometric information 21 is a "bedroom," the terminal device 14 displays "bedroom" in the location area 403.

[0096] For example, when the terminal device 14 estimates from the display setting information 24 that the behavior of the person 1 is “sleeping,” it displays “sleeping” in the behavior area 404.

[0097] For example, if the terminal device 14 estimates that the behavior of person 1 is "sleeping" based on the biometric level information 22 and the display setting information 24, it displays an icon 500 for "sleeping" at the location of "bedroom" on the floor plan displayed in the map area 401.

[0098] For example, when the terminal device 14 determines based on the vital sign information 22 and the display setting information 24 that the depth of breathing of person 1 is "normal" and the level of vital signs (for example, the level of heart rate) of the person is "normal", it displays an icon 501 indicating the depth of breathing of "normal" and an icon 502 indicating the level of vital signs (heart rate) of "normal" near the icon 500.

[0099] This allows the user to intuitively see, by looking at the monitoring screen 400A, that person 1, who is the monitoring target and lives in the residence, is currently asleep in the bedroom and that his or her vital signs are normal.

[0100] FIG. 11 is a diagram showing an example of a monitoring screen 400B when a person according to the first embodiment is watching television in the living room.

[0101] For example, if the posture of the person 1 estimated from the biometric information 21 is “sitting”, the terminal device 14 displays “sitting” in the posture area 402.

[0102] For example, if the location of person 1 estimated from the biometric information 21 is the “living room,” the terminal device 14 displays “living room” in the location area 403.

[0103] For example, when the terminal device 14 estimates that the behavior of the person 1 is “watching TV” based on the vitality level information 22 and the display setting information 24, it displays “watching TV” in the behavior area 404.

[0104] For example, if the terminal device 14 estimates from the biometric information 21 that the location of person 1 is "living room" and estimates from the display setting information 24 that person 1's behavior is "watching TV", it displays the "watching TV" icon 503 at the location of "living room" on the floor plan.

[0105] For example, if the terminal device 14 determines based on the vital sign information 22 and the display setting information 24 that the depth of breathing of person 1 is "normal" and the level of vital signs (e.g., the level of heart rate) of person 1 is "normal", it displays an icon 501 indicating the level of breathing depth of "normal" and an icon 504 indicating the level of vital signs (heart rate) of "normal" near the icon 503.

[0106] This allows the user to intuitively see, by looking at the monitoring screen 400B, that person 1, who is the monitoring target and lives in the residence, is currently watching television in the living room and that his or her vital signs are normal.

[0107] FIG. 12 is a diagram showing an example of a monitoring screen 400C when a person is in an abnormal state in a bathroom according to the first embodiment.

[0108] For example, if the posture of the person 1 estimated from the biometric information 21 is “lying down”, the terminal device 14 displays “lying down” in the posture area 402.

[0109] For example, if the location of person 1 estimated from the biometric information 21 is the “bathroom,” the terminal device 14 displays “bathroom” in the location area 403.

[0110] For example, when the terminal device 14 determines that the state of person 1 is "abnormal" based on the vital status information 22 and the display setting information 24, it displays an icon 504 indicating "abnormal" vital signs in the location of "bathroom" on the floor plan. Note that although the display of person 1's activity area 404 is omitted, alert information such as "safety check" and "emergency call" may also be displayed.

[0111] This allows the user to view the monitoring screen 400C and intuitively confirm that the person being watched over, who lives in the residence, is currently experiencing an abnormality in his or her vital signs in the bathroom.

[0112] <Usage scenario: Anomaly detection> Next, an example of a scenario in which the detection system 10 is used, that is, detection of abnormalities in the living bodies of employees working in an office, will be described.

[0113] FIG. 13 is a diagram showing a selection screen 50B for the usage scenario "abnormality detection" according to the first embodiment.

[0114] In step S11 of Fig. 4, the management device 13 displays a selection screen 50B for a usage scenario shown in Fig. 13. When the user selects "abnormality detection" as the usage scenario, the management device 13 displays a setting screen 100B for the liveness level determination information 23 for the usage scenario "abnormality detection" shown next.

[0115] <Anomaly detection setting screen> FIG. 14 is a diagram showing an example of a setting screen 100B for the liveness level determination information 23 for the usage scenario "abnormality detection" according to the first embodiment.

[0116] As shown in FIG. 14, the setting screen 100B of the vital level determination information 23 for the usage scenario "abnormality detection" includes a vital value threshold setting area 101, a vital value time change threshold setting area 102, a reliability threshold setting area 105, and a measurement number setting area 104.

[0117] 7, the user sets a threshold for the degree of vital value high or low by adjusting the threshold bar 120 in the vital value threshold setting area 101. For example, the user may set the threshold high (i.e., loose) because the employee who is the target of anomaly detection is relatively healthy.

[0118] 7, the user sets the thresholds for the degree of upward and downward changes in vital signs by adjusting the threshold bar 120 in the threshold setting area 102 for the degree of change over time in vital signs. For example, the user may set the thresholds lower (i.e., stricter) because the employee who is the target of anomaly detection is relatively healthy but does not want to miss any sudden changes in vital signs.

[0119] The user adjusts the threshold bar 120 included in the reliability threshold setting area 105 to determine a threshold for determining a biometric level related to the reliability of the reliability information included in the biometric information 21. The biometric level related to the reliability is referred to as the reliability level. For example, when three levels of reliability, "low," "normal," and "high," are set, the user sets a threshold 1 that distinguishes between "low" and "normal" and a threshold 2 that distinguishes between "normal" and "high," as shown in FIG. 14. For example, in an office environment, frequent false detection of an abnormal state when there is no abnormal state can interfere with operation, so the user may set the thresholds higher (i.e., stricter). The set thresholds 1 and 2 may be displayed as numerical values. The number of reliability levels is not limited to three levels, and may be two, four, or more. Each level of reliability may also be interpreted as a trust level.

[0120] 7, the user sets the maximum number of people to be measured in the number-of-people-to-be-measured setting area 104. For example, the user may set the maximum number of people to be measured in accordance with the number of employees working in the office.

[0121] The management device 13 generates liveness degree determination information 23 including each threshold value and the maximum number of people to be measured set by the user, and stores the information in association with the usage scenario "abnormality detection" in the storage 1003. As a result, when the usage scenario "abnormality detection" is selected in the monitoring process shown in FIG. 5, the management device 13 can use the liveness degree determination information 23 that is appropriately set for "abnormality detection."

[0122] <Display setting information for anomaly detection> FIG. 15 is a diagram showing a setting screen for the display setting information 24 for the usage scenario "abnormality detection" according to the first embodiment.

[0123] As shown in FIG. 15, the setting screen of the display setting information 24 for the usage scenario "abnormality detection" has items such as an action or state name, a setting name, and a setting value, similar to FIG.

[0124] <<Work in progress>> For example, as shown in FIG. 15, the setting names "location condition," "posture condition," "living state condition," and "icon name" are associated with the action or state name "working."

[0125] The setting value of the setting name "location condition" indicates the range of a person's location for determining that the person's behavior is "at work." This range may be determined by an X section and a Y section on a map. For example, the user sets the range of "desk" on a map (e.g., an office floor plan) as the setting value of the setting name "location condition" associated with the behavior "at work."

[0126] The setting value of the setting name "posture condition" indicates the posture of a person for determining that the person's behavior is "working." The posture may be selected from a predetermined posture list. For example, the user selects "sitting" from the predetermined posture list as the setting value of the setting name "posture condition" to be associated with the behavior "working."

[0127] The setting value of the setting name "vital level condition" indicates the vital level of a person and the correction amount of the vital level for determining the person's behavior as "working." Generally, a person working tends to have lower vital signs than usual because they are concentrating. Therefore, the user may set a correction amount that lowers the default threshold for the vital sign level by a predetermined amount as the setting value of the setting name "vital level condition" associated with the behavior "working." This reduces the possibility that the management device 13 will erroneously determine the vital sign level as "low" even when the vital sign is only slightly lower than usual because the person is working. However, it is not necessary to associate the setting name "vital level condition" with the behavior name "working."

[0128] The setting value of the setting name "icon name" indicates the file name of the icon to be used when the person's behavior is determined to be "working."

[0129] If the person's position is within the range indicated by the setting value of "location condition" (for example, a desk), the person's posture is "sitting" indicated by the setting value of "posture condition", and the level of the person's vital signs is "normal" corrected by the setting value of the setting name "vital level condition", the terminal device 14 determines the person's behavior as "working" and displays an icon with the file name indicated by the setting value of the setting name "icon name". The display method will be described in detail later.

[0130] <<Abnormal condition>> For example, as shown in FIG. 15, the action or state name "abnormal state" is associated with the setting names "location condition," "posture condition," "vital level condition," "vital level increase / decrease change condition," "trust level condition," and "icon name."

[0131] The setting names "location condition," "posture condition," "vital level condition," "vital level increase / decrease change condition," and "icon name" are the same as those in FIG. 8, and therefore will not be described.

[0132] The setting value of the setting name "confidence level condition" indicates the confidence level for determining that the state of person 1 is an "abnormal state." For example, the user sets "high" as the setting value of the setting name "confidence level condition" associated with the state "abnormal state." This is because in places where many relatively healthy people work, such as offices, the likelihood of biological abnormalities occurring is lower than for elderly people, and a low confidence level could result in frequent false positives, hindering operation.

[0133] For example, if the position of person 1 is within the range indicated by the setting value of "location condition," the posture of person 1 is "supine position" indicated by the setting value of "posture condition," the level of the person's vital sign is "high" or "low" indicated by the setting value of "vital sign level condition," the level of increase or decrease of vital sign of person 1 is "rapid increase" or "rapid decrease" indicated by the setting value of "vital sign increase / decrease level condition," and the level of reliability of person 1 is "high" indicated by the setting value of "reliability level condition," the terminal device 14 determines the state of person 1 to be an "abnormal state" and displays an icon with the file name indicated by the setting value of the setting name "icon name." Details of the display method will be described later.

[0134] <Body degree correction setting information for abnormality detection> FIG. 16 is a diagram showing a setting screen for setting information on liveness degree correction for the usage scenario "abnormality detection" according to the first embodiment.

[0135] The terminal device 14 displays a setting screen 300B for setting the biometric degree correction setting information shown in FIG. 16 in addition to the display setting information 24 described above.

[0136] The setting screen 300B for the biometric correction setting information has the fields of "place name" and "correction amount." If the monitoring area 8 is an office, the place name may be, for example, "toilet," "corridor," etc.

[0137] For example, as shown in the first line of the vital sign level correction setting information in Fig. 15, the user may associate a setting that increases the threshold value for "high" in the vital sign level as the amount of correction with the place name "toilet." In this case, the terminal device 14 determines the vital sign level for person 1 located in the toilet, taking into account the amount of correction. This reduces the possibility of erroneously determining the vital sign level as "high" even when person 1's vital sign value is slightly higher than usual because he is using a tray.

[0138] For example, as shown in the second line of the vital sign level correction setting information in Fig. 16, the user may associate a setting that increases the threshold value for "high" in the vital sign level as the amount of correction with the location name "corridor." In this case, the terminal device 14 determines the vital sign level for person 1 located in the corridor by taking the amount of correction into consideration. This reduces the possibility that the terminal device 14 will erroneously determine the vital sign level as "high" even though the vital sign value is only slightly higher than normal because the person is moving through the corridor.

[0139] <Monitoring screen for detecting abnormalities> FIG. 17 is a diagram showing an example of a monitoring screen 400D according to the first embodiment, in which two people are in an office.

[0140] The terminal device 14 displays a monitoring screen 400D as shown in Fig. 17. The monitoring screen 400D includes a map area 401.

[0141] The terminal device 14 displays, in the map area 401, a floor plan of an office, which is the monitored area 8, as an example of a map.

[0142] For example, if the terminal device 14 estimates that person A's behavior is "working" from the display setting information 24, it displays an "working" icon 511 at the position of person A on the floor plan displayed in the map area 401. In addition, the terminal device 14 displays the icon 511, for example, with a solid line, so that it is clear that the reliability level is "high." In addition, the terminal device 14 displays an arrow icon (a horizontal arrow icon 512 in FIG. 17 ) near the icon 511 indicating that the degree of increase / decrease in vital signs (heart rate) is "normal."

[0143] For example, if the terminal device 14 estimates that person B's behavior is "on the move" from the display setting information 24, it displays an icon 513 indicating "on the move" at the position of person B on the floor plan displayed in the map area 401. In addition, the terminal device 14 displays the icon 513, for example, with a dashed line, so that it is clear that the reliability level is "low." In addition, the terminal device 14 displays an arrow icon (a diagonally upward arrow icon 514 in FIG. 17 ) near the icon 513 indicating that the degree of increase / decrease in vital signs (heart rate) is "rapidly increasing."

[0144] As a result, the user can intuitively see by looking at monitoring screen 400D that person A, who works in the office, is working, his vital signs are normal, and the reliability of those vital signs is high. Also, the user can intuitively see by looking at monitoring screen 400D that person B is on the move, and although his vital signs are changing rapidly, the reliability of those vital signs is low.

[0145] FIG. 18 is a diagram showing an example of a monitoring screen 400E when a person in an abnormal state is present in the office according to the first embodiment.

[0146] For example, if the terminal device 14 estimates that the condition of person C is "abnormal" from the display setting information 24, it displays an icon 515 indicating "abnormal" at the position of the person on the floor plan displayed in the map area 401. In addition, the terminal device 14 displays the icon 515, for example, with a solid line, so that it is clear that the reliability level is "high." In addition, the terminal device 14 displays an icon 516 indicating that the vital signs are "abnormal" near the icon 515.

[0147] This allows the user to intuitively confirm by looking at the monitoring screen 400E that person C working in the office has developed an abnormality in his or her vital signs and that the reliability of the vital signs is high. In this case, the terminal device 14 may output an alert (for example, a text message or a voice message related to safety confirmation) indicating that person 1 has developed an abnormality in his or her vital signs.

[0148] (Embodiment 2) In the second embodiment, a detection system will be described that supports the installation of sensors in a predetermined area such as a room or an office, as described in the first embodiment. In the second embodiment, the same reference numerals will be used for components that have already been described in the first embodiment, and the description thereof may be omitted.

[0149] <Usage scenario: Sensor installation support> Next, sensor installation support, which is an example of a usage scenario of the detection system 10, will be described.

[0150] FIG. 19 is a diagram showing an example of a selection screen 50C for the usage scene "sensor installation support" according to the second embodiment.

[0151] A user (for example, a worker installing the sensor 11) first temporarily installs the sensor 11 in a predetermined area where the user wants to set up the monitoring area 8. Then, when the user selects the usage scenario "sensor installation support" on the selection screen 50C displayed by the terminal device 14, the terminal device 14 displays the sensor installation information setting screen 700 shown below.

[0152] <Sensor installation information setting screen> 20 is a diagram showing an example of a setting screen 700 for sensor installation information according to Embodiment 2. The setting screen 700 for sensor installation information is an example of support information for supporting the installation of the sensors 11 in an area.

[0153] The sensor installation information setting screen 700 includes a map setting area 710 , a sensor installation setting area 720 , a monitoring area setting area 730 , and a map display area 740 .

[0154] The map setting area 710 includes a map image input area 711 , a landscape input area 712 , and a portrait input area 713 .

[0155] In the map image input area 711, the user inputs a file of a map image (for example, an image of a room floor plan) 741 showing a predetermined area where the sensor 11 is installed.

[0156] In the horizontal input area 712, the user inputs the horizontal length of the area shown in the map image 741. In the vertical input area 713, the user inputs the vertical length of the area shown in the map image 741. Hereinafter, the scale of the area indicated by the values ​​input in the horizontal input area 712 and the vertical input area 713 will be referred to as the input scale.

[0157] The sensor installation setting area 720 includes a sensor number input area 721 and a sensor installation information input area 722 .

[0158] In the sensor number input area 721, the user inputs the number of sensors 11 temporarily installed in the area.

[0159] The sensor installation information input area 722 is where the user inputs sensor installation information. The sensor installation information includes a sensor ID that identifies the sensor 11, a value that indicates the installation position of the sensor 11, and a value that indicates the orientation of the sensor 11. The value that indicates the installation position of the sensor 11 may include a horizontal (X direction) coordinate and a vertical (Y direction) coordinate on the map image 741. The value that indicates the orientation of the sensor 11 may include an azimuth angle and a depression angle that indicate the orientation of the sensor 11. However, the sensor installation information does not necessarily need to include both a value that indicates the installation position of the sensor 11 and a value that indicates the orientation of the sensor 11; it is sufficient to include either one of them.

[0160] In the monitoring area setting region 730, the user inputs an X section, a Y section, and a Z section that indicate the XYZ space to be set as the monitoring area 8 within the area 11. The XYZ space defined by the X section, Y section, and Z section set here becomes the monitoring area 8 for monitoring, abnormality detection, etc. described in the first embodiment.

[0161] The map display area 740 displays a map image 741 input in the map image input area 711. Also, in the map display area 740, a sensor image 742 indicating the position and orientation of the sensor 11 input in the sensor installation information input area 722 is superimposed on the map image 741. This allows the user to easily check the position and orientation of the sensor 11 temporarily installed in the area by looking at the map display area 740.

[0162] In addition, in the map display area 740, the horizontal length of the area entered in the horizontal input area 712 and the vertical length of the area entered in the vertical input area 713 are displayed as numerical values ​​near the map image 741.

[0163] In addition, in the map display area 740, a range image 743 showing the range of the monitoring area 8 input in the monitoring area setting area 730 is displayed superimposed on the map image 741.

[0164] <Sensor installation confirmation support screen> There may be a discrepancy between the input scale input into the sensor installation information setting screen 700 and the actual scale of the area. Also, there may be a discrepancy between the position and orientation of the sensor 11 input into the sensor installation information setting screen 700 and the position and orientation of the sensor actually installed in the area. Therefore, as shown in FIG. 21 , the terminal device 14 displays a sensor installation confirmation support screen 800 that supports correction of these discrepancies.

[0165] 21 is a diagram showing an example of a sensor installation confirmation support screen 800 according to Embodiment 2. Note that the sensor installation confirmation support screen 800 is an example of support information.

[0166] The sensor installation confirmation support screen 800 includes a sensor installation confirmation button 801 , a sensor range confirmation button 802 , a walking route display area 810 , a start walking button 803 , and an end walking button 804 .

[0167] When the sensor installation confirmation button 801 is pressed, the terminal device 14 displays a sensor installation confirmation support screen 800 shown in Fig. 21. When the sensor range confirmation button 802 is pressed, the terminal device 14 displays a sensor range confirmation support screen 850 shown in Fig. 22, which will be described later.

[0168] The walking route display area 810 displays a map image 741 input in the map image input area 711. In addition, the walking route display area 810 displays a sensor image 742 indicating the position and orientation input in the sensor installation information input area 722 superimposed on the map image 741. In addition, the walking route display area 810 displays a walking route 811 indicating a route the user (person) is desired to walk superimposed on the map image 741. For example, the walking route 811 is displayed with an arrow as shown in FIG. 21. In FIG. 21, a dotted arrow indicates a walking route 811 that the user has not yet walked, and a solid arrow indicates a walking route 811 that the user has already walked.

[0169] The terminal device 14 controls the sensor 11 to detect the movement of a person's position within the area, thereby calculating the actual scale of the area and the actual position and orientation of the sensor 11. At this time, the terminal device 14 generates multiple walking routes 811 that enable the actual scale of the area and the actual position and orientation of the sensor to be calculated with relatively high accuracy. For example, the terminal device 14 performs image analysis on the map image 741 to estimate that black straight lines of a predetermined width are walls, and generates multiple walking routes 811 that follow the walls as closely as possible. As a result, the terminal device 14 can accurately calculate the actual scale of the area by detecting a user moving on the walking route 811 with the sensor 11 and calculating the distance traveled. In addition, the terminal device 14 can calculate the actual position and orientation of the sensor 11 by detecting a user moving on the walking route 811 with the sensor 11 and identifying the user's position within the detectable range of the sensor 11. Note that the generation of the multiple walking routes 811 is not limited to this method. For example, the walking route 811 may be generated manually by the user's operation to specify the starting point and the ending point of the walk, taking into consideration the arrangement of furniture and luggage in the room.

[0170] Next, a description will be given of the user's work of moving along the walking route 811 and the processing of the terminal device 14 at that time. For example, the user and the terminal device 14 perform the work and processing of steps S101 to S108 (not shown) shown below.

[0171] (S101) While looking at the walking route display area 810 displayed on the terminal device 14, the user moves to the starting point of the walking route 811 indicated by the dotted arrow and presses the start walking button 803. When the start walking button 803 is pressed, the terminal device 14 controls the sensor 11 to start detecting the biometric information 21 of the user.

[0172] (S102) The user moves along the walking route 811 indicated by the dotted arrow. At this time, the sensor 11 measures the position, speed, vital values, etc. of the user as they move, and generates biometric information 21.

[0173] (S103) The user moves to the end point of the walking route 811 indicated by the dotted arrow, and presses the walking end button 804. When the walking end button 804 is pressed, the terminal device 14 controls the sensor 11 to end detection.

[0174] (S104) The terminal device 14 changes the walking route 811 indicated by the dotted arrows for which detection has been completed to a walking route 811 indicated by the solid arrows.

[0175] (S105) The user and the terminal device 14 perform the operations and processes from step S101 to step S104 described above for the other walking routes 811 indicated by dotted arrows.

[0176] (S107) After all the walking routes 811 with dotted arrows have been changed to walking routes 811 with solid arrows, the terminal device 14 calculates the actual scale of the area and the actual position and orientation of the sensor 11 based on the biometric information 21 acquired from the biometric information detection device 12.

[0177] (S108) The terminal device 14 corrects the deviation of the input scale based on the calculated actual scale of the area. The terminal device 14 also corrects the deviation of the position and orientation of the sensor 11 input in the sensor installation information input area 722 based on the calculated actual position and orientation of the sensor 11. The terminal device 14 stores the corrected scale of the area and the position and orientation of the sensor 11 in the storage 1003 (see FIG. 24).

[0178] Through the above processing, the terminal device 14 can set a more accurate area scale and a more accurate position and orientation of the sensor 11.

[0179] <Sensor range confirmation support screen> If there is a range in the monitoring area 8 where sensing of a person is not possible, it is not possible to reliably perform the monitoring or abnormality detection described in the first embodiment. Therefore, as shown in Fig. 22, the terminal device 14 displays a sensor range confirmation support screen 850 that supports confirmation of the range in which sensing of a person is possible and / or the range in which sensing of a person is not possible.

[0180] 22 is a diagram showing an example of a sensor range check support screen 850 according to Embodiment 2. The sensor range check support screen 850 is an example of support information.

[0181] The sensor range confirmation support screen 850 includes a sensor installation confirmation button 801 , a sensor range confirmation button 802 , a measurement point display area 860 , a measurement start button 851 , and a measurement end button 852 .

[0182] When the sensor installation confirmation button 801 is pressed, the terminal device 14 displays the sensor installation confirmation support screen 800 shown in Fig. 21. When the sensor range confirmation button 802 is pressed, the terminal device 14 displays the sensor range confirmation support screen 850 shown in Fig. 22.

[0183] The measurement point display area 860 displays the map image 741 input in the map image input area 711. In addition, the measurement point display area 860 displays a sensor image 742 indicating the position and orientation of the sensor 11 corrected through the sensor installation confirmation support screen 800, superimposed on the map image 741. In addition, the measurement point display area 860 displays a measurement point 861 indicating the point where the user is desired to be located, superimposed on the map image 741. For example, the measurement point 861 is displayed as a circle, as shown in FIG. 22. In FIG. 22, a dotted circle indicates a measurement point 861 at which the user has not yet measured, and a solid circle indicates a measurement point 861 at which the user has already measured.

[0184] For example, the terminal device 14 analyzes a map image 741 of a floor plan and disperses multiple measurement points 861 within the monitoring area 8. For example, the terminal device 14 estimates that black straight lines of a predetermined width on the map image 741 are walls, and disposes measurement points 861 near the center and corners of a room surrounded by the walls. This allows the terminal device 14 to measure the user located at the measurement point 861 with the sensor 11, thereby determining whether or not a range of a predetermined size centered on the measurement point 861 is a sensing range. Note that the generation of multiple measurement points 861 is not limited to this method. For example, the measurement points 861 may be manually generated by a user's operation to indicate a location where the user will be staying, taking into account the arrangement of furniture and luggage in the room.

[0185] Next, a description will be given of the operation of the user moving to the measurement point 861 and the processing of the terminal device 14 at that time. For example, the user and the terminal device 14 perform the operation and processing of steps S201 to S208 shown below.

[0186] (S201) While viewing the measurement point display area 860 displayed on the terminal device 14, the user moves to the measurement point 861 marked with a dotted circle and presses the measurement start button 851. When the measurement start button 851 is pressed, the terminal device 14 displays the desired respiratory rate, posture, and orientation of the user at the measurement point 861, as well as the desired time to remain still at the measurement point 861 (hereinafter referred to as the resting time). Then, the terminal device 14 controls the sensor 11 to start measuring the user's vital values ​​and the like.

[0187] (S203) The user remains stationary at the measurement point 861 for the displayed resting time with the displayed respiratory rate, posture, and orientation. The sensor 11 measures the vital values ​​of the user who remains stationary at the measurement point 861 at any time, and generates the biological information 21.

[0188] (S204) After the displayed rest time has elapsed, the user presses measurement end button 852. When measurement end button 852 is pressed, terminal device 14 controls sensor 11 to end the measurement.

[0189] (S205) The terminal device 14 changes the measurement point 861 marked with a dotted circle where the measurement was performed to a measurement point 861 marked with a solid circle.

[0190] (S206) The user and the terminal device 14 perform the operations and processes from step S201 to step S205 described above for the other dotted circle items.

[0191] (S207) After all the dotted circles are changed to solid circles, the terminal device 14 identifies measurement points 861 where the user was detected and measurement points 861 where the user was not detected, based on the biometric information 21 acquired from the biometric information detection device 12. Furthermore, the terminal device 14 identifies measurement points 861 where the vital values ​​were measured and measurement points 861 where the vital values ​​were not measured, based on the biometric information 21 acquired from the biometric information detection device 12.

[0192] (S208) Based on the results of detection and measurement at each measurement point 861 in step S207, the terminal device 14 identifies a both-detectable range 911 (see FIG. 23), a person-detectable range 912 (see FIG. 23), and an undetectable range 913 (see FIG. 23). The both-detectable range 911 is a range in which the presence of a person can be detected and a vital value indicating the activity state of the person can be measured. The person-detectable range 912 is a range in which the presence of a person can be detected but a vital value indicating the activity state of the person cannot be measured. The undetectable range 913 is a range in which the presence of a person cannot be detected and a vital value indicating the activity state of the person cannot be measured.

[0193] <Result confirmation screen> The terminal device 14 displays the results obtained through the sensor installation confirmation support screen 800 and the sensor range confirmation support screen 950 described above as a result confirmation screen 900 shown in FIG.

[0194] 23 is a diagram showing an example of a result confirmation screen 900 according to Embodiment 2. The result confirmation screen 900 is an example of support information.

[0195] The result confirmation screen 900 includes an explanation area 901 and a result display area 902 .

[0196] The explanation area 901 displays an explanation of how to interpret the results displayed in the result display area 902.

[0197] The map image 741 and the scale of the area after the correction are displayed in the result display area 902. In addition, the result display area 902 displays a sensor image 742 indicating the position and orientation of the sensor 11 after the correction, superimposed on the map image 741. This allows the user to view the result display area 902 and confirm a more accurate scale of the area and a more accurate position and orientation of the sensor 11.

[0198] Additionally, in the result display area 902, if the both-detectable range 911, the person-detectable range 912, and the undetectable range 913 identified in the above-described step S208 exist, they are superimposed on the map image 741. This allows the user to check the both-detectable range 911, the person-detectable range 912, and the undetectable range 913 in the monitored area 8 by looking at the result display area 902. Therefore, the user can easily analyze how to adjust the position and orientation of the sensor 11 installed in the area so that the person-detectable range 912 or the undetectable range 913 in the monitored area 8 becomes the both-detectable range 911.

[0199] Furthermore, when a person detectable range 912 or an undetectable range 913 exists, the terminal device 14 may calculate the position and orientation of the additional sensor 11 to convert both of these ranges into the detectable range 911. Note that when calculating the installation position and orientation, the terminal device 14 may use information such as the specifications of various sensors and information on the detection ranges of existing sensors to enable the optimal installation of the additional sensor 11. Then, the terminal device 14 may superimpose an additional sensor image 914 indicating the calculated position and orientation of the additional sensor 11 on the map image 741. The additional sensor image 914 may be interpreted as information recommending the addition of a new sensor 11. This allows the user to easily analyze, by viewing the result display area 902, the position and orientation of the additional sensor 11 that can convert both the person detectable range 912 or the undetectable range 913 in the monitored area 8 into the detectable range 911.

[0200] <Hardware configuration> The embodiments of the present disclosure have been described in detail above with reference to the drawings, but the functions of the biometric information detection device 12, management device 13, and terminal device 14 described above can be realized by a computer program.

[0201] FIG. 24 is a diagram showing the hardware configuration of a computer that implements the functions of each device according to the present disclosure using a computer program.

[0202] The computer 1000 includes a processor 1001, a memory 1002, a storage 1003, an input device 1004, an output device 1005, a communication device 1006, a GPU (Graphics Processing Unit) 1007, a reading device 1008, and a bus 1009.

[0203] The processor 1001, memory 1002, storage 1003, input device 1004, output device 1005, communication device 1006, GPU 1007, and reading device 1008 are connected to a bus 1009, and can send and receive data bidirectionally via the bus 1009.

[0204] The processor 1001 is a device that executes a computer program stored in the memory 1002 and realizes the above-mentioned functional blocks. Examples of the processor 1001 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a controller, an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field-Programmable Gate Array).

[0205] The memory 1002 is configured as a volatile storage medium and is a device for storing computer programs and data used by the computer 1000. However, at least a part of the memory 1002 may be configured as a non-volatile storage medium.

[0206] The storage 1003 is configured as a nonvolatile storage medium, and is a device that stores computer programs and data handled by the computer 1000. Examples of the storage 1003 include a hard disk drive (HDD) and a solid state drive (SSD).

[0207] The input device 1004 is a device that accepts data to be input to the processor 1001. Examples of the input device 1004 include a keyboard, a mouse, a touchpad, and a microphone.

[0208] The output device 1005 is a device that outputs data generated by the processor 1001. Examples of the output device 1005 include a display and a speaker.

[0209] The communication device 1006 is a device that transmits and receives data to and from other devices via a communication network. The communication device 1006 may include a transmitter that transmits data and a receiver that receives data. The communication device 1006 may support either wired communication or wireless communication. An example of wired communication is Ethernet (registered trademark). Examples of wireless communication are IEEE802.11, Wi-Fi (registered trademark), Bluetooth (registered trademark), LTE, 4G, and 5G.

[0210] The GPU 1007 is a device that performs high-speed image rendering processing. The GPU 1007 may be used for AI (artificial intelligence) processing (e.g., deep learning).

[0211] The reading device 1008 is a device that reads data from a recording medium such as a DVD-ROM (Digital Versatile Disk Read Only Memory) or a USB (Universal Serial Bus) memory.

[0212] The contents of the present disclosure can be expressed as follows.

[0213] <a-1> The detection system (10) comprises: At least one radar-type sensor (11) installed in a predetermined area; a biometric information detection device (12) that detects biometric information (21) of a person (1) within the area based on sensor data output from the sensor; and a terminal device (14) that uses the detected biometric information to generate and display support information (e.g., a sensor installation information setting screen 700, a sensor installation confirmation support screen 800, a sensor range confirmation support screen 850, or a result confirmation screen 900) to support the installation of the sensor. This allows the terminal device to display support information for assisting in the installation of sensors in the area using the biometric information detected for people in the area, allowing the user to view the displayed support information and appropriately install sensors in the area.

[0214] <a-2> In the detection system according to A-1, The terminal device uses the detected biometric information to correct information input by the user indicating the location or direction of the sensor installation in the area, and displays the support information including the corrected information indicating the location or direction of the sensor installation. This allows the terminal device to correct the information indicating the installation position or direction of the sensor input by the user, and display information indicating the installation position or direction of the sensor with higher accuracy.

[0215] <a-3> In the detection system according to A-1 or A-2, The terminal device displays a map image (741) corresponding to the area and a walking route (811) superimposed on the map image, and instructs the person to move along the walking route. This allows the person to move along the walking route instructed from the terminal device.

[0216] <a-4> A detection system according to A-3, The terminal device corrects the information indicating the scale of the area entered by the user using the biometric information detected about the person moving along the walking route, and displays the support information including the information indicating the corrected scale of the area. This allows the terminal device to correct the information indicating the area scale input by the user and display information indicating the area scale with higher accuracy.

[0217] <a-5> A detection system according to any one of A-1 to A-4, The terminal device displays a map image corresponding to the area and a measurement point superimposed on the map image, and instructs the person to position themselves at the measurement point. This allows the person to position themselves at the measurement point instructed by the terminal device.

[0218] <a-6> In the detection system described in A-5, The terminal device uses the biometric information detected about the person located at the measurement point to identify a dual detectable range, which is the range in which the presence of the person can be detected by the sensor in the area and the person's activity status can be measured, and displays the support information including the dual detectable range. This allows the terminal device to make the user aware of the dual-detection range in the area.

[0219] <a-7> In the detection system according to A-5 or A-6, The terminal device uses the biometric information detected about the person located at the measurement point to identify a person detectable range, which is the range in which the presence of the person can be detected by the sensor in the area but the person's activity status cannot be measured, and displays the support information including the person detectable range. This allows the terminal device to make the user aware of the range in which people can be detected in the area.

[0220] <a-8> A detection system according to any one of A-5 to A-7, The terminal device uses the biometric information detected about the person located at the measurement point to identify an undetectable range, which is a range in which the activity status of the person cannot be measured by the sensor in the area, and displays the support information including the undetectable range. This allows the terminal device to make the user aware of the undetectable range in the area.

[0221] <a-9> In the detection system described in A-8, The terminal device displays the support information including information recommending the addition of a new sensor based on the undetectable range. This allows the terminal device to recommend to the user that a new sensor be added to eliminate the undetectable range.

[0222] <a-10> The detection method is Detecting biometric information (21) of a person (1) within a predetermined area based on sensor data output from at least one radar-type sensor (11) installed in the area; Using the detected biometric information, support information to assist in the installation of the sensor (e.g., a sensor installation information setting screen 700, a sensor installation confirmation support screen 800, a sensor range confirmation support screen 850, or a result confirmation screen 900) is generated and displayed. By performing the above detection method, it is possible to display support information for assisting in the installation of sensors in the area, for example, on a terminal device, using the detected biometric information of people in the area, so that the user can view the displayed support information and appropriately install sensors in the area.

[0223] <a-11> The detection program is Detecting biometric information (21) of a person (1) within a predetermined area based on sensor data output from at least one radar-type sensor (11) installed in the area; Using the detected biometric information, support information for supporting the installation of the sensor (for example, a sensor installation information setting screen 700, a sensor installation confirmation support screen 800, a sensor range confirmation support screen 850, or a result confirmation screen 900) is generated and displayed. Make the computer do that. This allows the computer running the detection program to display support information for assisting in the installation of sensors in the area using the detected biometric information of people in the area, allowing the user to view the displayed support information and appropriately install sensors in the area.

[0224] Although the embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, alterations, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components in the above-described embodiments may be combined in any manner without departing from the spirit of the invention. [Industrial Applicability]

[0225] The technology of the present disclosure is useful for a system, a method, a program, etc. that detects the biological state of a person using a radar-type sensor. [Explanation of symbols]

[0226] 1 person 8 Surveillance Area 10. Detection System 11 Sensors 12 Biometric information detection device 13 Management device 14 Terminal Equipment 20 Sensor Data 21 Biometric information 22 Biological degree information 23 Information on determining the degree of life 24 Display setting information 50A, 50B selection screen 100A, 100B Setting screen for biometric information 101 Vital Value Threshold Setting Area 102 Threshold setting area for the degree of change of vital values ​​over time 103 Breathing depth threshold setting area 104 Measurement number of people setting area 105 Confidence threshold setting area 106 Monitoring area setting area 107 Excitation threshold setting region 120 threshold bars 200A, 200B Display setting information setting screen 300A, 300B Biometric correction setting information setting screen 400A, 400B monitoring screen 401 Map Area 402 Posture area 403 Location Area 404 Action area 500, 501, 502, 503, 504, 511, 512, 513, 514, 515, 516 icons 700 Sensor installation information setting screen 710 Map Settings Area 711 Map Image Input Area 712 Landscape input area 713 Vertical input area 720 Sensor installation setting area 721 Sensor number input area 722 Sensor installation information input area 730 Monitoring area setting area 740 map display area 741 map images 742 sensor images 743 Range Images 800 Sensor installation confirmation support screen 801 Sensor installation confirmation button 802 Sensor range check button 803 Walking start button 804 Walking end button 810 Walking route display area 811 Walking Route 850 Sensor range confirmation support screen 851 Measurement start button 852 Measurement end button 860 Measurement point display area 861 measurement points 900 Result confirmation screen 901 Description Area 902 Results display area 911 Both detection range 912 Person detection range 913 Undetectable range 914 additional sensor images

Claims

1. At least one radar-based sensor installed in a given area; a biometric information detection device that detects biometric information of a person within the area based on sensor data output from the sensor; a terminal device that generates and displays a first screen that uses the detected biometric information to assist in correcting initial sensor installation information set by a user when the sensor was temporarily installed to the sensor installation information corresponding to the area, and a second screen that positions the person at a plurality of measurement points in the area and assists in checking a sensor range in which the biometric information can be detected based on the acquired biometric information. Detection system.

2. the terminal device corrects information indicating a position or a direction of installation of the sensor in the area input by a user through an operation on the first screen; The detection system of claim 1 .

3. the terminal device displays, on the first screen, a map image corresponding to the area and a walking route superimposed on the map image, and instructs the person to move along the walking route.

3. A detection system according to claim 1 or 2.

4. the terminal device corrects information indicating a scale of the area input by a user using the biometric information detected about the person moving along the walking route, and displays the corrected information indicating the scale of the area. The detection system of claim 3 .

5. the terminal device displays, on the second screen, a map image corresponding to the area and the measurement point superimposed on the map image, and instructs the person to position at the measurement point. A detection system according to any one of claims 1 to 4.

6. the terminal device uses the biological information detected about the person located at the measurement point to specify a both-detectable range in which the presence of the person can be detected by the sensor in the area and an activity state of the person can be measured, and displays information including the both-detectable range. The detection system of claim 5 .

7. the terminal device uses the biometric information detected about the person located at the measurement point to specify a person detectable range in which the presence of the person can be detected by the sensor in the area but the activity state of the person cannot be measured, and displays information including the person detectable range.

7. A detection system according to claim 5 or 6.

8. the terminal device uses the biological information detected about the person located at the measurement point to identify an undetectable range in which the activity state of the person cannot be measured by the sensor in the area, and displays information including the undetectable range. A detection system according to any one of claims 5 to 7.

9. the terminal device displays information recommending the addition of a new sensor based on the undetectable range. The detection system of claim 8.

10. Detecting biometric information of people within a predetermined area based on sensor data output from at least one radar-based sensor installed in the area; using the detected biometric information, a first screen is generated and displayed to assist in correcting the initial sensor installation information set by the user when the sensor was temporarily installed to the sensor installation information corresponding to the area, and a second screen is generated and displayed to assist in checking a sensor range in which the biometric information can be detected, based on the biometric information obtained by positioning the person at a plurality of measurement points in the area. Detection methods.

11. Detecting biometric information of people within a predetermined area based on sensor data output from at least one radar-based sensor installed in the area; using the detected biometric information, a first screen is generated and displayed to assist in correcting the initial sensor installation information set by the user when the sensor was temporarily installed to the sensor installation information corresponding to the area, and a second screen is generated and displayed to assist in checking a sensor range in which the biometric information can be detected, based on the biometric information obtained by positioning the person at a plurality of measurement points in the area. Make the computer do that, Detection program.

Images