Biological signal detection system and biological state determination system

The biosignal detection system enhances precision in detecting biological signals by using a microwave sensor on a patrol robot to adjust positioning and reduce external interference, enabling reliable detection and reporting of abnormal states.

JP2024167524APending Publication Date: 2024-12-04NISSHINBO MICRO DEVICES INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023083657
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-22
Publication Date
2024-12-04

AI Technical Summary

Technical Problem

Existing technologies face challenges in accurately detecting biological signals of humans or animals without contact sensors, particularly in environments where individuals are transient, and microwave sensors may not accurately detect signals due to distance and direction variations.

Method used

A biosignal detection system using a microwave sensor attached to a manipulator, such as a patrol robot, which approaches the detection position based on signal strength and image information to enhance precision, and includes an imaging sensor to aid in positioning and reduce external signal interference.

Benefits of technology

Enables high-precision detection and determination of abnormal biological states, such as cardiac arrest or apnea, even without contact sensors, by optimizing microwave beam directivity and using image information for accurate positioning.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024167524000001_ABST
    Figure 2024167524000001_ABST
Patent Text Reader

Abstract

To detect a biological signal of a human or an animal with a high degree of precision, and reliably notify a monitoring system that a human or an animal is in an abnormal state if the biological signal is determined to be in an abnormal state without depending on the position or posture of the human or the animal even when a contact type sensor that establishes a link with a monitoring system is not mounted on the human or the animal, and even when a microwave sensor is applied.SOLUTION: A biological signal detection system includes: a microwave sensor 1 for detecting a biological signal of a human or an animal B; an imaging sensor 2 for acquiring image information on the human or the animal B; and a manipulator 3 for causing the microwave sensor 1 to approach the detection position of the biological signal on the basis of signal intensity of the biological signal in a three-dimensional scan of the human or the animal B, or on the basis of a generation position of the biological signal in the image information on the human or the animal B.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a technique for detecting biological signals (such as heart rate or respiration) of humans or animals. [Background technology]

[0002] A technology for detecting a biological signal (heartbeat, breathing, etc.) of a human or animal and determining whether the biological signal is in an abnormal state (cardiac arrest, apnea, etc.) is disclosed in Patent Document 1 and the like. In the known technology, a contact sensor is attached to a human or animal, the biological signal of the human or animal is detected, and when it is determined that the biological signal is in an abnormal state, the fact that the human or animal is in an abnormal state is notified to a monitoring system in the building. In Patent Document 1, a microwave sensor is installed inside a building, the biological signal of the human or animal is detected, and when it is determined that the biological signal is in an abnormal state, the fact that the human or animal is in an abnormal state is notified to a monitoring system in the building. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-170033 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in known techniques, in buildings where an unspecified number of people enter and exit, contact sensors may not be attached to humans or animals, and even when contact sensors are attached to humans or animals, a link between the contact sensor and the monitoring system may not be established. Furthermore, in Patent Document 1, depending on the distance and direction between the human or animal and the microwave sensor, it may not be possible to detect the biological signals of the human or animal with high accuracy.

[0005] Therefore, in order to solve the above problems, the present disclosure aims to detect the bio-signals of a human or animal with high accuracy, regardless of the position and posture of the human or animal, even when the human or animal is not equipped with a contact sensor that establishes a link with a monitoring system, or when a microwave sensor is applied, and to reliably notify the monitoring system that the human or animal is in an abnormal state when it is determined that the bio-signal is in an abnormal state. [Means for solving the problem]

[0006] In order to solve the above problems, a microwave sensor is attached to a manipulator such as a patrol robot, and the microwave sensor is brought close to a detection position for a biological signal of a human or animal.

[0007] Specifically, the present disclosure is a biosignal detection system comprising a microwave sensor for detecting biosignals of a human or animal, and a manipulator for bringing the microwave sensor close to a detection position of the biosignal.

[0008] With this configuration, even when a contact sensor that establishes a link with the monitoring system is not attached to a human or animal, or when a microwave sensor is applied, it is possible to detect the biological signals of a human or animal with high accuracy, regardless of the position and posture of the human or animal.

[0009] The present disclosure also relates to a biosignal detection system, characterized in that the manipulator brings the microwave sensor closer to a detection position of the biosignal based on the signal strength of the biosignal in a three-dimensional scan of a human or animal.

[0010] According to this configuration, positions where the signal strength of a biological signal is high in a three-dimensional scan of a human or animal can be searched for, and the biological signal of a human or animal can be detected with high accuracy.

[0011] The present disclosure also relates to a biosignal detection system, further comprising an imaging sensor for acquiring image information of a human or animal, wherein the manipulator brings the microwave sensor closer to a detection position of the biosignal based on a generation position of the biosignal in the image information of the human or animal.

[0012] According to this configuration, it is possible to search for the generation position (chest, abdomen, etc.) of a biosignal in image information of a human or animal, and to detect the biosignal of a human or animal with high accuracy.

[0013] The present disclosure also relates to a biosignal detection system, characterized in that the microwave sensor improves the directionality of the microwave beam so as to reduce the influence of external signals other than the biosignal, and the manipulator controls the direction of the microwave beam so as to optimize the signal strength of the biosignal.

[0014] According to this configuration, it is possible to reduce the influence of external signals, search for a direction in which the signal strength of the biosignal is high, and detect the biosignal of a human or animal with high accuracy.

[0015] The present disclosure also provides a biological condition determination system, characterized by including an abnormal condition determination unit that uses the biological signal detection system described above to determine whether the biological signal is in an abnormal state.

[0016] According to this configuration, even when a contact sensor that establishes a link with a monitoring system is not attached to a human or animal, or when a microwave sensor is applied, it is possible to determine whether the biological signal is in an abnormal state using only the biological information of the microwave sensor (without using image information from an imaging sensor), regardless of the position and posture of the human or animal.

[0017] The present disclosure also relates to a biological condition determination system, which is characterized by including an abnormal condition determination unit that determines whether the biological signal is in an abnormal state even though the image information can be determined to be an image of a prone human or animal using the biological signal detection system described above.

[0018] According to this configuration, even when a contact sensor that establishes a link with a monitoring system is not attached to a human or animal, or when a microwave sensor is applied, it is possible to compare the biometric information of the microwave sensor with the image information of the imaging sensor to determine whether the biometric signal is in an abnormal state, regardless of the position and posture of the human or animal.

[0019] The present disclosure also relates to a biological condition determination system, further comprising an abnormal condition reporting unit that reports to a monitoring system that the human or animal from which the biological signal was detected is in an abnormal condition when it is determined that the biological signal is in an abnormal state.

[0020] With this configuration, even when a contact sensor that establishes a link with the monitoring system is not attached to a human or animal, or when a microwave sensor is applied, when it is determined that the biological signal is in an abnormal state, the fact that the human or animal is in an abnormal state can be reliably reported to the monitoring system, regardless of the position and posture of the human or animal.

[0021] The above disclosed inventions can be combined to the greatest extent possible. Effect of the Invention

[0022] In this way, the present disclosure can detect the biological signals of a human or animal with high accuracy, regardless of the position and posture of the human or animal, even when the human or animal is not equipped with a contact sensor that establishes a link with the monitoring system, or when a microwave sensor is applied, and when it is determined that the biological signals are in an abnormal state, can reliably notify the monitoring system that the human or animal is in an abnormal state. [Brief description of the drawings]

[0023] [Figure 1] 1 is a diagram showing a schematic configuration of a patrol monitoring system according to the present disclosure. [Diagram 2] FIG. 2 is a diagram showing a detailed configuration of the patrol monitoring system of the present disclosure. [Diagram 3] FIG. 2 is a diagram showing a detailed configuration of the patrol monitoring system of the present disclosure. [Figure 4] FIG. 1 is a diagram showing a procedure of a biological signal detection process according to the present disclosure. [Diagram 5] FIG. 11 is a diagram showing a specific example of a biological signal detection process according to the present disclosure. [Figure 6] FIG. 11 is a diagram showing a specific example of a biological signal detection process according to the present disclosure. [Figure 7] FIG. 11 is a diagram showing a specific example of a biological signal detection process according to the present disclosure. [Figure 8] FIG. 11 is a diagram showing a procedure of a biological condition determining process according to the present disclosure. [Figure 9] FIG. 11 is a diagram showing a specific example of a biological condition determining process according to the present disclosure. [Figure 10] FIG. 11 is a diagram showing a specific example of a biological condition determining process according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present disclosure will be described with reference to the accompanying drawings. The embodiments described below are examples of the present disclosure, and the present disclosure is not limited to the following embodiments.

[0025] (Configuration of the Patrol Monitoring System of the Present Disclosure) A schematic configuration of the patrol monitoring system of the present disclosure is shown in Fig. 1. The patrol monitoring system includes a patrol robot R, a cloud server C, and a monitoring system M. The patrol robot R includes a microwave sensor 1, an image sensor 2, and a manipulator 3.

[0026] In this disclosure, unlike Patent Document 1, a microwave sensor is not installed inside a building, but instead a microwave sensor 1 is attached to a manipulator 3 of a patrol robot R, and the microwave sensor 1 is brought close to a detection position (chest, abdomen, etc.) of a human or animal B's biological signals (heart rate, breathing, etc.).

[0027] The microwave sensor 1 is a patch antenna, a horn antenna, a radio wave lens, or the like, and detects a biosignal of a human or animal B even through the clothing of the human or animal B.

[0028] The image sensor 2 is a camera, a thermography or an infrared sensor, etc., and acquires image information of the human or animal B in order to compare it with the biological signal of the human or animal B.

[0029] The manipulator 3 is an arm of a patrol robot R or the like, and based on the biosignal or image information of a human or animal B, moves the microwave sensor 1 close to a detection position of the biosignal.

[0030] A detailed configuration of the patrol monitoring system of the present disclosure is shown in Fig. 2. The patrol robot R is equipped with a biological signal detection system D and a biological condition determination system J. The biological signal detection system D is equipped with a microwave sensor 1, an image sensor 2, and a manipulator 3. The biological condition determination system J is equipped with an abnormal condition determination unit 4 and an abnormal condition reporting unit 5.

[0031] In Figure 2, a patrol robot R detects the vital signs of a human or animal B, determines whether the vital signs are in an abnormal state (such as cardiac arrest or apnea), and then reports to a monitoring system M via a cloud server C that the human or animal B is in an abnormal state.

[0032] A detailed configuration of the patrol monitoring system of the present disclosure is also shown in Fig. 3. The patrol robot R is equipped with a biological signal detection system D. The biological signal detection system D is equipped with a microwave sensor 1, an image sensor 2, and a manipulator 3. The cloud server C is equipped with a biological condition determination system J. The biological condition determination system J is equipped with an abnormal condition determination unit 4 and an abnormal condition reporting unit 5.

[0033] In Figure 3, a patrol robot R detects the biological signals of a human or animal B, and a cloud server C determines whether the biological signals are in an abnormal state (such as cardiac arrest or apnea), and then reports to a monitoring system M that the human or animal B is in an abnormal state.

[0034] In the following, a detailed description will be given of the procedure of the biological signal detection process of the present disclosure and the procedure of the biological condition determination process of the present disclosure, which are common to the patrol monitoring systems of FIG. 2 and FIG.

[0035] (Procedure of Biological Signal Detection Processing of the Present Disclosure) The procedure of the biological signal detection process of the present disclosure is shown in Fig. 4. Specific examples of the biological signal detection process of the present disclosure are shown in Figs. 5 to 7. In Figs. 4 to 7, the procedure of the process of the biological signal detection system D will be described.

[0036] When the microwave sensor 1 detects a biosignal of a human or animal B (step S4), the imaging sensor 2 acquires image information of the human or animal B, and then the manipulator 3 brings the microwave sensor 1 close to the detection position of the biosignal (step S1 or S2).

[0037] In Figure 5, the manipulator 3 moves the microwave sensor 1 close to a detection position for the biosignal based on the signal strength of the biosignal in a three-dimensional scan of the human or animal B (step S1), and the microwave sensor 1 detects the biosignal of the human or animal B (step S4).

[0038] 5, the manipulator 3 causes the microwave sensor 1 to perform further stereoscopic scanning based on low signal strength of the biosignal in a scan of the head, etc. of the human or animal B. In the right column of Fig. 5, the manipulator 3 causes the microwave sensor 1 to approach the chest, abdomen, etc. based on high signal strength of the biosignal in a scan of the chest, abdomen, etc. of the human or animal B, and the microwave sensor 1 detects the biosignal of the human or animal B.

[0039] In Figure 6, the manipulator 3 moves the microwave sensor 1 close to the detection position of the bio-signal based on the generation position of the bio-signal in the image information of the human or animal B (step S2), and the microwave sensor 1 detects the bio-signal of the human or animal B (step S4).

[0040] In the left column of Fig. 6, the manipulator 3 searches for the location G (chest, abdomen, etc.) where the biosignal is generated based on the image information P of the human or animal B, using image recognition by AI or remote operation by a human. In the right column of Fig. 6, the manipulator 3 brings the microwave sensor 1 close to the chest, abdomen, etc. based on the location G (chest, abdomen, etc.) where the biosignal is generated in the image information P of the human or animal B, and the microwave sensor 1 detects the biosignal of the human or animal B.

[0041] In Figure 7, the microwave sensor 1 improves the directionality of the microwave beam so as to reduce the influence of external signals other than the biological signal (such as air conditioning or other people), the manipulator 3 controls the direction of the microwave beam so as to optimize the signal strength of the biological signal (step S3), and the microwave sensor 1 detects the biological signal of a human or animal B (step S4).

[0042] In the left column of Fig. 7, the microwave sensor 1 widens the directivity of the microwave beam for stereoscopic scanning, and is unable to reduce the influence of external signals. In the middle column of Fig. 7, the microwave sensor 1 narrows the directivity of the microwave beam after stereoscopic scanning so that the influence of external signals is reduced. In the right column of Fig. 7, the manipulator 3 rotates the direction of the microwave beam so that the signal strength of the biological signal is maximized.

[0043] Therefore, even when the human or animal B is not equipped with a contact sensor that establishes a link with the monitoring system M, and even when the microwave sensor 1 is applied, the biological signals of the human or animal B can be detected with high accuracy regardless of the position and posture of the human or animal B.

[0044] Then, by searching for a position where the signal strength of the biosignal is high in a three-dimensional scan of the human or animal B, or by searching for the position G (chest, abdomen, etc.) where the biosignal is generated in the image information P of the human or animal B, the influence of external signals can be reduced and a direction where the signal strength of the biosignal is high can be searched for, thereby detecting the biosignal of the human or animal B with high accuracy.

[0045] (Procedure of biological condition determination process of the present disclosure) The procedure of the biological condition determining process of the present disclosure is shown in Fig. 8. A specific example of the biological condition determining process of the present disclosure is shown in Figs. 9 and 10. In Figs. 8 to 10, the procedure of the process of the biological condition determining system J will be described.

[0046] 9, the abnormal condition determination unit 4 determines whether the vital sign is in an abnormal state (step S6). Then, when it is determined that the vital sign is in an abnormal state (step S6, YES), the abnormal condition notification unit 5 notifies the monitoring system M that the human or animal B from which the vital sign was detected is in an abnormal state (step S7). On the other hand, when it is determined that the vital sign is in a normal state (step S6, NO), the abnormal condition notification unit 5 does not have to notify the monitoring system M that the human or animal B from which the vital sign was detected is in a normal state.

[0047] 9, the abnormal condition determination unit 4 determines that the biological signal V is regularly indicating a heartbeat, respiration, etc., and is in a normal state (continuous heartbeat state, continuous respiration state, etc.). Then, the abnormal condition notification unit 5 does not need to notify the monitoring system M that the human or animal B from which the biological signal V was detected is in a normal state (continuous heartbeat state, continuous respiration state, etc.).

[0048] In the right column of Fig. 9, the abnormal condition determination unit 4 determines that the vital sign V shows irregular heartbeats or respirations, and is in an abnormal condition (cardiac arrest, apnea, etc.). Then, the abnormal condition notification unit 5 notifies the monitoring system M that the human or animal B from which the vital sign V was detected is in an abnormal condition (cardiac arrest, apnea, etc.). Then, the operator of the monitoring system M rushes to the room of the building where the human or animal B is located.

[0049] In Fig. 10, the abnormal condition determination unit 4 can determine that the image is an image of a human or animal B lying prone (step S5, YES) using the image information acquired by the imaging sensor 2, but still determines whether the biosignal is in an abnormal state (step S6). Then, when the image information is determined to be an image of a human or animal B lying prone (step S5, YES) and the biosignal is determined to be in an abnormal state (step S6, YES), the abnormal condition notification unit 5 notifies the monitoring system M that the human or animal B from which the biosignal has been detected is in an abnormal state (step S7). On the other hand, when the image information is determined to be an image of a human or animal B lying prone (step S5, YES) but the biosignal is determined to be in a normal state (step S6, NO), the abnormal condition notification unit 5 does not need to notify the monitoring system M that the human or animal B from which the biosignal has been detected is in a normal state.

[0050] 10, the abnormal condition determination unit 4 determines that the image information P is an image of a human or animal B lying prone, and also determines that the biological signal V at the generation position G is regularly indicating a heartbeat, breathing, or the like, and is in a normal state (continuous heartbeat state, continuous breathing state, etc.).The abnormal condition notification unit 5 then does not have to notify the monitoring system M that the human or animal B from which the biological signal V at the generation position G was detected is in a normal state (continuous heartbeat state, continuous breathing state, etc.).

[0051] In the right column of Fig. 10, the abnormal condition determination unit 4 determines that the image information P is an image of a human or animal B lying prone, but the biological signal V at the generation position G shows irregular heartbeats or breathing, and determines that the human or animal B is in an abnormal state (cardiac arrest, apnea, etc.). Then, the abnormal condition notification unit 5 notifies the monitoring system M that the human or animal B from which the biological signal V at the generation position G was detected is in an abnormal state (cardiac arrest, apnea, etc.). Then, the operator of the monitoring system M rushes to the room of the building where the human or animal B is located, etc.

[0052] Therefore, even when the human or animal B is not equipped with a contact sensor that establishes a link with the monitoring system M, or when the microwave sensor 1 is applied, the following biological condition determination process can be executed regardless of the position and posture of the human or animal B.

[0053] (1) It is possible to determine whether the bio-signal is in an abnormal state using only the bio-information from the microwave sensor 1 (without using the image information from the imaging sensor 2), (2) it is also possible to determine whether the bio-signal is in an abnormal state by comparing the bio-information from the microwave sensor 1 with the image information from the imaging sensor 2, and (3) when it is determined that the bio-signal is in an abnormal state, it is possible to reliably notify the monitoring system M that a human or animal B is in an abnormal state.

[0054] Here, in order to individually identify the human or animal B, the abnormal condition determination unit 4 may extract facial features of the human or animal B, may extract features of a biological signal of the human or animal B, or may detect a smartphone or a wireless tag of the human or animal B. However, the monitoring system M needs to register information about the human or animal B in advance. [Industrial Applicability]

[0055] The biosignal detection system and biostatus determination system disclosed herein can detect biosignals (heart rate, breathing, etc.) of humans or animals in buildings with a large number of unspecified people entering and exiting (inside a hospital, a nursing home, a train station, a commercial facility, or on a road, etc.) and determine whether the biosignals are in an abnormal state (such as cardiac arrest or apnea). [Explanation of symbols]

[0056] R: Patrol robot B: Human or animal C: Cloud server M: Surveillance system D: Biosignal detection system J: Biological condition determination system P: Image information G: Location of occurrence V: Biosignals 1: Microwave sensor 2: Image sensor 3: Manipulator 4: Abnormal state determination section 5: Abnormal condition reporting unit

Claims

1. A microwave sensor for detecting a biological signal of a human or an animal; a manipulator for moving the microwave sensor close to a detection position of the biological signal; A biological signal detection system comprising:

2. The manipulator moves the microwave sensor closer to a detection position of the biological signal based on a signal strength of the biological signal in a volumetric scan of a human or animal. The biosignal detection system according to claim 1 .

3. an imaging sensor for acquiring image information of a human or an animal; The manipulator moves the microwave sensor closer to a detection position of the biosignal based on a generation position of the biosignal in the image information of a human or an animal. The biosignal detection system according to claim 1 .

4. The microwave sensor improves the directivity of the microwave beam so as to reduce the influence of extraneous signals other than the biological signal, and the manipulator controls the directivity of the microwave beam so as to optimize the signal strength of the biological signal.

4. The biosignal detection system according to claim 1, wherein the biosignal detection system comprises:

5. Using the biosignal detection system according to claim 1, an abnormality determination unit that determines whether the biological signal is in an abnormal state; A biological condition determining system comprising:

6. Using the biosignal detection system according to claim 3, an abnormality determination unit that determines whether the biological signal is in an abnormal state even though the image information can be determined to be an image of a prone human or animal; A biological condition determining system comprising:

7. an abnormality notification unit that notifies a monitoring system when it is determined that the vital sign is in an abnormal state that the human or animal from which the vital sign is detected is in an abnormal state; The biological condition determining system according to claim 5 or 6, further comprising:

Citation Information

Patent Citations

  • Non-contact biological monitoring device, non-contact biological monitoring method and program

    JP2022170033A