Monitoring device, monitoring system, and monitoring method

Abstract

This monitoring device comprises a first transmission / reception unit for transmitting first radio waves in a first range and receiving reflected waves of the first radio waves, a first sensing processing unit for sensing the presence / absence of an object in the first range and acquiring first information relating to the object sensed in the first range, a second transmission / reception unit for transmitting second radio waves in a second range that is larger than the first range and receiving reflected waves of the second radio waves, and a second sensing processing unit for sensing the presence / absence of an object in the second range and acquiring second information relating to the object sensed in the second range, the first information including identification information with which it is possible to determine whether the object is a living thing.

Description

Monitoring device, monitoring system, and monitoring method

[0001] The present disclosure relates to a monitoring device, a monitoring system, and a monitoring method.

[0002] Patent Literature 1 discloses a non-contact vital sign monitoring system having a radar installed near a monitored subject. The non-contact vital sign monitoring system stores output signals from the radar sampled in sequence within a predetermined period, determines the status of the monitored subject based on the output signals, and determines the vital signs of the monitored subject based on the output signals in a stationary state. The non-contact vital sign monitoring system uses the radar to determine whether the monitored subject is stationary or not in order to detect and measure the subject's health condition and symptoms of illness, such as body temperature, blood pressure, heart rate, and respiratory rate.

[0003] Japanese Patent Application Publication No. 2020-99661

[0004] Recently, technologies have been disclosed that use radar to detect people (e.g., pedestrians, people receiving care, etc.) and acquire vital signs of detected people. However, surveillance radar distinguishes people from backgrounds such as buildings and trees by detecting moving objects, and has the problem of not being able to detect people when they are stationary.

[0005] The present disclosure has been devised in view of the above-described conventional circumstances, and aims to improve the accuracy of detecting living organisms by radar.

[0006] The present disclosure provides a monitoring device comprising: a first transceiver that transmits first radio waves within a first range and receives reflected waves of the first radio waves; a first detection processing unit that detects the presence or absence of an object within the first range based on the reflected waves of the first radio waves received by the first transceiver and acquires first information related to the object detected within the first range; a second transceiver that transmits second radio waves within a second range that is wider than the first range and receives reflected waves of the second radio waves; and a second detection processing unit that detects the presence or absence of an object within the second range based on the reflected waves of the second radio waves received by the second transceiver and acquires second information related to the object detected within the second range, wherein the first information includes identification information that can determine whether the object is a living organism.

[0007] The present disclosure also provides a monitoring system comprising a monitoring device and an information processing device communicatively connected to the monitoring device, wherein the monitoring device comprises: a first transmission / reception unit that transmits first radio waves within a first range and receives reflected waves of the first radio waves; a first detection processing unit that detects the presence or absence of an object within the first range based on the reflected waves of the first radio waves received by the first transmission / reception unit and acquires first information related to the object detected within the first range; a second transmission / reception unit that transmits second radio waves within a second range wider than the first range and receives reflected waves of the second radio waves; and a second detection processing unit that detects the presence or absence of an object within the second range based on the reflected waves of the second radio waves received by the second transmission / reception unit and acquires second information related to the object detected within the second range, and the first information includes identification information that can determine whether the object is a living organism.

[0008] The present disclosure also provides a monitoring method comprising: transmitting first radio waves in a first range; receiving reflected waves of the first radio waves; detecting the presence or absence of an object in the first range based on the reflected waves of the first radio waves; acquiring first information that is information about the object detected in the first range and includes identification information that can determine whether the object is a living organism; transmitting second radio waves in a second range that is wider than the first range; receiving reflected waves of the second radio waves; detecting the presence or absence of an object in the second range based on the reflected waves of the second radio waves; and acquiring second information about the object detected in the second range.

[0009] According to the present disclosure, it is possible to improve the accuracy of detecting living organisms by radar.

[0010] FIG. 1 is a block diagram showing an example of a system configuration of a detection system according to a first embodiment. FIG. 2 is a block diagram showing an example of the internal configuration of a surveillance radar device according to the first embodiment. FIG. 3 is a diagram illustrating an example of detection areas of a long-distance detection radar and a short-distance detection radar. FIG. 4 is a diagram illustrating an example of detection areas of a long-distance detection radar and a short-distance detection radar. FIG. 5 is a flowchart showing an example of an operation procedure of the surveillance radar device according to the first embodiment. FIG. 6 is a flowchart showing an example of an operation procedure of the surveillance radar device according to a first modification of the first embodiment. FIG. 7 is a flowchart showing an example of an operation procedure of the surveillance radar device according to a second modification of the first embodiment. FIG. 8 is a flowchart showing an example of an operation procedure of the surveillance radar device according to the second modification of the first embodiment. FIG. 9 is a flowchart showing an example of an operation procedure of the surveillance radar device according to a third modification of the first embodiment. FIG. 10 is a flowchart showing an example of an operation procedure of the surveillance radar device according to the third modification of the first embodiment. FIG. 11 is a diagram showing an example of a detection screen.

[0011] Hereinafter, with appropriate reference to the accompanying drawings, a detailed description will be given of embodiments that specifically disclose a monitoring device, a monitoring system, and a monitoring method according to the present disclosure. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims.

[0012] (First Embodiment) Fig. 1 is a diagram illustrating an example system configuration of a detection system 100 according to a first embodiment. As illustrated in Fig. 1, the detection system 100 includes one or more surveillance radar devices RD1, a server S1, and a network NW. The detection system 100 may also include a camera C1, a security drone DR1, and a security guard terminal TP1. Note that the camera C1, the security drone DR1, and the security guard terminal TP1 are not essential elements of the detection system 100 and may be omitted.

[0013] The detection system 100 is an example of a monitoring system that uses at least one monitoring radar device RD1 installed indoors or outdoors to detect objects (e.g., humans, animals, buildings, etc.) located within a detection area AR0 (see FIG. 4 ) of the monitoring radar device RD1. The detection system 100 analyzes vital sign information of the objects detected by the monitoring radar device RD1. The detection system 100 then generates a detection screen SC1 (an example of notification information, superimposed map information) (see FIG. 11 ) in which the position and vital sign information of the detected object (e.g., a human) are superimposed on a map (an example of map information) corresponding to the detection area AR0 of the monitoring radar device RD1. The detection system 100 then displays the detection screen generated by the monitoring radar device RD1 on a monitor MN of the server S1. The detection area AR0 corresponds to an area in which the long-range detection radar RA (see FIG. 2 ) and the short-range detection radar RB (see FIG. 2 ) can detect objects.

[0014] The surveillance radar device RD1 is connected to the server S1 and the camera C1 via a network NW so as to be able to communicate with each other via wired or wireless communication. The wireless communication is, for example, short-range wireless communication such as Bluetooth (registered trademark) or NFC (registered trademark), or communication via a wireless LAN (Local Area Network) such as Wi-Fi (registered trademark).

[0015] The surveillance radar device RD1 detects the position, moving speed, etc. of an object from within a second detection area AR2 (see FIG. 3) using the long-range detection radar RA. The surveillance radar device RD1 then acquires vital information of an object located within the first detection area AR1 (see FIG. 3) detected by the short-range detection radar RB.

[0016] The surveillance radar device RD1 generates a detection screen SC1 (see FIG. 11 ) and transmits it to the server S1. The detection screen SC1 is a map corresponding to the detection area AR0, in which the position of an object detected by the long-range detection radar RA or the position and vital information of an object detected by the short-range detection radar RB are superimposed. Note that although the number of surveillance radar devices RD1 shown in FIG. 1 is one as an example, two or more may be used.

[0017] If the surveillance radar device RD1 is connected to a camera C1 (described later) so as to be able to transmit and receive data thereto, it may acquire an image captured by the camera C1. In such a case, the surveillance radar device RD1 may generate a detection screen by superimposing the position of an object detected by the long-range detection radar RA or the position and vital information of an object detected by the short-range detection radar RB on the image captured by the camera C1.

[0018] The camera C1 is connected to the surveillance radar device RD1, the server S1, or the security guard terminal TP1 via the network NW so as to be able to communicate by wire or wirelessly. The camera C1 is, for example, a surveillance camera such as a security camera. The camera C1 captures images of at least a portion of the detection area AR0 and transmits the captured images to the surveillance radar device RD1, the server S1, or the security guard terminal TP1. Note that while the number of cameras C1 shown in FIG. 1 is one as an example, the number may be two or more.

[0019] The camera C1 may be a camera equipped with artificial intelligence (AI). If equipped with AI, the camera C1 detects an object shown in a captured image using a trained AI model and acquires the position of the object. The camera C1 also acquires detection results including vital information of the object (e.g., information such as respiratory rate, heart rate, blood pressure, respiratory interval, or heartbeat interval) transmitted from the surveillance radar device RD1. The camera C1 may generate a detection screen in which the acquired position and vital information of the object are superimposed on the captured image, and transmit the detection screen to the server S1.

[0020] The server S1 is connected via a network NW to the surveillance radar device RD1, the camera C1, the security drone DR1, or the security guard terminal TP1 so as to be able to communicate by wire or wirelessly. The server S1 is also connected to an operation unit 23 that can be operated by a user (e.g., an employee of a management company that monitors the monitored area, a security guard, a manager, etc.) and a monitor MN that can be viewed by the user so as to be able to send and receive data. When the server S1 includes the operation unit 23 and the monitor MN, it may be realized by an information processing device such as a PC (Personal Computer), a notebook PC, a tablet terminal, a smartphone, etc.

[0021] The server S1 outputs and displays on the monitor MN a detection screen SC1 (see FIG. 11 ) transmitted from the surveillance radar device RD1 or the camera C1. Furthermore, when a user performs an operation to notify a predetermined destination (e.g., a management company, a security company, an insurance company, a security guard, the security drone DR1, or the security guard terminal TP1), the server S1 notifies the predetermined destination. Based on the user's operation, the server S1 may generate a control command to direct the security drone DR1 to the location where the object was detected and to intimidate or warn the object, and transmit the control command to the security drone DR1.

[0022] The server S1 includes at least a communication unit 20, a processor 21, and a memory 22. The database DB2 may be implemented in an information processing device different from the server S1 and connected to the server S1 so as to be able to transmit and receive data therebetween.

[0023] The communication unit 20 is configured using a communication interface circuit for transmitting and receiving data to and from the surveillance radar device RD1, camera C1, security drone DR1, or security guard terminal TP1 via the network NW. The communication unit 20 outputs a detection screen SC1 transmitted from the surveillance radar device RD1 or camera C1 to the processor 21 via a wireless communication network or a wired communication network. The communication unit 20 also transmits control commands corresponding to user operations output from the processor 21 to the corresponding device (e.g., the security drone DR1, the security guard terminal TP1, etc.).

[0024] The processor 21 is an arithmetic device such as a CPU (Central Processing Unit) or an FPGA (Field Programmable Gate Array). The processor 21 performs various processes and controls in cooperation with the memory 22. Specifically, the processor 21 realizes various functions by loading and executing programs and data stored in the memory 22.

[0025] The processor 21 sends a report to a pre-set destination (for example, an email address or telephone number of a management company, security company, insurance company, or security guard terminal TP1) based on the electrical signal output from the operation unit 23. Based on the electrical signal output from the operation unit 23, the processor 21 moves the security drone DR1 to the location of the detected object and generates a control command to intimidate, warn, or otherwise address the object.

[0026] The memory 22 includes, for example, a RAM (Random Access Memory) as a work memory used when executing each process of the processor 21, and a ROM (Read Only Memory) that stores programs and data that define the operation of the processor 21. The memory 22 may include a storage device such as a solid state drive (SSD) or a hard disk drive (HDD). The RAM temporarily stores data or information generated or acquired by the processor 21. The ROM stores programs that define the operation of the processor 21. The memory 22 stores information about the destination of a report (for example, email addresses and telephone numbers of destinations such as a management company, security company, insurance company, or security guard terminal TP1), information about the security drone DR1, etc.

[0027] The database DB2 is a storage device such as an HDD or SSD. The database DB2 registers (stores) the detection area AR0, information about the surveillance radar device RD1 that monitors the detection area AR0 (e.g., serial number, ID, etc.), and information about objects that are permitted to enter the first detection area AR1 (e.g., name, face image, vital sign information, etc.) in association with each other.

[0028] The operation unit 23 is a user interface configured using, for example, a touch panel, buttons, a keyboard, etc. The operation unit 23 converts accepted user operations into electrical signals (control commands) and outputs them to the processor 21. When the operation unit 23 is a touch panel, the operation unit 23 is configured integrally with the monitor MN.

[0029] The monitor MN is a display such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display, etc. The monitor MN displays a detection screen SC1 transmitted from the surveillance radar device RD1 or the camera C1.

[0030] The security guard terminal TP1 is connected to the server S1 via the network NW so as to be able to send and receive data therebetween. The security guard terminal TP1 is used by security guards guarding the detection area AR0 monitored by the surveillance radar device RD1, building employees, etc., and may be implemented, for example, as a laptop computer, tablet terminal, smartphone, etc. The security guard terminal TP1 displays the detection screen SC1 or alarm information transmitted from the server S1. Note that while the number of security guard terminals TP1 shown in FIG. 1 is one as an example, two or more may be used.

[0031] The security drone DR1 is connected to the surveillance radar device RD1 or the server S1 via the network NW so as to be able to send and receive data therebetween. The security drone DR1 is equipped with a speaker, lighting, etc., and uses sound or light to intimidate or warn objects. The security drone DR1 flies to the location where an object is detected based on control commands sent from the surveillance radar device RD1 or the server S1. When the security drone DR1 reaches the location where an object is detected, it intimidates or warns the object. The security drone DR1 may also be equipped with a camera, capture an image of the object, and transmit the captured image (live video) to the server S1.

[0032] Next, the surveillance radar device RD1 will be described with reference to Figures 2 to 4. Figure 2 is a block diagram showing an example of the internal configuration of the surveillance radar device RD1. Figure 3 is a diagram explaining an example of the detection areas of the long-distance detection radar RA and the short-distance detection radar RB. Figure 4 is a diagram explaining an example of the detection areas of the long-distance detection radar RA and the short-distance detection radar RB.

[0033] The surveillance radar device RD1 includes a communication unit 10, a processor 11, a memory 12, a long-range detection radar RA, a short-range detection radar RB, and a database DB11. The database DB11 may be configured separately from the surveillance radar device RD1. The database DB11 is not an essential component and may be omitted.

[0034] The communication unit 10 is configured using a communication interface circuit for transmitting and receiving data between the server S1 and the camera C1 via the network NW. The communication unit 10 transmits a detection screen SC1 (see FIG. 11 ) generated by the processor 11 to the server S1 via a wireless communication network or a wired communication network. The communication unit 10 also outputs captured images transmitted from the camera C1 to the processor 11.

[0035] The processor 11 is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 12. Specifically, the processor 11 references the programs and data stored in the memory 12 and executes the programs to realize various functions of the AI ​​processing unit 13 and the like.

[0036] The processor 11 controls the long-distance detection radar RA and the short-distance detection radar RB. The processor 11 may control the long-distance detection radar RA and the short-distance detection radar RB independently. The processor 11 may cooperatively control the long-distance detection radar RA and the short-distance detection radar RB based on the detection result of the long-distance detection radar RA (an example of first information) and the detection result of the short-distance detection radar RB (an example of second information).

[0037] Furthermore, the processor 11 generates a detection screen SC1 (see FIG. 11 ) in which the detection result of the long-distance detection radar RA or the detection result of the short-distance detection radar RB is superimposed on a map, and outputs the detection screen SC1 to the communication unit 10. The communication unit 10 transmits the detection screen SC1 output from the processor 11 to the server S1.

[0038] Furthermore, when vital sign information of each of a plurality of persons is stored in the database DB11, the processor 11 performs person authentication based on the vital sign information of the person who has entered the first detection area AR1 to determine whether the person who has entered the first detection area AR1 is a person who is permitted to enter the first detection area AR1. If the processor 11 determines that the person who has entered the first detection area AR1 is not a person who is permitted to enter the first detection area AR1, the processor 11 generates a detection screen SC1 in which the position of this person is superimposed on a map and transmits the detection screen SC1 to the server S1.

[0039] The memory 12 includes, for example, a RAM as a work memory used when the processor 11 executes each process, and a ROM for storing programs and data that define the operation of the processor 11. The memory 12 may include a storage device such as an SSD or HDD. The RAM temporarily stores data or information generated or acquired by the processor 11. The ROM stores programs that define the operation of the processor 11.

[0040] The memory 12 stores map data corresponding to the detection area AR0 (i.e., the first detection area AR1 and the second detection area AR2) of the surveillance radar device RD1. The map may be two-dimensional map data or three-dimensional map data.

[0041] The first detection area AR1 is an area in which an object can be detected by the short-range detection radar RB, and the second detection area AR2 is an area in which an object can be detected by the long-range detection radar RA.

[0042] The first detection area AR1 is a horizontal distance X1 from the installation position PS0 of the surveillance radar device RD1, and is a range within which the short-range detection radar RB can transmit and receive radio waves. The second detection area AR2 is a horizontal distance X2 from the installation position PS0 of the surveillance radar device RD1, and is a range within which the long-range detection radar RA can transmit and receive radio waves. For example, the distance X1 is a horizontal distance of 10 to 20 meters from the installation position PS0 of the surveillance radar device RD1. The distance X2 is equal to or greater than the distance X1, for example, a horizontal distance of 20 to 30 meters from the installation position PS0 of the surveillance radar device RD1. In other words, the first detection area AR1 is smaller than the second detection area AR2, and is located closer to the installation position PS0 of the surveillance radar device RD1 than the second detection area AR2 (see FIG. 3 ). Furthermore, the first detection area AR1 and the second detection area AR2 may partially overlap each other.

[0043] The distances X1 and X2 are merely examples and are not intended to limit the present invention. Furthermore, the distance X2 from the installation position PS0 of the surveillance radar device RD1 to the second detection area AR2 is variable within a range where radio waves can be transmitted and received by the long-distance detection radar RA, provided that the distance X2 is equal to or greater than the distance X1 from the installation position PS0 of the surveillance radar device RD1.

[0044] The AI ​​processing unit 13 forms a neural network based on at least one trained AI model. The AI ​​processing unit 13 forms a neural network corresponding to each trained AI model stored in the training model memory 15. The AI ​​processing unit 13 uses the formed neural network to perform signal analysis processing on signals output from the long-range detection radar RA and the short-range detection radar RB. The AI ​​processing unit 13 includes an AI calculation processing unit 14 and a training model memory 15.

[0045] The AI ​​calculation processing unit 14 may use the trained AI model stored in the learning model memory 15 to perform a type determination process for a detected object based on signals output from the long-range detection radar RA or the short-range detection radar RB. Specifically, the type determination process according to this embodiment includes a process for determining whether a detected object is a living organism (an example of a first determination process or a fourth determination process), a process for determining whether an object determined to be a living organism is a human (an example of a third determination process or a sixth determination process), and the like. Furthermore, the AI ​​calculation processing unit 14 may use the trained AI model stored in the learning model memory 15 to perform a process for acquiring vital information of a detected object based on signals output from the short-range detection radar RB.

[0046] The learning model memory 15 is configured with memories such as RAM, ROM, and flash memory. The learning model memory 15 stores a trained AI model created in advance by a learning process. The AI ​​calculation processing unit 14 forms a neural network corresponding to the trained AI model stored in the learning model memory 15 and executes the desired signal analysis processing.

[0047] Specifically, the learning model memory 15 stores a trained AI model capable of determining the type of a detected object based on a signal output from the radar, and a trained AI model capable of acquiring vital information of the detected object. The learning model memory 15 may also store a trained AI model that enables the surveillance radar device RD1 to perform person authentication. Note that the trained AI model described above is merely an example and is not limited to this. The learning model memory 15 may also store other trained AI models used for other purposes.

[0048] The long-distance detection radar RA includes M (M: integer equal to or greater than 1) radar ICs (Integrated Circuits) RA1, ..., RAM (an example of a second detection processing unit). Each radar IC is connected to a transmitting antenna unit RAT1, ..., RATM and a receiving antenna unit RAR1, ..., RARM (an example of a second transceiver unit) (see FIG. 2). The transmitting antenna unit RAT1, ..., RATM and the receiving antenna unit RAR1, ..., RARM may be configured using multiple antennas. The long-distance detection radar RA detects objects (e.g., vehicles, motorcycles, etc.) within a second detection area AR2.

[0049] Specifically, the long-distance detection radar RA detects objects located within a predetermined horizontal viewing angle (e.g., 180°) centered on the installation position PS0 of the surveillance radar device RD1, and within a range surrounded by a second predetermined distance from the installation position PS0 (=0 (zero) m). The second predetermined distance is, for example, several meters to 100 meters, and is greater than the first predetermined distance at which the short-distance detection radar RB can detect an object.

[0050] The second predetermined distance may be a distance that includes a part of the first predetermined distance (see FIG. 3). In other words, the second detection area AR2 may include a part of the first detection area AR1 of the short-range detection radar RB.

[0051] Each of the M radar ICs RA1, ..., RAM emits radio waves with a wavelength of 1 to 10 mm from the corresponding transmitting antenna unit RAT1, ..., RATM under the control of the processor 11. Each of the radar ICs RA1, ..., RAM acquires reflected signals received by the receiving antenna units RAR1, ..., RARM from objects (e.g., people) present in the direction of irradiation of each antenna.

[0052] Each of the transmitting antenna units RAT1, . . . , RATM converts an analog signal output from the corresponding radar IC into a radio wave (an example of a second radio wave) and radiates the radio wave.

[0053] Each of the receiving antenna units RAR1, ..., RARM receives a reflected wave of the irradiated radio wave reflected by an object (e.g., a person, etc.) Furthermore, each of the receiving antenna units RAR1, ..., RARM converts the received reflected wave into an analog signal and outputs it to the corresponding radar IC.

[0054] Each of the M radar ICs RA1, ..., RAM executes, based on the analog signals received by each antenna, calculation processing of the distance and direction to the object, and the relative speed of the object (an example of the second determination processing and the fifth determination processing), object type determination processing, etc. Each of the M radar ICs RA1, ..., RAM outputs information calculated by the radar IC, such as the distance to the object, direction information, and relative speed information of the object, and object type information, to the processor 11.

[0055] The short-range detection radar RB includes N (N: an integer equal to or greater than 1) radar ICs RB1, ..., RBN (an example of a first detection processing unit). Each radar IC RB1, ..., RBN is connected to a transmitting antenna unit RBT1, ..., RBTN and a receiving antenna unit RBR1, ..., RBRN (an example of a first transceiver unit). The transmitting antenna unit RBT1, ..., RBTN and the receiving antenna unit RBR1, ..., RBRN may be configured using multiple antennas. The short-range detection radar RB detects objects (e.g., vehicles, motorcycles, etc.) within a first detection area AR1 near the installation position PS0 of the surveillance radar device RD1.

[0056] Specifically, the short-distance detection radar RB detects objects located within a predetermined horizontal viewing angle (e.g., 180°) centered on the installation position PS0 of the surveillance radar device RD1, and within a range surrounded by a first predetermined distance from the installation position PS0 (=0 (zero) m). The first predetermined distance here is, for example, several meters to 10 meters.

[0057] In this way, the transmitting antenna units RAT1, ..., RATM transmit radio waves over a wider range than the transmitting antenna units RBT1, ..., RBTN. Also, the receiving antenna units RAR1, ..., RARM receive radio waves over a wider range than the receiving antenna units RBR1, ..., RBRN.

[0058] The first range in this embodiment is the range over which the transmitting antenna units RBT1, ..., RBTM transmit radio waves and the receiving antenna units RBR1, ..., RBRN receive radio waves (including reflected waves of the radio waves transmitted by the transmitting antenna units RBT1, ..., RBTM). The second range in this embodiment is the range over which the transmitting antenna units RAT1, ..., RATM transmit radio waves and the receiving antenna units RAR1, ..., RARM receive radio waves (including reflected waves of the radio waves transmitted by the transmitting antenna units RAT1, ..., RATM). In other words, the first detection area AR1 is closer to the installation position PS0 of the surveillance radar device RD1 than the second detection area AR2, and has a smaller range in which objects can be detected than the second detection area AR2.

[0059] Each of the N radar ICs RB1, ..., RBN emits radio waves with a wavelength of 1 to 10 mm from the corresponding transmitting antenna unit RBT1, ..., RBTN under control of the processor 11. Each of the N radar ICs RB1, ..., RBN receives the reflected waves reflected by objects (e.g., buildings, plants, people, animals, etc.) present in the direction of irradiation of each antenna, which are received by the receiving antenna unit RBR1, ..., RBRN.

[0060] Each of the transmitting antenna units RBT1, . . . , RBTN converts an analog signal output from a corresponding radar IC into a radio wave (an example of a first radio wave) and radiates the radio wave.

[0061] Each of the receiving antenna units RBR1, ..., RBRN receives a reflected wave that is the irradiated radio wave reflected by an object. Each of the receiving antenna units RBR1, ..., RBRN further converts the received reflected wave into an analog signal and outputs it to the corresponding radar IC.

[0062] Each of the N radar ICs RB1, ..., RBN performs processes such as calculating the distance and direction to an object and the relative speed of the object, determining the type of object, and acquiring vital information of the object (e.g., information such as respiratory rate, heart rate, blood pressure, respiratory interval, or heartbeat interval) based on the analog signals received by each antenna. Each of the N radar ICs RB1, ..., RBN outputs information calculated by the radar IC, such as the distance to the object, direction information, relative speed information of the object, type information of the object, and vital information of the object, to the processor 11.

[0063] It goes without saying that the number of radar ICs included in the surveillance radar device RD1 is merely an example and is not limited to this. Furthermore, the number M of radar ICs included in the long-distance detection radar RA and the number N of radar ICs included in the short-distance detection radar RB, as well as the number of antennas connected to each radar IC, do not need to be the same and may be different.

[0064] The database DB11 is configured using a storage device such as an HDD, SSD, or NAND. The database DB11 registers (stores) information (e.g., name, facial image, vital sign information, etc.) about objects permitted to enter the first detection area AR1. For example, the database DB11 registers the name, facial image, vital sign information, etc. of a person permitted to enter the first detection area AR1 in association with an identifier that identifies the person permitted to enter the first detection area AR1.

[0065] Next, an example of the operation procedure of the surveillance radar device RD1 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the operation procedure of the surveillance radar device RD1 in embodiment 1. Note that the processing of steps St102 to St103 and steps St202 to St203 may be executed by the radar IC or by the processor 11.

[0066] First, the operation procedure executed by the long-distance detection radar RA will be described.

[0067] Each of the transmitting antenna units RAT1, ..., RATM of the long-distance detection radar RA emits radio waves with a wavelength of 1 to 10 mm (step St100), and each of the receiving antenna units RAR1, ..., RARM receives the radio waves reflected by an object (step St101).

[0068] Each of the radar ICs RA1, ..., RAM acquires reflected waves received by the receiving antenna units RAR1, ..., RARM connected to the radar IC. Each of the radar ICs RA1, ..., RAM calculates the distance to the reflection point where the radio waves are reflected by an object based on the acquired signals (step St102). Each of the radar ICs RA1, ..., RAM repeatedly emits radio waves and receives reflected waves of the radio waves at a predetermined cycle. Each of the radar ICs RA1, ..., RAM calculates the object's moving speed based on the time-series changes in the reflection point (step St102). Furthermore, each of the radar ICs RA1, ..., RAM calculates the azimuth to the reflection point based on the phase difference of the received signals between the multiple receiving antennas connected to each radar IC (step St102).

[0069] Each of the radar ICs RA1, . . . , RAM generates point cloud data indicating the coordinates of the detection points where objects are detected based on the calculated distances and directions of the reflection points (step St102).

[0070] Each of the radar ICs RA1, ..., RAM performs clustering processing on the acquired point cloud data (step St103). Each of the radar ICs RA1, ..., RAM determines the type of object based on the size of the object indicated by the clustered set of point clouds, the calculated moving speed of the point clouds, and other information (step St103).

[0071] Each of the radar ICs RA1, ..., RAM determines whether the object is a human. Each of the radar ICs RA1, ..., RAM generates an object detection result in which information such as the position (orientation, distance), moving speed, etc. of the object indicated by the set of point clouds determined to be a human among the sets of clustered point clouds is associated with each object, and outputs the result to the processor 11.

[0072] Next, an operation procedure executed by the short-range detection radar RB will be described.

[0073] Each of the transmitting antenna units RBT1, ..., RBTN of the short-distance detection radar RB emits radio waves with a wavelength of 1 to 10 mm (step St200), and each of the receiving antenna units RBR1, ..., RBRN receives the radio waves reflected by an object (step St201).

[0074] Each of the radar ICs RB1, ..., RBN acquires reflected waves received by the receiving antenna units RBR1, ..., RBRN connected to the radar IC. Each of the radar ICs RB1, ..., RBN calculates the distance to the reflection point where the radio waves are reflected by an object based on the acquired signals (step St202). Each of the radar ICs RB1, ..., RBN also repeatedly emits radio waves and receives reflected waves of the radio waves at a predetermined cycle. Each of the radar ICs RB1, ..., RBN calculates the moving speed of the object based on the time-series changes in the reflection point (step St202). Furthermore, each of the radar ICs RB1, ..., RBN calculates the azimuth to the reflection point based on the phase difference of the received signals between the multiple receiving antennas connected to the radar IC (step St202).

[0075] Each of the radar ICs RB1, . . . , RBN generates point cloud data indicating the coordinates of the detection points where objects are detected based on the calculated distances and directions of the reflection points (step St202).

[0076] Each of the radar ICs RB1, ..., RBN performs clustering processing on the acquired point cloud data (step St203). Each of the radar ICs RB1, ..., RBN determines whether the object is a living organism based on the size of the object indicated by the set of clustered point clouds, information on the calculated movement speed of the point clouds, etc. (step St203). In other words, the size of the object indicated by the set of clustered point clouds, information on the calculated movement speed of the point clouds, etc. are examples of identification information in this embodiment. The processing of step St203 is an example of a first determination process or a third determination process.

[0077] Each of the radar ICs RB1, ..., RBN determines whether an object (e.g., an object determined to be a living organism) is a human. The signals from the object determined to be a human among the clustered point clouds are analyzed, and vital information of the object (e.g., information such as respiratory rate, heart rate, blood pressure, respiratory interval, or heartbeat interval) is calculated (step St203).

[0078] The surveillance radar device RD1 can obtain the above-mentioned vital information of an object by analyzing signals from the object. Vital information corresponds to information such as respiratory rate, heart rate, blood pressure, respiratory interval, or heartbeat interval, that is, information that can be used to determine whether an object is a living organism. Therefore, the vital information is an example of identification information in this embodiment.

[0079] Furthermore, the respiratory rate, heart rate, blood pressure, respiratory interval, heartbeat interval, etc., derived from living organisms fluctuate according to a predetermined cycle or climatic conditions. In other words, vital information in which fluctuations according to a predetermined cycle or climatic conditions are observed is an example of biological information of this embodiment. Specifically, the biological information is information such as respiratory rate, heart rate, blood pressure, respiratory interval, heartbeat interval, and a respiratory rate that is not too high / too low, heart rate, blood pressure, respiratory interval, heartbeat interval, etc., and is information that varies over time.

[0080] Each of the radar ICs RB1, ..., RBN acquires information such as the position (orientation, distance), movement speed, etc. of an object indicated by a set of point clouds determined to be a human among the sets of clustered point clouds. Each of the radar ICs RB1, ..., RBN associates the information such as the position (orientation, distance), movement speed, etc. of the object with the calculated vital information for each object, generates an object detection result, and outputs it to the processor 11.

[0081] The processor 11 acquires coordinate information of point clouds corresponding to objects output from each of the radar ICs RA1, ..., RAM and coordinate information of point clouds corresponding to objects output from each of the radar ICs RB1, ..., RBN. The processor 11 uses the acquired coordinate information of the point clouds to generate a detection screen SC1 (see FIG. 11 ) by superimposing the detection points of objects detected by the two types of radar on the same map (step St300). At this time, if vital information is associated with the coordinate information of the object, the processor 11 generates a detection screen SC1 in which the detection points of the object and the vital information are superimposed on the same map. This allows the processor 11 to display the detection points (coordinate information) of the object together with the vital information of the object on the detection screen SC1. The two types of radars referred to here are the long-range detection radar RA and the short-range detection radar RB.

[0082] The processor 11 outputs the generated detection screen SC1 to the communication unit 10, and causes it to be transmitted to the server S1 (step St301).

[0083] The surveillance radar device RD1 repeatedly executes the above-described process to detect an object located within the detection area AR0. Note that the surveillance radar device RD1 may start the process of detecting the object using the short-range detection radar RB and the process of acquiring the object's vital information when the object detected by the long-range detection radar RA approaches the first detection area AR1.

[0084] The surveillance radar device RD1 may also perform person authentication based on vital information acquired by the short-range detection radar RB.

[0085] As a result, the surveillance radar device RD1 uses different radars for long-distance detection (i.e., the second detection area AR2) and short-distance detection (the first detection area AR1). In this way, the surveillance radar device RD1 can simultaneously detect objects located at long distances and detect objects located at short distances and perform vital sign sensing.

[0086] (First Modification of First Embodiment) The surveillance radar device RD1 in the first embodiment described above has been described as an example of detecting an object located at a long distance (second detection area AR2) and detecting an object located at a short distance (first detection area AR1) and performing vital sensing. An example of the surveillance radar device RD1 in the first modification of the first embodiment will be described below, in which the surveillance radar device RD1 determines whether a stationary object is a living organism.

[0087] The surveillance radar device RD1 in this modified example 1 has the same internal configuration as the surveillance radar device RD1 in embodiment 1. Hereinafter, the functions realized by each internal configuration of the surveillance radar device RD1 in this modified example 1 will be described.

[0088] The surveillance radar device RD1 according to the present modified example 1 executes a second determination process or a fifth determination process to determine whether a detected object is stationary (i.e., whether it is not moving). If the surveillance radar device RD1 determines that the detected object is not moving (i.e., stationary) as a result of the second determination process or the fifth determination process, the surveillance radar device RD1 determines whether the object determined to be not moving is a living organism. Examples of the second determination process and the fifth determination process will be described below.

[0089] Each of the radar ICs RB1, ..., RBN of the short-range detection radar RB determines whether a detected object is stationary or not. Each of the radar ICs RB1, ..., RBN analyzes signals corresponding to stationary objects among the detected objects and calculates vital information of the object.

[0090] Incidentally, when an object is moving, the wavelength of the reflected wave changes due to the Doppler effect. Whether or not the object is moving can be determined based on the change in the wavelength of the reflected wave. In other words, when an object is moving, the point cloud data includes information on the object's moving speed in the direction toward the surveillance radar device RD1. Therefore, when each of the radar ICs RB1, ..., RBN detects a change in the wavelength of the reflected wave acquired as point cloud data, it determines that the detected object is moving. Next, each of the radar ICs RB1, ..., RBN analyzes the signal corresponding to the object determined to be stationary and calculates the object's vital information.

[0091] Furthermore, for example, each of the radar ICs RB1, ..., RBN determines whether a detected object is stationary based on time-series changes in the position of point cloud data indicating the coordinates of the detection point at which the object is detected (for example, the position of the point cloud data at times t1 and t2 (t1<t2)). In such a case, each of the radar ICs RB1, ..., RBN determines that an object whose position in the point cloud data does not change over time is stationary. Each of the radar ICs RB1, ..., RBN analyzes signals corresponding to objects determined to be stationary and calculates vital information of the object.

[0092] Furthermore, for example, each of the radar ICs RB1, ..., RBN clusters the point cloud data of the detected object and determines whether the detected object is stationary based on the time series change in the area (range) of the clustered point cloud data (e.g., the position of the point cloud data at times t3 and t4 (t3<t4)). In such a case, each of the radar ICs RB1, ..., RBN determines that an object whose area (range) of the point cloud data does not change over time is stationary. Each of the radar ICs RB1, ..., RBN analyzes signals corresponding to the object determined to be stationary and calculates vital information of the object.

[0093] Each of the radar ICs RB1, ..., RBN determines whether the object is a stationary living thing (human, animal, etc.) based on the calculated vital information of the object. Each of the radar ICs RB1, ..., RBN outputs to the processor 11 information on the coordinates of the point cloud determined to be a stationary living thing and the vital information in association with each other.

[0094] The processor 11 acquires coordinate information of the point clouds determined to be stationary living organisms output from each of the radar ICs RB1, ..., RBN, and vital sign information. The processor 11 generates a detection screen SC1 (see FIG. 11 ) by superimposing the acquired positions of the stationary living organisms and vital sign information on a map. The processor 11 transmits the generated detection screen SC1 to the server S1.

[0095] Next, an example of the operation procedure of the surveillance radar device RD1 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the operation procedure of the surveillance radar device RD1 in Modification 1 of Embodiment 1. Note that the processing of steps St104 to St105 and steps St204 to St205 may be executed by the radar IC or by the processor 11.

[0096] In the description of the flowchart shown in FIG. 6, the processes in steps St100 to St101 and steps St200 to St202 are the same as those in FIG. 5, and therefore the description thereof will be omitted.

[0097] First, the operation procedure executed by the long-distance detection radar RA will be described.

[0098] Each of the radar ICs RA1, ..., RAM acquires reflected waves received by the receiving antenna units RAR1, ..., RARM connected to the radar IC. Each of the radar ICs RA1, ..., RAM calculates the distance to the reflection point where the radio waves are reflected by an object based on the acquired signals (step St104). Each of the radar ICs RA1, ..., RAM repeatedly emits radio waves and receives reflected waves of the radio waves at a predetermined cycle. Each of the radar ICs RA1, ..., RAM calculates the object's moving speed based on the time-series changes in the reflection point (step St104). Furthermore, each of the radar ICs RA1, ..., RAM calculates the azimuth to the reflection point based on the phase difference of the received signals between the multiple receiving antennas connected to each radar IC (step St104).

[0099] Each of the radar ICs RA1, . . . , RAM generates point cloud data indicating the coordinates of the detection points where objects are detected based on the calculated distances and azimuths of the reflection points (step St104).

[0100] Each of the radar ICs RA1, ..., RAM applies a background removal algorithm to remove backgrounds from the generated point cloud data. Each of the radar ICs RA1, ..., RAM removes (filters) point clouds corresponding to stationary objects (hereinafter referred to as "stationary objects") included in the point cloud data (step St104). The background removal algorithm here is specifically CFAR (Constant False Alarm Rate) or the like.

[0101] Each of the radar ICs RA1, ..., RAM performs clustering processing on the filtered point cloud data (step St105). Each of the radar ICs RA1, ..., RAM determines the type of object based on the size of the object indicated by the clustered set of point clouds, the calculated moving speed of the point clouds, and other information (step St105).

[0102] Each of the radar ICs RA1, ..., RAM determines whether the object is a person or not. Each of the radar ICs RA1, ..., RAM outputs information such as the position (orientation, distance), moving speed, etc. of the object indicated by the set of point clouds determined to be a person among the sets of clustered point clouds to the processor 11 for each object.

[0103] Next, an operation procedure executed by the short-range detection radar RB will be described.

[0104] Each of the radar ICs RB1, ..., RBN acquires reflected waves received by the receiving antenna units RBR1, ..., RBRN connected to the radar IC. Each of the radar ICs RB1, ..., RBN calculates the distance to the reflection point where the radio waves are reflected by an object based on the acquired signals (step St204). Each of the radar ICs RB1, ..., RBN also repeatedly emits radio waves and receives reflected waves of the radio waves at a predetermined cycle. Each of the radar ICs RB1, ..., RBN calculates the object's moving speed based on the time-series changes in the reflection point of the radio waves, which indicates the object's position (step St204). Each of the radar ICs RB1, ..., RBN also calculates the azimuth to the reflection point based on the phase difference of the received signals between the multiple receiving antennas connected to the radar IC (step St204).

[0105] Each of the radar ICs RB1, . . . , RBN generates point cloud data indicating the coordinates of the detection points where objects are detected based on the calculated distances and directions of the reflection points (step St204).

[0106] Each of the radar ICs RB1, ..., RBN performs clustering processing on the acquired point cloud data (step St205). Each of the radar ICs RB1, ..., RBN determines the type of object based on the size of the object indicated by the clustered set of point clouds, the calculated moving speed of the point clouds, and the like (step St205).

[0107] Furthermore, each of the radar ICs RB1, ..., RBN further determines whether an object determined to be a stationary object in the object type determination result is a living organism such as a human or an animal. Each of the radar ICs RB1, ..., RBN analyzes signals from the object determined to be a stationary object and calculates vital information (e.g., respiratory rate, heart rate, blood pressure, respiratory interval, or heartbeat interval) of the stationary object (step St205). Each of the radar ICs RB1, ..., RBN determines that the stationary object, for which the calculation result is determined to be vital information, is a living organism (e.g., a human or an animal) (step St205). The processing of step St205 is an example of a first determination processing and a fourth determination processing.

[0108] Each of the radar ICs RB1, ..., RBN generates a detection result of an organism by associating, for each organism, information such as the position (orientation, distance), movement speed, etc. of the organism indicated by a set of point clouds determined to be stationary among the sets of clustered point clouds with the calculated vital information. Each of the radar ICs RB1, ..., RBN outputs the generated detection result of the organism to the processor 11.

[0109] The processor 11 acquires coordinate information of point clouds corresponding to living organisms output from each of the radar ICs RA1, ..., RAM, and coordinate information of point clouds corresponding to living organisms and vital information output from each of the radar ICs RB1, ..., RBN. The processor 11 compares coordinates of living organisms detected in an overlapping area where the second detection area AR2 of the long-range detection radar RA and the first detection area AR1 of the short-range detection radar RB overlap (step St302). Note that if no overlapping area exists, the processor 11 may omit the process of comparing information about living organisms detected in the overlapping area.

[0110] If the processor 11 determines, as a result of the comparison, that the same organism has been detected by both the long-range detection radar RA and the short-range detection radar RB among the organisms detected in the overlapping area, the processor 11 further superimposes on the map the detection results (e.g., position, distance, etc.) of the organism detected by the long-range detection radar RA and the detection results (e.g., vital sign information, etc.) of the organism detected only by the short-range detection radar RB (step St302).The processor 11 generates a detection screen SC1 in which the detection results of the long-range detection radar RA and the detection results of the short-range detection radar RB are superimposed on the map, and transmits the detection screen SC1 to the server S1 (step St303).

[0111] The surveillance radar device RD1 may detect both stationary and moving creatures. In such a case, the surveillance radar device RD1 generates a detection screen SC1 in which the detection results of the stationary creatures and the detection results of the non-stationary objects are superimposed on a map, and transmits the detection screen SC1 to the server S1.

[0112] As described above, the surveillance radar device RD1 can determine whether a stationary object detected by the short-range detection radar RB is simply an object or a living thing such as a human or an animal. In other words, the surveillance radar device RD1 can improve the detection accuracy of stationary living things.

[0113] (Second Modification of First Embodiment) The surveillance radar device RD1 in the first embodiment described above has been described as an example in which it detects an object located at a long distance (second detection area AR2) and detects an object located at a short distance (first detection area AR1) and performs vital sensing. In a second modification of the first embodiment, the surveillance radar device RD1 determines whether the detected object is a human or an animal.

[0114] The configuration of the surveillance radar device RD1 in the second modification of the first embodiment has the same internal configuration as the surveillance radar device RD1 in the first embodiment. Hereinafter, the functions realized by each internal configuration of the surveillance radar device RD1 in the second modification of the first embodiment will be described.

[0115] The surveillance radar device RD1 determines whether the detected object is a human or an animal.

[0116] The learning model memory 15 may further store a trained AI model capable of determining whether an object is a human or an animal.

[0117] Each of the radar ICs RB1, ..., RBN determines whether the object is a human or an animal based on the size of the clustered point cloud set, analyzed vital sign information (e.g., information such as respiratory rate, heart rate, blood pressure, respiratory interval, or heartbeat interval), or radio wave reflection intensity. Each of the radar ICs RB1, ..., RBN may also receive the results of image analysis of the captured image in the camera C1 and use the results to determine whether the object is a human or an animal. These determination processes may be executed by the processor 11.

[0118] Each of the radar ICs RB1, ..., RBN outputs to the processor 11 information such as the position (orientation, distance), moving speed, etc. of the object indicated by the set of point clouds determined to be a human among the sets of clustered point clouds, as well as vital information.

[0119] The processor 11 acquires coordinate information of the point clouds determined to be humans output from each of the radar ICs RB1, ..., RBN, and vital sign information. The processor 11 generates a detection screen SC1 (see FIG. 11 ) by superimposing the acquired human positions and vital sign information on a map. The processor 11 transmits the generated detection screen SC1 to the server S1.

[0120] The memory 12 stores areas where human entry is prohibited (hereinafter referred to as "no entry areas") or lines along which human entry is prohibited (hereinafter referred to as "no entry lines"). The no entry areas AR10 (see FIG. 4) and no entry lines LN (see FIG. 4) are each set in advance by an administrator, and multiple no entry areas AR10 and multiple no entry lines LN (see FIG. 4) may be set within the detection area AR0.

[0121] The entry no-entry line LN may include information about the direction in which entry is prohibited. For example, in the example shown in Fig. 4, the entry no-entry line LN may be set to prohibit a human TG from passing through the entry no-entry line LN from the direction of the arrow. The entry no-entry area AR10 and the entry no-entry line LN may also be set to prohibit the entry of animals.

[0122] Furthermore, the database DB11 may store information about the entry-restricted area AR10 in association with information about people who are permitted to enter the entry-restricted area AR10 (for example, facial images, vital sign information, etc. of people who are permitted to enter the entry-restricted area AR10). Similarly, the database DB11 may store information about the entry-restricted line LN in association with information about people who are permitted to pass through the entry-restricted line LN (for example, facial images, vital sign information, etc. of people who are permitted to enter the entry-restricted area AR10).

[0123] When an entry-restricted area AR10 is set, the processor 11 determines whether or not a person has entered the entry-restricted area AR10 based on the position of the detected person.

[0124] When the processor 11 determines that a person has entered the entry-restricted area AR10, the processor 11 generates an alarm including position information of the person who has entered the entry-restricted area AR10 and notifying that a person has entered the entry-restricted area AR10. The processor 11 transmits the generated alarm to the server S1. The alarm may be a detection screen SC1. The processor 11 may also generate an alarm including a captured image in which at least a portion of the area capturing the person who has entered the entry-restricted area AR10 is cut out from the captured image transmitted from the camera C1.

[0125] Furthermore, when an entry no-entry line LN is set, the processor 11 acquires information on the movement line of the person (information on the movement trajectory) based on time-series changes in the position of the detected person. Based on the information on the movement line of the person, the processor 11 determines whether the detected person has passed through the entry no-entry line LN or whether the detected person has passed through the entry no-entry line LN from a predetermined direction.

[0126] When the processor 11 determines that a person has passed within the no-entry line LN, the processor 11 generates an alarm including position information of the person who passed within the no-entry line LN and notifying the detection that a person has passed within the no-entry line LN. The processor 11 transmits the generated alarm to the server S1. The alarm may be a detection screen SC1. The processor 11 may also generate an alarm including a captured image transmitted from the camera C1, in which at least a portion of the area showing the person who passed within the no-entry line LN is cropped.

[0127] If the set entry-restricted area AR10 or entry-restricted line LN is set within the first detection area AR1 that can be detected by the short-range detection radar RB, the processor 11 may determine whether a person who has entered the entry-restricted area AR10 or passed through the entry-restricted line LN is a person registered in the database DB11. The processor 11 compares the vital sign information of the person who has been detected as having entered the entry-restricted area AR10 or passed through the entry-restricted line LN with the vital sign information of each of multiple people registered in the database DB11.

[0128] The processor 11 omits the process of generating an alert when it determines that the vital information of each of the multiple people registered in the database DB11 contains vital information that is identical or similar to the vital information of the detected person. On the other hand, when it determines that the vital information of each of the multiple people registered in the database DB11 does not contain vital information that is identical or similar to the vital information of the detected person, it generates an alert and transmits it to the server S1.

[0129] Next, an example of the operation procedure of the surveillance radar device RD1 will be described with reference to Fig. 7 and Fig. 8. Fig. 7 is a flowchart showing an example of the operation procedure of the surveillance radar device RD1 in Modification 2 of Embodiment 1. Fig. 8 is a flowchart showing an example of the operation procedure of the surveillance radar device RD1 in Modification 2 of Embodiment 1. Note that the processing of steps St102 to St103 and steps St203 to St206 may be executed by the radar IC or by the processor 11.

[0130] In the description of the flowchart shown in FIG. 7, the processes of steps St100 to St103 and steps St200 to St203 are the same as those in FIG. 5, and therefore the description thereof will be omitted.

[0131] The operation procedure executed by the short-range detection radar RB will now be described.

[0132] Each of the radar ICs RB1, ..., RBN determines whether the object is a human or an animal (i.e., an animal other than a human) based on the vital sign information of the object (step St206). The processing of step St206 is an example of the third determination processing or the sixth determination processing. Note that, as described above, each of the radar ICs RB1, ..., RBN may determine whether the object is a human or an animal based on the size of the clustered point cloud, the reflection intensity of radio waves, etc.

[0133] Each of the radar ICs RB1, ..., RBN acquires the image analysis results transmitted from the camera C1. Each of the radar ICs RB1, ..., RBN may determine whether the object is a human or an animal using the image analysis results acquired from the camera C1, including the object's position and object type.

[0134] Each of the radar ICs RB1, ..., RBN generates an object (human) detection result in which information such as the position (orientation, distance), movement speed, etc. of an object determined to be a human is associated with the human's vital sign information for each person, and outputs the result to the processor 11.

[0135] The processor 11 acquires the detection results of objects (e.g., people, animals, etc.) output from the long-range detection radar RA and the detection results of objects (people) output from the short-range detection radar RB. The processor 11 generates a detection screen SC1 (see FIG. 11 ) in which the acquired detection results are superimposed on a map (step St304).

[0136] The processor 11 determines whether the entirety of the set entry-restricted area AR10 is within the first detection area AR1 detected by the short-range detection radar RB (step St305).

[0137] If, in processing step St305, the processor 11 determines that the entire area of ​​the set no-entry area AR10 is within the first detection area AR1 by the short-range detection radar RB (step St305, YES), it determines whether the object detected by the short-range detection radar RB has entered the no-entry area AR10 (step St306).

[0138] When the processor 11 determines in the processing of step St306 that the detected object has entered the entry-restricted area AR10 (YES in step St306), the processor 11 determines whether the detected object is a human (step St307). Here, the processing of step St307 may be omitted if the processing of step St206 is performed before the processing of step St307.

[0139] On the other hand, if the processor 11 determines in the processing of step St306 that the detected object has not entered the no-entry area AR10 (step St306, NO), it sends the detection screen SC1 generated in the processing of step St304 to the server S1 (step St311).

[0140] If the processor 11 determines in step St307 that the detected object is a human (YES in step St307), it generates an alarm notifying that a human has entered the entry-restricted area AR10 and transmits (issues) the alarm to the server S1 (step St308). In addition, the processor 11 transmits the detection screen SC1 generated in step St304 to the server S1 (step St311).

[0141] On the other hand, if the processor 11 determines in the processing of step St307 that the detected person is not a person (step St307, NO), the processor 11 proceeds to the processing of step St311.

[0142] Furthermore, if the processor 11 determines in the processing of step St305 that the entire area of ​​the set no-entry area AR10 is not within the first detection area AR1 by the short-range detection radar RB (step St305, NO), it determines whether an object detected by the long-range detection radar RA or the short-range detection radar RB has entered the no-entry area AR10 (step St309).

[0143] If the processor 11 determines in the processing of step St309 that the detected object has entered the entry-restricted area AR10 (YES in step St309), it generates an alarm notifying that an object has entered the entry-restricted area AR10 and transmits (issues) the alarm to the server S1 (step St308). Note that the detected object includes a person or animal whose vital information can be obtained, or a moving object such as a vehicle or a motorcycle whose vital information cannot be obtained.

[0144] On the other hand, if the processor 11 determines in the processing of step St309 that the detected object has not entered the entry-restricted area AR10 (step St309, NO), it proceeds to the processing of step St311.

[0145] As described above, when an entry no-entry area AR10 is set within the detection area AR0, the surveillance radar device RD1 can detect an object entering the entry no-entry area AR10. Similarly, when an entry no-entry line LN or the like is set, the surveillance radar device RD1 can detect an object passing through the entry no-entry line LN.

[0146] When the surveillance radar device RD1 detects an object entering the no-entry area AR10 or passing through the no-entry line LN, it generates an alarm different from the detection screen SC1 and transmits it to the server S1. This allows the administrator to intuitively understand, based on the alarm, that an object entering the no-entry area AR10 or passing through the no-entry line LN has been detected.

[0147] The entry-prohibited area AR10 or the entry-prohibited line LN may be set in the manner described in the first embodiment and the first modification of the second embodiment.

[0148] For example, the surveillance radar device RD1 in the first embodiment may execute the processes of steps St305 to St311 after the process of step St300. The surveillance radar device RD1 may omit the process of step St307. This allows the surveillance radar device RD1 to detect an object entering the no-entry area AR10 or an object passing through the no-entry line LN.

[0149] Furthermore, for example, the surveillance radar device RD1 in Modification 1 of Embodiment 1 may execute the processes of steps St305 to St311 after the process of step St302. Note that the surveillance radar device RD1 may omit the process of step St307. This allows the surveillance radar device RD1 to detect an object entering the entry-restricted area AR10 or an object passing through the entry-restricted line LN.

[0150] (Third Modification of First Embodiment) The surveillance radar device RD1 in the first embodiment described above has been described as an example of detecting an object located at a long distance (second detection area AR2) and detecting an object located at a short distance (first detection area AR1) and performing vital sign sensing. An example will be described in which the surveillance radar device RD1 in a third modification of the first embodiment determines whether a detected object is one for which an administrator should be alerted, based on an emotion index of the object using acquired vital sign information.

[0151] The configuration of the surveillance radar device RD1 in the third modification of the first embodiment has the same internal configuration as the surveillance radar device RD1 in the first embodiment. Hereinafter, the functions realized by each internal configuration of the surveillance radar device RD1 in the third modification of the first embodiment will be described.

[0152] The surveillance radar device RD1 calculates an emotion index of the person based on time-series changes in the vital sign information, and determines whether an alarm is necessary based on the calculated emotion index of the person.

[0153] The short-range detection radar RB calculates an emotion index that estimates the emotion of each object (e.g., a person detected by the short-range detection radar RB) based on time-series changes in the acquired vital information. The short-range detection radar RB evaluates an attention index for determining whether to generate an alert based on the calculated emotion index of the person.

[0154] For example, the short-range detection radar RB evaluates the attention index highly when the calculated human emotion index indicates tension, anger, or the like. The short-range detection radar RB may also evaluate the attention index based on the human emotion index and the acquired vital sign information. The short-range detection radar RB determines whether to generate an alert based on whether the evaluated attention index is equal to or greater than a threshold. When the short-range detection radar RB determines that the evaluated attention index is equal to or greater than a threshold, the short-range detection radar RB generates an alert (an example of a first notification) that includes position information of the person who has passed the no-entry line LN and notifies the processor 11 that the person detected by the short-range detection radar RB is a person requiring attention.

[0155] The above-described processes of calculating the emotion index, evaluating the attention index, and determining whether to generate an alert may each be executed by the processor 11. Below, we will explain the functions realized by the processor 11 and the learning model memory 15 when each of these processes is executed by the processor 11.

[0156] The learning model memory 15 further stores a trained AI model capable of calculating an emotional index of a person based on time-series changes in the person's vital information.

[0157] The processor 11 calculates an emotion index that estimates the emotion of each object based on time-series changes in the acquired vital information. The processor 11 evaluates an attention index for determining whether to generate an alert based on the calculated human emotion index.

[0158] The processor 11 determines whether to generate an alert based on whether the evaluated attention index is equal to or greater than a threshold. If the processor 11 determines that the evaluated attention index is equal to or greater than the threshold, the processor 11 generates an alert (an example of a first notification) that includes position information of the person who has passed the no-entry line LN and notifies the user that the person detected by the short-range detection radar RB is a person requiring attention. The processor 11 transmits the generated alert to the server S1. The alert may be a detection screen SC1. The processor 11 may also generate an alert that includes a captured image in which at least a partial area of ​​the person whose attention index is determined to be equal to or greater than the threshold is cropped from the captured image transmitted from the camera C1.

[0159] Next, an example of the operation procedure of the surveillance radar device RD1 will be described with reference to Fig. 9 and Fig. 10. Fig. 9 is a flowchart showing an example of the operation procedure of the surveillance radar device RD1 in Modification 3 of Embodiment 1. Fig. 10 is a flowchart showing an example of the operation procedure of the surveillance radar device RD1 in Modification 3 of Embodiment 1. Note that the processing of steps St102 to St103 and steps St203 to St206 may be executed by the radar IC or by the processor 11.

[0160] In the description of the flowchart shown in FIG. 9, the processes of steps St100 to St103 and steps St200 to St203 are the same as those in FIG. 5, and therefore the description thereof will be omitted.

[0161] The operation procedure executed by the short-range detection radar RB will now be described.

[0162] Each of the radar ICs RB1, ..., RBN generates time-series data in which the acquired vital information of the object is arranged in chronological order. Each of the radar ICs RB1, ..., RBN calculates a human emotion index based on the time-series data of the object's vital information (step St207). Each of the radar ICs RB1, ..., RBN determines whether the detected person is a person who should be watched (monitored) based on the calculated human emotion index (step St207).

[0163] Each of the radar ICs RB1, ..., RBN generates a person detection result in which information on whether the detected person is a person requiring attention, information on the person's position (direction, distance), moving speed, etc., and vital information of the person are associated with each person, and output the result to the processor 11.

[0164] The processor 11 acquires the detection results of objects (e.g., humans, animals, etc.) output from the long-range detection radar RA and the detection results of objects (humans) output from the short-range detection radar RB. The processor 11 generates a detection screen SC1 (see FIG. 11 ) in which the acquired detection results of these objects are superimposed on a map (step St312).

[0165] The processor 11 determines whether or not the person detected by the short-range detection radar RB has entered the entry-restricted area AR10 (step St313).

[0166] If the processor 11 determines in the processing of step St313 that the detected human has entered the entry-restricted area AR10 (step St313, YES), the processor 11 calculates an attention index for the detected object. The processor 11 determines whether the calculated attention index is equal to or greater than a threshold value (step St314).

[0167] On the other hand, if the processor 11 determines in the processing of step St313 that the detected human has not entered the entry-restricted area AR10 (step St313, NO), the processor 11 generates a detection screen SC1 in which the detection results of the object detected by the long-range detection radar RA and the short-range detection radar are superimposed on a map (step St315). The processor 11 transmits the generated detection screen SC1 to the server S1 (step St315).

[0168] If the processor 11 determines in the processing of step St314 that the calculated attention index is equal to or greater than the threshold value (step St314, YES), it generates an alarm notifying that a person requiring attention has been detected and sends (issues) the alarm to the server S1 (step St316).

[0169] On the other hand, if the processor 11 determines in the process of step St314 that the calculated attention index is not equal to or greater than the threshold value (NO in step St314), the processor 11 proceeds to the process of step St315.

[0170] As described above, the surveillance radar device RD1 calculates an attention index based on the emotion index of the detected person, and based on the calculated attention index, can notify the administrator that a person requiring attention (i.e., monitoring or vigilance) has been detected. This allows the surveillance radar device RD1 to support the administrator in detecting and monitoring people requiring attention in the course of their surveillance work.

[0171] Next, a detection screen SC1 generated by the surveillance radar device RD1 will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of the detection screen SC1.

[0172] The detection screen SC1 is generated by the processor 11 of the surveillance radar device RD1 and displayed on the monitor MN by the server S1. The detection screen SC1 may be generated by superimposing the detection results on a two-dimensional map or a three-dimensional map. The detection screen SC1 shown in Fig. 11 shows an example in which the detection screen SC1 is generated by superimposing the detection results on a two-dimensional map.

[0173] The detection screen SC1 has the installation position PS0 of the surveillance radar device RD1 and the positions of the objects PS1, PS2, and PS3 detected by the surveillance radar device RD1 superimposed on a map including the detection area AR0 of the surveillance radar device RD1. Furthermore, if the object PS3 detected by the short-range detection radar RB is determined to be a living organism (such as a person or an animal) as a result of the first or fourth determination process, vital sign information INF is further superimposed on the detection screen SC1. Note that, while the vital sign information INF shown in FIG. 11 includes, for example, heart rate information "Heart Rate: XXX" and respiratory rate information "Respiration: XXX" of the object PS3, this is not limiting.

[0174] For example, the vital information INF may include the result of the third determination process or the sixth determination process for determining whether the object detected in the first detection area AR1 is a human. For example, if the detected object is determined to be a human, the processor 11 may generate vital information INF (an example of first notification information) including information notifying the user that the object is a human. Furthermore, for example, if the detected object is determined to be an animal, the processor 11 may generate vital information INF (an example of second notification information) including information notifying the user that the object is an animal.

[0175] 11 includes matching result information "unregistered person" indicating that the object PS3 is a human being and is not a person previously registered in the database DB11. If the object PS3 is a human being and is a person previously registered in the database DB11, the vital information INF (an example of the first notification) may include matching result information indicating that the object PS3 is a person previously registered in the database DB11 (for example, the name, facial image, employee number, etc. of the person associated with the vital information stored in the database DB11).

[0176] The server S1 enlarges, reduces, rotates, etc. the detection screen SC1 displayed on the monitor MN based on operations such as enlarging, reducing, and rotating the detection screen SC1 performed by the administrator via the operation unit 23, and displays it on the monitor MN.

[0177] As described above, the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment includes transmitting antenna units RBT1, ..., RBTN that transmit first radio waves in a first detection area AR1 (an example of a first range), receiving antenna units RBR1, ..., RBRN (an example of a first transmitting / receiving unit) that receive the first radio waves reflected by an object, and a radar IC that detects the presence or absence of an object in the first detection area AR1 based on the reflected waves of the first radio waves received by the receiving antenna units RBR1, ..., RBRN and acquires a detection result (an example of first information) related to the object detected in the first detection area AR1. , RBN (an example of a first detection processing unit), transmitting antenna units RAT1, ..., RATM that transmit second radio waves in a second detection area AR2 (an example of a second range) that is wider than the first detection area AR1, receiving antenna units RAR1, ..., RARM (an example of a second transceiver unit) that receive the second radio waves reflected from objects, and radar ICs RA1, ..., RAM (an example of a second detection processing unit) that detect the presence or absence of objects in the second detection area AR2 based on the reflected waves of the second radio waves received by the receiving antenna units RAR1, ..., RARM and acquire detection results (an example of second information) related to the objects detected in the second detection area AR2. The detection results (an example of first information) acquired by the radar ICs RB1, ..., RBN include identification information that can determine whether the objects detected in the first detection area AR1 are living organisms.

[0178] As a result, the surveillance radar device RD1 according to the first embodiment and the first to third variations of the first embodiment can simultaneously detect objects located at long distances and detect objects located at short distances and perform vital sign sensing by selectively using radar for long distances (i.e., the second detection area AR2) and short distances (the first detection area AR1). Also, by selectively using radar for long distances (i.e., the second detection area AR2) and short distances (the first detection area AR1), the surveillance radar device RD1 according to the first embodiment can monitor a wide range with a single surveillance radar device RD1 while determining whether an object at short distances is a living thing.

[0179] Furthermore, as described above, in the surveillance radar device RD1 according to the first embodiment and the first to third variations of the first embodiment, the detection result regarding an object detected in the first detection area AR1 further includes a position (an example of first coordinate information) indicating the coordinates of the object detected in the first detection area AR1. The detection result regarding an object detected in the second detection area AR2 includes second coordinate information indicating the coordinates of the object detected in the second range. This allows the surveillance radar device RD1 according to the first embodiment and the first to third variations of the first embodiment to acquire position information of objects detected in each of the first detection area AR1 and the second detection area AR2.

[0180] As described above, the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment includes a processor 11 that generates and outputs a detection screen SC1 (an example of notification information) regarding a detected object based on the detection results acquired by the radar ICs RB1, ..., RBN and the detection results (an example of second information) acquired by the radar ICs RA1, ..., RAM. As a result, the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment can support the surveillance work performed by a manager, security guard, etc., by outputting the detection results of objects detected within the detection area AR0.

[0181] As described above, the radar ICs RB1, ..., RBN of the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment perform a first determination process to determine whether an object detected in the first detection area AR1 is a living organism based on the identification information. The processor 11 generates a detection screen SC1 in which information indicating that the object determined to be a living organism by the first determination process is a living organism (e.g., vital information of the object) and position information (an example of first coordinate information) indicating coordinates (i.e., orientation, distance) corresponding to the object determined to be a living organism by the first determination process are superimposed on a map including at least the first detection area AR1. As a result, the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment can detect an object (living organism) using the short-range detection radar RB and output the position where the object is detected, thereby supporting the surveillance work performed by managers, security guards, etc.

[0182] As described above, the radar ICs RB1, ..., RBN of the surveillance radar device RD1 according to the first modification of the first embodiment perform a second determination process to determine whether or not an object detected in the first detection area AR1 is moving, and if the identification information corresponding to the object determined not to be moving in the second determination process includes biological information indicating that the object is a living organism, the radar ICs RB1, ..., RBN of the surveillance radar device RD1 according to the first modification of the first embodiment determine whether or not the detected object is a living organism.

[0183] Furthermore, as described above, the radar ICs RB1, ..., RBN of the surveillance radar device RD1 according to the second modification of the first embodiment perform a third determination process to determine whether or not the object determined to be a living organism in the first determination process is a human, based on at least one of the identification information, the size of the object, and the strength of the reflected wave of the radio wave received by the receiving antenna units RBR1, ..., RBRN. This enables the surveillance radar device RD1 according to the second modification of the first embodiment to more accurately determine whether the detected object is a person or an animal.

[0184] As described above, the processor 11 of the surveillance radar device RD1 according to the first modification of the first embodiment performs a fourth determination process to determine whether or not an object detected in the first detection area AR1 is a living thing based on the identification information, and generates a detection screen SC1 in which information indicating that the object determined to be a living thing in the fourth determination process is a living thing and location information (an example of the first coordinate information) corresponding to the object determined to be a living thing in the fourth determination process are superimposed on a map showing at least the first detection area AR1. As a result, the surveillance radar device RD1 according to the first modification of the first embodiment can detect an object (living thing) using the short-range detection radar RB and output the location where the object is detected, thereby supporting the surveillance work performed by a manager, security guard, etc.

[0185] Furthermore, as described above, the processor 11 of the surveillance radar device RD1 according to the first modification of the first embodiment performs a fifth determination process to determine whether an object detected in the first detection area AR1 is moving, and if it determines that the identification information corresponding to an object determined to be not moving in the fifth determination process includes biological information indicating that the object is a living thing, it determines that the object determined to be not moving in the fifth determination process is a living thing. This allows the surveillance radar device RD1 according to the first modification of the first embodiment to determine whether a stationary object is a living thing.

[0186] As described above, the processor 11 of the surveillance radar device RD1 according to the second modification of the first embodiment performs a sixth determination process to determine whether the object determined to be a living organism in the fourth determination process is a human or not, based on at least one of the identification information, the size of the object, and the intensity of the reflected wave of the first radio wave received by the receiving antenna units RBR1, ..., RBRN. This enables the surveillance radar device RD1 according to the second modification of the first embodiment to determine with higher accuracy whether the detected object is a person or an animal.

[0187] As described above, the processor 11 of the surveillance radar device RD1 according to the second modification of the first embodiment generates, as notification information, first notification information that provides a first notification regarding an object that has been determined to be a human by the radar ICs RB1, ..., RBN or the processor 11, and second notification information that provides a second notification different from the first notification regarding an object that has not been determined to be a human by the radar ICs RB1, ..., RBN or the processor 11. In this way, the surveillance radar device RD1 according to the second modification of the first embodiment can notify a manager, security guard, or the like whether or not a living thing is a human (person).

[0188] Furthermore, as described above, when the processor 11 of the surveillance radar device RD1 according to the second modification of the first embodiment determines that an object determined to be a human has entered the entry-prohibited area AR10 where human entry is prohibited, the processor 11 issues a first notification notifying the administrator, security guard, or the like of the detection of a person's entry into the pre-set entry-prohibited area AR10.

[0189] As described above, the processor 11 of the surveillance radar device RD1 according to the third modification of the first embodiment calculates an emotion index for an object determined to be a human based on the radar ICs RB1, ..., RBN or the vital sign information of the object determined to be a human by the processor 11, and notifies the emotion index for the object determined to be a human as a first notification. In this way, the surveillance radar device RD1 according to the third modification of the first embodiment can support surveillance work by notifying a manager, security guard, or the like of the detection of a person for whom an excited or aggressive emotion index has been calculated.

[0190] As described above, when an object that has been determined to be a human by the radar ICs RB1, ..., RBN or the processor 11 and has an emotion index in a predetermined state enters a no-entry area, the processor 11 of the surveillance radar device RD1 according to the third modification of the first embodiment issues a first notification that a suspicious object has entered the no-entry area. As a result, the surveillance radar device RD1 according to the third modification of the first embodiment can support surveillance work by notifying a manager, security guard, or the like of the intrusion of a person whose emotion index is calculated to be excited or aggressive into a pre-set no-entry area AR10.

[0191] Furthermore, as described above, when the biometric information of an object determined to be a human by the radar ICs RB1, ..., RBN or the processor 11 is similar to pre-registered biometric information, the processor 11 of the surveillance radar device RD1 according to the second modification of the first embodiment sends a first notification that the object determined to be a human by the radar ICs RB1, ..., RBN or the processor 11 is a pre-registered person. This allows the surveillance radar device RD1 according to the second modification of the first embodiment to determine whether a person located within the first detection area AR1 is a person who has been pre-registered in the database DB11 and is permitted to enter the first detection area AR1.

[0192] As described above, the first radio wave and the second radio wave are millimeter waves or microwaves in the surveillance radar device RD1 according to the first to third modifications of embodiment 1. As a result, the surveillance radar device RD1 according to the first embodiment and the first to third modifications of embodiment 1 can detect objects (people, animals, etc.) within the detection area AR0 with higher accuracy by emitting radio waves in a wavelength band more suitable for acquiring vital sign information.

[0193] As described above, the detection results obtained by the radar ICs RB1, ..., RBN of the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment include at least one of the following: a distance from the installation position PS0 of the surveillance radar device RD1 to an object detected in the first detection area AR1, a direction from the installation position PS0 of the surveillance radar device RD1 to the object detected in the first detection area AR1, and a height of the object detected in the first detection area AR1. The detection results obtained by the radar ICs RA1, ..., RAM include at least one of the following: a distance from the installation position PS0 of the surveillance radar device RD1 to an object detected in the second detection area AR2, a direction from the installation position PS0 of the surveillance radar device RD1 to the object detected in the second detection area AR2, and a height of the object detected in the second detection area AR2. As a result, the surveillance radar device RD1 according to embodiment 1 and variants 1 to 3 of embodiment 1 can determine the type of object (e.g., person, animal, vehicle, etc.) based on the object's position based on its position and orientation, and the object's height.

[0194] Furthermore, as described above, the radar ICs RB1, ..., RBN of the surveillance radar device RD1 according to Modifications 1 to 3 of Embodiment 1 calculate the movement speed of an object detected in the first detection area AR1. The detection results acquired by the radar ICs RB1, ..., RBN further include the movement speed of the object detected in the first detection area AR1. The radar ICs RA1, ..., RAM calculate the movement speed of an object detected in the second detection area AR2. The detection results acquired by the radar ICs RA1, ..., RAM further include the movement speed of the object detected in the second detection area AR2. As a result, the surveillance radar device RD1 according to Modifications 1 to 3 of Embodiment 1 can more accurately determine the type of object (e.g., person, animal, vehicle, etc.) based on the calculated movement speed of the object.

[0195] As described above, the maps of the surveillance radar devices RD1 according to the first embodiment and the first to third modifications of the first embodiment are two-dimensional or three-dimensional map data. As a result, the surveillance radar devices RD1 according to the first embodiment and the first to third modifications of the first embodiment can support the surveillance work of an administrator by displaying a detection screen SC1 in which detection information is superimposed on a two-dimensional or three-dimensional map.

[0196] As described above, in the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment, the identification information includes at least one of the respiratory rate, the heart rate, the blood pressure, the respiratory interval, and the heartbeat interval, which allows the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment to more accurately determine the type of the detected object (e.g., person, animal, etc.) based on the identification information.

[0197] As described above, in the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment, the detection result regarding an object detected in the second detection area AR2 includes identification information (e.g., respiratory rate, heart rate). This allows the surveillance radar device RD1 according to the first embodiment and the first to third modifications of the first embodiment to more accurately determine the type of the detected object (e.g., living thing, stationary object, etc.) based on the identification information.

[0198] As described above, the detection system 100 (an example of a monitoring system) according to the first embodiment and the first to third variations of the first embodiment comprises transmitting a first radio wave in a first detection area AR1 (an example of a first range), receiving a reflected wave of the first radio wave, detecting the presence or absence of an object in the first detection area AR1 based on the reflected wave of the first radio wave, acquiring first information which is information about the object detected in the first detection area AR1 and includes identification information that can determine whether the object is a living organism, transmitting a second radio wave in a second detection area AR2 (an example of a second range) which is larger than the first detection area AR1, receiving a reflected wave of the second radio wave, detecting the presence or absence of an object in the second detection area AR2 based on the reflected wave of the second radio wave, and acquiring second information about the object detected in the second detection area AR2.

[0199] As a result, the detection systems 100 according to the first embodiment and the first to third variations of the first embodiment can simultaneously detect objects located at long distances, and detect objects located at short distances and perform vital sensing by selectively using radar for long distances (i.e., the second detection area AR2) and short distances (detection area AR0). Furthermore, the surveillance radar device RD1 according to the first embodiment can monitor a wide range with a single surveillance radar device RD1 while determining whether an object at short distances is a living organism by selectively using radar for long distances (i.e., the second detection area AR2) and short distances (detection area AR0).

[0200] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, alterations, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner without departing from the spirit of the invention.

[0201] This application is based on a Japanese patent application (Patent Application No. 2022-029909) filed on February 28, 2022, the contents of which are incorporated herein by reference.

[0202] The present disclosure is useful as a monitoring device, a monitoring system, and a monitoring method that improve the accuracy of detecting living organisms by radar.

[0203] 10, 20 Communication unit 11, 21 Processor 12, 22 Memory 13 AI processing unit 14 AI calculation processing unit 15 Learning model memory 100 Detection system AR0 Detection area AR1 First detection area AR2 Second detection area C1 Camera DB11, DB2 Database DR1 Security drone RA1, RAM, RB1, RBN Radar IC RAT1, RATM, RBT1, RBTN Transmitting antenna unit RAR1, RARM, RBR1, RBRN Receiving antenna unit RD1 Surveillance radar device MN Monitor NW Network S1 Server TP1 Security guard terminal

Claims

1. a first transceiver configured to transmit a first radio wave within a first range and receive a reflected wave of the first radio wave; a first detection processing unit that detects the presence or absence of an object in the first range based on a reflected wave of the first radio wave received by the first transmitting / receiving unit, and acquires first information regarding the object detected in the first range; a second transceiver configured to transmit a second radio wave within a second range wider than the first range and receive a reflected wave of the second radio wave; a second detection processing unit that detects the presence or absence of an object in the second range based on a reflected wave of the second radio wave received by the second transceiver unit, and acquires second information related to the object detected in the second range, the first information includes identification information that can determine whether the object is a living thing; monitoring equipment.

2. the first information further includes first coordinate information indicating coordinates of an object detected in the first range; the second information includes second coordinate information indicating coordinates of an object detected in the second range; The monitoring device of claim 1 .

3. a processor that generates and outputs notification information regarding an object in the first range and an object in the second range based on the first information and the second information, The monitoring device according to claim 2 .

4. the first detection processing unit performs a first determination process of determining whether or not the object detected in the first range is a living thing based on the identification information; the processor generates superimposed map information by superimposing information indicating that the object determined to be a living organism by the first determination process is a living organism and first coordinate information corresponding to the object determined to be a living organism by the first determination process on map information indicating at least the first range. The monitoring device according to claim 3.

5. the first detection processing unit performs a second determination process to determine whether or not an object detected in the first range is moving, and when the first information corresponding to an object determined to be not moving in the second determination process includes biological information indicating that the object is a living organism, determines that the object determined to be not moving in the second determination process is a living organism. The monitoring device according to claim 4.

6. the first detection processing unit performs a third determination process to determine whether the object determined to be a living organism in the first determination process is a human or not, based on at least one of the identification information, the size of the object, and the intensity of the reflected wave of the first radio wave received by the first transmitting / receiving unit.

6. The monitoring device according to claim 4 or 5.

7. the processor performs a fourth determination process to determine whether the object detected in the first range is a living organism based on the identification information, and generates superimposed map information in which information indicating that the object determined to be a living organism in the fourth determination process is a living organism and the first coordinate information corresponding to the object determined to be the living organism in the fourth determination process are superimposed on map information indicating at least the first range. The monitoring device according to claim 3.

8. the processor performs a fifth determination process to determine whether an object detected in the first range is moving, and if it determines that the identification information corresponding to an object determined to be not moving in the fifth determination process includes biometric information indicating that the object is a living organism, it determines that the object determined to be not moving in the fifth determination process is the living organism. The monitoring device according to claim 7.

9. the processor performs a sixth determination process of determining whether the object determined to be a living organism in the fourth determination process is a human being based on at least one of the identification information, the size of the object, and the intensity of the reflected wave of the first radio wave received by the first transceiver.

9. The monitoring device according to claim 7 or 8.

10. The processor generates, as the notification information, first notification information for making a first notification regarding the object determined to be a human by the first detection processing unit or the processor, and second notification information for making a second notification different from the first notification regarding the object not determined to be a human by the first detection processing unit or the processor. The monitoring device according to claim 6.

11. when it is determined that an object determined to be a human has entered an entry-prohibited area where entry of humans is prohibited, the processor notifies, as the first notification, that a human has entered the entry-prohibited area. The monitoring device of claim 10.

12. the processor calculates an emotion index of the object determined to be a human being based on biometric information of the object determined to be a human being by the first detection processing unit or the processor, and notifies the emotion index regarding the object determined to be a human being as the first notification. The monitoring device of claim 10.

13. when an object determined to be the human by the first detection processing unit or the processor and having the emotion index in a predetermined state enters an entry-restricted area, the processor notifies, as the first notification, that a suspicious object has entered the entry-restricted area.

13. The monitoring device of claim 12.

14. When biometric information of the object determined to be a human by the first detection processing unit or the processor is similar to pre-registered biometric information, the processor notifies, as the first notification, that the object determined to be a human by the first detection processing unit or the processor is a person registered in advance. The monitoring device of claim 10.

15. The map information is two-dimensional or three-dimensional map data. The monitoring device according to claim 4.

16. the first radio wave and the second radio wave are millimeter waves or microwaves; The monitoring device of claim 1 .

17. the first information includes at least one of a distance from an installation position of the monitoring device to an object detected in the first range, a direction from the installation position of the monitoring device to the object detected in the first range, and a height of the object detected in the first range; the second information includes at least one of a distance from an installation position of the monitoring device to an object detected in the second range, a direction from an installation position of the monitoring device to the object detected in the second range, and a height of the object detected in the second range; The monitoring device of claim 1 .

18. the first detection processing unit calculates a moving speed of the object detected in the first range; the first information further includes a moving speed of the object detected in the first range; the second detection processing unit calculates a moving speed of the object detected in the second range; The second information further includes a moving speed of the object detected in the second range. The monitoring device of claim 1 .

19. The identification information includes at least one of a respiratory rate, a heart rate, a blood pressure, a respiratory interval, and a heartbeat interval. The monitoring device of claim 1 .

20. The second information includes the identification information. The monitoring device of claim 1 .

21. The monitoring device according to claim 1; an information processing device communicably connected to the monitoring device, Surveillance system.

22. transmitting a first radio wave in a first range; receiving a reflected wave of the first radio wave; Detecting the presence or absence of an object in the first range based on a reflected wave of the first radio wave; acquiring first information that is information about an object detected in the first range and includes identification information that can determine whether the object is a living thing; transmitting a second radio wave in a second range wider than the first range; receiving a reflected wave of the second radio wave; Detecting the presence or absence of an object in the second range based on the reflected wave of the second radio wave; and acquiring second information about objects detected in the second range. Monitoring method.