Control device, network, method and computer program for controlling presence detection using radio frequency sensing in a network

Abstract

This invention relates to a control device for controlling radio frequency (RF) sensing in a network (100) (e.g., a Zigbee or Wi-Fi network) including a detection area (120). The control device (110) includes: a neighbor network information providing unit (111), wherein the neighbor network (150) includes neighbor network devices (154) adjacent to network devices of the network (100); and a network control unit (112) for controlling network devices (103) based on the provided neighbor network information, such that the network devices of the network can detect signals that can be used for RF sensing in a detection area (170) extending beyond the detection area of ​​the network (100) and / or for RF sensing in the detection area of ​​the network (100), wherein the detected signals are transmitted by at least one neighbor network device. This allows for improved RF detection in the periphery of the network.

Description

Technical Field

[0001] The present invention relates to a control device, network, method, and computer program for using radio frequency sensing to control presence detection in a network comprising multiple network devices. Background Technology

[0002] Radio frequency (RF) sensing is a technology that allows for highly reliable measurement of motion, presence, occupancy, falls, and / or breathing detection, as well as even human counting and behavior analysis, based on how humans influence and / or interfere with wireless signals transmitted between a group of networked devices (i.e., within the network). This technology is highly convenient because no additional hardware is required beyond what is already installed for the network, eliminating the need for physically installed presence detection in the field. Furthermore, RF sensing potentially offers better coverage compared to sensing technologies such as cameras or passive infrared sensors, which have very limited fields of view and require line-of-sight connections. Additionally, this technology can be advantageously added to networked devices like lights and luminaires and can also be used in both professional and residential applications.

[0003] While radio frequency sensing, for example, performed by network devices with lighting capabilities, typically covers the area between the network devices involved, occupancy detection in areas surrounding the network (e.g., parts of the house away from the network devices) can be unreliable. This can result in sparse or nonexistent occupancy detection coverage, for example, at the boundaries of rooms or houses, such as in the case of a network device used as a ceiling light located in the middle of each room if it were used for occupancy detection. The same problem can occur if a network device, such as a light provided in a garden along a walking path, is used for occupancy detection, where occupancy detection may not be very reliable for the perimeter of the yard away from the path illuminated by the network device. This can be particularly problematic if occupancy detection is used for security purposes (e.g., providing light when movement is detected), because the perimeter of the house or garden (e.g., the darker parts of the garden away from the illuminated path) could be used by unauthorized individuals to enter the yard. Therefore, it would be advantageous to provide a mechanism that allows reliable radio frequency sensing to also be performed on the perimeter of the area covered by the network performing the occupancy sensing.

[0004] EP1534037A1 discloses a method for determining device proximity in a wireless network, the method comprising: characterizing any detected wireless network radio signal at a first device; receiving any broadcast network characteristics from at least one other device on the network; comparing the network characteristics of the first device with the network characteristics received from at least one other device on the network; and if the network characteristics are within a predetermined relationship, then the first device and at least one other device are close to each other. Summary of the Invention

[0005] The purpose of this invention is to provide a control device, a network, a method, and a computer program that allow for improved radio frequency detection in the periphery of a network.

[0006] In a first aspect of the invention, an RF sensing control device is provided for controlling RF sensing in a network including at least one network device, wherein at least one network device is adapted to perform RF sensing in a detection area of ​​the network based on communication signals transmitted within the network, wherein the RF sensing control device includes a) a neighbor network information providing unit for providing information about a neighbor network, wherein the neighbor network includes at least one neighbor network device adjacent to at least one network device of the network, and b) a network control unit for controlling at least one network device based on the provided neighbor network information, such that at least one network device of the network is capable of detecting signals that can be used for RF sensing in a detection area extending beyond the detection area of ​​the network and / or signals that can be used for RF sensing in the detection area of ​​the network, wherein the detected signals are transmitted by at least one neighbor network device.

[0007] Because the network control unit is adapted to control network devices based on information provided on neighboring networks, the network devices can use signals transmitted by neighboring network devices to perform radio frequency (RF) sensing. Therefore, RF sensing can be extended beyond the network's detection area, and the detection results allow for improved occupancy detection in that extended area. Furthermore, using RF sensing signals from neighboring network devices can improve the sensing quality of RF sensing within the network's detection area, especially when the detection areas of the network and neighboring networks overlap in some parts. Therefore, the RF sensing control device allows for improved occupancy detection at the periphery of the network's detection area and / or within the network's detection area controlled by the RF sensing control device itself.

[0008] The network can be any type of wireless network and can be based on different types of radio frequency (RF) technologies and communication protocols, such as Wi-Fi, Thread, Bluetooth, cellular device-to-device communication, V2X protocols, ESP-now, or Zigbee. Then, depending on the technology and protocol used for the network, the network is preferably formed by multiple network devices. However, the network can also be defined by only one network device that enables the network, i.e., that the network can be formed when communicating with another network device. In this particular case, the network can be considered as a single network device, and the detection area of ​​the network can include zero range, or the network device can use the reflection of its own signal to perform RF sensing, such that in this case, a certain range of the detection area can also be provided based on the presence or absence of reflectors in the environment of the network device. Preferably, the network includes at least three network devices. However, in one embodiment, the network controlled by the RF sensing control device may include only two network devices, in which case at least one network device suitable for performing RF sensing may not be able to perform reliable RF sensing between the two network devices. Therefore, although the network devices are suitable for performing RF sensing in the network's detection area based on communication signals transmitted within the network, the network itself does not necessarily need to include enough network devices to perform reliable RF sensing in the network's detection area.

[0009] At least one network device, which can be controlled by an RF sensing control device, is adapted to perform RF sensing in a detection area of ​​the network based on communication signals transmitted within the network. The detection area of ​​the network is typically defined by the distribution of network devices within the network and the ability of the sensing network device (i.e., the network device performing RF sensing) to receive communication signals from other network devices. Furthermore, the detection area can also be defined by the region where reliable RF sensing is possible—for example, the region where reliability parameters (such as the number of false alarms, the number of missed alarms, the ratio between false alarms and total detections, etc.) fall within a range of user-acceptable values. In extreme cases where reliable RF sensing is impossible, such as when only one network device exists in the network and there are no suitable reflectors in the environment allowing the network device to perform RF sensing using its own signals, the detection area is zero. Communication signals transmitted within the network and used for RF sensing by the sensing network device can refer to all kinds of communication signals, typically used with respect to communication protocols employed by the network, such as control messages, network maintenance messages, information provision messages, etc., wherein the sensing network device may be adapted to use received signal strength indicators, channel state information, or any other measure indicating signal interference between the transmitting and sensing network devices.

[0010] The network can be formed by any type of network device. Preferably, the network device (particularly a network device with radio frequency sensing capabilities) refers to a device that can be used as part of a smart home or office application. For example, a network device with radio frequency sensing capabilities can be a sensor device (such as a temperature sensor), an application providing device (such as a smart TV, speaker, heating unit, etc.) that provides applications to users, and / or a control device, for example, for controlling other network devices. In a preferred embodiment, the network device including radio frequency sensing capabilities is a smart lighting device, which is part of a network that includes other smart lighting devices.

[0011] The neighbor network information providing unit is adapted to provide information about a neighbor network. A neighbor network refers to a network of network devices within the communication range of a network controlled by an RF sensing and control device. Specifically, a neighbor network of a network controlled by an RF sensing and control device includes at least one neighbor network device adjacent to at least one network device of the network. A neighbor network device can be considered adjacent to a network device of the network controlled by the RF sensing and control device if at least one network device can receive communication signals from a neighbor network device that allow communication to be established between the network device and the neighbor network device. In one example, a neighbor network can be constructed from network devices located in the same area (e.g., a detection area or location) as the network devices of the network but not part of the network. In other examples, a neighbor network is constructed from network devices in different areas (e.g., detection areas or locations), as network devices of the network, or a combination of network devices within and outside the network area. A neighbor network preferably includes multiple neighbor network devices (i.e., network devices belonging to the neighbor network) and can also be based on any RF technology and protocol, such as Wi-Fi, Thread, Bluetooth, cellular device-to-device communication, V2X protocol, Zigbee, ESP-now, etc. However, a neighbor network may also include only neighbor network devices.

[0012] The neighbor network information providing unit can be a storage unit in which neighbor network information is stored and can be retrieved. Furthermore, the neighbor network information providing unit can be a retrieval unit for retrieving neighbor network information from, for example, a network device that has received communication signals from a neighbor network, wherein the neighbor network information providing unit is then adapted to provide the received neighbor network information. The neighbor network information providing unit can also receive neighbor network information, for example, through user input received from an input device that is part of the network or from a user input device that can communicate with the neighbor network information providing unit in any other way. For example, the input device can be a telephone capable of communicating with the neighbor network information providing unit via Bluetooth. Furthermore, the neighbor network information providing unit can be adapted to control network devices—preferably network devices at the edge or periphery of the network and / or at the edge or periphery of the detection area—to perform a scanning process for detecting neighbor networks and to provide information based on the detection of neighbor networks. For example, during the scanning process, the network can be adapted to send communication signals, for example, on other communication channels or according to other communication protocols, and can be adapted to determine information about another network (i.e., the neighbor network) based on return signals received from another network device (especially a neighbor network device).

[0013] Neighbor network information can refer to any information about a neighboring network, including its characteristics such as the communication protocols used (e.g., whether it's Wi-Fi, Thread, Bluetooth, ESP-now, or Zigbee), the communication channels used, the security protocols used (e.g., whether it's an open or closed network), the location of one or more neighboring network devices, the types of devices included in the network, the status of one or more devices, network identification (e.g., a Zigbee network's Personal Area Network ID), the network key, and the criticality of neighboring network devices to the tasks they perform on the network. Preferably, neighbor network information includes information that allows determining possible ways to communicate with at least one neighboring network device. For example, information about device type can be used to identify neighboring network devices with which reliable communication is possible; for instance, if the information indicates that one of the neighboring network devices is battery-powered, communication with that device might be considered unreliable.

[0014] The network control unit is adapted to control at least one network device based on provided neighbor network information, enabling the at least one network device to detect signals that can be used for radio frequency (RF) sensing in a detection area extending beyond the network's detection area and / or for RF sensing in the network's own detection area. Specifically, the neighbor network information provides information that allows the network control unit to determine which signals might be provided by neighbor network devices that can be used by network devices controlled by the RF sensing control device for RF sensing, and how to access the corresponding signals. Therefore, the network control unit can control at least one network device to detect signals, for example, by searching for communication signals from neighbor network devices on channels specified in the neighbor network information, or by interacting with neighbor network devices to cause them to send corresponding signals to the network device, etc. Furthermore, the network control unit can then be adapted to control at least one network device to perform RF sensing based on detection signals transmitted by at least one neighbor network device for occupancy detection in a detection area extending beyond the network's detection area and / or for RF sensing in the network's own detection area.

[0015] In one embodiment, the network control unit is adapted to control at least one network device such that it determines the signal quality characteristics of communication signals from at least one neighboring network device and uses these signal quality characteristics for radio frequency (RF) sensing. The signal quality characteristics can refer to any feature of the communication signals received from the neighboring network that indicates signal quality. Preferably, the signal quality characteristics can refer to the signal strength of the communication signals from at least one neighboring network device and / or the channel state information of the communication signals from at least one neighboring network device. In particular, the signal strength of the communication signals from at least one neighboring network device can refer to the Received Signal Strength Indicator (RSSI) determined for the corresponding communication signal. For Wi-Fi applications, it is particularly preferred that the channel state information (CSI) of the communication signals received by the network device is used for RF sensing. However, in other embodiments, the signal quality characteristics can also refer to other measures of the communication signals transmitted by at least one neighboring network device and received by the network device of the network controlled by the RF sensing control device.

[0016] In one embodiment, the network control unit is adapted to control at least one network device based on provided information, enabling it to interact with at least one neighboring network device of a neighboring network device, and the network control unit is adapted to control the at least one network device to perform radio frequency (RF) sensing based on the interaction with the at least one interacting neighboring network device. The interaction between the at least one network device and the at least one neighboring network device can refer to any kind of interaction defined by signal exchange between the network device and the neighboring network device. Signal exchange can refer to, for example, one device providing a communication signal, and the other network device providing a return or acknowledgment signal based on the communication signal. The network control unit can then be adapted to control the network device to perform RF sensing based on the interaction (i.e., signal exchange) between the network device and the interacting neighboring network device. In particular, the network control unit can be adapted to control the at least one network device to perform RF sensing based on signals transmitted by the interacting neighboring network device and received by the network device as part of the interaction between the two devices.

[0017] In a preferred embodiment, the network control unit is adapted to control at least one network device to interact with at least one neighboring network device by sending a trigger message to at least one interacting neighboring network device, and to use the return signal from the at least one interacting neighboring network device for radio frequency (RF) sensing. The trigger message can be any message that causes the interacting neighboring network device to transmit a signal according to the network protocol used by the interacting neighboring network device, which can be used for RF sensing in a detection area outside the network detection area. Specifically, the network control unit can be adapted to determine, based on neighboring network information, which trigger signal will allow receiving a return signal from a neighboring network device that allows RF sensing in a detection area extending beyond the network's detection area. Based on this determination, the network control unit is then adapted to control at least one network device to send a trigger message to at least one interacting neighboring network device. The at least one network device can then use parameters of the return signal (e.g., the metric of the return signal, the content of the return signal, or both) for RF sensing (particularly occupancy detection) in the detection area extending beyond the network's detection area—particularly in the detection area between the sensing network device and the interacting neighboring network device.

[0018] In one embodiment, the network control unit is adapted to control network devices to send trigger messages to a public communication platform, preferably cloud storage, from which at least one neighboring network device authorized to access the public communication platform can retrieve the trigger messages. In this case, the trigger message can also serve as a control message for the neighboring network, controlling its communication characteristics. The network control unit may also be adapted to send the trigger message itself.

[0019] In one embodiment, a trigger signal is selected such that a return signal from at least one interacting neighbor network device indicates its connection to other neighbor network devices in the neighbor network and / or its connection to one or more network devices in the network. Preferably, the return signal from at least one interacting network device includes information about its connection to other neighbor network devices in the neighbor network and / or its connection to one or more network devices in the network, such as reliability information, metrics of connection to other network devices, location information of other network devices, type of other network devices, etc. Preferably, the return signal includes signal quality characteristics of the communication signal received by the neighbor network. For example, the return signal may indicate the signal strength of the communication signal received by the neighbor network device, which was sent by another neighbor network device or a network device in the network controlled by the RF sensing control device. If the neighbor network is based on the Zigbee communication protocol, the return signal may reference a neighbor table according to the Zigbee communication protocol. The network control unit can then be adapted to control at least one network device to perform RF sensing, also based on information provided by the interacting neighbor network device regarding connections to other neighbor network devices—in particular, by recording changes in connections to other neighbor network devices between two return signals containing information about connections to other neighbor network devices. In this embodiment, the network device may perform radio frequency (RF) sensing not only between interacting neighboring network devices and the network device itself, but also within the area defined by communication between the interacting neighboring network devices and the neighboring network devices communicating with them. Therefore, the possible detection area for RF sensing of the network can be very effectively expanded to the area occupied by neighboring network devices.

[0020] In a preferred embodiment, the return signal indicates changes in the signal quality characteristics of connections from at least one interacting neighbor network device to other neighbor network devices in the neighbor network and / or to one or more network devices in the network during a predetermined past time period. For example, the return signal may include measured signal strengths of connections from at least one interacting neighbor network device to other neighbor network devices and / or to at least one network device in the network during the predetermined past time period, wherein the sequence of signal strengths indicates changes in these signal strengths. The predetermined past time period may refer to, for example, the last few seconds or minutes, and may also be defined, for example, by defining a number of past signal strength measurements that should be provided. For example, the return signal may refer to a neighbor table that includes the last ten measurements of signal strength between the interacting neighbor network devices and each neighbor network device that is part of the neighbor table.

[0021] In one embodiment, the network control unit is adapted to control a network device to perform radio frequency (RF) sensing for a predetermined past time period based on changes in the signal strength of connections between at least one interacting neighbor network device and connected neighbor network devices within a predetermined past time period. Since the return signal indicates changes in the signal strength of connections from at least one interacting neighbor network device to other neighbor network devices, the network device can be controlled by the network control unit to use information about the signal strength changes to perform RF sensing based on that information within the predetermined time period to which these changes pertain. This embodiment allows, for example, checking whether the current detection result of the sensing network device is consistent with detection results in the area of ​​the neighbor network during a previous time period. An example application of this is a situation where the sensing network device senses the presence of a potential unauthorized person in the perimeter area of ​​a garden adjacent to a neighbor's garden, where the area can only be reached by passing through the neighbor's garden. In this configuration, it would be advantageous to check whether occupancy (i.e., the passage of a person) could indeed be detected in the neighbor's garden during the time period prior to the occupancy detection in the sensing network device's garden, indicating that the occupancy detection by the perimeter network device was correct.

[0022] In one embodiment, the network control unit is adapted to control at least one network device to listen for network maintenance messages or other messages used for communication between network devices in a neighboring network, wherein the network control unit is then adapted to control the network device to perform radio frequency sensing based on the received messages. Network maintenance messages can refer to any kind of message used for maintaining or establishing a network for the network devices. Preferably, the device can be configured by the network control unit to passively listen for all communication messages provided by neighboring network devices and use the received messages for radio frequency sensing.

[0023] In one embodiment, the network control unit may also be adapted to control network devices such that a trigger message is sent, prompting neighboring network devices to send maintenance messages or other messages for communication between network devices in neighboring networks. In a preferred embodiment, the trigger signal is a beacon request signal, and the network maintenance message refers to a response to a beacon request. In another preferred embodiment, the network maintenance message may also refer to a link-state message, a keep-alive message, or a Wi-Fi pinging message. The network device may then be adapted to use the RSSI or CSI of the network maintenance message for radio frequency sensing. However, the content or other metrics of the network maintenance message may also be used for radio frequency sensing.

[0024] In one embodiment, the network control unit is adapted to control at least one network device to interact with at least one neighboring network device by entering and at least partially becoming part of the neighboring network, and to perform radio frequency (RF) sensing as part of the neighboring network. The network control unit is also adapted to control at least one network device to report the results of the RF sensing performed as part of the neighboring network. Preferably, in this embodiment, the neighboring network information provided by the neighboring network information providing unit includes information about whether the neighboring network is an open or closed network, or includes security measures information and network identification information, such that the network control unit can control at least one network device to at least partially become part of the neighboring network based on this neighboring network information. At least one network device can then request to become a full member or a partial member of the neighboring network, for example, a network member with only partial access to network resources and network communications. The network device can then perform RF sensing as part of the neighboring network, and thus perform RF sensing in the detection area of ​​the neighboring network and in the detection area between the neighboring network and at least one network device. The results can be reported to the RF sensing control device and / or can be reported to other network devices in the network, for example, by broadcasting the results to the network. Alternatively, network devices can use other communication channels, such as communicating with at least one network device via Bluetooth, communicating with cloud servers that other network devices also have access to and can retrieve information from, and so on.

[0025] To become part of a neighboring network, a network device can be controlled to leave its current network. However, preferably, the network control unit is adapted to control network devices capable of being part of two networks simultaneously. In this case, the network device can be controlled by the network control unit to become part of a neighboring network and perform radio frequency sensing as part of the neighboring network, while still participating in the network including the network control unit and reporting the results of the radio frequency sensing as part of the network. The ability to be part of two networks simultaneously can be achieved by providing firmware with sufficient capability to be part of two networks, or by providing a single wireless device.

[0026] Preferably, the network control unit is adapted to control at least one network device such that it becomes part of a neighboring network only for a predetermined time period, wherein the network control unit is also adapted to control at least one network device to report the results of radio frequency sensing during the predetermined time period after the network device has become part of the network again. After the predetermined time period has elapsed, the network device may be adapted to automatically leave the neighboring network and request to become part of the network again (i.e., the network controlled by the radio frequency sensing control device). The network control unit may then control at least one network device to report the results of radio frequency sensing processed as part of the neighboring network. Alternatively, the network control unit may be adapted to provide a control trigger signal or control one of the network devices of the network to provide a control trigger signal that triggers at least one network device currently part of the neighboring network to change networks again and request to become part of the network controlled by the radio frequency sensing control device again. In an alternative embodiment, the network control unit may be adapted to control at least one network device to interact with at least one neighboring network device by entering and becoming part of the neighboring network for an indeterminate time period, and is adapted to report the results of radio frequency sensing performed within the neighboring network to the network controlled by the radio frequency sensing control device, while still being part of the neighboring network. The at least one network device can be controlled to report the results of radio frequency sensing, for example, within a predetermined time period (e.g., every few seconds), or can be controlled to report the results of radio frequency sensing only when a predetermined trigger message is provided.

[0027] In one embodiment, the network control unit is adapted to control at least one network device based on provided information, causing the network device to transmit a control trigger message capable of controlling at least one neighboring device to change the timing of communication signals used for communication within the neighboring network, and controlling at least one network device to use the communication signals of the neighboring network for radio frequency sensing. The control trigger message can be any message implemented in the communication protocol used by the neighboring network device, causing at least one neighboring network device to change the timing of transmitting communication signals within the neighboring network. For example, the control trigger message can be implemented and selected to change the timing of network maintenance messages (such as link status messages) within the neighboring network. Preferably, the timing of the communication signals is changed to allow for more frequent transmission of communication signals within a time interval, enabling more accurate radio frequency sensing with higher time resolution.

[0028] In one embodiment, the neighbor network information providing unit is adapted to provide a network channel as information about the neighbor network on which network devices can communicate with the neighbor network, wherein the network control unit is adapted to control at least some, preferably all, network devices of the network to also communicate on the network channel provided by the neighbor network. In a preferred embodiment, the network channel refers to the network channel on which the neighbor network itself communicates. Alternatively, the network channel refers to a dedicated network channel provided by the neighbor network for communicating with network devices outside the neighbor network, such as a guest network channel or a dedicated radio frequency sensing channel. Controlling network devices of a network controlled by a radio frequency sensing control device to communicate (i.e., sending communication messages on the same network channel as the neighbor network) has the advantage of making it easier to control at least one network device of the network to be part of the neighbor network. Furthermore, it becomes easier to perform radio frequency sensing using communication signals transmitted within the neighbor network and received by at least one network device.

[0029] In another aspect of the invention, a network is proposed, wherein the network includes a) at least two network devices, wherein at least one network device is adapted to perform radio frequency sensing in a detection area of ​​the network, and b) a radio frequency sensing control device as described above.

[0030] In another aspect of the invention, a radio frequency sensing control method is proposed for controlling radio frequency sensing in a network including at least one network device, wherein the at least one network device is adapted to perform radio frequency sensing in a detection area of ​​the network based on communication signals transmitted within the network, wherein the radio frequency sensing control method includes a) providing information about neighboring networks, wherein the neighboring networks include at least one neighboring network device adjacent to the at least one network device of the network, and b) controlling the at least one network device based on the provided neighboring network information such that the network device of the network is able to detect signals that can be used for radio frequency sensing in a detection area extending beyond the detection area of ​​the network and / or signals that can be used for radio frequency sensing in the detection area of ​​the network, wherein the detected signals are transmitted by the at least one neighboring network device.

[0031] In another aspect of the invention, a computer program for controlling radio frequency sensing in a network is provided, wherein the computer program includes program code means for causing the radio frequency sensing control device to perform the steps of the radio frequency sensing control method as described above when the computer program is executed by the radio frequency sensing control device as described above.

[0032] It should be understood that the radio frequency sensing control device of claim 1, the network of claim 13, the radio frequency sensing control method of claim 14, and the computer program of claim 15 have similar and / or identical preferred embodiments, particularly as defined in the dependent claims.

[0033] It should be understood that the preferred embodiments of the present invention may also be any combination of the dependent claims or the above embodiments with the corresponding independent claims.

[0034] These and other aspects of the invention will become clear and explained with reference to the embodiments described below. Attached Figure Description

[0035] In the following figures:

[0036] Figure 1 An embodiment of a network including a plurality of network devices according to the radio frequency sensing and control device according to the present invention is illustrated schematically and exemplary.

[0037] Figure 2 A flowchart illustrating an exemplary embodiment of a method for controlling presence detection using radio frequency sensing in a network is shown, and

[0038] Figure 3 and Figure 4 The application of the invention is illustrated schematically and exemplary. Detailed Implementation

[0039] Figure 1 An embodiment of a network having multiple network devices including radio frequency sensing and control devices is illustrated schematically and exemplary. Network 100 is formed by network devices 101, 102, 103, and 104, which communicate with and maintain network 100 via communication signal 130, which is a radio frequency signal. Network devices 101, 102, 103, and 104 are preferably intelligent lighting devices, but may also refer to intelligent devices with other functional capabilities. The term "intelligent" herein refers to devices that provide additional functions (particularly network communication functions, control functions, etc.) in addition to their primary functions (e.g., providing light for lighting devices or sensing temperature for temperature sensors). At least one of network devices 101, 102, 103, and 104 includes a radio frequency sensing function as an additional function, i.e., adapted to perform radio frequency sensing in a detection area 120 of network 100. The detection area 120 is defined as the area where a network device suitable for radio frequency sensing of the network 100 can perform radio frequency sensing tasks given to the network, such as sensing the presence or absence of an object or person, determining the activity of an object or person, detecting a person's breathing, etc.

[0040] In this example, network 100 is located near neighboring network 150. Neighboring network 150 includes neighboring network devices 151, 152, 153, and 154, which communicate within neighboring network 150 using, for example, communication messages 180 to maintain neighboring network 150. In this example, at least one of neighboring network devices 151, 152, 153, and 154 also includes radio frequency (RF) capabilities, i.e., is adapted to perform RF sensing in a detection area 160. In this example, detection area 160 is also defined as an area where a neighboring network device including RF sensing capabilities can detect the presence or absence of an object (such as a person). In other embodiments, the neighboring network devices of neighboring network 150 cannot perform RF sensing themselves. Preferably, neighboring network devices 151, 152, 153, and 154 are also smart lighting devices. However, neighbor network devices 151, 152, 153, and 154 can also refer to intelligent devices with other functional capabilities, such as those described with respect to network devices 101, 102, 103, and 104 of network 100.

[0041] Network 100 also includes an RF sensing control device 110, which is adapted to control presence detection using RF sensing of network 100. Specifically, the RF sensing control device 110 may be adapted to control at least one of network devices 101, 102, 103, and 104 of network 100. Preferably, the RF sensing control device 110 may be adapted to control all network devices 101, 102, 103, and 104 of network 100. The RF sensing control device 110 may be part of one of the network devices 101, 102, 103, and 104 of network 100, for example, it may be provided as hardware or software within a network device housing. Alternatively, the RF sensing control device 110 may be, for example, all or part of network devices 101, 102, 103, and 104, such that the function of the RF sensing control device 110 is performed jointly by network devices 101, 102, 103, and 104, i.e., through interaction between network devices 101, 102, 103, and 104. In another alternative, the radio frequency control device 110 can be a standalone device, for example, it can be a network device itself, including hardware and software for providing the functionality of the radio frequency sensing control device 110 and communicating with at least one of the network devices 101, 102, 103, 104. Figure 1 In the example shown, the radio frequency sensing control device 110 is connected to the network device 103 of the network 100, which includes radio frequency sensing capabilities.

[0042] The radio frequency sensing control device 110 includes a neighbor network information providing unit 111 and a network control unit 112. The neighbor network information providing unit 111 is adapted to provide information about a neighbor network, in this example, about neighbor network 150. For example, the neighbor network information providing unit 111 can provide information determined based on communication signals 180 used within neighbor network 150 and received by network device 103 as neighbor network information. These communication signals 180 can, for example, provide information about the communication protocol used by neighbor network 150, the communication channel used by neighbor network 150, the identifier or security key used by neighbor network 150, whether neighbor network 150 is an open network or a closed network, etc. The neighbor network information providing unit 111 can then be adapted to extract or determine this information from the received communication signals 180.

[0043] In another embodiment, the neighbor network information providing unit 111 may also be adapted to control the network device 103 to actively scan neighbor networks, specifically by transmitting a trigger message that causes each potential neighbor network device to respond and provide information about its own neighbor network. In this case, the network device 103 will provide a trigger message 140, which will be received by a neighbor network device 154 of the neighbor network 150, wherein the trigger message 140 causes the neighbor network device 154 to transmit a network information message 141, which contains, for example, information about the neighbor network 150 that can be received by the network device 103.

[0044] The neighbor network information providing unit 111 can also be adapted to receive neighbor network information based on input from an input unit that is also in communication with the radio frequency sensing and control device 110. Alternatively, the neighbor network information providing unit 111 can also receive neighbor network information from cloud storage where the user has already stored neighbor network information. The cloud storage can also include central storage, such as network storage used by multiple devices for storing and exchanging data. In particular, the neighbor network information directly provided by the user through the neighbor information providing unit 111 can refer to the security information of the neighbor network 150, such as the network password and security key of the neighbor network 150.

[0045] The neighbor network information providing unit 111 can then provide this information as information about the neighbor network 150. The network control unit 112 is then adapted to control the network device 103 based on the neighbor network information provided by the neighbor network information providing unit 111. In particular, the network control unit 112 is adapted to control the network device 103 such that the network device 103 can detect signals available for radio frequency sensing in a detection area 170 extending beyond the detection area 120 of the network 100, wherein the detection signals are transmitted by one of the neighbor network devices 151, 152, 153, 154. For example, if the neighbor network information indicates that the neighbor network 150 provides its communication signal 180 on the same communication channel as the communication signal 130 used in the network 100, then the network control unit 112 may be adapted to control the network device 103 to use the communication signal 180 of the neighbor network 150 received by the network device 103 for radio frequency sensing in the detection area 170. Alternatively, if the neighbor network information indicates that the neighbor network 150 uses a specific communication protocol (such as Zigbee or Wi-Fi), the network control unit 112 may be adapted to control the network device 103 to send a trigger message 140 to, for example, the neighbor network device 154 according to the network protocol, causing the neighbor network device 154 to transmit a return signal 141 according to the communication protocol it is using. The network control unit 112 may then be adapted to control the network 103 to use the return signal 141 for radio frequency sensing in the detection area 170.

[0046] In another embodiment, if neighbor network information indicates that neighbor network 150 is an open network, or if, for example, due to input from a user of network 100, the RF sensing control device 110 knows the certificate (such as a security key) of neighbor network 150, then the network control unit 112 may be adapted to control network device 103 to become part of neighbor network 150. Specifically, the network control unit 112 may control network device 103 to leave network 100 and request to become part of neighbor network 150, such that network device 103 can perform RF sensing as part of neighbor network 150, for example, based on communication signal 180. Then, the network control unit 112 may further control network device 103 to leave neighbor network 150 and rejoin network 100 after a predetermined time period, or to report the RF sensing results as part of neighbor network device 150 to network 100 at predetermined time intervals or in response to a trigger message, for example, to one of other network devices 101, 102, 104 of network 100, while still remaining part of neighbor network 150.

[0047] Figure 2A flowchart is shown, which exemplarily illustrates an embodiment of a method for controlling presence detection using radio frequency sensing in a network, such as network 100. In a first step 201, method 200 includes providing information about neighboring networks (such as neighboring network 150), wherein neighboring network 150 includes at least one neighboring network device 154 adjacent to at least one network device 103 of network 100. In a second step 202, at least one network device (e.g., network device 103 of network 100) is controlled based on the provided information such that network device 103 of network 100 is able to detect signals 141, 180 for radio frequency sensing in a detection area 170 outside the detection area 120 of network 100. The detection signals 141, 180 are transmitted by at least one neighboring network device 151, 152, 153, 154.

[0048] The following provides more detailed examples of preferred embodiments and applications of the invention summarized above.

[0049] Figure 3 An example of a typical application of the invention is illustrated. In this figure, a typical apartment 300 is shown. The apartment includes multiple rooms, such as a dining room, bathroom, or bedroom. In each of these rooms, a network device 310, indicated by dots in the figure, is provided, where the network device may be a smart lighting device. However, network device 310 may also refer to a network device with other functions, such as a sensor device or a control device. In this example, the network devices provided in one room form a network. For example, network devices 310 provided in the living room form a network, network devices provided in the first bedroom form a network, network devices in the second bedroom form a network, and network devices provided, for example, in the hallway also form a network, although only one network device is provided in the hallway. Therefore, the network in the hallway refers to a network including only one network device. In this example, areas 320 in the living room and bedrooms include enough network devices 310 whose distribution allows for very good coverage of radio frequency sensing performed by the network devices in these areas. However, areas 330 and 340 include too few or too unevenly distributed network devices, making it impossible to provide accurate and reliable radio frequency sensing by the network devices in the respective areas. If the radio frequency occupancy sensor is used to control network devices in a room (e.g., turning on lights), this could pose a problem if someone is detected in the room, or if the network devices are used for security purposes. These security purposes might be particularly valuable in area 340, including the apartment lobby and balcony, where current detection might allow, for example, turning on lights or notifying apartment residents.

[0050] exist Figure 4 The image shows another example of a configuration in which the present invention, as described above, can be applied. Figure 4The illustration shows a garden area 400 where network devices 410 (in this example, smart lighting devices) are distributed. Specifically, network devices 410 are provided at terraces, walkways, and sheds in the garden. In this example, all the lights provided in the garden can form a network, where radio frequency (RF) sensing can be provided by the network devices, resulting in good results and high reliability in area 420 of the garden. However, in area 430 where no network devices are provided, RF sensing will be unreliable or even impossible. Typically, occupancy detection in a garden using RF sensing can lead to unreliable results because only a limited number of network devices (such as smart lighting devices) are available in most gardens. For example, the user may not even provide the three preferred network devices for reliable RF sensing. Furthermore, network devices used in gardens (such as smart lights) are often placed on walkways or along the perimeter of the yard, and they may not be provided in other areas of the garden. Additionally, the lack of constraints in outdoor areas results in a limited number of reflections, which can also contribute to RF sensing in other applications. Therefore, the lack of reflections generally reduces the performance of RF detection in outdoor areas. In particular, in radio frequency sensing applications based on signal analysis involving multipath signal transmission (e.g., using CSI measurements in Wi-Fi communication protocols), this lack of reflection leads to a further reduction in the reliability of presence detection.

[0051] exist Figure 3 and Figure 4 In the two exemplary environments shown, applications such as those related to... Figure 1 and Figure 2 The exemplary radio frequency control device described allows for the expansion of the detection area of ​​network devices, for example, by utilizing signals provided by network devices that do not belong to that network, particularly those belonging to neighboring networks, in addition to the radio frequency signals provided by network devices belonging to a particular network, thereby expanding areas with unreliable radio frequency sensing. For example, in Figure 3 In the application shown, the neighbor network can be any network provided, for example, in adjacent rooms. For instance, high-precision RF sensing in the second bedroom can be achieved by further considering RF signals provided by network devices in the first bedroom, hallway, and / or bathroom. Figure 4 In the second exemplary application shown, the neighboring network of the network shown in the garden can refer to the network of a neighbor that also provides network devices in an adjacent garden. If the corresponding neighboring network (e.g., in an adjacent garden) is available, then based on... Figure 4 The network settings shown are for Figure 4 In the area 430 shown, there is no available radio frequency sensing. This area can be covered by signals provided by neighboring network devices and its own network devices, making it possible to perform improved (e.g., more reliable) radio frequency sensing in area 430.

[0052] According to the general embodiments of the invention described above, a hybrid RF sensing mode is recommended for RF sensing. Specifically, a first set of network devices (e.g., lights) is provided in a network (e.g., a Philips Hue network) under the direct control of the network owner (i.e., specifically, the owner of the network devices). According to the embodiments described above, the network devices of the network capable of RF sensing can then interact with a second set of network devices (e.g., also with the lights), which is part of another network, particularly a neighboring network that may be owned by a neighbor or others, to improve the network's RF detection. Neighboring network devices as part of a neighboring network can refer to, for example, a neighbor's Wi-Fi light, a neighbor's Zigbee light, a Zigbee-enabled smart meter owned by an electric company, a combination of Wi-Fi and Zigbee lights owned by a neighbor, a neighbor's Wi-Fi access point, a city's public Wi-Fi infrastructure, Zigbee-enabled streetlights and / or emergency lights owned by an electric company or municipality, sensors, thermostats, etc.

[0053] Using signals from neighboring network devices that do not belong to one's own network allows for improvements in one's own network's radio frequency (RF) sensing performance. For example, by utilizing neighboring network devices (such as lights) in neighboring apartments upstairs and downstairs, a sensing space can be created from the ceiling to the room floor, enabling one's own network to perform vertically oriented RF sensing. Furthermore, by using neighboring network devices belonging to neighboring apartments located on the same floor, the sensing performance of one's own network near shared walls between apartments and / or near the entrance areas of two apartments can be improved.

[0054] Using a neighbor network device (such as a light) provided from a neighbor network in an adjacent room may be sufficient in many cases to determine whether a suspicious but unconfirmed false alarm in a room is truly caused by something happening in that room, or by interference from an adjacent room (e.g., in a neighbor's room). For example, a network device provided in a user's living room can detect interference that might be caused by the presence of someone in the living room using radio frequency sensing. To confirm that someone is indeed in the living room, the network provided in the living room can, for example, provide a reference... Figure 1 The aforementioned radio frequency sensing control device, at least temporarily, involves signals provided by neighbor network devices in a neighbor network provided in adjacent rooms near the living room for radio frequency sensing. If, based on signals provided by these neighbor network devices, interference in the radio frequency sensing is measured to be significant, the network may be adapted to infer that it is more likely that someone is indeed in the neighbor room and not present in the living room (e.g., moving).

[0055] Typically, a first group of network devices (such as lights) as part of a first network can perform well-known radio frequency (RF) sensing. For example, if the first network is based on a Wi-Fi communication protocol, RF sensing can utilize a distributed RF sensing architecture, where all Wi-Fi network devices are considered equally in terms of RF sensing. In this example, Wi-Fi RF sensing does not require a central node, i.e., a central network device, such as a Wi-Fi access point that may be prone to failure. Typically, the Wi-Fi communication protocol used by the network devices can refer to a conventional Wi-Fi communication protocol or a Wi-Fi mesh communication protocol. The first network can then further include RF sensing control devices as described above to extend the RF sensing capabilities of the network according to the invention.

[0056] In one example, a second set of network devices (i.e., the neighboring network) owned by a neighbor of a user of the first network may not provide sufficient computing resources, or may be based on Wi-Fi radio communication protocols, making it impossible for the second set of network devices to obtain the raw CSI data necessary for analyzing communication signals to provide RF sensing performance. In this case, the second set of network devices may rely on RF sensing computation from a network device (e.g., an anchor node) that may be located elsewhere. If the neighboring network includes an RF sensing control device according to the invention described above, such an anchor node may be provided, for example, by a Wi-Fi access point or one of the Wi-Fi network devices as part of a first set of lights in the first network. The RF sensing control device of the first network can then, for example, control the anchor node to interact with at least one of the network devices in the second set of lights, which is part of the neighboring network and does not have the resources to perform RF sensing itself. In such an example, the RF sensing resulting from the interaction of the two networks is not performed in a fully distributed manner. Preferably, the RF sensing application is provided on the Wi-Fi network device of the first set of network devices, while the second set of network devices in the neighboring network, which does not have RF sensing capabilities, can only interact as standard Wi-Fi nodes. In particular, in such an embodiment, network devices of the first or second network (i.e., network devices owned by a neighbor) do not necessarily have agreed to participate in the radio frequency sensing of the first group of network devices.

[0057] In one example, if the second Wi-Fi network is a public or open Wi-Fi network, the RF sensing control device can be adapted to control one of the network devices in the first group of network devices (e.g., a Wi-Fi light) to leave the first Wi-Fi network and temporarily join the second Wi-Fi network (e.g., a neighbor's Wi-Fi network) to perform an RF sensing scan. This method using the RF sensing control device according to the invention can preferably be used when the network is in a "homeless mode" and, based on RF sensing, there is suspicion that an unauthorized person (e.g., a thief) may be inside the house. In such an application, after a network device that has temporarily become part of the neighbor's network has completed an RF scan of the extended detection area based on signals provided by the neighbor's network devices (e.g., adjacent Wi-Fi access points), the network device can again leave the neighbor's network and rejoin the first Wi-Fi network to report the results of the RF scan. Specifically, in the case of Wi-Fi communication protocols, up to 1500 Wi-Fi messages per second can be used for rapid detection of human movement. However, in this embodiment, the first network cannot reach the network device while it is performing an RF scan in the neighbor's network. However, this is acceptable for that time period because verifying the presence of authorized personnel near the primary network may take precedence over other network functions, such as lighting control or lighting functionality. Such embodiments are particularly interesting because public or open networks exist in many environments, for example, as guest networks that can be configured in network routers to grant unrestricted access to external users, for example, via passwordless access, allowing anyone to join. However, this configuration may not provide access to network devices blocked by some firewalls. Another example refers to a router that provides the ability to broadcast two Service Set Identifiers (SSIDs), one of which can be configured to refer to a secure network, and the other SSID can be configured to provide public access, for example, to users who are also allowed to use its access point. Therefore, in many applications, open or free networks are often used to increase the detection area of ​​networks performing radio frequency sensing.

[0058] While the above examples relate to a distributed radio frequency (RF) sensing architecture based on a Wi-Fi communication protocol, other RF sensing protocols can also be used in the network or neighboring networks according to the present invention. For example, RF sensing implemented over a Wi-Fi communication protocol, where only the Wi-Fi access point is aware of the RF sensing (i.e., provides RF sensing capability), where an access point, which can be considered one of the network devices, provides a trigger message to other network devices that do not have RF sensing capability, and where the access point can provide RF sensing based on return signals from other network devices that are part of the network of the access point. In such embodiments, the RF sensing control device can be adapted, for example, to enable the network control unit to control the access point that is at least one network device, or to enable the network control unit to control one of the network devices so that it interacts with access points in a neighboring network.

[0059] In one embodiment, if the network is based on the Zigbee communication protocol, the radio frequency sensing control device can be adapted to control at least one network device to change its state in the Zigbee network from a Zigbee router to a Zigbee end device for interacting with neighboring network devices. This is particularly useful because it allows the network device interacting with neighboring network devices to dedicate more time, bandwidth, and processing power to interacting with or listening to neighboring network devices.

[0060] Typically, neighboring networks and their devices can communicate (i.e., transmit communication signals) on radio frequency channels different from those used by the network controlled by the radio frequency sensing control device. Furthermore, in a preferred embodiment, the network control unit may be adapted to control at least one network device (e.g., a battery-powered network device) to act as a Zigbee endpoint relative to a network using the Zigbee communication protocol, and simultaneously as part of a neighboring network of conventional Zigbee devices (i.e., Zigbee routers or Zigbee endpoints) relative to neighboring networks also based on the Zigbee communication protocol. The network device can then perform radio frequency sensing as part of an adjacent Zigbee network and simultaneously report the results of the radio frequency sensing to the network controlled by the radio frequency sensing control device as a Zigbee endpoint.

[0061] In another exemplary embodiment, the network control unit may be adapted to control at least one network device to send a trigger message to a neighboring network device, which is obligated to respond (i.e., send a return message) according to the communication protocol or standard used by the neighboring network. The return message may even be a message inquiring about the meaning of the trigger message, or even an error message indicating that the trigger message is not understood and / or supported by the neighboring network device. The network control unit may be adapted to determine trigger messages that may be useful to the neighboring network device in triggering the return message, based on neighboring network information provided by a neighboring network information providing unit. For example, useful trigger messages may be stored in the network control unit depending on information about which network communication protocol the neighboring network uses. The network control unit may then be adapted to control the network device to determine the RSSI of the return message for radio frequency sensing. Possible trigger message / return message pairs may be beacon request / response pairs of communication protocols. Furthermore, other trigger message / return message pairs may also be used, where such pairs may even be newly implemented in the hardware or software of the network device, or may be newly introduced into the network's communication protocol. For example, the network device (e.g., a Hue lamp) may be implemented, either in hardware or software, to respond to InterPAN communication including a specific trigger message by providing a short return message that is particularly useful for radio frequency sensing. This trigger / response message pair can be implemented independently of the specific communication protocol in the network device. In the case of Wi-Fi, beacon frames can be used, which refer to periodic pulses (pings) that routers / access points can send at a configurable rate. These beacon frames are received by all devices within the area, regardless of whether the device is part of the network. Typically, beacon frames are used to indicate the presence and / or characteristics of a network generated by a router or access point. Therefore, in Wi-Fi applications, these messages can also be used for radio frequency detection.

[0062] In one embodiment, the network control unit may be adapted to control a network device to communicate with neighboring network devices using the ESP-now protocol and to utilize ESP-now returned messages for radio frequency sensing. The ESP-now protocol refers to a communication protocol developed by Espressif for enabling communication between multiple network devices without using the Wi-Fi protocol, whereby ESP-now allows direct and low-power communication using the same 802.11 radio. In one example, if a network utilizing the Wi-Fi communication protocol is provided in a garden, and one neighboring device is outside the range of the Wi-Fi network, the network control unit may be adapted to control one of the network devices near the neighboring device to communicate with the neighboring network device using the ESP-now protocol to provide messages that can be used for radio frequency sensing. Alternatively, other network protocols providing the same functionality as ESP-now may also be utilized accordingly.

[0063] The implementation using trigger / return message pairs for radio frequency sensing is particularly useful in applications using network devices with Zigbee radio capabilities, such as smart meters or streetlights. Furthermore, this implementation is also useful in Wi-Fi radio frequency sensing if neighboring network devices include Wi-Fi radio capabilities, where, for example, network devices belonging to public Wi-Fi infrastructure buildings on streetlight poles in urban areas can be used. Such public Wi-Fi routers or access points are available at regular distances in urban areas in many applications, allowing coverage of portions of the area surrounding the networked building (such as the front of the house or the garden) using these network devices provided outside the building, which is particularly valuable for security purposes.

[0064] The radio frequency (RF) sensing control device may also be adapted to provide, for example, a privacy protection unit in all embodiments described above or below, which is adapted to manage security measures regarding the interaction between at least one network device and at least one neighboring network device and / or regarding RF sensing results obtained based on signals detected from neighboring network devices. Since, in the mentioned applications, a network device belonging to one person may interact with a network device belonging to another person or with a public network device, providing security measures may become important for the user to accept such interaction. For example, the security management unit may be adapted to control RF sensing between two networks, making it impossible to obtain information about activity in a neighboring room from RF sensing, and preventing the results of RF transmissions from being used with malicious intent. In an exemplary embodiment, the security management unit may be adapted to provide a privacy setting to the user, for example, via a display, in which the user consents to his / her network device being allowed to provide trigger messages, and in response to trigger messages provided by a neighboring network device also using the RF sensing control device. For example, such a setting may be provided on a reciprocal basis, "If you help me, I'll help you." Furthermore, the security management unit may also be adapted to provide different RF sensing modes, which may be enabled, for example, at different times. For example, at certain times and in certain configurations, based on different security settings and different interactions between the network and neighboring networks, basic occupancy detection, fall detection, people counting detection, or breathing detection may be available. For instance, if the detection area of ​​the neighboring network has been determined to be unoccupied (e.g., during nighttime), radio frequency-based breathing detection using the network and the neighboring network may only be permitted by the neighboring network and / or the network's security management unit. Furthermore, the security management unit can be adapted to allow the use of neighboring network devices only for a predetermined amount of time, such as every two minutes and ten seconds. This allows for increased accuracy and reliability of radio frequency sensing within the network itself, while preventing the collection of privacy-sensitive statistics about users of the neighboring network, or preventing noticeable negative impacts of radio frequency sensing on the performance of the neighboring network (e.g., due to additional bandwidth usage).

[0065] The following describes some further preferred embodiments of the invention in detail. In one embodiment, for example, at least for radio frequency (RF) sensing purposes, the network device and neighboring network devices are already part of the same network, since the network control unit of at least one network has controlled the network device to join the neighboring network. In this case, the primary RF sensing device (i.e., the network device of the network controlled by the RF sensing control device) can send all kinds of messages and receive responses from the secondary RF sensing devices (i.e., the neighboring network devices). The network device can then use the RSSI and / or CSI of the message sent by the neighboring network device. In this case, RF sensing can be provided, although the neighboring network devices may not even be able to provide their own RF reception results to the network. In contrast, in a complete RF sensing system, the body of the message can carry the RF reception results of other nodes that have been pre-recorded. Therefore, in an embodiment with two different networks (i.e., the network and the neighboring network), the two different networks only cooperate in RF sensing, and less data is available compared to a single network performing RF sensing within its own detection area.

[0066] If a device (i.e., a network device controlled by an RF sensing control device) and a neighboring network device are on two different networks, namely the local network and the neighboring network, in one embodiment, the Zigbee certificates of the two networks can be shared, for example, as part of the neighboring network information. In this case, at least one network device can temporarily switch its communication channel, PAN, and certificate, communicate with the neighboring network device as part of the neighboring network, and then switch back. Preferably, for this embodiment, the network control unit is adapted to control the network devices such that the two networks communicate on the same communication channel. Furthermore, the network control unit can be adapted to control network devices capable of being part of two networks simultaneously. In this case, the network device can be controlled to add the neighboring network as a network and continuously be part of two parallel networks. Preferably, the network device can be used to interact with a neighboring network device capable of managing two PANs and corresponding network keys.

[0067] In embodiments where the neighboring network uses the Zigbee communication protocol or at least one neighboring network device is capable of Zigbee communication, the implemented Zigbee beacon request / response messages can be used for radio frequency (RF) sensing. The trigger message in the above embodiments can be, for example, proprietary or simply a normal Zigbee message. For example, a network device may occasionally send a trigger message requesting a Zigbee neighbor table, where the neighbor table includes a list of all neighboring network devices that can communicate with the interacting neighboring network device, and received RSSIs for communicating with all neighboring network devices in the list. However, since the neighbor table may only be updated with 15s link-state messages, the RSSI data may not have sufficient granularity for reliable RF sensing on its own.

[0068] In one embodiment, a network device (such as a Philips Hue light) can be controlled to send a proprietary trigger message, which causes a neighboring network to extend its response with additional metadata. For example, a neighboring network device can add the last 10 RSSI values ​​it has already seen within the neighboring network to its response, and then report the RSSI of the received trigger message. Such embodiments can lead to further penetration into areas occupied by neighboring network devices, or provide more sensing details in the time domain.

[0069] In one embodiment, existing responses from communication protocols (such as Wi-Fi pinging, keep-alive messages, etc.) can be used for RF sensing. Keep-alive messages (such as link-state messages in Zigbee) are typically sent every 15 seconds and may include signal quality indications for all network devices the sending network device has been listening to. In some applications, using these messages for RF sensing can lead to inaccurate results. To improve RF sensing performance, in such cases, it is preferable that the network control unit is adapted to request, for example, that the communication rate (e.g., the link-state message delivery rate) be increased to one message every 2 seconds for a selected subset of neighboring network devices. Such an embodiment can also be combined with embodiments where two networks use the same communication channel. This improves the performance of RF sensing based solely on listening to communications from neighboring networks (e.g., link-state messages from neighboring network devices).

[0070] This RF sensing mode, based solely on keep-alive messages, can be used in areas where wireless messaging is restricted, yet basic RF sensing is still required. During dedicated time windows, an increased frequency of communication messages can also be requested to avoid unnecessary network congestion when occupancy detection is not needed, and / or gating can be achieved via dedicated trigger messages. For example, security use cases typically operate when the area / home is unoccupied, resulting in fewer control messages from normal network devices, and any increased latency in responding to control commands (e.g., due to a larger volume of link-state messages) is acceptable, as no one will be affected by the increased delay.

[0071] In one embodiment, the network control unit may be adapted to control network devices to utilize passive "eavesdropping" by, for example, measuring the RSSI value of a standard message sent within a neighboring network. In this case, the radio frequency sensing network device may not be able to decode the message sent by the neighboring network device, but if the network device physically receives such a message, it can extract the RSSI value of the message and the ID of the possible sending neighboring network device by analyzing the message header rather than the payload, i.e., the RSSI can be determined independently of addressing.

[0072] Preferably, in this embodiment, the network control unit is adapted to control the network to operate on the same communication channel (e.g., the same Zigbee channel) as the neighboring networks. Alternatively, in the case of a Zigbee network, a "terminal device" method can be used, in which network devices of the network are controlled to act as terminal devices of their own network while eavesdropping on messages on neighboring networks.

[0073] In one embodiment, a cooperative model between a network and neighboring networks can be utilized. This embodiment is particularly useful in applications where the network is owned by a first owner and the potential neighboring networks are owned by a second owner (i.e., a neighbor of the first owner). This embodiment will be described below for this application; however, other applications are also contemplated. The first owner and neighbors of a network located in a first apartment may agree to use the invention described above for inter-network radio frequency sensing. In this case, the network control unit can control some of the first owner's network devices, i.e., "first devices," to change their state to an end-device state relative to their own "first" network and spend most of their time listening to communications on the neighboring network's communication channels to perform radio frequency sensing based on interactions with some of the neighboring network devices. The first devices, as end-devices, can then report the radio frequency sensing results to their own network, for example, to their own bridge. Preferably, in this embodiment, the network control unit may be adapted to control network devices or request control of neighboring network devices such that a shared encryption key is used for messages related to radio frequency sensing. In an example where both networks include a bridge architecture, the bridges of both networks may be adapted, upon a request from the network control unit, to instruct the network devices associated with the respective bridges to share an encryption key for messages related to radio frequency sensing. For multi-bridge applications, the network control unit can be adapted to coordinate between different bridges to provide sharing of streaming encryption keys. However, in two networks, such as two apartments, it can be difficult for a single light to operate RF sensing simultaneously. Therefore, if inter-network RF sensing is required for two networks, it is preferable that different network devices in each network are separately assigned for sensing in that network and the neighboring network. Preferably, in this arrangement, the control of both networks uses the same communication channel, such as a Zigbee RF channel. In this case, the network device interacting with the neighboring network device can remain a normal router and can use a standard InterPAN. However, even in this case, it is still preferable that the encryption key used for RF sensing is shared between the local network and the neighboring network.

[0074] If both networks are in "armed security" mode, the radio frequency sensing algorithm can run on a single group of network devices to cover one's own and a neighbor's residence and / or garden, where both residences benefit from the same sensing cluster. For example, if an apartment owner and his neighbor each have two network devices (such as smart lights) in their gardens, they can aggregate them into a detection group of four network devices based on the invention described above. Preferably, in the basic scenario, if any movement is detected, the lights in both gardens are turned on. In a preferred embodiment in this case, the details of the radio frequency levels can be balanced to discern which light an intruder is closest to and therefore which of the two gardens. For example, when using Wi-Fi CSI sensing, a sensing event is stronger if a person is closer to the transmitting node than the receiving node.

[0075] In one application, one of the above embodiments can be used for staircase monitoring in a hotel or apartment building. In this application, radio frequency sensing can be provided by light from many different networks employing, for example, different Philips Hue bridges, where the radio frequency sensing of the different networks can be based on the principles described above in this invention. In hotel complexes, most people use elevators. However, instead, some people use stairs and emergency exit doors to leave the building. For example, when leaving a hotel, the opening of the door leading to the outside may allow an unwelcome person without a hotel keycard access certificate to tailgate inwards. Therefore, it is desirable to monitor the staircases to detect potential intruders. For this purpose, the above invention can be used, wherein when a tailgating person is detected, a network including a lighting system can be controlled by a network control unit to signal the intruder that he has been detected, for example by providing a light effect or a pre-recorded message, and request that the person leave and re-enter using his room key. Optionally, if a person opens the door first but, for example, walks back into the house because he / she has forgotten something, a secondary detection mechanism can be applied to eliminate false triggering. If the radio frequency sensor detects someone following at the emergency exit in this situation, it can take a picture of the potential intruder, but for privacy reasons, it will not take a picture of anyone who has already entered correctly using their keycard.

[0076] Although in the above embodiments the network and neighboring networks are described as using Zigbee or Wi-Fi communication protocols, in other embodiments other communication protocols (e.g., Thread, ESP-now, or Bluetooth) may be used while employing the same principles as the present invention described above.

[0077] Although the network described in the above embodiments includes more than one network device, in certain embodiments the network may include only one network device that enables the network, such that in this case the network device can be considered a network and the range of the detection area can be considered zero, or it may rely on an appropriate reflector in the network device environment that allows the network device to use its own signal for radio frequency sensing.

[0078] By studying the accompanying drawings, the disclosure, and the appended claims, those skilled in the art can understand and implement other variations of the disclosed embodiments in practicing the claimed invention.

[0079] In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality.

[0080] A single unit or device can perform the functions of several items listed in the claims. The mere fact that certain measures are referenced in mutually different dependent claims does not indicate that a combination of these measures cannot be used advantageously.

[0081] Processes performed by one or more units or devices (such as providing information about neighboring networks, controlling at least one network device, etc.) can be performed by any other number of units or devices. These processes—particularly the control of network devices according to control methods performed by radio frequency sensing and control devices—can be implemented as program code devices of computer programs and / or as dedicated hardware.

[0082] Computer programs can be stored / distributed on suitable media, such as optical storage media or solid-state media, provided together with or as part of other hardware; but they can also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems.

[0083] Any reference numerals in the claims should not be construed as limiting the scope.

[0084] This invention relates to a control device for controlling radio frequency (RF) sensing in a network (e.g., a Zigbee or Wi-Fi network) including a detection area. The control device includes: a neighbor network information providing unit, wherein the neighbor network includes neighbor network devices adjacent to network devices of the network; and a network control unit for controlling the network devices based on the provided neighbor network information, such that the network devices are capable of detecting signals usable for RF sensing in a detection area extending beyond the network's detection area and / or signals usable for RF sensing in the network's detection area, wherein the detected signals are transmitted by at least one neighbor network device. This allows for improved RF detection in the network's perimeter area.

Claims

1. A radio frequency (RF) sensing control device arranged for controlling RF sensing in a network (100) including at least one network device (101, 102, 103, 104), wherein at least one network device (103) is adapted to perform RF sensing in a detection area (120) of the network (100) based on communication signals transmitted within the network (100), wherein the RF sensing control device (110) comprises: A neighbor network information providing unit (111) is configured to provide information about a neighbor network (150), wherein the neighbor network (150) includes at least one neighbor network device (154) adjacent to the at least one network device (103) of the network (100), and A network control unit (112) is arranged to control the at least one network device (103) based on provided neighbor network information, such that the at least one network device (103) of the network (100) is capable of detecting radio frequency sensing in a detection area (170) extending outside the detection area (120) of the network (100) and / or signals that can be used for radio frequency sensing in the detection area (120) of the network (100), wherein the detected signals are transmitted by at least one neighbor network device; The network control unit (112) is adapted to control the at least one network device (103) based on the provided information, enabling it to interact with at least one neighboring network device, and the network control unit (112) is adapted to control the at least one network device (103) to perform radio frequency sensing based on the interaction with the at least one interacting neighboring network device; and The network control unit (112) is adapted to control the at least one network device (103) to interact with the at least one neighboring network device (154) by sending a trigger message to the at least one interacting neighboring network device (154), and to perform radio frequency sensing using the return signal of the at least one interacting neighboring network device (154).

2. The radio frequency sensing control device according to claim 1, wherein the network control unit (112) is adapted to control the at least one network device (103) such that it determines the signal quality characteristics of the communication signals of the at least one neighboring network device (154) and uses the signal quality characteristics for radio frequency sensing.

3. The radio frequency sensing control device according to claim 1, wherein the trigger message is selected such that the return signal of the at least one interacting neighbor network device (154) indicates its connection with other neighbor network devices of the neighbor network (150) and / or its connection with one or more network devices (101, 102, 103, 104) of the network (100).

4. The radio frequency sensing and control device according to claim 3, wherein, The return signal indicates a change in the signal quality characteristics of the connection between the at least one interacting neighbor network device (154) and other neighbor network devices of the neighbor network (150) and / or its connection to one or more network devices (101, 102, 103, 104) of the network (100) during a predetermined past time period.

5. The radio frequency sensing control device according to claim 4, wherein the network control unit (112) is adapted to control the network device (103) to perform radio frequency sensing during the predetermined past time period based on the change in signal strength of the connection between the at least one interacting neighbor network device (154) and the connected neighbor network devices of the neighbor network (150) during the predetermined past time period.

6. The radio frequency sensing control device according to any one of claims 1 and 2, wherein the network control unit (112) is adapted to control the at least one network device (103) such that it listens for network maintenance messages or other messages for communication between network devices in the neighboring network (150), wherein the network control unit (112) is then adapted to control the network device (103) to perform radio frequency sensing based on the received messages.

7. The radio frequency sensing control device according to claim 1, wherein the network control unit (112) is adapted to control the at least one network device (103) to interact with at least one neighbor network device (154) by entering and at least partially becoming part of the neighbor network (150), and to perform radio frequency sensing as part of the neighbor network (150), wherein the network control unit (112) is also adapted to control the at least one network device (103) to report the results of the radio frequency sensing performed as part of the neighbor network (150).

8. The radio frequency sensing control device according to any one of claims 1-5 and 7, wherein the network control unit (112) is adapted to control the at least one network device (103) based on the information provided, such that the network device (103) transmits a control trigger message capable of controlling at least one neighboring device to change the timing of communication signals used for communication within the neighboring network (150), and controlling the at least one network device (103) to use the communication signals of the neighboring network (150) for radio frequency sensing.

9. The radio frequency sensing control device according to any one of claims 1-5 and 7, wherein the neighbor network information providing unit (111) is adapted to provide a network channel as information about the neighbor network (150), the network device (103) is capable of communicating with the neighbor network (150) on the network channel, and wherein the network control unit (112) is adapted to control at least some network devices (101, 102, 103, 104) of the network (100) to also communicate on the network channel provided by the neighbor network (150).

10. The radio frequency sensing control device according to any one of claims 1-5 and 7, wherein the network (100) is a Wi-Fi, Thread, Bluetooth, cellular device-to-device communication, V2X protocol, ESP-now or Zigbee network, and the neighbor network (150) is a Wi-Fi, Thread, Bluetooth, cellular device-to-device communication, V2X protocol, ESP-now or Zigbee network.

11. A network comprising: At least two network devices (101, 102, 103, 104), wherein at least one network device (103) is adapted to perform radio frequency sensing in a detection area (120) of the network (100), and The radio frequency sensing and control device (110) according to claim 1.

12. A radio frequency sensing control method for controlling radio frequency sensing in a network (100) including at least one network device (101, 102, 103, 104), wherein at least one network device (103) of the network device is adapted to perform radio frequency sensing in a detection area (120) of the network (100) based on communication signals transmitted within the network (100), wherein the radio frequency sensing control method includes: Provide (201) information about a neighboring network (150), wherein the neighboring network (150) includes at least one neighboring network device (154) adjacent to at least one network device (103) of the network (100). Control (202) the at least one network device (103) based on the provided neighbor network information, such that the network device (103) of the network (100) is able to detect radio frequency sensing in a detection area (170) extending outside the detection area (120) of the network (100) and / or signals that can be used for radio frequency sensing in the detection area (120) of the network (100), wherein the detected signals are transmitted by at least one neighbor network device; The method further includes: Based on the provided information, the at least one network device (103) is controlled to interact with at least one neighboring network device, wherein the network control unit (112) is adapted to control the at least one network device (103) to perform radio frequency sensing based on the interaction with at least one interacting neighboring network device, and The at least one network device (103) is controlled to interact with the at least one neighboring network device (154) by sending a trigger message to the at least one interacting neighboring network device (154), and radio frequency sensing is performed using the return signal of the at least one interacting neighboring network device (154).

13. A computer program for controlling radio frequency sensing in a network (100), wherein the computer program includes program code means for causing the radio frequency sensing control device (110) of claim 1 to perform the steps of the radio frequency sensing control method defined in claim 12 when the computer program is executed by the radio frequency sensing control device (110) of claim 1.

Images