Motion localization wireless mesh network based on motion indicator value
The wireless mesh network system addresses the limitations of existing motion detection systems by using movement indicator values and time factors to accurately detect and localize movement within a space without requiring a direct line of sight, improving spatial detection capabilities.
Patent Information
- Application Number
- JP2025025158
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2017-10-20
- Filing Date
- 2025-02-19
- Publication Date
- 2025-06-24
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing motion detection systems often require a clear line of sight and are limited in their ability to accurately determine the location of detected movement within a space using wireless communication devices.
A wireless mesh network system utilizing movement indicator values and time factors derived from wireless signals to detect and localize movement without the need for a direct line of sight, employing a combination of movement indicator values and time coefficients to determine the location of detected motion based on wireless communication devices and links within the network.
Enables accurate detection and localization of movement in various environments by leveraging wireless signals, enhancing the system's ability to identify the location of detected motion using movement indicator values and time factors, even in complex spatial configurations.
Smart Images

Figure 2025093937000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to motion detection and localization.
[0002] (Claim of Priority) This application claims priority to U.S. Patent Application No. 15 / 789,761, filed October 20, 2017, entitled "Motion Localization in a Wireless Mesh Network Based on Motion Indicator Values", the disclosure of which is incorporated herein by reference.
Background Art
[0003] Motion detection systems have been used, for example, to detect the movement of objects within a room or an outdoor area. In some exemplary motion detection systems, infrared sensors or optical sensors are used to detect the movement of objects within the field of view of these sensors. Motion detection systems are used in security systems, automatic control systems, and other types of systems.
Brief Description of the Drawings
[0004]
Figure 1A
Figure 1B
Figure 1C
Figure 2
Figure 3A
Figure 3B
Figure 4A
Figure 4B
Figure 5A
Figure 5B
Figure 5C
Figure 5D
Figure 6
[0005] In some aspects of the content described in this specification, the location of the detected movement in space can be determined based on a movement indicator value, a time coefficient, or a combination of these. For example, in some cases, the location of the detected movement can be determined based on the movement indicator value for each wireless communication device or link in a wireless communication system such as a wireless mesh network. The movement indicator value for an individual wireless communication device can represent the degree of movement detected by the individual wireless communication device (generally or on a specific communication link) and can be based on a subset of the wireless signals transmitted or received by the wireless communication device. The location of the detected movement in space can be assumed to be near one or more of the wireless communication devices having the maximum movement indicator value. The location can be determined by selecting the maximum movement indicator value or by selecting movement indicator values greater than a threshold value.
[0006] As another example, in some cases, the location of the detected movement can be determined based on a time factor for each wireless communication device or link. The time factor can be (i) the range of sequence values included in the movement probe signal used to detect movement on the communication link, (ii) the set (e.g., all) of sequence values included in the movement probe signal used to detect movement on the communication link, (iii) the minimum or maximum sequence value within the set of sequence values included in the movement probe signal used to detect movement on the communication link, or (iv) another indicator of the time period during which the movement probe signal is obtained to detect movement, or can be based on these. For example, the time factor can be a weighting factor based on the maximum or minimum sequence value within the set of movement probe signals used to detect movement by a device or on a particular communication link between devices. Using this weighting factor, the movement indicator value for a device or link can be weighted, and the weighted movement indicator value can be used to determine the location of the detected movement.
[0007] The systems and techniques described herein can, in some cases, provide one or more advantages. For example, the movement of an object can be detected based on wireless signals (e.g., radio frequency (RF) signals) received by a wireless communication device without the need for a clear line of sight. Additionally, the location of the detected movement can be determined based on the movement indicator value, the time factor, or both, for each of a plurality of wireless communication devices.
[0008] FIG. 1A shows an exemplary wireless communication system 100. The exemplary wireless communication system 100 includes three wireless communication devices, namely, a first wireless communication device 102A, a second wireless communication device 102B, and a third wireless communication device 102C. The exemplary wireless communication system 100 can include additional wireless communication devices and other components (e.g., additional wireless communication devices, one or more network servers, network routers, network switches, cables, or other communication links, etc.).
[0009] The exemplary wireless communication devices 102A, 102B, and 102C can operate within a wireless network, for example, in accordance with a wireless network standard or another type of wireless communication protocol. For example, the wireless network can be configured to operate as a wireless local area network (WLAN), a personal area network (PAN), a metropolitan area network (MAN), or another type of wireless network. Examples of WLANs include networks (e.g., Wi-Fi networks) configured to operate in accordance with one or more of the 802.11 family of standards developed by the IEEE. Examples of PANs include networks that operate in accordance with short-range communication standards (e.g., BLUETOOTH®, near field communication (NFC), ZigBee®), millimeter wave communication, etc.
[0010] In some implementation configurations, the wireless communication devices 102A, 102B, and 102C can be configured to communicate within a cellular network, for example, according to cellular network standards. Examples of cellular networks include networks configured according to 2G standards such as Global System for Mobile Communications (GSM) and GSM Enhanced Data Rates for GSM Evolution (EDGE) or EGPRS, Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA (registered trademark)), Universal Mobile Telecommunications System (UMTS), and Time Division Synchronous Code Division Multiple Access (TD-SCDMA) for 3G standards, and Long Term Evolution (LTE) and LTE-Advanced (LTE-A) for 4G standards, and the like.
[0011] In the example shown in FIG. 1A, the wireless communication devices 102A, 102B, and 102C can be or include standard wireless network components. For example, the wireless communication devices 102A, 102B, and 102C can be commercially available Wi-Fi access points, or another type of wireless access point (WAP) that executes one or more operations described herein incorporated as instructions (e.g., software or firmware) on a WAP modem. In some examples, the wireless communication devices 102A, 102B, and 102C can be nodes of a wireless mesh network, such as a commercially available mesh network system (e.g., GOOGLE WIFI). In some examples, another type of standard or conventional Wi-Fi transmitter device can be used. The wireless communication devices 102A, 102B, and 102C can be implemented without Wi-Fi components, for example, other types of standard or non-standard wireless communication can be used for motion detection. In some examples, the wireless communication devices 102A, 102B, and 102C can be or be part of a dedicated motion detection system. For example, a dedicated motion detection system can include a hub device and one or more beacon devices (as remote sensor devices), and the wireless communication devices 102A, 102B, and 102C can be either the hub device or a beacon device in the motion detection system.
[0012] As shown in FIG. 1A, an exemplary wireless communication device 102C includes a modem 112, a processor 114, a memory 116, and a power supply unit 118. Any of the wireless communication devices 102A, 102B, and 102C within the wireless communication system 100 can include the same components, additional components, or different components, and these components can be configured to operate as shown in FIG. 1A or in another way. In some embodiments, the modem 112, processor 114, memory 116, and power supply unit 118 of the wireless communication device are housed together in a common housing or other assembly. In some embodiments, one or more of the components of the wireless communication device can be separately housed, for example, in separate housings or other assemblies.
[0013] The exemplary modem 112 can communicate (receive, transmit, or do both) wireless signals. For example, the modem 112 can be configured to communicate radio frequency (RF) signals formatted according to a wireless communication standard (such as Wi-Fi or Bluetooth). The modem 112 can be implemented as the exemplary wireless network modem 112 shown in FIG. 1B, or can be implemented in another way using, for example, other types of components or subsystems. In some embodiments, the exemplary modem 112 includes a radio subsystem and a baseband subsystem. In some examples, the baseband subsystem and the radio subsystem can be implemented on a common chip or chipset, or can be implemented on a card or another type of assembled device. The baseband subsystem can be coupled to the radio subsystem by, for example, leads, pins, wires, or other types of connections. FIG. 1B shows an exemplary modem 112 of a wireless communication device.
[0014] In some examples, the wireless subsystem within modem 112 can include one or more antennas and radio frequency circuitry. The radio frequency circuitry can include, for example, circuitry to filter, amplify, or otherwise condition an analog signal, circuitry to up-convert a baseband signal to an RF signal, circuitry to down-convert an RF signal to a baseband signal, and the like. Such circuitry can include, for example, filters, amplifiers, mixers, local oscillators, and the like. The wireless subsystem can be configured to transmit radio frequency wireless signals over a wireless communication channel. As an example, the wireless subsystem can include the wireless chip 113, RF front end 115, and one or more antennas 117 shown in FIG. 1B. The wireless subsystem can include additional or different components. In some implementations, the wireless subsystem can be or include wireless electronics (e.g., an RF front end, wireless chip, or similar components) from a legacy modem such as, for example, a Wi-Fi modem, a pico base station modem, and the like. In some implementations, the antenna includes a plurality of antennas.
[0015] In some examples, the baseband subsystem within the modem 112 can include, for example, digital electronic devices configured to process digital baseband data. As an example, the baseband subsystem can include the baseband chip 111 shown in FIG. 1B. The baseband subsystem can include additional or different components. In some examples, the baseband subsystem can include a digital signal processor (DSP) device or another type of processor device. In some examples, the baseband system can include digital processing logic circuitry that operates the radio subsystem, transmits wireless network traffic via the radio subsystem, detects movement based on movement detection signals received via the radio subsystem, or performs other types of processing. For example, the baseband subsystem can be configured to encode a signal and send the encoded signal to the radio subsystem for transmission, or to identify and analyze the encoded data in a signal from the radio subsystem (e.g., by decoding the signal according to a wireless communication standard, by processing the signal according to a movement detection process, or otherwise), and can include one or more chips, chip sets, or other types of devices.
[0016] In some cases, the wireless subsystem within the exemplary modem 112 receives a baseband signal from the baseband subsystem, upconverts this baseband signal to a radio frequency (RF) signal, and wirelessly transmits this radio frequency signal (e.g., via an antenna). In some cases, the wireless subsystem within the exemplary modem 112 wirelessly receives a radio frequency signal (e.g., via an antenna), downconverts this radio frequency signal to a baseband signal, and sends this baseband signal to the baseband subsystem. The signals exchanged between the wireless subsystem and the baseband subsystem can be digital signals or analog signals. In some embodiments, the baseband subsystem includes a conversion circuit (e.g., a digital-to-analog converter, an analog-to-digital converter) and exchanges analog signals with the wireless subsystem. In some embodiments, the wireless subsystem includes a conversion circuit (e.g., a digital-to-analog converter, an analog-to-digital converter) and exchanges digital signals with the baseband subsystem.
[0017] In some examples, the baseband subsystem of the exemplary modem 112 can transmit wireless network traffic (e.g., data packets) within a wireless communication network over one or more network traffic channels via the wireless subsystem. Also, the baseband subsystem of the modem 112 can transmit or receive (or both) signals (e.g., motion probe signals or motion detection signals) over a dedicated wireless communication channel via the wireless subsystem. In some cases, the baseband subsystem generates and transmits a motion probe signal for exploring space with respect to motion, for example. In some cases, the baseband subsystem processes a received motion detection signal (a signal based on a motion probe signal transmitted through space) to detect, for example, the motion of an object within the space.
[0018] Exemplary processor 114 can, for example, execute instructions to generate output data based on data input. These instructions can include a program, code, script, or other type of data stored in memory. Additionally or alternatively, the instructions can be encoded as pre-programmed or reprogrammable logic circuitry, logic gates, or other types of hardware or firmware components. Processor 114 can be or include a dedicated coprocessor or a general-purpose microprocessor as another type of data processing device. In some examples, processor 114 performs the high-level operations of wireless communication device 102C. For example, processor 114 can be configured to execute or interpret software, scripts, programs, functions, executable files, or other instructions stored in memory 116. In some implementations, processor 114 can be included in modem 112.
[0019] Exemplary memory 116 can include, for example, computer-readable media such as volatile memory devices, non-volatile memory devices, or both. Memory 116 can include one or more read-only memory devices, random access memory devices, buffer memory devices, or combinations of these and other types of memory devices. In some cases, one or more components of the memory can be integrated with or otherwise associated with another component of wireless communication device 102C. Memory 116 can store instructions executable by processor 114. For example, the instructions can include instructions to determine the location of a detected movement, for example, by one or more of the operations of exemplary process 600 of FIG. 6.
[0020] The exemplary power supply unit 118 supplies power to other components of the wireless communication device 102C. For example, the other components can operate based on the power supplied by the power supply unit 118 via a voltage bus or other connection. In some implementations, the power supply unit 118 includes a battery or battery system, such as a rechargeable battery. In some implementations, the power supply unit 118 includes an adapter (e.g., an AC adapter) that receives an external power signal (from an external signal source) and converts the external power signal into an internal power signal adjusted for the components of the wireless communication device 102C. The power supply unit 118 can include other components or operate in another manner.
[0021] In the example shown in FIG. 1A, the wireless communication devices 102A and 102B transmit wireless signals (e.g., according to a wireless network standard, a motion detection protocol, or other means). For example, the wireless communication devices 102A and 102B can broadcast wireless signals (e.g., a reference signal, a beacon signal, a status signal, etc.) or send addressed wireless signals to other devices (e.g., user equipment, client devices, servers, etc.). Also, other devices (not shown) as well as the wireless communication device 102C can receive the wireless signals transmitted by the wireless communication devices 102A and 102B. In some examples, the wireless signals transmitted by the wireless communication devices 102A and 102B are periodically repeated, e.g., according to a wireless communication standard or other means.
[0022] In the illustrated embodiment, the wireless communication device 102C processes wireless signals from the wireless communication devices 102A and 102B to detect the movement of an object within the space accessed by the wireless signal, or to determine the location of the detected movement, or both. For example, the wireless communication device 102C can perform one or more operations of the exemplary process 600 of FIG. 6, or another type of process for detecting movement or determining the location of the detected movement. The space accessed by the wireless signal can be an indoor or outdoor space that can include, for example, one or more fully or partially enclosed areas, unenclosed open areas, etc. This space can be the interior of a room, multiple rooms, a building, or the like, or can include these. In some examples, the wireless communication system 100 can be modified such that, for example, the wireless communication device 102C transmits a wireless signal and the wireless communication devices 102A and 102B process the wireless signal from the wireless communication device 102C to detect movement or determine the location of the detected movement.
[0023] The wireless signals used for motion detection can include, for example, beacon signals (e.g., Bluetooth beacons, Wi-Fi beacons, other wireless beacon signals), signals of another standard generated for other purposes according to wireless network standards, or non-standard signals (e.g., random signals, reference signals, etc.) generated for motion detection or other purposes. In some embodiments, the wireless signal propagates through an object (e.g., a wall) before or after the interaction with the moving object, thereby enabling the movement of the moving object to be detected without the need for a line-of-sight optical path between the moving object and the transmitting or receiving hardware. Based on the received signal, the third wireless communication device 102C can generate motion detection data. In some cases, the third wireless communication device 102C can transmit the motion detection data to another device or system, such as a security system, and these devices or systems can include a control center for monitoring the movement within a space such as a room, a building, an outdoor area, etc.
[0024] In some implementation configurations, the wireless communication devices 102A and 102B can be changed to transmit a motion probe signal (which can include, for example, a reference signal, a beacon signal, or another signal used to explore the space with respect to motion) on a wireless communication channel (e.g., a frequency channel or an encoded channel) separated from the wireless network traffic signal. For example, the third wireless communication device 102C can recognize the modulation applied to the payload of the motion probe signal and the type of data or data structure within this payload, thereby reducing the processing amount for the third wireless communication device 102C to perform motion detection. The header can include additional information such as, for example, an indication of whether another device within the communication system 100 has detected motion, an indication of the modulation type, and the identification information of the device transmitting the signal.
[0025] In the example shown in FIG. 1A, the wireless communication system 100 is a wireless mesh network having a wireless communication link between each of the respective wireless communication devices 102. In the illustrated example, the wireless communication link between the third wireless communication device 102C and the first wireless communication device 102A can be used to explore the first motion detection field 110A, and the wireless communication link between the third wireless communication device 102C and the second wireless communication device 102B can be used to explore the second motion detection field 110B, and the wireless communication link between the first wireless communication device 102A and the second wireless communication device 102B can be used to explore the third motion detection field 110C. In some cases, each wireless communication device 102C detects motion within the motion detection field 110 accessed by this device by processing a received signal based on a wireless signal transmitted through the motion detection field 110 by the wireless communication device 102. For example, when the person 106 shown in FIG. 1A moves within the first motion detection field 110A and the third motion detection field 110C, the wireless communication device 102 can detect the motion based on the signals received by these devices based on the wireless signals transmitted through the respective motion detection fields 110. For example, the first wireless communication device 102A can detect the motion of the person within both the motion detection fields 110A and 110C, the second wireless communication device 102B can detect the motion of the person 106 within the motion detection field 110C, and the third wireless communication device 102C can detect the motion of the person 106 within the motion detection field 110A.
[0026] In some cases, the motion detection field 110 can include, for example, air, solid materials, liquids, or another medium through which wireless electromagnetic signals can propagate. In the embodiment shown in FIG. 1A, the first motion detection field 110A provides a wireless communication channel between the first wireless communication device 102A and the third wireless communication device 102C, the second motion detection field 110B provides a wireless communication channel between the second wireless communication device 102B and the third wireless communication device 102C, and the third motion detection field 110C provides a wireless communication channel between the first wireless communication device 102A and the second wireless communication device 102B. In some aspects of operation, wireless signals transmitted over a wireless communication channel (separated from or shared with the wireless communication channel for network traffic) are used to detect the movement of objects in space. The object can be any type of stationary or movable object, and can be living or inanimate. For example, the object can be a human (e.g., the person 106 shown in FIG. 1A), an animal, an inanimate object, or another device, apparatus or assembly, an object that defines all or part of the boundary of the space (e.g., a wall, door, window, etc.), or another type of object. In some configurations, the motion information from the wireless communication device is analyzed to determine the location of the detected motion. For example, as further described below, one of the wireless communication devices 102 (or another device communicatively coupled to device 102) can determine that the detected motion is near a particular wireless communication device.
[0027] Figure 1C shows an exemplary communication path that defines a communication link between the wireless communication device 102A and the wireless communication device 102C of Figure 1A. In the illustrated embodiment, the first wireless communication device 102A includes a first modem 112A, and the third wireless communication device 102C includes a third modem 112C. The exemplary wireless modems 112A and 112C communicate with each other through a plurality of communication paths 121 to 124. The four communication paths 121 to 124 define a communication link 126 between the two wireless communication devices 102A and 102C. Each communication path is defined by the signal hardware path of the modem 112A and the signal hardware path of the modem 112C. For example, in the illustrated embodiment, the communication path 121 is defined by the antenna 128A of the modem 112A and the antenna 128C of the modem 112C, the communication path 122 is defined by the antenna 128A of the modem 112A and the antenna 130C of the modem 112C, the communication path 123 is defined by the antenna 130A of the modem 112A and the antenna 128C of the modem 112C, and the communication path 124 is defined by the antenna 130A of the modem 112A and the antenna 130C of the modem 112C. In some cases, the modems 112A and 112C can communicate through various communication paths 121 to 124 by transmitting signals (e.g., the same signal at each antenna) from both antennas 128 and 130, and these signals can be received by other modems using one or both of the antennas 128, 130 (e.g., depending on the interference in each communication path). For example, the signals transmitted by the antennas 128A, 130A can be received only by the antenna 128C of the modem 112C when there is significant interference near the communication paths 122, 124. In some implementation configurations, the signal hardware path includes a plurality of antennas of the modem. For example, the communication path can be defined by a plurality of antennas in the first modem 112A and a plurality of antennas in the third modem 112C.More specifically, each communication path exists between a transmitter (e.g., one or more than two transmitting antennas) of the first wireless communication device in the pair and a receiver (e.g., one or more than two receiving antennas) of the second wireless communication device in the pair. In a specific implementation configuration, modem 112 includes two transmitters and two receivers that provide four communication paths for each modem. In other modem configurations, different numbers of transmitters and receivers, such as two transmitters and four receivers that provide eight RF communication paths, can be included.
[0028] Figure 2 shows an exemplary motion probe signal 202. The exemplary motion probe signal 202 can be transmitted to monitor motion in space, for example, in a wireless communication system. In some embodiments, the motion probe signal 202 is transmitted in the form of a motion detection signal on a motion detection channel in a wireless communication network. In some embodiments, the motion probe signal 202 includes motion channel packets. For example, the motion probe signal 202 can include binary data, which is converted into an analog signal, up-converted to a radio frequency, and wirelessly transmitted by an antenna.
[0029] The motion probe signal 202 shown in FIG. 2 includes control data 204 and motion data 206. The motion probe signal 202 can include additional or different features and can be formatted in another way. In the illustrated embodiment, the control data 204 can include the type of control data included in a conventional data packet. For example, the control data 204 can include a preamble (also called a header) indicating the type of information included in the motion probe signal 202, an identifier of the wireless device that transmits the motion probe signal 202, the MAC address of the wireless device that transmits the motion probe signal 202, the transmission power, and the like. The motion data 206 is the payload of the motion probe signal 202. In some implementation configurations, the motion data 206 can be, for example, a pseudo-random code or another type of reference signal, or can include these. In some implementation configurations, the motion data 206 can be, for example, a beacon signal broadcast by a wireless network system, or can include this.
[0030] In one example, the motion probe signal 202 is transmitted by a wireless device (e.g., the wireless communication device 102A shown in FIG. 1A) and received by a motion detection device (e.g., the motion detection device 102C shown in FIG. 1A). In some examples, the control data 204 changes from transmission to transmission, for example, to indicate the transmission time or updated parameters. The motion data 206 can remain unchanged for each transmission of the motion probe signal 202. The motion detection device can process the received signal based on each transmission of the motion probe signal 202 and analyze the motion data 206 for changes. For example, a change in the motion data 206 can indicate the motion of an object within the space accessed by the wireless transmission of the motion probe signal 202. Next, the motion data 206 can be processed to generate, for example, a response to the detected motion.
[0031] Figures 3A and 3B show exemplary signals transmitted between wireless communication devices. As shown in FIGS. 3A and 3B, a plurality of exemplary paths of the wireless signal transmitted from the first wireless communication device 304A are shown by dashed lines. The wireless signal along the first signal path 316 is transmitted from the first wireless communication device 304A and reflected from the first wall 302A towards the second wireless communication device 304B. The wireless signal along the second signal path 318 is transmitted from the first wireless communication device 304A and reflected from the second wall 302B and the first wall 302A towards the third wireless communication device 304C. The wireless signal along the third signal path 320 is transmitted from the first wireless communication device 304A and reflected from the second wall 302B towards the third wireless communication device 304C. The wireless signal along the fourth signal path 322 is transmitted from the first wireless communication device 304A and reflected from the third wall 202C towards the second wireless communication device 304B.
[0032] In FIG. 3A, the wireless signal along the fifth signal path 324A is transmitted from the first wireless communication device 304A and reflected from the object at the first position 314A towards the third wireless communication device 304C. Between FIGS. 3A and 3B, the surface of the object moves from the first position 314A to the second position 314B (e.g., a distance away from the first position 314A) within the space 300. In FIG. 3B, the wireless signal along the sixth signal path 324B is transmitted from the first wireless communication device 304A and reflected from the object at the second position 314B towards the third wireless communication device 304C. The sixth signal path 324B shown in FIG. 3B is longer than the fifth signal path 324A shown in FIG. 3A due to the movement of the object from the first position 314A to the second position 314B. In some embodiments, the signal paths can be added, deleted, or otherwise changed due to the movement of an object within the space.
[0033] In the embodiments shown in FIGS. 3A and 3B, the first wireless communication device 304A can repeatedly transmit a wireless signal. Specifically, FIG. 3A shows that the wireless signal is being transmitted from the first wireless communication device 304A at a first time, and FIG. 3B shows that the same wireless signal is being transmitted from the first wireless communication device 304A at a second later time. The transmitted signal can be transmitted continuously, periodically, randomly, or intermittently in time or the like, or a combination thereof. The transmitted signal can have a plurality of frequency components within a frequency bandwidth. The transmitted signal can be transmitted omnidirectionally, unidirectionally, or in other ways from the first wireless communication device 304A. In the illustrated embodiment, the wireless signal passes through a plurality of respective paths within the space 300, and the signal along each path is attenuated due to path loss, scattering, reflection, etc., and can have a phase offset or a frequency offset.
[0034] As shown in FIGS. 3A and 3B, signals from various paths 316, 318, 320, 322, 324A, and 324B are combined at the third wireless communication device 304C and the second wireless communication device 304B to form a received signal. Due to the influence of the plurality of paths within the space 300 on the transmitted signal, the space 300 can be represented as a transfer function (e.g., a filter) into which the transmitted signal is input and from which the received signal is output. When an object moves within the space 300, the attenuation or phase offset that was affecting the signal in the signal path can change, and thus the transfer function of the space 300 can change. Assuming that the same wireless signal is transmitted from the first wireless communication device 304A, when the transfer function of the space 300 changes, the output of this transfer function, i.e., the received signal, will change as well. This change in the received signal can be used to detect the movement of the object.
[0035] Mathematically speaking, the transmitted signal f(t) transmitted from the first wireless communication device 304A can be represented according to the following equation (1):
Number
Number
Number
Number
[0036] Next, the received signal R at the wireless communication device can be analyzed. The received signal R at the wireless communication device can be converted into the frequency domain using, for example, the fast Fourier transform (FFT) or another type of algorithm. The converted signal can represent the received signal R as a series of n complex numerical values, where each value corresponds to each of the frequency components (at n frequencies ω n ). Regarding the frequency component at frequency ω n , the complex numerical value H n can be expressed as shown in the following formula (5).
Number
[0037] The complex number value H n for a given frequency component ω n indicates the relative magnitude and phase offset of the received signal at that frequency component ω n . When an object moves within space, the complex number value H n changes due to the channel response α n,k of the spatial variation. Therefore, the changes detected in the channel response can indicate the movement of an object within the communication channel. In some cases, noise, interference, or other phenomena may affect the channel response detected by the receiver, and the motion detection system can reduce or isolate such effects to enhance the accuracy and quality of the motion detection ability.
[0038] In some implementation configurations, the channel response can be expressed as follows.
Number
Number
Number
[0039] As shown in the above equation, the received signal can be regarded as the convolution of the reference signal and the channel response. The convolution operation means that the channel coefficients have a certain correlation with each of the delayed replicas of the reference signal. Therefore, the convolution operation shown in the above equation indicates that the received signal appears at different delay points and each delayed replica is weighted by the channel coefficients. In some cases, the channel response h ch with respect to space can be determined based on the channel state information (CSI) determined by the modem or other components of the wireless communication device that receives the wireless signal.
[0040] In some aspects, the signal quality metric for the received signal can be determined based on the channel response. For example, the channel response (h ch ) determined with respect to space is applied to the reference signal (R ef ) to obtain an estimated received signal ( TIFF2025093937000012.tif7150), and this estimated received signal can be used as an estimate of what the received signal should be based on the channel response (e.g., based on the convolution of the above-mentioned reference signal (R ef ) and the channel response (h ch ). The estimated received signal ( TIFF2025093937000013.tif7150) and the actual received signal (R cvd ) can be used to calculate a signal quality metric. In some embodiments, for example, the signal quality metric is the actual received signal (R cvd ) and the estimated received signal ( TIFF2025093937000014.tif7150) and the actual received signal (R cvd ) dot product of the difference between, for example,
Number
[0041] In some cases, a wireless communication device can "reject" a received signal. For example, in some implementation configurations, the motion detection process can include quality criteria for the signal. Received signals that do not meet the quality criteria can be rejected (e.g., discarded or ignored) and not considered in determining whether motion has occurred within the space 300. A signal can be accepted or rejected as an input to the motion detection process based on a signal quality metric (e.g., the value described by Equation (9)). For example, in some examples, motion is detected using only a subset of received signals having a value Q above a certain threshold.
[0042] Figures 4A and 4B illustrate an exemplary wireless communication system 400. In the illustrated embodiment, the exemplary wireless communication system 400 is a wireless mesh network that includes a plurality of remote sensor devices 402A, 402B, 402C, 402D, and a hub device 404, and each device can communicate wirelessly with one or more of the other devices within the system 400. In some cases, the wireless communication system 400 can be used within the wireless communication system 100 of FIG. 1A. The remote sensor devices 402 and the hub device 404 in FIGS. 4A and 4B can be implemented in the same or similar manner as the wireless communication devices 102A, 102B, and 102C of FIG. 1A, or the wireless communication device 302 of FIGS. 3A and 3B. Configurations other than those shown in FIGS. 4A and 4B are possible. In some implementations, any one of the remote sensor devices 402 can be configured to perform the operations of the hub device 404. In some cases, only one device 402 or 404 performs the operations of the hub device 404 described herein.
[0043] In the embodiments shown in FIGS. 4A and 4B, the hub device 404 transmits a beacon wireless signal 406 (illustrated in FIG. 4A), and in response to the reception of the beacon wireless signal 406, each of the remote sensor devices 402 transmits a motion probe signal (motion probe signals 408, 410, 412, and 414 shown in FIG. 4B). As shown in FIG. 4B, when an object 416 (e.g., a person) moves within the space accessed by the motion probe signal, the signal path of the motion probe signal can be added, deleted, or otherwise changed due to the movement, as described above. For example, the motion probe signals 408, 410, 412, and 414 shown in FIG. 4B can cause attenuation, frequency shift, phase shift, or other effects through their respective paths, and can have portions that propagate in different directions based on the interaction with the moving object. The remote sensor device 402 and / or the hub device 404 can monitor these changes (e.g., by analyzing the channel response as described above) to detect the movement of the object 416 within the space, and the hub device 404 can detect the relative position of the object 416 within the space (e.g., based on the motion indicator values for the remote sensor device 402 and / or the hub device 404, as described later).
[0044] As shown in FIG. 4A, the hub device 404 transmits an exemplary beacon wireless signal 406 omnidirectionally. The beacon wireless signal 406 can be transmitted in another way (e.g., in another beam pattern such as a non-omnidirectional pattern). For example, the hub 404 can broadcast the beacon wireless signal 406. The propagation of the beacon wireless signal 406 over distance is shown by the dashed concentric circles. The remote sensor device 402 receives the beacon wireless signal 406 and performs one or more operations based on the received beacon wireless signal 406. In some cases, the hub 404 transmits the beacon continuously, that is, transmits the beacon wireless signal 406 at a first time and transmits the next beacon wireless signal at a subsequent second time. The beacon wireless signals 406 transmitted by the hub device 404 can form a series of wireless signals. The hub device 404 can transmit the beacon wireless signal 406 continuously, periodically, randomly, or at intermittent times, or a combination thereof. In a particular implementation, for example, the hub device 404 repeatedly transmits the beacon wireless signal 406. In a particular implementation, the beacon wireless signal 406 indicates to the remote sensor device 402 an instruction to transmit a motion probe signal.
[0045] In some implementations, the beacon wireless signal 406 includes synchronization information that controls the timing when the remote sensor device transmits the motion probe signals 408, 410, 412, and 414. For example, the synchronization information can indicate an instruction to the remote sensor device 402 to transmit the motion probe signals 408, 410, 412, and 414 simultaneously at a specified time. As another example, the synchronization information can indicate an instruction to the remote sensor device to transmit the motion probe signals 408, 410, 412, and 414 at specified intervals after receiving the beacon wireless signal 406.
[0046] In some implementation configurations, the beacon wireless signal 406 includes a sequence value. For example, the hub device 404 can configure the header (e.g., control data) of the beacon wireless signal 406 to include a sequence value. Also, the header of the beacon wireless signal 406 can include the identification information of the transmitting remote sensor device 402. The hub device 404 can send subsequent beacon wireless signals 406 having an incremented or decremented sequence value. To obtain each sequence value, the hub device 404 can sequentially select different values from a set of values, or the hub 404 can generate different values in a series of orders. For example, the beacon wireless signal transmitted by the hub device 404 at the first time (t0) can include the sequence value 999, and the hub device 404 can transmit a beacon wireless signal including the next sequence value 1000 at the time (t1) after the second time, as shown in FIG. 5A, and so on. In some cases, the sequence value represents the time position of the wireless signal within a series of beacon wireless signals 406. The sequence value can be selected and changed in another way in subsequent transmissions.
[0047] Figure 4B shows an exemplary wireless motion probe signal transmitted in the wireless communication system 400 of FIG. 4A. In the illustrated embodiment, each remote sensor device 402 transmits a motion probe signal in response to receipt of a beacon wireless signal 406 (e.g., from the hub device 404 shown in FIG. 4A). More specifically, in response to receipt of the beacon wireless signal 406, remote sensor device 402A transmits a first motion probe signal 408, remote sensor device 402B transmits a second motion probe signal 410, remote sensor device transmits a third motion probe signal 412, and remote sensor device 402D transmits a fourth motion probe signal 414. In the illustrated embodiment, remote sensor devices 402 transmit their respective motion probe signals 408, 410, 412, 414 directionally. Propagation of the motion probe signals 408, 410, 412, and 414 over distance is shown by dashed concentric arcs. Remote sensor devices can transmit motion probe signals in another way (e.g., with another beam pattern such as a non-omnidirectional pattern). In some cases, the hub device 404 transmits a motion probe signal in the same way as the remote sensor device 402.
[0048] In the example shown in FIGS. 4A and 4B, the remote sensor device 402A receives the beacon wireless signal 406 and, in response, performs one or more operations based on the received signal, such as updating an internal sequence value. For example, the remote sensor device 402A can be configured to store an internal sequence value and update the internal sequence value with a sequence value obtained from the most recently received beacon wireless signal 406. The remote sensor device 402A transmits a first motion probe signal 408 having a sequence value (e.g., within a header) that is the same as the stored internal sequence value. The remote sensor device 402A can also transmit a first motion probe signal 408 having an identifier indicating that this device 402A sent the signal 408. Next, the other remote sensor devices 402B to 402D and the hub device 404 receive signals based on the first motion probe signal 408 and can then perform one or more operations (e.g., motion detection, motion information transmission, or other operations). The other remote sensor devices 402B to 402D can operate in the same or similar manner as described above with respect to the remote sensor device 402A, or in a different manner.
[0049] The remote sensor device 402 and the hub device 404 can detect the movement of the object 416 based on the motion probe signal transmitted by the remote sensor device. For example, the remote sensor device can analyze the change in the channel response (e.g., as described above) to detect whether movement has occurred within the space accessed by the motion probe signal. In some cases, a specified number of signals ("motion calculation quantity") are used to detect whether movement has occurred. When movement is detected within the space, a motion indicator value (MIV) is calculated by the device. The MIV represents the degree of movement detected by the device based on the wireless signals transmitted or received by the device. For example, a higher MIV can indicate a higher level of channel perturbation (due to the detected movement), while a lower MIV can indicate a lower level of channel perturbation. A higher level of channel perturbation can indicate movement closer to the device. The MIV can include an aggregated MIV (representing the degree of movement detected overall by each device 402), a link MIV (representing the degree of movement detected on a specific communication link between each device 402), a path MIV (representing the degree of movement detected on a specific communication path between the hardware signal paths of each device 402), or a combination thereof. Exemplary MIVs are described below with respect to FIGS. 5C and 5D.
[0050] Next, the hub device 404 can determine the relative position of the detected movement of the object 416 based on the MIV (e.g., by performing one or more of the operations of the exemplary process 600 of FIG. 6). In some implementations, for example, the remote sensor device 402 transmits movement information including the MIV calculated by each remote sensor device 402 to the hub device 404 (e.g., periodically or after movement is detected). The movement information can also, in some cases, include other information related to the movement detection performed by each remote sensor device 402. For example, the movement information can include signal quality metric values (e.g., for the overall device or for each link between the device and other devices), sequence values of the signals used to detect the movement, or other information used by the device 402 to detect the movement. Next, the hub device 404 uses the movement information from the remote sensor device 402 and its own movement information (since the hub device 404 also detects movement based on the movement probe signal) to determine the location of the detected movement (e.g., the position of the object 416). In some cases, the hub device 404 can weight one or more of the data in the movement information (e.g., the MIV) before using the data to determine the location of the detected movement.
[0051] In some implementations, another device can perform the detection of movement, the determination of the location of the detected movement, or both. For example, in some cases, a remote server communicatively coupled to the wireless communication system 400 receives movement information from the devices 402, 404 (instead of the hub device 404 described above) and can determine the location of the detected movement based on this movement information.
[0052] FIG. 5A is Table 510 for exemplary sequence values represented by wireless signals transmitted and received in the wireless communication system 400 of FIGS. 4A and 4B according to a 100 percent (100%) throughput scenario. In the illustrated embodiment, the hub device 404 transmits ten consecutive beacon wireless signals (beacon number 0 to beacon number 9), each corresponding to one of ten consecutive time points, from the first time (t0) to the tenth time (t9). The hub device 404 configures each of the ten consecutive beacon wireless signals (beacon number 0 to beacon number 9) to include a respective sequence value obtained from the set of values {999, 1000, ..., 1007, 1008}. In the illustrated embodiment, the sequence of sequence values is incremented by only one integer value, but these sequence values can be incremented, decremented, or otherwise changed in other ways, such as, for example, incremented or decremented by an integer of 2. In some cases, the sequence values include alphabetic characters and the sequence values are incremented in alphabetical order (e.g., A to Z, AA to ZZ, etc.).
[0053] The ten consecutive beacon wireless signals (beacon number 0 to beacon number 9) are received at each remote sensor device 402, and each remote sensor device 402 transmits a motion probe signal in response. More specifically, the remote sensor device 402 constructs and transmits ten consecutive motion probe signals (e.g., motion probe signals 408, 410, 4121, 414) including the respective sequence values {999, 1000, ..., 1007, 1008} received via the ten consecutive beacon wireless signals.
[0054] FIG. 5B is Table 520 for exemplary sequence values indicated by the motion probe signals received in the wireless communication system 400 of FIGS. 4A and 4B according to various throughput scenarios. More specifically, Table 520 shows the ten most recently received ten sequence values in the motion probe signals on each communication link. As in the previous example, the hub device 404 constructs each successive beacon wireless signal with the sequence value incremented by only an integer value of 1 in sequence. If interference exists or the link between devices is of low quality in some other way (e.g., long distance between devices), only certain beacon wireless signals are received at the remote sensor device. Accordingly, only these specific sequence values received at the remote sensor device are transmitted in the motion probe signal, and as shown in FIG. 5B, the motion probe signals received on various communication links will have various ranges of sequence values. These sequence values can indicate the link signal quality and can be used, for example, to weight the MIV for each link. For example, if a link has a wide range of sequence values or old sequence values compared to other links (e.g., like link IDs 1 and 7 in FIG. 5B), the signal quality is degraded and the data used to detect motion may be old (compared to other links). Accordingly, the motion detected on these links (MIV for the link) can be weighted low or not considered when determining the location of the detected motion.
[0055] In Table 520, the identification information of each communication link corresponds to the device identification information of the source and destination devices communicating via the communication link. The remote sensor devices 402A, 402B, 402C, 402D, and the hub device 404 have respective device IDs of A, B, C, D, and H. In the illustrated embodiment, the first communication link (Link ID 1) corresponds to source device ID A and destination device ID H. The second communication link (Link ID 2) corresponds to source device ID B and destination device ID H. The third communication link (Link ID 3) corresponds to source device ID C and destination device ID H. The fourth communication link (Link ID 4) corresponds to source device ID D and destination device ID H. The fifth communication link (Link ID 5) corresponds to source device ID B and destination device ID A. The sixth communication link (Link ID 6) corresponds to source device ID C and destination device ID A. The seventh communication link (Link ID 7) corresponds to source device ID D and destination device ID A. The eighth communication link (Link ID 8) corresponds to source device ID C and destination device ID B. The ninth communication link (Link ID 9) corresponds to source device ID D and destination device ID B. The tenth communication link (Link ID 10) corresponds to source device ID D and destination device ID C. In the illustrated embodiment, the reverse link between devices (e.g., the reverse link of Link ID 10 when the source is device ID C and the destination is device ID D) is not shown to avoid redundancy.
[0056] FIG. 5C is Table 530 of exemplary motion information regarding communication links in the wireless communication system 400 of FIGS. 4A and 4B. In the illustrated embodiment, Table 530 corresponds to each communication link and includes a link MIV that indicates the amount of channel perturbation from the detected motion between the source device and the destination device of the communication link. The larger the MIV, the greater the channel perturbation between the source device and the destination device of the communication link, and the smaller the MIV, the smaller the channel perturbation between the pair of source and destination devices. The exemplary MIVs in Table 530 are normalized between zero (0) and 100. Table 530 also includes the signal quality metric value for each communication link and the range of sequence values of the motion probe signals used to detect motion (e.g., the data used to generate the MIVs shown in Table 530). Although shown as including motion information for each communication link, in some implementations, Table 530 can include motion information for each communication path between various devices.
[0057] The signal quality metric values in Table 530 indicate the relative communication quality on each individual communication link. The signal quality metric value can be based on a plurality of factors including throughput (shown in the sequence range for the communication link in Table 530), signal-to-noise ratio (SNR), number of discarded packets, or a combination thereof between the pair of wireless communication devices corresponding to the communication link. In the illustrated embodiment, the signal quality metric is calculated to be in the range of zero (0) to 100. In some cases, the signal quality metric is based on (e.g., equal to) the value Q described above in Equation (9). The higher the signal quality metric, the higher quality the channel environment of the communication link is shown to be. For example, in the illustrated embodiment, Link IDs 1 and 7 both have a relatively low signal quality metric value of 10, at least partially based on the low throughput of these communication links.
[0058] The sequence range in Table 530 indicates the time period during which movement is detected for each communication link. As an example, the movement probe signal used to detect movement on Link ID 1 is collected over a longer time period based on the larger range of sequence numbers from 905 to 995 as compared to the smaller sequence range from 999 to 1008 for Link ID 2. In some cases, movement is detected using a specified number of data packets, and thus, it is shown that the larger the sequence range, the longer the time required to collect the specified number of packets for movement detection. For low-quality links (such as Link ID 1), it may take a longer time to collect the specified number of packets, and thus, movement detection may be less reliable compared to links that have received more recent data packets (such as Link ID 2). Thus, in some cases, the MIV can be weighted based on the sequence range associated with the MIV. The corresponding weighted MIV can be generated by scaling the unweighted MIV by the determined weight value.
[0059] The hub device 404 can determine a weight value based on a time factor (e.g., sequence range, etc.), a signal quality metric value, or another factor. For example, the hub device 404 can select the maximum sequence value in the sequence range column as a time reference value (also referred to as the "reference sequence value"), and weight the MIV based on this reference sequence value. In the illustrated embodiment, since the value of 1008 is the most recently received sequence value, the hub device 404 selects this value as the reference sequence value. The hub 404 can generate a weight value based on the reference sequence value in various ways. For example, in the illustrated embodiment, binary weighting (e.g., a weighting value of zero (0) or 1 is used) is applied based on whether the maximum sequence value for the communication link is within a threshold sequence range of the reference sequence value. Thus, in the illustrated embodiment, the MIVs for link IDs 1 and 7 are weighted to zero (0) because their maximum sequence values are not within the range of 10 of the reference sequence value of 1008. Another weighting technique can be implemented instead of the binary technique shown. For example, a stepwise weighting method that applies a weighting factor between zero (0) and 1 can be used. In some cases, for example, a communication link having a maximum sequence value (e.g., 900) that is significantly deviated from the reference sequence value (1008 in the example of the figure), i.e., outside the threshold sequence range, can contribute a portion of the MIV of this link to the positioning by applying a weight value greater than zero.
[0060] In some implementation configurations, the neural network is trained to determine the location of the detected movement based on the information provided by the hub device 404. For example, the hub device 404 can provide the information in Table 530 as input to the trained neural network, and the neural network can result in the determination of the location of the detected movement. The neural network can be configured to generate a weighting function through a machine learning process, and the input data to the neural network includes a range of sequence values and corresponding movement values.
[0061] Figure 5D is Table 540 for exemplary aggregated motion indicator values and confidence factors corresponding to wireless communication devices within the wireless communication network 400 of FIGS. 4A and 4B. Specifically, Table 540 includes confidence factors (with or without weighting applied) that are the peak-to-average value ratio of the MIV. The aggregated MIV is based on the link MIV shown in Table 530. In some cases, the aggregated MIV can be calculated according to the following formula.
Equation
[0062] For example, in the example for Link ID 1, the motion indicator value (motion(link)) is for the remote sensor device 402A(link source ) and the hub device 404(link dest)indicates the degree of movement detected between them. The larger the aggregated MIV for a device, the more it can indicate that the detected movement is close to that device, while the smaller the aggregated MIV, the more it can indicate that the detected movement is farther away from the device. Next, the hub device 404 can compare the aggregated MIV for each device and determine the location of the detected movement. For example, in the illustrated embodiment, the hub device 404 can determine that the detected movement is closest to device ID A because this device has the largest aggregated MIV (both for weighted and unweighted cases). In some cases, the weighted MIV can be used to determine the location of the detected movement. In some configurations, the hub device 404 determines the peak-to-average value ratio (weighted or unweighted) of the aggregated MIV. The peak-to-average value ratio can be used as a confidence factor and can be expressed as follows. [Number]
[0063] Next, the location of the detected movement can be determined using the confidence factor. For example, in the illustrated embodiment, the hub device 404 can determine that the detected movement is closest to the device because device ID A is the device with the highest confidence factor (in both the peak-to-average ratio, weighted cases, and unweighted cases). In some examples, such as when the number of users is less than the number of remote sensor devices 402, the hub device 404 can extend the confidence factor to determine that there is movement to the corresponding device. For example, if the wireless communication system 400 includes a total of five devices and one user, the wireless communication device with the maximum peak-to-average ratio above the peak-to-average ratio threshold indicates the likelihood that the user is near the wireless communication device with this highest confidence factor. Similarly, if the wireless communication system 400 includes a total of five devices and two users, the top two confidence factors above a certain value can indicate the likelihood that the users are near the two devices with these two highest confidence factors.
[0064] In certain embodiments, the hub device 404 can perform time-averaged sampling over a period of time to smooth the aggregated MIV of the communication link based on signal quality metric values. In some cases, the motion information can further be aggregated into snapshots shown as the percentage of time wireless communication devices detected motion over various time periods. Over a given time period, the freshness of the motion information (e.g., how recently a motion probe signal was received based on a sequence value) can be used to increment a counter for the determined location of the detected motion based on the wireless communication device (e.g., device ID). If during the sampling time period the freshness of the data drops below a threshold (e.g., the most recent sequence value is less than a certain reference value), the counter is not incremented. As a result, the sum of the counters for each device over a particular time period (e.g., as a percentage) can be used to determine the most active wireless communication device (the device closest to the detected motion) for that time period.
[0065] In some embodiments, the location of the detected motion can be shown on a user device (e.g., smartphone, speaker) or an electronic display device (e.g., TV, monitor, screen) such that the determined location of the object (i.e., person) can be displayed or presented. The location of the detected motion can be presented to the user in an interface (e.g., visual, audio, audiovisual display) that highlights, for example, the device 402 or 404 that was determined to have last had motion.
[0066] FIG. 6 illustrates a process 600 for determining the location of detected movement within a space. In some instances, process 600 can be implemented to determine the location of detected movement based on movement indicator values for each device, communication link, communication path, or combination thereof. A data processing device (e.g., processor 114 of exemplary wireless communication device 102C in FIG. 1A) can perform the operations in exemplary process 600 to determine the location of detected movement based on signals received at various wireless communication devices (e.g., hub device 404 in FIGS. 4A and 4B can determine the location of detected movement of object 416 based on signals received at remote sensor device 402 and hub device 404). Another type of device can also perform exemplary process 600. For example, the operations of process 600 can be performed by a system other than a wireless communication device that receives signals (e.g., a computer system connected to wireless communication system 400 in FIGS. 4A and 4B that aggregates and analyzes movement indicator values).
[0067] Exemplary process 600 can include additional or different operations, and the operations can be performed in the order shown or in a different order. In some examples, one or more of the operations shown in FIG. 6 are implemented as a process that includes multiple operations, sub-processes, or other types of routines. In some examples, the operations can be combined, performed in a different order, performed in parallel, repeated, or otherwise repeated or performed in another way.
[0068] At 602, a wireless signal is transmitted through space. The wireless signal can be a motion probe signal configured to explore space with respect to movement. The motion probe signal can be formatted in the same manner as the motion probe signal 202 of FIG. 2 or in another way. Referring to the examples shown in FIGS. 4A and 4B, the remote sensor device 402 transmits a motion probe signal in response to a beacon wireless signal transmitted by the hub device 404. In a particular implementation, the beacon wireless signal includes a sequence value indicating the time point at which this beacon wireless signal was transmitted, and the remote sensor device includes the sequence value in the motion probe signal transmitted in response to the beacon wireless signal (for example, in the control data 204).
[0069] At 604, movement is detected based on the wireless signal transmitted at 602. The movement can be detected in one or more of the wireless communication devices that receive the signal transmitted at 602. For example, referring to the examples shown in FIGS. 4A and 4B, each of the remote sensor device 402 and the hub device 404 can execute a movement detection process to detect the movement of the object 416. The movement detection process can detect the movement of the object 416 based on a set of signals received at each wireless communication device at 602. In some cases, the movement detection process includes a comparison of signals received over a period of time. For example, the movement can be detected based on a detected change in the frequency response of the signal received at 602, or based on a detected change in the channel response to space (for example, based on channel state information (CSI)).
[0070] At 606, a motion indicator value for each communication link is calculated. The motion indicator value can indicate the relative degree of motion detected on the communication link. For example, referring to the example shown in FIG. 5C, the motion indicator values in the fourth column of Table 530 indicate the degree of motion detected by one or both of these devices on each communication link between the devices shown in the second and third columns. The motion indicator value can be calculated based on the amount of perturbation observed in the channel response for the communication link. In some cases, the motion indicator value is normalized. For example, the motion indicator values in Table 530 of FIG. 5C are values normalized between zero (0) and 100.
[0071] At 608, a time coefficient for each communication link is calculated. The time coefficient for an individual communication link can be (i) the range of sequence values included in the motion probe signal used to detect motion on that communication link, (ii) the set of sequence values (e.g., all) included in the motion probe signal used to detect motion on that communication link, (iii) the minimum or maximum sequence value within the set of sequence values included in the motion probe signal used to detect motion on that communication link, or (iv) another indicator of the time period during which the motion probe signal for detecting motion is obtained. In some implementations, the time coefficient for each communication link includes a value based on one or more of the foregoing examples. For example, the time coefficient can be a weighting factor based on the maximum or minimum sequence value in the set of motion probe signals used to detect motion.
[0072] At 610, the motion indicator value is processed. The motion indicator value can be processed by a specified hub device (e.g., the hub device 404 in the examples shown in FIGS. 4A and 4B), or by another system communicatively coupled to a device that transmits or sends the motion probe signal. In a particular implementation, the step of processing the motion indicator value for each communication link includes the step of calculating an aggregated motion indicator value for the wireless communication device. The step of calculating the aggregated motion indicator value can, in some cases, include the step of calculating the sum of each link motion indicator value associated with the wireless communication device. For example, referring to the examples shown in FIGS. 5C and 5D, the values in the second column of Table 540 include the sum of the link motion indicator values shown in Table 530. The total link motion indicator value can, in some examples, be used as the aggregated motion indicator value at 612 to determine the location of the detected motion.
[0073] In a particular implementation, the step of calculating the aggregated motion indicator value includes the step of calculating the peak-to-average value ratio of the total link motion indicator value for each wireless communication device. For example, referring to the examples shown in FIGS. 5C and 5D, the values in the third column of Table 540 include the peak-to-average value ratio of the total link motion indicator values shown in Table 530. The peak-to-average value ratio can, in some examples, be used as the aggregated motion indicator value at 612 to determine the location of the detected motion. In some cases, the peak-to-average value ratio can be used as the confidence factor described above.
[0074] In some implementation configurations, the step of processing the movement indicator value for each communication link includes the step of weighting the link movement indicator value (e.g., using binary weighting, stepwise weighting, or a weighting mechanism determined by a neural network). In some cases, the weighting is based on the time coefficient calculated at 608. For example, the same total value and peak-to-average value as described above are then calculated based on the weighted movement indicator value, and the calculated value can be used as an aggregated movement indicator value at 612 to determine the location of the detected movement.
[0075] At 612, the location of the detected movement is determined. The location of the detected movement can be determined as the possibility that the movement of the object is near one or more of the wireless communication devices. In some cases, the location is determined based on (i) the maximum aggregated movement indicator value based on the unweighted link movement indicator value, (ii) the maximum aggregated movement indicator value based on the weighted link movement indicator value, (iii) the highest confidence factor (e.g., peak-to-average value ratio), or (iv) a confidence factor greater than a threshold value. In some implementation configurations, the determined location is related to one of the wireless communication devices. For example, referring to the examples shown in FIGS. 5C and 5D, the determined location can be indicated with respect to device ID A (e.g., "detected movement near device ID A") based on device ID A having the maximum link movement indicator total value or the maximum peak-to-average value ratio among all devices. In some implementation configurations, the determined location is related to a plurality of wireless communication devices. For example, referring to the examples shown in FIGS. 5C and 5D, the determined location can be indicated with respect to these device IDs A and B (e.g., "detected movement near device IDs A and B") based on device IDs A and B having a peak-to-average value ratio greater than 1 (in the weighted scenario).
[0076] Although the present disclosure has been described with respect to motion values determined for each communication link (e.g., communication link 126 in FIG. 1C), the process 600 of FIG. 6 can be implemented based on criteria for each communication path (e.g., communication paths 121 to 124 in FIG. 1C). In some cases, this can scale the number of inputs to the motion localization process described above. For example, in some implementations, motion indicator values are calculated for each communication path. For example, assuming that each device shown in table 530 of FIG. 5C has two transmit antennas and two receive antennas, motion indicator values can be calculated for each of the four communication paths between the respective antennas of that device. In some examples, the motion indicator value for a communication link can be based on the motion indicator values for each communication path of this link. In some cases, the motion indicator values for each communication path can be weighted based on signal quality metric values for the communication path, and the weighted values for the communication path can be used to determine the motion indicator value for the communication link. In some examples, the motion indicator values for the communication path can be used in the same way as described herein for the use of the motion indicator values for the communication link (e.g., at 610, path motion indicator values can be used instead of link motion indicator values to calculate an aggregated motion indicator value for a communication device). Also, the time factor can be calculated for each communication path in the same way as described above for the communication link. In some cases, the time factor can be used to calculate the time factor for each communication link or used instead of the time factor for each communication link (e.g., a path time factor can be used instead of a link time factor at 610).
[0077] Some of the subject matter and operations described in this specification can be implemented in digital electronic circuitry, or in computer software, firmware, hardware, or in any combination of one or more of these, including the structures disclosed in this specification and their structural equivalents. Some of the subject matter described in this specification can be implemented as one or more computer programs, i.e., as one or more modules of computer program instructions encoded on a computer storage medium and executable by, or to control the operation of, a data processing apparatus. The computer storage medium can be or include a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of these, or can be included in these. Further, the computer storage medium can be, but is not a propagated signal, and can be an information source or storage destination for computer program instructions encoded in an artificially generated propagated signal. The computer storage medium can also be or include one or more distinct physical components or media (e.g., multiple CDs, disks, or other storage devices), or can be included in these.
[0078] Some of the operations described in this specification can be implemented as operations executed by a data processing apparatus on data stored in or received from one or more computer-readable storage devices or other information sources.
[0079] The term "data processing apparatus" encompasses all kinds of devices, apparatuses, and machines that process data, and by way of example, includes the aforementioned programmable processors, computers, system-on-chips or multiple system-on-chips, or combinations of the foregoing. The apparatus can include dedicated logic circuitry such as, for example, an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The apparatus can further include, in addition to hardware, code that forms an execution environment for a targeted computer program, such as, for example, processor firmware, protocol stack, database management system, operating system, cross-platform runtime environment, virtual machine, or code that constitutes a combination of one or more of these.
[0080] A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language including compiled or interpreted languages, declarative or procedural languages, and the computer program can be deployed in any form including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. The computer program can optionally correspond to a file in a file system. The program can be stored as part of a file that holds other programs or data (such as one or more scripts stored in a markup language document) in a single file dedicated to the program or in multiple related files (for example, files that store one or more modules, subprograms, or portions of code). The computer program can be deployed to be executed on one computer or to be executed on multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.
[0081] Some of the processes and logic flows described in this specification can be executed to operate by acting on input data by one or more programmable processors that execute one or more computer programs to generate an output. Also, the processes and logic flows can be executed by dedicated logic circuits such as, for example, FPGAs (Field Programmable Gate Arrays) or ASICs (Application Specific Integrated Circuits), and the apparatus can also be implemented as these circuits.
[0082] Processors suitable for executing a computer program include, by way of example, both general-purpose and special-purpose microprocessors, as well as processors for any kind of digital computer. Generally, a processor receives instructions and data from a read-only memory or a random access memory, or both. The elements of a computer system can include a processor that executes operations in accordance with instructions, and one or more memory devices that store instructions and data. Further, a computer system can include one or more mass storage devices that store data, such as, for example, a non-magnetic drive (e.g., a solid state drive), a magnetic disk, a magneto-optical disk, or an optical disk, or can be operatively coupled to perform receiving or transferring data, or both, between these. However, a computer system need not have such devices. Additionally, a computer system can be incorporated into another device, such as, for example, a telephone, a tablet computer, an electronic device, a portable audio or video player, a gaming console, a global positioning system (GPS) receiver, or an Internet of Things (IoT) device, a machine-to-machine (M2M) sensor or actuator, or a portable storage device (e.g., a universal serial bus (USB) flash drive). Devices suitable for storing computer program instructions and data include, by way of example, semiconductor memory devices (e.g., EPROM, EEPROM, flash memory devices, etc.), magnetic disks (e.g., internal hard disks, removable disks, etc.), magneto-optical disks, and all forms of non-volatile memory, media, and memory devices including CD ROM and DVD ROM disks. In some examples, the processor and memory can be supplemented by, or incorporated in, dedicated logic circuitry.
[0083] To provide interaction with a user, the operations can be implemented on a computer having a display device (e.g., a monitor, or another type of display device) for displaying information to the user, and a keyboard and a pointing device (e.g., a mouse, trackball, stylus pen, touch sensor screen, or another type of pointing device) that enable the user to provide input to the computer. Other types of devices can also be used to effect interaction with the user, for example, the feedback provided to the user can be any form of sensory feedback such as visual feedback, auditory feedback, or tactile feedback, and the input received from the user can be in any form including acoustic input, voice input, or tactile input. Additionally, the computer can interact with the user by sending and receiving documents to and from the devices the user uses, for example, by sending a web page to a web browser on the user's client device in response to a request received from a web browser.
[0084] A computer system can include a single computing device, or multiple computers that operate in proximity to or generally apart from each other and typically interact via a communication network. The communication network can include one or more of a local area network ("LAN") and a wide area network ("WAN"), an internetwork (e.g., the Internet), a network including satellite links, and a peer-to-peer network (e.g., an ad hoc peer-to-peer network). The client-server relationship can arise from computer programs that operate on respective computers and have a client-server relationship with each other.
[0085] In some general aspects of the described embodiments, the location of a detected movement within a space is determined.
[0086] In the first embodiment, the movement of an object in space is detected based on wireless signals transmitted through the space by a wireless communication system comprising a plurality of wireless communication devices. Each wireless signal is transmitted and received by a respective pair of the wireless communication devices. A movement indicator value for each wireless communication device is calculated by the operation of one or more processors. The movement indicator value for an individual wireless communication device represents the degree of movement detected by the individual wireless communication device based on a subset of the wireless signals transmitted or received by the individual wireless communication device. The location of the detected movement in space is determined based on the movement indicator values.
[0087] The implementation configuration of the first example can, in some examples, include one or more of the following functions. The wireless communication system can include a hub device and remote sensor devices. The hub device can receive a motion indicator value from a remote sensor device and determine the location of the detected motion based on the received motion indicator value. The motion indicator value can be an aggregated motion indicator value. A link motion indicator value for each communication link in the wireless communication system can be obtained, and the aggregated motion indicator value for each wireless communication device is calculated based on the link motion indicator values for a subset of the communication links supported by the wireless communication device. Each communication link can be provided by a respective pair of wireless communication devices. The step of calculating the aggregated motion indicator value for a wireless communication device can include the step of weighting the link motion indicator values for a subset of the communication links based on the signal quality metric for each communication link. The wireless communication system can include a plurality of communication links each provided by a respective pair of wireless communication devices, and each communication link includes a plurality of communication paths in a state where each communication path is between a first signal hardware path of a first wireless communication device of the pair and a second signal hardware path of a second wireless communication device of the pair. A path motion indicator value for each communication path in the wireless communication system can be obtained, and the aggregated motion indicator value for each wireless communication device can be calculated based on the path motion indicator values for a subset of the communication paths supported by that wireless communication device.
[0088] The implementation configuration of the first example can, in some examples, include one or more of the following functions. The confidence factor for each wireless communication device can be calculated based on the scaling of the motion indicator value for the wireless communication device by the normative motion indicator value for that wireless communication device, and the detected location of the motion is determined based on this confidence factor. The step of determining the detected location of the motion in the space can include the step of determining which of the wireless communication devices is closest to the detected motion based on the comparison of the respective motion indicator values for the wireless communication devices. The detected location of the motion in the space can be determined based on the signal quality metric for each communication link in the wireless communication system, and each communication link is provided by a respective pair of wireless communication devices. The step of determining the detected location of the motion in the space can include the step of combining the signal quality metrics for a subset of the communication links supported by each wireless communication device. The motion indicator value can be provided as an input to a neural network, and the detected location of the motion can be determined based on the output of the neural network.
[0089] In the second example, the motion of an object in the space is detected based on a series of wireless signals transmitted through the space by a wireless communication system including a plurality of wireless communication devices. The time factor for each pair of wireless communication devices is calculated based on the sequence values included in each wireless signal transmitted and received between the pair of wireless communication devices by the operation of one or more processors. The sequence value in each wireless signal represents the time position of the wireless signal within the series of signals. The detected location of the motion in the space is determined based on the time factor.
[0090] The implementation configuration of the second example can, in some examples, include one or more of the following functions. The wireless communication system can include a hub device and a remote sensor device. The hub device can receive a motion indicator value from the remote sensor device and determine the location of the detected motion based on the received motion indicator value and a time factor. The motion indicator value can be calculated for each wireless communication device of the wireless communication system, and the motion indicator value for an individual wireless communication device represents the degree of motion detected by the individual wireless communication device. The motion indicator value can be based on a subset of a series of wireless signals transmitted or received by the individual wireless communication device. The location of the detected motion can be determined based on the motion indicator value and the time factor. Each motion indicator value can be weighted by an associated time factor, and the location of the detected motion can be determined based on the weighted motion indicator value. The associated time factor can be for the same wireless communication device as the motion indicator value.
[0091] The implementation configuration of the second example may, in some examples, include one or more of the following functions. The step of calculating the time coefficient may include the step of selecting a reference sequence value from among the sequence values included in a set of wireless signals received by a wireless communication device of a wireless communication system, and the step of calculating a time coefficient for each communication link provided by each pair of the wireless communication devices. The step of calculating the time coefficient for each communication link may be based on a determination as to whether the sequence value in the wireless signal received on the communication link is within a threshold sequence range of the reference sequence value. The reference sequence value may be the maximum or minimum sequence value in a set of wireless signals received by a wireless communication device of a wireless communication system. The step of calculating the time coefficient for each communication link may include the step of determining whether the maximum sequence value included in a subset of the wireless signals received on the communication link is within the threshold sequence range of the reference sequence value. The sequence value can be provided as an input to a neural network, and the time coefficient can be calculated based on the output of the neural network.
[0092] In some implementation configurations, a computer-readable storage medium stores instructions that are operable to perform one or more operations of the first or second example when executed by a data processing device. In some implementation configurations, the system (e.g., a wireless communication device, a computer system, or another type of system communicatively coupled to the wireless communication device) includes one or more data processing devices and a memory that stores instructions that are operable to perform one or more operations of the first or second example when executed by the data processing device. In some implementation configurations, a motion detection system includes a hub device and one or more remote sensor devices, and these devices are configured to perform one or more operations of the first or second example.
[0093] This specification includes many details, but these details should not be construed as limiting the scope of what can be claimed, but rather as descriptions of features specific to particular examples. Also, some features described in connection with separate implementations in this specification can also be combined. Conversely, various features described in connection with a single implementation can also be implemented separately in multiple embodiments or in any suitable partial combination thereof.
[0094] Some embodiments have been described. Nevertheless, it will be understood that various modifications can be made. Accordingly, other embodiments are within the scope of the following claims.
Claims
1. 1. A motion detection method, comprising: detecting a motion of an object in a space based on wireless signals transmitted through the space by a wireless communication system including a plurality of wireless communication devices, each wireless signal being transmitted and received by a respective pair of the wireless communication devices; calculating, by operation of one or more processors, a motion indicator value for each of the wireless communication devices, the motion indicator value for an individual wireless communication device representing a degree of motion detected by the individual wireless communication device based on a subset of the wireless signals transmitted or received by the individual wireless communication device; determining a location of the detected movement within the space based on the movement indicator value; A motion detection method comprising:
2. 10. The method of claim 1, wherein the wireless communication system includes a hub device and a remote sensor device, the hub device receiving a motion indicator value from the remote sensor device and determining a location of the detected motion based on the received motion indicator value.
3. the motion indicator value is an aggregate motion indicator value; The method comprises: obtaining link movement indicator values for each communication link in the wireless communication system, each communication link being provided by a respective pair of the wireless communication devices; calculating the aggregate motion indicator value for each wireless communication device based on the link motion indicator values for a subset of the communication links supported by the wireless communication device; The method of claim 1 , comprising:
4. 4. The method of claim 3, wherein calculating the aggregate motion indicator value for the wireless communication device comprises weighting the link motion indicator values for a subset of the communication links based on a signal quality metric for the respective communication links.
5. the wireless communication system includes a plurality of communication links, each communication link provided by a respective pair of the wireless communication devices, each communication link including a plurality of communication paths, each communication path being between a first signal hardware path of a first wireless communication device of the pair and a second signal hardware path of a second wireless communication device of the pair; the motion indicator value is an aggregate motion indicator value; The method comprises: obtaining a path movement indicator value for each communication path within the wireless communication system; calculating the aggregate motion indicator value for each wireless communication device based on the path motion indicator values for a subset of the communication paths supported by the wireless communication device; The method of claim 1 , comprising:
6. 6. The method of claim 1 , comprising: for each wireless communication device, calculating a confidence factor based on scaling the movement indicator value for the wireless communication device by a reference movement indicator value for the wireless communication device, and a location of the detected movement is determined based on the confidence factor.
7. 6. The method of claim 1, wherein determining a location of the detected motion within the space comprises determining which of the wireless communication devices is closest to the detected motion based on a comparison of the respective motion indicator values for the wireless communication devices.
8. 6. The method of claim 1, wherein the location of the detected movement in the space is determined based on signal quality metrics for respective communication links in the wireless communication system, each communication link being provided by a respective pair of the wireless communication devices.
9. 10. The method of claim 8, wherein determining a location of the detected movement within the space comprises combining signal quality metrics for a subset of the communication links supported by each wireless communication device.
10. providing said motion indicator values as inputs to a neural network; determining a location of the detected movement based on an output of the neural network; The method of any one of claims 1 to 5, comprising:
11. 1. A computer-readable storage medium storing instructions operable to perform operations when executed by a data processing apparatus, comprising: The operation includes: Detecting a movement of an object in a space based on wireless signals transmitted through the space by a wireless communication system including a plurality of wireless communication devices, each wireless signal being transmitted and received by a respective pair of the wireless communication devices; calculating a motion indicator value for the respective wireless communication device, the motion indicator value for each individual wireless communication device representing a degree of motion detected by the individual wireless communication device based on a subset of the wireless signals transmitted or received by the individual wireless communication device; determining a location of the detected movement within the space based on the movement indicator value; 23. A computer-readable storage medium comprising:
12. 12. The computer-readable storage medium of claim 11, wherein the wireless communication system includes a hub device and a remote sensor device, the hub device receiving a motion indicator value from the remote sensor device and determining a location of the detected motion based on the received motion indicator value.
13. the motion indicator value is an aggregate motion indicator value; The operation includes: obtaining link movement indicator values for respective communication links in the wireless communication system, each communication link being provided by a respective pair of the wireless communication devices; calculating the aggregate motion indicator value for each wireless communication device based on the link motion indicator values for a subset of the communication links supported by the wireless communication device; The computer-readable storage medium of claim 11 .
14. 14. The computer-readable storage medium of claim 13, wherein calculating the aggregate motion indicator value for the wireless communication device includes weighting the link motion indicator values for a subset of the communication links based on a signal quality metric for the respective communication links.
15. the wireless communication system includes a plurality of communication links, each communication link provided by a respective pair of the wireless communication devices, each communication link including a plurality of communication paths, each communication path being between a first signal hardware path of a first wireless communication device of the pair and a second signal hardware path of a second wireless communication device of the pair; the motion indicator value is an aggregate motion indicator value; The operation includes: obtaining a path movement indicator value for each communication path within the wireless communication system; calculating the aggregate motion indicator value for each wireless communication device based on the path motion indicator values for a subset of the communication paths supported by the wireless communication device; The computer-readable storage medium of claim 11, comprising:
16. 16. The computer-readable storage medium of claim 11, further comprising: for each wireless communication device, calculating a confidence factor based on a scaling of the motion indicator value for the wireless communication device by a reference motion indicator value for the wireless communication device, wherein a location of the detected motion is determined based on the confidence factor.
17. 16. The computer-readable storage medium of claim 11, wherein determining a location of the detected motion within the space includes determining which of the wireless communication devices is closest to the detected motion based on a comparison of the respective motion indicator values for the wireless communication devices.
18. 16. The computer-readable storage medium of claim 11, wherein a location of the detected movement in the space is determined based on signal quality metrics for respective communication links in the wireless communication system, each communication link being provided by a respective pair of the wireless communication devices.
19. 20. The computer-readable storage medium of claim 18, wherein determining a location of the detected movement within the space includes combining signal quality metrics for a subset of the communication links supported by each wireless communication device.
20. The operation includes: providing said motion indicator values as inputs to a neural network; determining a location of the detected movement based on an output of the neural network; and 16. The computer readable storage medium of claim 11, comprising:
21. 1. A motion detection system comprising: A plurality of remote sensor devices, each remote sensor device comprising: Detecting movement of an object in space based on wireless signals received from other remote sensor devices; determining a motion indicator value representative of a degree of motion detected by the remote sensor device based on the wireless signals received by the remote sensor device; It is configured as follows: The motion detection system comprises: a hub device communicatively coupled to the remote sensor devices, the hub device configured to determine a location of the detected movement within the space based on the movement indicator values from the respective remote sensor devices; a motion detection system.
22. 22. The motion detection system of claim 21, wherein the remote sensor device and the hub device form a wireless mesh network.
23. 22. The motion detection system of claim 21, wherein the motion indicator values are link motion indicator values for each communication link between a pair of remote sensor devices, and the hub device is configured to calculate an aggregate motion indicator value for each remote sensor device based on the link motion indicator values for a subset of the communication links supported by the remote sensor devices.
24. 24. The motion detection system of claim 23, wherein the hub device is configured to calculate the aggregate motion indicator value for each remote sensor device by weighting the link motion indicator values for a subset of the communication links supported by the remote sensor device based on signal quality metrics for the communication links.
25. the movement indicator value being a path movement indicator value for each communication path between a first signal hardware path of a first remote sensor device and a second signal hardware path of a second remote sensor device; the hub device is configured to calculate the aggregate motion indicator value for each remote sensor device based on the path motion indicator values for a subset of the communication paths supported by the remote sensor device.
22. The motion detection system of claim 21.
26. 26. The movement detection system of claim 21, wherein the hub device is configured to calculate, for each remote sensor device, a confidence factor based on scaling the movement indicator value for the remote sensor device by a reference movement indicator value for the wireless communication device, and to determine a location of the detected movement based on the confidence factor.
27. 26. The motion detection system of claim 21, wherein the hub device is configured to determine a location of the detected motion by determining which of the remote sensor devices is closest to the detected motion based on a comparison of the respective motion indicator values for the remote sensor devices.
28. 26. The motion detection system of claim 21 , wherein the hub device is configured to determine a location of the detected motion in the space based on signal quality metrics for each communication link in the wireless communication system, each communication link being provided by a respective pair of the remote sensor devices.
29. 30. The motion detection system of claim 28, wherein the hub device is configured to determine a location of the detected motion within the space by combining signal quality metrics for a subset of the communication links supported by each remote sensor device.
30. 26. A movement detection system according to any one of claims 21 to 25, wherein the hub device is configured to provide the movement indicator value as an input to a neural network and to determine a location of the detected movement based on an output of the neural network.