Method, apparatus and system for wireless sensing measurement and reporting
By using transmitters and receivers to send and receive wireless detection signals in wireless data communication networks, perform multiple wireless sensing measurements and report results, the standardization problem of wireless sensing measurements and reports is solved, and the multi-path environment is realized efficient sensing in it supports intelligent IoT applications.
Patent Information
- Application Number
- CN202410935328.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-09-15
- Filing Date
- 2022-10-04
- Publication Date
- 2024-11-05
AI Technical Summary
The prior art has not yet completed the standardization of wireless sensing measurements and reporting, especially in multipath-rich indoor or metropolitan environments, where efficient and effective wireless sensing measurements and reporting are difficult to achieve.
Using transmitters and receivers in wireless data communication networks, multiple wireless sensing measurements are performed by sending and receiving time series of wireless detection signals, and the sensing measurement results are reported to higher layers to perform sensing-based Task.
It realizes efficient wireless sensing measurement and reporting in a multi-path rich environment, can monitor the motion characteristics and space-time information of objects, and supports the development of intelligent Internet of Things applications.
Smart Images

Figure CN118900426A_ABST
Abstract
Description
[0001] This application is a divisional application of application number 2022800676799, application date October 4, 2022, and invention name “Method, device and system for wireless sensing measurement and reporting”.
[0002] CROSS-REFERENCE TO RELATED APPLICATIONS
[0003] This application hereby incorporates by reference the entire disclosure of each of the following cases and claims priority:
[0004] (a) U.S. Provisional Patent Application No. 63 / 253,083, filed on October 6, 2021, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESS SENSING, DETECTION AND TRACKING,”
[0005] (b) U.S. Provisional Patent Application No. 63 / 276,652, filed on November 7, 2021, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESSLY MONITORING VITAL SIGN AND PERIODIC MOTIONS,”
[0006] (c) U.S. Provisional Patent Application No. 63 / 281,043, entitled “METHOD, APPARATUS, AND SYSTEM FOR SENSING,” filed on November 18, 2021,
[0007] (d) U.S. Provisional Patent Application No. 63 / 293,065, filed on December 22, 2021, entitled “METHOD, APPARATUS, AND SYSTEM FOR SPEECH,”
[0008] (e) U.S. Provisional Patent Application No. 63 / 300,042, filed on January 16, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESS SENSING AND SLEEP TRACKING,”
[0009] (f) U.S. Provisional Patent Application No. 63 / 308,927, filed on February 10, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESS SENSING BASED ON MULTIPLE GROUPS OF WIRELESS DEVICES,”
[0010] (g) U.S. Provisional Patent Application No. 63 / 332,658, filed on April 19, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESS SENSING,”
[0011] (h) U.S. patent application Ser. No. 17 / 827,902, filed on May 30, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR SPEECHENHANCEMENT AND SEPARATOIN BASED ON AUDIO AND RADIO SIGNALS,”
[0012] (i) U.S. Provisional Patent Application No. 63 / 349,082, filed on June 4, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESS SENSING VOICE ACTIVITY DETECTION,”
[0013] (j) U.S. patent application Ser. No. 17 / 838,228, filed on June 12, 2022, entitled “METHOD, APPRAATUS, AND SYSTEM FOR WIRELESS SENSING BASED ON CHANNEL INFORMATION,”
[0014] (k) U.S. patent application Ser. No. 17 / 838,231, filed on June 12, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR IDENTIFYING AND QUALIFYING DEVICES FOR WIRELESS SENSING,”
[0015] (l) U.S. patent application Ser. No. 17 / 838,244, filed on June 12, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESS SENSING BASED ON LINKWISE MOTION STATISTICS,”
[0016] (m) U.S. Provisional Patent Application No. 63 / 354,184, filed on June 21, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR MOTION LOCALIZATION AND OUTLIER REMOVAL,”
[0017] (n) U.S. Provisional Patent Application No. 63 / 388,625, filed on July 12, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESS SENSING AND INDOOR LOCALIZATION,”
[0018] (o) U.S. patent application Ser. No. 17 / 888,429, filed on August 15, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR RADIOBASED SLEEP TRACKING,”
[0019] (p) U.S. patent application Ser. No. 17 / 891,037, filed on August 18, 2022, entitled “METHOD, APPARATUS, AND SYSTEM FOR MAPRECONSTRUCTION BASED ON WIRELESS TRACKING,”
[0020] (q) U.S. patent application 17 / 945,995, entitled “METHOD, APPARATUS, AND SYSTEM FOR WIRELESSVITAL MONITORING USING HIGH FREQUENCY SIGNALS,” filed on September 15, 2022. Technical Field
[0021] The present teachings relate generally to wireless sensing. More specifically, the present teachings relate to methods, systems, and devices for performing wireless sensing measurements and reporting. Background Art
[0022] With the proliferation of Internet of Things (IoT) applications, billions of home appliances, phones, smart devices, security systems, environmental sensors, vehicles and buildings, and other radio-connected devices will send data and communicate with each other or with people, and everything will be able to be measured and tracked all the time. Among the various methods of measuring what is happening in the surrounding environment, wireless sensing has received increasing attention in recent years due to the widespread deployment of wireless radio devices. In addition, human activities affect the propagation of wireless signals, so understanding and analyzing how wireless signals react to human activities can reveal rich information about the activities. With more bandwidth available in new generation wireless systems, wireless sensing will make many smart IoT applications that can only be imagined today possible in the near future. This is because, when bandwidth increases, in scattering-rich environments such as indoors or in metropolitan areas, one can see more multipaths, which can be regarded as hundreds of virtual antennas / sensors. Some technical standards (including, for example, IEEE 802.11bf) support wireless sensing, but standardization of many details about wireless sensing, such as how to perform wireless sensing measurements and reports, has not yet been completed. Therefore, an efficient and effective method for wireless sensing measurements and reports is needed. Summary of the invention
[0023] The present teachings relate generally to wireless sensing. More specifically, the present teachings relate to methods, systems, and devices for performing wireless sensing measurements and reporting.
[0024] In one embodiment, a system for wireless sensing in a wireless data communication network is described. The system includes: a transmitter configured to send a time sequence of wireless sounding signals (WSS) based on a wireless protocol associated with the wireless data communication network; and a receiver. The wireless data communication network includes a physical (PHY) layer, a medium access control (MAC) layer, and at least one higher layer. The receiver is configured to: receive a time sequence of WSS (TSWSS) based on a wireless protocol through a wireless channel of a venue, and perform multiple wireless sensing measurements based on the received TSWSS to obtain sensing measurement results. The PHY layer or MAC layer of the receiver reports the sensing measurement results to at least one higher layer of the receiver. At least one higher layer of the receiver performs a sensing-based task based on the sensing measurement results.
[0025] In another embodiment, a wireless device for wireless sensing in a wireless data communication network is described. The wireless device includes: a processor; a memory, which is communicatively coupled to the processor; and a receiver, which is communicatively coupled to the processor. An additional wireless device in the wireless data communication network is configured to send a time sequence of wireless sounding signals (WSS) based on a wireless protocol associated with the wireless data communication network. The wireless data communication network includes a physical (PHY) layer, a medium access control (MAC) layer, and at least one higher layer. The receiver is configured to: receive a time sequence of WSS (TSWSS) based on a wireless protocol through a wireless channel of the venue, and perform multiple wireless sensing measurements based on the received TSWSS to obtain sensing measurement results. The PHY layer or the MAC layer of the receiver reports the sensing measurement results to at least one higher layer of the receiver. At least one higher layer of the receiver performs a sensing-based task based on the sensing measurement results.
[0026] In yet another embodiment, a method for wireless sensing is described. The method includes: a transmitter in a wireless data communication network sends a time sequence of wireless sounding signals (WSS) based on a wireless protocol associated with the wireless data communication network, wherein the wireless data communication network includes a physical (PHY) layer, a medium access control (MAC) layer, and at least one higher layer; a receiver in the wireless data communication network receives a time sequence of WSS (TSWSS) based on the wireless protocol through a wireless channel of a venue; the receiver performs a plurality of wireless sensing measurements based on the received TSWSS to obtain sensing measurement results; the PHY layer or MAC layer of the receiver reports the sensing measurement results to at least one higher layer of the receiver; and at least one higher layer of the receiver performs a sensing-based task based on the sensing measurement results.
[0027] Other concepts relate to software for implementing the present teachings of wireless sensing measurement and reporting. Additional novel features will be set forth in part in the following description, and in part will become apparent to those skilled in the art upon examination of the following and accompanying drawings, or may be learned by production or operation of the examples. The novel features of the present teachings may be realized and obtained by practicing or using various aspects of the methods, tools, and combinations set forth in the detailed examples discussed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] The methods, systems and / or devices described herein are further described according to exemplary embodiments. These exemplary embodiments are described in detail with reference to the accompanying drawings. These embodiments are non-limiting exemplary embodiments, in which the same reference numerals represent similar structures in multiple views of the accompanying drawings.
[0029] Figure 1 An example of a wireless sensing process according to some embodiments of the present disclosure is shown.
[0030] Figure 2 Another example of a wireless sensing process according to some embodiments of the present disclosure is shown.
[0031] Figure 3 An example of a trigger-based wireless sensing measurement instance according to some embodiments of the present disclosure is shown.
[0032] Figure 4-13 Various exemplary use cases for wireless sensing and reporting according to various embodiments of the present disclosure are shown.
[0033] Fig.14 An example of measurement instances shared within a wireless sensing session according to some embodiments of the present disclosure is shown.
[0034] Fig.15 An example of measurement instances shared across wireless sensing sessions according to some embodiments of the present disclosure is shown.
[0035] Fig.16 An exemplary block diagram of a first wireless device of a system for wireless sensing according to some embodiments of the present disclosure is shown.
[0036] Fig.17 An exemplary block diagram of a second wireless device of a system for wireless sensing according to some embodiments of the present disclosure is shown.
[0037] Fig.18 A flow chart illustrating an exemplary method for identifying a device for wireless sensing according to some embodiments of the present disclosure.
[0038] Fig.19 An example of two-way transponder-to-transponder sensing is shown in accordance with some embodiments of the present disclosure.
[0039] Fig. 20 A plurality of stations (STAs) are shown in a non-infrastructure mode forming an ad hoc network according to some embodiments of the present disclosure.
[0040] Figure 21-25 Various use cases for non-infrastructure mode sensing according to some embodiments of the present disclosure are shown.
[0041] Figure 26-27 Various use cases for updating a proxy sensing (SBP) process according to some embodiments of the present disclosure are shown. DETAILED DESCRIPTION
[0042] In one embodiment, the present teaching discloses a method, apparatus, device, system and / or software (method / apparatus / device / system / software) for a wireless monitoring system. A time sequence of channel information (CI) of a wireless multipath channel (channel) can be obtained (e.g., dynamically) using a processor, a memory communicatively coupled to the processor, and an instruction set stored in the memory. A time sequence of CI (TSCI) can be extracted from a wireless signal (signal) transmitted between a type 1 heterogeneous wireless device (e.g., a wireless transmitter, TX) and a type 2 heterogeneous wireless device (e.g., a wireless receiver, RX) in a venue through a channel. The channel may be affected by the expression (e.g., motion, movement, expression and / or change in positioning / posture / shape / expression) of an object in the venue. Features and / or space-time information (STI, such as motion information) of an object and / or the motion of the object can be monitored based on the TSCI. Tasks can be performed based on features and / or STI. Representations associated with the task can be generated in a user interface (UI) on a user's device. The TSCI can be a wireless signal stream. The TSCI or each CI can be preprocessed. The device can be a station (STA). In the present teachings, the notation “A / B” means “A and / or B”.
[0043] Expression can include placement, placement of movable parts, position, location, orientation, identifiable location, area, spatial coordinates, representation, state, static expression, size, length, width, height, angle, proportion, shape, curve, surface, area, volume, pose, posture, performance, body language, dynamic expression, movement, movement sequence, gesture, extension, contraction, distortion, deformation, body expression (e.g., head, face, eyes, mouth, tongue, hair, voice, neck, limbs, arms, hands, legs, feet, muscles, movable parts), surface expression (e.g., shape, texture, material, color, electromagnetic (EM) signature, visual pattern, moisture, reflectivity, translucency, flexibility), material properties (e.g., living tissue, hair, fabric, metal, wood, leather, plastic, man-made materials, solids, liquids, gases, temperature), movement, activity, behavior, change of expression, and / or some combination.
[0044] Wireless signals may include: transmit / receive signals, EM radiation, RF signals / transmissions, signals in licensed / unlicensed / ISM bands, band-limited signals, baseband signals, wireless / mobile / cellular communication signals, wireless / mobile / cellular network signals, mesh signals, optical signals / communications, downlink / uplink signals, unicast / multicast / broadcast signals, standards (e.g., WLAN, WWAN, WPAN, WBAN, international, national, industry, de facto standards, IEEE, IEEE The CI may be a signal or sequence of signals, such as a signal from a wireless device, a signal from a wireless network, a signal from a wireless device, a signal from a wireless network, a signal from a wireless device, a signal from a wireless network, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device, a signal from a wireless device
[0045] A wireless multipath channel may include: a communication channel, an analog frequency channel (e.g., an analog carrier frequency close to 700 / 800 / 900 MHz, 1.8 / 1.8 / 2.4 / 3 / 5 / 6 / 27 / 60 GHz), a coded channel (e.g., in CDMA), and / or a channel of a wireless network / system (e.g., WLAN, WiFi, mesh network, LTE, 4G / 5G, Bluetooth, Zigbee, UWB, RFID, microwave). It may include more than one channel. Channels may be continuous (e.g., with adjacent / overlapping frequency bands) or non-continuous channels (e.g., non-overlapping WiFi channels, one at 2.4 GHz and one at 5 GHz).
[0046] The TSCI may be extracted from a wireless signal at a layer of a Type 2 device (e.g., OSI reference model layer, physical layer, data link layer, logical link control layer, medium access control (MAC) layer, network layer, transport layer, session layer, presentation layer, application layer, TCP / IP layer, internet layer, link layer). The TSCI may be extracted from a derived signal (e.g., baseband signal, motion detection signal, motion sensing signal) derived from a wireless signal (e.g., RF signal). It may be a (wireless) measurement sensed using a communication protocol (e.g., a standardized protocol) of an existing mechanism (e.g., wireless / cellular communication standards / networks, 3G / LTE / 4G / 5G / 6G / 7G / 8G, WiFi, IEEE 802.11 / 15 / 16). The derived signal may include a packet having at least one of: a preamble, a header, and a payload (e.g., for data / control / management in a wireless link / network). The TSCI may be extracted from a sounding signal (e.g., training sequence, STF, LTF, L-STF, L-LTF, L-SIG, HE-STF, HE-LTF, HE-SIG-A, HE-SIG-B, CEF) in a packet. The motion detection / sensing signal may be recognized / identified based on the sounding signal. The packet may be a standard-compliant protocol frame, a management frame, a control frame, a data frame, a sounding frame, an excitation frame, an illumination frame, a null data frame, a beacon frame, a pilot frame, a probe frame, a request frame, a response frame, an association frame, a reassociation frame, a disassociation frame, an authentication frame, an operation frame, a report frame, a polling frame, an announcement frame, an extension frame, an inquiry frame, an acknowledgement frame, an RTS frame, a CTS frame, a QoS frame, a CF-Poll frame, a CF-Ack frame, a block acknowledgement frame, a reference frame, a training frame, and / or a synchronization frame.
[0047] The packet may include control data and / or motion detection probes. Data (e.g., ID / parameters / features / settings / control signals / commands / instructions / notifications / broadcast related information of a Type 1 device) may be obtained from the payload. The wireless signal may be sent by a Type 1 device. It may be received by a Type 2 device. A database (e.g., in a local server, hub device, cloud server, storage network) may be used to store TSCI, features, STI, signatures, patterns, behaviors, trends, parameters, analysis, output responses, identification information, user information, device information, channel information, venue (e.g., map, environment model, network, neighboring devices / network) information, task information, class / category information, representation (e.g., UI) information, and / or other information.
[0048] Type 1 / Type 2 devices may include at least one of the following: electronics, circuitry, transmitter (TX) / receiver (RX) / transceiver, RF interface, "raw satellite" / "tracker Bof", unicast / multicast / broadcast device, wireless source device, source / destination device, wireless node, hub device, target device, motion detection device, sensor device, remote / wireless sensor device, wireless communication device, wireless-enabled device, standard-compliant device, and / or receiver. Type 1 (or Type 2) devices may be heterogeneous in that when there is more than one instance of a Type 1 (or Type 2) device, they may have different circuitry, housing, structure, purpose, ancillary functions, chips / ICs, processors, memory, software, firmware, network connections, antennas, brands, models, appearance, form, shape, color, materials, and / or specifications. Type 1 / Type 2 devices may include: access points, routers, mesh routers, Internet of Things (IoT) devices, wireless terminals, one or more radio / RF subsystems / wireless interfaces (e.g., 2.4 GHz radio, 5 GHz radio, fronthaul radio, backhaul radio), modems, RF front ends, RF / radio chips or integrated circuits (ICs).
[0049] At least one of the following: Type 1 devices, Type 2 devices, links between them, objects, features, STIs, monitoring of motion, and tasks can be associated with an identification (ID) such as a UUTD. Type 1 / Type 2 / another device can obtain / store / retrieve / access / pre-process / adjust / process / analyze / monitor / apply TSCI. Type 1 and Type 2 devices can transmit network services in another channel (e.g., Ethernet, HDMI, USB, Bluetooth, BLE, WiFi, LTE, other networks, wireless multipath channels) in parallel with wireless signals. Type 2 devices can passively observe / monitor / receive wireless signals from Type 1 devices in wireless multipath channels without establishing a connection (e.g., as association / authentication) or requesting services with Type 1 devices.
[0050] A transmitter (i.e., a type 1 device) may temporarily, sporadically, continuously, repeatedly, interchangeably, alternatingly, simultaneously, in parallel, and / or concurrently act as a receiver (i.e., a type 2 device) (playing the role of a receiver); and vice versa. A device may temporarily, sporadically, continuously, repeatedly, simultaneously, in parallel, and / or concurrently act as a type 1 device (transmitter) and / or a type 2 device (receiver). There may be multiple wireless nodes, each of which is a type 1 (TX) and / or type 2 (RX) device. When every two nodes exchange / communicate wireless signals, TSCI may be obtained between them. The characteristics and / or STI of an object may be monitored individually based on TSCI, or jointly based on two or more (e.g., all) TSCIs.
[0051] The movement of an object may be monitored actively (because a Type 1 device, a Type 2 device, or both are wearable / associated with the object) and / or passively (because both Type 1 and Type 2 devices are not wearable / associated with the object). It may be passive because the object may not be associated with a Type 1 device and / or a Type 2 device. The object (e.g., a user, an automated guided vehicle, or an AGV) may not need to carry / install any wearable devices / fixtures (i.e., Type 1 devices and Type 2 devices are not wearable / attached devices that the object needs to carry to perform a task). It may be active because the object may be associated with a Type 1 device and / or a Type 2 device. The object may carry (or install) a wearable / fixture (e.g., a Type 1 device, a Type 2 device, a device communicatively coupled to a Type 1 device or a Type 2 device).
[0052] The representation may be visual, audio, image, video, animation, graphical representation, text, etc. The computation of the task may be performed by a processor (or logic unit) of a type 1 device, a processor (or logic unit) of an IC of a type 1 device, a processor (or logic unit) of a type 2 device, a processor of an IC of a type 2 device, a local server, a cloud server, a data analysis subsystem, a signal analysis subsystem, and / or another processor. The task may be performed with reference to / without reference to a wireless fingerprint or baseline (e.g., collected, processed, calculated, sent, and / or stored in a training phase / survey / current survey / previous survey / recent survey / initial wireless survey, passive fingerprint), training, profile, trained profile, static profile, survey, initial wireless survey, initial setup, installation, retraining, update, and reset.
[0053] A type 1 device (TX device) may include at least one heterogeneous wireless transmitter. A type 2 device (RX device) may include at least one heterogeneous wireless receiver. Type 1 devices and type 2 devices may be collocated. Type 1 devices and type 2 devices may be the same device. Any device may have a data processing unit / device, a computing unit / system, a network unit / system, a processor (e.g., a logic unit), a memory communicatively coupled to the processor, and a set of instructions stored in the memory and executed by the processor. Some processors, memories, and instruction sets may be coordinated.
[0054] There may be multiple type 1 devices that interact (e.g., communicate, exchange signals / controls / notifications / other data) with the same type 2 device (or multiple type 2 devices), and / or there may be multiple type 2 devices that interact with the same type 1 device. Multiple type 1 devices / type 2 devices may be synchronous and / or asynchronous, with the same / different window widths / sizes and / or time offsets, the same / different synchronization start times, synchronization end times, etc. The wireless signals sent by multiple type 1 devices may be sporadic, temporary, continuous, repeated, synchronous, simultaneous, concurrent, and / or contemporaneous. Multiple type 1 devices / type 2 devices may operate independently and / or collaboratively. Type 1 and / or type 2 devices may have / include / be heterogeneous hardware circuit systems (e.g., heterogeneous chips or heterogeneous ICs capable of generating / receiving wireless signals, extracting CI from received signals, or making CI available). They may be communicatively coupled to the same or different servers (e.g., cloud servers, edge servers, local servers, hub devices).
[0055] The operation of one device may be based on the operation, state, internal state, storage, processor, memory output, physical location, computing resources, network of another device. Different devices may communicate directly, and / or via another device / server / hub device / cloud server. The device may be associated with one or more users and associated settings. Settings may be selected once, preprogrammed, and / or changed (e.g., adjusted, changed, modified) / changed over time. There may be additional steps in the method. The steps and / or additional steps of the method may be performed in the order shown or in another order. Any step may be repeated in parallel, iteratively or otherwise or performed in another manner. The user may be a human, an adult, an elderly person, a man, a woman, a teenager, a child, a baby, a pet, an animal, a creature, a machine, a computer module / software, etc.
[0056] In the case where one or more type 1 devices interact with one or more type 2 devices, any processing (e.g., time domain, frequency domain) may be different for different devices. The processing may be based on location, orientation, direction, role, user-related characteristics, settings, configuration, available resources, available bandwidth, network connection, hardware, software, processor, coprocessor, memory, battery life, available power, antenna, antenna type, directional / unidirectional characteristics of antenna, power settings, and / or other parameters / characteristics of the device.
[0057] A wireless receiver (e.g., a type 2 device) may receive a signal and / or another signal from a wireless transmitter (e.g., a type 1 device). The wireless receiver may receive another signal from another wireless transmitter (e.g., a second type 1 device). The wireless transmitter may send a signal and / or another signal to another wireless receiver (e.g., a second type 2 device). The wireless transmitter, the wireless receiver, another wireless receiver, and / or another wireless transmitter may move with the object and / or another object. Another object may be tracked.
[0058] Type 1 and / or type 2 devices may be capable of wirelessly coupling with at least two type 2 and / or type 1 devices. A type 1 device may be prompted / controlled to switch / establish a wireless coupling (e.g., association, authentication) from a type 2 device to a second type 2 device at another location in the venue. Similarly, a type 2 device may be prompted / controlled to switch / establish a wireless coupling from a type 1 device to a second type 1 device at another location in the venue. The switch may be controlled by a server (or hub device), a processor, a type 1 device, a type 2 device, and / or another device. The radio used before and after the switch may be different. A second wireless signal (second signal) may be prompted to be sent between a type 1 device and a second type 2 device (or between a type 2 device and a second type 1 device) through a channel. A second TSCI of a channel extracted from the second signal may be obtained. The second signal may be the first signal. Features, STIs, and / or another quantity of an object may be monitored based on the second TSCI. Type 1 devices and type 2 devices may be the same. Features, STIs, and / or another quantity with different timestamps may form a waveform. The waveform may be displayed in a representation.
[0059] The wireless signal and / or another signal may be embedded with data. The wireless signal may be a series of detection signals (e.g., repeated transmission of a detection signal, reuse of one or more detection signals). The detection signal may change / change over time. The detection signal may be a standard-compliant signal, a protocol signal, a standardized wireless protocol signal, a control signal, a data signal, a wireless communication network signal, a cellular network signal, a WiFi signal, a LTE / 5G / 6G / 7G signal, a reference signal, a beacon signal, a motion detection signal, and / or a motion sensing signal. The detection signal may be formatted according to a wireless network standard (e.g., WiFi), a cellular network standard (e.g., LTE / 5G / 6G), or another standard. The detection signal may include a packet having a header and a payload. The detection signal may be embedded with data. The payload may include data. The detection signal may be replaced by a data signal. The detection signal may be embedded in a data signal. A wireless receiver, a wireless transmitter, another wireless receiver and / or another wireless transmitter may be associated with at least one processor, a memory communicatively coupled to the corresponding processor and / or a corresponding instruction set stored in the memory, which, when executed, causes the processor to perform any and / or all steps required to determine the STI (e.g., motion information), initial STI, initial time, direction, instantaneous position, instantaneous angle and / or velocity of an object.
[0060] The processor, memory and / or instruction set may be associated with a type 1 device, one of at least one type 2 device, an object, a device associated with an object, another device associated with a location, a cloud server, a hub device, and / or another server.
[0061] A type 1 device may send a signal to at least one type 2 device in a broadcast manner through a channel in a place. The signal is sent when the type 1 device does not establish a wireless connection (e.g., association, authentication) with any type 2 device and no type 2 device requests a service from the type 1 device. The type 1 device may send to a specific media access control (MAC) address shared by more than one type 2 device. Each type 2 device may adjust its MAC address to a specific MAC address. A specific MAC address may be associated with a place. The association may be recorded in an association table of an association server (e.g., a hub device). A place may be identified by a type 1 device, a type 2 device, and / or another device based on a specific MAC address, a series of probe signals, and / or at least one TSCI extracted from the probe signal.
[0062] For example, a type 2 device may be moved to a new location in a venue (e.g., from another venue). A type 1 device may be newly set up in a venue so that the type 1 and type 2 devices are unaware of each other. During setup, a type 1 device may be instructed / guided / caused / controlled (e.g., using a virtual receiver, using hardware pin settings / connections, using stored settings, using local settings, using remote settings, using downloaded settings, using a hub device, or using a server) to send a series of probe signals to a specific MAC address. At startup, a type 2 device may scan for probe signals based on a MAC address table (e.g., stored in a specified source, server, hub device, cloud server), which may be used to broadcast in different locations (e.g., different MAC addresses are used for different venues, such as a house, office, housing, floor, multi-story building, store, airport, mall, stadium, hall, station, subway, lot, region, zone, region, city, country, continent). When a type 2 device detects a probe signal sent to a specific MAC address, the type 2 device may use the table to identify the venue based on the MAC address.
[0063] The location of the Type 2 device in the venue may be calculated based on a specific MAC address, a series of probe signals, and / or at least one TSCI obtained by the Type 2 device from the probe signals. The calculation may be performed by the Type 2 device.
[0064] The specific MAC address may change (e.g., adjust, vary, modify) over time. It may change according to a schedule, rule, policy, mode, condition, situation, and / or change. The specific MAC address may be selected based on availability of MAC addresses, a pre-selected list, conflict patterns, traffic patterns, data traffic between a Type 1 device and another device, available bandwidth, random selection, and / or a MAC address switching schedule. The specific MAC address may be a MAC address of a second wireless device (e.g., a virtual receiver or a receiver acting as a virtual receiver).
[0065] A type 1 device may transmit a probing signal in a channel selected from a group of channels. At least one CI of the selected channel may be obtained by a corresponding type 2 device from the probing signal transmitted in the selected channel.
[0066] The selected channel may change (e.g., adjust, vary, modify) over time. The change may be according to a schedule, rule, policy, pattern, condition, situation, and / or change. The selected channel may be selected based on channel availability, random selection, a pre-selected list, co-channel interference, inter-channel interference, channel traffic pattern, data traffic between a Type 1 device and another device, effective bandwidth associated with the channel, security criteria, channel switching schedule, standards, quality criteria, signal quality conditions, and / or considerations.
[0067] The information of the specific MAC address and / or the selected channel can be transmitted between the type 1 device and the server (e.g., a hub device) through a network. The specific MAC address and / or the information of the selected channel can also be transmitted between the type 2 device and the server (e.g., a hub device) through another network. The type 2 device can transmit the information of the specific MAC address and / or the selected channel to another type 2 device (e.g., via a mesh network, Bluetooth, WiFi, NFC, ZigBee, etc.). The specific MAC address and / or the selected channel can be selected by the server (e.g., a hub device). The specific MAC address and / or the selected channel can be signaled in an announcement channel by the type 1 device, the type 2 device, and / or the server (e.g., a hub device). Any information can be pre-processed before transmission.
[0068] A wireless connection (e.g., association, authentication) between a type 1 device and another wireless device may be established (e.g., using a signal handshake). The type 1 device may send a first handshake signal (e.g., a probe frame, a detection signal, a request to send RTS) to the other device. The other device may reply by sending a second handshake signal (e.g., a command or clear to send CTS) to the type 1 device, triggering the type 1 device to send a signal (e.g., a series of detection signals) to multiple type 2 devices in a broadcast manner without establishing a connection with any type 2 device. The second handshake signal may be a response or confirmation (e.g., ACK) to the first handshake signal. The second handshake signal may contain data with information of a location and / or type 1 device. The other device may be a virtual device having the purpose (e.g., primary purpose, secondary purpose) of establishing a wireless connection with the type 1 device, receiving the first signal, and / or sending the second signal. The other device may be physically attached to the type 1 device.
[0069] In another example, another device may send a third handshake signal to a type 1 device, triggering the type 1 device to broadcast a signal (e.g., a series of probe signals) to multiple type 2 devices without establishing a connection (e.g., association, authentication) with any type 2 device. The type 1 device may reply to the third special signal by sending a fourth handshake signal to the other device. Another device may be used to trigger more than one type 1 device to broadcast. The trigger may be sequential, partially sequential, partially parallel, or completely parallel. Another device may have more than one wireless circuit to trigger multiple transmitters in parallel. Parallel triggering can also be implemented using at least one other device to perform a trigger in parallel with another device (similar to what another device does). After establishing a connection with a type 1 device, the other device may not communicate with the type 1 device (or suspend communication). Suspended communication may be resumed. After establishing a connection with a type 1 device, the other device may enter an inactive mode, a dormant mode, a sleep mode, a standby mode, a low power mode, a shutdown mode, and / or a power-off mode. Another device may have a specific MAC address so that the type 1 device sends a signal to a specific MAC address. The type 1 device and / or the other device may be controlled and / or coordinated by a first processor associated with the type 1 device, a second processor associated with the other device, a third processor associated with the specified source, and / or a fourth processor associated with the other device. The first and second processors may coordinate with each other.
[0070] A first series of probe signals may be sent by a first antenna of a type 1 device to at least one first type 2 device via a first channel in a first location. A second series of probe signals may be sent by a second antenna of a type 1 device to at least one second type 2 device via a second channel in a second location. The first series and the second series may or may not be different. At least one first type 2 device may / may not be different from at least one second type 2 device. The first and / or second series of probe signals may be broadcast without establishing a connection (e.g., association, authentication) between the type 1 device and any type 2 device. The first and second antennas may be the same / different.
[0071] The two locations may have different sizes, shapes, multipath characteristics. The first and second locations may overlap. The corresponding immediate vicinity around the first and second antennas may overlap. The first and second channels may be the same / different. For example, the first may be WiFi and the second may be LTE. Or, both may be WiFi, but the first may be 2.4 GHz WiFi and the second may be 5 GHz WiFi. Or, both may be 2.4 GHz WiFi, but with different channel numbers, SSID names, and / or WiFi settings.
[0072] Each type 2 device may obtain at least one TSCI from a corresponding series of probing signals, which is the CI of the corresponding channel between the type 2 device and the type 1 device. Some of the first type 2 devices and some of the second type 2 devices may be identical. The first and second series of probing signals may be synchronous / asynchronous. The probing signals may be sent with data or replaced by data signals. The first and second antennas may be identical.
[0073] The first series of probe signals may be sent at a first rate (e.g., 30 Hz). The second series of probe signals may be sent at a second rate (e.g., 200 Hz). The first and second rates may be the same / different. The first and / or second rates may change (e.g., adjust, vary, modify) over time. The change may be based on a schedule, rule, policy, pattern, condition, situation, and / or change. Any rate may change (e.g., adjust, vary, modify) over time.
[0074] The first and / or second series of probe signals may be sent to the first MAC address and / or the second MAC address, respectively. The two MAC addresses may be the same / different. The first series of probe signals may be sent in a first channel. The second series of probe signals may be sent in a second channel. The two channels may be the same / different. The first or second MAC address, the first or second channel may change over time. Any changes may be based on a schedule, rule, policy, pattern, condition, situation, and / or change.
[0075] The type 1 device and the other device may be controlled and / or coordinated, physically attached, or may belong to / be in / belong to a common device. They may be controlled by / connected to a common data processor, or may be connected to a common bus interconnect / network / LAN / Bluetooth network / NFC network / BLE network / wired network / wireless network / mesh network / mobile network / cloud. They may share a common memory, or be associated with a common user, user device, profile, account, identity (ID), identifier, home, house, physical address, location, geographic coordinates, IP subnet, SSID, home device, office device, and / or manufacturing equipment.
[0076] Each type 1 device may be a signal source for a group of corresponding type 2 devices (i.e., it sends a corresponding signal (e.g., a corresponding series of detection signals) to the group of corresponding type 2 devices). Each corresponding type 2 device selects a type 1 device as its signal source from all type 1 devices. Each type 2 device may be selected asynchronously. At least one TSCI may be obtained by each corresponding type 2 device from a corresponding series of detection signals from a type 1 device, the CI being the CI of the channel between the type 2 device and the type 1 device.
[0077] The corresponding type 2 device selects a type 1 device as its signal source from all type 1 devices based on the identity (ID) or identifier of the type 1 / type 2 device, the task to be performed, past signal sources, history (e.g., past signal sources, type 1 devices, another type 1 device, the corresponding type 2 receiver and / or another type 2 receiver), thresholds for switching signal sources and / or user information, accounts, access information, parameters, characteristics and / or signal strength (e.g., associated with the type 1 device and / or the corresponding type 2 receiver).
[0078] Initially, a Type 1 device may be a signal source for a group of initial corresponding Type 2 devices at an initial time (i.e., the Type 1 device sends a corresponding signal (a series of detection signals) to the group of initial corresponding Type 2 devices). Each initial corresponding Type 2 device selects a Type 1 device from all Type 1 devices as its signal source.
[0079] The signal source (type 1 device) of a particular type 2 device may be changed (e.g., adjusted, altered, modified) when (1) the time interval between two adjacent detection signals received from the current signal source of the type 2 device (e.g., between the current detection signal and the detection signal that just passed, or between the next detection signal and the current detection signal) exceeds a first threshold; (2) the signal strength associated with the current signal source of the type 2 device is lower than a second threshold; (3) the processed signal strength associated with the current signal source of the type 2 device is lower than a third threshold, and the signal strength is processed using a low-pass filter, a band-pass filter, a median filter, a moving average filter, a weighted average filter, a linear filter, and / or a nonlinear filter; and / or (4) the signal strength (or processed signal strength) associated with the current signal source of the type 2 device has a significant percentage (e.g., 70%, 80%, 90%) lower than a fourth threshold in a recent time window. The percentage may exceed a fifth threshold. The first, second, third, fourth, and / or fifth thresholds may change over time.
[0080] When the Type 1 device and the Type 2 device become increasingly distant from each other, situation (1) may occur, causing some of the probe signals from the Type 1 device to become too weak and not be received by the Type 2 device. When the two devices move away from each other so that the signal strength becomes very weak, situations (2)-(4) may occur.
[0081] If other Type 1 devices have signal strengths that are a factor (eg, 1, 1.1, 1.2, or 1.5) weaker than the current signal source, the signal source for the Type 2 device may not change.
[0082] If the signal source changes (e.g., adjusts, changes, modifies), the new signal source may take effect at a near future time (e.g., the next corresponding time). The new signal source may be a Type 1 device with the strongest signal strength and / or processed signal strength. The current and new signal sources may be the same / different.
[0083] A list of available Type 1 devices may be initialized and maintained by each Type 2 device. The list may be updated by examining the signal strengths associated with the corresponding group of Type 1 devices and / or the processed signal strengths. The Type 2 device may select between a first series of probe signals from a first Type 1 device and a second series of probe signals from a second Type 1 device based on the respective probe signal rates, MAC addresses, channels, features / characteristics / states, tasks to be performed by the Type 2 device, signal strengths of the first and second series, and / or another consideration.
[0084] A series of probe signals may be sent at a regular rate (e.g., 100 Hz). A series of probe signals may be scheduled at regular intervals (e.g., 0.01 s for 100 Hz), but each probe signal may experience small time perturbations due to timing requirements, timing control, network control, handshaking, messaging, collision avoidance, carrier sensing, congestion, resource availability, and / or another consideration.
[0085] The rate may be changed (e.g., adjusted, varied, modified). The change may be based on a schedule (e.g., changed every hour), a rule, a policy, a mode, a condition, and / or a change (e.g., changed whenever a certain event occurs). For example, the rate may be typically 100 Hz, but changed to 1000 Hz in demanding situations, and changed to 1 Hz in low power / standby situations. The probe signal may be sent in bursts.
[0086] The detection signal rate can vary based on the task performed by the type 1 device or the type 2 device (for example, a task may normally require 100 Hz and temporarily require 1000 Hz for 20 seconds). In one example, the transmitter (type 1 device), the receiver (type 2 device), and the associated tasks can be adaptively (and / or dynamically) associated to classes (for example, low priority, high priority, emergency, critical, regular, privileged, non-subscription, subscription, paid and / or non-paid classes). The rate (of the transmitter) can be adjusted for some classes (for example, a high priority class). The rate can be changed (for example, adjusted, changed, modified) when the needs of the class change. When the receiver has extremely low power, the rate can be reduced to reduce the power consumption of the receiver in response to the detection signal. In one example, the detection signal can be used to wirelessly transmit power to the receiver (type 2 device), and the rate can be adjusted to control the amount of power transmitted to the receiver.
[0087] The rate can be changed by (or based on) a server (e.g., a hub device), a Type 1 device, and / or a Type 2 device. Control signals can be transmitted between them. The server can monitor, track, predict, and / or anticipate the needs of the Type 2 device and / or the tasks performed by the Type 2 device, and can control the Type 1 device to change the rate. The server can make predetermined changes to the rate according to a schedule. The server can detect an emergency and change the rate immediately. The server can detect a developing situation and gradually adjust the rate.
[0088] Features and / or STIs (e.g., motion information) may be monitored individually based on TSCIs associated with a specific Type 1 device and a specific Type 2 device, and / or jointly based on any TSCI associated with a specific Type 1 device and any Type 2 device, and / or jointly based on any TSCI associated with a specific Type 2 device and any Type 1 device, and / or globally based on any TSCI associated with any Type 1 device and any Type 2 device. Any joint monitoring may be associated with: a user, user account, profile, family, venue map, venue environment model, and / or user history, etc.
[0089] A first channel between a Type 1 device and a Type 2 device may be different from a second channel between another Type 1 device and another Type 2 device. The two channels may be associated with different frequency bands, bandwidths, carrier frequencies, modulations, wireless standards, encodings, encryptions, payload characteristics, networks, network IDs, SSIDs, network characteristics, network settings, and / or network parameters, etc.
[0090] The two channels may be associated with different kinds of wireless systems (e.g., two of the following: WiFi, LTE, LTE-A, LTE-U, 2.5G, 3G, 3.5G, 4G, Beyond 4G, 5G, 6G, 7G, cellular network standards, UMTS, 3GPP, GSM, EDGE, TDMA, FDMA, CDMA, WCDMA, TD-SCDMA, 802.11 systems, 802.15 systems, 802.16 systems, mesh networks, Zigbee, NFC, WiMax, Bluetooth, BLE, RFID, UWB, microwave systems, radar-like systems). For example, one is WiFi and the other is LTE.
[0091] The two channels may be associated with similar kinds of wireless systems, but in different networks. For example, the first channel may be associated with a WiFi network named "Pizza and Pizza" in the 2.4 GHz band with a bandwidth of 20 MHz, while the second channel may be associated with a WiFi network with an SSID of "StarBud hotspot" in the 5 GHz band with a bandwidth of 40 MHz. The two channels may be different channels in the same network (e.g., the "StarBud hotspot" network).
[0092] In one embodiment, the wireless monitoring system may include training classifiers for multiple events in a venue based on training TSCI associated with multiple events. The CI or TSCI associated with an event may be considered / may include wireless samples / signatures / fingerprints associated with the event (and / or venue, environment, object, object's motion, state / emotional state / mental state / condition / stage / posture / gait / action / movement / activity / daily activities / history / object event, etc.).
[0093] For each of a plurality of known events occurring in a venue during a corresponding training (e.g., survey, wireless survey, initial wireless survey) time period associated with the known event, a corresponding training wireless signal (e.g., a corresponding series of training probe signals) may be sent by an antenna of a first type 1 heterogeneous wireless device using a processor, a memory, and a set of instructions of the first type 1 device to at least one first type 2 heterogeneous wireless device via a wireless multipath channel in the venue during a corresponding training time period.
[0094] A time sequence of at least one corresponding training CI (training TSCI) may be asynchronously obtained by each of the at least one first type 2 device from a (corresponding) training signal. The CI may be a CI of a channel between the first type 2 device and the first type 1 device during a training time period associated with a known event. The at least one training TSCI may be pre-processed. The training may be an over-the-air survey (e.g., during installation of the type 1 device and / or type 2 device).
[0095] For a current event occurring in a venue in a current time period, a current wireless signal (e.g., a series of current detection signals) may be sent by an antenna of a second type 1 heterogeneous wireless device using a processor, a memory, and a set of instructions of the second type 1 device to at least one second type 2 heterogeneous wireless device through a channel in the venue in a current time period associated with the current event.
[0096] A time sequence of at least one current CI (current TSCI) may be asynchronously obtained by each of the at least one second type 2 device from a current signal (e.g., a series of current probe signals). The CI may be a CI of a channel between the second type 2 device and the second type 1 device in a current time period associated with the current event. The at least one current TSCI may be pre-processed.
[0097] The classifier may be applied to classify at least one current TSCI obtained by at least one second type 2 device from a series of current detection signals, to classify at least a portion of a specific current TSCI, and / or to classify a combination of at least a portion of a specific current TSCI and another portion of another TSCI. The classifier may divide the TSCI (or feature / STI or other analysis or output response) into clusters and associate the clusters with specific events / objects / topics / positions / movements / activities. Tags / marks may be generated for clusters. Clusters may be stored and retrieved. The classifier may be applied to associate the current TSCI (or feature / STI or other analysis / output response, which may be associated with the current event) with the following: clusters, known / specific events, lists / clusters / sets of classes / categories / groups / groupings / known events / topics / positions / movements / activities, unknown events, lists / clusters / sets of classes / categories / groups / groupings / unknown events / topics / positions / movements / activities, and / or another event / topic / position / movement / activity / classes / categories / groups / groupings / lists / clusters / sets. Each TSCI may include at least one CI, each associated with a corresponding timestamp. The two TSCIs associated with two Type 2 devices may be different, having different: start time, duration, stop time, CI amount, sampling frequency, sampling period. Their CIs may have different characteristics. The first and second Type 1 devices may be located at the same location in the premises. They may be the same device. The at least one second Type 2 device (or their location) may be an arrangement of at least one first Type 2 device (or their location). A specific second Type 2 device and a specific first Type 2 device may be the same device.
[0098] The subset of the first type 2 devices and the subset of the second type 2 devices may be the same. The at least one second type 2 device and / or the subset of the at least one second type 2 device may be a subset of at least one first type 2 device. The at least one first type 2 device and / or the subset of the at least one first type 2 device may be a permutation of a subset of at least one second type 2 device. The at least one second type 2 device and / or the subset of the at least one second type 2 device may be a permutation of a subset of at least one first type 2 device. The at least one second type 2 device and / or the subset of the at least one second type 2 device may be located at the same corresponding position as the subset of at least one first type 2 device. The at least one first type 2 device and / or the subset of the at least one first type 2 device may be located at the same corresponding position as the subset of at least one second type 2 device.
[0099] The antenna of the type 1 device and the antenna of the second type 1 device may be located at the same location in the venue. The antenna of the at least one second type 2 device and / or the antenna of the at least one subset of the second type 2 devices may be at the same respective location as the corresponding antenna of the at least one subset of the first type 2 devices. The antenna of the at least one first type 2 device and / or the antenna of the at least one subset of the first type 2 devices may be at the same respective location as the corresponding antenna of the at least one subset of the second type 2 devices.
[0100] A first segment of a first duration of a first TSCI and a second segment of a second duration of a second segment of a second TSCI may be aligned. A mapping between items of the first segment and items of the second segment may be calculated. The first segment may include a first fragment (e.g., a subset) of a first TSCI having a first start / end time and / or another fragment (e.g., a subset) of a processed first TSCI. The processed first TSCI may be a first TSCI processed by a first operation. The second segment may include a second fragment (e.g., a subset) of a second TSCI having a second start time and a second end time and another fragment (e.g., a subset) of a processed second TSCI. The processed second TSCI may be a second TSCI processed by a second operation. The first operation and / or the second operation may include: subsampling, resampling, interpolation, filtering, transformation, feature extraction, preprocessing, and / or another operation.
[0101] The first item of the first segment can be mapped to the second item of the second segment. The first item of the first segment can also be mapped to another item of the second segment. Another item of the first segment can also be mapped to the second item of the second segment. The mapping can be one-to-one, one-to-many, many-to-one, and many-to-many. A function of at least one of the following can satisfy at least one constraint: the first item of the first segment of the first TSCI, another item of the first TSCI, the timestamp of the first item, the time difference of the first item, the time difference of the first item, the adjacent timestamps of the first item, another timestamp associated with the first item, the second item of the second segment of the second TSCI, another item of the second TSCI, the timestamp of the second item, the time difference of the second item, the time difference of the second item, the adjacent timestamps of the second item, and another timestamp associated with the second item.
[0102] One constraint may be that the difference between the timestamp of the first item and the timestamp of the second item may be bounded above by an adaptive (and / or dynamically adjusted) upper threshold and bounded below by an adaptive lower threshold.
[0103] The first segment may be the entire first TSCI. The second segment may be the entire second TSCI. The first duration may be equal to the second duration. A segment of the duration of the TSCI may be adaptively (and / or dynamically) determined. A tentative segment of the TSCI may be calculated. A start time and an end time of a segment (e.g., a tentative segment, a segment) may be determined. The segment may be determined by removing a start portion and an end portion of a tentative segment. The start portion of a tentative segment may be determined as follows. Iteratively, items of tentative segments with increasing timestamps may be considered current items, one item at a time.
[0104] In each iteration, at least one activity metric / index may be calculated and / or considered. The at least one activity metric may be associated with at least one of: a current item associated with a current timestamp, a past item of the tentative segment having a timestamp not greater than the current timestamp, and / or a future item of the tentative segment having a timestamp not less than the current timestamp. The current item may be added to the beginning of the tentative segment if at least one criterion (e.g., quality criterion, signal quality condition) associated with the at least one activity metric is met.
[0105] At least one criterion associated with the activity metric may include at least one of the following: (a) the activity metric is less than an adaptive (e.g., dynamically adjusted) upper threshold, (b) the activity metric is greater than an adaptive lower threshold, (c) for at least a predetermined number of consecutive timestamps, the activity metric is continuously less than the adaptive upper threshold, (d) for at least another predetermined number of consecutive timestamps, the activity metric is continuously greater than the adaptive lower threshold, (e) the activity metric is continuously less than the adaptive upper threshold for at least a predetermined percentage of a predetermined number of consecutive timestamps, (f) the activity metric is continuously greater than the adaptive lower threshold for at least another predetermined percentage of another predetermined number of consecutive timestamps, (g) another activity metric associated with another timestamp associated with the current timestamp is less than another adaptive upper threshold and greater than another adaptive lower threshold, (h) at least one activity metric associated with at least one corresponding timestamp associated with the current timestamp is less than a corresponding upper threshold and greater than a corresponding lower threshold, (i) the percentage of timestamps in a set of timestamps associated with the current timestamp having associated activity metrics less than a corresponding upper threshold and greater than a corresponding lower threshold exceeds a threshold, and (j) another criterion (e.g., a quality criterion, a signal quality condition).
[0106] The activity metric / index associated with an item at time T1 may include at least one of: (1) a first function of the item at time T1 and the item at time T1-D1, where D1 is a predetermined positive quantity (e.g., a constant time offset), (2) a second function of the item at time T1 and the item at time T1+D1, (3) a third function of the item at time T1 and the item at time T2, where T2 is a predetermined quantity (e.g., a fixed initial reference time; T2 may vary over time (e.g., adjusted, changed, modified); T2 may be updated periodically; T2 may be the beginning of a time period and T1 may be a sliding time in the time period), and (4) a fourth function of the item at time T1 and another item.
[0107] At least one of the first function, the second function, the third function and / or the fourth function may be a function having at least two independent variables X and Y (e.g., F(X, Y, ...)). The two independent variables may be scalars. The function (e.g., F) may be a function of at least one of the following: X, Y, (XY), (YX), abs(XY), X^a, Y^b, abs(X^aY^b), (XY)^a, (X / Y), (X+a) / (Y+b), (X^a / Y^b) and ((X / Y)^ab), where a and b may be some predetermined quantities. For example, the function may simply be abs(XY), or (XY)^2, (XY)^4. The function may be a robust function. For example, when abs(XY) is less than a threshold value T, the function may be (XY)^2, and when abs(XY) is greater than T, the function may be (XY)+a. Alternatively, when abs(XY) is greater than T, the function can be a constant. When abs(Xy) is greater than T, the function may also be limited by a slowly increasing function so that outliers do not seriously affect the results. Another example of the function may be (abs(X / Y)-a), where a=1. Thus, if X=Y (i.e., no change or no activity), the function will give a value of 0. If X is greater than Y, (X / Y) will be greater than 1 (assuming X and Y are positive) and the function will be positive. And if X is less than Y, (X / Y) will be less than 1, and the function will be negative. In another example, both the independent variables X and Y can be n-tuples, such that X=(x_1, x_2, ..., x_n) and Y=(y_1, y_2, ..., y_n). The function can be a function of at least one of the following: x_i, y_i, (x_i-y_i), (y_i-x_i), abs(x_i-y_i), x_i^a, y_i^b, abs(x_i^a-y_i^b), (x_i-y_i)^a, (x_i / y_i), (x_i+a) / (y_i+b), (x_i^a / y_i^b) and ((x_i / y_i)^ab), where i is the component index of the n-tuple X and Y, and l<=i<=n, for example, the component index of x_l is i=1, and the component index of x_2 is i=2. The function may include a component-wise summation of another function of at least one of the following: x_i, y_i, (x_i-y_i), (y_i-x_i), abs(x_i-y_i), x_i^a, y_i^b, abs(x_i^a-y_i^b), (x_i-y_i)^a, (x_i / y_i), (x_i+a) / (y_i+b), (x_i^a / y_i^b), and ((x_i / y_i)^ab), where i is the component index of the n-tuple X and Y.For example, the function can be the component index of sum_{i=l}^n(abs(x_i / y_i)-l) / n or sum_{i=l}^n w_i*(abs(x_i / y_i)-l), where w_i is some weight of component i.
[0108] The mapping may be calculated using dynamic time warping (DTW). DTW may include constraints on at least one of: a mapping, an item of a first TSCI, an item of a second TSCI, a first duration, a second duration, a first segment, and / or a second segment. Assume that in a mapping, the i^{th} domain item is mapped to the j^{th} range item. The constraint may be an acceptable combination of i and j (a constraint on the relationship between i and j). A mismatch cost between a first segment of a first duration of a first TSCI and a second segment of a second duration of a second TSCI may be calculated.
[0109] The first segment and the second segment can be aligned so that a mapping including more than one link can be established between the first item of the first TSCI and the second item of the second TSCI. For each link, one of the first items having the first timestamp can be associated with one of the second items having the second timestamp. A mismatch cost between the aligned first segment and the aligned second segment can be calculated. The mismatch cost can include the following functions: a per-item cost between the first item and the second item associated with a particular link of the mapping, and a per-link cost associated with a particular link of the mapping.
[0110] The aligned first segment and the aligned second segment may be represented as a first vector and a second vector having the same vector length, respectively. The mismatch cost may include at least one of an inner product, a class inner product amount, a correlation-based amount, a correlation indicator, a covariance-based amount, a discriminant score, a distance, a Euclidean distance, an absolute distance, an Lk distance (e.g., LI, L2, ...), a weighted distance between the first vector and the second vector, a class distance amount, and / or another similarity value. The mismatch cost may be normalized by the corresponding vector length.
[0111] Parameters derived from the mismatch cost between a first segment of a first duration of a first TSCI and a second segment of a second duration of a second TSCI may be modeled with a statistical distribution.At least one of: a scale parameter, a location parameter and / or another parameter of the statistical distribution may be estimated.
[0112] The first segment of the first duration of the first TSCI may be a sliding segment of the first TSCI. The second segment of the second duration of the second TSCI may be a sliding segment of the second TSCI.
[0113] The first sliding window may be applied to the first TSCI and the corresponding second sliding window may be applied to the second TSCI.The first sliding window of the first TSCI and the corresponding second sliding window of the second TSCI may be aligned.
[0114] A mismatch cost between an aligned first sliding window of the first TSCI and a corresponding aligned second sliding window of the second TSCI may be calculated.Based on the mismatch cost, the current event may be associated with at least one of: a known event, an unknown event, and / or another event.
[0115] The classifier may be applied to at least one of: each first segment of the first duration of the first TSCI, and / or each second segment of the second duration of the second TSCI to obtain at least one tentative classification result. Each tentative classification result may be associated with a corresponding first segment and a corresponding second segment.
[0116] Based on the mismatch cost, the current event can be associated with at least one of: a known event, an unknown event, a class / category / group / grouping / list / set of unknown events, and / or another event. Based on the maximum number of tentative classification results in more than one segment of the first TSCI and more than one segment of the corresponding second TSCI, the current event can be associated with at least one of: a known event, an unknown event, and / or another event. For example, if the mismatch cost points to a specific known event N times in a row (e.g., N=10), the current event can be associated with the specific known event. In another example, if the percentage of mismatch costs within the first N consecutive N that point to a specific known event exceeds a specific threshold (e.g., >80%), the current event can be associated with a specific known event.
[0117] In another example, the current event may be associated with a known event that achieves a minimum mismatch cost the most times in a time period. The current event may be associated with a known event that achieves a minimum overall mismatch cost, which is a weighted average of at least one mismatch cost associated with at least one first segment. The current event may be associated with a specific known event that achieves another minimum overall cost. If a known event does not achieve a mismatch cost below a first threshold T1 in a sufficient percentage of at least one first segment, the current event may be associated with an "unknown event". If no event reaches an overall mismatch cost below a second threshold T2, the current event may also be associated with an "unknown event". Based on the mismatch cost and additional mismatch cost associated with at least one additional segment of the first TSCI and at least one additional segment of the second TSCI, the current event may be associated with at least one of: a known event, an unknown event, and / or another event. Known events may include at least one of: a door closing event, a door opening event, a window closing event, a window opening event, a multi-state event, an open state event, a closed state event, an intermediate state event, a continuous state event, a discrete state event, a human presence event, a human absence event, a life sign presence event, and / or a life sign absence event.
[0118] The projection of each CI can be trained using a dimensionality reduction method based on the training TSCI. The dimensionality reduction method can include at least one of the following: principal component analysis (PCA), PCA with different kernels, independent component analysis (ICA), Fisher linear discriminant, vector quantization, supervised learning, unsupervised learning, self-organizing maps, autoencoders, neural networks, deep neural networks, and / or another method. The projection can be applied to at least one of the following: a training TSCI associated with at least one event, and / or a current TSCI of the classifier.
[0119] A classifier for at least one event may be trained based on a projection and a training TSCI associated with at least one event. At least one current TSCI may be classified / classified based on the projection and the current TSCI. The projection may be retrained using at least one of a dimensionality reduction method and another dimensionality reduction method based on at least one of the following: a training TSCI, at least one current TSCI before retraining the projection, and / or an additional training TSCI. The other dimensionality reduction method may include at least one of the following: principal component analysis (PCA), PCA with different kernels, independent component analysis (ICA), Fisher linear discriminant, vector quantization, supervised learning, unsupervised learning, self-organizing maps, autoencoders, neural networks, deep neural networks, and / or another method. A classifier for at least one event may be retrained based on at least one of the following: a retrained projection, a training TSCI associated with at least one event, and / or at least one current TSCI. At least one current TSCI may be classified based on: a retrained projection, a retrained classifier, and / or a current TSCI.
[0120] Each CI may comprise a vector of complex values. Each complex value may be preprocessed to give a magnitude of the complex value. Each CI may be preprocessed to give a non-negative real vector comprising the magnitude of the corresponding complex value. Each training TSCI may be weighted in the training of the projection. The projection may comprise more than one projection component. The projection may comprise at least one most important projection component. The projection may comprise at least one projection component that may be beneficial to the classifier.
[0121] Channel / channel information / location / space-time information / motion / object
[0122] Channel information (CI) may be associated with / may include signal strength, signal amplitude, signal phase, spectral power measurements, modem parameters (e.g., used in connection with modulation / demodulation in digital communication systems such as WiFi, 4G / LTE), dynamic beamforming information (including feedback or steering matrices generated by wireless communication devices in accordance with a standardized process (e.g., IEEE 802.11 or another standard)), transfer function components, radio states (e.g., used in digital communication systems to decode digital data, baseband processing states, RF processing states, etc.), measurable variables, sensed data, coarse-grained / fine-grained information of layers (e.g., physical layer, data link layer, MAC layer, etc.), digital settings, gain settings, RF filter settings, RF front-end switch settings, DC bias settings, DC correction settings, IQ compensation settings, effects of the environment (e.g., location) on wireless signals during propagation, transformation of input signals (wireless signals transmitted by type 1 devices) to output signals (wireless signals received by type 2 devices), environmental Stable behavior, state profile, wireless channel measurement, received signal strength indicator (RSSI), channel state information (CSI), channel impulse response (CIR), channel frequency response (CFR), characteristics of frequency components (e.g., subcarriers) in a bandwidth, channel characteristics, channel filter response, timestamp, auxiliary information, data, metadata, user data, account data, access data, security data, session data, status data, supervision data, home data, identity (ID), identifier, device data, network data, neighbor data, environmental data, real-time data, sensor data, stored data, encrypted data, compressed data, protected data, and / or another channel information. Each CI can be associated with a timestamp and / or arrival time. CSI can be used to equalize / cancel / minimize / reduce multipath channel effects (of a transmission channel) to demodulate signals similar to signals sent by a transmitter through a multipath channel. CI can be associated with information associated with a frequency band, frequency signature, frequency phase, frequency amplitude, frequency trend, frequency characteristics, quasi-frequency characteristics, time domain elements, frequency domain elements, time-frequency domain elements, orthogonal decomposition characteristics, and / or non-orthogonal decomposition characteristics of a signal through a channel. TSCI may be a wireless signal stream (eg, CI).
[0123] The CI may be pre-processed, processed, post-processed, stored (e.g., in local memory, portable / mobile memory, removable memory, storage network, cloud storage, in a volatile manner, in a non-volatile manner), retrieved, sent, and / or received. One or more modem parameters and / or radio state parameters may remain constant. The modem parameters may be applied to a radio subsystem. The modem parameters may represent a radio state. A motion detection signal (e.g., a baseband signal and / or a packet decoded / demodulated from a baseband signal, etc.) may be obtained by the radio subsystem processing (e.g., down-converting) a first wireless signal (e.g., an RF / WiFi / LTE / 5G signal) using the radio state represented by the stored modem parameters. The modem parameters / radio state may be updated (e.g., using previous modem parameters or previous radio states). Both previous and updated modem parameters / radio states may be applied to a radio subsystem in a digital communication system. Both previous and updated modem parameters / radio states may be compared / analyzed / processed / monitored in a task.
[0124] The channel information may also be modem parameters (e.g., stored or newly calculated) for processing wireless signals. The wireless signal may include multiple sounding signals. The same modem parameters may be used to process more than one sounding signal. The same modem parameters may also be used to process more than one wireless signal. The modem parameters may include parameters indicating settings or overall configurations for the operation of a radio subsystem or a baseband subsystem (or both) for a wireless sensor device. The modem parameters may include one or more of the following: gain settings, RF filter settings, RF front-end switch settings, DC offset settings, or IQ compensation settings for a radio subsystem, or digital DC correction settings, digital gain settings, and / or digital filtering settings (e.g., for a baseband subsystem). The CI may also be associated with information associated with a time period, a time signature, a timestamp, a time amplitude, a time phase, a time trend, and / or a time characteristic of a signal. The CI may be associated with information associated with a time-frequency partition, a signature, an amplitude, a phase, a trend, and / or a characteristic of a signal. The CI may be associated with a decomposition of a signal. The CI may be associated with information associated with a direction, an angle of arrival (AoA), an angle, and / or a phase of a directional antenna through a channel. The CI may be associated with an attenuation pattern of a signal through a channel. Each CI may be associated with a Type 1 device and a Type 2 device. Each CI may be associated with an antenna of a Type 1 device and an antenna of a Type 2 device.
[0125] The CI can be obtained from communication hardware (e.g., a type 2 device or a type 1 device) that can provide the CI. The communication hardware can be a chip / IC (integrated circuit) that supports WiFi, a chip that complies with 802.11 or 802.16 or another wireless / radio standard, a chip that supports the next generation of WiFi, a chip that supports LTE, a chip that supports 5G, a chip that supports 6G / 7G / 8G, a chip that supports Bluetooth, a chip that supports NFC (near field communication), a chip that supports BLE (low-power Bluetooth), a UWB chip, another communication chip (e.g., Zigbee, WiMax, mesh network), etc. The communication hardware calculates the CI and stores the CI in a buffer memory and makes the CI available for extraction. The CI may include data and / or at least one matrix related to channel state information (CSI). The at least one matrix can be used for channel equalization and / or beamforming, etc. A channel can be associated with a place. Attenuation may be due to signal propagation in the venue, signal propagation / reflection / refraction / diffraction through the air (e.g., the air of the venue) / in the air / around the air, refractive media / reflective surfaces (such as walls, doors, furniture, obstacles and / or barriers, etc.). Attenuation may be due to reflections at surfaces and obstacles (e.g., reflective surfaces, obstacles) such as floors, ceilings, furniture, fixtures, objects, people, pets, etc. Each CI may be associated with a timestamp. Each CI may include N1 components (e.g., N1 frequency domain components in CFR, N1 time domain components in CIR, or N1 decomposed components). Each component may be associated with a component index. Each component may be a real, imaginary or complex number, an amplitude, a phase, a sign and / or a set. Each CI may include a vector or matrix of complex numbers, a set of mixed quantities, and / or a multidimensional set of at least one complex number.
[0126] The components of the TSCI associated with a particular component index can form a corresponding component time series associated with the corresponding index. The TSCI can be divided into N1 component time series. Each corresponding component time series is associated with a corresponding component index. Features / STI of the motion of an object can be monitored based on the component time series. In one example, one or more ranges of CI components (e.g., one range is from component 11 to component 23, a second range is from component 44 to component 50, and a third range has only one component) can be selected for further processing based on some criteria / cost function / signal quality metric (e.g., based on signal-to-noise ratio and / or interference level).
[0127] The component-by-component features of the component characteristic time series of TSCI can be calculated. The component-by-component features can be scalars (e.g., energy) or functions with domain and range (e.g., autocorrelation functions, transforms, inverse transforms). Features / STI of the motion of an object can be monitored based on the component-by-component features. The overall features (e.g., aggregate features) of TSCI can be calculated based on the component-by-component features of each component time series of TSCI. The overall features can be a weighted average of the component-by-component features. Features / STI of the motion of an object can be monitored based on the overall features. The total amount can be a weighted average of the individual quantities.
[0128] Type 1 devices and Type 2 devices may support WiFi, WiMax, 3G / beyond 3G, 4G / beyond 4G, LTE, LTE-A, 5G, 6G, 7G, Bluetooth, NFC, BLE, Zigbee, UWB, UMTS, 3GPP, GSM, EDGE, TDMA, FDMA, CDMA, WCDMA, TD-SCDMA, mesh networks, proprietary wireless systems, IEEE 802.11 standards, 802.15 standards, 802.16 standards, 3GPP standards and / or another wireless system.
[0129] The public wireless system and / or public wireless channel may be shared by a type 1 transceiver and / or at least one type 2 transceiver. The at least one type 2 transceiver may use the public wireless system and / or public wireless channel to transmit corresponding signals contemporaneously (or: asynchronously, synchronously, sporadically, continuously, repeatedly, in parallel, simultaneously and / or temporarily). The type 1 transceiver may use the public wireless system and / or public wireless channel to send signals to at least one type 2 transceiver.
[0130] Each type 1 device and type 2 device may have at least one transmit / receive antenna. Each CI may be associated with one of the transmit antennas of the type 1 device and one of the receive antennas of the type 2 device. Each pair of transmit antennas and receive antennas may be associated with a link, a path, a communication path, a signal hardware path, etc. For example, if a type 1 device has M (e.g., 3) transmit antennas and a type 2 device has N (e.g., 2) receive antennas, there may be MxN (e.g., 3x2=6) links or paths. Each link or path may be associated with a TSCI.
[0131] The at least one TSCI may correspond to each antenna pair between the type 1 device and the type 2 device. The type 1 device may have at least one antenna. The type 2 device may also have at least one antenna. Each TSCI may be associated with an antenna of the type 1 device and an antenna of the type 2 device. An average or a weighted average over the antenna link may be performed. The average or weighted average may be for at least one TSCI. Optionally, an average may be performed on a subset of at least one TSCI corresponding to a subset of antenna pairs.
[0132] The timestamps of CIs of a portion of a TSCI may be irregular and may be corrected so that the corrected timestamps of the time-corrected CIs may be evenly spaced in time. In the case of multiple type 1 devices and / or multiple type 2 devices, the corrected timestamps may be relative to the same or different clocks. An original timestamp associated with each CI in the CI may be determined. The original timestamps may not be evenly spaced in time. The original timestamps of all CIs of a particular portion of a particular TSCI in the current sliding time window may be corrected so that the corrected timestamps of the time-corrected CIs may be evenly spaced in time.
[0133] Features and / or STI (e.g., motion information) may include: position, position coordinates, change in position, positioning (e.g., initial positioning, new positioning), positioning on a map, altitude, horizontal position, vertical position, distance, displacement, speed, acceleration, rotation speed, rotation acceleration, direction, movement angle, azimuth, movement direction, rotation, path, deformation, transformation, contraction, expansion, gait, gait cycle, head movement, repetitive movement, periodic movement, pseudo-periodic movement, pulse movement, sudden movement, falling movement, transient movement, behavior, transient behavior, movement cycle, movement frequency, time trend, time profile, time feature, occurrence, change, time change, CI change, frequency change, timing change, gait cycle change, timing, start time, start time, end time, duration, motion history, motion type, motion classification, frequency, spectrum, frequency characteristics, presence, absence, approach, approaching, retreating, identity / identifier of object, composition of object, head movement rate, head movement direction, mouth-related rate, eye-related rate, breathing rate, heart rate, tidal volume, breathing depth, inspiratory time, expiratory time, ratio of inspiratory time to expiratory time, airflow rate, heart beat-to-beat interval, heart rate variability, hand movement rate, hand movement direction, leg movement, body movement, walking rate, hand movement rate, positioning characteristics, characteristics associated with movement of object (e.g., change in positioning / position), tool movement, machine movement features, events, signal statistics, signal dynamics, anomalies, motion statistics, motion parameters, motion detection indication, motion amplitude, motion phase, similarity score, distance score, Euclidean distance, weighted distance, L_1 norm, L_2 norm, L_k norm for k>2, statistical distance, correlation, correlation indicator, autocorrelation, covariance, autocovariance, cross-covariance, inner product, outer product, motion signal transformation, motion features, motion presence, motion absence, motion location, motion identification, motion recognition, object presence, object absence, object entry, object exit, object change, motion cycle, motion count, gait cycle, motion rhythm, deformed motion, posture, handwriting, Head movement, mouth movement, heart movement, visceral movement, movement trend, size, length, area, volume, capacity, shape, form, label, start / starting position, end position, start / starting quantity, end quantity, event, fall event, safety event, accident event, home event, office event, factory event, warehouse event, manufacturing event, assembly line event, maintenance event, car-related event, navigation event, tracking event, door event, door opening event, door closing event, window event, window opening event, window closing event, repeatable event, one-time event, consumption, unconsumed quantity, state, physical state, health state, well-being state, emotional state, mental state, another event, analysis, output response and / or another information.Features and / or STI may be calculated / monitored based on features calculated from CI or TSCI (e.g., feature calculation / extraction). Static segments or curves (and / or dynamic segments / curves) may be identified / calculated / analyzed / monitored / extracted / obtained / labeled / represented / indicated / highlighted / stored / communicated based on analysis of the features. The analysis may include motion detection / movement assessment / presence detection. The computational workload may be shared between a Type 1 device, a Type 2 device, and another processor.
[0134] Type 1 devices and / or type 2 devices may be local devices. Local devices may be: smartphones, smart devices, televisions, sound bars, set-top boxes, access points, routers, repeaters, wireless signal repeaters / extenders, remote controls, speakers, fans, refrigerators, microwave ovens, ovens, coffee makers, water kettles, appliances, tables, chairs, lights, lamps, door locks, cameras, microphones, motion sensors, security devices, fire hydrants, garage doors, switches, power adapters, computers, dongles, computer peripherals, electronic mats, sofas, tiles, accessories, home equipment, vehicle equipment, office equipment, building equipment, manufacturing equipment, watches, glasses, clocks, televisions, ovens, air conditioners, accessories, public service equipment, appliances, smart machines, smart vehicles, Internet of Things (IoT) devices, internet-enabled devices, computers, laptop computers, tablet computers, smart houses, smart offices, smart buildings, smart parking lots, smart systems, and / or another device.
[0135] Each type 1 device may be associated with a corresponding identifier (e.g., ID). Each type 2 device may also be associated with a corresponding identity (ID). IDs may include: a number, a combination of text and numbers, a name, a password, an account, an account ID, a network link, a website, an index of certain information, and / or another ID. IDs may be assigned. IDs may be assigned by hardware (e.g., hardwired, via a dongle and / or other hardware), software, and / or firmware. IDs may be stored (e.g., in a database, in a memory, in a server (e.g., a hub device), in the cloud, locally stored, remotely stored, permanently stored, temporarily stored) and may be retrieved. IDs may be associated with at least one record, account, user, home, address, phone number, social security number, customer number, another ID, another identifier, timestamp, and / or data set. IDs and / or partial IDs of type 1 devices may be available to type 2 devices. The ID may be used for registration, initialization, communication, identification, verification, detection, recognition, authentication, access control, cloud access, networking, social networking, logging, recording, cataloging, classification, tagging, association, pairing, transactions, electronic transactions, and / or intellectual property control of Type 1 devices and / or Type 2 devices.
[0136] The object can be a person, a user, a subject, a passenger, a child, an elderly person, a baby, a sleeping baby, a baby in a car, a patient, a worker, a high-value worker, a skilled person, an expert, a waiter, a customer in a shopping mall, a traveler in an airport / train station / bus terminal / shipping terminal, a staff / worker / customer service staff in a factory / shopping mall / supermarket / office / workplace, a soldier in a sewage / ventilation system / elevator shaft, an elevator in an elevator shaft, a lift, a prisoner, a person to be tracked / surveilled, an animal, a plant, a living body, a pet, a dog, a cat, a smart phone, a mobile phone accessory, a computer, a tablet computer, a portable computer, a dongle, a computing accessory, a network device, a WiFi device, an IoT device, a smart watch, a smart glasses, a smart device, a speaker, a key, a smart key, a wallet, a purse, a handbag, a backpack, a commodity, a cargo, a luggage, equipment, an engine, a machine, an air conditioner, a fan, Air conditioning equipment, lamps, movable lamps, televisions, cameras, audio and / or video equipment, stationery, surveillance equipment, parts, signs, tools, carts, tickets, parking tickets, toll tickets, airline tickets, credit cards, plastic cards, access cards, food packaging, utensils, tables, chairs, cleaning equipment / tools, vehicles, cars, cars in parking facilities, merchandise in warehouses / stores / supermarkets / distribution centers, boats, bicycles, airplanes, drones, remote-controlled cars / planes / boats, robots, manufacturing equipment, assembly lines, materials / unfinished parts / robots / trucks / transportation on factory floors, objects to be tracked in airports / shopping centers / supermarkets, non-objects, non-existent objects, existing objects, objects with shapes, objects with changing shapes, objects without shapes, fluid masses, liquid masses, gas / smoke masses, fire, flames, electromagnetic (EM) sources, EM media, and / or another object.
[0137] The object itself may be communicatively coupled to some network, such as WiFi, MiFi, 3G / 4G / LTE / 5G / 6G / 7G, Bluetooth, NFC, BLE, WiMax, Zigbee, UMTS, 3GPP, GSM, EDGE, TDMA, FDMA, CDMA, WCDMA, TD-SCDMA, mesh networks, ad hoc networks, and / or other networks. The object itself may be bulky, powered by AC, but moved during installation, cleaning, maintenance, renovation, etc. It may also be mounted on a movable platform, such as an elevator, a pad, a movable platform, an elevator, a conveyor belt, a robot, a drone, a forklift, a car, a ship, a vehicle, etc. The object may have multiple parts, each with different movements (e.g., changes in positioning / position). For example, the object may be a person walking forward. While walking, his left and right hands may move in different directions with different instantaneous velocities, accelerations, motions, etc.
[0138] A wireless transmitter (e.g., a type 1 device), a wireless receiver (e.g., a type 2 device), another wireless transmitter, and / or another wireless receiver may move with the object and / or another object (e.g., in a previous move, a current move, and / or a future move). They may be communicatively coupled to one or more nearby devices. They may send TSCI and / or information associated with TSCI to nearby devices and / or to each other. They may be with nearby devices. The wireless transmitter and / or wireless receiver may be part of a small, lightweight portable device (e.g., the size of a coin, the size of a cigarette pack, or even smaller). The portable device may be wirelessly coupled to nearby devices.
[0139] The nearby device may be a smartphone, iPhone, Android phone, smart device, smart appliance, smart vehicle, smart gadget, smart TV, smart refrigerator, smart speaker, smart watch, smart glasses, smart tablet, iPad, computer, wearable computer, notebook computer, gateway. The nearby device may be connected to a cloud server, a local server (e.g., a hub device), and / or other servers via the Internet, a wired Internet connection, and / or a wireless Internet connection. The nearby device may be portable. Portable devices, nearby devices, local servers (e.g., hub devices), and / or cloud servers can share computation and / or storage for tasks and information (e.g., TSCI) (e.g., obtaining TSCI, determining features / STI of an object associated with movement of the object (e.g., change in positioning / location), computing time series of power (e.g., signal strength) information, determining / computing specific functions, finding local extrema, classification, identifying specific values of time offset, denoising, processing, simplifying, cleaning, wireless smart sensing tasks, extracting CI from signals, switching, segmenting, estimating trajectories / paths / tracks, processing maps, processing trajectories / paths / tracks based on environmental models / constraints / restrictions, correction, correction adjustment, adjustment, map-based (or model-based) correction, detecting errors, checking whether boundaries are hit, threshold setting). Nearby devices may / may not move with the object. Nearby devices may be portable / non-portable / movable / non-movable. Nearby devices may use battery power, solar power, AC power, and / or other power sources. Nearby devices may have replaceable / non-replaceable batteries and / or rechargeable / non-rechargeable batteries. Nearby devices may be similar to the object. Nearby devices may have the same (and / or similar) hardware and / or software as the object. Nearby devices may be smart devices, network devices, devices connected to WiFi / 3G / 4G / 5G / 6G / Zigbee / Bluetooth / NFC / UMTS / 3GPP / GSM / EDGE / TDMA / FDMA / CDMA / WCDMA / TD-SCDMA / ad hoc networks / other networks, smart speakers, smart watches, smart clocks, smart appliances, smart machines, smart devices, smart tools, smart vehicles, Internet of Things (IoT) devices, Internet-enabled devices, computers, portable computers, tablet computers, and another device. Nearby devices and / or at least one processor associated with a wireless receiver, a wireless transmitter, another wireless receiver, another wireless transmitter, and / or a cloud server (in the cloud) may determine the initial STI of the object. Two or more of them may jointly determine the initial space-time information. Two or more of them may share intermediate information for determining the initial STI (e.g., initial position).
[0140] In one example, a wireless transmitter (e.g., a type 1 device or a Tracker Bot) may move with an object. The wireless transmitter may send a signal to a wireless receiver (e.g., a type 2 device or an origin register) or determine the initial STI (e.g., initial position) of an object. The wireless transmitter may also send a signal and / or another signal to another wireless receiver (e.g., another type 2 device, or another source register) for monitoring the movement of the object (space-time information). The wireless receiver may also receive a signal and / or another signal from the wireless transmitter and / or another wireless transmitter for monitoring the movement of the object. The position of the wireless receiver and / or another wireless receiver may be known. In another example, a wireless receiver (e.g., a type 2 device or a tracking robot) may move with an object. The wireless receiver may receive a signal sent from a wireless transmitter (e.g., a type 1 device or a source register) for determining the initial space-time information (e.g., initial position) of the object. The wireless receiver may also receive a signal and / or another signal from another wireless transmitter (e.g., another type 1 device or another origin register) for monitoring the current movement (e.g., space-time information) of the object. The wireless transmitter may also send the signal and / or another signal to the wireless receiver and / or another wireless receiver (eg, another Type 2 device or another tracking robot) for monitoring the movement of the object. The location of the wireless transmitter and / or another wireless transmitter may be known.
[0141] A place can be a space such as a sensing area, a room, a house, an office, a property, a workplace, a corridor, a walkway, an elevator, an elevator shaft, an escalator, a lift, a sewage system, an air ventilation system, a staircase, a gathering area, a duct, a duct, a tube, a pipe, an enclosed space, an enclosed structure, a semi-enclosed structure, an enclosed area, an area with at least one wall, a plant, a machine, an engine, a structure with wood, a structure with glass, a structure with metal, a structure with walls, a structure with doors, a structure with gaps, a structure with reflective surfaces, a structure with fluids, a building, a roof, a shop, a factory factories, assembly lines, hotel rooms, museums, classrooms, schools, universities, government buildings, warehouses, garages, shopping malls, airports, train stations, bus terminals, hubs, transportation hubs, shipping terminals, government facilities, public facilities, schools, universities, recreational facilities, leisure facilities, hospitals, pediatric / neonatal wards, senior homes, senior care facilities, senior facilities, community centers, stadiums, playgrounds, parks, fields, sports facilities, swimming facilities, tracks and / or fields, basketball courts, tennis courts, football fields, baseball fields, gymnasiums, halls, garages, shopping centers, malls, supermarkets, manufacturing facilities, parking lots facility, construction site, mining facility, transportation facility, highway, road, valley, forest, wood, terrain, landscape, study, courtyard, land, path, amusement park, urban area, rural area, suburb, metropolitan area, garden, square, open air plaza, concert hall, downtown facility, aerial facility, semi-open facility, enclosed area, train platform, train station, distribution center, warehouse, store, distribution center, storage facility, underground facility, space (e.g. above ground, outer space) facility, floating facility, cave, tunnel facility, indoor facility, open air facility, outdoor facility with some walls / doors / reflective barriers, open Facilities, semi-open facilities, cars, trucks, buses, vans, containers, ships / boats, submersibles, trains, trams, airplanes, vehicles, mobile homes, caves, tunnels, pipelines, passages, metropolitan areas, downtown areas with relatively high buildings, valleys, wells, pipelines, paths, gas pipelines, oil pipelines, water pipes, interconnected path networks / alleys / roads / pipelines / cavities / caves / tubular structures / air spaces / fluid spaces, human bodies, animal bodies, body cavities, organs, bones, teeth, soft tissues, hard tissues, rigid tissues, non-rigid tissues, blood / body fluid vessels, trachea, air ducts, study rooms, etc. Places can be indoor spaces, outdoor spaces. Places can include the inside and outside of a space. For example, a place can include the inside of a building and the outside of a building. For example, a place can be a building of one or more floors, and a portion of the building can be underground. The shape of the building can be, for example, circular, square, rectangular, triangular or irregular. These are just examples. The present disclosure can be used to detect events in other types of places or spaces.
[0142] A wireless transmitter (e.g., a type 1 device) and / or a wireless receiver (e.g., a type 2 device) can be embedded in a portable device (e.g., a module or a device having a module) that can move with the object (e.g., in a previous movement and / or a current movement). The portable device can be communicatively coupled to the object using a wired connection (e.g., via USB, microUSB, FireWire, HDMI, serial port, parallel port, and other connectors) and / or a connection (e.g., Bluetooth, Bluetooth Low Energy (BLE), WiFi, LTE, NFC, ZigBee). The portable device can be a lightweight device. The portable device can be powered by a battery, a rechargeable battery, and / or an AC power source. The portable device can be very small (e.g., sub-millimeter and / or sub-centimeter) and / or small (e.g., coin-sized, card-sized, pocket-sized, or larger). The portable device may be large, large in size, and / or bulky (e.g., heavy machinery to be installed).The portable device can be a WiFi hotspot, an access point, a mobile WiFi (MiFi), a dongle with a USB / micro USB / Firewire / other connector, a smartphone, a laptop, a computer, a tablet, a smart device, an Internet of Things (IoT) device, a WiFi-enabled device, an LTE-enabled device, a smart watch, a smart glass, a smart mirror, a smart antenna, a smart battery, a smart light, a smart pen, a smart ring, a smart door, a smart window, a smart clock, a small battery, a smart wallet, a smart belt, a smart handbag, smart clothing / apparel, smart decorations, smart packaging, a system of smart paper / books / magazines / posters / prints / signage / displays / lighting / Lighting system, smart key / tool, smart bracelet / chain / necklace / wearable / accessory, smart mat / cushion, smart tile / block / brick / building material / other material, smart trash can / trash bin, smart dining car / locker, smart ball / racket, smart chair / sofa / bed, smart shoes / shoes / carpet / mat / shoe rack, smart gloves / hand ornaments / rings / hand tools, smart hat / headwear / cosmetics / sticker / tattoo, smart mirror, smart toys, smart pills, smart utensils, smart milk bottles / food containers, smart tools, smart devices, IoT devices, WiFi-enabled devices, network-enabled devices, 3G / 4G / 5G / 6G-enabled devices, UMTS devices, 3GPP devices, GSM devices, EDGE devices, TDMA devices, FDMA devices, CDMA devices, WCDMA devices, TD-SCDMA devices, embedded devices, implanted devices, air conditioners, refrigerators, heaters, stoves, furniture, ovens, cooking equipment, TV / set-top box (STB) / DVD player / audio player / video player / remote control, hi-fi, audio equipment, speakers, lamps / lights, walls, doors, windows, roofs, roof tiles / shingles / structures / attic structures Structure / equipment / feature / installation / fixture, lawn mower / garden tool / yard tool / machine tool / garage tool / , trash can / container, 20-foot / 40-foot container, storage container, factory / manufacturing / production equipment, repair tool, fluid container, machine, machinery to be installed, vehicle, cart, carriage, storage vehicle, car, bicycle, motorcycle, boat, ship, airplane, basket / box / bag / barrel / container, smart plate / cup / bowl / pot / mat / utensil / kitchen tool / kitchen equipment / kitchen accessories / cabinet / table / chair / tile / light / water pipe / faucet / gas range / oven / dishwasher / etc. The portable device may have replaceable, non-replaceable, rechargeable and / or non-rechargeable batteries. The portable device may be wirelessly charged. The portable device may be a smart payment card. The portable device may be a payment card used in a parking lot, highway, amusement park or other place / facility where payment is required. The portable device may have an identity (ID) / identifier as described above.
[0143] Events can be monitored based on TSCI. The event can be an event related to an object, such as a fall, rotation, hesitation, pause, collision (e.g., a person hitting a sandbag, a door, a window, a bed, a chair, a table, a writing desk, a cabinet, a box, another person, an animal, a bird, a fly, a table, a chair, a ball, a bowling ball, a tennis ball, a football, a soccer ball, a baseball, a basketball, a volleyball), a two-body action (e.g., a person releasing a balloon, catching a fish, shaping clay, writing a paper, a person typing on a computer), a car driving in a garage, a person carrying a smart phone walking in an airport / shopping center / government building / office / around, etc., an autonomously moving object / machine (e.g., a vacuum cleaner, a multi-purpose vehicle, a car, a drone, a self-driving car).
[0144] Tasks or wireless smart sensing tasks may include: object detection, presence detection, proximity detection, object recognition, activity recognition, object verification, object counting, daily activity monitoring, health monitoring, wellness monitoring, health status monitoring, infant monitoring, elderly monitoring, sleep monitoring, sleep stage monitoring, walking monitoring, motion monitoring, tool detection, tool recognition, tool verification, patient detection, patient monitoring, patient verification, machine detection, machine recognition, machine verification, human detection, human recognition, human verification, infant detection, infant recognition, infant verification, human breathing detection, human breathing recognition, human breathing estimation, human breathing verification, human heartbeat detection, human heartbeat recognition, human heartbeat estimation, human heartbeat verification, fall detection, fall recognition ,Fall Estimation,Fall Verification,Emotion Detection,Emotion Recognition,Emotion Estimation,Emotion Verification,Motion Detection,Motion Degree Estimation,Motion Recognition,Motion Estimation,Motion Verification,Periodic Motion Detection,Periodic Motion Recognition,Periodic Motion Estimation,Periodic Motion Verification,Repetitive Motion Detection,Repetitive Motion Recognition,Repetitive Motion Estimation,Repetitive Motion Verification,Stationary Motion Detection,Stationary Motion Recognition,Stationary Motion Estimation,Stationary Motion Verification,Cyclostationary Motion Detection,Cyclostationary Motion Recognition,Cyclostationary Motion Estimation,Cyclostationary Motion Verification,Transient Motion Detection,Transient Motion Recognition,Transient Motion Estimation,Transient Motion Verification,Trend Detection,Trend Recognition,Trend Estimation,Trend Verification,Respiration Detection,Respiration Recognition,Respiration Estimation,Respiration Estimation, Human biometric detection, human biometric recognition, human biometric estimation, human biometric verification, environmental informatics detection, environmental informatics recognition, environmental informatics estimation, environmental informatics verification, gait detection, gait recognition, gait estimation, gait verification, posture detection, posture recognition, posture estimation, posture verification, machine learning, supervised learning, unsupervised learning, semi-supervised learning, clustering, feature extraction, feature training, principal component analysis, feature decomposition, frequency decomposition, time decomposition, time-frequency decomposition, function decomposition, other decomposition, training, discriminant training, supervised training, unsupervised training, semi-supervised training, neural network, sudden motion detection, fall detection, danger detection, life threat detection, regular motion detection, steady motion detection, cyclic balancing Steady Motion Detection, Intrusion Detection, Suspicious Motion Detection, Security, Security Surveillance, Navigation, Guidance, Map-Based Processing, Map-Based Correction, Model-Based Processing / Correction, Irregularity Detection, Localization, Room Sensing, Tracking, Multi-Target Tracking, Indoor Tracking, Indoor Localization, Indoor Navigation, Energy Management, Power Transfer, Wireless Power Transfer, Object Counting, Car Tracking in Parking Lots, Activation of Devices / Systems (e.g., Security Systems, Access Control Systems, Sirens, Alarms, Speakers, Televisions, Entertainment Systems, Cameras, Heater / Air Conditioning (HVAC) Systems, Ventilation Systems, Lighting Systems, Gaming Systems, Coffee Machines, Cooking Equipment, Cleaning Equipment, Housekeeping Equipment), Geometry Estimation, Augmented Reality, Wireless Communications, Data Communications, Signal Broadcasting, Networking,Coordination, management, encryption, protection, cloud computing, other processing, and / or other tasks. The task may be performed by a Type 1 device, a Type 2 device, another Type 1 device, another Type 2 device, a nearby device, a local server (e.g., a hub device), an edge server, a cloud server, and / or another device. The task may be based on the TSCI between any pair of Type 1 and Type 2 devices. A Type 2 device may be a Type 1 device and vice versa. A Type 2 device may temporarily, continuously, sporadically, simultaneously, and / or contemporaneously play / perform the role (e.g., function) of a Type 1 device and vice versa. The first part of the task may include at least one of the following: pre-processing, processing, signal conditioning, signal processing, post-processing, occasional / continuous / simultaneous / concurrent / dynamic / adaptive / on-demand / on-demand processing, calibration, denoising, feature extraction, encoding, encryption, transformation, mapping, motion detection, motion estimation, motion change detection, motion pattern detection, motion pattern estimation, motion pattern recognition, vital sign detection, vital sign estimation, vital sign recognition, periodic motion detection, periodic motion estimation, repetitive motion detection / estimation, breathing rate detection, breathing rate estimation, breathing pattern detection, breathing pattern estimation, breathing pattern recognition, heartbeat detection, heartbeat estimation, heartbeat pattern detection, heartbeat pattern estimation, heartbeat pattern recognition, posture detection, posture estimation, posture recognition, speed detection, speed estimation, object positioning, object tracking, navigation, acceleration estimation, acceleration detection, fall detection, change detection, intruder (and / or illegal behavior) detection, infant detection, infant monitoring, patient monitoring, object recognition, wireless power transmission and / or wireless charging.
[0145] The second part of the task may include at least one of the following: smart home tasks, smart office tasks, smart building tasks, smart factory tasks (e.g., manufacturing using machines or assembly lines), smart Internet of Things (IoT) tasks, smart system tasks, smart home operations, smart office operations, smart building operations, smart manufacturing operations (e.g., moving supplies / parts / raw materials to machines / assembly lines), IoT operations, smart system operations, turning lights on, turning lights off, controlling lights in at least one of the following: rooms, areas and / or places, playing a sound clip, playing a sound clip in at least one of the following: rooms, areas, and / or places, playing a sound clip of at least one of the following: welcome, greeting, farewell, a first message and / or a second message associated with the first part of the task, turning appliances on, turning appliances off, controlling at least one of the following appliances in: rooms, areas and / or places, turn on the electrical system, turn off the electrical system, control the electrical system in at least one of the following: rooms, areas, and / or places, turn on the security system, turn off the security system, control the security system in at least one of the following: rooms, areas and / or places, turn on the mechanical system, turn off the mechanical system, control the mechanical system in at least one of the following: rooms, areas and / or places, and / or control at least one of the following: air conditioning systems, heating systems, ventilation systems, lighting systems, heating equipment, furnaces, entertainment systems, doors, fences, windows, garages, computer systems, network equipment, network systems, home appliances, office equipment, lighting equipment, robots (such as robotic arms), smart cars, smart machines, assembly lines, smart devices, Internet of Things (IoT) devices, smart home devices and / or smart office equipment.
[0146] The tasks may include: detecting user coming home, detecting user leaving home, detecting user moving from one room to another, detecting / controlling / locking / unlocking / opening / closing / partially opening windows / doors / garage doors / blinds / curtains / panels / solar panels / sunshades, detecting pets, detecting / monitoring user doing something (e.g. sleeping on the couch, sleeping in the bedroom, running on a treadmill, cooking, sitting on the couch, watching TV, eating in the kitchen, eating in the dining room, going up / down stairs, going out / coming back, in the lounge), monitoring / detecting the location of the user / pet, automatically doing something after detection (e.g. sending a message, notifying / reporting someone), automatically doing something for the user after detecting the user, turning on / off / dim the lights, turning on / off the music / radio / home entertainment system, turn on / off / adjust / control TV / HiFi / set-top box (STB) / home entertainment system / smart speaker / smart device, turn on / off / adjust air conditioning system, turn on / off / adjust ventilation system, turn on / off / adjust heating system, adjust / control curtains / lamp shades, turn on / off / wake up computer, turn on / off / preheat / control coffee maker / water boiler, turn on / off / control / preheat cooker / oven / microwave oven / another cooking device, check / adjust temperature, check weather forecast, check phone answering box, check mail, perform system check, control / adjust system, check / control / arm / disarm security system / baby monitor, check / control refrigerator, give report (for example through speaker, such as Google home, Amazon Echo, on display / screen, via web page / email / message system / notification system).
[0147] For example, when the user drives his car to the house, the task may be to automatically detect the user or his car approaching, open the garage door when detected, turn on the driveway / garage lights when the user approaches the garage, turn on the air conditioner / heater / fan, etc. When the user enters the house, the task may be to automatically turn on the entrance lights, turn off the driveway / garage lights, play a greeting to welcome the user, turn on music, turn on the radio and tune to the user's favorite broadcast news channel, open the curtains / blinds, monitor the user's mood, adjust the light and sound environment according to the user's mood or current / upcoming events on the user's daily calendar (e.g., make romantic lights and music because the user has a dinner planned with his girlfriend in 1 hour), heat up the food that the user prepared in the morning in the microwave, perform diagnostic checks on all systems in the house, check the weather forecast for tomorrow's work, check the news that the user is interested in, check the user's calendar and to-do list and play reminders, check the phone answering system / messaging system / email and make verbal reports using the dialogue system / speech synthesis, remind (e.g., using a system such as a speaker / HiFi / speech synthesis / sound / speech / music / song / sound field / background sound field / dialogue system, using auditory tools such as TV / entertainment system / computer / notebook / smart tablet / display / light / color / brightness / pattern / symbol, using tactile tools / virtual reality tools / gestures / tools, using smart devices / appliances / materials / furniture / fixtures, using network tools / servers / hub devices / cloud servers / fog servers / edge servers / home networks / mesh networks, using messaging tools / notification tools / communication tools / scheduling tools / email, using user interfaces / GUIs, using fragrance / smell / aroma / taste, using neural tools / neural system tools, using a combination of) the user's mother's birthday, and calling her, preparing a report, and giving the report (e.g., using reminder tools as described above). The task may be to turn on the air conditioning / heating / ventilation system in advance, or adjust the temperature setting of a smart thermostat in advance, etc. As the user moves from the entryway to the living room, the tasks may be to turn on the living room lights, open the living room curtains, open the windows, turn off the entryway lights behind the user, turn on the TV and set-top box, set the TV to the user's favorite channels, adjust appliances based on the user's preferences and conditions / states (e.g. adjust the lights and select / play music to create a romantic atmosphere), etc.
[0148] Another example could be: when the user wakes up in the morning, the tasks could be to detect the user walking in the bedroom, open the blinds / curtains, open the windows, turn off the alarm, adjust the room temperature from night temperature mode to day temperature mode, turn on the bedroom light, turn on the bathroom light when the user approaches the bathroom, check the radio or streaming channel and play the morning news, turn on the coffee maker and preheat the water, turn off the security system, etc. When the user walks from the bedroom to the kitchen, the tasks could be to turn on the kitchen and hallway lights, turn off the bedroom and bathroom lights, move the music / messages / reminders from the bedroom to the kitchen, turn on the kitchen TV, switch the TV to the morning news channel, lower the kitchen blinds and open the kitchen windows to bring in fresh air, open the back door so the user can check the backyard, adjust the kitchen temperature settings, etc. Another example could be: when the user leaves home for work, the tasks could be detecting the user's departure, playing a farewell and / or wishing you a nice day message, opening / closing the garage door, turning on / off the garage lights as well as the driveway lights, turning off / dimming the lights to save energy (in case the user forgets), closing / locking all doors / windows (in case the user forgets), turning off appliances (especially stoves, ovens, microwaves), turning on / arming the home security system to protect the home from any intruders, adjusting the air conditioning / heating / ventilation system to "away" mode to save energy, sending alerts / reports / updates to the user's smartphone, etc.
[0149] The motion may include at least one of: no motion, resting motion, motion without motion, movement, change of position / location, deterministic motion, transient motion, falling motion, repetitive motion, periodic motion, pseudo-periodic motion, periodic / repetitive motion associated with breathing, periodic / repetitive motion associated with heartbeat, periodic / repetitive motion associated with living things, periodic / repetitive motion associated with machines, periodic / repetitive motion associated with man-made objects, periodic / repetitive motion associated with nature, complex motion with transient elements and periodic elements, repetitive motion, non-deterministic motion, probabilistic motion, chaotic motion, random motion, complex motion with non-deterministic and deterministic elements, stationary random motion, pseudo-stationary random motion, cyclostationary random motion, non-stationary random motion, stationary random motion with a periodic autocorrelation function (ACF), random motion with a periodic ACF over a period of time, pseudo-stationary random motion over a period of time, random motion in which the instantaneous ACF has a pseudo-periodic / repetitive element over a period of time, machine motion, mechanical motion, vehicle motion, drone motion, air related motion, wind related motion, weather related motion, water related motion, fluid related motion, ground related motion, changes in electromagnetic signatures, sub-surface motion, earthquake motion, plant motion, animal motion, human motion, normal motion, abnormal motion, dangerous motion, warning motion, suspicious motion, rain, fire, flood, tsunami, explosion, collision, impending collision, human motion, head motion, face motion, eye motion, mouth motion, tongue motion, neck motion, finger motion, hand motion, arm motion, shoulder motion, body motion, chest motion, abdominal motion movement, hip movement, leg movement, foot movement, body joint movement, knee movement, elbow movement, upper body movement, lower body movement, skin movement, subcutaneous movement, subcutaneous tissue movement, blood vessel movement, vein movement, organ movement, heart movement, lung movement, stomach movement, intestinal movement, defecation movement, eating movement, breathing movement, facial expression, eye expression, mouth expression, speaking movement, singing movement, eating movement, posture, gesture, arm posture, keystroke, typing, user interface posture, human-computer interaction, gait, dance movement, coordinated movement and / or coordinated body movement.
[0150] The heterogeneous ICs of the type 1 device and / or any type 2 receiver may include a low noise amplifier (LNA), a power amplifier, a transmit-receive switch, a media access controller, a baseband radio, a 2.4 GHz radio, a 3.65 GHz radio, a 4.9 GHz radio, a 5 GHz radio, a 5.9 GHz radio, a sub-6 GHz radio, a sub-60 GHz radio, and / or another radio. The heterogeneous ICs may include a processor, a memory communicatively coupled to the processor, and an instruction set stored in the memory for execution by the processor. The IC and / or any processor may include at least one of a general purpose processor, a special purpose processor, a microprocessor, a multiprocessor, a multi-core processor, a parallel processor, a CISC processor, a RISC processor, a microcontroller, a central processing unit (CPU), a graphics processor unit (GPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), an embedded processor (e.g., an ARM), a logic circuit, other programmable logic devices, discrete logic, and / or a combination. Heterogeneous ICs can support broadband networks, wireless networks, mobile networks, mesh networks, cellular networks, wireless local area networks (WLAN), wide area networks (WAN) and metropolitan area networks (MAN), WLAN standards, WiFi, LTE, LTE-A, LTE-U, 802.11 standards, 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.11ad, 802.11af, 80211ah, 802.1 1ax, 802.11ay, mesh network standard, 802.15 standard, 802.16 standard, cellular network standard, 3G, 3.5G, 4G, beyond 4G, 4.5G, 5G, 6G, 7G, 8G, 9G, UMTS, 3GPP, GSM, EDGE, TDMA, FDMA, CDMA, WCDMA, TD-SCDMA, Bluetooth, Bluetooth Low Energy (BLE), NFC, Zigbee, WiMax and / or another wireless network protocol.
[0151] The processor may include a general-purpose processor, a special-purpose processor, a microprocessor, a microcontroller, an embedded processor, a digital signal processor, a central processing unit (CPU), a graphics processing unit (GPU), a multiprocessor, a multi-core processor, and / or a processor with graphics capabilities, and / or a combination. The memory may be volatile, non-volatile, a random access memory (RAM), a read-only memory (ROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a hard disk, a flash memory, a CD-ROM, a DVD-ROM, a magnetic storage, an optical storage, an organic storage, a storage system, a storage network, a network storage, a cloud storage, an edge storage, a local storage, an external storage, an internal storage, or other forms of non-transient storage media known in the art. The instruction set (machine executable code) corresponding to the method steps may be directly embodied in hardware, software, firmware, or a combination thereof. The instruction set may be embedded, preloaded, loaded at startup, dynamically loaded, loaded on demand, preinstalled, installed, and / or downloaded.
[0152] The representation can be in an audiovisual manner (e.g., using a combination of visuals, graphics, text, symbols, colors, shading, video, animation, sound, voice, audio, etc.), graphical manner (e.g., using GUI, animation, video), textual manner (e.g., web page with text, messages, animated text), symbolic manner (e.g., emoticons, signs, gestures), or mechanical manner (e.g., vibration, actuator movement, tactile, etc.).
[0153] Basic calculations
[0154] The computational workload associated with the method is shared between a processor, a type 1 heterogeneous wireless device, a type 2 heterogeneous wireless device, a local server (eg, a hub device), a cloud server, and another processor.
[0155] Operations, pre-processing, processing and / or post-processing may be applied to the data (e.g., TSCI, autocorrelation, characteristics of TSCI). Operations may be pre-processing, processing and / or post-processing. Pre-processing, processing and / or post-processing may be operations. Operations may include pre-processing, processing, post-processing, scaling, calculating confidence factors, calculating line-of-sight (LOS) quantities, calculating non-LOS (NLOS) quantities, quantities including LOS and NLOS, calculating quantities for a single link (e.g., a path, a communication path, a link between a transmitting antenna and a receiving antenna), calculating quantities including multiple links, calculating functions of operands, filtering, linear filtering, non-linear filtering, folding, grouping, energy calculation, low pass filtering, band pass filtering, high pass filtering, median filtering, rank filtering, quartile filtering, percentile filtering, modal filtering, finite impulse response (FIR) filtering, infinite impulse response (HR) filtering, moving average (MA) filtering, autoregressive ( AR) filtering, autoregressive moving average (ARMA) filtering, selective filtering, adaptive filtering, interpolation, decimation, subsampling, upsampling, resampling, time correction, time base correction, phase correction, amplitude correction, phase cleaning, amplitude cleaning, matched filtering, enhancement, restoration, denoising, smoothing, signal conditioning, enhancement, restoration, spectrum analysis, linear transformation, nonlinear transformation, inverse transformation, frequency transformation, inverse frequency transformation, Fourier transform (FT), discrete time FT (DTFT), discrete FT (DFT), fast FT (FFT), wavelet transform, Laplace transform, Hilbert transform, Hadamard transform, trigonometric transform, sine transform, cosine transform, DCT, 2 times square transform, sparse transform, graph-based transform, graph signal processing, fast transform, zero-padding combination transform, cyclic padding, padding, zero padding, feature extraction, decomposition, projection, orthogonal projection, non-orthogonal projection, overcomplete projection, eigendecomposition, singular value decomposition (SVD), principle component analysis (PCA), independent component analysis (ICA), grouping, sorting, threshold, soft thresholding, hard thresholding, clipping, soft clipping, first derivative, second derivative, higher-order derivatives, convolution, multiplication, division, addition, subtraction, integration, maximization, minimization, least mean square error, recursive least squares, constrained least squares, batch least squares, least absolute error, least mean square deviation, least absolute deviation , local maximization, local minimization, cost function optimization, neural networks, recognition, labeling, training, clustering, machine learning, supervised learning, unsupervised learning, semi-supervised learning, comparison with another TSCI, similarity calculation, quantization, vector quantization, matching pursuit, compression, encryption, encoding, storage, sending, normalization, time normalization, frequency normalization, classification, clustering, labeling, tags, learning, detection, estimation, learning network, mapping, remapping, expansion, storage, retrieval, sending, receiving, representation, merging, combining, segmentation, tracking, monitoring, matched filter, Kalman filter, particle filter, interpolation, extrapolation, histogram estimation, importance sampling, Monte Carlo sampling,Compressed sensing, representation, merging, combining, partitioning, scrambling, error protection, forward error correction, do nothing, time varying processing, conditional average, weighted average, arithmetic mean, geometric mean, harmonic mean, selected frequency average, antenna link average, logical operation, permutation, combination, sorting, AND, OR, XOR, union, intersection, vector addition, vector subtraction, vector multiplication, vector division, inverse operation, norm, distance, and / or another operation. The operation can be pre-processing, processing, and / or post-processing. The operation can be applied jointly to multiple time series or functions.
[0156] Functions (e.g., functions of operands) may include: scalar functions, vector functions, discrete functions, continuous functions, polynomial functions, characteristics, properties, amplitude, phase, exponential functions, logarithmic functions, trigonometric functions, transcendental functions, logical functions, linear functions, algebraic functions, nonlinear functions, piecewise linear functions, real functions, complex functions, vector-valued functions, inverse functions, derivatives of functions, integrals of functions, circular functions, functions of another function, one-to-one functions, one-to-many functions, many-to-one functions, many-to-many functions, zero crossings, absolute functions, indicator functions, mean, mode, median, range, statistics, histograms, variance, standard deviation, measures of variation, distribution, dispersion, deviation, scatter, range, interquartile range, total variation, absolute deviation, total deviation, arithmetic mean mean, geometric mean, harmonic mean, trimmed mean, percentile, square, cube, root, power, sine, cosine, tangent, cotangent, secant, cosecant, elliptic function, parabolic function, hyperbolic function, game function, zeta function, absolute value, thresholding, limit function, floor function, rounding function, sign function, quantization, piecewise constant function, composite function, function of function, time function processed by operations such as filtering, probability function, random function, random function, ergodic function, stationary function, deterministic function, periodic function, repeating function, transform, frequency transform, inverse frequency transform, discrete time transform, Laplace transform, Hilbert transform, sine transform, cosine transform, trigonometric transform, wavelet transform, integer transform, 2 power transform, sparse transform, projection, decomposition, principal component analysis (PCA), independent component analysis (ICA), neural network, feature extraction, moving function, moving window function of neighboring terms of time series, filter function, convolution, mean function, histogram, variance / standard deviation function, statistical function, short time transform, discrete transform, discrete Fourier transform, discrete cosine transform, discrete sine transform, Hadamard transform, eigendecomposition, eigenvalue, singular value decomposition (SVD), singular value, orthogonal decomposition, matching pursuit, sparse transform, sparse approximation, arbitrary decomposition, graph-based processing, graph-based transform, graph signal processing, classification, identification of classes / groups / categories, labeling, learning, machine learning, detection, estimation, feature extraction, learning network, special Characteristic extraction, denoising, signal enhancement, encoding, encryption, mapping, remapping, vector quantization, low pass filter, high pass filter, band pass filter, matched filter, Kalman filter, preprocessing, postprocessing, particle filter, FIR filter, IIR filter, autoregressive (AR) filter, adaptive filter, first order derivative, higher order derivative, integral, zero crossing, smoothing, median filter, pattern filter, sampling, random sampling, resampling function, down sampling, down conversion, up sampling, up conversion, interpolation, extrapolation, importance sampling, Monte Carlo sampling, compressed sensing, statistics, short term statistics, long term statistics, autocorrelation function, cross correlation, moment generating function, time average, weighted average, special function, Bessel function, error function, complementary error function, Beta function,Gamma function, integral function, Gaussian function, Poisson function, etc.
[0157] Machine learning, training, discriminative training, deep learning, neural networks, continuous time processing, distributed computing, distributed storage, acceleration using GPU / DSP / coprocessor / multi-core / multi-processing can be applied to the steps (or each step) of the disclosure.
[0158] The frequency transform may include a Fourier transform, a Laplace transform, a Hadamard transform, a Hilbert transform, a sine transform, a cosine transform, a trigonometric transform, a wavelet transform, an integer transform, a power of 2 transform, a combined zero padding and transform, a Fourier transform with zero padding, and / or another transform. A fast version and / or an approximate version of the transform may be performed. The transform may be performed using floating point and / or fixed point arithmetic.
[0159] The inverse frequency transform may include an inverse Fourier transform, an inverse Laplace transform, an inverse Hadamard transform, an inverse Hilbert transform, an inverse sine transform, an inverse cosine transform, an inverse trigonometric transform, an inverse wavelet transform, an inverse integer transform, an inverse 2nd power transform, a combined zero padding and transform, an inverse Fourier transform with zero padding, and / or another transform. A fast version and / or an approximate version of the transform may be performed. The transform may be performed using floating point and / or fixed point arithmetic.
[0160] Quantities / features from TSCI may be calculated. The quantity may include statistics of at least one of: motion, position, map coordinates, altitude, speed, acceleration, angle of movement, rotation, size, volume, time trend, pattern, one-time pattern, repetitive pattern, evolving pattern, time pattern, mutually exclusive pattern, related / correlated pattern, cause and effect, correlation, short-term / long-term correlation, trend, tendency, statistics, typical behavior, atypical behavior, time trend, time profile, periodic motion, repetitive motion, repetition, trend, change, mutation, gradual change, frequency, transient, breathing, gait, action, event, suspicious event, dangerous event, alarm event, warning, belief, approach, collision, power, signal, signal power, signal strength, signal strength, received signal strength indicator (RSSI), signal amplitude, signal phase, signal frequency component, signal frequency band component, channel state information (CSI), mapping radiation, time, frequency, time-frequency, decomposition, orthogonal decomposition, non-orthogonal decomposition, tracking, breathing, heartbeat, statistical parameter, cardiopulmonary statistics / analysis (e.g., output response), daily activity statistics / analysis, chronic disease statistics / analysis, medical statistics / analysis, early (or instantaneous or simultaneous or delayed) indication / suggestion / sign / indicator / verifier / detection / symptom of disease / condition / situation, biometric, infant, patient, machine, equipment, temperature, vehicle, parking lot, place, elevator, lift, space, road, fluid flow, home, room, office, house, building, warehouse, storage, system, ventilation, fan, pipe, duct, person, human, car, ship, truck, airplane, drone, city center, crowd, pulse event, cyclostationary, environment, vibration, material, surface, 3D, 2D, local, global, presence and / or another measurable quantity / variable.
[0161] Sliding Window / Algorithm
[0162] The sliding time window may have a window width that varies over time. It may be small at the beginning to enable fast acquisition and may increase to a steady-state size over time. The steady-state size may be related to the frequency, repetitive motion, transient motion, and / or STI to be monitored. Even in the steady state, the window size may be adaptively (and / or dynamically) changed (e.g., adjusted, changed, modified) based on battery life, power consumption, available computing power, changes in the number of targets, the nature of the motion to be monitored, etc.
[0163] The time offset between two sliding time windows at adjacent time instances can be constant / variable / locally adaptive / dynamically adjusted over time. When a shorter time offset is used, any monitored updates can be more frequent, which can be used for fast-changing situations, object motions, and / or objects. Longer time offsets can be used for slower situations, object motions, and / or objects.
[0164] The window width / size and / or time offset may be changed (e.g., adjusted, varied, modified) based on a user request / selection. The time offset may be changed automatically (e.g., as controlled by a processor / computer / server / hub device / cloud server) and / or adaptively (and / or dynamically).
[0165] At least one feature (e.g., a feature value or feature point) of a function (e.g., an autocorrelation function, an autocovariance function, a cross-correlation function, a cross-covariance function, a power spectral density, a time function, a frequency domain function, a frequency transform) can be determined (e.g., by an object tracking server, a processor, a type 1 heterogeneous device, a type 2 heterogeneous device, and / or another device). At least one feature of a function may include: maximum, minimum, extremum, local maximum, local minimum, local extremum, local extremum with positive time offset, first local extremum with positive time offset, nth local extremum with positive time offset, local extremum with negative time offset, first local extremum with negative time offset, nth local extremum with negative time offset, constrained maximum, constrained minimum, constrained extremum, significant maximum, significant minimum, significant extremum, slope, derivative, higher-order derivatives, maximum slope, minimum slope, local maximum slope, local maximum slope with positive time offset, local minimum slope, constrained maximum slope, constrained minimum slope, maximum higher-order derivative, minimum higher-order derivative, constrained higher-order derivative, zero crossing, zero crossing with positive time offset, nth zero crossing with positive time offset, zero crossing with negative time offset, nth zero crossing with negative time offset, constrained zero crossing, slope zero crossing, higher-order derivative zero crossing, and / or another feature. At least one independent variable of the function associated with at least one feature of the function may be identified. Certain quantities (eg, spatio-temporal information of the object) may be determined based on the at least one independent variable of the function.
[0166] Features (e.g., motion features of objects in a venue) may include at least one of: instantaneous features, short-term features, repetitive features, cyclic features, history, incremental features, change features, deviation features, phase, amplitude, degree, time features, frequency features, time-frequency features, decomposition features, orthogonal decomposition features, non-orthogonal decomposition features, deterministic features, probabilistic features, random features, autocorrelation function (ACF), mean, variance, standard deviation, measure of variation, spread, dispersion, bias, divergence, range, interquartile range, total variation, absolute deviation, total deviation, statistics, duration, time, trend, periodic features, repetitive features, long-term features, historical features, average features, current features, past features, future features, predicted features, position, distance, height, rate, direction, speed, acceleration, change in acceleration, angle, angular rate, angular velocity, object angular acceleration, change in angular acceleration, object orientation, rotation angle, object deformation, object shape, change in object shape, change in object size, change in object structure and / or change in object features.
[0167] At least one local maximum and at least one local minimum of the function can be identified. At least one local signal-to-noise ratio (SNR-like) parameter can be calculated for each pair of adjacent local maximums and local minimums. The SNR-like parameter can be a function (e.g., linear, logarithmic, exponential, monotonic) of the fraction of the amount (e.g., power, amplitude) of the local maximum relative to the same amount of the local minimum. It can also be a function of the difference between the amount of the local maximum and the same amount of the local minimum. Significant local peaks can be identified or selected. Each significant local peak can be a local maximum with a SNR-like parameter greater than a threshold value T1 and / or a local maximum with an amplitude greater than a threshold value T2. A persistence-based method can be used to identify / calculate at least one local minimum and at least one local minimum in the frequency domain.
[0168] The selected set of significant local peaks can be selected from the set of identified significant local peaks based on a selection criterion (e.g., a quality criterion, a signal quality condition). Features / STI of the object can be calculated based on the selected set of significant local peaks and the frequency values associated with the selected set of significant local peaks. In one example, the selection criterion can always correspond to the strongest peak within the selection range. Although the strongest peak can be selected, the peaks that are not selected may still be significant (quite strong).
[0169] Unselected significant peaks can be stored and / or monitored as "reserved" peaks for use in future selections in future sliding time windows. As an example, over time, there may be a particular peak that continues to appear (with a particular frequency). Initially, it may be significant, but not selected (because other peaks may be stronger). But at a later time, the peak may become stronger and more dominant, and may be selected. When it is "selected", it can be traced back in time and "selected" at an earlier time when it was significant but not selected. In such cases, the traced back peak can replace the previously selected peak at an early stage. The replaced peak may be the relatively weakest, or a peak that appears isolated in time (i.e., appears only briefly in time).
[0170] In another example, the selection criteria may not correspond to the strongest peak in the selection range. Instead, it may consider not only the "strength" of the peak, but also the "traces" of the peak - peaks that may have occurred in the past, especially those that have been identified for a long time.
[0171] For example, if a finite state machine (FSM) is used, it may select the peak value based on the state of the FSM.The decision threshold may be adaptively (and / or dynamically) calculated based on the state of the FSM.
[0172] A similarity score and / or component similarity score may be calculated based on a pair of temporally adjacent CIs of a TSCI (e.g., by a server (e.g., a hub device), a processor, a type 1 device, a type 2 device, a local server, a cloud server, and / or another device). The pair may be from the same sliding window or two different sliding windows. A similarity score may also be based on a pair of temporally adjacent or not so adjacent CIs from two different TSCIs. A similarity score and / or component similarity score may be / include: time reversal resonance strength (TRRS), correlation, cross-correlation, autocorrelation, correlation indicator, covariance, cross-covariance, autocovariance, inner product of two vectors, distance score, norm, metric, quality metric, signal quality condition, statistical feature, discriminant score, neural network, deep learning network, machine learning, training, discriminant, weighted average, preprocessing, denoising, signal conditioning, filtering, time correction, timing compensation, phase offset compensation, transformation, component-wise operation, feature extraction, finite state machine, and / or another score. Features and / or STIs may be determined / calculated based on the similarity score.
[0173] Any threshold value may be predetermined, adaptively (and / or dynamically) determined, and / or determined by a finite state machine. Adaptive determination may be based on time, space, location, antenna, path, link, state, battery life, remaining battery life, available power, available computing resources, available network bandwidth, etc.
[0174] A threshold applied to a test statistic to distinguish between two events (or two conditions, or two situations or two states) A and B can be determined. Data (e.g., CI, channel state information (CSI), power parameters) can be collected under A and / or under B in a training situation. Test statistics can be calculated based on the data. The distribution of the test statistic under A can be compared with the distribution of the test statistic under B (reference distribution), and the threshold can be selected according to some criteria. The criteria may include: maximum likelihood (ML), maximum a posteriori probability (MAP), discriminant training, minimum type 1 error for a given type 2 error, minimum type 2 error for a given type 1 error, and / or other criteria (e.g., quality criteria, signal quality conditions). The threshold can be adjusted to achieve different sensitivities to A, B and / or another event / condition / situation / state. Threshold adjustment can be automatic, semi-automatic and / or manual. Threshold adjustment can be applied once, sometimes, often, periodically, repeatedly, occasionally, sporadically and / or on demand. Threshold adjustment can be adaptive (and / or dynamically adjusted). Threshold adjustment can depend on an object, object movement / position / direction / action, object characteristics / STI / size / features / traits / habits / behavior, a place, in a place, being in a place, characteristics of the place / fixtures / furniture / barriers / materials / machines / living things / things / objects / boundaries / surfaces / medium, a map, constraints of a map (or environment model), an event / state / situation / condition, time, timing, duration, current state, past history, user and / or personal preferences, etc.
[0175] The stopping criterion (or skipping or bypassing or blocking or pausing or passing or rejecting criterion) of the iterative algorithm can be that the change of the current parameter (e.g., offset value) in the update in the iteration is less than a threshold value. The threshold value can be 0.5, 1, 1.5, 2 or another number. The threshold value can be adaptive (and / or dynamically adjusted). It may change as the iteration proceeds. For the offset value, an adaptive threshold value can be determined based on the task, a specific value at the first time, a current time offset value, a regression window, a regression analysis, a regression function, a regression error, a convexity of the regression function, and / or the number of iterations.
[0176] The local extrema may be determined as a corresponding extrema of the regression function in the regression window. The local extrema may be determined based on a set of time offset values and a set of associated regression function values in the regression window. Each of the set of associated regression function values associated with the set of time offset values may be within a range of a corresponding extrema of the regression function in the regression window.
[0177] Searching for local minima can include robust search, minimization, maximization, optimization, statistical optimization, dual optimization, constrained optimization, convex optimization, global optimization, local optimization, energy minimization, linear regression, quadratic regression, higher-order regression, linear programming, nonlinear programming, stochastic programming, combinatorial optimization, constraint programming, constraint satisfaction, variational computing, optimal control, dynamic programming, mathematical programming, multi-objective optimization, multimodal optimization, disjunctive programming, space mapping, infinite-dimensional optimization, heuristics, metaheuristics, convex programming, semidefinite programming, cone programming, cone programming, integer programming, quadratic programming, sub Numerical programming, numerical analysis, simplex algorithm, iterative method, gradient descent, subgradient method, coordinate descent, conjugate gradient method, Newton's algorithm, sequential quadratic programming, interior point method, ellipsoid method, gradient descent method, quasi-Newton method, simultaneous perturbation stochastic approximation, interpolation method, pattern search method, line search, non-differentiable optimization, genetic algorithm, evolutionary algorithm, dynamic relaxation, hill climbing, particle swarm optimization, gravitational search algorithm, simulated annealing, meme algorithm, differential evolution, dynamic relaxation, random tunneling, taboo search, reaction search optimization, curve fitting, least squares, simulation-based optimization, variational calculus and / or variants. The search for local extrema can be associated with an objective function, a loss function, a cost function, a utility function, a fitness function, an energy function and / or an energy function.
[0178] A regression function may be used to perform regression to fit sampled data (e.g., CI, features of CI, components of CI) or another function (e.g., autocorrelation function) in a regression window. In at least one iteration, the length of the regression window and / or the position of the regression window may be changed. The regression function may be a linear function, a quadratic function, a cubic function, a polynomial function, and / or another function.
[0179] The regression analysis may minimize at least one of: an error, an aggregate error, a component error, an error in a projected domain, an error in a selected axis, an error in a selected orthogonal axis, an absolute error, a squared error, an absolute deviation, a squared deviation, a higher order error (e.g., third order, fourth order), a robust error (e.g., a squared error of a smaller error magnitude and an absolute error of a larger error magnitude, or a first type error of a smaller error magnitude and a second type error of a larger error magnitude), another error, a weighted sum (or weighted average) of absolute / squared errors (e.g., for a wireless transmitter with multiple antennas and a wireless receiver with multiple antennas, each pair of transmitter antennas and receiver antennas forms a link), a mean absolute error, a mean squared error, a mean absolute deviation, and / or a mean squared deviation. Errors associated with different links may have different weights. One possibility is that some links and / or some components with greater noise or lower signal quality indicators may have smaller or larger weights, weighted sums of squared errors, weighted sums of higher-order errors, weighted sums of robust errors, weighted sums of another errors, absolute costs, squared costs, higher-order costs, robust costs, another cost, weighted sums of absolute costs, weighted sums of squared costs, weighted sums of higher-order costs, weighted sums of robust costs, and / or weighted sums of another cost.
[0180] The determined regression error may be an absolute error, a squared error, a higher order error, a robust error, another error, a weighted sum of absolute errors, a weighted sum of squared errors, a weighted sum of higher order errors, a weighted sum of robust errors, and / or a weighted sum of another error.
[0181] The time offset associated with the maximum regression error (or minimum regression error) of the regression function with respect to a particular function in the regression window may become the current time offset updated in the iteration.
[0182] The local extrema may be searched based on a quantity including a difference between two different errors (e.g., a difference between an absolute error and a square error). Each of the two different errors may include an absolute error, a square error, a high-order error, a robust error, another error, a weighted sum of absolute errors, a weighted sum of square errors, a weighted sum of high-order errors, a weighted sum of robust errors, and / or a weighted sum of another error.
[0183] The quantity can be compared to reference data or a reference distribution, such as an F-distribution, a central F-distribution, another statistical distribution, a threshold, a threshold associated with a probability / histogram, a threshold associated with a probability / histogram for finding false peaks, a threshold associated with the F-distribution, a threshold associated with a central F-distribution, and / or a threshold associated with another statistical distribution.
[0184] The regression window can be determined based on at least one of: movement of the object (e.g., change in positioning / location), a quantity associated with the object, at least one feature of the object associated with the movement of the object and / or the STI, an estimated location of a local extrema, a noise characteristic, an estimated noise characteristic, a signal quality indicator, an F distribution, a central F distribution, another statistical distribution, a threshold, a preset threshold, a threshold associated with a probability / histogram, a threshold associated with a desired probability, a threshold associated with a probability of finding a false peak, a threshold associated with the F distribution, a threshold associated with the central F distribution, a threshold associated with another statistical distribution, a condition that the quantity at the center of the window is the largest within the regression window, a condition that the quantity at the center of the window is the largest within the regression window, a condition that for a specific value of the first time in the regression window, there is only one local extrema for a specific function, another regression window, and / or another condition.
[0185] The width of the regression window can be determined based on the specific local extrema to be searched. The local extrema can include a first local maximum, a second local maximum, a higher order local maximum, a first local maximum with a positive time offset value, a second local maximum with a positive time offset value, a higher local maximum with a positive time offset value, a first local maximum with a negative time offset value, a second local maximum with a negative time offset value, a higher local maximum with a negative time offset value, a first local minimum, a second local minimum, a higher local minimum, a first local minimum with a positive time offset value, a second local minimum with a positive time offset value, a higher local minimum with a positive time offset value, a first local minimum with a negative time offset value, a second local minimum with a negative time offset value, a higher local minimum with a negative time offset value, a first local extrema, a second local extrema, a higher local extrema, a first local extrema with a positive time offset value, a second local extrema with a positive time offset value, a higher local extrema with a positive time offset value, a first local extrema with a negative time offset value, a second local extrema with a negative time offset value, and / or a higher local extrema with a negative time offset value.
[0186] The current parameter (e.g., time offset value) can be initialized based on a target value, a target curve, a trend, a past trend, a current trend, a target speed, a speed curve, a target speed curve, a past speed trend, a motion or movement of an object (e.g., a change in positioning / position), at least one feature of an object associated with the movement of the object and / or STI, a positioning amount of an object, an initial speed of an object associated with the movement of the object, a predefined value, an initial width of a regression window, a duration, a value based on a signal carrier frequency, a value based on a signal subcarrier frequency, a signal bandwidth, an antenna amount associated with a channel, a noise characteristic, a signal h-index, and / or an adaptive (and / or dynamically adjusted) value. The current time offset can be located at the center, left side, right side, and / or another fixed relative position of the regression window.
[0187] In the representation, information may be displayed along with a map (or environment model) of the venue. The information may include: location, zone, area, region, coverage area, corrected location, approximate location, location relative to a map of the venue, location relative to a segmentation of the venue, direction, path, path relative to a map and / or segmentation, trajectory (e.g., location within a time window such as the last 5 seconds or the last 10 seconds; the time window duration may be adaptively (and / or dynamically) adjusted; the time window duration may be adaptively (and / or dynamically) adjusted relative to speed, acceleration, etc.), history of the path, approximate area / zone along the path, history / summary of past locations, history of past locations of interest, frequently visited areas, customer traffic, crowd distribution, crowd behavior, crowd control information, speed, acceleration, motion statistics, respiration rate, heart rate, presence / absence of motion, presence / absence of a person or pet or object, presence / absence of vital signs, posture, posture control (using a posture control device), location-based gesture control, location-based operation information, related objects (e.g., pets, people, self-service machines / equipment, vehicles, identity (ID) or identifier of a device (e.g., drone, car, boat, bicycle, self-driving vehicle, machine with fan, air conditioner, television, machine with movable parts), user identity (e.g., person), user information, user's position / speed / acceleration / direction / motion / posture / posture control / motion trajectory, user's ID or identifier, user's activity, user's state, user's sleep / rest characteristics, user's emotional state, user's vital signs, environmental information of the place, weather information of the place, earthquake, explosion, storm, rain, fire, temperature, collision, impact, vibration, events, door opening event, door closing event, window opening event, window closing event, fall event, burning event, freezing event, water-related event, wind-related event, air movement event, accident event, pseudo-periodic event (e.g., running on a treadmill, jumping up and down, skipping rope, somersault, etc.), repetitive events, crowd events, vehicle events, user posture (e.g., gestures, arm postures, foot postures, leg postures, body postures, head postures, facial postures, mouth postures, eye postures, etc.).
[0188] The location can be 2-dimensional (e.g., having 2D coordinates), 3-dimensional (e.g., having 3D coordinates). The location can be relative (e.g., relative to a map or environment model) or relative (e.g., halfway between point A and point B, around a corner, up a flight of stairs, on top of a table, on a ceiling, on a floor, on a couch, near point A, at a distance R from point A, within a radius of R from point A, etc.). The location can be expressed in rectangular coordinates, polar coordinates, and / or another representation.
[0189] Information (e.g., location) may be marked with at least one symbol. The symbol may change over time. The symbol may flash and / or pulse, with or without changing color / intensity. The size may change over time. The orientation of the symbol may change over time. The symbol may be a number reflecting an instantaneous quantity (e.g., a user's vital signs / respiratory rate / heart rate / posture / state / condition / action / motion, temperature, network traffic, network connectivity, the state of a device / machine, the remaining power of a device, the state of a device, etc.). The rate of change, size, orientation, color, intensity, and / or symbol may reflect the corresponding movement. The information may be represented visually and / or described verbally (e.g., using pre-recorded speech or speech synthesis). The information may be described in text. Information may also be represented mechanically (e.g., animated gadgets, movement of movable parts).
[0190] The user interface (UI) device can be a smart phone (such as an iPhone, an Android phone), a tablet computer (such as an iPad), a laptop computer (such as a notebook computer), a personal computer (PC), a device with a graphical user interface (GUI), a smart speaker, a device with voice / audio / speaker functions, a virtual reality (VR) device, an augmented reality (AR) device, a smart car, an in-car display, a voice assistant, an in-car voice assistant, etc.
[0191] The map (or environment model) can be 2-dimensional, 3-dimensional and / or higher dimensional (e.g., a 2D / 3D map / environment model that changes over time). Walls, windows, doors, entrances, exits, restricted areas can be marked on the map or model. The map can include a floor plan of the facility. The map or model can have one or more layers (overlays). The map / model can be a maintenance map / model that includes water pipes, gas pipes, wiring, cables, air ducts, crawl spaces, ceiling layouts, and / or underground layouts. The site can be divided / subdivided / zoned / grouped into multiple zones / regions / geographic areas / departments / sections / territories / districts / jurisdictions / gatherings / neighborhoods / regions / extensions / extensions, such as bedrooms, living rooms, storage rooms, walkways, kitchens, dining rooms, foyers, garages, first floors, second floors, lounges, offices, conference rooms, reception areas, various office areas, various warehouse areas, various facility areas, etc. Segments / regions / areas can be represented in the map / model. Different areas can be color-coded. Different areas may be represented by features (e.g., color, brightness, color intensity, texture, animation, blinking, blinking rate, etc.) Logical segmentation of the venue may be accomplished using at least one heterogeneous type 2 device or server (e.g., a hub device) or a cloud server, etc.
[0192] Here is an example of the disclosed systems, apparatus, and methods. Stephen and his family wish to install the disclosed wireless motion detection system to detect motion in their 2,000 square foot, two-story townhouse located in Seattle, Washington. Since his house has two floors, Stephen decides to use one Type 2 device (named A) and two Type 1 devices (named B and C) on the first floor. His first floor has three main rooms: a kitchen, dining room, and living room arranged in a straight line with the dining room in the middle. The kitchen and living room are located at the other ends of the house. He places the Type 2 device (A) in the dining room, one Type 1 device (B) in the kitchen, and another Type 1 device (C) in the living room. With this placement of the devices, he actually divides the ground floor into 3 zones (dining room, living room, and kitchen) using the motion detection system. When the AB pair and AC pair detect motion, the system will analyze the motion information and associate the motion with one of the 3 zones.
[0193] When Stephen and his family go away for the weekend (e.g., go camping during a long weekend), Stephen uses a mobile application (e.g., an Android phone application or an iPhone application) to turn on the motion detection system. When the system detects motion, a warning signal (e.g., a text message, an email, a push message sent to the mobile application, etc.) is sent to Stephen. If Stephen pays a monthly fee (e.g., $10 / month), the service company (e.g., a security company) will receive the warning signal through a wired network (e.g., broadband) or a wireless network (e.g., home WiFi, LTE, 3G, 2.5G, etc.) and perform security procedures for Stephen (e.g., call him to verify any problems, send someone to check the house, contact the police on Stephen's behalf, etc.). Stephen loves his elderly mother and is concerned about her well-being when she is alone at home. When his mother is alone at home and other family members are out (e.g., going to work, shopping, or vacation), Stephen uses his mobile application to turn on the motion detection system to make sure his mother is okay. He then uses the mobile application to monitor his mother's activities in the house. Stephen knew his mother was okay when he saw her moving between the 3 areas of the house as she went about her daily routine using the mobile app. Stephen was grateful that the motion detection system helped him monitor his mother’s well-being when he was away from home.
[0194] On a typical day, the mother wakes up around 7am. She spends about 20 minutes in the kitchen cooking breakfast. She then spends about 30 minutes eating breakfast in the dining room. She then does her daily exercise routine in the living room before sitting down on the couch in the living room to watch her favorite TV show. The motion detection system enables Stephen to see the timing of movement in each of the 3 areas of the house. When the movement matches daily life, Stephen knows roughly that the mother should be fine. But when the movement pattern is abnormal (e.g., no movement until 10am, or she stays in the kitchen too long, or she is motionless for too long, etc.), Stephen suspects something is wrong and will call the mother to check on her. Stephen may even ask someone (e.g., family member, neighbor, employee, friend, social worker, service provider) to check on his mother.
[0195] Sometimes, Stephen wants to relocate the Type 2 device. He simply unplugs the device from the original AC power plug and plugs it into another AC power plug. He is pleased that the wireless motion detection system is plug-and-play and relocation does not affect the operation of the system. It works immediately after powering on.
[0196] After some time, Stephen is convinced that the disclosed wireless motion detection system is indeed capable of detecting motion with very high accuracy and very low alert, and that he can indeed use the mobile app to monitor motion on the first floor. He decides to install a similar setup on the second floor (i.e., one Type 2 device and two Type 1 devices) to monitor the bedrooms on the second floor. He again finds that the system setup is very simple, simply plugging the Type 2 device and the Type 1 device into the AC power outlet on the second floor. No special installation is required. He can use the same mobile app to monitor motion on both the first and second floors. Each Type 2 device on the first / second floor can interact with all Type 1 devices on the first and second floors. Stephen is pleased to see that as he doubles his investment in Type 1 and Type 2 devices, the capabilities of the combined system he has have more than doubled.
[0197] According to various embodiments, each CI (CI) may include at least one of the following: channel state information (CSI), frequency domain CSI, frequency representation of CSI, frequency domain CSI associated with at least one subband, time domain CSI, intra-domain CSI, channel response, estimated channel response, channel impulse response (CIR), channel frequency response (CFR), channel characteristics, channel filter response, wireless multipath channel CSI, wireless multipath channel information, timestamp, auxiliary information, data, metadata, user data, account data, access data, security data, session data, status data, supervision data, home data, identity (ID), identifier, device data, network data, neighbor data, environmental data, real-time data, sensor data, stored data, encrypted data, compressed data, protected data and / or another CI. In one embodiment, the disclosed system has hardware components (e.g., wireless transmitter / receiver with antenna, analog circuit, power supply, processor, memory) and corresponding software components. According to various embodiments of the present teachings, the disclosed system includes a Bot (referred to as a type 1 device) and an Origin (referred to as a type 2 device) for vital sign detection and monitoring. Each device includes a transceiver, a processor and memory.
[0198] The disclosed system can be applied to many situations. In one example, a type 1 device (transmitter) can be a small WiFi-enabled device placed on a table. It can also be a WiFi-enabled TV (TV), set-top box (STB), smart speaker (e.g., Amazon echo), smart refrigerator, smart microwave, mesh network router, mesh network satellite, smart phone, computer, tablet computer, smart plug, etc. In one example, a type 2 (receiver) can be a WiFi-enabled device placed on a table. It can also be a WiFi-enabled TV (TV), set-top box (STB), smart speaker (e.g., Amazon echo), smart refrigerator, smart microwave, mesh network router, mesh network satellite, smart phone, computer, tablet computer, smart plug, etc. Type 1 devices and type 2 devices can be placed in / near a conference room to count the number of people. Type 1 devices and type 2 devices can be used in health monitoring systems for the elderly to monitor their daily activities and any signs of symptoms (e.g., dementia, Alzheimer's disease). Type 1 devices and type 2 devices can be used in baby monitors to monitor the vital signs (breathing) of living babies. Type 1 and Type 2 devices can be placed in bedrooms to monitor sleep quality and any sleep apnea. Type 1 and Type 2 devices can be placed in cars to monitor the health of passengers and drivers, detect driver sleep, and detect any infants left in the car. Type 1 and Type 2 devices can be used in logistics to prevent human trafficking by monitoring any persons hidden in trucks and containers. Type 1 and Type 2 devices can be deployed by emergency services in disaster areas to search for victims trapped in rubble. Type 1 and Type 2 devices can be deployed in an area to detect the breathing of any intruders. There are many applications for wireless respiration monitoring that do not require wearable devices.
[0199] The hardware module may be constructed to contain a type 1 transceiver and / or a type 2 transceiver. The hardware module may be sold to / used by different brands to design, build and sell a final commercial product. Products using the disclosed systems and / or methods may be home / office security products, sleep monitoring products, WiFi products, mesh products, televisions, STBs, entertainment systems, HiFi, speakers, home appliances, lamps, stoves, ovens, microwaves, tables, chairs, beds, shelves, tools, tableware, flashlights, vacuum cleaners, smoke detectors, sofas, pianos, fans, doors, windows, door / window handles, locks, smoke detectors, automotive accessories, computing devices, office equipment, air conditioners, heaters, pipes, connectors, surveillance cameras, access points, computing devices, mobile devices, LTE devices, 3G / 4G / 5G / 6G devices, UMTS devices, 3GPP devices, GSM devices, EDGE devices, TDMA devices, FDMA devices, CDMA devices, WCDMA devices, TD-SCDMA devices, gaming devices, glasses, glass panels, VR glasses, necklaces, watches, waist belts, belts, wallets, pens, hats, wearable devices, implanted devices, tags, parking tickets, smart phones, etc.
[0200] The summary may include: analysis, output response, selected time window, sub-sampling, transformation and / or projection. The representation may include representing at least one of: monthly / weekly / daily view, simplified / detailed view, cross-sectional view, small / large form factor view, color coded view, comparison view, summary view, animation, web page view, voice announcement, and another representation related to the periodic / repetitive characteristics of the repetitive motion.
[0201] A Type 1 / Type 2 device may be an antenna, a device with an antenna, a device with a housing (e.g., for a radio, antenna, data / signal processing unit, wireless IC, circuitry), a device with an interface to attach / connect to / link to an antenna, a device to interface to / attach to / connect to / link to another device / system / computer / phone / network / data aggregator, a device with a user interface (UI) / graphical UI / display, a device with a wireless transceiver, a device with a wireless transmitter, a device with a wireless receiver, an Internet of Things (IoT) device, a device with a wireless network, a device with both wired and wireless network capabilities, a device with a wireless integrated circuit (IC), or a device with a wireless transmitter. equipment, Wi-Fi devices, devices with Wi-Fi chips (e.g., compliant with 802.11a / b / g / n / ac / ax standards), Wi-Fi access points (APs), Wi-Fi clients, Wi-Fi routers, Wi-Fi repeaters, Wi-Fi hubs, Wi-Fi mesh network routers / hubs / APs, wireless mesh network routers, ad hoc network devices, wireless mesh network devices, mobile devices (e.g., 2G / 2.5G / 3G / 3.5G / 4G / LTE / 5G / 6G / 7G, UMTS, 3GPP, GSM, EDGE, TDMA, FDMA, CDMA, WCDMA, TD-SCDM A), cellular devices, base stations, mobile network base stations, mobile network hubs, mobile network compatible devices, LTE devices, devices with LTE modules, mobile modules (e.g., circuit boards with mobile support chips (ICs), such as Wi-Fi chips, LTE chips, BLE chips), Wi-Fi chips (ICs), LTE chips, BLE chips, devices with mobile modules, smart phones, companion devices for smart phones (e.g., dongles, accessories, plug-ins), dedicated devices, plug-in devices, AC-powered devices, battery-powered devices, devices with processors / memory / instruction sets, smart devices / gadgets / items: clocks, stationery, pens, user interfaces, paper, mat, camera, television (TV), set-top box, microphone, speaker, refrigerator, oven, machine, phone, wallet, furniture, door, window, ceiling, floor, wall, table, chair, bed, nightstand, air conditioner, heater, pipe, duct, cable, carpet, decoration, gadget, USB device, plug, dongle, lamp / light, tile, decoration, bottle, vehicle, car, AGV, drone, robot, laptop, tablet, computer, hard drive, network card, instrument, racket, ball, shoe, wearable device, clothing, glasses, hat, necklace, food, pill, small device that moves within a living body (e.g., blood vessels, lymphatic fluid, digestive system), and / or another device.Type 1 devices and / or Type 2 devices may be communicatively coupled with the Internet, another device capable of accessing the Internet (e.g., a smart phone), a cloud server (e.g., a hub device), an edge server, a local server, and / or a storage device. Type 1 devices and / or Type 2 devices may be operated by local control, may be controlled by another device via a wired / wireless connection, may be operated automatically, or may be controlled by a remote (e.g., away from home) central system.
[0202] In one embodiment, a type B device may be a transceiver that can perform both as an Origin (type 2 device, Rx device) and a Bot (type 1 device, Tx device), that is, a type B device may be a type 1 (Tx) and a type 2 (Rx) device (e.g., simultaneously or alternately), such as a mesh device, a mesh router, etc. In one embodiment, a type A device may be a transceiver that only acts as a Bot (Tx device), that is, only a type 1 device or only Tx, such as a simple IoT device. It may have the capabilities of an Origin (type 2 device, Rx device), but somehow it only acts as a Bot in an embodiment. All type A and type B devices form a tree structure. The root may be a type B device with access to a network (e.g., the Internet). For example, it may be connected to a broadband service via a wired connection (e.g., Ethernet, cable modem, ADSL / HDSL modem) or a wireless connection (e.g., LTE, 3G / 4G / 5G, WiFi, Bluetooth, microwave link, satellite link, etc.). In one embodiment, all type A devices are leaf nodes. Each Type B device can be a root node, a non-leaf node, or a leaf node.
[0203] Type 1 devices (transmitters, or Tx) and type 2 devices (receivers, or Rx) can be on or only on the same device (e.g., RF chip / IC). The device can operate at high frequency bands, such as 28 GHz, 60 GHz, 77 GHz, etc. The RF chip can have dedicated Tx antennas (e.g., 32 antennas) and dedicated Rx antennas (e.g., another 32 antennas).
[0204] One Tx antenna can send a wireless signal (e.g., a series of probe signals, perhaps at 100 Hz). Alternatively, all Tx antennas can be used to send wireless signals through beamforming (in Tx) so that the wireless signal is focused in a certain direction (e.g., to improve energy efficiency or improve signal-to-noise ratio in that direction, or low power operation when "scanning" that direction, or low power operation when a known object is in that direction).
[0205] Wireless signals hit objects (e.g., a living person lying in a bed 4 feet away from the Tx / Rx antennas, breathing and having a heartbeat) in a place (e.g., a room). Object motion (e.g., lung motion due to breathing rate, or blood vessel motion due to heartbeat) can affect / modulate the wireless signals. All Rx antennas can be used to receive wireless signals.
[0206] Beamforming can be applied (digitally) (in Rx and / or Tx) to "scan" different directions. Multiple directions can be scanned or monitored simultaneously. With beamforming, a "sector" (e.g., direction, orientation, orientation, zone, area, segment) associated with a Type 2 device can be defined (e.g., relative to the center position of the antenna array). For each probe signal (e.g., pulse, ACK, control packet, etc.), channel information or CI (e.g., channel impulse response / CIR, CSI, CFR) is obtained / calculated for each sector (e.g., from an RF chip). In breathing detection, CIRs can be collected in a sliding window (e.g., 30 seconds, and at a 100Hz sounding / probing rate, 3000 CIRs can be collected in 30 seconds).
[0207] The CIR may have many taps (e.g., N1 components / tap). Each tap may be associated with a time lag or flight time (tof, e.g., time to hit a person 4 feet away and return). When a person breathes in a certain direction at a certain distance (e.g., 4 feet), the CIR in the "certain direction" may be searched. The tap corresponding to the "certain distance" may then be searched. One may then calculate the breathing rate and heart rate from the taps of this CIR.
[0208] One can think of each tap in a sliding window (e.g., a 30 second window of a "component time series") as a function of time (e.g., "tap function," "component time series"). One can examine each tap function to look for strong periodic behavior (e.g., corresponding to breathing, perhaps in the range of 10bpm to 40bpm).
[0209] Type 1 devices and / or type 2 devices may have external connections / links and / or internal connections / links. The external connection (e.g., connection 1110) may be associated with 2G / 2.5G / 3G / 3.5G / 4G / LTE / 5G / 6G / 7G / NBIoT, UWB, WiMax, Zigbee, 802.16, etc. Internal connections (e.g., 1114A and 1114B, 1116, 1118, 1120) can be associated with WiFi, IEEE 802.11 standards, 802.11a / b / g / n / ac / ad / af / ag / ah / ai / aj / aq / ax / ay, Bluetooth, Bluetooth 1.0 / 1.1 / 1.2 / 2.0 / 2.1 / 3.0 / 4.0 / 4.1 / 4.2 / 5, BLE, mesh network, IEEE 802.16 / 1 / 1a / 1b / 2 / 2a / a / b / c / d / e / f / g / h / i / j / k / l / m / n / o / p / standards.
[0210] Type 1 devices and / or Type 2 devices can be powered by batteries (e.g., AA batteries, AAA batteries, coin cells, button cells, micro batteries, battery packs, power banks, car batteries, hybrid batteries, vehicle batteries, container batteries, non-rechargeable batteries, rechargeable batteries, nickel-cadmium batteries, nickel-metal hydride batteries, lithium-ion batteries, zinc-carbon batteries, zinc-chloride batteries, lead-acid batteries, alkaline batteries, batteries with wireless chargers, smart batteries, solar cells, marine batteries, aircraft batteries, other batteries, temporary energy storage devices, capacitors, flywheels).
[0211] Any device can be powered by DC or direct current (e.g., from a battery, generator, power converter, solar panel, rectifier, DC-DC converter as described above, using various voltages such as 1.2V, 1.5V, 3V, 5V, 6V, 9V, 12V, 24V, 40V, 42V, 48V, 110V, 220V, 380V, etc.) and therefore can have a DC connector or a connector with at least one pin for DC power.
[0212] Any device may be powered by AC or alternating current (e.g., a wall outlet in a home, a transformer, an inverter, shore power, at various voltages, such as 100V, 110V, 120V, 100-127V, 200V, 220V, 230V, 240V, 220-240V, 100-240V, 250V, 380V, 50Hz, 60Hz, etc.), and thus may have an AC connector or a connector having at least one prong for AC power. Type 1 devices and / or Type 2 devices may be located (e.g., installed, placed, moved to) in a facility or outside a facility.
[0213] For example, in a vehicle (e.g., a car, truck, van, bus, special vehicle, tractor, backhoe, excavator, conveyor, bulldozer, crane, forklift, electric cart, AGV, emergency vehicle, freight train, truck, trailer, container, ship, ferry, vessel, submersible, airplane, airship, elevator, monorail, train, tram, rail vehicle, rail car, etc.), the type 1 device and / or type 2 device can be an embedded device embedded in the vehicle, or an additional device (e.g., an aftermarket device) that is plugged into a vehicle port (e.g., an OBD port / socket, a USB port / socket, an accessory port / socket, a 12V auxiliary power socket, and / or a 12V cigarette lighter port / socket).
[0214] For example, one device (e.g., a Type 2 device) can be plugged into a 12V cigarette lighter / accessory port or an OBD port or a USB port (e.g., of a car / truck / vehicle), while another device (e.g., a Type 1 device) can be plugged into a 12V cigarette lighter / accessory port or an OBD port or a USB port (e.g., of a car / truck / vehicle). The OBD port and / or the USB port can provide power (of the car / truck / vehicle), signaling, and / or networking. The two devices can work together to monitor passengers in the vehicle, including children / infants. They can be used to count passengers, identify the driver, and detect the presence of passengers in a specific seat / position in the vehicle.
[0215] In another example, one device may be plugged into a 12V cigarette lighter / accessory port or OBD port or USB port of a car / truck / vehicle, while another device may be plugged into a 12V cigarette lighter / accessory port or OBD port or USB port of another car / truck / vehicle.
[0216] In another example, there are many devices of the same type A (e.g., type 1 or type 2) in many heterogeneous vehicles / portable devices / smart gadgets (e.g., automated guided vehicles / AGVs, shopping / luggage / moving carts, parking tickets, golf carts, bicycles, smart phones, tablet computers, cameras, recording devices, smart watches, skates, shoes, jackets, goggles, hats, glasses, wearable devices, Segways, scooters, luggage tags, cleaning machines, vacuum cleaners, pet tags / collars / wearable devices / implantable devices), each of which is either plugged into the vehicle's 12V accessory port / OBD port / USB port or embedded in the vehicle. At locations covering larger areas such as factories / stadiums / train stations / shopping centers / construction sites (e.g., gas stations, street lamp posts, street corners, tunnels, multi-story parking facilities, dispersed locations), one or more devices of other types B (e.g., if A is type 2, then B is type 1, or if A is type 1, then B is type 2) may be installed. Type A devices can be located, tracked, or monitored based on TSCI.
[0217] The area / location may not have local connectivity, such as broadband service, WiFi, etc. Type 1 and / or Type 2 devices may be portable. Type 1 and / or Type 2 devices may support plug-and-play.
[0218] Paired wireless links can be established between multiple pairs of devices to form a tree structure. In each pair (and associated links), a device (second device) can be a non-leaf (type B). The other device (first device) can be a leaf device (type A or type B) or a non-leaf device (type B). In the link, the first device acts as a bot (type 1 device or Tx device) to send a wireless signal (e.g., a probe signal) to the second device through a wireless multipath channel. The second device can act as an Origin (type 2 device or Rx device) to receive the wireless signal, obtain TSCI and calculate "link analysis" based on TSCI.
[0219] In some embodiments, the present teachings disclose systems and methods for wireless sensing.In one embodiment, a type 1 heterogeneous wireless device or a type 2 heterogeneous wireless device may be one of many heterogeneous wireless devices or stations (STAs) in a space.
[0220] Roles in wireless sensing: A type 1 device or a type 2 device or another STA can act as a sensing initiator. A sensing initiator can be a STA that initiates a wireless sensing process (or simply referred to as a sensing process, such as using WiFi, WLAN, 5G, UWB, millimeter wave, WiMax, WiGig, Bluetooth or other radio systems). At least one STA (e.g., a type 1 device, a type 2 device, a sensing initiator, a sensing transmitter, a sensing receiver, or another STA) can act as a sensing responder. A sensing responder can be a STA that participates in a sensing process initiated by a sensing initiator. At least one STA (e.g., a type 1 device, a type 2 device, a sensing initiator, a sensing responder, a sensing receiver or another STA) can act as a sensing transmitter. A sensing transmitter can be a STA that sends a wireless signal for sensing measurement in a wireless sensing process (e.g., a physical layer protocol data unit (PPDU) in WiFi, a data packet frame (NDP), an NDP announcement (NDPA) frame, or some sounding signals). At least one STA (e.g., a type 1 device, a type 2 device, a sensing initiator, a sensing responder, a sensing transmitter, or another STA) can act as a sensing receiver. The sensing receiver may be a STA that receives a wireless signal (eg, PPDU, NDPA, NDP or some sounding signals in WiFi) transmitted by a sensing transmitter and performs sensing measurements in a WLAN sensing process.
[0221] A STA may assume one or more possible roles (e.g., sensing initiator, sensing receiver, sensing transmitter, sensing receiver, sensing contributor, SBP requesting STA) in one (or more) sensing process. In a sensing process, a sensing initiator may be a sensing transmitter, a sensing receiver, both, or neither. In a sensing process, a sensing responder may be a sensing transmitter, a sensing receiver, or both.
[0222] Sensing process: The sensing process may allow the STA to perform sensing and obtain measurement results. The sensing process may consist of one or more of the following: sensing session setup, sensing measurement setup, sensing measurement instance, sensing measurement setup termination, and sensing session termination. The sensing process may include one or more sensing measurement instances.
[0223] Sensing Session: A sensing session may be a protocol between a sensing initiator and a sensing responder to participate in a sensing process. A sensing process may include zero or at least one sensing measurement instance. Figure 1 and Figure 2 Some examples of the sensing process are shown in FIG.
[0224] The measurement setup ID may be used to identify the attributes of the sensing measurement instance. The measurement instance ID may be used to identify the sensing measurement instance using the attributes of the same measurement setup ID. The dialog token field may be used to include both the measurement setup ID and the measurement instance ID. At least one type of sensing measurement result may be defined. The sensing transmitter and sensing receiver roles of the STA corresponding to the measurement setup ID may be fixed, unchanged, changed, modified, or adjusted as determined during the sensing measurement setup until the sensing measurement setup is terminated.
[0225] In the sensing session setup of the sensing process, a sensing session can be established, and operating parameters associated with the sensing session can be determined and exchanged between STAs. The sensing session can be paired and can be identified by a MAC address, an associated AID / UTD, a session ID, or another ID. A sensing initiator can maintain multiple sensing sessions. A STA can be a sensing initiator in one session and a sensing responder in another session.
[0226] An optional negotiation process in a sensing measurement setup may be defined to allow a sensing initiator and a sensing responder to exchange and agree on operational attributes associated with a sensing measurement instance. The operational attributes may include the roles of the initiator and responder, measurement report type (for non-local reporting or local reporting or both), and other operational parameters.
[0227] In a sensing measurement instance of a sensing process, sensing measurements may be performed to obtain sensing measurement results. More than one sensing transponder may participate in a sensing measurement instance. There may be at least two types of sensing measurement instances: (a) trigger-based (TB) sensing measurement instances, and (b) non-TB sensing measurement instances.
[0228] TB sensing measurements: TB sensing measurement instances may include a polling phase, an NDPA probing phase, a trigger frame (TF) probing phase, a reporting phase, and / or an LTF security update phase. As for the order between the probing phases, NDPA probing may precede TF probing and vice versa. This order may change over time.
[0229] Figure 3 Some examples of possible TB sensing measurement instances are shown in FIG. Figure 3 As shown in , two probing sequences are shown in Examples 3 and 4. The reporting phase in Example 5 can be separated in time from the probing phase. This may delay reporting. The polling in the reporting phase in Example 5 can be directed to transponders other than those participating in the probing.
[0230] Polling phase: In the polling phase, the AP (e.g., a WiFi access point, or a 3G / 4G / 5G / 6G base station or hub) can send a trigger frame to check the availability of the STA. If the STA is available, it can respond with CTS-to-self.
[0231] NDPA Probing: If at least one STA as a sensing receiver responds in the polling phase, the NDPA Probing phase may be present in a TB sensing measurement instance. The NDPA Probing phase may include: (a) transmission of a sensing NDP Announcement (NDPA) frame by the AP, and (b) transmission of an NDP by the AP after the transmission of the sensing NDPA frame. The NDP may be used for channel measurements (e.g., CI, CSI, CIR, CFR, etc.) between a sensing transmitter and a sensing receiver (e.g., in sub-7 GHz bands).
[0232] TF Probing: If at least one STA as a sensing transmitter responds in the polling phase, a trigger frame (TF) probing phase may be present in a TB sensing measurement instance. The TF probing phase may include: (a) transmission of a trigger frame (TF) by the AP to request NDP transmission from the STA; and (b) transmission of an NDP by the STA after receiving the trigger frame. The NDP may be used for channel measurements (e.g., CI, CSI, CIR, CFR, etc.) between a sensing transmitter and a sensing receiver (e.g., in sub-7 GHz bands).
[0233] Local / non-local reporting: During the reporting phase of a sensing measurement instance, sensing measurement results may be reported. Measurement results performed during the sensing process may be reported and / or obtained locally, non-locally, both (i.e., locally and non-locally), or not reported and / or obtained (i.e., not reported, e.g., when the CI change is less than a threshold, indicating that the CI may be substantially the same as the previous CI).
[0234] When reported locally, the sensing measurements may be reported locally in a sensing receiver or where the sensing measurements may be measured. Such local reporting may be implemented via some software interface, such as a medium access control (MAC) sublayer management entity (MLME) primitive or some firmware application program interface (or API). Some applications or high-level software may use a software interface (e.g., using a software interrupt) to obtain or read the sensing measurements.
[0235] When reporting non-locally, the measurement results may be reported non-locally to another device or STA (e.g., at least one of the following: a sensing initiator, a sensing responder, a sensing transmitter, a sensing receiver, a type 1 device, a type 2 device, a neighboring STA, other STAs, or some local or cloud server).
[0236] Measurements may be reported locally and non-locally (e.g., simultaneously, contemporaneously, alternately, selectively, adaptively, and / or in an on-demand / scheduled / planned manner). Measurement reports may include a combination of local and non-local reporting within a measurement "span" (a period of time) (e.g., simultaneous local / non-local reporting, alternating local / non-local / both / no reporting, local / non-local / both / no reporting selected by some mechanism, adaptively determined local / non-local / both / no reporting, on-demand local / non-local / both / no reporting, scheduled local / non-local / both / no reporting, scheduled local / non-local / both / no reporting in response to certain situations / states / events (e.g., based on thresholds)).
[0237] Settings (e.g., a combination of local and non-local reporting, any setting parameter, any session setting parameter, one of the measurement setting parameters) may apply to a "measurement span". A measurement span may include measurement instances associated with multiple sensing initiators, or identification of sensing initiators, or sensing initiator IDs, or multiple sessions associated with one (or more) sensing initiators, or sessions, or identification of sessions, or session IDs, or multiple measurement settings in a session, or measurement settings, or identification of measurement settings, or measurement setting IDs, or multiple measurement instances (or measurement setting IDs) associated with a measurement setting, or measurement instance numbers.
[0238] In simultaneous reporting, both local reporting and non-local reporting can be performed simultaneously or concurrently. In alternative reporting, a measurement instance can be segmented into consecutive sensing result groups, and a first group can be reported in a first manner, followed by a second group in a second manner, followed by a third group in a third manner, and so on, wherein each of the first manner, the second manner, the third manner, the fourth manner, the fifth manner, ... can be one of the following: (a) only locally, (b) only non-locally, (c) both locally and non-locally, or (d) none (not reported).
[0239] The type / precision / processing / other specifications of the measurement results reported non-locally in a sensing process / session / measurement instance may be determined by its sensing initiator (non-locally). The type / precision / processing / other specifications of the measurement results reported locally in the sensing process may be determined (locally) via a software interface (e.g., MLME primitives) in the sensing receiver or at the place where the measurement results are located. Local / non-local reporting may be enabled / disabled (non-locally) by the sensing initiator or by negotiation between the sensing initiator and the sensing responder. The switch between local and non-local reporting may be completely controlled by the sensing initiator, or partially controlled by the sensing initiator and partially controlled via a software interface in the sensing responder.
[0240] Sensing Measurement Report Frame: A sensing measurement report frame may be defined that may allow a sensing receiver to report sensing measurements non-locally. The frame may contain at least the following two fields: (a) a measurement report control field that contains information required to interpret the measurement report field; and (b) a measurement report field that carries the sensing measurement results obtained by the sensing receiver (e.g., channel information, CI, CSI, CIR, CFR, RSSI, or some variant).
[0241] Each of local reporting and non-local reporting may be initiated by a corresponding MLME. Transmission of a sensing measurement report frame may be initiated by an MLME primitive. Both immediate reporting and delayed reporting may be performed.
[0242] In the sensing session termination, the STA stops performing measurements and terminates the sensing session.
[0243] Threshold-based reporting: An optional threshold-based measurement and reporting process can be performed. The difference between the currently measured CI (e.g., CSI) and the previously measured CI (e.g., CSI) can be quantified. The difference can be referred to as a CI change. Thresholds to be used by the sensing receiver in a threshold-based process can be defined (e.g., by a sensing initiator, a sensing responder, a sensing transmitter, a sensing receiver, another STA, and / or a server). By comparing the CI change with a threshold, the sensing receiver can report measurement results (e.g., measurement results, original or transformed, uncompressed or compressed) when the CI change may be large (e.g., greater than a threshold or falls into a "large" classification).
[0244] CI change selection: CI change can include more than one quantity / measurement / selection (for example, two CI change measurements can be selected from 7 selections). As an example, CI change selection can include any of the following: difference (subtraction of current CI and previous CI), moving average difference (current CI moving average minus previous CI moving average), amplitude difference (or LI-norm, i.e. current CI amplitude minus previous CI amplitude), power difference (current CI power minus previous CI power), difference between current value and moving average (current CI minus CI moving average), high pass or band pass filter output, inner product (inner product of current CI and previous CI, both are vectors), inner product of moving average, inner product of amplitude, inner product of power, autocorrelation function (of CI), autocorrelation function of CI amplitude, autocorrelation of CI power, autocorrelation of CI function, autocovariance, etc.
[0245] Selection: The same, similar, or different threshold-based measurement and reporting processes can be applied to local reporting and non-local reporting, where (a) the quantities of CI change measurements used for local reporting and non-local reporting can be the same or different, (b) the selection of CI change measurements used for local reporting and non-local reporting can be the same or different, and / or (c) the thresholds used for local reporting and non-local reporting can be the same and / or different.
[0246] For non-local reporting, the enablement / disablement of threshold-based reporting, the amount and selection of CI changes, and the corresponding thresholds may be determined by the sensing initiator. They may also be determined by at least one of the following: a sensing transponder, a sensing transmitter, a type 1 device, another STA, and / or a server. They may also be determined locally by a sensing receiver or a type 2 device. Some precision reduction measures (e.g., quantization, approximation) may be applied to the measurement results before reporting non-locally.
[0247] For local reporting, the enablement / disablement of threshold-based reporting, the amount and selection of CI changes, and the corresponding thresholds can be determined locally by the sensing receiver or type 2 device. They can also be determined non-locally by at least one of the following: a sensing initiator, a sensing transponder, a sensing transmitter, a type 1 device, another STA, and / or a server. For local reporting, any precision reduction measures applied to the measurement results before non-local reporting may be applied / may not be applied (i.e., may be skipped / may not be skipped). For local reporting, the measurement results can be reported with the highest precision supported by the hardware of the sensing receiver.
[0248] Buffering timeout: During a sensing session, measurement results associated with a measurement instance and corresponding measurement setup ID may be buffered and kept available for local / non-local reporting in the sensing receiver (or type 2 device) for a duration comparable to the probing period associated with the measurement setup ID (e.g., a percentage of the probing period). The probing period associated with the measurement setup ID may be the target duration between two consecutive measurement instances as negotiated in the sensing measurement setup.
[0249] CSI as measurement result: CI (e.g., CSI, CIR, CFR, RSSI, or channel measured during training symbols of a received PPDU) may be a type of sensing measurement result (e.g., for WiFi / WLAN below 7 GHz). To enable sensing, a parameter (e.g., RXVECTOR parameter CI_ESTIMATE) may be defined that may contain the channel measured during training symbols of a received wireless signal (e.g., PPDU in WiFi / WLAN). The format of the parameter (e.g., CI_ESTIMATE) may be the same as the format used in the measurement report field within a sensing measurement report frame.
[0250] Central Computation: Some sensing networks including STAs may form a centralized sensing system, in which most advanced sensing computing tasks based on sensing measurement results (or "consumption" of sensing results, such as motion detection, breathing detection / monitoring, fall detection, etc.) are centrally performed by a central device (which may be a STA and a sensing initiator, or a device that requests a STA to act as a sensing initiator), while most STAs (e.g., sensing transponders, sensing transmitters, sensing receivers, type 1 devices, type 2 devices) do not participate in advanced sensing tasks. If the sensing measurement results are generated at the central device, local-only reporting can be used in the central device and central computing of advanced sensing computing tasks can be performed, and the sensing measurement results do not need to be sent from most STAs to the central device (which will take up a lot of network resources, take up time, bandwidth, hardware / software resources, and have considerable time delays). If the sensing measurements are generated at most STAs, non-local-only reporting can be used in most STAs to send all measurement results to the central device, which will then perform central computing of advanced sensing computing tasks. However, such non-local-only reporting may use a lot of network resources, take up time, bandwidth, hardware / software resources, and may cause considerable time delays.
[0251] Distributed computing: Some sensing networks form distributed sensing systems, in which most of the advanced sensing computing tasks based on sensing measurement results are distributed or shared among most STAs, and their corresponding advanced task results are sent to a central device (e.g., STA and sensing initiator, or a device requesting STA to act as a sensing initiator) for fusion and / or further processing. If the sensing measurement results are generated at most STAs, only local reporting can be performed and distributed computing of advanced sensing tasks can be performed. If the sensing measurement results are generated at the central device, the central device may need to send the corresponding results to the corresponding STA for distributed computing.
[0252] Example: As an example, there may be an infrastructure device that acts as a sensing initiator (e.g., an access point / AP for WiFi, or a base station in 3G / 4G / 5G / 6G / 7G / 8G, or a hub), and there may be many client devices (e.g., IoT devices for WiFi, mobile phones, or client devices for 3G / 4G / 5G / 6G / 7G / 8G).
[0253] Case 1: The base device may use trigger-based (TB) sensing measurements by sending a trigger frame (TF) to solicit NDP from the client device so that the measurement results are generated at the base device. In this way, only local reporting can be performed in the base device and central computation of high-level tasks can be performed in the base device.
[0254] Case 2: The base device can use non-TB sensing measurements by sending NDPA and NDP to the client device so that the measurement results are generated at the client device. In this way, only local reporting can be performed in the client device and distributed computing of high-level tasks can be performed in the client device. The client can send its high-level task results to the base device for fusion and further processing.
[0255] Example (Proxy): In another example, an initiator device (e.g., a STA as a real sensing initiator) can request a base device to act as a sensing initiator (proxy sensing initiator) to establish a sensing network with an IoT device. In case 1, the base device can send all measurements to the initiator device, which can then perform central computation of the high-level task. In case 2, the client device can send its high-level task results to the base device, which then sends to the initiator device for fusion and further processing (in the initiator device).
[0256] Measurement instance sharing: In one embodiment, a measurement instance may be associated with one measurement setup. In another embodiment, measurement instance sharing in a public session may be disclosed. A measurement instance may be shared by more than one measurement setup in a sensing session (by being associated with more than one measurement setup ID, the same initiator-responder pair), where measurements are performed using a "shared" or "combined" measurement setup, which may be a superset of more than one measurement setup (e.g., if one setup is 300 Hz with 2 antennas and another setup is 200 Hz with 3 antennas, the combined setup may be 300 Hz with 3 antennas). The combined probing frequency may be greater than or equal to the probing frequencies of more than one measurement setup, and less than or equal to their least common multiple (LCM) (e.g., the LCM of 200 and 300 is 600). For example, the combined probing frequency may be the maximum of the probing frequencies (e.g., the maximum of 200 and 300 is 300). Or it may be the LCM. Such measurement instance sharing may be useful when a large number of sampling times of more than one measurement setups coincide with each other or are very close to each other.The combined amount of antennas may be the maximum of the number of antennas of more than one measurement setups.
[0257] As an example, measurement instance sharing may be useful for two measurement setups that differ only in probing frequency, one being a coefficient of the other (e.g., 100 Hz vs. 200 Hz, all other setups being the same). By sharing measurement instances, all slower (with lower probing frequencies) measurement instances can be completely absorbed by the fast measurement instances. By sharing measurement instances, 100 measurement instances can be saved (a total of 200 instances per second compared to 300 instances per second previously). This will save a significant amount of network resources (airtime, bandwidth, hardware / software usage).
[0258] As another example, measurement instance sharing may be useful for two measurement settings that differ only in probing frequency, where the two probing frequencies have a sufficiently large GCF (greatest common factor), such as 200 Hz vs. 300 Hz, GCF=100, all other settings being the same. By sharing measurement instances, 10 measurement instances can be saved (a total of 400 instances per second compared to a total of 500 measurement instances per second previously). In general, if GCF=N, then N measurement instances can be saved per second. If the GCF of two measurement instances is greater than a threshold, the two measurement instances can be merged or shared.
[0259] In another embodiment, measurement instances shared across multiple sessions may be disclosed. There may be multiple sessions, each associated with a unique session ID. A measurement instance may be shared by more than one measurement setup (by being associated with more than one measurement setup ID and more than one session ID, with multiple sessions corresponding to multiple initiator-responder pairs) in multiple sensing sessions, where measurements are performed using a "shared" or "combined" measurement setup, which may be a superset of more than one measurement setup. Such measurement instance sharing may be useful for eliminating or avoiding "redundant" measurement instances when different initiator-responder pairs select similar or identical sets of measurement setup parameters.
[0260] As an example, a smart TV can establish a first sensing session with an AP, where the AP acts as a sensing initiator. A smart thermostat can establish a second sensing session with an AP, where the AP acts as a sensing initiator. Two sensing sessions can have the same or very similar set of measurement setting parameters (e.g., both have 100Hz in the "same" case, or 100Hz vs. 200Hz in the "similar" case, with all other settings the same). For example, some smart professor may have published a paper sharing a very good set of measurement setting parameters (e.g., 100Hz). In the "same" case, both the TV and the thermostat can be designed based on the published results, resulting in the same settings (e.g., both are 100Hz). In the "similar" case, a device may adjust the probing frequency from 100Hz to 200Hz in order to meet its performance requirements, resulting in "similar" settings (100Hz vs. 200Hz). As mentioned earlier, by allowing measurement instances to be shared across multiple sessions, 100 instances per second can be saved.
[0261] Generally speaking, two measurement instances associated with two different measurement setups (either in the same session or across multiple sessions) may be “merged” or “shared” if the difference between their sampling times may be smaller than a threshold.
[0262] In some embodiments, applications can benefit from "local" reporting / consumption of sensing measurements (e.g., CSI) in the sensing receiver, rather than "non-local" reporting (sent to the sensing initiator using a sensing measurement report frame) / consumption (by the sensing initiator). For example, the sensing initiator and the sensing receiver can be designed / operated by the same company to jointly perform sensing tasks. The sensing initiator can be designed to establish a WLAN sensing network, while the sensing receiver can be designed to perform most of the sensing calculations locally (e.g., motion / breathing detection) based on the locally reported sensing measurements. The locally calculated sensing results (which are much simpler than the raw sensing measurements) can be sent to the sensing initiator for fusion / further processing.
[0263] This will significantly reduce the heavy network resources (signaling, bandwidth, occupancy time, latency) required in non-local reporting, since the sensing measurements (e.g., CSI) are quite large. Local consumption distributes the sensing computations to many sensing receivers, which means that the computation / memory requirements of each receiver are relatively low. In contrast, non-local consumption concentrates all sensing computations in the sensing initiator, which means high computation / memory requirements. Thus, according to some embodiments of the present teachings, sensing measurements are reported locally in the sensing receivers via MLME primitives.
[0264] In some embodiments, the threshold-based process is extended from non-local reporting of sensed measurements to local reporting. An optional "threshold-based local reporting" may be defined for local reporting. In some embodiments, the optional "threshold-based local reporting" (and associated threshold) may be selected / deselected by MLME primitives. When sensed measurements may be reported locally in a sensing receiver, "threshold-based local reporting" may be applied to local reporting in a sensing receiver. Threshold-based local reporting means that when the "sensed measurement change" is greater than a threshold, the sensed measurement will be reported locally.
[0265] In various embodiments, threshold-based local reporting may be applied in a sensing receiver in an optional or mandatory manner. In some embodiments, the threshold used in "threshold-based local reporting" may be set via the MLME in the sensing receiver. In some embodiments, at least one "sensing measurement variation" (SMV) may be used for "threshold-based local reporting". In some embodiments, one of the at least one SMV is selected via the MLME in the sensing receiver.
[0266] In some embodiments, the wireless device may reduce the precision of the sensing measurements by performing some quantization on the sensing measurements (e.g., CSI) before sending them in the sensing measurement report frame. This may help achieve: reduced computational complexity, reduced hardware cost, increased / sustained throughput. However, for local consumption by a sensing receiver (or local reporting of sensing measurements), the sensing measurements may / should be reported with as high precision as possible.
[0267] In some embodiments, for the purpose of non-local reporting in the sensing receiver, any accuracy reduction measures applied to the sensing measurements may be skipped.In some embodiments, the sensing measurements may be reported locally in the sensing receiver via the MLME with the highest accuracy supported by the sensing receiver's hardware.
[0268] In some embodiments, the sensing measurements may require considerable memory to store / buffer in the sensing receiver. Due to limited allocated memory in the sensing receiver's hardware, buffering new sensing measurements may be expensive, if not impossible, if the old sensing measurements are not "flushed," where "flushed" means being sent for non-local reporting or being read for local reporting.
[0269] In some embodiments, old sensing measurements may be overwritten by new sensing measurements. Therefore, sensing measurements associated with a measurement instance with a measurement setup ID should be buffered and available for local / non-local reporting for a duration comparable to the probing period associated with the measurement setup ID (e.g., a percentage of the probing period, such as 50%). This will allow a high-level application to know how much time it needs to obtain sensing measurements using MLME primitives.
[0270] The Probing Period associated with a measurement setup ID is the target duration between two consecutive measurement instances as negotiated in the corresponding sensing measurement setup. In some embodiments, this statement is added in the SPF: sensing measurements associated with a measurement instance with a measurement setup ID should be buffered and available for local / non-local reporting for a duration comparable to the Probing Period associated with the measurement setup ID.
[0271] In various embodiments, there are different methods for reporting sensing measurement results. First, sensing measurement results can be reported only non-locally, without local reporting, which is beneficial to centralized sensing systems. Second, sensing measurement results can be reported only locally, without non-local reporting, which is beneficial to fully distributed sensing systems. Third, sensing measurement results can be reported locally and non-locally, which is beneficial to hybrid sensing systems. Fourth, sensing measurement results are not reported, or reporting is paused / stopped. For example, for privacy protection, sensing measurements / sessions can be paused. Pausing can be achieved by terminating the measurement setup and then resuming by starting a new measurement setup.
[0272] After the first method, there is only non-local reporting of sensing measurement results using sensing measurement report frames, and no local reporting. In this method, all sensing measurement results are sent to other places and consumed non-locally. This is very useful in centralized sensing systems, where sensing transponders do not participate in the consumption of sensing measurements. That is, the sensing transponders do not perform advanced WLAN sensing calculations (such as detecting / monitoring movement, breathing, falling, etc.). This will cause a lot of network traffic, occupy time or resources for sending raw sensing measurements (such as CSI), which leads to considerable time delays (for the sensing initiator to collect all sensing measurements). In addition, this requires central computing, which places high demands on the computing / storage of the sensing initiator. This method is very useful for "cooperative" sensing receivers, which are only willing to help generate and send back sensing measurement results.
[0273] After the second method, there is only local reporting of sensing measurement results, no non-local reporting. In this method, all sensing measurement results are consumed locally at the higher layer of the sensing transponder instead of being sent to the sensing initiator. This is useful in a distributed situation, where each sensing receiver performs advanced WLAN sensing calculations associated with (local) sensing measurements (such as detecting / monitoring motion, breathing, falling, etc.). The sensing initiator is used to set up the sensing transponder to form a WLAN sensing network. The sensing initiator can be used as a sensing transmitter or a sensing receiver. In some embodiments, the sensing receiver can share the calculated sensing results (which will require very little network bandwidth, occupied time or resources) with the sensing initiator for fusion / further processing. This only causes local calculations, and the computing / storage requirements are lower than the first method. There are no network resources for sending high-demand raw sensing measurement results, which is good for "partner" sensing receivers, who will help perform some advanced calculations.
[0274] After the third method, both local reporting and non-local reporting are performed, so that the sensing measurement results are consumed locally and non-locally. This is useful in mixed situations, where both the sensing transponder and the sensing initiator participate in the consumption of the sensing measurement. That is, the sensing transponder shares some advanced WLAN sensing calculations with the sensing initiator. Similar to the first method, the third method will result in a large amount of network traffic, occupying time or resources spent on sending raw sensing measurements (such as CSI). Since the third method performs both centralized and distributed computing, its computing / memory requirements for the sensing initiator are similar to those of the first method, and its computing / memory requirements for the sensing receiver are similar to those of the second method.
[0275] The hybrid case implies both central and distributed computing. In one example, assume that the AP is a sensing initiator, and there are many IoT devices acting as sensing responders (or requiring AP proxies).
[0276] An exemplary "recipe" for central computation is: AP solicits NDP from loT devices using TB sensing measurements using TF so that measurements are generated at the AP. Only local reporting is then sufficient for central computation. Measurements are not transmitted over the air.
[0277] An exemplary "recipe" for distributed computing is: The AP can use non-TB sensing measurements by sending NDPA+NDP to the loT device, so that the measurement results are generated at the loT device. Then, only local reporting is sufficient for distributed computing at the IoT device. The measurement results are not transmitted over the air.
[0278] In some embodiments, for measurement instances with the same measurement setting ID, the selection of local reporting and non-local reporting remains the same. Local or non-local reporting can be selected at different levels or granularities, including: at the session setting level (e.g., local / non-local reporting selection applied to all (ALL) measurement settings in the session), at the measurement setting level (e.g., local / non-local reporting selection applied to one (ONE) measurement setting), or both (e.g., a 1 bit in the session level indicates the session level or the measurement setting level, and then the selection is made at the corresponding level).
[0279] In some embodiments, a measurement instance is associated with a measurement setup. But it may be useful to associate a measurement instance with more than one measurement setup within a sensing session, and perform the measurement using a "shared" measurement setup. In a first example, the more than one shared measurement setups may be two measurement setups with a large number of measurement instances that overlap with each other. In a second example, the more than one shared measurement setups may be two measurement setups that differ only in the probing frequency, with F1 being a coefficient of F2 (e.g., 10 Hz vs. 20 Hz, all other settings being the same, where 30 instances become 20 instances). In a third example, the more than one shared measurement setups may be two measurement setups that differ only in the probing frequency, with a large greatest common factor (GCF) (e.g., 20 Hz vs. 30 Hz, all other settings being the same, GCF=10, where 20+30=50 instances become 40 instances. If GCF=N, then instance saving=N). In a fourth example, the more than one shared measurement setups may be two measurement setups that differ in the probing frequency and number of antennas (e.g., 10 Hz / 3 antennas vs. 20 Hz / 2 antennas, "shared" measurement setup = 3 antennas). Sensing measurement sharing may reduce the total amount of measurement instances, which means less occupied time / bandwidth / network resources for sensing, less buffer memory, lower power consumption, longer battery life, etc.
[0280] In some embodiments, it may be useful to share measurement instances of different sensing sessions (e.g., different initiator-responder pairs), where the measurements are performed using a "shared" measurement setting. When the initiator is an AP and the responder is an IoT device, many IoTs may use some "common" and "good" settings, resulting in their measurement setting parameters being very similar. In one example, the shared measurement settings in TB-based sensing are two measurement settings that differ only in the probing frequency, one of which is a coefficient of the other (e.g., a smart TV requires 10Hz, while a smart speaker requires 20Hz, and all other settings are the same). In another example, the shared measurement settings in TB-based sensing are two measurement settings that differ in the probing frequency and number of antennas (e.g., a smart TV requires 3 antennas for 10Hz, while a smart speaker requires 2 antennas for 20Hz), "shared" measurement settings = 3 antennas). Sensing measurement sharing can reduce the total amount of measurement instances, which means less time / bandwidth / network resources occupied for sensing, less buffer memory, lower power consumption, longer battery life, etc.
[0281] In some embodiments, the sensing transmitter is allowed to associate a measurement instance with up to N measurement setting IDs. N is an integer. Among the N measurement setting IDs, local / non-local reporting is performed in a predefined order (eg, increasing) of the measurement setting IDs.
[0282] In some embodiments, "measurement instance sharing" is enabled in a sensing session. In some embodiments, "measurement instance sharing" allows an instantaneous (individual) measurement instance to be associated with N sensing measurement setup IDs and to perform the associated sensing measurements using an instantaneous "common" setting, which enables the sensing measurements to meet all requirements / specifications of the N sensing measurement setup IDs. N is an integer greater than 1.
[0283] In some embodiments, "measurement instance sharing" is optional in a sensing session, where "measurement instance sharing" allows an instantaneous (individual) measurement instance to be associated with N sensing measurement setup IDs, and the associated sensing measurements to be performed with an instantaneous "common" setup, which enables the sensing measurements to meet all requirements / specifications of the N sensing measurement setup IDs. N is an integer greater than 1.
[0284] In some embodiments, access to CSI is controlled to protect privacy. In WLAN sensing, there are different functional roles. The sensing initiator is used to initiate the sensing process and can access the CSI. The sensing responder will participate in the session process and can access the CSI if it is a receiver. The sensing transmitter is used to send the sensing PPDU. The sensing receiver is used to perform sensing measurements and report sensing measurements, and can access the CSI. There can also be an SBP requesting STA that can request the SBP process and can access the CSI.
[0285] In some embodiments, the sensing system may maintain a classification of STAs in order to manage access to CSI. In one example, the system may allow a class of the most trusted STAs to perform all roles (with full access to CSI), including 1, 2, 3, 4, 5 (e.g., user's loT device from a trusted source). In another example, the system may allow a class of STAs to perform some roles (with limited access to CSI), such as {1, 2, 3, 4}, {2, 3, 4}, or {4} (e.g., for user loT devices from less trusted sources, neighbor's devices). In another example, the system may allow a class of STAs to play some roles (without access to CSI), such as a transponder that is not a receiver, or {3} (e.g., for an unknown device). In another example, the system may allow a class of STAs to play no roles (without access to CSI) (e.g., hostile devices, damaged devices).
[0286] In some embodiments, an optional proxy sensing (SBP) process may be defined as follows. First, an "SBP request" includes a non-AP STA sending an SBP request frame to an AP STA with SBP capabilities. The STA that sends the SBP request frame to invoke the SBP (and therefore perform WLAN sensing) is represented by an "SBP requesting STA". The format and content of the SBP request frame are to be determined. Secondly, the AP STA that receives the SBP request may send an SBP response frame to the SBP requesting STA to accept or reject the request. The format and content of the SBP response frame are to be determined. The AP STA that accepts the SBP request may then initiate a WLAN sensing process with one or more non-AP STAs using operating parameters derived from those operating parameters indicated within the SBP request frame. The measurement results obtained in the WLAN sensing process generated by the SBP request may be reported to the SBP requesting STA.
[0287] In some embodiments, the proxy sensing and local reporting (SBP-LR) process may be defined as follows. An "SBP-LR request" includes a non-AP STA sending an SBP-LR request frame to an AP STA with SBP-LR capability. The STA that sends the SBP-LR request frame to invoke SBP-LR (and therefore perform WLAN sensing) is represented by an "SBP-LR requesting STA". The format and content of the SBP request frame are to be determined. The AP STA that receives the SBP-LR request may send an SBP-LR response frame to the SBP-LR requesting STA to accept or reject the request. If accepted, the AP may commit to perform SBP-LR for a period of time. At the end of this period, ABP-LR may stop. However, the SBP-LR requesting STA (or another STA) may send another "continue request" together with the SBP-LR setting ID. The format and content of the SBP-LR response frame are to be determined. The AP STA that accepts the SBP-LR request may initiate a WLAN sensing process with one or more non-AP STAs using those derived operating parameters indicated in the SBP-LR request frame. The measurement results may be reported only locally (ie, locally to a sensing receiver), only remotely (to an APSTA that will forward the SBP-LR / SBP requesting STA), or both locally and remotely.
[0288] In some embodiments, the SBP-LR setting ID may be associated with the SBP-LR setting and / or operating parameters. Each measurement instance may be associated with one or more SBP-LR setting IDs. The AP STA may store / buffer / process / forward / redirect / reroute / distribute / utilize / execute / distribute the sensing measurement results received from the sensing receiver.
[0289] In some embodiments, an AP STA may perform non-TB sensing measurements with a non-AP STA, wherein an NDP is sent to the non-AP STA, so that sensing measurements are performed at each of the non-AP STAs and the measurement results are reported locally in the non-AP STA. The AP STA may perform non-TB sensing measurements with the non-AP STA using an NDP sent from the non-AP STA, so that sensing measurements are performed at the AP STA and the measurement results are reported locally in the AP STA. The AP STA may perform non-TB sensing measurements with the non-AP STA, wherein some NDPs are sent to the non-AP STA and some NDPs are sent from the non-AP STA. In this way, the sensing measurement results may not be sent from the sensing receiver to the AP STA over the air. In some embodiments, the AP STA may perform TB sensing measurements with the non-AP STA, so that sensing measurements are performed at the AP STA and the measurement results are reported locally in the AP STA.
[0290] For local reporting in the sensing receiver, unclaimed / unconsumed measurement results may be retained for up to a timeout period. Beyond the timeout period, the measurement results may be retained (e.g., retained until overwritten, retained for a timeout period), discarded, overwritten, or retained. One or more advanced application processes in the non-AP STA may use the MLME primitive to request the non-AP STA to participate in the SBP-LR with the corresponding sounding frequency. The sensing measurement results may be read via the MLME primitive within the timeout period. The AP STA may perform a wireless (e.g., WLAN, 4G / 5G / 6G / 7G / 8G, Bluetooth, WiMax, Wi-Fi, etc.) sensing process for more than one SBP-LR request / SBP request and / or more than one SBP-LR requesting STA / SBP requesting STA. The AP STA may perform a WLAN sensing process as a service to more than one SBP-LR requesting STA / SBP requesting STA. As long as there is one SBP-LR / SBP request, the AT STA may start performing the WLAN sensing process. The service may be suspended when all SBP-LR / SBP requests have been satisfied and completed and there are no more requests.
[0291] When there are two or more SBP-LR requests / SBP requests with different sensing parameters (for example, one with 20 Hz sounding and one with 10 Hz, or one with 20 Hz and the other with 30 Hz), the AP STA may perform a wireless sensing process with a "superset" of sensing parameters so that all SBP-LR / SBP requests are satisfied at the same time. Or the AP STA may perform multiple wireless sensing processes so that each SBP-LR / SBP request is satisfied by more than one wireless sensing process. For example, the AP STA may perform multiple wireless sensing processes, such as A, B, and C, each with corresponding sensing parameters. The first SBP-LR / SBP request may be satisfied by A (or a portion of A). The second request may be satisfied by combining A and B. The third request may be satisfied by A and C. The fourth request may be satisfied by A, B, and C, and so on.
[0292] In some embodiments, more than one SBP-LR / SBP requesting STA may be selected or allowed to send SBP-LR / SBP requests. The AP STA may decline / reject SBP-PR / SBP requests from non-selected / non-allowed STAs.
[0293] In some embodiments, the AP STA may provide privacy protection / access control for a wireless sensing system formed by the AP STA and the non-AP STA. The AP STA may belong to a user and be installed at the user's home / office / facility. The user may specify / designate / select some user devices (e.g., the user's device, some allowed user's devices, the user's trusted devices, the user's approved devices, the user's allowed devices) as "allowed" or "selected" STAs to send SBP-LR / SBP requests to enable sensing, such as using some authentication protocols, some pairing processes, some identification processes, some passwords, etc. The user may also specify / designate / select some AP STA "visible" WiFi devices (e.g., neighbors' WiFi devices, public devices, commercial devices, unknown devices, devices that the user does not trust, or devices owned by unauthorized users (such as tenants or residents or visitors of the user's home / office / facility)) as "unallowed" or "unselected" or "rejected" devices.
[0294] In some embodiments, in a mesh network where there are more than one AP STAs working together to form a mesh network, some or all of the AP STAs may perform SBP or SBP-LR. Each AP STA may perform wireless sensing independently with a corresponding group of "client" STAs. A client STA may perform wireless sensing with one or more than one AP STA. Alternatively, some or all of the AP STAs may perform wireless sensing jointly or in a coordinated manner. The detection of two AP STAs may be synchronous, or nearly synchronous, or simultaneous, or phased with a certain phase lag, or not synchronous. Assume there are three APs: AP1, AP2, and AP3. Each of the three APs may perform one or more wireless sensing processes (e.g., A, B, C for AP1, and D, E, F for AP2), each with corresponding sensing parameters. D and A may be related. D and A may have the same sensing parameters. Similarly, E and B may be related or similar or identical. F and C may be related or similar or identical. AP1 and AP2 may perform A and D simultaneously or concurrently or in a synchronous (with or without phase lag) manner, or asynchronously. AP1 and AP2 may perform A and B alternately (e.g., A=D, B=E, such that AP1 performs A and AP2 performs B, and then AP1 performs B and AP2 performs A), or in a staged manner (e.g., AP1 performs A, then AP2 performs D, while AP1 performs B, then AP2 performs E, while AP1 performs C, then AP2 performs F, while AP1 performs A, and so on - i.e., AP2 may be one step slower than AP1). AP3 may perform wireless sensing only with respect to AP1, only with respect to AP2, or both AP1 and AP2.
[0295] In some embodiments, a "recipe" for distributed computing is implemented. The AP can use non-TB sensing measurements by sending NDPA+NDP to the loT device, so that the measurement results are generated at the loT device. Then, only local reporting is sufficient to satisfy the distributed computing at the IoT device. The measurement results are not transmitted over the air.
[0296] In some embodiments, the proxy sensing and local reporting (SBP-LR) process for more than one SBP-LR requesting STA (e.g., one requesting 10Hz / 20MHz / 1 antenna, one requesting 30Hz / 40MHz / 4 antennas, and one requesting 15Hz / 40MHz / 3 antennas) can be defined as follows. When more than one SBP-LR requesting STA sends an SBP-LR request to an AP STA with SBP-LR capability, the AP can assign an SBP-LR setting ID to each set of requested parameters. For the case where the requested parameters are the same, the SBP-LR setting ID can be the same, which means that the SBP-PR setting ID is shared. When the AP establishes a session with a non-AP STA, it will obtain the maximum parameter set supported by the non-AP STA. Therefore, the AP will know which non-AP STAs can participate in each SBP-LR setting. The AP will perform measurement settings with each non-AP STA, where the measurement settings are based on the SBP-LR settings. Some measurement setting IDs can be reserved for SBP-LR settings.
[0297] Selective SBP can be applied in some embodiments. A proxy initiator (e.g., an SBP initiator) can send a request to a wireless access point (AP) as a proxy responder (e.g., an SBP responder) so that non-selective wireless sensing (e.g., SBP) is performed between the AP (as a sensing initiator, on behalf of the proxy initiator) and any available sensing responder (e.g., a non-AP STA / device, another AP, a mesh AP) in the AP wireless network. Each of the available sensing responders can be assigned / associated with an identity (ID, such as a MAC address). The proxy initiator (e.g., an SBP initiator) can send another request to the AP to perform selective wireless sensing (e.g., selective SBP) with a group of selected sensing responders in the AP's wireless network. Each selected sensing responder can be identified by a corresponding ID. The same or different sensing settings can be used for different sensing responders. For sensing responders, the same or different sensing settings can be used for different target tasks (for more than one target task) or different proxy initiators (for multiple proxy initiators).
[0298] The proxy initiator may request the AP to provide a list of sensing-capable devices in the AP's network that support / can perform wireless sensing (e.g., 802.11bf compatibility), as well as associated device information (e.g., device name, host name, vendor class ID, device product name). The proxy initiator may select the selected sensing transponder based on the list and associated device information.
[0299] The agent launcher can use a two-stage approach to perform selective wireless sensing on the target task. In stage 1, the agent launcher can request / execute / use non-selective wireless sensing (i.e., sensing using all available sensing transponders) to perform a trial / test / training task with all sensing transponders, and select the selected sensing transponder based on the sensing results and some criteria. The trial / test / training task can be a motion detection task. The location of each sensing transponder in the venue (or a mapping to a certain target physical device) can be estimated in the trial / test / training task, and the selection can be based on the estimated location (or mapping) of the sensing transponder. The agent selector can also select some devices from a list of devices with sensing capabilities that did not participate in stage 1.
[0300] Then in phase 2, the proxy initiator may request / perform selective wireless sensing for the target task with the selected sensing transponder. The trial / test / training task may be related to the target task in some way. The trial / test / training task may have low sensing requirements so that all wireless transponders with sensing capabilities can meet the requirements and can participate in non-selective wireless sensing. The trial / test / training task may have sensing results that are useful for selecting the selected sensing transponder.
[0301] The proxy launcher can use a two-stage method to perform selective wireless sensing on two target tasks. For each target task, a corresponding stage 1 can be executed, followed by a corresponding stage 2. Alternatively, a common stage 1 can be executed, in which a first group of selected sensing transponders can be selected for the first target task, and a second group of selected sensing transponders can be selected for the second target task. The first group may or may not overlap with the second group. Then, a separate stage 2 (e.g., sequentially, simultaneously, or contemporaneously) can be performed on the two target tasks based on the selected sensing transponders of the corresponding groups. If the first group and the second group overlap with at least one common sensing transponder that appears in the two groups, the sensing results associated with the common sensing transponder can be shared by the two target tasks.
[0302] Two different proxy initiators can use a two-stage method to perform selective wireless sensing for their corresponding target tasks. For each target task of each proxy initiator, a corresponding stage 1 can be executed, followed by a corresponding stage 2. Alternatively, a first common stage 1 can be executed for the first proxy initiator (a set of selected sensing transponders are selected for each of its target tasks), followed by a separate stage 2 (selective wireless sensing is performed for each of its target tasks). Similarly, a second common stage 1 can be executed for the second proxy initiator, followed by a separate stage 2 for each of its target tasks. Alternatively, a third common stage 1 can be executed for two proxy initiators, followed by a separate stage 2 for each target task. If a common sensing transponder is selected for more than one target task, the sensing results associated with the common sensing transponder can be shared by more than one target task.
[0303] The proxy initiator may be an "authorized" or "trusted" device that the AP allows / authorizes / authenticates to initiate one of the non-selective SBPs, or the non-selective SBPs, or both. A first qualification test / setup / process may be performed so that the SBP initiator is authorized by the AP to initiate a non-selective SBP (first authorization). A second qualification test / setup / process may be performed so that the SBP initiator is authorized by the AP to initiate a selective SBP (second authorization). The SBP initiator may have one of the first authorization and the second authorization, or both. One of the first authorization and the second authorization may imply the other.
[0304] The proxy launcher can be connected to the AP via a wireless connection (e.g., AP's wireless network, WiFi, WiMax, 4G / 5G / 6G / 7G / 8G, Bluetooth, UWB, mmWave, etc.) or via a wired connection (e.g., Ethernet, USB, fiber optic, etc.).
[0305] The sensing transponder may / may not support non-selective proxy sensing (e.g., SBP) or selective proxy sensing or both. When sending the sensing results to the AP for onward transmission to the proxy initiator, the sensing transponder may encrypt / process the sensing results so that the sensing results cannot be decrypted / interpreted / consumed / understood by the AP (which does not have the decryption key), but may be decrypted / interpreted / consumed / understood by the proxy initiator (which has the decryption key).
[0306] In some embodiments, the SBP initiator may request (e.g., during SBP setup; or in an SBP setup request frame; or in an SBP setup protocol / exchange / signaling) the SBP responder, and the SBP responder may limit the sensing process in the SBP to a list of selected non-AP STAs as sensing responders. Each selected non-AP STA may be specified based on its MAC address. When requested, the SBP responder may not include any non-selected non-AP STA as a sensing responder in the sensing process in the SBP. The SBP initiator may include itself as one of the sensing responders.
[0307] In some embodiments, a bit pattern in the SBP setup request frame may be used to indicate the presence or absence of such a request. If the bit pattern indicates the presence of a request, a field may be present in the SBP setup request frame to indicate the number / count / amount of non-AP STAs selected. The MAC addresses of the list of selected non-AP STAs may be sent in or after the SBP setup request frame.
[0308] In some embodiments, there are different use cases for wireless sensing. A first use case for wireless sensing is as follows: Figure 4 As shown in . In this case, the AP is both a sensing initiator and a sensing transmitter for wireless sensing. An 802.11bf-compatible STA can be a sensing transponder and a sensing receiver for wireless sensing. In this case, the sensing measurement results (e.g., CSI) can be fed back to the sensing initiator. Some sensing-based results (e.g., tasks and applications such as breathing detection and fall detection) can be calculated by the sensing initiator based on the sensing measurement results.
[0309] Figure 5 A second use case of wireless sensing is shown in FIG. 1 . In this case, the AP is both a sensing initiator and a sensing transmitter for wireless sensing. An 802.11bf-compatible STA can be a sensing transponder and a sensing receiver for wireless sensing. In this case, there is no sensing measurement result (e.g., CSI) fed back to the sensing initiator. Some sensing-based results can be calculated by the sensing transponder based on the sensing measurement results. The sensing-based results can be used by the sensing transponder or sent elsewhere.
[0310] Figure 6 The third use case of wireless sensing is shown in FIG. 1 . In this case, the AP is both a sensing transponder and a sensing receiver for wireless sensing. An 802.11bf-compatible STA can be a sensing initiator and a sensing transmitter for wireless sensing. In this case, the sensing measurement results (e.g., CSI) can be fed back to the sensing initiator. Some sensing-based results (e.g., tasks and applications such as breathing detection, fall detection) can be calculated by the sensing initiator based on the sensing measurement results.
[0311] Figure 7 The fourth use case of wireless sensing is shown in FIG. In this case, the AP is both a sensing transponder and a sensing receiver for wireless sensing. An 802.11bf-compatible STA can be a sensing initiator and a sensing transmitter for wireless sensing. In this case, there is no sensing measurement result (e.g., CSI) fed back to the sensing initiator. Some sensing-based results can be calculated by the sensing transponder (AP) based on the sensing measurement results. The sensing-based results can be used by the sensing transponder or sent elsewhere.
[0312] Figure 8 The fifth use case of wireless sensing is shown in FIG. In this case, the AP is both a sensing initiator and a sensing receiver for wireless sensing. An 802.11bf-compatible STA can be a sensing transponder and a sensing transmitter for wireless sensing. In this case, sensing measurement results (e.g., CSI) can be obtained by the sensing initiator. Some sensing-based results (e.g., tasks and applications such as breathing detection and fall detection) can be calculated by the sensing initiator based on the sensing measurement results.
[0313] Fig. 9 The sixth use case of wireless sensing is shown in FIG. In this case, the AP is both a sensing transponder and a sensing transmitter for wireless sensing. An 802.11bf-compatible STA can be a sensing initiator and a sensing receiver for wireless sensing. In this case, the sensing measurement results (e.g., CSI) can be obtained by the sensing initiator. Some sensing-based results (e.g., tasks and applications such as breathing detection and fall detection) can be calculated by the sensing initiator based on the sensing measurement results.
[0314] The seventh use case for wireless sensing is Fig.10 Proxy sensing (SBP) case shown in . In this case, the AP is both a sensing initiator and a sensing transmitter for wireless sensing. An 802.11bf-compatible STA can be a sensing transponder and a sensing receiver for wireless sensing. In this case, the sensing measurement results (e.g., CSI) can be fed back to the SBP requesting STA. Some sensing-based results (e.g., tasks and applications such as breathing detection and fall detection) can be calculated by the SBP requesting STA based on the sensing measurement results.
[0315] The eighth use case for wireless sensing is Fig.11Proxy sensing (SBP) case shown in . In this case, the AP is both a sensing initiator and a sensing receiver for wireless sensing. An 802.11bf-compatible STA can be a sensing transponder and a sensing transmitter for wireless sensing. In this case, the sensing measurement results (e.g., CSI) can be fed back to the SBP requesting STA. Some sensing-based results (e.g., tasks and applications such as breathing detection and fall detection) can be calculated by the SBP requesting STA based on the sensing measurement results.
[0316] The ninth use case for wireless sensing is Fig.12 Proxy sensing (SBP) case shown in . In this case, the AP is both a sensing initiator and a sensing transmitter for wireless sensing. An 802.11bf-compatible STA can be a sensing transponder and a sensing receiver for wireless sensing. In this case, there is no sensing measurement result (e.g., CSI) fed back to the SBP requesting STA. Some sensing-based results (e.g., tasks and applications such as breathing detection and fall detection) can be calculated by the sensing transponder based on the sensing measurement results.
[0317] The tenth use case for wireless sensing is Fig.13 Proxy sensing (SBP) case shown in . In this case, the AP is both a sensing initiator and a sensing transmitter for wireless sensing. An 802.11bf-compatible STA can be a sensing responder and a sensing receiver for wireless sensing. In this case, the PPDU is broadcast from the AP to one or more sensing responders with the same sensing measurement settings; and there is no sensing measurement result (e.g., CSI) fed back to the SBP requesting STA. Some sensing-based results (e.g., tasks and applications such as breathing detection and fall detection) can be calculated by the sensing responder based on the sensing measurement results.
[0318] In some embodiments, the present teachings disclose systems and methods for wireless sensing. In some embodiments, when sensing results (e.g., CSI) are reported locally at a sensing receiver, a timestamp may be included in the report. The timestamp may include the time when a wireless signal from a type 1 device (which may be a sensing transmitter) (i.e., a sensing physical layer protocol data unit (PPDU) sent from a sensing transmitter to a sensing receiver) is received by a type 2 device (sensing receiver). In some embodiments, the timestamp may be used for time base correction (e.g., in breathing detection / monitoring).
[0319] In some embodiments, each measurement instance is associated with one and only one measurement setup, although it may be associated with multiple sessions.
[0320] But it may be useful to associate a measurement instance with more than one measurement setup. This may reduce the total amount of measurement instances, which means less occupied time / bandwidth / network resources for sensing, less buffer memory, lower power, longer battery life, etc. In some embodiments, there are measurement instances that are shared within a session. Fig.14 An example of associating a measurement instance with more than one measurement setting ID is shown.
[0321] In some embodiments, there may be measurement instances shared across sessions. Since one measurement instance may be associated with more than one session in the standard, a measurement instance associated with more than one measurement setup may be associated with more than one set of {measurement setup ID, session ID}. Fig.15 An example of a measurement instance with more than one {measurement setup ID, session ID} is shown.
[0322] Thus, according to some embodiments, in 802.11bf, a measurement instance may or may not be allowed to be associated with more than one measurement setup ID.According to some embodiments, in 802.11bf, a measurement instance may or may not be allowed to be associated with more than one {measurement setup ID, session ID}.
[0323] Fig.16 An exemplary block diagram of a first wireless device (e.g., Bot 1600) of a system for wireless sensing according to some embodiments of the present disclosure is shown. Bot 1600 is an example of a device that can be configured to implement the various methods described herein. Fig.16 As shown in , Bot 1600 includes a housing 1640 , which contains a processor 1602 , a memory 1604 , a transceiver 1610 including a transmitter 1612 and a receiver 1614 , a synchronization controller 1606 , a power module 1608 , an optional carrier configurator 1620 , and a wireless signal generator 1622 .
[0324] In this embodiment, the processor 1602 controls the general operation of the Bot 1600 and may include one or more processing circuits or modules, such as a central processing unit (CPU) and / or a general-purpose microprocessor, a microcontroller, a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a controller, a state machine, gating logic, discrete hardware components, a dedicated hardware finite state machine, or any other suitable circuits, devices, and / or structures that can perform calculations or other manipulations of data.
[0325] The memory 1604, which may include both a read-only memory (ROM) and a random access memory (RAM), may provide instructions and data to the processor 1602. A portion of the memory 1604 may also include a non-volatile random access memory (NVRAM). The processor 1602 typically performs logic and arithmetic operations based on program instructions stored in the memory 1604. The instructions (also known as software) stored in the memory 1604 may be executed by the processor 1602 to perform the methods described herein. The processor 1602 and the memory 1604 together form a processing system for storing and executing software. As used herein, "software" refers to any type of instruction that can configure a machine or device to perform one or more desired functions or processes, whether referred to as software, firmware, middleware, microcode, etc. Instructions may include code (e.g., source code format, binary code format, executable code format, or any other suitable code format). When the instruction is executed by one or more processors, the processing system is caused to perform the various functions described herein.
[0326] The transceiver 1610 including a transmitter 1612 and a receiver 1614 allows the Bot 1600 to send and receive data to and from a remote device (e.g., Origin or another Bot). The antenna 1650 is typically attached to the housing 1640 and electrically coupled to the transceiver 1610. In various embodiments, the Bot 1600 includes (not shown) multiple transmitters, multiple receivers, and multiple transceivers. In one embodiment, the antenna 1650 is replaced with a multi-antenna array 1650, which can form multiple beams, each beam pointing in a different direction. The transmitter 1612 can be configured to wirelessly transmit signals of different types or functions, such signals being generated by the processor 1602. Similarly, the receiver 1614 is configured to receive wireless signals of different types or functions, and the processor 1602 is configured to process multiple different types of signals.
[0327] Bot 1600 in this example can act as a Bot or a type 1 device or a sensing transmitter for wireless sensing. The synchronization controller 1606 in this example can be configured to control the operation of Bot 1600 to be synchronized or asynchronous with another device (e.g., Origin or another Bot). In one embodiment, the synchronization controller 1606 can control Bot 1600 to synchronize with Origin that receives a wireless signal sent by Bot 1600. In another embodiment, the synchronization controller 1606 can control Bot 1600 to send wireless signals asynchronously with other Bots. In another embodiment, each of Bot 1600 and other Bots can send wireless signals separately and asynchronously.
[0328] The carrier configurator 1620 is an optional component in the Bot 1600 to configure transmission resources, such as time and carrier, for transmitting the wireless signal generated by the wireless signal generator 1622. In one embodiment, each CI in the time series of CIs has one or more components, each component corresponding to a carrier or subcarrier for wireless signal transmission. Wireless sounding sensing can be based on any one or any combination of the components.
[0329] The power module 1608 may include a power source such as one or more batteries and a power regulator to provide power to the Fig.16 Each of the above modules in the provides regulated power. In some embodiments, if Bot 1600 is coupled to a dedicated external power source (e.g., a wall outlet), the power module 1608 may include a transformer and a power regulator.
[0330] The various modules described above are coupled together via a bus system 1630. In addition to the data bus, the bus system 1630 may also include a data bus and, for example, a power bus, a control signal bus, and / or a status signal bus. It should be understood that the modules of Bot 1600 may be operably coupled to each other using any suitable technology and medium.
[0331] although Fig.16 , but those skilled in the art will appreciate that one or more modules may be combined or implemented in common. For example, processor 1602 may not only implement the functions described above with respect to processor 1602, but may also implement the functions described above with respect to wireless signal generator 1622. Fig.16 Each of the modules shown in the figure may be implemented using multiple individual components or elements.
[0332] Fig.17 An exemplary block diagram of a second wireless device (e.g., Origin 1700) of a system for wireless sensing according to one embodiment of the present teachings is shown. Origin 1700 is an example of a device that can be configured to implement the various methods described herein. Origin 1700 in this example can be used as an Origin or Type 2 device or a sensing receiver for wireless sensing. Fig.17 As shown in , Origin 1700 includes a housing 1740 that contains a processor 1702 , a memory 1704 , a transceiver 1710 including a transmitter 1712 and a receiver 1714 , a power module 1708 , a synchronization controller 1706 , a channel information extractor 1720 , and an optional motion detector 1722 .
[0333] In this embodiment, the processor 1702, memory 1704, transceiver 1710 and power module 1708 operate similarly to the processor 1602, memory 1604, transceiver 1610 and power module 1608 in Bot 1600. Antenna 1750 or multiple antenna array 1750 is typically attached to housing 1740 and electrically coupled to transceiver 1710.
[0334] Origin 1700 may be a second wireless device of a different type from the first wireless device (e.g., Bot 1600). In particular, a channel information extractor 1720 in Origin 1700 is configured to receive a wireless signal through a wireless channel and obtain a time series of channel information (CI) of the wireless channel based on the wireless signal. The channel information extractor 1720 may send the extracted CI to an optional motion detector 1722 or to a motion detector outside Origin 1700 for wireless detection sensing in a venue.
[0335] Motion detector 1722 is an optional component in Origin 1700. In one embodiment, it is located within Origin 1700, such as Fig.17 . In another embodiment, it is outside Origin 1700 and in another device, which can be a Bot, another Origin, a cloud server, a fog server, a local server, and an edge server. The optional motion detector 1722 can be configured to detect sound information from a vibrating object or source in the venue based on the motion information. The motion information can be calculated by the motion detector 1722 or another motion detector outside Origin 1700 based on the time series of CI.
[0336] The synchronization controller 1706 in this example can be configured to control the operation of Origin 1700 to be synchronized or asynchronous with another device (e.g., a Bot, another Origin, or an independent motion detector). In one embodiment, the synchronization controller 1706 can control Origin 1700 to synchronize with a Bot that sends a wireless signal. In another embodiment, the synchronization controller 1706 can control Origin 1700 to receive wireless signals asynchronously with other Origins. In another embodiment, each of Origin 1700 and other Origins can receive wireless signals separately and asynchronously. In one embodiment, an optional motion detector 1722 or a motion detector external to Origin 1700 is configured to asynchronously calculate corresponding heterogeneous motion information based on the corresponding time series of CI.
[0337] The various modules described above are coupled together via a bus system 1730. In addition to the data bus, the bus system 1730 may also include a data bus and, for example, a power bus, a control signal bus, and / or a status signal bus. It should be understood that the modules of Origin 1700 may be operably coupled to each other using any suitable technology and medium.
[0338] although Fig.17 , but those skilled in the art will appreciate that one or more modules may be implemented in combination or in common. For example, processor 1702 may not only implement the functions described above with respect to processor 1702, but may also implement the functions described above with respect to channel information extractor 1720. On the contrary, Fig.17 Each of the modules shown in the figure may be implemented using multiple individual components or elements.
[0339] Fig.18 A flowchart of an exemplary method 1800 for wireless sensing according to some embodiments of the present disclosure is shown. In various embodiments, the method 1800 may be performed by the system disclosed above. At operation 1802, a time sequence of wireless sounding signals (WSS) is sent by a transmitter in a wireless data communication network based on a wireless protocol associated with the communication network. The wireless data communication network may include multiple layers: a physical (PHY) layer, a medium access control (MAC) layer, and at least one higher layer. At operation 1804, a receiver in the wireless data communication network receives a time sequence of WSS (TSWSS) through a wireless channel of a venue based on a wireless protocol. At operation 1806, the receiver performs multiple wireless sensing measurements based on the received TSWSS to obtain sensing measurement results. At operation 1808, the PHY layer (or MAC layer) of the receiver reports the sensing measurement results to at least one higher layer of the receiver. At operation 1810, at least one higher layer of the receiver performs a sensing-based task based on the sensing measurement results. Fig.18 The order of operations in may be changed according to various embodiments of the present teachings.
[0340] In some embodiments, the present teachings disclose methods for bidirectional P2P sensing. In one example of bidirectional P2P sensing, the AP may be a sensing initiator, and both the first and second non-AP STAs may be sensing responders. In another example, the non-AP STA may be a proxy sensing (SBP) initiator requesting the AP (SBP responder) to perform bidirectional P2P sensing, wherein the AP may be a sensing initiator and both the first and second non-AP STAs may be sensing responders.
[0341] In both examples, the AP may configure / negotiate / arrange with the two non-AP STAs individually so that the two non-AP STAs can identify each other (each with at least one corresponding ID, such as an identifiable network address, an identifiable wireless network address / ID, an AP-assigned ID, an initiator-assigned ID, a user-defined ID, a MAC address) and the two non-AP STAs will send NDPs to each other as a sounding signal so that sensing measurements can be obtained / generated in the two non-AP STAs. The AP may send a second P2P sensing trigger frame to the pair of non-AP STAs. The second P2P sensing trigger frame may be an NDPA frame, a trigger frame, a special NDPA trigger frame (as described above), a first P2P sensing trigger frame, or another frame. A separate first P2P sensing trigger frame may be sent to each pair of non-AP STAs, or a common / shared first P2P sensing trigger frame may be sent to multiple (e.g., some or all) available STAs. Then, the first non-AP STA will send an NDP to the second non-AP STA to generate a sensing measurement result at the second non-AP STA, and the second non-AP STA will send an NDP to the first non-AP STA to generate a sensing measurement result at the first non-AP STA. The sensing measurement result may be used / needed in the second non-AP STA, or the sensing result may be optionally sent from the second non-AP STA (sensing responder) to the AP (sensing initiator). In the SBP example, the AP (SBP responder) may further report the sensing result to the SBP initiator.
[0342] In another example, the first and second non-AP STAs may perform unidirectional P2P sensing or bidirectional P2P sensing without signaling from the AP. The two non-AP STAs may be able to recognize each other and configure / negotiate / arrange with each other. In unidirectional P2P sensing, the NDP may be sent unidirectionally from the first non-AP STA to the second non-AP STA to generate a sensing result in the second non-AP STA. The second non-AP STA may optionally send its sensing result to the first non-AP STA. In bidirectional P2P sensing, the NDP may be sent bidirectionally between the two non-AP STAs without signaling from the AP.
[0343] In the sensing process initiated by the AP, for two-way transponder-to-transponder sensing, transponder-to-transponder sounding may be optionally allowed. For example, two-way sounding between two transponders may be optionally allowed in the sensing process initiated by the AP, with one NDP from transponder 1 (R1) to transponder (R2) and another NDP from transponder 2 (R2) to transponder 1 (R1). This may be useful when there are N transponders forming a daisy chain or scanning order or configuration.
[0344] For the example of N=3, three transponders R1, R2 and R3 can form a closed daisy chain or closed loop. R2 can obtain CSI between R1-R2 and between R2-R3. It can perform useful WLAN sensing calculations based on two CSIs. Optionally, the CSI can be reported to the AP.
[0345] Fig.19 An example of bidirectional transponder-to-transponder sensing is shown. In this example, four sensing transponders R1, R2, R3, and R4 are configured to form a network (e.g., a daisy chain). Some "links" may perform bidirectional sensing (e.g., R1-R2 or R2-R3) such that each link pair will send NDPs to each other in series (e.g., R1 to R2 NDP and R2 to R1 NDP).
[0346] Some links may do unidirectional sensing (e.g., R3-R4, R4-R1), so that the NDP will be sent in only one direction. R2 has two CSIs: the CSI between R1-R2 and the CSI between R2-R3 (and more if R2 is further linked to additional transponders such as R4). In some embodiments, reporting of sensing measurements is optional.
[0347] According to some embodiments, in optional transponder-transponder sensing, a first sensing transponder should be allowed to perform unidirectional sensing or bidirectional sensing with a second sensing transponder. In unidirectional sensing, an NDP is sent from the first transponder to the second transponder. In bidirectional sensing, one NDP is sent from the first transponder to the second transponder, and then another NDP is sent from the second transponder to the first transponder.
[0348] In some embodiments, the present teachings also disclose termination or suspension of session setup / measurement setup associated with a sensing transponder. The AP may determine, or the AP may receive a determination from a SBP initiator in the case of proxy sensing (SBP), that sensing measurements (e.g., CSI, CIR, CFR, RSSI) associated with a particular sensing transponder may be useless, not very useful, and / or least useful for the task (e.g., too noisy, too unstable, too chaotic, too much interference, unreliable, faulty, or the user "paused" or "stopped" sensing associated with a particular transponder, or the user "paused" or "stopped" sensing associated with all sensing transponders, etc.). The determination may be based on (i) testing of the sensing measurements (e.g., based on testing / measurements of noise, stability, variability, randomness / chaos, interference, reliability, faults, errors, and / or errors) and / or (ii) the state / condition / test of the system (e.g., sensing measurement transmission / storage / associated processing / sensing computation may consume too much bandwidth / memory / processing power / time, or generate too much power, or another higher priority task requires resources currently allocated to the sensing measurements). It may be determined that sensing measurements associated with another sensing transponder may be useful, not useless, and / or more useful for the task.
[0349] As a result, the AP may terminate the sensing session setup associated with the particular sensing transponder, or in the case of SBP may receive a request from an SBP initiator. The AP may, or in the case of SBP may receive a request from an SBP initiator, to wait for a period of time (e.g., wait until some interfering / noisy / unstable / unreliable / adverse condition ends, or wait for a user to "unpause" or "unstop" sensing), and then start another sensing session with the particular sensing transponder (by executing the sensing session setup) using the same or similar or modified sensing session setup as the terminated sensing session setup. The determination of the cycle time may be based on some criteria.
[0350] Alternatively, instead of terminating the sensing session establishment, the AP may or may receive a request from the SBP initiator in the case of SBP to terminate a specific sensing measurement setup associated with a specific sensing transponder. The AP may or may receive a request from the SBP initiator in the case of SBP to wait for a period of time and then start another sensing measurement setup with the specific sensing transponder with the same or similar setup as the specific terminated sensing measurement setup.
[0351] Alternatively, the AP may, or in the case of an SBP may receive a request from an SBP initiator, to suspend a sensing session (ie, sensing session setup) with a particular sensing transponder for a period of time and resume the sensing session after the period of time.
[0352] Alternatively, the AP may, or in the case of an SBP may receive a request from an SBP initiator, to suspend a specific sensing measurement session with a specific sensing transponder for a period of time and resume the specific sensing measurement session after the period of time.
[0353] In some embodiments, the probe signal may be multicast or broadcast from the AP to more than one sensing transponder in the SBP. The AP may be a sensing initiator or a sensing transmitter (e.g., in a sensing session, or in an SBP). It may send a probe signal (e.g., NDP) to each of the multiple sensing transponders separately (i.e., point-to-point probe). Alternatively, it may send a probe signal (e.g., NDP) to more than one sensing transponder using multicast or broadcast, so that sensing measurement results may be generated simultaneously or concurrently in more than one sensing transponder. The sensing measurement results may be optionally (i.e., may / may not) be reported to the AP. In the case of an SBP, the AP may optionally (i.e., may / may not) report the sensing measurement results to the SBP initiator.
[0354] In some embodiments, the present teachings disclose systems and methods for ad hoc network sensing, peer-to-peer mode sensing, and non-infrastructure mode (NIM) sensing, such as wireless sensing in wireless ad hoc networks or decentralized wireless networks (e.g., using WiFi, Bluetooth, or other devices in non-infrastructure mode or ad-hoc mode, WiFi Direct, mobile ad hoc networks (MANETs), vehicular ad hoc networks (VANETs), SPANs, wireless mesh networks). In some embodiments, ad hoc networks do not rely on pre-existing infrastructure (e.g., there are no access points / APs in ad hoc networks), which makes them suitable for applications where central nodes cannot be relied upon. Ad hoc networks often require minimal configuration and can be deployed quickly, making them suitable for emergency situations, natural disasters, temporary / special events, or for robotics.
[0355] The wireless sensing process can be used in infrastructure mode (non-ad hoc network), where an access point (AP) establishes / organizes / manages a wireless network. A STA (AP STA or non-AP STA) can act as a sensing initiator to initiate a sensing process (infrastructure mode). One or more other STAs can act as sensing transponders by joining the sensing process. A STA can initiate multiple wireless sensing processes, each of which has a corresponding set of sensing transponders and corresponding settings of sensing parameters / settings. There may be multiple STAs, each of which initiates a corresponding sensing process.
[0356] The AP can be a sensing initiator or a sensing responder. Probing signals can be sent from a STA (sensing transmitter) to another STA (sensing receiver). They can be sent from an AP to a non-AP STA, or from a non-AP STA to an AP, or both, or neither. If the AP is a sensing initiator, trigger-based (TB) sensing can be used. The triggering of the transmission of a probing signal (e.g., a non-data packet (NDP), a variant type of NDP) can be achieved by the AP sending an NDP announcement frame (NDPA) or a trigger frame variant (TF). Within a short period of time after the trigger (e.g., interframe space (IFS), short IFS (SIFS), reduced IFS (RIFS), PCF IFS (PIFS), DCF IFS (DIFS), arbitrary IFS (AIFS), extended IFS (EIFS), etc.), the NDP can be sent from an AP (sensing initiator) to a non-AP STA (sensing responder), or from a non-AP STA to an AP, or both, or from a non-AP STA to another non-AP STA to generate a sensing result. If the non-AP STA is the sensing initiator, non-TB sensing can be used, where the non-AP STA sends an NDPA to the AP, followed by a pair of initiator-responder (I2R) NDP and responder-initiator (R2I) NDP. Any NDP can be used to generate sensing results in the sensing receiver. Reporting the sensing results to the sensing initiator is optional.
[0357] In some embodiments, the present teachings disclose non-infrastructure mode (NIM) wireless sensing based on a protocol (e.g., 802.11, 802.11bf) for a wireless ad hoc network that includes more than one peer wireless device or wireless station (STA) in non-infrastructure mode. Non-infrastructure mode wireless sensing (including frames, exchanges, timing, specifications, etc.) can be based on / based on a protocol or standard (e.g., 802.11, 802.11bf). Similar to infrastructure mode, a STA in non-infrastructure mode can act as a sensing initiator by initiating a non-infrastructure mode sensing process or sensing session (e.g., by sending a request to a neighboring station in the ad hoc network). The non-infrastructure mode sensing process can be similar to the infrastructure mode sensing process, except that the AP is replaced by the STA in the non-infrastructure mode. Similar to infrastructure mode, other STAs in non-infrastructure mode can act as sensing responders by joining the non-infrastructure mode sensing process (e.g., by responding to a request from a sensing initiator that intends to join). A STA in non-infrastructure mode can initiate more than one non-infrastructure mode sensing process or sensing session, each process / session has a corresponding set of sensing responders (which are STAs in non-infrastructure mode). In an ad hoc network, there can be multiple STAs in non-infrastructure mode acting as sensing initiators, each STA having its corresponding non-infrastructure mode sensing process or sensing session.
[0358] In the non-infrastructure mode sensing process, the sensing initiator can be a sensing transmitter, or a sensing receiver, or both, or neither. The sensing transponder can be a transmitter, a receiver, or both. A probe signal can be sent from a sensing transmitter to a sensing receiver. If bidirectional sensing is supported, a probe signal can also be sent in the reverse direction. The probe signal can be sent from a sensing initiator to a sensing transponder, or from a sensing transponder to a sensing initiator, or both, or from a first sensing transponder to a second transponder.
[0359] Sensing based on non-infrastructure mode trigger (TB) can be performed, similar to TB sensing in infrastructure mode, except that the AP in infrastructure mode is replaced by the sensing initiator in non-infrastructure mode. The triggering of the transmission of the probe signal (e.g., NDP, NDP variant) can be achieved by the sensing initiator sending an NDPA, or a frame similar to an NDPA, or a TF, or a frame similar to a TF. Within a short time after the trigger (e.g., IFS, SIFS, RIFS, PIFS, DIFS, AIFS, EIFS, etc.), the NDP can be sent from the sensing initiator to the sensing responder, or from the sensing responder to the sensing initiator, or both, or from the first sensing responder to the second sensing responder to generate a sensing result (in the sensing receiver).
[0360] Similar to non-TB sensing in infrastructure mode, non-infrastructure mode non-TB sensing may be performed where a sensing initiator may send an NDPA to a sensing responder, followed by a pair of initiator-responder (I2R) NDP and responder-initiator (R2I) NDP. In non-infrastructure mode non-TB sensing, a sensing responder may send an NDPA to a sensing initiator, followed by a pair of initiator-responder (I2R) NDP and responder-initiator (R2I) NDP.
[0361] Any NDP may be used to generate sensing results in the sensing receiver. Reporting sensing results to the sensing initiator is optional.
[0362] In some embodiments, for non-infrastructure mode (e.g., during the polling phase in TB sensing), a frame similar to a trigger frame variant (TF) (public or protected) may be defined in a protocol or standard (e.g., 802.11, 802.11bf) that allows a STA in non-infrastructure (e.g., sensing initiator) mode to solicit NDP transmissions from other STAs in non-infrastructure mode to obtain sensing measurements. If a STA in non-infrastructure mode is available, it may respond with a CTS-to-self.
[0363] In some embodiments, a TF in a protocol or standard may be defined / refined / modified / changed to allow a STA in non-infrastructure mode to request NDP transmissions from other STAs in non-infrastructure mode to obtain sensing measurements. When a TF is sent by an AP (in infrastructure mode), the TF will allow the AP to solicit NDP transmissions from STAs to obtain sensing measurements. When a TF is sent by a STA in non-infrastructure mode, the TF will allow the STA to solicit NDP transmissions from other STAs in non-infrastructure mode to obtain sensing measurements.
[0364] The non-infrastructure mode NDPA sounding phase may consist of: a STA in non-infrastructure mode (e.g., a sensing initiator or a sensing responder) transmitting an NDPA or a frame similar to an NDPA; and after the NDPA transmission, the STA in non-infrastructure mode transmits an NDP (e.g., a sensing initiator, or a sensing responder, or a sensing transmitter) within a short duration (e.g., IFS, SIFS, RIFS, PIFS, DIFS, AIFS, EIFS, etc.). For example, NDPA sounding may be used by high efficiency (HE), extremely high throughput (EHT), or pre-HE STAs in 802.11.
[0365] The non-infrastructure mode TF probing phase may consist of: transmission of TF or TF-like frames by a STA in non-infrastructure mode (e.g., a sensing initiator or a sensing responder) to solicit NDP transmissions from other STAs; and transmission of NDP by other STAs (e.g., from another STA to the STA, or from the STA to another STA, or from another STA to another STA) within a short duration (e.g., IFS, SIFS, RIFS, PIFS, DIFS, AIFS, EIFS, etc.) after receiving the TF or TF-like frames.
[0366] A non-infrastructure mode non-TB sensing measurement instance may be performed as follows: When a STA in non-infrastructure mode (e.g., sensing transmitter, sensing initiator, sensing transponder) obtains a transmit opportunity (TXOP), it initiates a non-infrastructure mode non-TB sensing measurement instance by sending an NDPA to a sensing receiver, followed by a pair of I2R NDPs (from sensing initiator to sensing transponder) and R2I NDPs (from sensing transponder to sensing initiator). If the sensing initiator is only a sensing transmitter, the NDPA frame shall configure the R2I NDP to be sent with one LTF symbol in the smallest possible length. If the sensing transponder is only a sensing transmitter, the NDPA frame shall configure the I2R NDP to be sent with one LTF symbol in the smallest possible length.
[0367] The proxy sensing (SBP) process is mainly used in infrastructure mode. In infrastructure mode SBP, a non-AP STA (which acts as an SBP initiator) sends an SBP request (using an SBP request frame, or "infrastructure mode SBP request frame") to an AP (which acts as an SBP responder), and the AP sends an SBP reply (using an SBP response frame) to accept the SBP request. The AP then performs a sensing process with multiple sensing responders (where the SP acts as a sensing initiator) and optionally reports sensing measurement results (such as CSI).
[0368] In some embodiments, for infrastructure mode SBP, the SBP responder (and sensing initiator) in infrastructure mode may perform an existing sensing process before receiving an SBP request from the SBP initiator. The sensing process may or may not be associated with another SBP process initiated by another SBP initiator. The existing sensing process includes multiple existing sensing responders and may be associated with a set of sensing measurement settings / parameters.
[0369] In one case, the sensing measurement settings / parameters of the existing sensing process may be acceptable to the SBP initiator (for the requested SBP). The SBP responder may simply associate the existing sensing process with the requested SBP and send / share the sensing measurements from the existing sensing process to the SBP initiator.
[0370] In another case, the sensing measurement settings / parameters of the existing sensing process may be unacceptable to the SBP initiator (for the requested SBP). The SBP responder / sensing initiator may work with the sensing responder to adjust / modify one or more sensing measurement settings / parameters of the existing sensing process so that the adjusted / modified sensing process with the adjusted / modified sensing measurement settings / parameters is acceptable to the SBP initiator. The SBP responder may then associate the existing sensing process with the requested SBP and send / share the sensing measurements from the existing sensing process to the SBP initiator.
[0371] For example, one of the following settings / parameters of the existing sensing process can be adjusted / modified: probing frequency / timing (e.g., 0.1 / 1 / 10 / 100 / 1000 / 10000 Hz), carrier frequency (e.g., number of channels, 2.4 GHz, 5 GHz, 6 GHz, etc.), bandwidth (e.g., 20 / 40 / 80 / 160 / 320 / 640 MHz or partial / shared bandwidth), unicast / multicast / broadcast, sensing transmitter / receiver settings, triggering amount of antennas (e.g., TB sensing, NDPA / TF usage, non-TB sensing), optional reporting of sensing measurements, type of sensing measurements reported, and set of sensing transponders.
[0372] In another case, the sensing measurement settings / parameters of the existing sensing process may be partially acceptable to the SBP initiator (for the requested SBP). It may become acceptable if it is enhanced by another sensing process. For example, the SBP initiator may request a probing frequency of 100 Hz, but the existing sensing process has a probing frequency of 50 Hz. The SBP responder may initiate a supplementary / auxiliary sensing process with a probing frequency of 50 Hz, and time the probing of the supplementary / auxiliary sensing process so that the two sensing processes together can produce a probing frequency of 100 Hz as requested by the SBP initiator.
[0373] In another example, the SBP initiator may request a probing frequency of 100 Hz, but the existing sensing process has a probing frequency of 25 Hz (uniform timing / sampling). The SBP responder may initiate a complementary / auxiliary sensing process with a probing frequency of 75 Hz (non-uniform timing / sampling), and time the probing of the complementary / auxiliary sensing process so that the two sensing processes together may produce a probing frequency of 100 Hz (uniform probing / sampling) as requested by the SBP initiator. For example, the SBP responder may obtain one sensing measurement from the existing sensing process, then obtain the next three sensing measurements from the auxiliary sensing process, then obtain another sensing measurement from the existing sensing process, then obtain another three sensing measurements from the auxiliary sensing process, and so on.
[0374] In another example, the SBP initiator may request a bandwidth of 80 MHz, but the existing sensing process has a bandwidth of 40 MHz. The SBP responder may initiate a supplementary / auxiliary sensing process with a bandwidth of 40 MHz, and the two sensing processes together may produce a bandwidth of 80 MHz as requested by the SBP initiator.
[0375] In the SBP request frame, there may be a field (e.g., a bit or a bit pattern) to indicate whether more than one sensing process (for one / some / any / all sensing transponders) may be used in the SBP process. Alternatively, there may be a field (e.g., a bit) to indicate whether a "mix and match" of sensing processes is acceptable in the SBP process.
[0376] In some embodiments, the SBP request frame or related frame may include a specification / description / list of permissible sensing transponders (or permissible / preferred sensing transponders). The SBP initiator may limit the SBP process performed / to be initiated by the SBP responder / sensing initiator so that the SBP responder / sensing initiator may only allow permissible sensing transponders to join the sensing process (or, the SBP initiator may only want / prefer to receive sensing measurement results from permissible sensing transponders, and the SBP responder may only provide sensing measurement results from permissible sensing transponders to the SBP initiator). Other sensing transponders that are not in the permissible sensing transponder list are "not permissible" and may not be allowed to join the sensing process. To specify the permissible sensing transponders, the SBP initiator may provide a unique identifier (ID) (e.g., any one of a user ID (UID), an association (AID), a universally unique ID (UUTD), a globally unique ID (GUTD), a MAC address or an Internet Protocol (IP) address, an internal ID in the system, etc.) for each permissible sensing transponder in the SBP request frame or a related frame.
[0377] In some embodiments, the SBP initiator may send an SBP update frame to the SBP responder to update / change / modify at least one setting / parameter of the SBP process at any time during the sensing process of the SBP process. For example, the SBP initiator may request the SBP responder / sensing initiator (e.g., using an SBP update frame) to terminate / stop a specific sensing responder (e.g., because the sensing measurement / TSCI associated with the specific sensing responder may be too noisy, problematic, unstable, faulty, unreliable, etc., and may waste valuable network resources, such as TXOPs, data bandwidth, memory, computing power, and / or processing / transmission energy), or at least stop sending the sensing measurement / TSCI associated with the specific sensing responder. The SBP initiator may request the SBP responder / sensing initiator to pause, or resume, or add a specific sensing responder. The SBP may provide a unique identifier for a specific sensing responder.
[0378] In some embodiments, a non-infrastructure mode (NIM) SBP process similar to the infrastructure mode SBP is defined, except that the AP in the infrastructure mode SBP is replaced by the STA in the non-infrastructure mode. A frame similar to the SBP request frame (public or protected) is defined in a protocol or standard (e.g., 802.11, 802.11bf) that allows a STA in the non-infrastructure mode (which acts as an SBP initiator or NIM SBP initiator) to use the frame to send a NIM SBP request to another STA in the non-infrastructure mode (which acts as an SBP responder or NIM SBP responder, like the AP in the infrastructure mode SBP), which sends a NIM SBP response (e.g., an SBP response frame or similar frame) to accept the SBP request. The SBP request frame may have a bit / field to indicate / specify whether the SBP responder can be a sensing transmitter, or a sensing receiver, or both, or neither in the NIM sensing process initiated by it. Then, another STA (both SBP responder and sensing initiator) can perform / initiate NIM sensing process with multiple sensing responders (STAs in non-infrastructure mode). The measurement results obtained in the non-infrastructure mode sensing process can be optionally reported to the sensing initiator by the sensing responder, and reported to the SBP initiator by the SBP responder (sensing initiator). Another STA (i.e., SBP responder and sensing initiator) can allocate a measurement setting ID in its SBP response.
[0379] In some embodiments, an infrastructure mode (IM) SBP request frame may be defined / refined / modified / changed to allow a STA in non-infrastructure mode (SBP initiator) to send a non-infrastructure mode SBP request to another STA in non-infrastructure mode.
[0380] The NIM SBP reply sent by another STA in non-infrastructure mode may be a frame similar to the IM SBP response frame, or may be the IM SBP response frame itself, which may be defined / modified in a protocol or standard to allow another STA in non-infrastructure mode to accept or reject the NIM SBP request.
[0381] In some embodiments, the SBP initiator may specify / describe / list / provide a plurality of permissible sensing transponders. The SBP initiator may limit the NIM SBP process, or the NIM sensing process executed / to be initiated by the SBP responder / sensing initiator, so that the SBP responder / sensing initiator may only allow a plurality of permissible sensing transponders to join the NIM sensing process (or, the SBP initiator may only want / prefer to receive sensing measurement results from permissible sensing transponders, and the SBP responder may only provide sensing measurement results from permissible sensing transponders to the SBP initiator). Other sensing transponders not in the permissible sensing transponder list are "not permissible" and may not be allowed to join the NIM sensing process. In order to specify the number of permissible sensing transponders, the SBP initiator may provide a unique identifier (ID) for each permissible sensing transponder (e.g., any one of a user ID (UID), an association (AID), a universally unique ID (UUID), a globally unique ID (GUID), a MAC address or an Internet Protocol (IP) address, an internal ID in the system, etc.).
[0382] In some embodiments, the SBP initiator may send a NIM SBP update frame to the SBP responder to update / change / modify at least one setting / parameter of the NIM SBP process at any time during the NIM sensing process of the NIM SBP process. For example, the SBP initiator may request the SBP responder / sensing initiator (e.g., using a NIM SBP update frame) to terminate / stop a specific sensing responder (e.g., possibly because the sensing measurements / TSCI associated with the specific sensing responder may be too noisy, problematic, unstable, faulty, unreliable, etc., and may waste valuable network resources, such as TXOPs, data bandwidth, memory, computing power, and / or processing / transmitting energy), or at least stop sending the sensing measurements / TSCI associated with the specific sensing responder. The SBP initiator may request the SBP responder / sensing initiator to pause, or resume, or add a specific sensing responder. The SBP may provide a unique identifier for a specific sensing responder.
[0383] In infrastructure mode, the sensing process initiated by the AP STA may be enhanced to optionally allow sensing transponder NDP measurements.
[0384] In some embodiments, the non-infrastructure mode sensing process initiated by a STA in non-infrastructure mode can be enhanced to optionally allow sensing transponder sensing transponder NDP measurements. A first sensing transponder and a second sensing transponder of a STA both in non-infrastructure mode can be configured to send an NDP from the first transponder to the second transponder, or from the second transponder to the first transponder, or both.
[0385] In some embodiments, a STA in a non-infrastructure mode in an ad hoc network acts as a sensing initiator to initiate a non-infrastructure mode sensing process based on a protocol (e.g., 802.11, 802.11bf). At least one other STA in the ad hoc network joins the sensing process as a sensing responder based on a protocol in a non-infrastructure mode. The sensing initiator and the sensing responder negotiate to set up a sensing process / session and related sensing measurement parameters.
[0386] In some embodiments, one device is configured as a sensing transmitter (Type 1 device). The other device is configured as a sensing receiver (Type 2 device). A wireless sounding signal (e.g., NDP, time sequence of NDPs) is sent from the sensing transmitter to the sensing receiver to generate a sensing measurement (e.g., TSCI) in the sensing receiver. Depending on which device is the sensing transmitter, the NDP can be I2R or R2I.
[0387] The sensing measurements may be made locally available to an application (e.g., software, firmware) in a sensing receiver. The sensing measurements may optionally be wirelessly sent from a sensing transponder to a sensing initiator (e.g., using a protocol-based sensing measurement report frame) and made available to an application (e.g., software, firmware) in the sensing initiator, or wirelessly sent from a sensing receiver to a sensing transmitter.
[0388] In some embodiments, in a mesh network, there may be more than one wireless mesh router, for example, for some k (e.g., k may be 3, 4, 6, or 10 or 100), R1, R2, R3, ..., R_k. Some mesh routers may be dual-band, tri-band, or quad-band devices. Some reverse channels may allow mesh routers to send / receive / forward / transmit / exchange digital data to / from the Internet / broadband service (e.g., via some broadband routers / service providers). Mesh routers may be interconnected via non-infrastructure mode. Individual wireless client devices (e.g., loT devices) may be connected to any one of more than one mesh routers (e.g., in infrastructure mode or in non-infrastructure mode). Wireless client devices and / or mesh routers may form a wireless sensing network, some of which are wireless transmitters (e.g., sensing transmitters) and some of which are wireless receivers (e.g., sensing receivers). Some (e.g., sensing initiators) may initiate a wireless sensing process / session. Some may respond to join a wireless sensing process / session.
[0389] In some embodiments, while each mesh router is available for client device association, most or all client devices are "encouraged" or "moved" or "reassociated" or "reconnected" or "centralized" to one (or very few) mesh routers if possible. The sensing network can have better site coverage for all client devices associated with the same mesh router, and / or the sensing network functions / logic / algorithms can function better. For example, the system can centralize all client devices to one or more specific mesh routers (e.g., R1). But for larger places, more than one mesh router may be needed to cover the entire place. In this case, two or more mesh routers can be identified as specific mesh routers.
[0390] In some embodiments, some signaling (protocol, control data / frame exchange) may be performed to suggest / prompt / request / ask / instruct client devices to disassociate from their current mesh router and associate with a specific mesh router (or one of a few specific mesh routers). Each specific mesh router may be identified (e.g., SSID, name, MAC address, etc.).
[0391] Fig. 20 A plurality of STAs in non-infrastructure mode forming an ad hoc network are shown. There is no access point (AP) in the ad hoc network. Figure 21-25 Various use cases for non-infrastructure mode sensing are shown.
[0392] Fig.21Use case 1 is shown, where the sensing initiator is a sensing transmitter. First, the STA starts a sensing session (as a sensing initiator). Some STAs join the sensing session (as sensing responders). Some STAs are not in the sensing session. The sensing initiator is a sensing transmitter (Tx). In some embodiments, NDPA (I2R) and NDP (I2R) can be used to perform TB-type sensing. In some ...
Claims
1. A standardized proxy sensing method, include: In a wireless data communication network, based on a standard wireless network protocol, a proxy initiator device wirelessly sends a proxy sensing request message to a proxy responder device to request the proxy responder device to act as a proxy of the proxy initiator device and perform wireless sensing on its behalf, wherein: The proxy responder device is requested by the proxy initiator device to perform the wireless sensing in the following manner: acting as a sensing initiator device to initiate at least one sensing session with at least one sensing responder device based on the standard wireless network protocol; The wireless data communication network includes a physical (PHY) layer, a medium access control (MAC) layer, and at least one higher layer; In response to the proxy sensing request message from the proxy initiator device, the proxy responder device wirelessly sends at least one wireless sensing measurement setup request message to the at least one sensing responder device based on the standard wireless network protocol; and In response to the proxy sensing request message or the at least one wireless sensing measurement setting request message: The transmitter sends at least one time sequence of wireless sounding signals (WSS) based on the standard wireless network protocol, receiving, by a receiver, a time series of at least one WSS (TSWSS) based on the standard wireless network protocol, wherein each of the transmitter and the receiver is one of the at least one sensing transponder device or the proxy transponder device, and performing, by the receiver, a plurality of wireless sensing measurements based on the received TSWSS to obtain sensing measurement results based on the standard wireless network protocol, wherein the PHY layer or the MAC layer of the receiver locally provides the sensing measurement results to the at least one higher layer of the receiver based on the standard wireless network protocol according to the proxy sensing request message, Wherein the sensing measurements are available to the at least one higher layer of the receiver to perform a sensing-based task based on the sensing measurements.
2. The standardized proxy sensing method according to claim 1, in: The standard wireless network protocol is at least one of the following: a wireless LAN (WLAN) standard protocol, a mobile communication standard protocol, a WLAN standard, a Wi-Fi standard, an IEEE 802 standard, an IEEE 802.11 standard, or an IEEE 802.11bf standard; The sensing measurement result includes a time series of channel information (CI) of the wireless channel; Each CI of a time series of CIs (TSCI) is obtained by a receiver based on a corresponding WSS; and Each CI includes at least one of: channel state information (CSI), channel impulse response (CIR), or channel frequency response (CFR).
3. The standardized proxy sensing method according to claim 1, further comprising: include: In response to the proxy sensing request message, constructing, by the proxy responder device, at least one configuration frame based on the proxy sensing request message, wherein each wireless sensing measurement setup request message includes a corresponding configuration frame, and wherein a first configuration field of the at least one configuration frame is constructed based on a second configuration field of the proxy sensing request message; receiving, by the at least one sensing transponder device, a corresponding configuration frame of a corresponding wireless sensing measurement setup request message; determining, by the receiver, whether the first configuration field or the second configuration field of the corresponding received configuration frame has a first bit pattern or a second bit pattern; as well as The first configuration field is constructed by the proxy responder device based on a reproduction of the second configuration field.
4. The standardized proxy sensing method according to claim 3, in: When the first configuration field or the second configuration field has the first bit pattern, the sensing measurement result is configured to be reported locally to the at least one higher layer of the receiver and not to any device other than the receiver according to the standard wireless network protocol; when the first configuration field or the second configuration field has the second bit pattern, the sensing measurements are configured to be simultaneously reported locally to the at least one higher layer of the receiver and non-locally to the proxy initiator device via the proxy responder device in accordance with the standard wireless network protocol; as well as The configuration frame is a part of a corresponding wireless sensing measurement setup request message sent before a corresponding plurality of wireless sensing measurements.
5. The standardized proxy sensing method according to claim 1, in: Based on configuring the receiver according to the standard wireless network protocol using a wireless sensing measurement setup request message sent during a setup process, the sensing measurement results obtained by the receiver are indirectly configured by the proxy initiator device via the proxy responder device to be reported locally in the receiver, reported non-locally to the proxy initiator device via the proxy responder device, reported locally and non-locally, or not reported; as well as During the setup process, the receiver is indirectly configured by the proxy enabler device via the proxy responder device based on the standard wireless network protocol to report the sensing measurement results locally in the receiver, report the sensing measurement results non-locally to the proxy enabler device via the proxy responder device, report both locally and non-locally, or not report.
6. The standardized proxy sensing method according to claim 1, in: sending a wireless sensing measurement setup request message in a negotiation process between the sensing initiator device and each sensing transponder device based on the standard wireless network protocol; Based on the standard wireless network protocol, the proxy initiator device indirectly and individually configures each of the transmitter and the receiver via the proxy responder device based on the proxy sensing request message and the corresponding wireless sensing measurement setting request message to cooperatively perform the plurality of wireless sensing measurements; The transmitter is configured to act as a sensing transmitter device to transmit the TSWSS to the receiver; at least one configuration associated with the TSWSS is related to the sensing-based task; The receiver is configured to act as a sensing receiver device to receive the TSWSS from the transmitter and obtain the sensing measurement result based on the received TSWSS; the receiver being configured whether to report the sensory measurements locally to the at least one higher layer of the receiver, or non-locally to the proxy initiator device via the proxy responder device, or both locally and non-locally; as well as At least one of the transmitter or the receiver is a sensing transponder device.
7. The standardized proxy sensing method according to claim 6, further comprising at least one of the following: performing, by the receiver, first processing of the sensed measurements to locally report the sensed measurements, the first processing comprising a first reduction in precision; or A second processing of the sensed measurements is performed by the receiver to non-locally report the sensed measurements, the second processing comprising a second reduction in precision.
8. The standardized proxy sensing method according to claim 7, in: When the sensing measurement result is reported non-locally, the sensing measurement result is wirelessly sent by the receiver to the proxy responder device based on the standard wireless network protocol, and then sent by the proxy responder device to the proxy initiator device, wherein the non-locally reported sensing measurement result is non-locally available at the proxy initiator device for a second sensing-based task, and wherein the non-locally reported sensing measurement result is available at the proxy initiator device for central computation of the second sensing-based task; as well as When the sensing measurements are reported locally, the sensing measurements are made locally available at the at least one higher layer of the receiver for the sensing-based task at the receiver, wherein the locally reported sensing measurements can be used for distributed computation of the sensing-based task at the receiver.
9. The standardized proxy sensing method according to claim 1, in: first sensing measurements are reported locally and non-locally by the receiver; as well as The second sensing measurement is not reported locally or non-locally by the receiver.
10. The standardized proxy sensing method according to claim 1, in: The proxy responder device is an access point (AP) device of the wireless data communication network; The proxy initiator device is a non-AP device of the wireless data communication network; The transmitter is a client device of the wireless data communication network and acts as a sensing transponder device; The receiver is the AP; The sensing measurement results include a time series of channel information (CI), wherein each CI includes at least one of the following: channel state information (CSI), channel impulse response (CIR), or channel frequency response (CFR); the receiver locally reporting the sensing measurements, Locally reported sensing measurements are available at the AP for the sensing-based tasks; The wireless sensing measurements are trigger-based (TB) based on the standard wireless network protocol using Null Data Packet (NDP) frames and Trigger Frames (TFs).
11. The standardized proxy sensing method according to claim 1, in: There is at least one additional transmitter in the premises, each individually configured by the proxy initiator device to function as a sensing transmitter device indirectly via the proxy responder device based on the standard wireless network protocol; Each respective additional transmitter is configured to transmit a respective TSWSS to the receiver based on the standard wireless network protocol; as well as The receiver is configured as follows: receiving the corresponding TSWSS from the corresponding additional transmitter via the wireless channel based on the standard wireless network protocol, obtaining corresponding sensing measurements based on the corresponding received TSWSS, and The respective sensing measurements are reported locally to the at least one higher layer of the receiver, wherein a plurality of locally reported sensing measurements may be used to perform the sensing based task in a centralized manner.
12. The standardized proxy sensing method according to claim 1, in: The proxy responder device is an access point (AP) device of the wireless data communication network; The proxy initiator device is a non-AP device of the wireless data communication network; The transmitter is the AP; The receiver is a client device of the wireless data communication network; The sensing measurement results include a time series of channel information (CI), wherein each CI includes at least one of the following: channel state information (CSI), channel impulse response (CIR), or channel frequency response (CFR); the receiver locally reporting the sensing measurements to the at least one higher layer of the receiver, locally reported sensing measurements are available at the client device to the sensing-based task; The TSWSS propagates from the transmitter to the receiver; as well as The wireless sensing measurements are trigger-based (TB) based on the standard wireless network protocol using Null Data Packet (NDP) frames and Trigger Frames (TFs).
13. The standardized proxy sensing method according to claim 1, in: There is at least one additional receiver in the premises, each individually configured by the proxy enabler device to function as a sensing receiver device indirectly via the proxy responder device based on the standard wireless network protocol; The transmitter is configured to transmit a corresponding TSWSS to each corresponding additional receiver based on the standard wireless network protocol; as well as Each corresponding additional receiver is configured as: receiving the corresponding TSWSS through the corresponding wireless channel based on the standard wireless network protocol, obtaining corresponding sensing measurements based on the corresponding received TSWSS, and The respective sensing measurement results are locally reported to the at least one higher layer of the respective additional receiver, wherein the respective locally reported sensing measurement results are locally available to perform the sensing-based task in the respective additional receiver in a decentralized manner based on the respective locally reported sensing measurement results.
14. The standardized proxy sensing method according to claim 1, in: The proxy responder device is an access point (AP) device of the wireless data communication network; The proxy initiator device is a non-AP device of the wireless data communication network; The transmitter is a second non-AP device; The receiver is a third non-AP device; The receiver locally reports the sensing measurements; as well as The locally reported sensing measurements are available at the third non-AP for the sensing-based task.
15. A standardized agent sensing method, include: In a wireless data communication network, configuring a proxy initiator device to use standardized proxy wireless sensing to indirectly cause a receiver in the wireless data communication network to perform wireless sensing measurements to (a) obtain sensing measurement results based on wireless probe signals received from transmitters in the wireless data communication network, and (b) report the sensing measurement results locally based on a standard wireless network protocol; In the wireless data communication network, the proxy initiator device is configured to wirelessly send a proxy sensing request message to the proxy responder device based on the standard wireless network protocol to request the proxy responder device to act as a proxy of the proxy initiator device and perform wireless sensing on its behalf, wherein: The proxy responder device is requested by the proxy initiator device to perform the wireless sensing in the following manner: acting as a sensing initiator device to initiate at least one sensing session with at least one sensing responder device based on the standard wireless network protocol, The wireless data communication network includes a physical (PHY) layer, a medium access control (MAC) layer, and at least one higher layer, In response to the proxy sensing request message from the proxy initiator device, the proxy responder device wirelessly sends at least one wireless sensing measurement setting request message to the at least one sensing responder device based on the standard wireless network protocol, In response to the proxy sensing request message or the at least one wireless sensing measurement setting request message: sending, by the transmitter, a time sequence of at least one wireless sounding signal (WSS) based on the standard wireless network protocol, receiving, by the receiver, a time series of at least one WSS (TSWSS) based on the standard wireless network protocol, and The receiver performs a plurality of wireless sensing measurements based on the received TSWSS to obtain sensing measurement results based on the standard wireless network protocol, Each of the transmitter and the receiver is one of the at least one sensing transponder device or the proxy transponder device, and The PHY layer or the MAC layer of the receiver locally provides the sensing measurement results to the at least one higher layer of the receiver based on the standard wireless network protocol according to the proxy sensing request message; as well as The processor of the receiver is configured to obtain the sensing measurements from the PHY layer or the MAC layer of the receiver at the at least one higher layer of the receiver and to perform sensing-based tasks based on the sensing measurements.
Citation Information
Cited By
Unmanned aerial vehicle tracking method, system and equipment
CN120044513A
Unmanned Aerial Vehicle (UAV) Tracking Methods, Systems, and Equipment
CN120044513B
