RF sensing based on pseudo single station sensing mode

Abstract

A computer-implemented method for multi-device sensing at a first device in a wireless network includes determining, by the first device, whether the first device is operating in a mode in which the first device and a second device cooperate to simultaneously transmit and receive radio frequency (RF) signals and the first device is within a distance of the second device; exchanging, by the first device, the RF signal with the second device; obtaining signal information from the exchanged RF signal by communicating with the second device; and performing sensing based on the signal information.

Description

Technical Field

[0001] This disclosure generally relates to radio frequency (RF) sensing, and more specifically to RF sensing, such as, but not limited to, pseudo-single-station sensing modes. Background Technology

[0002] Since the late 1990s, Wireless Local Area Network (WLAN) technology has evolved towards increasing data rates and continues to grow in various markets, such as homes, businesses, and hotspot areas. WLAN allows devices to access the Internet in the 2.4 GHz, 5 GHz, 6 GHz, or 60 GHz frequency bands. WLAN is based on the Institute of Electrical and Electronics Engineers (IEEE) 802.11 standard. The IEEE 802.11 standard family is designed to improve speed and reliability and extend the operational range of wireless networks.

[0003] WLAN devices increasingly need to support a variety of latency-sensitive or real-time applications, such as augmented reality (AR), robotics, artificial intelligence (AI), cloud computing, and autonomous vehicles. To achieve the extremely low latency and extremely high throughput required for such applications, Multi-Link Operation (MLO) has been proposed for WLANs. A WLAN is formed by WLAN devices within a limited area, such as a home, school, apartment, or office building. Each WLAN device can have one or more Stations (STAs), such as Access Point (AP) STAs and Non-Access Point (Non-AP) STAs.

[0004] RF sensing plays a vital role in today's consumer electronics. Compared to other electromagnetic sensors (such as cameras, infrared sensors, and LiDAR), RF sensors offer advantages such as better user privacy and lower cost.

[0005] The descriptions set forth in the Background section should not be assumed to be prior art simply because they are set forth therein. The Background section may describe aspects or embodiments of this disclosure. Summary of the Invention

[0006] Solution to the problem One aspect of this disclosure provides a computer-implemented method for performing multi-device sensing at a first device in a wireless network. The method includes determining whether the first device is operating in a mode in which the first device and a second device cooperate to simultaneously transmit and receive radio frequency (RF) signals and the first device is within distance of the second device. The method includes exchanging RF signals between the first device and the second device. The method includes obtaining signal information from the exchanged RF signals through communication with the second device. The method includes performing sensing based on the signal information.

[0007] In some embodiments, the performing sensing includes: detecting a person’s movement and breathing rate from signal information, and estimating a sleep state based on the detected movement and breathing rate.

[0008] In some embodiments, the performing sensing includes: detecting movement of a person indicating exercise from signal information, extracting Doppler patterns from the signal information to estimate exercise information during the time period in which the person is identified as exercising, and outputting exercise information, including calories burned and the number of repetitions of the exercise.

[0009] In some embodiments, the determination includes: establishing a wireless link between the first device and the second device; measuring the signal strength of an RF signal transmitted by the second device; comparing the signal strength with a threshold; and determining that the first device operates in the mode based on the signal strength being greater than the threshold.

[0010] In some embodiments, the determination includes: establishing a wireless link between the first device and the second device; determining the round-trip time (RTT) value of the RF signal transmitted by the first device; comparing the RTT with a threshold; and determining that the first device operates in the mode based on the RTT being less than the threshold.

[0011] In some embodiments, the determination includes: determining the energy of an audio signal transmitted by the second device; comparing the energy of the audio signal with a threshold; and determining that the first device operates in the mode based on the energy of the audio signal being greater than the threshold.

[0012] In some embodiments, the determination includes: determining that the second device is being charged by the first device, and determining that the first device is operating in the mode based on the fact that the second device is being charged by the first device.

[0013] In some embodiments, the determination includes: determining whether the first device and the second device are being charged by the charging device, and determining that the first device is operating in the mode based on whether the first device and the second device are being charged by the charging device.

[0014] In some embodiments, the method further includes converting the RF signal between the first device and the second device into a channel impulse response (CIR), determining a person within a threshold distance based on the CIR, and displaying information related to the battery level of the first device based on the person being within the threshold distance.

[0015] In some embodiments, the method further includes: using a camera on the first device, using a facial recognition process to determine the identity of a person, and displaying information based on the person's identity.

[0016] One aspect of this disclosure provides a computer-readable storage medium storing one or more instructions, wherein the one or more instructions, when executed individually or jointly by at least one processor, cause the at least one processor to perform any combination of the methods described herein.

[0017] One aspect of this disclosure provides a first device in a wireless network. The first device includes a memory and at least one processor. The memory includes one or more storage media storing instructions. The at least one processor includes processing circuitry and is coupled to the memory. The one or more instructions, when executed individually or jointly by the at least one processor, cause the first device to determine whether it is operating in a mode in which the first device and a second device cooperate to simultaneously transmit and receive radio frequency (RF) signals and the first device is within range of the second device. The one or more instructions, when executed individually or jointly by the at least one processor, cause the first device to exchange RF signals with the second device. The one or more instructions, when executed individually or jointly by the at least one processor, cause the first device to obtain signal information from the exchanged RF signals by communicating with the second device. The one or more instructions, when executed individually or jointly by the at least one processor, cause the first device to perform sensing based on the signal information.

[0018] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also performs sensing by detecting human movement and breathing rate from signal information, and estimating sleep state based on the detected human movement and breathing rate.

[0019] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also performs sensing by: detecting movement of a person indicating exercise from signal information, extracting Doppler patterns from the signal information to estimate exercise information during the time period in which the person is identified as exercising, and outputting exercise information including calories burned and the number of repetitions of exercise.

[0020] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also causes the first device to determine whether it is operating in the mode by: establishing a wireless link between the first device and the second device, measuring the signal strength of an RF signal transmitted by the second device, comparing the signal strength with a threshold, and determining that the first device is operating in the mode when the signal strength is greater than the threshold.

[0021] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also causes the first device to determine whether it is operating in the mode by: establishing a wireless link between the first device and the second device; determining a round-trip time (RTT) value of an RF signal transmitted by the first device; comparing the RTT with a threshold; and determining that the first device is operating in the mode when the RTT is less than the threshold.

[0022] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also causes the first device to determine whether it is operating in the mode by: determining the energy of an audio signal transmitted by the second device, comparing the energy of the audio signal with a threshold, and determining that the first device is operating in the mode when the energy of the audio signal is greater than the threshold.

[0023] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also causes the first device to determine whether it is operating in the mode by: determining that the second device is being charged by the first device, and determining that the first device is operating in the mode when the second device is being charged by the first device.

[0024] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also determines whether it is operating in the mode by: determining that the first device and the second device are being charged by the charging device; and determining that the first device is operating in the mode when the first device and the second device are being charged by the charging device.

[0025] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also causes the first device to: convert an RF signal between the first device and the second device into a channel impulse response (CIR); determine that a person is within a threshold distance based on the CIR; and when the person is within the threshold distance, display information associated with the battery level of the first device.

[0026] In some embodiments, when the one or more instructions are executed individually or jointly by the at least one processor, the first device also causes the first device to: use a camera on the first device to determine the identity of a person using a facial recognition process, and display information based on the identity of the person. Attached Figure Description

[0027] Figure 1 An example of a wireless network according to an embodiment is shown.

[0028] Figure 2AAn example of an AP according to an embodiment is shown.

[0029] Figure 2B An example of a STA according to an embodiment is shown.

[0030] Figure 3 A flowchart illustrating an example process for determining a sleep state using a pseudo-monostatic mode of an RF device, according to an embodiment, is shown.

[0031] Figure 4 A flowchart illustrating an example process for tracking exercise status using a pseudo-single-station mode of an RF device according to an embodiment is shown.

[0032] Figure 5 A flowchart illustrating an example process for performing proximity detection using a pseudo-single-station mode according to an embodiment is shown.

[0033] Figure 6 A system based on proximity detection and a camera for battery display application is shown according to an embodiment.

[0034] Figure 7 This illustrates the process of using a battery display based on Wi-Fi CSI proximity detection according to an embodiment.

[0035] Figure 8A , Figure 8B and Figure 8C The process of a battery display with proximity detection and face detection according to an embodiment is shown.

[0036] Figure 9A , Figure 9B and Figure 9C The process of displaying a battery with only proximity detection according to an embodiment is shown.

[0037] Figure 10 Proximity detection based on CIR statistical features according to an embodiment is shown.

[0038] Figure 11A , Figure 11B and Figure 11C A flowchart illustrating an example process for joint WiFi and camera motion detection with automatic gain control (AGC) compensation according to an embodiment is provided.

[0039] Figure 12 A flowchart illustrating an example process for determining a pseudo-single-station mode using RF signals according to an embodiment is shown.

[0040] Figure 13 A flowchart illustrating an example process for determining a pseudo-single-station mode using audio signals according to an embodiment is shown.

[0041] Figure 14A flowchart illustrating an example process for determining a pseudo-single-station mode using the charging state of a device is shown.

[0042] Figure 15 A flowchart illustrating an example process for determining a pseudo-single-station mode using the charging state of a charging pad according to an embodiment is shown.

[0043] Figure 16 A flowchart illustrating an example process for establishing signal exchange between two WiFi devices for sensing, according to an embodiment.

[0044] In one or more embodiments, not all components depicted in each figure may be required, and one or more embodiments may include additional components not shown in the figures. Variations in the arrangement and type of components may be made without departing from the scope of this subject matter disclosure. Within the scope of this subject matter disclosure, additional components, different components, or fewer components may be used. Detailed Implementation

[0045] The detailed description set forth below with reference to the accompanying drawings is intended to describe various embodiments and not to represent the only possible implementation of the subject matter. Rather, the detailed description includes specific details for the purpose of providing a thorough understanding of the subject matter of the invention. As those skilled in the art will recognize, the described embodiments can be modified in various ways without departing from the scope of this disclosure. Therefore, the drawings and description are to be considered illustrative rather than restrictive in nature. The same reference numerals denote the same elements.

[0046] The following description pertains to certain embodiments for the purpose of describing the innovative aspects of this disclosure. However, those skilled in the art will readily recognize that the teachings herein can be applied in many different ways. The examples in this disclosure are based on WLAN communication according to the Institute of Electrical and Electronics Engineers (IEEE) 802.11 standard (including the IEEE 802.11be standard and any future modifications to the IEEE 802.11 standard). However, the described embodiments can be implemented in any device, system, or network capable of transmitting and receiving radio frequency (RF) signals according to IEEE 802.11 standards, Bluetooth standards, Global System for Mobile Communications (GSM), GSM / General Packet Radio Service (GPRS), Enhanced Data GSM Environment (EDGE), Terrestrial Trunking Radio (TETRA), Wideband CDMA (W-CDMA), Evolved Data Optimized (EV-DO), 1xEV-DO, EV-DO Rev A, EV-DO Rev B, High-Speed ​​Packet Access (HSPA), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolved High-Speed ​​Packet Access (HSPA+), Long Term Evolution (LTE), 5G NR (New Radio), AMPS, or other known signals used for communication within wireless, cellular, or Internet of Things (IoT) networks, such as systems and technologies utilizing 3G, 4G, 5G, 6G, or further implementations thereof.

[0047] Depending on the network type, other known terms may be used instead of "access point" or "AP," such as "router" or "gateway." For convenience, the term "AP" is used in this disclosure to refer to a network infrastructure component that provides wireless access to remote terminals. In a WLAN, assuming that the AP also competes for a wireless channel, the AP may also be referred to as a STA. Furthermore, depending on the network type, other known terms may be used instead of "station" or "STA," such as "mobile station," "user station," "remote terminal," "user equipment," "wireless terminal," or "user device." For convenience, the terms "station" and "STA" are used in this disclosure to refer to a wireless access AP or a remote wireless device competing for a wireless channel in a WLAN, whether the STA is a mobile device (such as a mobile phone or smartphone) or is generally considered a stationary device (such as a desktop computer, AP, media player, stationary sensor, television, etc.).

[0048] Multilink Operation (MLO) is a key feature of next-generation Ultra High Throughput (EHT) Wi-Fi systems currently developed by the standards body for IEEE 802.11be. Wi-Fi devices that support MLO are called Multilink Devices (MLDs). Using MLO, a non-AP MLD can discover, authenticate, associate with an AP MLD, and establish multiple links with the AP MLD. Channel access and frame switching can occur on each link between the AP MLD and non-AP MLDs.

[0049] Figure 1 An example of a wireless network 100 according to an embodiment is shown. Figure 1 The illustrated embodiment of the wireless network 100 is for illustrative purposes only. Other embodiments of the wireless network 100 may be used without departing from the scope of this disclosure.

[0050] like Figure 1 As shown, the wireless network 100 may include multiple wireless communication devices. Each wireless communication device may include one or more stations (STAs). An STA may be a logical entity that is a separate addressable instance of an interface to the Media Access Control (MAC) layer and the Physical (PHY) layer of the wireless medium. STAs may be classified as Access Point (AP) STAs and Non-Access Point (Non-AP) STAs. An AP STA may be an entity that provides access to distributed system services to an associated STA via the wireless medium. A Non-AP STA may be a STA that is not included in an AP-STA. For simplicity, an AP STA may be referred to as an AP, and a Non-AP STA may be referred to as a STA. Figure 1 In the example, APs 101 and 103 are wireless communication devices, and each of APs 101 and 103 may include one or more AP STAs. In such an embodiment, APs 101 and 103 may be AP multilink devices (MLDs). Similarly, STAs 111-114 are wireless communication devices, and each of STAs 111-114 may include one or more non-AP STAs. In such an embodiment, STAs 111-114 may be non-AP MLDs.

[0051] APs 101 and 103 communicate with at least one network 130, such as the Internet, a proprietary Internet Protocol (IP) network, or other data network. AP 101 utilizes its coverage area 120 to provide wireless access to network 130 for multiple stations (STAs) 111-114. APs 101 and 103 can communicate with each other and with STAs using Wi-Fi or other WLAN communication technologies.

[0052] Depending on the network type, other known terms may be used instead of "access point" or "AP," such as "router" or "gateway." For convenience, the term "AP" is used in this disclosure to refer to a network infrastructure component that provides wireless access to remote terminals. In a WLAN, assuming that the AP also competes for a wireless channel, the AP may also be referred to as a STA. Furthermore, depending on the network type, other known terms may be used instead of "station" or "STA," such as "mobile station," "user station," "remote terminal," "user equipment," "wireless terminal," or "user device." For convenience, the terms "station" and "STA" are used in this disclosure to refer to a wireless access AP or a remote wireless device competing for a wireless channel in a WLAN, whether the STA is a mobile device (such as a mobile phone or smartphone) or is generally considered a stationary device (such as a desktop computer, AP, media player, stationary sensor, television, etc.).

[0053] exist Figure 1 In the diagram, the dashed lines indicate the approximate extent of the coverage areas 120 and 125 of APs 101 and 103. For illustrative and explanatory purposes, coverage areas 120 and 125 are shown as approximately circular. It should be clearly understood that, depending on the configuration of the APs, the coverage areas associated with the APs (such as coverage areas 120 and 125) may have other shapes, including irregular shapes.

[0054] As described in more detail below, one or more of the APs may include circuitry and / or programming for managing MU-MIMO and OFDMA channel sounding in the WLAN. Although Figure 1 An example of a wireless network 100 is shown, but it is possible to modify it. Figure 1 Various modifications can be made. For example, wireless network 100 can include any number of APs and any number of STAs in any suitable arrangement. Furthermore, AP 101 can communicate directly with any number of STAs and provide those STAs with wireless broadband access to network 130. Similarly, each AP 101 and 103 can communicate directly with network 130 and provide STAs with direct wireless broadband access to network 130. Additionally, AP 101 and / or 103 can provide access to other or additional external networks, such as external telephone networks or other types of data networks.

[0055] Figure 2A An example of AP 101 according to an embodiment is shown. Figure 2A The embodiment of AP 101 shown is for illustrative purposes, and Figure 1 AP 103 can have the same or similar configuration. However, APs have a wide variety of configurations, and Figure 2A This disclosure is not intended to limit the scope of any particular implementation of AP.

[0056] like Figure 2A As shown, AP 101 may include multiple antennas 204a-204n, multiple radio frequency (RF) transceivers 209a-209n, transmit (TX) processing circuitry 214, and receive (RX) processing circuitry 219. AP 101 may also include a controller / processor 224, a memory 229, and a backhaul or network interface 234. RF transceivers 209a-209n receive incoming RF signals (such as signals transmitted by STAs in network 100) from antennas 204a-204n. RF transceivers 209a-209n down-convert the incoming RF signals to generate intermediate (IF) or baseband signals. The IF or baseband signals are sent to RX processing circuitry 219, which generates a processed baseband signal by filtering, decoding, and / or digitizing the baseband or IF signals. RX processing circuitry 219 sends the processed baseband signal to controller / processor 224 for further processing.

[0057] TX processing circuit 214 receives analog or digital data (such as voice data, network data, email, or interactive video game data) from controller / processor 224. TX processing circuit 214 encodes, multiplexes, and / or digitizes the outgoing baseband data to generate processed baseband or IF signals. RF transceivers 209a-209n receive the processed baseband or IF signals from TX processing circuit 214 and up-convert the baseband or IF signals into RF signals transmitted via antennas 204a-204n.

[0058] The controller / processor 224 may include one or more processors or other processing devices (or processing circuitry) that control the overall operation of the AP 101. For example, the controller / processor 224 may control the reception of uplink signals and the transmission of downlink signals by the RF transceivers 209a-209n, the RX processing circuitry 219, and the TX processing circuitry 214, according to known principles. The controller / processor 224 may also support additional functions, such as more advanced wireless communication functions. For example, the controller / processor 224 may support beamforming or directional routing operations, in which outgoing signals from multiple antennas 204a-204n are weighted differently to effectively direct the outgoing signals in a desired direction. The controller / processor 224 may also support OFDMA operations, in which outgoing signals are allocated to different subsets of subcarriers for different receivers (e.g., different STA111-114). The controller / processor 224 may support any of a variety of other functions in AP 101, including combining DL MU-MIMO and OFDMA in the same transport opportunity. In some embodiments, the controller / processor 224 may include at least one microprocessor or microcontroller. The controller / processor 224 is also capable of executing programs and other processes, such as an operating system, residing in memory 229. The controller / processor 224 may move data into or out of memory 229 as needed for the execution of the process.

[0059] Controller / processor 224 is also coupled to backhaul or network interface 234. Backhaul or network interface 234 allows AP 101 to communicate with other devices or systems via a backhaul connection or over a network. Interface 234 may support communication via any suitable wired or wireless connection(s). For example, interface 234 may allow AP 101 to communicate via a wired or wireless local area network or via a wired or wireless connection to a larger network, such as the Internet. Interface 234 may include any suitable construct supporting communication via wired or wireless connections, such as Ethernet or an RF transceiver. Memory 229 is coupled to controller / processor 224. A portion of memory 229 may include RAM, and another portion of memory 229 may include flash memory or other ROM. In some embodiments, memory 229 may include one or more storage media storing one or more instructions. One or more instructions, when executed individually or collectively by controller / processor 224, may cause AP 101 to perform any combination of the operations described herein.

[0060] As described in more detail below, AP 101 may include circuitry and / or programming for managing the channel detection process in a WLAN. Although Figure 2A An example of AP 101 is shown, but it is possible to compare it with other versions. Figure 2AVarious changes can be made. For example, AP 101 can include any number of... Figure 2A Each component shown. As a specific example, the AP may include multiple interfaces 234, and the controller / processor 224 may support routing functionality to route data between different network addresses. As another example, although shown as a single instance including TX processing circuitry 214 and a single instance including RX processing circuitry 219, AP 101 may include multiple instances of each (e.g., one for each RF transceiver). Alternatively, only one antenna and RF transceiver path may be included, as in a conventional AP. Furthermore, Figure 2A The various components can be combined, further subdivided, or omitted, and additional components can be added as needed.

[0061] like Figure 2A As shown, in some embodiments, AP 101 may be an AP MLD comprising multiple APs 202a-202n. Each AP 202a-202n is attached to AP MLD 101 and includes multiple antennas 204a-204n, multiple radio frequency (RF) transceivers 209a-209n, transmit (TX) processing circuitry 214, and receive (RX) processing circuitry 219. Each AP 202a-202n may independently communicate with the controller / processor 224 and other components of AP MLD 101. Figure 2A The diagram shows that each AP 202a-202n has multiple individual antennas, but each AP 202a-202n can share multiple antennas 204a-204n without requiring separate multiple antennas. Each AP 202a-202n can represent the physical (PHY) layer and the lower media access control (MAC) layer.

[0062] Figure 2B An example of STA 111 according to an embodiment is shown. Figure 2B The embodiment of STA 111 shown is for illustrative purposes, and Figure 1 STAs 111-114 can have the same or similar configurations. However, STAs have a wide variety of configurations, and Figure 2B This disclosure is not intended to limit the scope of any particular implementation of STA.

[0063] like Figure 2BAs shown, STA 111 may include one or more antennas 205, an RF transceiver 210, a TX processing circuit 215, a microphone 220, and an RX processing circuit 225. STA 111 may also include a speaker 230, a controller / processor 240, an input / output (I / O) interface (IF) 245, an input 250, a display 255, and a memory 260. The memory 260 may include an operating system (OS) 261 and one or more applications 262.

[0064] RF transceiver 210 receives incoming RF signals transmitted by the AP of network 100 from antenna(s) 205. RF transceiver 210 down-converts the incoming RF signals to generate an IF or baseband signal. The IF or baseband signal is sent to RX processing circuitry 225, which generates a processed baseband signal by filtering, decoding, and / or digitizing the baseband or IF signal. RX processing circuitry 225 sends the processed baseband signal to speaker 230 (e.g., for voice data) or to controller / processor 240 for further processing (e.g., for web browsing data).

[0065] TX processing circuitry 215 receives analog or digital voice data from microphone 220, or other outgoing baseband data (such as network data, email, or interactive video game data) from controller / processor 240. TX processing circuitry 215 encodes, multiplexes, and / or digitizes the outgoing baseband data to generate processed baseband or IF signals. RF transceiver 210 receives the processed baseband or IF signals from TX processing circuitry 215 and up-converts the baseband or IF signals into RF signals transmitted via antenna(s) 205.

[0066] The controller / processor 240 may include one or more processors and executes a basic OS program 261 stored in memory 260 to control the overall operation of STA 111. In one such operation, the controller / processor 240 controls the reception of downlink signals and the transmission of uplink signals by the RF transceiver 210, RX processing circuitry 225, and TX processing circuitry 215 according to known principles. The controller / processor 240 may also include processing circuitry configured to provide management of channel detection processes in a WLAN. In some embodiments, the controller / processor 240 may include at least one microprocessor or microcontroller. In some embodiments, the controller / processor 240 may include at least one processor that includes processing circuitry.

[0067] The controller / processor 240 is also capable of executing other processes and programs residing in the memory 260, such as operations for managing channel sounding processes in the WLAN. The controller / processor 240 may move data into or out of the memory 260 as needed for the execution of processes. In some embodiments, the controller / processor 240 is configured to execute multiple applications 262, such as applications for channel sounding, including feedback calculations based on received null packet advertisements (NDPA) and null packets (NDP), and sending beamforming feedback reports in response to trigger frames (TF). The controller / processor 240 may operate the multiple applications 262 based on the OS program 261 or in response to signals received from the AP. The controller / processor 240 is also coupled to an I / O interface 245, which provides the STA 111 with the ability to connect to other devices, such as laptops and handheld computers. The I / O interface 245 is the communication path between these accessories and the main controller / processor 240.

[0068] The controller / processor 240 is also coupled to an input 250 (such as a touchscreen) and a display 255. An operator of the STA 111 can use the input 250 to enter data into the STA 111. The display 255 may be a liquid crystal display, a light-emitting diode display, or other display capable of rendering text and / or at least limited graphics from a website. A memory 260 is coupled to the controller / processor 240. A portion of the memory 260 may include random access memory (RAM), and another portion of the memory 260 may include flash memory or other read-only memory (ROM). In some embodiments, the memory 260 may include one or more storage media storing one or more instructions. One or more instructions, when executed individually or collectively by the controller / processor 240, may cause the STA 111 to perform any combination of the operations described herein.

[0069] although Figure 2B An example of STA 111 is shown, but it is possible to compare it with other models. Figure 2B Make various changes. For example, Figure 2B Various components can be combined, further subdivided, or omitted, and additional components can be added as needed. In a specific example, STA 111 may include any number (one or more) antennas 205 for MIMO communication with AP 101. In another example, STA 111 may not include voice communication, or the controller / processor 240 may be divided into multiple processors, such as one or more central processing units (CPUs) and one or more graphics processing units (GPUs). Furthermore, although... Figure 2B The STA 111 is shown configured as a mobile phone or smartphone, but the STA can be configured to operate as other types of mobile or fixed devices.

[0070] like Figure 2B As shown, in some embodiments, STA 111 may be a non-AP MLD comprising multiple STAs 203a-203n. Each STA 203a-203n is attached to the non-AP MLD 111 and includes one or more antennas 205, an RF transceiver 210, TX processing circuitry 215, and RX processing circuitry 225. Each STA 203a-203n may independently communicate with the controller / processor 240 and other components of the non-AP MLD 111. Figure 2B It is shown that each STA 203a-203n has a separate antenna, but each STA 203a-203n can share antenna 205 without requiring a separate antenna. Each STA 203a-203n can represent the physical (PHY) layer and the lower media access control (MAC) layer.

[0071] Embodiments of this disclosure provide a method for reusing an RF transmitter and receiver on a single device to perform pseudo-single-site sensing. For single-site sensing, the transmitter and receiver are typically within a single device, and therefore located in the same location. For pseudo-single-site sensing, the transmitter and receiver are typically located in two different devices; however, they can collaborate to determine their relative distance and work together as a single single-site sensor.

[0072] In some embodiments, the RF module in the device can be used to perform multi-static / bistatic sensing. According to embodiments of this disclosure, bistatic / multi-static / pseudo-single-static RF sensing can be used in a variety of applications, including sleep monitoring, exercise monitoring, proximity detection, and various other applications. In particular, a challenge in reusing available RF transmitters and receivers on a current device for sensing is that the RF transmitters and receivers on the same device may not support duplex mode (simultaneous transmission and reception of signals at the same time), making it difficult to perform single-station (transmitter and receiver in the same location) RF sensing. However, if two devices are used to perform bistatic (transmitter and receiver in different locations) RF sensing, any movement between the two devices can lead to various interferences.

[0073] According to embodiments of this disclosure, a bi-station sensing setup can be used to mimic mono-station sensing or create pseudo-mono-station sensing. Embodiments of this disclosure provide pseudo-mono-station sensing that supports a full-duplex mode capable of simultaneously transmitting and receiving RF signals. Support for a full-duplex mode is advantageous in various sensing applications where RF signals are concurrently transmitted and received within an environment to sense environmental characteristics (e.g., the presence of objects / people), where RF signals propagate at near-light speeds, thus the ability of the device to concurrently transmit and receive signals is essential.

[0074] Therefore, RF signaling devices can be used to perform bi-station / multi-station sensing according to embodiments of this disclosure. Some embodiments may first determine the coverage area of ​​the RF sensing devices based on the relative distance between the RF sensing devices.

[0075] In some embodiments, a pair of RF devices may be used to perform motion and respiration detection to track a person's sleep state. Some embodiments may use motion and Doppler energy detection to track a person's exercise state. Some embodiments may use channel impulse response and signal strength to perform proximity detection. Some embodiments may use one or a combination of received signal strength indicator (RSSI), round-trip time (RTT), audio sound, and / or the device's status at the charging station to determine if the device is very close to enable pseudo-single-station mode.

[0076] Some embodiments may utilize RF signals from different sources, including WiFi, Bluetooth, and / or ultra-wideband (UWB) devices, to perform bi-site / multi-site sensing. For WiFi, some embodiments may use soft APs, WiFi sensing, Tunneled Direct Link Setup (TDLS), WiFi Direct, etc., to establish communication between devices for sensing. In some embodiments, for Bluetooth, specific signal patterns may be transmitted to enable multi-site sensing. In some embodiments, for UWB, device-to-device modes may be used to enable multi-site sensing.

[0077] Some embodiments may utilize multiple devices to enable pseudo-single-station sensing for sleep monitoring, exercise monitoring and / or proximity detection, and other applications. In some embodiments, for sleep monitoring, RF signals may be used between a pair of RF devices to detect a person's movement and breathing rate for sleep state estimation.

[0078] Figure 3 A flowchart illustrating an example process for determining a sleep state using a pseudo-single-station mode of an RF device according to an embodiment is provided. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 3 The flowchart depicted in the diagram shows the device (such as...) Figure 1The operation performed by the device shown.

[0079] In operation 301, process 300 involves communication between first device A and second device B to determine whether they are in pseudo-single-station mode. If, in operation 301, the process determines that first device A and second device B are not in pseudo-single-station mode, then operation 301 is repeated. If, in operation 301, the process determines that first device A and second device B are in pseudo-single-station mode, then in operation 303, the process initiates RF signal exchange between first device A and second device B. In operation 305, the process measures the duration of movement and estimates the respiratory rate. In operation 307, the process estimates the sleep state. In operation 309, the process determines whether first device A and second device B are still in pseudo-single-station mode. If, in operation 309, the process determines that first device A and second device B are still in pseudo-single-station mode, then the process returns to operation 305; otherwise, the process returns to operation 301.

[0080] In some embodiments, for exercise monitoring, RF signals can be used between a pair of RF devices to detect motion, and then Doppler patterns can be extracted from the signals to estimate calories burned during exercise and the number of repetitions of certain movements.

[0081] Figure 4 A flowchart illustrating an example process for tracking exercise status using a pseudo-single-station mode of an RF device according to an embodiment is provided. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 4 The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0082] In operation 401, process 400 involves communication between first device A and second device B to determine whether they are in pseudo-single-station mode. If, in operation 401, the process determines that first device A and second device B are not in pseudo-single-station mode, operation 401 is repeated. If, in operation 401, the process determines that first device A and second device B are in pseudo-single-station mode, the process proceeds to operation 403, where RF signal exchange between first device A and second device B begins. In operation 405, the process determines whether large motion is detected. In some embodiments, large motion is detected when the variance of the signal exceeds a certain threshold.

[0083] If, in operation 405, the process determines that no large movements were detected, the process proceeds to operation 415, where it determines whether no large movements were detected within N seconds. If, in operation 415, the process determines that the condition of no large movements being detected within N seconds is not met, the process returns to operation 405. If, in operation 415, the process determines that the condition of no large movements being detected within N seconds is met, the process proceeds to operation 417 to output the total exercise time, calories burned, and / or number of repetitions, etc., and then returns to operation 401.

[0084] If, in operation 405, the process determines that large movements have been detected, the process proceeds to operation 407, where the exercise time is increased. In operation 409, the process estimates and integrates the Doppler data. In operation 411, the process estimates the calories burned. In operation 413, the process counts the number of repeated Doppler patterns and returns to operation 405. In some embodiments, the repeated Doppler patterns may be used to provide a count of the specific exercise being performed (e.g., the number of push-ups, pull-ups, etc.).

[0085] In some embodiments, for proximity detection, the RF signal between two RF devices can be converted into a channel impulse response (CIR). The first N taps of the CIR can be examined to check for movement. The N taps can be used to determine the distance range. If movement is detected within the first N taps, the camera can be activated to determine if a person is very close. If it is confirmed that someone is very close, information can be displayed on the device screen.

[0086] Figure 5 A flowchart illustrating an example process for performing proximity detection using a pseudo-single-station mode according to an embodiment is provided. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 5 The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0087] In operation 501, process 500 involves communication between first device A and second device B to determine whether they are in pseudo-single-station mode. If, in operation 501, the process determines that first device A and second device B are not in pseudo-single-station mode, then operation 501 is repeated. If, in operation 501, the process determines that first device A and second device B are in pseudo-single-station mode, then the process proceeds to operation 503, where RF signal exchange between first device A and second device B begins. In operation 505, the process converts new Channel State Information (CSI) (e.g., the RF signals exchanged between first device A and second device B) into CIR. In operation 507, the process determines whether motion detection occurs in the first N taps. If, in operation 507, no motion detection occurs in the first N taps, then the process returns to operation 505. If, in operation 507, the process determines that motion is detected within the first N taps, the process proceeds to operation 509, where the process sets up to detect very close motion. In operation 511, the process determines whether the camera confirms the presence of a person. If, in operation 511, the camera does not confirm the presence of a person, the process returns to operation 507. If, in operation 511, the camera confirms the presence of a person, the process proceeds to operation 514 to display information on the device's screen. This document describes a system for a battery display application based on wireless proximity detection according to various embodiments.

[0088] Figure 6 A system for a battery display application based on proximity detection and a camera, according to an embodiment, is illustrated. Although one or more operations are described or illustrated in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 6 The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0089] like Figure 6As shown, device 601 (e.g., a telephone) approaches Wi-Fi AP 603 (such as a wireless charging hub). Device 601 can perform proximity detection using CSI packets received from Wi-Fi AP 603. If motion 607 is detected approaching the telephone and Wi-Fi AP, the device can activate the telephone camera 609 and perform facial recognition 611. In some embodiments, facial recognition 611 can use machine learning techniques from various machine learning techniques, such as multilayer perceptrons and convolutional neural networks. When it detects a user's face, it will display battery status, messages, and / or other information on the screen 613 for several seconds (e.g., 5 seconds). The device may then leave the camera 617 and screen 605 on until no motion 615 is detected within several seconds (e.g., 10 seconds). If there is no motion for several seconds, the device can turn off the camera 617 and turn off the screen 605. In some embodiments, a system for implementing a battery display application can be implemented using proximity detection based solely on Wi-Fi CSI.

[0090] Figure 7 The process of using a battery display based on Wi-Fi CSI proximity detection according to an embodiment is illustrated. Although one or more operations are described or illustrated in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 7 The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0091] As shown in the figure, device 701 can approach AP 703. When device 701 detects proximity 707, it can display battery status 709 on its screen. In some embodiments, proximity detection based on Wi-Fi CSI can be used to determine proximity. The phone screen then remains on until no proximity is detected for a preset duration (e.g., 10 seconds). As shown in the figure, if there is no movement 711 during the set duration, the phone screen is then turned off 705.

[0092] In some embodiments, the device (e.g., a telephone) may receive CSI packets from a Wi-Fi AP and may store the data in a CSI buffer having a length N (e.g., 300). In some embodiments, the device may then use... (For example, 1.5 seconds) sliding window and longer timers The latest CSI data within (e.g., 5 seconds) is used to calculate the standard deviation (STD) for each subcarrier. The median STD is then used within a shorter time sliding window. It was used to detect large movements.

[0093] Figure 8A , Figure 8B and Figure 8C The process of a battery display with proximity detection and face detection according to an embodiment is illustrated. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 8A , Figure 8B and Figure 8C The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0094] Process 800 collects CSI data at a 25Hz data rate in operation 801 and stores the CSI data in a CSI buffer. This process can execute operations 803-809 and 811-817 concurrently. In operation 803, the process acquires data with shape from the most recent second every 0.5 seconds. csi .

[0095] In operation 805, the process calculates the STD along each subcarrier: , where k is one of the CSI subcarriers.

[0096] In operation 807, the process obtains The median: .

[0097] In operation 809, the process determines whether... >LM_thd If the conditions are met during operation 809. > LM_thd Then the process continues until Figure 8C Operation 819 is shown in the figure.

[0098] Return to reference operation 801; this process can also proceed to... Figure 8C Operation 811 in the middle obtains a shape every 1 second within the last 5 seconds. csi In operation 813, the process calculates the standard deviation (STD) along each subcarrier: , where k is one of the CSI subcarriers.

[0099] In operation 815, the process obtains The median: .

[0100] In operation 817, the process determines whether the median is greater than the threshold. >SM_thd .

[0101] In operation 817, if the condition is met... >SM_thd Then the process continues until Figure 8C Operation 823 in the middle.

[0102] Reference Figure 8C , from Figure 8A The output of operation 809 is provided to operation 819, where the process determines whether the camera is on. If, in operation 819, the process determines that the camera is not on, the process proceeds to operation 821, where the process turns on the camera and updates the time. .

[0103] If, during operation 819, the process determines that the camera is on, then the process proceeds to operation 823 to update the time. .

[0104] Then in operation 825, the process determines the condition: current time minus... <10 seconds.

[0105] If, during operation 825, the process determines that the current time minus... If the condition is less than 10 seconds, the process proceeds to operation 841 to turn off the camera.

[0106] If in operation 825, the process determines that the current time is subtracted from the condition that it meets the requirement. If the time is less than 10 seconds, then in operation 827, the process determines whether it has detected a face.

[0107] If, in operation 827, the process determines that it has not detected a face, it proceeds to operation 840, where it determines whether isDisplayinfo == true (determining whether information is being displayed). If the condition isDisplayinfo == true (information is being displayed) is met, the process returns to operation 825. If the condition isDisplayInfo == true (information is not being displayed) is not met, the process proceeds to operation 839 to turn off the screen.

[0108] Returning to operation 827, if the condition for detecting a face is met, the process proceeds to operation 829, where the display time is updated. = Current timeThen, in operation 831, the process determines whether the condition isDisplayInfo == false (whether information is not being displayed). If the condition isDisplayInfo == false (information is being displayed) is not met in operation 831, the process returns to operation 823. If the condition isDisplayInfo == false (information is not being displayed) is met in operation 831, the process proceeds to operation 833, where isDisplayInfo = true (the variable isDisplayInfo is set to true) and the battery level and message are displayed. Then, in operation 835, the process determines whether the current time > +5. If the condition "current time >" is not met during operation 835, then... +5, then the process repeats operation 835. If, during operation 835, the condition current time > If +5 is added, then in operation 837, the procedure sets isDisplayinfo = false (sets the variable isDisplayinfo to false). In operation 839, the procedure closes the screen and returns to operation 825.

[0109] exist Figure 8A In operation 809, when Greater than the threshold At this time, the phone will turn on the screen and front-facing camera. A face detection process will also be initiated. There is a timer. To control the camera. In operation 825, if the system time... If the time difference is greater than a certain number of seconds (e.g., 10 seconds), the camera will be turned off. 841. Median STD in a longer sliding window. Used to detect small movements and update To keep the camera on. In Operation 827, if the user's face is detected, the phone displays the battery status on the screen for a period of time (e.g., 5 seconds) and then turns off the screen.

[0110] Figure 9A , Figure 9B and Figure 9C The process of a battery display with only proximity detection is illustrated according to an embodiment. Although one or more operations are described or illustrated in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 9A , Figure 9B and Figure 9C The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0111] In operation 901, process 900 collects CSI data at a 25Hz data rate and stores the CSI in a CSI buffer. This process can concurrently execute operations 903-909 and 911-917. In operation 903, this process acquires data with shape from the most recent second every 0.5 seconds. csi .

[0112] In operation 905, the process calculates the standard deviation (STD) along each subcarrier: , where k is one of the CSI subcarriers.

[0113] In operation 907, the process obtains The median: .

[0114] In Operation 909, the process determines whether... >LM_thd If the conditions are met during operation 909. > LM_thd Then the process continues until Figure 9C Operation 921 in the middle.

[0115] exist Figure 9B In operation 911, the process obtains a shape within the last 5 seconds every 1 second. csi In Operation 913, the process calculates the standard deviation (STD) along each subcarrier: , where k is one of the CSI subcarriers.

[0116] In operation 915, the process obtains The median: .

[0117] In operation 917, the process determines the conditions. >SM_thd .

[0118] In operation 917, if the condition is met... >SM_thd Then the process continues until Figure 9C Operation 919.

[0119] exist Figure 9C In operation 919, the procedure determines if the condition Display_flag == True (information is being displayed). If in operation 919, the procedure determines that the condition Display_flag == True (information is being displayed) is met, then the procedure proceeds to operation 921, in which the procedure updates... = Current timeThen, in operation 923, the process determines the current time condition. <5 seconds. If the condition is met during operation 923, the current time - If the time is less than 5 seconds, then in operation 925, the procedure determines whether the condition Display_flag == False (no information is being displayed). If in operation 925, the procedure determines that the condition Display_flag == False is not met (the information is being displayed), then the procedure returns to operation 923.

[0120] If, in operation 925, the process determines that the condition Display_flag == false (no information is displayed), then the process proceeds to operation 927, in which display_flag = true (the variable display_flag is set to true) and the battery level and message are displayed until... +5 seconds, then display_flag = false (the variable display_flag is set to false).

[0121] In operation 929, if the condition Display_flag == true (information is being displayed) is met, the process returns to operation 923.

[0122] In operation 929, if the condition Display_flag == True is not met (the information is not displayed), the process proceeds to operation 931 to turn off the screen, and then returns to operation 923.

[0123] exist Figures 9A-9C In the middle, when Greater than the threshold At this time, the phone will only turn on the screen and initialize the timer. To rotate the screen and time To display battery status. The median STD value in a longer sliding window. Used to detect small movements and update and To keep the screen on and display the battery status.

[0124] Figure 10 Proximity detection based on CIR statistical characteristics is illustrated. Although one or more operations are described or illustrated in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 10 The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0125] In operation 1001, process 1000 obtains H_csi in the sliding window, where In operation 1001, if the device only receives CSI data from the Wi-Fi AP, then in operation 1003, the inverse fast Fourier transform (IFFT) can be used to calculate the CIR, and each CIR is normalized as follows.

[0126]

[0127] in, It is the output size of the IFFT. ,and It is an index in H_cir. Then in operation 1005, the procedure calculates the mean and variance of each tap, and in operation 1007, the procedure finds the maximum mean. or maximum variance ,in It's the index of the tap. If in operation 1009... Or in operation 1011 Then, in operation 1013, the predicted range (bin) is... Proximity at a given location. Although the distance within the range is on the order of meters (e.g., with Wi-Fi bandwidth). The two range intervals are 1.8m apart, but CIR-based proximity detection can still be applied to battery status display in charging phones.

[0128] For proximity detection, some embodiments use CSI energy-based methods. Some embodiments use statistics of the average CSI power per packet to determine if there is significant movement near a pseudo-single-site WiFi device. However, due to WiFi receiver automatic gain control (AGC), unwanted WiFi packet energy fluctuations can be observed due to AGC compensation. To compensate for AGC, some embodiments collect several Wi-Fi packets and divide them into clusters by running the DBSCAN (Density-based Spatial Clustering for Noisy Applications) algorithm on the CSI packet energy. For each CSI packet in a cluster, some embodiments divide the energy of each CSI packet by the mean of the CSI energy cluster. After creating clusters, for each new WiFi packet, some embodiments directly check which cluster it belongs to and normalize the packet's CSI energy using the cluster mean.

[0129] Figure 11A , Figure 11B and Figure 11CA flowchart illustrating an example process for combined Wi-Fi and camera motion detection with AGC compensation according to an embodiment is shown. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 11A , Figure 11B and Figure 11C The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0130] In operation 1101, process 1100 involves the first device A communicating with the second service B to determine if the device is in pseudo-single-site mode. If, in operation 1101, the process determines that the device is not in pseudo-single-site mode, then operation 1101 is repeated. If, in operation 1101, the process determines that the device is in pseudo-single-site mode, then the process proceeds to operation 1103, in which the device exchanges RF signals / packets and obtains raw CSI data. In operation 1105, the process determines the conditions for the existence of an AGC compensation cluster. If, in operation 1105, the process determines that the conditions for the existence of an AGC compensation cluster are not met, then the process proceeds to operation 1101 to accumulate packets for M seconds. Then, the process proceeds to operation 1114 to generate / update CSI clusters based on CSI, and then proceeds to operation 1109.

[0131] In operation 1105, if the process determines that the condition for the existence of the AGS compensation cluster is met, the process proceeds to operation 1107. In operation 1107, the process determines the condition: Has the distance between device A and device B changed by more than X cm? If in operation 1107, the process determines that the condition for the change in distance between device A and device B by more than X cm is met, the process proceeds to operation 1107 and performs the operations as described above.

[0132] If, in operation 1107, the process determines that the condition of device A and device B changing by more than X cm is not met, the process proceeds to operation 1109. In operation 1109, the process divides the CSI power of each packet by its cluster mean. In operation 1115, the process calculates the variance of the power of the CSI packets within the moving window. In operation 1117, the process determines whether the variance of the CSI power is greater than a first threshold (i.e., Var(CSI_power) > csi_thresh1). If, in operation 1117, the condition that the variance of the CSI power is greater than the first threshold is not met, the process returns to operation 1115. If, in operation 1117, the condition that the variance of the CSI power is greater than the first threshold is met, the process proceeds to operation 1119. In operation 1119, the process determines that motion has been detected and activates the camera. The process proceeds to... Figure 11B Operation 1121 in

[0133] In Figure 11B it, in operation 1121, the process determines whether the condition of detecting a human face is met. If in operation 1121 the process determines that the condition regarding whether a human face is detected is satisfied, then the process proceeds to Figure 11C operation 1129 of Figure 11A If in operation 1121 the process determines that no human face is detected, then the process proceeds to operation 1123. In operation 1123, the process increases the time T1. In operation 1125, the process determines whether the condition that T1 is greater than the first threshold and the variance of the CSI power is less than the second threshold (i.e., T1>T_thresh1 and Var(CSI_power)<csi_thresh2) is met. If the condition that T1 is greater than the first threshold and the variance of the CSI power is less than the second threshold is not met, then the process returns to operation 1121. If the condition that T1 is greater than the first threshold and the variance of the CSI power is less than the second threshold is met, then the process proceeds to operation 1127. In operation 1127, the process resets the timer T1 and turns off the camera. The process returns to

[0134] In Figure 11C it, operation 1129 receives from Figure 11BThe input output by operation 1121 in []. In operation 1129, the process turns on the screen and displays information. In operation 1131, the process determines whether the condition of detecting a human face is met. If in operation 1131, the process determines that a human face is detected, the process returns to operation 1131. If in operation 1131, the process determines that no human face is detected, the process proceeds to operation 1131. In operation 1133, the process increases the time T2. In operation 1135, the process determines the condition of whether T2 is greater than a second threshold (i.e., T2 > T_thresh2). If in operation 1135, the process determines that the condition of T2 being greater than the second threshold is not met, the process returns to operation 1131. If in operation 1135 the process determines that the condition of T2 being greater than the second threshold is met, the process proceeds to operation 1137. In operation 1137, the process turns off the screen. In operation 1139, the process determines whether a human face is detected by the camera. If in operation 1139, the process determines that a human face is detected by the camera, the process returns to operation 1129. If in operation 1139, the process determines that the condition of whether a human face is detected by the camera is not met, the process proceeds to operation 1141. In operation 1141, the process determines the condition of whether the variance of the CSI power is less than a first threshold (i.e., Var(CSI_power) < csi_thresh1). If in operation 1, the process determines that the condition of the variance of the CSI power being less than the first threshold is met, the process returns to operation 1139. If in operation the process determines that the condition of the variance of the CSI power being less than the first threshold is not met, the process proceeds to operation 1143. In operation 1143, the process increases the timer T3. In operation 1145, the process determines the condition of whether the time T3 is greater than a third threshold (i.e., T3 > T_threshd3). If in operation 1145, the process determines that the condition of T3 being greater than the third threshold is not met, the process returns to operation 1141. If in operation 1145, the process determines that the condition of T3 being greater than the third threshold is met, the process proceeds to operation 1147. In operation 1147, the process resets the timer T3 and turns off the camera. Then, the process returns to Figure 11A operation 1103 in [].

[0135] In the following, a method for detecting the pseudo single - station / multi - station state of an RF sensor for sensing according to several embodiments is described.

[0136] Some embodiments can detect / determine whether the current scenario is suitable for enabling the pseudo single - station / multi - station RF sensing mode. To detect whether the RF transmitting and receiving devices are close together, the transmitter RSSI and RTT values measured by the receiver can be used. Exemplary RF transmitting and receiving devices can be a phone, wireless earbuds, tablet, smartwatch, etc.

[0137] Figure 12 The flowchart shows an example process for determining the pseudo single - station mode using RF signals according to an embodiment. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations during at least partially overlapping time periods. Figure 12 The flowchart depicted in shows operations performed by a device (such as Figure 1 the device shown in).

[0138] In operation 1201 of process 1200, a wireless link is established between a first device and a second device. In operation 1203, the process measures the RSSI of the transmitter and the RTT between the transmitter and the receiver based on the communication between the devices.

[0139] In some embodiments, the RSSI is the received packet signal strength measured at the receiver. In some embodiments, the typical range of threshold a is from - 10 dbm to - 30 dbm. The RTT is the measured round - trip time from the transmitter to the receiver and then back from the receiver to the transmitter on the transmitter side. The typical range of threshold b is from 0.1 to 2 meters.

[0140] In operation 1205, the process determines whether RSSI > a or RTT < b. If the condition RSSI > a or RTT < b in operation 1205 is not satisfied, the process returns to operation 1203. If the condition RSSI > a or RTT < b in operation 1205 is satisfied, the process proceeds to operation 1207, where the process determines that the device is in the pseudo single - station mode and the process performs sensing.

[0141] In operation 1209, the process determines whether RSSI b. If in operation 1209, the condition RSSI b is not satisfied, the process returns to operation 1207. If in operation 1209, the condition RSSI b is satisfied, the process proceeds to operation 1211, where the process determines that the device is not in the pseudo single - station mode, and the process stops transmitting. The process returns to operation 1203. In some embodiments, an audio signal transmitted from one device and measured by another device can be used to determine the pseudo single - station state.

[0142] Figure 13 The flowchart shows an example process for determining the pseudo single - station mode using audio signals according to an embodiment. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations during at least partially overlapping time periods. Figure 13The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0143] In operation 1301, device A receives an audio signal sent by device B. In operation 1303, device A measures the audio signal energy E from device B. In operation 1305, the process determines whether E > a threshold. If in operation 1305 the process determines that the condition E > threshold is not met, the process returns to operation 1303. If in operation 1305 the process determines that the condition E > threshold is met, the process proceeds to operation 1307, where the process determines that the device is not in pseudo-single-station mode and performs sensing. The process proceeds to operation 1309, where it determines whether the condition E < a threshold. If in operation 1309 the condition E < threshold is not met, the process returns to operation 1307. If the condition E < threshold is met in operation 1309, the process proceeds to operation 1311, where the process determines that the device is not in pseudo-single-station mode and stops sensing. Then, the process returns to operation 1303.

[0144] In some embodiments, whether device A is providing wireless charging to device B can be used to determine pseudo-single-station mode.

[0145] Figure 14 A flowchart illustrating an example process for determining a pseudo-single-station mode using the charging state of a device is shown. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 14 The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0146] In operation 1401, process 1400 determines that device A has started wireless charging. In operation 1403, process 1400 determines whether device B is being charged by device A. If, in operation 1403, the condition that device B is being charged by device A is not met, the process returns to operation 1401. In operation 1403, if the condition that device B is being charged by device A is met, the process proceeds to operation 1405 and determines that devices A and B are in pseudo-single-station mode, and the process performs sensing. The process proceeds to operation 1407, where process 1407 determines whether device B is no longer being charged by device A. If, in operation 1407, the condition that device B is no longer being charged by device A is not met, the process returns to operation 1405. If, in operation 1407, the condition that device B is no longer being charged by device A is met, the process proceeds to operation 1409, where process 1409 determines that the device is no longer in pseudo-single-station mode, and the process stops sensing. The process then returns to operation 1401. In some embodiments, whether device A and device B are charged by the same wireless charging pad can be used to determine the pseudo-single-station status.

[0147] Figure 15 A flowchart illustrating an example process for determining a pseudo-single-station mode using the charging state of a charging pad according to an embodiment is shown. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 3 The flowchart depicted illustrates the operations performed by the device.

[0148] In operation 1501, the charging board detects device A. In operation 1503, the process determines whether the charging board has detected device B. If the condition for the charging board to detect device B is not met in operation 1503, the process returns to operation 1501. If the condition for the charging board to detect device B is met in operation 1503, the process proceeds to operation 1505, determines that devices A and B are in pseudo-single-station mode, and performs sensing. In operation 1507, the process determines whether the condition for the charging board to no longer detect device A or device B is met. If the condition for the charging board to no longer detect device A or device B is not met in operation 1507, the process returns to operation 1505. If the condition for the charging board to no longer detect device A or device B is met in operation 1507, the process proceeds to operation 1509, determines that the device is not in pseudo-single-station mode, and stops sensing. Then, the process returns to operation 1501.

[0149] The following describes multi-device sensing based on RF signals according to several embodiments.

[0150] In some embodiments, RF signals used in device-to-device communication can be used for sensing purposes in order to perform pseudo-single-site multi-device sensing using currently available RF transceivers on the device. In some embodiments, RF signals from WiFi devices can be used.

[0151] In some embodiments, for WiFi-based multi-device sensing, device-to-device communication can be established via P2P WiFi protocols, such as, but not limited to, WiFi Direct, WiFi Sensing, WiFi TDLS, and WiFi softAP. After establishing a WiFi link, a user-controlled device can be used as a master device. The master device can repeatedly send WiFi packets to other devices. Other devices can reply with ACK packets (or other packets), which the master device can use to extract the channel impulse response (CIR). In some embodiments, the master device can listen for periodic frames sent by other devices to extract CIR information. An example of a periodic frame could be a beacon frame. The CIR information can be used for sensing.

[0152] Figure 26 illustrates a flowchart of an example process for establishing a signal exchange between two WiFi devices for sensing, according to an embodiment. Although one or more operations are described or shown in a specific order, in other embodiments, the operations may be rearranged in a different order, which may include performing multiple operations in at least partially overlapping time periods. Figure 16 The flowchart depicted in the diagram shows the device (such as...) Figure 1 The operation performed by the device shown.

[0153] In operation 1601, process 1600 involves the master device establishing a WiFi link with the source device. In operation 1603, the master device sends WiFi packets to the source device. In operation 1605, the master device receives and uses returned ACK packets or other packets for sensing. In some embodiments, the master device may use ACK packets to extract the channel impulse response (CIR) for sensing.

[0154] In some embodiments, a Bluetooth device may be used. For Bluetooth, the master device may send a long sequence of 1s followed by a long sequence of 0s (several consecutive 1s, then several consecutive 0s). The CIRs from all frequency hopping bands can then be concatenated to obtain wideband CIR information. According to an embodiment, in Figure 16 The steps for performing CIR to enable sensing are described. In some embodiments, a UWB device may be used. For UWB, the master device may send UWB packets to other devices and use ack packets to obtain the CIR for sensing. Alternatively, the master device may listen for packets periodically sent by other devices and extract the CIR for sensing. According to an embodiment, in Figure 16 The steps to enable sensing on a CIR are described in the document.

[0155] Unless otherwise specified, references to elements in the singular form do not imply one and only one, but rather one or more. For example, a “one” module can refer to one or more modules. Without further constraints, elements beginning with “a,” “an,” “the,” or “the” do not exclude the existence of other identical elements.

[0156] Titles and subtitles (if any) are used for convenience only and do not limit the invention. The word "exemplary" is used to indicate that it is intended as an example or illustration. Within the scope of the use of terms such as "comprising," "having," etc., such terms are intended to be inclusive in a manner similar to the term "including," as interpreted when "including" is used as a transitional word in the claims. Relational terms such as "first" and "second" may be used to distinguish one entity or action from another without necessarily requiring or implying any actual such relationship or order between these entities or actions.

[0157] Phrases such as aspect, that aspect, on the other hand, some aspects, one or more aspects, implementation, that implementation, another implementation, some implementations, one or more implementations, embodiment, that embodiment, another embodiment, some embodiments, one or more embodiments, configuration, that configuration, another configuration, some configurations, one or more configurations, subject matter, disclosure, this disclosure, other variations thereof, etc., are for convenience and do not imply that disclosures associated with such phrases(s) are essential to the subject matter, or that such disclosures apply to all configurations of the subject matter. Disclosures associated with such phrases(s)(s)(s) may apply to all configurations or one or more configurations. Disclosures associated with such phrases(s)(s)(s)(s)(s)(s)) may provide one or more examples. Phrases such as aspect or some aspects may refer to one or more aspects, and vice versa, and this similarly applies to other foregoing phrases.

[0158] The phrase "at least one" preceding a list of items, separated by the terms "and" or "or," modifies the entire list, not each member of the list. The phrase "at least one of..." does not require the selection of at least one item; rather, it allows for the inclusion of at least one of any one item, and / or at least one of any combination of items, and / or at least one of each item. For example, each in the phrase "at least one of A, B, and C" or "at least one of A, B, or C" refers to only A, only B, or only C; any combination of A, B, and C; and / or at least one of each of A, B, and C.

[0159] As described herein, any electronic device and / or portion thereof according to any example embodiment may include, be included in, or be implemented by one or more processors and / or combinations of processors. A processor is a circuit that performs processing.

[0160] The processor may include processing circuitry, which may more specifically include, but is not limited to, a central processing unit (CPU), a microprocessor unit (MPU), a system-on-a-chip (SoC), an integrated circuit (IC), an arithmetic logic unit (ALU), a graphics processing unit (GPU), an application processor (AP), a digital signal processor (DSP), a microcomputer, a field-programmable gate array (FPGA), a programmable logic unit, a microprocessor, an application-specific integrated circuit (ASIC), a neural network processing unit (NPU), an electronic control unit (ECU), an image signal processor (ISP), etc. In some example embodiments, the processing circuitry may include: a non-transitory computer-readable storage device (e.g., memory), such as a DRAM device, storing a program of instructions; and a processor (e.g., a CPU), configured to execute the program of instructions to implement functions and / or methods performed by all or some of any device, system, module, unit, controller, circuit, architecture, and / or portions thereof, according to any example embodiment and / or any portion of any example embodiment. Instructions may be stored in memory and / or partitioned across multiple memories. In some embodiments, a computer-readable storage medium stores one or more instructions, wherein the one or more instructions, when executed individually or jointly by at least one processor, cause the at least one processor to perform any combination of the methods described herein.

[0161] Different processors can execute different functions and / or parts of functions. For example, processor 1 can execute functions A and B, and processor 2 can execute function C; or processor 1 can execute a portion of function A, while processor 2 can execute the remainder of function A, and also execute functions B and C. Different processors can be dynamically configured to execute different processes. For example, at one time, processor 1 can execute function A, and at another time, processor 2 can execute function A. Processors can reside on different processing circuits (e.g., client-side processors and server-side processors, device-side processors and cloud computing processors, etc.).

[0162] It will be understood that the specific order or hierarchy of the disclosed steps, operations, or processes is an illustrative example. Unless otherwise expressly stated, it will be understood that a particular order or hierarchy of steps, operations, or processes may be performed in different orders. Some steps, operations, or processes may be performed simultaneously, or may be performed as part of one or more other steps, operations, or processes. The appended method claims (if any) present the elements of various steps, operations, or processes in a sample order, and are not intended to be limited to the specific order or hierarchy presented. These may be performed serially, linearly, in parallel, or in different orders. It should be understood that the described instructions, operations, and systems may generally be integrated together in a single software / hardware product or packaged into multiple software / hardware products.

[0163] This disclosure is provided to enable any person skilled in the art to practice the various aspects described herein. In some cases, well-known structures and components are shown in block diagram form to avoid obscuring the concept of the subject matter. This disclosure provides various examples of the subject matter, and the subject matter is not limited to these examples. Various modifications to these aspects will be apparent to those skilled in the art, and the principles described herein can be applied to other aspects.

[0164] All structural and functional equivalents of elements throughout all aspects of this disclosure that are now or hereafter known to a person skilled in the art are expressly incorporated herein by reference and are intended to be covered by the claims. Furthermore, nothing herein is intended to be offered to the public, whether or not such disclosure is expressly stated in the claims. No element of any claim should be construed under paragraph 6 of 35 U.S.SC § 112 unless it is expressly stated using the phrase “means for…” or, in the case of a method claim, using the phrase “steps for…”.

[0165] The title, background information, description of the drawings, abstract, and figures are incorporated herein by reference and are provided as illustrative examples rather than limiting descriptions. They are intended not to limit the scope or meaning of the claims. Furthermore, in the detailed description, it will be apparent that the description provides illustrative examples and that various features are combined in various embodiments for the purpose of simplifying the disclosure. The approach of this disclosure should not be construed as reflecting an intention to require more features than expressly recited in each claim. Rather, as reflected in the following claims, the inventive subject matter lies in fewer than all features of a configuration or operation as disclosed in a single claim. The following claims are incorporated herein by reference, each claim being itself a separately claimed subject matter.

[0166] The claims are not intended to be limited to the aspects described herein, but rather to conform to the full scope consistent with the language claims and to cover all legal equivalents. Nevertheless, no claim is intended to include subject matter that does not meet the requirements of applicable patent law, nor should they be interpreted in this manner.

Claims

1. A computer-implemented method for performing multi-device sensing at a first device in a wireless network, the method comprising: The first device determines whether it is operating in a mode in which the first device and the second device cooperate to simultaneously transmit and receive radio frequency (RF) signals and the first device is within the distance of the second device. The first device and the second device exchange RF signals; Signal information is obtained from the exchanged RF signals by communicating with the second device; as well as Sensing is performed based on signal information.

2. The computer-implemented method according to claim 1, wherein, The execution sensing includes: Detecting human movement and respiratory rate from signal information; and Sleep status is estimated based on the detected human movement and breathing rate.

3. The computer-implemented method according to claim 1 or claim 2, wherein, The execution sensing includes: The signal information indicates the movement of the person exercising; Doppler patterns are extracted from the signal information to estimate exercise information during the time period when the person is identified as exercising, including calories burned and the number of exercise repetitions; and Output the exercise information.

4. The computer-implemented method according to any one of claims 1 to 3, wherein, The determination includes: Establish a wireless link between the first device and the second device; Measure the signal strength of the RF signal transmitted by the second device; Compare the signal strength with a threshold; and The first device is determined to operate in the mode based on a signal strength greater than the threshold.

5. The computer-implemented method according to any one of claims 1 to 3, wherein, The determination includes: Establish a wireless link between the first device and the second device; Determine the round-trip time (RTT) value of the RF signal transmitted by the first device; Compare RTT with a threshold; and The first device is determined to operate in the mode based on the RTT being less than the threshold.

6. The computer-implemented method according to any one of claims 1 to 3, wherein, The determination includes: Determine the energy of the audio signal transmitted by the second device; Compare the energy of the audio signal with a threshold; and The first device is determined to operate in the mode based on the energy of the audio signal being greater than the threshold.

7. The computer-implemented method according to any one of claims 1 to 3, wherein, The determination includes: It is determined that the second device is being charged by the first device; and Based on the fact that the second device is being charged by the first device, it is determined that the first device is operating in the mode.

8. The computer-implemented method according to any one of claims 1 to 3, wherein, The determination includes: Determine whether the first and second devices are being charged by the charging device; and Based on the fact that the first device and the second device are being charged by the charging device, it is determined that the first device is operating in the mode.

9. The computer-implemented method according to any one of claims 1 to 8, further comprising: Convert the RF signal between the first device and the second device into a channel impulse response (CIR); Based on CIR, the person is determined to be within a threshold distance; as well as Information related to the battery level of the first device is displayed based on the distance between the person and the threshold.

10. The computer-implemented method according to claim 9, further comprising: Using the camera on the first device, a facial recognition process is used to identify the person; as well as Information is displayed based on a person's identity.

11. A computer-readable storage medium storing one or more instructions, wherein, When the one or more instructions are executed individually or jointly by at least one processor, the at least one processor causes the at least one processor to perform the method according to any one of claims 1 to 10.

12. A first device in a wireless network, the first device comprising: Memory, including one or more storage media that store instructions; as well as At least one processor, including processing circuitry and coupled to the memory, Wherein, when the one or more instructions are executed individually or jointly by the at least one processor, the first device causes to perform the following operations: Determine whether the first device is operating in a mode in which the first device and the second device cooperate to simultaneously transmit and receive radio frequency (RF) signals and the first device is within the distance of the second device; Exchange RF signals with the second device; Signal information is obtained from the exchanged RF signals by communicating with the second device; and Sensing is performed based on signal information.

13. The first device according to claim 12, wherein, When executed by the at least one processor, the one or more instructions also cause the first device to perform sensing by: Detecting human movement and respiratory rate from signal information; and Sleep status is estimated based on the detected human movement and breathing rate.

14. The first device according to claim 12 or 13, wherein, When executed by the at least one processor, the one or more instructions also cause the first device to perform sensing by: The signal information indicates the movement of the person exercising; Doppler patterns are extracted from the signal information to estimate exercise information during the time period when the person is identified as exercising, including calories burned and the number of exercise repetitions; and Output the exercise information.

15. The first device according to any one of claims 12 to 14, wherein, When executed by the at least one processor, the one or more instructions further cause the first device to perform the following operations: Convert the RF signal between the first device and the second device into a channel impulse response (CIR); Based on CIR, the person is determined to be within a threshold distance; as well as When a person is within the threshold distance, information related to the battery level of the first device is displayed.

Images