Sensing method and apparatus therefor

Abstract

This application discloses a sensing method and apparatus. The apparatus includes a sensing device, a home appliance, a computer-readable storage medium, and a computer program product. The sensing method is applied to a sensing device, which includes a first Wi-Fi and a second Wi-Fi. The sensing method includes: controlling the first Wi-Fi to periodically transmit wireless signals; acquiring the reflected wireless signals received by the second Wi-Fi; and processing and analyzing the reflected wireless signals to obtain motion data of objects in the sensing environment. Through this approach, the sensing method of this application, based on a dual Wi-Fi module architecture, enables the wireless signals to form a closed-loop link at the device end, achieving a self-transmitting and self-receiving working mode. This not only effectively overcomes protocol compatibility limitations but also ensures the reliability and stability of the Wi-Fi sensing function.

Description

Technical Field

[0001] This application relates to the field of sensing technology, specifically to a sensing method and apparatus, the apparatus including sensing devices, household appliances, computer-readable storage media, and computer program products. Background Technology

[0002] Currently, smart home appliances mainly rely on hardware such as cameras and infrared sensors to achieve environmental perception. However, the deployment of additional hardware usually leads to increased costs and maintenance difficulties, and cameras pose a risk of privacy leaks. While existing Wi-Fi sensing technology can integrate communication and sensing using existing Wi-Fi infrastructure, it still suffers from problems such as poor protocol compatibility. Summary of the Invention

[0003] To address the aforementioned problems, this application proposes a sensing method and apparatus, which aims to resolve the problems described above.

[0004] To solve the above-mentioned technical problems, one technical solution adopted in this application is: to provide a sensing method, which is applied to a sensing device, the sensing device including a first Wi-Fi and a second Wi-Fi, the sensing method including: controlling the first Wi-Fi to periodically transmit wireless signals; acquiring the reflected path wireless signals received by the second Wi-Fi; and processing and analyzing the reflected path wireless signals to obtain motion data of objects in the sensing environment.

[0005] The first Wi-Fi and the second Wi-Fi are integrated on the same circuit board and share the same crystal oscillator.

[0006] The first Wi-Fi is configured to operate in both wireless terminal mode and hotspot mode, and the second Wi-Fi is configured to operate in wireless terminal mode. The wireless terminal mode of the first Wi-Fi is used to connect to an external network, and the second Wi-Fi connects to the hotspot mode of the first Wi-Fi through the wireless terminal mode.

[0007] The steps of processing and analyzing the reflector wireless signal to obtain motion data of objects in the sensing environment include: obtaining channel state information based on the transmitted predefined signal and the reflector wireless signal; and performing feature analysis on the channel state information to obtain motion data of objects in the sensing environment.

[0008] The step of performing feature analysis on channel state information to obtain motion data of objects in the perceived environment includes: performing feature analysis on channel state information to obtain the amplitude and phase corresponding to the channel state information; and inputting the amplitude and phase into the activity recognition model to obtain motion data corresponding to objects in the perceived environment.

[0009] To solve the above-mentioned technical problems, another technical solution adopted in this application is: to provide a sensing device, which includes a fixedly installed first Wi-Fi and second Wi-Fi and a processor, wherein the processor is connected to the first Wi-Fi and the second Wi-Fi to execute the sensing method that implements any of the above-mentioned methods.

[0010] The antenna for the first Wi-Fi is configured as an omnidirectional antenna, and the antenna for the second Wi-Fi is configured as a panel-oriented antenna.

[0011] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide a home appliance that includes the sensing device of any of the above-mentioned items.

[0012] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide a computer-readable storage medium that stores program instructions internally, which are executed to implement any of the above-mentioned sensing methods.

[0013] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide a computer program product, which includes a computer program and is executed by a processor to implement the perception method of any of the above-mentioned methods.

[0014] The beneficial effects of this application are as follows: Unlike existing technologies, the sensing method of this application includes: controlling a first Wi-Fi network to periodically transmit wireless signals; acquiring the reflected path wireless signals received by a second Wi-Fi network; and processing and analyzing the reflected path wireless signals to obtain motion data of objects in the sensing environment. Through the above methods, the sensing method of this application is based on dual Wi-Fi networks. The Fi module architecture enables the wireless signal to form a closed-loop link at the device end, achieving a self-transmitting and self-receiving working mode. This not only effectively overcomes protocol compatibility limitations but also ensures Wi-Fi security. Reliability and stability of Fi sensing function. Attached Figure Description

[0015] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with this application and, together with the specification, serve to explain the technical solutions of this application.

[0016] Figure 1 This is a flowchart illustrating an embodiment of the sensing method provided in this application; Figure 2 This is a schematic diagram of an embodiment of the sensing device provided in this application sensing an object; Figure 3 This is a schematic diagram illustrating the integration of the first and second Wi-Fi networks in this application; Figure 4 yes Figure 1 A flowchart illustrating an embodiment of step S103; Figure 5 yes Figure 4 A flowchart illustrating an embodiment of step S202; Figure 6 This is a schematic diagram of the structure of an embodiment of the sensing device provided in this application; Figure 7 This is a schematic diagram of the structure of an embodiment of the home appliance provided in this application; Figure 8 This is a schematic diagram of an embodiment of the computer-readable storage medium provided in this application. Detailed Implementation

[0017] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0018] Currently, smart home appliances mainly rely on hardware such as cameras and infrared sensors to achieve environmental perception. However, the deployment of additional hardware usually leads to increased costs and maintenance difficulties, and cameras pose a risk of privacy leaks. While existing Wi-Fi sensing technology can integrate communication and sensing using existing Wi-Fi infrastructure, it still suffers from problems such as poor protocol compatibility.

[0019] For example, while existing Wi-Fi sensing technologies perform well in experimental environments, in real-world home environments, individual smart home appliances must be connected to the home router or Wi-Fi hotspot for the Wi-Fi sensing function to work properly. However, not all routers support plaintext Channel State Information (CSI) in actual use, thus preventing sensing from being achieved.

[0020] To address the aforementioned problems, this application first proposes a sensing method, please refer to [link to relevant documentation]. Figure 1 , Figure 1 This is a schematic flowchart of an embodiment of the sensing method provided in this application. In this embodiment, the sensing method is applied to a sensing device, which includes a first Wi-Fi and a second Wi-Fi, such as... Figure 1 As shown, the sensing method in this embodiment specifically includes steps S101 to S103: Step S101: Control the first Wi-Fi to periodically send out wireless signals.

[0021] In this embodiment, the sensing device is equipped with dual Wi-Fi modules, namely a first Wi-Fi and a second Wi-Fi. During the sensing process, the sensing device first controls the first Wi-Fi to connect to the omnidirectional antenna and periodically sends out wireless signals.

[0022] Step S102: Obtain the reflected wireless signal received by the second Wi-Fi.

[0023] During the operation of the first Wi-Fi network, its transmitted wireless signal is reflected by environmental objects and reaches the sensing range of the second Wi-Fi receiving antenna. At this time, the second Wi-Fi network can receive and acquire the reflected wireless signal through its receiving antenna.

[0024] Step S103: Process and analyze the reflected wireless signal to obtain motion data of objects in the sensing environment.

[0025] After acquiring the reflected path wireless signal received by the second Wi-Fi through the receiving antenna, the sensing device in this embodiment can process and analyze the reflected path wireless signal, obtain the channel state information of the reflected path wireless signal, and obtain motion data of objects in the sensing environment based on the channel state information.

[0026] For example, please refer to Figure 2 , Figure 2 This is a schematic diagram of an embodiment of the sensing device provided in this application sensing an object. Figure 2 As shown, the first Wi-Fi and the second Wi-Fi are integrated on the same circuit board. The first Wi-Fi periodically transmits wireless signals through a first antenna and connects to a router via the first antenna for network access. The wireless signals transmitted by the first antenna are reflected by environmental objects, becoming reflected wireless signals that reach the sensing range of the second Wi-Fi receiving antenna. The second Wi-Fi receives these reflected wireless signals through the second antenna, and the sensing device can analyze these signals to obtain corresponding channel state information and, based on this information, acquire motion data of objects in the sensing environment. The second antenna of the second Wi-Fi can have its sensing radius and sensing angle adjusted by changing its installation angle and parameters.

[0027] Unlike existing technologies, the sensing method of this application includes: controlling a first Wi-Fi network to periodically transmit wireless signals; acquiring reflected wireless signals received by a second Wi-Fi network; and processing and analyzing the reflected wireless signals to obtain motion data of objects in the sensing environment. Through the above methods, the sensing method of this application is based on dual Wi-Fi networks. The Fi module architecture enables the wireless signal to form a closed-loop link at the device end, achieving a self-transmitting and self-receiving working mode. This not only effectively overcomes protocol compatibility limitations but also ensures Wi-Fi security. Reliability and stability of Fi sensing function.

[0028] Optionally, based on the above embodiments, please refer to Figure 3 , Figure 3 This is a schematic diagram illustrating the integration of the first and second Wi-Fi networks in this application. Figure 3 As shown, in this embodiment, the first Wi-Fi and the second Wi-Fi are integrated on the same circuit board and share the same crystal oscillator.

[0029] In this embodiment, the first Wi-Fi and the second Wi-Fi are physically integrated on the same circuit board and share the same crystal oscillator. The crystal oscillator can provide a precise reference clock signal. In this embodiment, the crystal oscillator is directly connected to the clock input of the two Wi-Fis as a clock source, thereby ensuring that the two Wi-Fis remain completely synchronized when sampling signals.

[0030] To explain the principle of resolving channel state information (CSO) phase offset through clock synchronization, it is necessary to first analyze the mathematical model of CSO. CSO characterizes the propagation characteristics of a wireless signal from transmitter to receiver at a specific carrier frequency. The amplitude and phase of CSO are affected by multipath effects, including amplitude attenuation and phase offset. A single-antenna Wi-Fi channel is divided into multiple subcarriers using orthogonal frequency division multiplexing (OFDM). To measure CSO, the Wi-Fi transmitter sends Long Training Symbols (LTFs) in the packet preamble, containing predefined symbols for each subcarrier. When the LTFs are received, the Wi-Fi receiver estimates the CSO using the received reflected path wireless signal and the original LTFs. For each subcarrier, the Wi-Fi channel is modeled as y = Hx + n, where y represents the received reflected path wireless signal, x is the transmitted wireless signal, H represents the CSO, which is a complex number where the real part represents amplitude and the imaginary part represents phase, and n is the noise vector. After receiving and processing, the receiver uses a predefined wireless signal x and the received reflection path wireless signal y to estimate the channel state information. The complex value H of the estimated channel state information is shown in the following formula (1), where the subscript k of H represents the k-th subcarrier. That is, each measurement of the channel state information will generate the amplitude and phase corresponding to k subcarriers. Formula (1) is shown below: (1) Among them, in the formula Indicates the impact of multipath channels; This indicates the effect of sampling frequency offset; This indicates the impact of sampling time offset. Of the three impacts mentioned above, the multipath channel effect is for the purpose of channel state information measurement, while sampling frequency offset and sampling time offset are disturbances introduced by the asynchronous hardware clocks of the transmitter and receiver. This application, by using a shared crystal oscillator, can directly eliminate sampling frequency offset and sampling time offset, thereby eliminating these two types of interference.

[0031] Optionally, based on the above embodiments, in this embodiment, the first Wi-Fi is configured to operate in wireless terminal mode and hotspot mode, and the second Wi-Fi is configured to operate in wireless terminal mode; the wireless terminal mode of the first Wi-Fi is used to connect to an external network, and the second Wi-Fi connects to the hotspot mode of the first Wi-Fi through the wireless terminal mode.

[0032] In this embodiment, the first Wi-Fi operates in both wireless terminal mode and hotspot mode. The wireless terminal mode connects to external networks, such as a home router, while the hotspot mode provides an internal hotspot. The second Wi-Fi operates in wireless terminal mode and connects to the hotspot of the first Wi-Fi. Thus, the second Wi-Fi can communicate with the first Wi-Fi through the internal network. During operation, the first Wi-Fi sends signals, and the second Wi-Fi receives reflected signals. Simultaneously, the first Wi-Fi maintains its connection to the external network through wireless terminal mode, ensuring normal network connectivity for the device.

[0033] Through the above method, this embodiment configures the first Wi-Fi to operate simultaneously in wireless terminal mode and hotspot mode, ensuring that the device can stably access external networks and maintain the normal operation of daily network functions. Simultaneously, the second Wi-Fi is connected to the hotspot created by the first Wi-Fi via wireless terminal mode, enabling data to flow in a closed loop within the device and effectively solving protocol compatibility issues.

[0034] Optionally, based on the above embodiments, in this embodiment, please refer to Figure 4 , Figure 4 yes Figure 1 A flowchart illustrating an embodiment of step S103. This embodiment can be achieved through, as shown in... Figure 4 The steps shown in step S103 include steps S201 to S202: Step S201: Obtain channel state information based on the transmitted predefined signal and the reflection path wireless signal.

[0035] In this embodiment, after acquiring the reflective path wireless signal, the predefined signal transmitted by the first Wi-Fi can be acquired. As mentioned above, the channel state information can be estimated based on the predefined signal transmitted by the first Wi-Fi and the reflective path wireless signal.

[0036] Step S202: Perform feature analysis on the channel state information to obtain motion data of objects in the perceived environment.

[0037] After acquiring the corresponding channel state information, the sensing device can perform feature analysis on the channel state information to obtain motion data of objects in the sensing environment.

[0038] Optionally, based on the above embodiments, in this embodiment, please refer to Figure 5 , Figure 5 yes Figure 4 A flowchart illustrating an embodiment of step S202. This embodiment can be achieved through, as shown in... Figure 5 The steps shown in step S202 are implemented, specifically including steps S301 to S302: Step S301: Perform feature analysis on the channel state information to obtain the amplitude and phase corresponding to the channel state information.

[0039] In this embodiment, after obtaining the channel state information, feature analysis can be performed on the channel state information to obtain the amplitude and phase corresponding to the channel state information. The amplitude represents the change in signal strength, and the phase represents the signal phase shift. Both reflect the changes in channel characteristics caused by the movement of objects in the environment.

[0040] Step S302: Input the amplitude and phase into the activity recognition model to obtain motion data corresponding to objects in the perceived environment.

[0041] After acquiring the amplitude and phase, this embodiment can input them into the activity recognition model to obtain motion data corresponding to objects in the perceived environment. This activity recognition model is a pre-trained, lightweight machine learning model that processes the input amplitude and phase to output corresponding motion data of objects in the perceived environment.

[0042] In this embodiment, the use of an activity recognition model to process amplitude and phase data simplifies the feature processing flow, improves processing efficiency, and further enhances the real-time performance and accuracy of motion data acquisition.

[0043] Optionally, this application further proposes a sensing device, please refer to [link to relevant documentation]. Figure 6 , Figure 6 This is a schematic diagram of the structure of an embodiment of the sensing device provided in this application. Figure 6 As shown, the sensing device 100 of this embodiment includes a fixedly configured first Wi-Fi 10 and second Wi-Fi 20, and a processor 30, wherein the processor 30 is connected to the first Wi-Fi 10 and the second Wi-Fi 20 to execute the sensing method implementing any of the above embodiments.

[0044] Optionally, based on the above embodiments, in this embodiment, the antenna of the first Wi-Fi 10 is configured as an omnidirectional antenna, and the antenna of the second Wi-Fi 20 is configured as a panel directional antenna.

[0045] In this embodiment, the antenna of the first Wi-Fi 10 can be used both as a STA mode connection to the router for network communication and as a wireless signal transmitting antenna; the antenna of the second Wi-Fi 20 is only used as a receiving antenna for the reflected wireless signal. In this embodiment, the sensing radius and angle of the receiving antenna can be changed by adjusting the installation angle and parameters of the panel directional antenna; the wireless signal transmission from the antenna of the first Wi-Fi 10 to the antenna of the second Wi-Fi 20 is divided into the direct path and the reflected path. In this application, the movement of objects only affects the channel state information characteristics by changing the reflected wireless signal; in this embodiment, the antennas of the first Wi-Fi 10 and the second Wi-Fi 20 can be fixedly installed on home appliances (such as both ends of an air conditioner indoor unit). In this case, the direct path can be considered to remain unchanged.

[0046] Optionally, this application further proposes a household appliance; please refer to [link / reference]. Figure 7 , Figure 7 This is a schematic diagram of the structure of an embodiment of the household appliance provided in this application. Figure 7 As shown, the home appliance 200 in this embodiment includes the sensing device 100 of any of the above embodiments.

[0047] In this embodiment, the home appliance 200 can be a refrigerator, air conditioner, washing machine, or range hood, etc., and there is no limitation.

[0048] Optionally, this application further proposes a computer-readable storage medium. See also... Figure 8 , Figure 8 This is a schematic diagram of an embodiment of the computer-readable storage medium provided in this application.

[0049] The computer-readable storage medium 300 of this application embodiment stores program instructions 310, which are executed by a processor to implement the perception method of any of the above embodiments.

[0050] Specifically, program instructions 310 can form a program file and be stored in the aforementioned storage medium as a software product, so that an electronic device (which may be a personal computer, server, or network device, etc.) or processor can execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks, or terminal devices such as computers, servers, mobile phones, and tablets.

[0051] In this embodiment, the computer-readable storage medium 300 may be, but is not limited to, a USB flash drive, SD card, PD optical drive, portable hard drive, large-capacity floppy drive, flash memory, multimedia memory card, server, etc.

[0052] In one embodiment, a computer program product or computer program is provided, which includes a computer program that, when executed by a processor, is capable of implementing the steps of the methods described in any of the foregoing embodiments. Specifically, the computer program product may be a software or program product containing a computer program that can run on a computing device or be stored on any available medium.

[0053] Furthermore, if the aforementioned functions are implemented as software functions and sold or used as independent products, they can be stored in a mobile terminal-readable storage medium. That is, this application also provides a storage device storing program data, which can be executed to implement the methods of the above embodiments. This storage device can be, for example, a USB flash drive, an optical disc, or a server. In other words, this application can be embodied in the form of a software product, which includes several instructions to cause a smart terminal to execute all or part of the steps of the methods described in the various embodiments.

[0054] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0055] Any process or method description in the flowchart or otherwise herein can be understood as representing an apparatus, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order according to the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0056] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (which may be a personal computer, server, network device, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0057] The above are merely embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A sensing method, characterized in that, The sensing method is applied to a sensing device, which includes a first Wi-Fi and a second Wi-Fi, and includes: Control the first Wi-Fi to periodically send out wireless signals; Acquire the reflected path wireless signal received by the second Wi-Fi; The reflected wireless signal is processed and analyzed to obtain motion data of objects in the perceived environment.

2. The sensing method according to claim 1, characterized in that, The first Wi-Fi and the second Wi-Fi are integrated on the same circuit board and share the same crystal oscillator.

3. The sensing method according to claim 1, characterized in that, The first Wi-Fi is configured to operate in both wireless terminal mode and hotspot mode, and the second Wi-Fi is configured to operate in wireless terminal mode; the wireless terminal mode of the first Wi-Fi is used to connect to an external network, and the second Wi-Fi connects to the hotspot mode of the first Wi-Fi through the wireless terminal mode.

4. The sensing method according to claim 1, characterized in that, The step of processing and analyzing the reflected wireless signal to obtain motion data of objects in the perceived environment includes: Channel state information is obtained based on the transmitted predefined signal and the reflected path wireless signal; Feature analysis is performed on the channel state information to obtain motion data of objects in the perceived environment.

5. The sensing method according to claim 4, characterized in that, The step of performing feature analysis on the channel state information to obtain motion data of objects in the perceived environment includes: The channel state information is subjected to feature analysis to obtain the amplitude and phase corresponding to the channel state information; The amplitude and phase are input into the activity recognition model to obtain motion data corresponding to objects in the perceived environment.

6. A sensing device, characterized in that, The sensing device includes a fixed first Wi-Fi and a second Wi-Fi, and a processor, wherein the processor is connected to the first Wi-Fi and the second Wi-Fi to execute the sensing method according to any one of claims 1-5.

7. The sensing device according to claim 6, characterized in that, The antenna of the first Wi-Fi is configured as an omnidirectional antenna, and the antenna of the second Wi-Fi is configured as a panel-oriented antenna.

8. A household appliance, characterized in that, The home appliance includes the sensing device according to any one of claims 6-7.

9. A computer-readable storage medium, characterized in that, It internally stores program instructions that are executed to implement the sensing method according to any one of claims 1-5.

10. A computer program product, characterized in that, Includes a computer program, which is executed by a processor to implement the sensing method according to any one of claims 1-5.

Images