Method, device and system for determining status of person in intelligent manner on basis of csi

Abstract

The present application relates to the technical field of the Internet of Things. Specifically disclosed are a method, device and system for determining the status of a person in an intelligent manner on the basis of CSI. The method comprises: a sensing device receiving a CSI data packet sent by each sensing device from among other sensing devices, wherein each of the other sensing devices sends a corresponding CSI data packet to the sensing device at the same time; and the sensing device analyzing the CSI data packet corresponding to each of the other sensing devices, so as to obtain CSI features of channel propagation paths between the sensing device and the other sensing devices, thereby sensing the status of a person in space, for example, the location of the person in the space. The granularity and accuracy for sensing the statuses of persons are improved, and therefore the accuracy and precision for localizing the location of persons are improved.

Description

Methods, equipment, and systems for determining personnel status based on CSI (Computer-In-Sight) intelligence. Technical Field

[0001] This application relates to the field of Internet of Things (IoT) technology, and in particular to a method, device, and system for determining the status of personnel based on CSI (Care Information System). Background Technology

[0002] Currently, when it is necessary to determine the location of a person in a certain space, such as the location of a person in a living room, it is often done by receiving CSI (Channel State Information) data packets in that space through equipment in that space, and then analyzing the data packets to determine the location of the person in the space.

[0003] However, in practice, it has been found that each existing device can only detect the signal path between itself and the router, and there are often multiple devices in the space. The signal paths detected by multiple devices can easily overlap, making it impossible to accurately locate the position of people.

[0004] Therefore, technical solutions that improve the accuracy of multiple devices in sensing the status of personnel, thereby improving the accuracy of personnel location positioning, are particularly important. Summary of the Invention

[0005] The technical problem to be solved by this application is to provide a method, device and system for determining personnel status based on CSI, which can improve the accuracy of the perception granularity of personnel status by multiple devices, thereby improving the accuracy of personnel location positioning.

[0006] To address the aforementioned technical problems, the first aspect of this application discloses a method for determining personnel status based on CSI (Computer-In-Sight) intelligence. This method is applied to a sensing system comprising multiple sensing devices. All sensing devices are connected via the same channel and reside in the same space. For any of the sensing devices, the method includes:

[0007] The sensing device receives CSI data packets sent by each other sensing device, and each of the other sensing devices sends a corresponding CSI data packet to the sensing device at the same time;

[0008] The sensing device analyzes the CSI data packets corresponding to each of the other sensing devices to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device;

[0009] The CSI feature corresponding to each of the other sensing devices is used as the basis for determining the status data of the person in the space, and the status data of the person in the space includes the position of the person in the space.

[0010] As an optional implementation, in the first aspect of this application, each of the other sensing devices sends a CSI data packet carrying an identifier;

[0011] The method further includes:

[0012] The sensing device filters out all the required target CSI data packets from all the CSI data packets based on the identifier carried by each CSI data packet;

[0013] The sensing device analyzes the CSI data packets corresponding to each of the other sensing devices to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device, including:

[0014] The sensing device analyzes each target CSI data packet to obtain the CSI characteristics of the channel propagation path between the sensing device and other sensing devices corresponding to the target CSI data packet.

[0015] As an optional implementation, in the first aspect of this application, the identifier carried in the CSI data packet corresponding to each of the other sensing devices includes the identifier of the other sensing device and / or the identifier of the receiving sensing device that requires the CSI data packet;

[0016] The sensing device, based on the identifier carried in each CSI data packet, filters out all desired target CSI data packets from all CSI data packets, including:

[0017] The sensing device determines whether there is an identifier that matches the sensing device identifier among the identifiers carried in all the CSI data packets.

[0018] When it is determined that the existence exists, the sensing device filters out all target identifiers that match the sensing device identifier from all the identifiers carried in the CSI data packets;

[0019] The sensing device filters CSI data packets that match each target identifier from all the CSI data packets.

[0020] All target CSI data packets consist of CSI data packets corresponding to each target identifier.

[0021] As an optional implementation, in the first aspect of this application, the method further includes:

[0022] The sensing device analyzes the CSI features corresponding to each of the other sensing devices to obtain the personnel status analysis result corresponding to the other sensing device. The personnel status analysis result corresponding to each other sensing device includes the area where the personnel are located in the target space that matches the other sensing device. The target space is located in the space. The area corresponding to each other sensing device includes a first area or a second area. The area of ​​the first area is smaller than the area of ​​the second area.

[0023] The sensing device determines the activity analysis results of the personnel in the space based on the personnel status analysis results corresponding to all the other sensing devices.

[0024] As an optional implementation, in the first aspect of this application, the sensing system further includes a server;

[0025] The activity analysis results for each of the aforementioned sensing devices include the distance of personnel moving relative to that sensing device.

[0026] The method further includes:

[0027] The server receives the activity analysis results corresponding to each of the sensing devices, and each sensing device sends its corresponding activity analysis results to the server at the same time.

[0028] The server determines the activity area of ​​the person in the space based on the activity analysis results corresponding to each of the sensing devices.

[0029] As an optional implementation, in the first aspect of this application, the server determines the activity area of ​​a person in the space based on the activity analysis results corresponding to each of the sensing devices, including:

[0030] For any of the aforementioned sensing devices, the server analyzes the activity distance corresponding to the sensing device to obtain the personnel activity area corresponding to the sensing device;

[0031] The server determines the activity area of ​​a person in the space based on the activity area of ​​the person corresponding to each sensing device.

[0032] The second aspect of this application discloses a sensing system for intelligently determining the status of personnel based on CSI. The sensing system includes multiple sensing devices, all of which are interconnected via the same channel and located in the same space. For any one of the sensing devices, the sensing device includes:

[0033] The communication module is used to receive CSI data packets sent by each other sensing device, and each of the other sensing devices sends a corresponding CSI data packet to the sensing device at the same time;

[0034] The analysis module is used to analyze the CSI data packets corresponding to each of the other sensing devices to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device;

[0035] The CSI features corresponding to each of the other sensing devices are used as the basis for determining the status data of the person in the space, wherein the status data of the person in the space includes the position of the person in the space.

[0036] As an optional implementation, in the second aspect of this application, each of the other sensing devices sends a CSI data packet carrying an identifier;

[0037] The sensing device also includes:

[0038] The filtering module is used to filter out all the desired target CSI data packets from all the CSI data packets based on the identifier carried by each CSI data packet;

[0039] The analysis module analyzes the CSI data packets corresponding to each of the other sensing devices to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device in a specific way, including:

[0040] Each target CSI data packet is analyzed to obtain the CSI characteristics of the channel propagation path between the sensing device and other sensing devices corresponding to the target CSI data packet.

[0041] As an optional implementation, in the second aspect of this application, the identifier carried in the CSI data packet corresponding to each of the other sensing devices includes the identifier of the other sensing device and / or the identifier of the receiving sensing device that requires the CSI data packet;

[0042] The specific method by which the filtering module selects all desired target CSI data packets from all CSI data packets based on the identifier carried by each CSI data packet includes:

[0043] Determine whether there is an identifier among all the identifiers carried in the CSI data packets that matches the sensing device identifier of the sensing device;

[0044] When it is determined that the existence exists, all target identifiers that match the sensing device identifier of the sensing device are filtered out from the identifiers carried by all the CSI data packets.

[0045] Based on each target identifier, filter out CSI data packets that match that target identifier from all the CSI data packets;

[0046] All target CSI data packets consist of CSI data packets corresponding to each target identifier.

[0047] As an optional implementation, in the second aspect of this application, the analysis module is further configured to analyze the CSI features corresponding to each of the other sensing devices to obtain the personnel status analysis result corresponding to the other sensing device. The personnel status analysis result corresponding to each of the other sensing devices includes the area where the personnel are located in the target space that matches the other sensing device. The target space is located in the space. The area corresponding to each of the other sensing devices includes a first area or a second area. The area of ​​the first area is smaller than the area of ​​the second area.

[0048] The sensing device also includes:

[0049] The first determining module is used to determine the activity analysis results of personnel in the space based on the personnel status analysis results corresponding to all the other sensing devices.

[0050] As an optional implementation, in the second aspect of this application, the sensing system further includes a server;

[0051] The activity analysis results for each of the aforementioned sensing devices include the distance of personnel moving relative to that sensing device.

[0052] The server includes:

[0053] The receiving module is used to receive the activity analysis results corresponding to each of the sensing devices, and each of the sensing devices sends the corresponding activity analysis results to the server at the same time.

[0054] The second determining module is used to determine the activity area of ​​personnel in the space based on the activity analysis results corresponding to each of the sensing devices.

[0055] As an optional implementation, in a second aspect of this application, the second determining module determines the specific method by which it determines the activity area of ​​a person in the space based on the activity analysis results corresponding to each of the sensing devices, including:

[0056] For any of the aforementioned sensing devices, analyze the activity distance corresponding to the sensing device to obtain the personnel activity area corresponding to the sensing device;

[0057] Based on the activity area of ​​the person corresponding to each of the sensing devices, the activity area of ​​the person in the space is determined.

[0058] A third aspect of this application discloses a sensing device, wherein multiple sensing devices constitute a sensing system, all sensing devices are connected for communication based on the same channel and are located in the same space, and for any one of the sensing devices, the sensing device includes:

[0059] Memory containing executable program code;

[0060] A processor coupled to the memory;

[0061] The processor calls the executable program code stored in the memory to execute the method for determining personnel status based on CSI, as disclosed in the first aspect of this application.

[0062] The fourth aspect of this application discloses a computer-readable storage medium storing computer instructions, which, when invoked, are used to execute the method for determining personnel status based on CSI intelligently disclosed in the first aspect of this application.

[0063] Compared with the prior art, the embodiments of this application have the following beneficial effects:

[0064] In this embodiment, the sensing system includes multiple sensing devices. All sensing devices communicate with each other through the same channel and are located in the same space. For any sensing device, the sensing device receives CSI data packets sent by each other sensing device. Each other sensing device sends its corresponding CSI data packet to the sensing device at the same time. The sensing device analyzes the CSI data packets corresponding to each other sensing device to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device, so as to sense the state of the person in the space, such as the position in the space, thereby improving the granularity accuracy of the multiple devices in sensing the state of the person, and thus improving the accuracy and precision of the person's location. Attached Figure Description

[0065] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0066] Figure 1 is a schematic diagram of a scenario of a method for determining the status of personnel based on CSI intelligence disclosed in an embodiment of this application;

[0067] Figure 2 is a flowchart illustrating a method for determining personnel status based on CSI intelligence, as disclosed in an embodiment of this application.

[0068] Figure 3 is a schematic diagram of a region sensing method disclosed in an embodiment of this application;

[0069] Figure 4 is another schematic diagram of area perception disclosed in an embodiment of this application;

[0070] Figure 5 is a schematic diagram of the structure of a perception system based on CSI intelligent determination of personnel status disclosed in an embodiment of this application;

[0071] Figure 6 is a schematic diagram of another sensing system based on CSI intelligent determination of personnel status disclosed in an embodiment of this application;

[0072] Figure 7 is a schematic diagram of the structure of a sensing device disclosed in an embodiment of this application. Detailed Implementation

[0073] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0074] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.

[0075] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0076] This application discloses a method, device, and system for intelligently determining personnel status based on CSI (Content Sense Indication). When receiving corresponding CSI data packets sent by each other sensing device simultaneously, the sensing device analyzes the CSI data packets corresponding to each other sensing device to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device, thereby sensing the personnel's status in space, such as their location in space. This improves the granularity accuracy of multiple devices' perception of personnel status, thereby improving the accuracy and precision of personnel location positioning. Detailed descriptions follow.

[0077] To better understand the method, device, and system for determining personnel status based on CSI intelligence described in this application, the applicable scenarios for the method are first described. Specifically, a schematic diagram of this scenario is shown in Figure 1, which is a schematic diagram of a scenario for a method for determining personnel status based on CSI intelligence according to an embodiment of this application. As shown in Figure 1, taking a smart home scenario as an example, this scenario is equipped with a corresponding sensing system and personnel. Personnel can move around in this smart home scenario. The sensing system includes multiple sensing devices and a server, wherein each sensing device and server communicates with each other based on the same channel. It should be noted that any network providing device that can provide the same channel is within the scope of this application, such as a router that can provide WIFI. The server includes a cloud server or a local server. Furthermore, all sensing devices include, but are not limited to, smart home devices and / or non-smart home devices. Smart home devices include one or more of the following: smart door locks, smart refrigerators, smart cleaning equipment, smart fans, smart sofas, smart air conditioners, smart TVs, etc. Non-smart home devices may include one or more of the following: mobile phones, computers, smart bracelets, smart glasses, network providing devices, etc. The network provider can be any device capable of providing a network for other sensing devices. As shown in Figure 1, a smart refrigerator, smart sofa, and smart TV are placed together in the living room, with a table in the room. When someone walks from the smart refrigerator towards the smart TV, the CSI data sensed by the smart refrigerator, smart sofa, and smart TV will all be disturbed. Using the smart TV as the receiving device, the CSI data packets sent by the smart refrigerator and smart sofa at the same time are received. The received CSI data packets are analyzed separately to obtain the CSI characteristics of the channel propagation path between the smart TV and the smart refrigerator, and the CSI characteristics of the channel propagation path between the smart TV and the smart sofa. A comprehensive analysis of the CSI characteristics corresponding to these two channel propagation paths is then performed to determine if a person is approaching the smart TV.

[0078] It should be noted that the scenario diagram shown in Figure 1 is only intended to illustrate the applicable scenarios for the CSI-based intelligent determination of personnel status. The sensing systems, sensing devices, and network providing equipment involved are also only illustrative, and the scenario diagram in Figure 1 is not intended to limit the scope of the application. The following is a detailed description of the CSI-based intelligent determination of personnel status method, equipment, and system.

[0079] Example 1

[0080] Please refer to Figure 2, which is a flowchart illustrating a method for determining personnel status based on CSI intelligence according to an embodiment of this application. The method described in Figure 2 can be applied to any scenario requiring the perception of personnel status, such as personnel location perception in a smart home scenario or personnel location perception in an inspection scenario. This scenario is equipped with a corresponding perception system, which includes multiple perception devices. All perception devices communicate with each other via the same channel and are located in the same space. The perception system may also include a server, and each perception device can communicate with the server. The server may be a cloud server or a local server. Furthermore, all perception devices include, but are not limited to, smart home devices and / or non-smart home devices. Smart home devices include one or more of smart door locks, smart refrigerators, smart cleaning equipment, smart fans, smart TVs, etc. Non-smart home devices may include one or more of mobile phones, computers, smart bracelets, smart glasses, network providers, etc. As shown in Figure 2, for any perception device, the method may include the following operations:

[0081] 101. The sensing device receives CSI data packets sent by each other sensing device, and each other sensing device sends its corresponding CSI data packet to the sensing device at the same time.

[0082] In this embodiment, optionally, "same time" can be understood as the same instant or the same time period. It should be noted that each sensing device in the sensing system will perform the same operation simultaneously. This description focuses on the execution process of one sensing device; the execution processes of other sensing devices can be found here.

[0083] In this embodiment, optionally, the CSI data packet includes CSI amplitude data, CSI phase data, and time delay data. Further, it may also include one or more of the following: a checksum, a timestamp, a path type, a label representing the actual scene area corresponding to the path, and the distance between the sensing device and other sensing devices. The checksum is used by the sensing device to verify the integrity of the received CSI data packet, and upon successful verification, step 102 is executed on the corresponding CSI data packet. The timestamp includes the packet transmission time and / or clock synchronization marker of the corresponding CSI data packet. The packet transmission time is used by the sensing device to calculate the signal propagation delay to assist in positioning, such as determining the activity distance of personnel through time difference; the clock synchronization marker is used by the sensing device to time-align the CSI data packets on this channel propagation path with CSI data packets on other channel propagation paths for more accurate CSI data packet analysis. The path type includes a direct path type or a reflected path type. The direct path type indicates that no personnel have passed through the corresponding channel propagation path, while the reflected path type indicates that personnel have passed through the corresponding channel propagation path. The label representing the actual scene area corresponding to the path includes a long dashed line area label and a short dashed line area label. Each sensing device has a corresponding long dashed line region and a short dashed line region. The long and short dashed line regions correspond to the actual location of the sensing device in the current scene. The short dashed line region represents a region with high-frequency phase perturbation and low latency, while the long dashed line region represents a region with low-frequency amplitude attenuation and high latency.

[0084] 102. The sensing device analyzes the CSI data packets corresponding to each other sensing device to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device. The CSI characteristics corresponding to each other sensing device are used as the basis for determining the status data of personnel in space. The status data of personnel in space includes the position of personnel in space.

[0085] In this embodiment of the application, optionally, the CSI features include CSI amplitude features / phase features and time delay features / spectral features. Furthermore, the CSI features also include the actual scene region label corresponding to the path.

[0086] In this embodiment of the application, optionally, the status data of a person in space may also include the person's limb movements and / or facial movements at the corresponding position.

[0087] As can be seen, when implementing this application, when each other sensing device sends a corresponding CSI data packet at the same time, the sensing device analyzes the CSI data packet corresponding to each other sensing device to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device, so as to sense the state of the person in space, such as the position in space, improve the granularity accuracy of multiple devices in sensing the state of the person, thereby improving the accuracy and precision of the person's location.

[0088] In an optional embodiment, the method may further include the following steps:

[0089] The sensing device filters out all the required target CSI data packets from all CSI data packets based on the identifier carried by each CSI data packet;

[0090] Specifically, the sensing device analyzes the CSI data packets corresponding to each other sensing device to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device, including:

[0091] The sensing device analyzes each target CSI data packet to obtain the CSI characteristics of the channel propagation path between the sensing device and other sensing devices corresponding to that target CSI data packet.

[0092] In this optional embodiment, each CSI data packet sent by another sensing device may optionally carry an identifier. The identifier carried in the CSI data packet corresponding to each other sensing device includes the identifier of the other sensing device and / or the identifier of the receiving sensing device that requires the CSI data packet. The identifier of the other sensing device includes a device identifier and / or a MAC address identifier; the identifier of the receiving sensing device includes a device identifier and / or a MAC address identifier. The identifier of the other sensing device is used by the sensing device to identify which other sensing device sent the corresponding CSI data packet, so that the sensing device can distinguish the corresponding propagation path.

[0093] As can be seen, after receiving CSI data packets sent by other sensing devices, this optional embodiment further filters out the CSI data packets it needs based on the identifiers carried by the CSI data packets, thereby improving the accuracy of CSI data packet acquisition, which in turn helps to improve the accuracy of CSI data packet analysis, and further helps to improve the accuracy of determining the status of personnel in space.

[0094] In this optional embodiment, optionally, the sensing device filters out all desired target CSI data packets from all CSI data packets based on the identifier carried by each CSI data packet, including:

[0095] The sensing device determines whether there is an identifier that matches the sensing device's identifier among all the identifiers carried in the CSI data packets;

[0096] When its existence is determined, the sensing device filters out all target identifiers that match the sensing device identifier from all the identifiers carried in all CSI data packets;

[0097] The sensing device filters out CSI data packets that match each target identifier from all CSI data packets;

[0098] Each target CSI data packet consists of a CSI data packet corresponding to each target identifier.

[0099] In this optional embodiment, for any CSI data packet, if it is determined that the identifier of the receiving sensing device in the identifier it carries contains the device identifier of the sensing device, and / or if it is determined that the identifier of another sensing device in the identifier it carries matches the identifier stored in the sensing device, or if the sensing device can parse the identifier of the other sensing device, then it is determined that it exists; otherwise, it does not exist. In this case, the received CSI data packet is discarded, or steps 101-102 are re-executed.

[0100] As can be seen, this optional embodiment improves the accuracy and efficiency of identifier comparison by comparing the identifier carried by the received CSI data with its own identifier, thereby improving the accuracy of filtering the required CSI data packets.

[0101] In another alternative embodiment, the method may further include the following steps:

[0102] The sensing device analyzes the CSI features corresponding to each other sensing device to obtain the personnel status analysis results corresponding to that other sensing device;

[0103] The sensing devices determine the activity analysis results of personnel in the space based on the personnel status analysis results corresponding to all other sensing devices.

[0104] In this optional embodiment, the personnel status analysis result corresponding to each other sensing device may include the area where the personnel are located in the target space matching the other sensing device. The target space is located in space, and the area corresponding to each other sensing device includes a first area or a second area. The area of ​​the first area is smaller than the area of ​​the second area. The first area is a high-frequency phase disturbance and low-latency area, and the second area is a low-frequency amplitude attenuation and high-latency area. As shown in Figure 3, Figure 3 is a schematic diagram of area sensing disclosed in an embodiment of this application. As shown in Figure 3, devices STA1, STA2, and AP are represented by “○”, “○”, and “△”, respectively. There are two long dashed line areas a1 and a2 and four short dashed line areas b1, b2, b3, and b4. The area with the larger channel carrier disturbance indicates that the personnel are in the corresponding area. For example, if the personnel status analysis result indicates that the channel carrier disturbance in area b1 is larger, it means that the personnel are in area b1.

[0105] As can be seen, this optional embodiment can more accurately determine the area where people are actually active by comprehensively analyzing the personnel status analysis results corresponding to all other sensing devices received, thereby further improving the accuracy and reliability of personnel location positioning.

[0106] In this optional embodiment, the sensing device analyzes the CSI features corresponding to each other sensing device to obtain the personnel status analysis results corresponding to that other sensing device, including:

[0107] For any other sensing device, the sensing device determines the path weight of the channel propagation path corresponding to the other sensing device based on the CSI characteristics of the other sensing device, and determines the personnel status analysis result of the other sensing device based on the path weight and CSI characteristics of the channel propagation path.

[0108] In this optional embodiment, the sum of the path weights corresponding to all other sensing devices is optionally equal to 1.

[0109] As can be seen, this optional embodiment can also improve the accuracy and reliability of personnel status analysis results by performing path weight analysis on the CSI features of each channel propagation path and combining it with the corresponding CSI features.

[0110] In this optional embodiment, the sensing device determines the path weight corresponding to the other sensing device based on the CSI characteristics of the other sensing device, including:

[0111] The sensing device determines the path weight matching the path type of the channel propagation path corresponding to each other sensing device, determines the distance weight matching the distance corresponding to each other sensing device, and determines the environment weight matching the environment complexity corresponding to each other sensing device. Finally, the sum of the path weight, distance weight and environment weight is calculated as the path weight corresponding to the other sensing device.

[0112] In this optional embodiment, the weight of the direct path type is greater than the weight of the reflected path type; the shorter the distance, the greater the corresponding distance weight; the lower the environmental complexity, the greater the corresponding environmental weight, such as the environmental weight of passing through a wall being less than the environmental weight of not passing through a wall.

[0113] As can be seen, this optional embodiment can also comprehensively analyze the path weight of the channel propagation path by considering the path type of different channel propagation paths, the distance between two sensing devices, and the environmental complexity, thereby improving the accuracy of the analysis of the weight of all channel propagation paths and thus helping to further improve the accuracy and reliability of the personnel status analysis results.

[0114] In yet another optional embodiment, the method may further include the following steps:

[0115] The sensing device calculates the signal-to-noise ratio (SNR) of the channel propagation path corresponding to each other sensing device based on the CSI characteristics of that other sensing device, and then performs a correction operation on the path weight of that other sensing device based on the SNR to obtain the corrected path weight. The higher the SNR, the higher the corrected path weight.

[0116] As can be seen, this optional embodiment can also correct the path weight by the signal-to-noise ratio of the channel propagation path, further improving the accuracy of path weight analysis.

[0117] In yet another optional embodiment, the method may further include the following steps:

[0118] The sensing device acquires the historical CST characteristics of each channel propagation path within a preset time period and the frequency of personnel activities on that channel propagation path. The cutoff time of the preset time period is determined by the time when CSI data packets sent by other devices are received.

[0119] The sensing device analyzes the signal stability value corresponding to each channel propagation path based on the historical CST characteristics and the current CSI characteristics.

[0120] The sensing device performs a correction operation on the path weight of each channel propagation path based on the frequency of personnel activities and the signal stability value, and obtains the corrected path weight.

[0121] In this optional embodiment, the greater the frequency of personnel activity, or the higher the signal stability value, the greater the corrected path weight.

[0122] As can be seen, this optional embodiment can also correct the path weight by the frequency of personnel activities and signal stability value over a period of time in the channel propagation path, which further improves the accuracy of path weight analysis, thereby helping to further improve the accuracy and reliability of personnel status analysis results.

[0123] In another optional embodiment, the activity analysis results for each sensing device include the distance of a person's activity relative to that sensing device;

[0124] The method may also include the following steps:

[0125] The server receives the activity analysis results for each sensing device from each sensing device, and each sensing device sends its corresponding activity analysis results to the server at the same time.

[0126] The server determines the activity area of ​​people in the space based on the activity analysis results corresponding to each sensing device.

[0127] In this optional embodiment, each sensing device sends the corresponding activity analysis results to the server at the same time or within the same time period.

[0128] In this optional embodiment, the activity distance of the sensing device can be understood as the distance between the location of the person and the location of the sensing device, and / or the distance between the location of the person and the locations of other corresponding sensing devices. The distance can be the distance at a specific moment or the activity distance over a period of time, i.e., a changing distance.

[0129] In this optional embodiment, optionally, the server determines the activity area of ​​personnel in the space based on the activity analysis results corresponding to each sensing device, including:

[0130] For any sensing device, the server analyzes the activity distance corresponding to the sensing device to obtain the personnel activity area corresponding to the sensing device;

[0131] The server determines the activity area of ​​a person in the space based on the activity area corresponding to each sensing device.

[0132] In this optional embodiment, when a person passes through or approaches the corresponding channel propagation path, the amplitude or phase of the channel carrier will be disturbed, indicating that the person is in the corresponding area. If the person does not approach or pass through, the amplitude or phase of the channel carrier will not be disturbed, indicating that the person has not entered the corresponding area. Optionally, Figure 4 is another area sensing schematic diagram disclosed in this application embodiment. As shown in Figure 4, it includes sensing devices STA1, STA2, STA3, SAT4, and AP. Each sensing device has a corresponding channel propagation path, as shown by the dotted line in the figure. If STA1 analyzes and finds that a person is in the area between itself and SAT2, between itself and SAT4, and between itself and AP, i.e., channel carrier disturbance has occurred in all of them, it indicates that the person is active in these areas and not in the area between STA1 and STA3, and this area can be excluded.

[0133] As can be seen, this optional embodiment comprehensively analyzes the results of all sensing devices' analysis of people's activities in space in order to accurately sense the activity area of ​​people, thereby facilitating the execution of corresponding operations on people, such as monitoring and care.

[0134] Example 2

[0135] Please refer to Figure 5, which is a schematic diagram of a sensing system for determining the status of people based on CSI intelligence, as disclosed in an embodiment of this application. The sensing system described in Figure 5 can be applied to any scenario requiring the sensing of the status of people, such as the location sensing of people in a smart home scenario. The sensing system includes multiple sensing devices, all of which communicate with each other via the same channel and are located in the same space. The sensing system may also include a server, and each sensing device can communicate with the server. The server may be a cloud server or a local server. Furthermore, all sensing devices include, but are not limited to, smart home devices and / or non-smart home devices. Smart home devices include one or more of the following: smart door locks, smart refrigerators, smart cleaning equipment, smart fans, smart TVs, etc. Non-smart home devices may include one or more of the following: mobile phones, computers, smart bracelets, smart glasses, network providing devices, etc. As shown in Figure 5, for any sensing device, the sensing device may include:

[0136] Communication module 201 is used to receive CSI data packets sent by each other sensing device, and each other sensing device sends a corresponding CSI data packet to the sensing device at the same time;

[0137] Analysis module 202 is used to analyze the CSI data packets corresponding to each other sensing device to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device. The CSI characteristics corresponding to each other sensing device are used as the basis for determining the status data of personnel in space. The status data of personnel in space includes the position of personnel in space.

[0138] As can be seen, when the sensing system described in Figure 5 receives the corresponding CSI data packets sent by each other sensing device at the same time, the sensing device analyzes the CSI data packets corresponding to each other sensing device to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device, so as to sense the state of the person in space, such as the position in space, improve the granularity accuracy of multiple devices in sensing the state of the person, and thus improve the accuracy and precision of the person's location.

[0139] In an optional embodiment, Figure 6 is a schematic diagram of another sensing system based on CSI intelligent determination of personnel status disclosed in this application. As shown in Figure 6, the sensing device may further include:

[0140] The filtering module 203 is used to filter out all the required target CSI data packets from all CSI data packets based on the identifier carried by each CSI data packet;

[0141] Specifically, the analysis module 202 analyzes the CSI data packets corresponding to each other sensing device to obtain the specific method of CSI characteristics of the channel propagation path between the sensing device and the other sensing device, including:

[0142] Each target CSI data packet is analyzed to obtain the CSI characteristics of the channel propagation path between the sensing device and other sensing devices corresponding to that target CSI data packet.

[0143] The specific method by which the filtering module 203 filters out all the required target CSI data packets from all CSI data packets based on the identifier carried by each CSI data packet includes:

[0144] Determine whether there is an identifier among all the identifiers carried in the CSI data packets that matches the sensor device identifier of the sensing device;

[0145] When it is determined that the existence exists, all target identifiers that match the sensing device identifier of the sensing device are filtered out from the identifiers carried in all CSI data packets;

[0146] Based on each target identifier, filter all CSI packets to find the CSI packets that match that target identifier;

[0147] Each target CSI data packet consists of a CSI data packet corresponding to each target identifier.

[0148] In this optional embodiment, each CSI data packet sent by another sensing device may carry an identifier. The identifier carried in the CSI data packet corresponding to each other sensing device includes the identifier of the other sensing device and / or the identifier of the receiving sensing device that requires the CSI data packet. The identifier of the other sensing device includes a device identifier and / or a MAC address identifier; the identifier of the receiving sensing device includes a device identifier. The identifier of the other sensing device is used by the sensing device to identify which other sensing device sent the corresponding CSI data packet, so that the sensing device can distinguish the corresponding propagation path. In this optional embodiment, for any CSI data packet, if it is determined that the identifier of the receiving sensing device in its carried identifier contains the device identifier of the sensing device, and / or if it is determined that the identifier of the other sensing device in its carried identifier matches the identifier stored in the sensing device, or if the sensing device can parse the identifier of the other sensing device, then it is determined that it exists; otherwise, it does not exist. In this case, the received CSI data packet is discarded, or the communication module 101 is re-triggered to execute the corresponding function.

[0149] As can be seen, the sensing system described in Figure 6 can further filter out the required CSI data packets based on the identifiers carried in the CSI data packets after receiving CSI data packets sent by other sensing devices. This improves the accuracy of CSI data packet acquisition, which in turn improves the accuracy of CSI data packet analysis and, consequently, the accuracy of determining the status of personnel in space. Furthermore, by comparing the identifiers carried in the received CSI data packets with its own identifier, the system improves the accuracy and efficiency of identifier comparison, thereby improving the accuracy of filtering the required CSI data packets.

[0150] In another optional embodiment, the analysis module 202 is further configured to analyze the CSI features corresponding to each other sensing device to obtain the personnel status analysis result corresponding to the other sensing device. The personnel status analysis result corresponding to each other sensing device includes the area where the personnel are located in the target space that matches the other sensing device. The target space is in space. The area corresponding to each other sensing device includes a first area or a second area. The area of ​​the first area is smaller than the area of ​​the second area.

[0151] As shown in Figure 6, the sensing device may further include:

[0152] The first determining module 204 is used to determine the activity analysis results of personnel in space based on the personnel status analysis results corresponding to all other sensing devices.

[0153] As can be seen, the sensing system described in Figure 6 can also more accurately determine the area where personnel are actually active by comprehensively analyzing the personnel status analysis results corresponding to all other sensing devices, thereby further improving the accuracy and reliability of personnel location positioning.

[0154] In this optional embodiment, the specific method by which the analysis module 202 analyzes the CSI features corresponding to each other sensing device to obtain the personnel status analysis results corresponding to that other sensing device includes:

[0155] For any other sensing device, the path weight of the channel propagation path corresponding to the other sensing device is determined based on the CSI characteristics of the other sensing device, and the personnel status analysis result of the other sensing device is determined based on the path weight and CSI characteristics of the channel propagation path.

[0156] In this optional embodiment, the sum of the path weights corresponding to all other sensing devices is optionally equal to 1.

[0157] As can be seen, this optional embodiment can also improve the accuracy and reliability of personnel status analysis results by performing path weight analysis on the CSI features of each channel propagation path and combining it with the corresponding CSI features.

[0158] In this optional embodiment, the analysis module 202 determines the specific method of the path weight corresponding to the other sensing device based on the CSI characteristics of the other sensing device, including:

[0159] Based on the path type of the channel propagation path corresponding to each other sensing device, a path weight matching the path type is determined. Based on the distance corresponding to each other sensing device, a distance weight matching the distance is determined. Based on the environmental complexity corresponding to each other sensing device, an environmental weight matching the environmental complexity is determined. Finally, the sum of the path weight, distance weight, and environmental weight is calculated as the path weight corresponding to the other sensing device.

[0160] In this optional embodiment, the weight of the direct path type is greater than the weight of the reflected path type; the shorter the distance, the greater the corresponding distance weight; the lower the environmental complexity, the greater the corresponding environmental weight, such as the environmental weight of passing through a wall being less than the environmental weight of not passing through a wall.

[0161] As can be seen, this optional embodiment can also comprehensively analyze the path weight of the channel propagation path by considering the path type of different channel propagation paths, the distance between two sensing devices, and the environmental complexity, thereby improving the accuracy of the analysis of the weight of all channel propagation paths and thus helping to further improve the accuracy and reliability of the personnel status analysis results.

[0162] In another optional embodiment, the analysis module 202 is further configured to calculate the signal-to-noise ratio (SNR) of the channel propagation path corresponding to each other sensing device based on the CSI characteristics of that other sensing device, and perform a correction operation on the path weight of the other sensing device based on the SNR to obtain the corrected path weight. The higher the SNR, the higher the corrected path weight.

[0163] As can be seen, this optional embodiment can also correct the path weight by the signal-to-noise ratio of the channel propagation path, further improving the accuracy of path weight analysis.

[0164] In another optional embodiment, the analysis module 202 is further configured to obtain the historical CST characteristics of each channel propagation path within a preset time period and the frequency of personnel activities on the channel propagation path, wherein the cutoff time of the preset time period is determined by the time when CSI data packets sent by other devices are received.

[0165] Based on the historical CST characteristics and current CSI characteristics of each channel propagation path, analyze the signal stability value corresponding to that channel propagation path;

[0166] Based on the frequency of personnel activity and signal stability value on each channel propagation path, the path weight of the channel propagation path is corrected to obtain the corrected path weight.

[0167] In this optional embodiment, the greater the frequency of personnel activity, or the higher the signal stability value, the greater the corrected path weight.

[0168] As can be seen, this optional embodiment can also correct the path weight by the frequency of personnel activities and signal stability value over a period of time in the channel propagation path, which further improves the accuracy of path weight analysis, thereby helping to further improve the accuracy and reliability of personnel status analysis results.

[0169] In yet another alternative embodiment, as shown in Figure 6, the server may include:

[0170] The receiving module 205 is used to receive the activity analysis results corresponding to each sensing device sent by each sensing device, and each sensing device sends the corresponding activity analysis results to the server at the same time.

[0171] The second determining module 206 is used to determine the activity area of ​​personnel in the space based on the activity analysis results corresponding to each sensing device.

[0172] In this optional embodiment, the second determining module 206 determines the specific method by which a person's activity area in the space is determined based on the activity analysis results corresponding to each sensing device, including:

[0173] For any sensing device, analyze the activity distance corresponding to the sensing device to obtain the personnel activity area corresponding to the sensing device;

[0174] Based on the activity area of ​​the personnel corresponding to each sensing device, the activity area of ​​the personnel in the space is determined.

[0175] In this optional embodiment, the activity distance of the sensing device can be understood as the distance between the location of the person and the location of the sensing device, and / or the distance between the location of the person and the locations of other corresponding sensing devices. The distance can be the distance at a specific moment or the activity distance over a period of time, i.e., a changing distance.

[0176] As can be seen, the sensing system described in Figure 6 can also comprehensively analyze the results of the analysis of personnel activities in space by all sensing devices, so as to accurately sense the activity area of ​​personnel, thereby facilitating the execution of corresponding operations such as monitoring and care.

[0177] Example 3

[0178] Please refer to Figure 7, which is a schematic diagram of the structure of a sensing device disclosed in an embodiment of this application. This sensing device can be applied to any scenario requiring the sensing of human status, such as human location sensing in a smart home scenario. This scenario is equipped with a corresponding sensing system, which includes multiple sensing devices. All sensing devices communicate with each other via the same channel and are located in the same space. The sensing system may also include a server, and each sensing device can communicate with the server. The server may be a cloud server or a local server. Furthermore, all sensing devices include, but are not limited to, smart home devices and / or non-smart home devices. Smart home devices include one or more of smart door locks, smart refrigerators, smart cleaning equipment, smart fans, smart TVs, etc. Non-smart home devices may include one or more of mobile phones, computers, smart bracelets, smart glasses, network providing devices, etc. As shown in Figure 7, for any sensing device, the sensing device may include:

[0179] Memory 301 storing executable program code;

[0180] Processor 302 coupled to memory 301;

[0181] The processor 302 calls the executable program code stored in the memory 301 to execute some or all of the steps performed by the sensing device in the method for determining the status of personnel based on CSI as described in Embodiment 1 of this application.

[0182] Example 4

[0183] This application discloses a computer-readable storage medium storing computer instructions. When invoked, these computer instructions are used to execute the steps in the method for determining personnel status based on CSI as described in Embodiment 1 of this application.

[0184] Example 5

[0185] This application discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform the steps in the method for determining the status of personnel based on CSI as described in Embodiment 1.

[0186] The above-described embodiments of the sensing system are merely illustrative. The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0187] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0188] Finally, it should be noted that the method, device, and system for determining personnel status based on CSI intelligence disclosed in the embodiments of this application are merely preferred embodiments of this application and are only used to illustrate the technical solutions of this application, not to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for determining personnel status based on CSI (Computer-In-Sight) intelligence, the method being applied to a sensing system comprising multiple sensing devices, all of which are connected via the same channel and located in the same space; for any one of the sensing devices, the method comprising: The sensing device receives CSI data packets sent by each other sensing device, and each of the other sensing devices sends a corresponding CSI data packet to the sensing device at the same time; The sensing device analyzes the CSI data packets corresponding to each of the other sensing devices to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device; The CSI feature corresponding to each of the other sensing devices is used as the basis for determining the status data of the person in the space, and the status data of the person in the space includes the position of the person in the space.

2. The method for intelligently determining personnel status based on CSI according to claim 1, wherein, Each of the other sensing devices sends a CSI data packet carrying an identifier; The method further includes: The sensing device filters out all the required target CSI data packets from all the CSI data packets based on the identifier carried by each CSI data packet; The sensing device analyzes the CSI data packets corresponding to each of the other sensing devices to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device, including: The sensing device analyzes each target CSI data packet to obtain the CSI characteristics of the channel propagation path between the sensing device and other sensing devices corresponding to the target CSI data packet.

3. The method for intelligently determining personnel status based on CSI according to claim 2, wherein, The identifier carried in the CSI data packet corresponding to each of the other sensing devices includes the identifier of the other sensing device and / or the identifier of the receiving sensing device that needs the CSI data packet; The sensing device, based on the identifier carried in each CSI data packet, filters out all desired target CSI data packets from all CSI data packets, including: The sensing device determines whether there is an identifier that matches the sensing device identifier among the identifiers carried in all the CSI data packets. When it is determined that the existence exists, the sensing device filters out all target identifiers that match the sensing device identifier from all the identifiers carried in the CSI data packets; The sensing device filters out CSI data packets that match each target identifier from all the CSI data packets; All target CSI data packets consist of CSI data packets corresponding to each target identifier.

4. The method for determining personnel status based on CSI intelligently according to any one of claims 1-3, the method further comprising: The sensing device analyzes the CSI features corresponding to each of the other sensing devices to obtain the personnel status analysis results corresponding to the other sensing device. The sensing device determines the activity analysis results of the personnel in the space based on the personnel status analysis results corresponding to all the other sensing devices.

5. The method for intelligently determining personnel status based on CSI according to claim 4, wherein, The personnel status analysis result corresponding to each of the other sensing devices includes the area where the personnel are located in the target space that matches the other sensing device. The target space is located in the space. The area corresponding to each of the other sensing devices includes a first area or a second area, wherein the area range of the first area is smaller than the area range of the second area.

6. The method for intelligently determining personnel status based on CSI according to claim 4, wherein, The sensing system also includes a server; The activity analysis results for each of the aforementioned sensing devices include the distance of personnel moving relative to that sensing device. The method further includes: The server receives the activity analysis results corresponding to each of the sensing devices, and each sensing device sends its corresponding activity analysis results to the server at the same time. The server determines the activity area of ​​the person in the space based on the activity analysis results corresponding to each of the sensing devices.

7. The method for intelligently determining a person's state based on CSI according to claim 6, wherein, The server determines the activity area of ​​personnel in the space based on the activity analysis results corresponding to each of the sensing devices, including: For any of the aforementioned sensing devices, the server analyzes the activity distance corresponding to the sensing device to obtain the personnel activity area corresponding to the sensing device; The server determines the activity area of ​​a person in the space based on the activity area of ​​the person corresponding to each sensing device.

8. A sensing system for determining personnel status based on CSI (Computer-In-Sight) intelligence, wherein, The sensing system includes multiple sensing devices, all of which are interconnected via the same channel and located in the same space. For any given sensing device, the sensing device includes: The communication module is used to receive CSI data packets sent by each other sensing device, and each of the other sensing devices sends a corresponding CSI data packet to the sensing device at the same time; The analysis module is used to analyze the CSI data packets corresponding to each of the other sensing devices to obtain the CSI characteristics of the channel propagation path between the sensing device and the other sensing device; The CSI features corresponding to each of the other sensing devices are used as the basis for determining the status data of the person in the space, wherein the status data of the person in the space includes the position of the person in the space.

9. A sensing device, wherein a plurality of said sensing devices constitute a sensing system, all said sensing devices are communicatively connected based on the same channel and are located in the same space, and for any said sensing device, said sensing device includes: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the method for determining personnel status based on CSI as described in any one of claims 1-7.

10. A computer-readable storage medium storing computer instructions, which, when invoked, are used to perform the method for determining personnel status based on CSI as described in any one of claims 1-6.

Images