Object perception method and object perception device

Abstract

The present application provides an object perception method and an object perception device, which relate to the field of signal processing technology. The object perception method includes using a wireless device to obtain channel state information transmitted by a wireless terminal at time t; performing a modulo operation on the channel state information to obtain a signal amplitude matrix, wherein the signal amplitude matrix includes multiple subcarrier amplitudes; calculating a first amplitude mean based on the multiple subcarrier amplitudes; generating an autocorrelation function based on the multiple subcarrier amplitudes and the first amplitude mean, and calculating an antenna index function based on the autocorrelation function; generating a first detection result based on the antenna index function and a static detection threshold, wherein the first detection result represents whether a detected object exists in a target area where the wireless device and the wireless terminal are located.

Description

Technical Field

[0001] The present application relates to the field of signal processing technology, and more specifically, to an object perception method, an object perception device, an electronic device, a computer-readable storage medium, and a computer program product. Background Art

[0002] Wireless WiFi devices, an essential component of modern life, are widely used in communications, intelligent sensing, and other fields. In indoor environments, these technologies typically utilize infrared sensors, cameras, radar, and other devices for detection. However, due to obstructions from buildings and the varying environmental conditions within different buildings, these devices often exhibit poor accuracy in detecting human presence. Consequently, the ability to accurately determine the presence of human beings in indoor environments has attracted increasing attention. Summary of the Invention

[0003] In view of this, the present application provides an object perception method, an object perception device, an electronic device, a computer-readable storage medium, and a computer program product.

[0004] One aspect of the present application provides an object perception method, comprising:

[0005] Using a wireless device to obtain channel state information transmitted by a wireless terminal at time t;

[0006] Performing a modulo operation on the channel state information to obtain a signal amplitude matrix, wherein the signal amplitude matrix includes multiple subcarrier amplitudes;

[0007] Calculating a first amplitude mean according to the plurality of subcarrier amplitudes;

[0008] Generating an autocorrelation function based on the plurality of subcarrier amplitudes and the first amplitude mean, and calculating an antenna index function based on the autocorrelation function;

[0009] A first detection result is generated according to the antenna index function and the static detection threshold, wherein the first detection result indicates whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

[0010] According to an embodiment of the present application, before generating the above-mentioned autocorrelation function, the method further includes:

[0011] Calculating a first standard deviation based on the plurality of subcarrier amplitudes and the first amplitude mean;

[0012] generating a second detection result based on the first standard deviation and the tth body motion detection threshold, wherein the second detection result indicates whether the detected object is within the target area;

[0013] When the second detection result shows that the detected object does not exist, the autocorrelation function is calculated.

[0014] According to an embodiment of the present application, the t-th body motion detection threshold is generated as follows:

[0015] averaging and standard deviation of the first standard deviations to obtain a target average and a target standard deviation;

[0016] The t-th body movement detection threshold is calculated based on the target average value and the target standard deviation.

[0017] According to an embodiment of the present application, the channel state information includes multiple subcarriers with subcarrier indexes.

[0018] According to an embodiment of the present application, before calculating the first amplitude mean, the method further includes:

[0019] Acquire multiple pieces of associated state information related to the channel state information;

[0020] For the same subcarrier index in the above-mentioned channel state information and multiple pieces of the above-mentioned associated state information, when the multiple subcarrier amplitudes corresponding to the above-mentioned subcarrier index are all preset values, the subcarrier amplitude corresponding to the above-mentioned subcarrier index is deleted from the above-mentioned channel state information to obtain multiple filtered subcarrier amplitudes.

[0021] According to an embodiment of the present application, before obtaining the above-mentioned filtered multiple channel state information, the method further includes:

[0022] Calculating a second amplitude mean based on the plurality of subcarrier amplitudes, and calculating a second standard deviation based on the plurality of subcarrier amplitudes and the second amplitude mean;

[0023] For each of the subcarrier amplitudes, generating an amplitude difference according to the subcarrier amplitude and the second amplitude mean;

[0024] When the amplitude difference satisfies a preset amplitude threshold, the subcarrier amplitude corresponding to the amplitude difference is deleted from the multiple channel state information to obtain multiple filtered subcarrier amplitudes, wherein the preset amplitude threshold is generated based on the second standard deviation.

[0025] According to an embodiment of the present application, generating an autocorrelation function based on the plurality of subcarrier amplitudes and the first amplitude mean, and calculating an antenna index function based on the autocorrelation function includes:

[0026] generating an initial autocorrelation function according to the plurality of subcarrier amplitudes, the index interval parameter and the first amplitude mean;

[0027] The antenna index function is calculated based on the initial autocorrelation function.

[0028] According to an embodiment of the present application, calculating the antenna index function according to the initial autocorrelation function includes:

[0029] Assigning the above index interval parameter multiple times to obtain multiple index interval parameter values;

[0030] For each of the above index interval parameter values, substituting the above index interval parameter value into the above initial autocorrelation function to obtain a target autocorrelation function;

[0031] The antenna index function is obtained by summing up a plurality of the target autocorrelation functions.

[0032] According to an embodiment of the present application, generating a first detection result according to the antenna index function and the static detection threshold includes:

[0033] Determine the maximum value of the above antenna index function;

[0034] When the maximum value satisfies the static detection threshold, an object presence result is generated, wherein the object presence result indicates that the detected object exists in the target area;

[0035] If the maximum value does not meet the static detection threshold, an object-not-existing result is generated, wherein the object-not-existing result indicates that the detected object does not exist in the target area, and the first detection result includes the object-existing result or the object-not-existing result;

[0036] Wherein, in the case where the wireless device has multiple antennas, the method further includes:

[0037] The maximum values ​​corresponding to the plurality of antennas are screened to obtain a screened maximum value, and the screened maximum value is used to compare with the static detection threshold.

[0038] According to an embodiment of the present application, the wireless device includes multiple receiving antennas.

[0039] According to an embodiment of the present application, generating a second detection result based on the first standard deviation and the tth body movement detection threshold includes:

[0040] Calculating a standard deviation mean based on the first standard deviation corresponding to each of the receiving antennas;

[0041] When the mean of the standard deviations is greater than the t-th body motion detection threshold, generating a detection presence result, wherein the detection presence result indicates that the detected object exists in the target area;

[0042] In the case where the mean of the standard deviation is not greater than the t-th body motion detection threshold, a detection non-existence result is generated, wherein the detection non-existence result indicates that the detected object does not exist in the target area.

[0043] Another aspect of the present application provides an object sensing device, comprising:

[0044] An acquisition module, configured to acquire, using a wireless device, the channel state information transmitted by the wireless terminal at time t;

[0045] An obtaining module is configured to perform a modulo operation on the channel state information to obtain a signal amplitude matrix, wherein the signal amplitude matrix includes multiple subcarrier amplitudes;

[0046] A first calculation module, configured to calculate a first amplitude mean based on the plurality of subcarrier amplitudes;

[0047] a second calculation module, configured to generate an autocorrelation function based on the plurality of subcarrier amplitudes and the first amplitude mean, and calculate an antenna index function based on the autocorrelation function;

[0048] The detection module is configured to generate a first detection result based on the antenna index function and the static detection threshold, wherein the first detection result indicates whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

[0049] Another aspect of the present application provides an electronic device, comprising:

[0050] one or more processors;

[0051] a memory for storing one or more programs,

[0052] When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described above.

[0053] Another aspect of the present application provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the method described above when executed.

[0054] Another aspect of the present application provides a computer program product, which includes computer-executable instructions. When the instructions are executed, the instructions are used to implement the method described above.

[0055] According to an embodiment of the present application, a signal amplitude matrix is ​​obtained by taking the modulus of the channel state information collected by the wireless device from the wireless terminal, a first amplitude mean is calculated based on the multiple subcarrier amplitudes in the signal amplitude matrix, an autocorrelation function is generated based on the multiple subcarrier amplitudes and the first amplitude mean, and an antenna index function is calculated based on the autocorrelation function. A first detection result of whether a detected object exists is generated based on the antenna index function and a static detection threshold. Since this embodiment only requires channel state information at a single sampling moment, the first detection result of whether a detected object exists can be obtained by calculating the autocorrelation function and the antenna index function based on the channel state information, thereby improving the efficiency of object perception and avoiding the problems of low object perception efficiency and large data processing volume caused by relying on sampling data from a historical period. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] The above and other objects, features and advantages of the present application will become more apparent through the following description of the embodiments of the present application with reference to the accompanying drawings, in which:

[0057] Figure 1 An exemplary system architecture to which the object perception method according to an embodiment of the present application can be applied is shown;

[0058] Figure 2 A flow chart of an object perception method according to an embodiment of the present application is shown;

[0059] Figure 3 A flow chart of an object perception method according to another embodiment of the present application is shown;

[0060] Figure 4 A schematic diagram of subcarrier amplitudes corresponding to different subcarrier indices according to an embodiment of the present application is shown;

[0061] Figure 5 A block diagram of an object sensing device according to an embodiment of the present application is shown;

[0062] Figure 6 A block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0063] Hereinafter, embodiments of the present application will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present application. In the detailed description below, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present application. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessarily confusing the concepts of the present application.

[0064] The terms used herein are only for describing specific embodiments and are not intended to limit this application. The terms "comprise," "include," etc. used herein indicate the presence of the features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0065] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0066] When expressions such as "at least one of A, B, and C, etc." are used, they should generally be interpreted in accordance with the meaning commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0067] Related technologies primarily rely on infrared sensors, cameras, or specialized radar equipment for human detection. Infrared detection is susceptible to temperature interference and cannot penetrate obstructions. Visual solutions pose privacy risks and require high computing power. Radar, while highly accurate, is expensive in hardware. These methods generally suffer from complex deployment and high operational and maintenance costs, making them difficult to meet the demand for low-cost, ubiquitous sensing in areas such as smart homes and security monitoring.

[0068] With the rapid development of technology, IoT devices are ubiquitous in our daily lives. Most IoT devices are equipped with corresponding wireless communication modules (such as WiFi), which are mainly used for wireless data transmission. As IoT terminals become more and more popular in daily life, a huge wireless communication network will be formed.

[0069] In view of this, an embodiment of the present application provides an object perception method and an object perception device, which includes using a wireless device to obtain channel state information transmitted by a wireless terminal at time t; performing a modulo operation on the channel state information to obtain a signal amplitude matrix, wherein the signal amplitude matrix includes multiple subcarrier amplitudes; calculating a first amplitude mean based on the multiple subcarrier amplitudes; generating an autocorrelation function based on the multiple subcarrier amplitudes and the first amplitude mean, and calculating an antenna index function based on the autocorrelation function; generating a first detection result based on the antenna index function and a static detection threshold, wherein the first detection result represents whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

[0070] In the embodiments of this application, the collection, updating, analysis, processing, use, transmission, provision, disclosure, and storage of all data involved (including, but not limited to, user personal information) comply with relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. In particular, necessary measures have been taken to prevent unauthorized access to user personal information data and maintain the security of user personal information and network security.

[0071] In the embodiments of the present application, the user's authorization or consent is obtained before obtaining or collecting the user's personal information.

[0072] Figure 1 FIG. 1 shows an exemplary system architecture 100 to which an object perception method according to an embodiment of the present application can be applied. It should be noted that, Figure 1 What is shown is merely an example of a system architecture to which the embodiments of the present application can be applied, to help those skilled in the art understand the technical content of the present application, but does not mean that the embodiments of the present application cannot be used in other devices, systems, environments or scenarios.

[0073] like Figure 1 As shown, the system architecture 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used as a medium for providing a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired and / or wireless communication links, etc.

[0074] A user may use a first terminal device 101, a second terminal device 102, or a third terminal device 103 to interact with a server 105 via a network 104 to receive or send messages, etc. Various communication client applications may be installed on the first terminal device 101, the second terminal device 102, or the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, and / or social platform software (for example only).

[0075] The first terminal device 101 , the second terminal device 102 , and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0076] The server 105 may be a server that provides various services, such as a background management server (for example only) that supports websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process received data such as user requests, and feed back processing results (e.g., web pages, information, or data obtained or generated based on user requests) to the terminal devices.

[0077] It should be noted that the object perception method provided in the embodiment of the present application can generally be executed by the server 105. Accordingly, the object perception device provided in the embodiment of the present application can generally be set in the server 105. The object perception method provided in the embodiment of the present application can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the object perception device provided in the embodiment of the present application can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Alternatively, the object perception method provided in the embodiment of the present application can also be executed by the first terminal device 101, the second terminal device 102 or the third terminal device 103, or can also be executed by other terminal devices different from the first terminal device 101, the second terminal device 102 or the third terminal device 103. Correspondingly, the object perception device provided in the embodiment of the present application can also be set in the first terminal device 101, the second terminal device 102 or the third terminal device 103, or in other terminal devices different from the first terminal device 101, the second terminal device 102 or the third terminal device 103.

[0078] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is merely illustrative. Any number of terminal devices, networks and servers may be provided as required.

[0079] Figure 2 A flowchart of an object perception method according to an embodiment of the present application is shown.

[0080] like Figure 2 As shown, the object perception method includes operations S201 to S205.

[0081] In operation S201, a wireless device is used to obtain channel state information transmitted by a wireless terminal at time t.

[0082] In operation S202, a modulo operation is performed on the channel state information to obtain a signal amplitude matrix, where the signal amplitude matrix includes multiple subcarrier amplitudes.

[0083] In operation S203, a first amplitude mean is calculated according to the amplitudes of the plurality of subcarriers.

[0084] In operation S204, an autocorrelation function is generated according to the plurality of subcarrier amplitudes and the first amplitude mean, and an antenna index function is calculated according to the autocorrelation function.

[0085] In operation S205 , a first detection result is generated according to the antenna index function and the static detection threshold, wherein the first detection result indicates whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

[0086] According to an embodiment of the present application, the wireless device can be any type of WiFi device in access point mode. The wireless device can transmit data with at least one wireless terminal (such as a mobile phone or computer) via the 2.4 GHz frequency band (or other frequency bands). The sampling frequency F_s (in Hz) of the wireless device can be set according to actual needs, for example, to 10 Hz. The detected object can include humans or animals.

[0087] According to an embodiment of the present application, after a certain sampling is performed to obtain the channel state information (CSI), the channel state information can be used express, is a complex number, and the channel state information is expressed by formula (1) Perform the modulo operation to obtain the signal amplitude matrix :

[0088] (1);

[0089] in, is a modulo operation, t is the tth time, and f is the fth subcarrier.

[0090] In a specific embodiment, if the wireless device has dual antennas, the channel state information It is a 2×64 complex matrix, where 2 is the number of antennas, the specific value of which is related to the wireless device, and 64 is the number of subcarriers, which is related to the factory parameters of the network card in the wireless device.

[0091] According to an embodiment of the present application, according to the signal amplitude matrix The first amplitude mean is calculated by taking the amplitudes of the multiple subcarriers in , according to the amplitude of multiple subcarriers and the first amplitude mean , generating the autocorrelation function , and according to the autocorrelation function Calculate the antenna index function .

[0092] According to an embodiment of the present application, according to the antenna index function and the static detection threshold , generating a first detection result, from which it can be seen whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

[0093] According to an embodiment of the present application, a signal amplitude matrix is ​​obtained by taking the modulus of the channel state information collected by the wireless device from the wireless terminal, a first amplitude mean is calculated based on the multiple subcarrier amplitudes in the signal amplitude matrix, an autocorrelation function is generated based on the multiple subcarrier amplitudes and the first amplitude mean, and an antenna index function is calculated based on the autocorrelation function. A first detection result of whether a detected object exists is generated based on the antenna index function and a static detection threshold. Since this embodiment only requires channel state information at a single sampling moment, the first detection result of whether a detected object exists can be obtained by calculating the autocorrelation function and the antenna index function based on the channel state information, thereby improving the efficiency of object perception and avoiding the problems of low object perception efficiency and large data processing volume caused by relying on sampling data from a historical period.

[0094] Figure 3 A flowchart of an object perception method according to another embodiment of the present application is shown.

[0095] According to an embodiment of the present application, before generating the autocorrelation function, it also includes: calculating a first standard deviation based on multiple subcarrier amplitudes and a first amplitude mean; generating a second detection result based on the first standard deviation and the tth body motion detection threshold, wherein the second detection result characterizes whether there is a detected object in the target area; when the second detection result shows that there is no detected object, calculating the autocorrelation function.

[0096] According to the embodiments of this application, see Figure 3 In operation S301, before calculating the autocorrelation function, a first standard deviation may be calculated based on the amplitudes of multiple subcarriers and the first amplitude mean. , as shown in formula (2):

[0097] (2);

[0098] in, is the number of subcarrier amplitudes, is the amplitude of the f-th subcarrier, is the first amplitude mean.

[0099] According to an embodiment of the present application, in operation S302, if the first standard deviation is greater than the tth body motion detection threshold , it means that there is a detected object in the target area. If it is not greater than the tth body motion detection threshold , it is necessary to further determine whether there is a detected object by calculating the autocorrelation function and the static detection threshold in operation S303.

[0100] According to an embodiment of the present application, the tth body motion detection threshold is generated in the following manner:

[0101] The first standard deviation is averaged and standard deviation is calculated to obtain a target average value and a target standard deviation; and the tth body movement detection threshold is calculated based on the target average value and the target standard deviation.

[0102] According to the embodiment of the present application, the t-th body motion detection threshold is a dynamically changing threshold whose value is different at each sampling moment. Calculate using formula (3):

[0103] (3).

[0104] in, is the target average value at the current moment, It is a preset coefficient. The specific value can be set according to actual needs. For example, it can be a value greater than or equal to 3. is the target standard deviation, is the first standard deviation.

[0105] According to an embodiment of the present application, the t-th body motion detection threshold is dynamically updated. To sense whether there is a detected object, only if the tth body motion detection threshold is not used Subsequent static detection based on the autocorrelation function or the like is performed only when the detected object is detected, thereby effectively reducing the time required for data processing, that is, reducing the time required for detecting the detected object, thereby improving detection accuracy.

[0106] Figure 4 A schematic diagram of subcarrier amplitudes corresponding to different subcarrier indices according to an embodiment of the present application is shown.

[0107] According to an embodiment of the present application, the channel state information includes a plurality of subcarriers having subcarrier indexes.

[0108] According to an embodiment of the present application, before calculating the first amplitude mean, it also includes: obtaining multiple associated state information related to the channel state information; for the same subcarrier index in the channel state information and the multiple associated state information, when the multiple subcarrier amplitudes corresponding to the subcarrier index are all preset values, deleting the subcarrier amplitude corresponding to the subcarrier index from the channel state information to obtain multiple filtered subcarrier amplitudes.

[0109] According to an embodiment of the present application, in order to improve the detection accuracy of the detected object, the collected channel state information may be preprocessed.

[0110] According to an embodiment of the present application, multiple association state information related to the channel state information is first obtained. For example, when the sampling frequency of the wireless device is 10 Hz (i.e., sampling once every 0.1 second), multiple channel state information within a preset time period (e.g., 3 seconds) at that moment can be determined as association state information.

[0111] According to the embodiments of this application, see Figure 4 If the subcarrier amplitude corresponding to a subcarrier index in the channel state information and multiple associated state information is always a preset value (for example, 0), the subcarrier amplitude corresponding to the subcarrier index can be deleted in each channel state information within the preset time period, thereby obtaining multiple filtered subcarrier amplitudes.

[0112] According to an embodiment of the present application, the channel state information at the current moment is preprocessed based on the subcarrier amplitude that is always a preset value in the associated state information, thereby improving the accuracy of the channel state information and thus improving the detection accuracy of the detected object.

[0113] According to an embodiment of the present application, before obtaining the filtered multiple channel state information, it also includes: calculating the second amplitude mean based on multiple subcarrier amplitudes, and calculating the second standard deviation based on the multiple subcarrier amplitudes and the second amplitude mean; for each subcarrier amplitude, generating an amplitude difference based on the subcarrier amplitude and the second amplitude mean; when the amplitude difference meets the preset amplitude threshold, deleting the subcarrier amplitude corresponding to the amplitude difference from the multiple channel state information to obtain the filtered multiple subcarrier amplitudes, wherein the preset amplitude threshold is generated based on the second standard deviation.

[0114] According to an embodiment of the present application, after deleting the subcarrier amplitudes that are always preset values, the subcarrier amplitudes may be further screened to further improve detection accuracy.

[0115] According to an embodiment of the present application, based on the first amplitude mean The same calculation formula is used to calculate the second amplitude mean based on multiple subcarrier amplitudes. The multiple subcarrier amplitudes currently used are the multiple subcarrier amplitudes after removing the subcarrier amplitudes that are always the preset value. The second standard deviation is calculated in the same way .

[0116] According to an embodiment of the present application, the preset amplitude threshold may be a preset multiple of the second standard deviation, such as 10. Referring to formula (4), for each subcarrier amplitude, an amplitude difference is generated based on the subcarrier amplitude and the second amplitude mean. If the amplitude difference exceeds the preset amplitude threshold, the subcarrier amplitude may be deleted, thereby obtaining multiple filtered subcarrier amplitudes.

[0117] (4);

[0118] in, is the second amplitude mean, is the second standard deviation, is the preset multiple, To take the absolute value.

[0119] According to an embodiment of the present application, invalid data that interferes with object perception can be deleted through further screening based on the second standard deviation, thereby improving subsequent detection accuracy.

[0120] In a specific embodiment, 64 subcarrier amplitudes can be obtained based on the channel state information. After deleting the subcarrier amplitudes that are always preset values ​​and performing deletion operations based on the second standard deviation, 52 subcarrier amplitudes can be obtained, thereby using the 52 subcarrier amplitudes to calculate autocorrelation functions, etc.

[0121] According to an embodiment of the present application, an autocorrelation function is generated based on multiple subcarrier amplitudes and a first amplitude mean, and an antenna index function is calculated based on the autocorrelation function, including: generating an initial autocorrelation function based on multiple subcarrier amplitudes, an index interval parameter and a first amplitude mean; and calculating the antenna index function based on the initial autocorrelation function.

[0122] According to an embodiment of the present application, an initial autocorrelation function is generated based on multiple subcarrier amplitudes, index interval parameters and the first amplitude mean. , as shown in formula (5):

[0123] (5);

[0124] in, is the number of subcarrier amplitudes, for example, it can be 64 or 52, is the jth subcarrier amplitude, is the first amplitude mean, and i is the interval of subcarrier indexes, that is, the index interval parameter below.

[0125] According to an embodiment of the present application, according to the initial autocorrelation function Calculate the antenna index function .

[0126] According to an embodiment of the present application, the antenna index function is calculated based on the initial autocorrelation function, including: assigning multiple values ​​to the index interval parameter to obtain multiple index interval parameter values; for each index interval parameter value, substituting the index interval parameter value into the initial autocorrelation function to obtain a target autocorrelation function; and summing the multiple target autocorrelation functions to obtain the antenna index function.

[0127] According to an embodiment of the present application, the index interval parameter i is assigned multiple times to obtain multiple index interval parameter values. For example, the index interval parameter values ​​may be i=1, i=2, and i=3, respectively.

[0128] According to the embodiment of the present application, i=1, i=2 and i=3 are substituted into the initial autocorrelation function of formula (5) respectively. In this paper, multiple target autocorrelation functions can be obtained.

[0129] According to an embodiment of the present application, multiple target autocorrelation functions are summed to obtain the antenna index function of the receiving antenna of the wireless device at the tth time , as shown in formula (6).

[0130] (6);

[0131] in, The maximum value among the index interval parameter values.

[0132] According to an embodiment of the present application, a first detection result is generated based on the antenna index function and the static detection threshold, including: determining the maximum value of the antenna index function; when the maximum value meets the static detection threshold, generating an object existence result, wherein the object existence result represents the presence of the detected object in the target area; when the maximum value does not meet the static detection threshold, generating an object non-existence result, wherein the object non-existence result represents the absence of the detected object in the target area, and the first detection result includes an object existence result or an object non-existence result.

[0133] According to an embodiment of the present application, the static detection threshold It can be set according to actual needs, for example, it can be 0.8.

[0134] According to the embodiments of this application, see Figure 3 , from the antenna index function of formula (6) The maximum value of the function is determined in operation S304. If the maximum value is greater than the static detection threshold, , then the object existence result is generated, which indicates that the detected object exists in the target area. If it is not greater than the static detection threshold , an object non-existence result is generated, indicating that the detected object does not exist.

[0135] According to an embodiment of the present application, when the wireless device has multiple antennas, the method further includes: filtering the maximum values ​​corresponding to the multiple antennas to obtain the filtered maximum value, and using the filtered maximum value to compare with the static detection threshold.

[0136] According to the embodiment of the present application, since the wireless device sometimes has more than one antenna, assuming two antennas, the channel state information received by each antenna needs to perform the above operation, and for the antenna index function corresponding to each antenna, the maximum value and the static detection threshold are selected from the two maximum values. Make a comparison.

[0137] According to an embodiment of the present application, a wireless device includes multiple receiving antennas.

[0138] According to an embodiment of the present application, a second detection result is generated based on the first standard deviation and the tth body motion detection threshold, including: calculating the standard deviation mean based on the first standard deviation corresponding to each receiving antenna; when the standard deviation mean is greater than the tth body motion detection threshold, generating a detection existence result, wherein the detection existence result indicates that the detected object exists in the target area; when the standard deviation mean is not greater than the tth body motion detection threshold, generating a detection non-existence result, wherein the detection non-existence result indicates that the detected object does not exist in the target area.

[0139] According to an embodiment of the present application, when the number of receiving antennas is greater than one, the first standard deviations of different receiving antennas can be averaged to obtain the standard deviation mean. If the standard deviation mean is greater than the tth body motion detection threshold, a detection presence result is generated indicating the presence of the detected object; otherwise, a detection absence result is generated indicating the absence of the detected object.

[0140] Figure 5 A block diagram of an object perception device according to an embodiment of the present application is shown.

[0141] like Figure 5 As shown, the object perception device 500 includes an acquisition module 510, a obtaining module 520, a first calculation module 530, a second calculation module 540 and a detection module 550.

[0142] The acquisition module 510 is configured to use a wireless device to acquire the channel state information transmitted by the wireless terminal at time t.

[0143] The obtaining module 520 is configured to perform a modulo operation on the channel state information to obtain a signal amplitude matrix, wherein the signal amplitude matrix includes multiple subcarrier amplitudes.

[0144] The first calculation module 530 is configured to calculate a first amplitude mean according to multiple subcarrier amplitudes.

[0145] The second calculation module 540 is configured to generate an autocorrelation function according to the multiple subcarrier amplitudes and the first amplitude mean, and calculate the antenna index function according to the autocorrelation function.

[0146] The detection module 550 is configured to generate a first detection result according to the antenna index function and the static detection threshold, wherein the first detection result indicates whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

[0147] According to an embodiment of the present application, a signal amplitude matrix is ​​obtained by taking the modulus of the channel state information collected by the wireless device from the wireless terminal, a first amplitude mean is calculated based on the multiple subcarrier amplitudes in the signal amplitude matrix, an autocorrelation function is generated based on the multiple subcarrier amplitudes and the first amplitude mean, and an antenna index function is calculated based on the autocorrelation function. A first detection result of whether a detected object exists is generated based on the antenna index function and a static detection threshold. Since this embodiment only requires channel state information at a single sampling moment, the first detection result of whether a detected object exists can be obtained by calculating the autocorrelation function and the antenna index function based on the channel state information, thereby improving the efficiency of object perception and avoiding the problems of low object perception efficiency and large data processing volume caused by relying on sampling data from a historical period.

[0148] According to an embodiment of the present application, the object perception device 500 also includes a third calculation module and a first generation module.

[0149] The third calculation module is used to calculate a first standard deviation according to the amplitudes of multiple subcarriers and the first amplitude mean.

[0150] The first generation module is used to generate a second detection result based on the first standard deviation and the tth body motion detection threshold, wherein the second detection result represents whether there is a detected object in the target area; when the second detection result shows that there is no detected object, calculate the autocorrelation function.

[0151] According to an embodiment of the present application, the tth body motion detection threshold is generated by the processing unit and the first calculation unit.

[0152] The processing unit is used to perform averaging and standard deviation processing on the first standard deviations to obtain a target average value and a target standard deviation.

[0153] The first calculation unit is used to calculate the tth body motion detection threshold according to the target mean and the target standard deviation.

[0154] According to an embodiment of the present application, the channel state information includes a plurality of subcarriers having subcarrier indexes.

[0155] According to an embodiment of the present application, the object perception device 500 further includes a second acquisition module and a deletion module.

[0156] The second acquisition module is used to acquire multiple pieces of association state information related to the channel state information.

[0157] The deletion module is used to delete the subcarrier amplitude corresponding to the subcarrier index from the channel state information for the same subcarrier index in the channel state information and multiple associated state information, when multiple subcarrier amplitudes corresponding to the subcarrier index are all preset values, to obtain multiple filtered subcarrier amplitudes.

[0158] According to an embodiment of the present application, the object perception device 500 also includes a fourth calculation module, a second generation module, and a screening module.

[0159] The fourth calculation module is used to calculate a second amplitude mean according to multiple subcarrier amplitudes, and calculate a second standard deviation according to the multiple subcarrier amplitudes and the second amplitude mean.

[0160] The second generating module is used to generate an amplitude difference for each subcarrier amplitude according to the subcarrier amplitude and the second amplitude average.

[0161] The screening module is used to delete the subcarrier amplitude corresponding to the amplitude difference from multiple channel state information when the amplitude difference meets a preset amplitude threshold, so as to obtain multiple filtered subcarrier amplitudes, wherein the preset amplitude threshold is generated according to the second standard deviation.

[0162] According to an embodiment of the present application, the second calculation module 540 includes a first generation unit and a second calculation unit.

[0163] The first generating unit is configured to generate an initial autocorrelation function according to multiple subcarrier amplitudes, an index interval parameter, and a first amplitude mean.

[0164] The second calculation unit is used to calculate the antenna index function according to the initial autocorrelation function.

[0165] According to an embodiment of the present application, the second calculation unit includes an assignment unit, a substitution unit, and a summation unit.

[0166] The assignment unit is used to assign multiple values ​​to the index interval parameter to obtain multiple index interval parameter values.

[0167] The substitution unit is used to substitute the index interval parameter value into the initial autocorrelation function for each index interval parameter value to obtain a target autocorrelation function.

[0168] The summing unit is used to sum a plurality of target autocorrelation functions to obtain an antenna index function.

[0169] According to an embodiment of the present application, the detection module 550 includes a determination unit, a second generation unit, and a third generation unit.

[0170] The determining unit is used to determine the maximum value of the antenna index function.

[0171] The second generating unit is configured to generate an object existence result when the maximum value satisfies a static detection threshold, wherein the object existence result indicates that the detected object exists in the target area.

[0172] The third generation unit is used to generate an object non-existence result when the maximum value does not meet the static detection threshold, wherein the object non-existence result indicates that the detected object does not exist in the target area, and the first detection result includes an object existence result or an object non-existence result.

[0173] According to an embodiment of the present application, the detection module 550 further includes a screening unit.

[0174] The screening unit is used to screen the maximum values ​​corresponding to the multiple antennas when the wireless device has multiple antennas, and obtain the screened maximum value, so as to compare the screened maximum value with the static detection threshold.

[0175] According to an embodiment of the present application, a wireless device includes multiple receiving antennas.

[0176] According to an embodiment of the present application, the first generation module includes a third calculation unit, a fourth generation unit, and a fifth generation unit.

[0177] The third calculation unit is configured to calculate a standard deviation mean according to the first standard deviation corresponding to each receiving antenna.

[0178] The fourth generating unit is configured to generate a detection existence result when the mean of the standard deviation is greater than the t-th body motion detection threshold, wherein the detection existence result indicates that the detected object exists in the target area.

[0179] The fifth generating unit is configured to generate a detection non-existence result when the standard deviation mean is not greater than the t-th body motion detection threshold, wherein the detection non-existence result indicates that the detected object does not exist in the target area.

[0180] According to the embodiments of the present application, any number of modules, submodules, units, and subunits, or at least part of the functions of any number of them, can be implemented in one module. According to the embodiments of the present application, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present application, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging the circuit, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present application, one or more of the modules, submodules, units, and subunits can be at least partially implemented as a computer program module, which can perform the corresponding functions when the computer program module is executed.

[0181] For example, any number of the acquisition module 510, the obtaining module 520, the first calculation module 530, the second calculation module 540, and the detection module 550 can be combined into a single module / unit / sub-unit, or any one of these modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functionality of one or more of these modules / units / sub-units can be combined with at least part of the functionality of other modules / units / sub-units and implemented in a single module / unit / sub-unit. According to an embodiment of the present application, at least one of the acquisition module 510, the obtaining module 520, the first calculation module 530, the second calculation module 540, and the detection module 550 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented in hardware or firmware by any other reasonable means of integrating or packaging circuits, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or any appropriate combination of any of these. Alternatively, at least one of the acquisition module 510 , the obtaining module 520 , the first calculation module 530 , the second calculation module 540 and the detection module 550 may be at least partially implemented as a computer program module, which may perform corresponding functions when executed.

[0182] It should be noted that the object perception device part in the embodiment of the present application corresponds to the object perception method part in the embodiment of the present application. The description of the object perception device part specifically refers to the object perception method part and will not be repeated here.

[0183] Figure 6 A block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present application is shown. Figure 6 The electronic device shown is merely an example and should not limit the functions and scope of use of the embodiments of the present application.

[0184] like Figure 6 As shown, an electronic device 600 according to an embodiment of the present application includes a processor 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage unit 608 into a random access memory (RAM) 603. The processor 601 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 601 may also include onboard memory for caching purposes. The processor 601 may include a single processing unit or multiple processing units for performing different actions of the method flow according to the embodiment of the present application.

[0185] Various programs and data required for the operation of the electronic device 600 are stored in the RAM 603. The processor 601, ROM 602, and RAM 603 are connected to each other via a bus 604. The processor 601 performs various operations of the method flow according to the embodiment of the present application by executing the programs in the ROM 602 and / or RAM 603. It should be noted that the programs may also be stored in one or more memories other than the ROM 602 and RAM 603. The processor 601 may also perform various operations of the method flow according to the embodiment of the present application by executing the programs stored in the one or more memories.

[0186] According to an embodiment of the present application, electronic device 600 may further include an input / output (I / O) interface 605, which is also connected to bus 604. Electronic device 600 may also include one or more of the following components connected to I / O interface 605: an input section 606 including a keyboard, mouse, etc.; an output section 607 including devices such as a cathode ray tube (CRT), liquid crystal display (LCD), and speakers; a storage section 608 including a hard disk; and a communication section 609 including a network interface card such as a LAN card or modem. Communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to I / O interface 605 as needed. Removable media 611, such as a magnetic disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed in drive 610 as needed, so that computer programs read from the removable media can be installed into storage section 608 as needed.

[0187] According to an embodiment of the present application, the method flow according to the embodiment of the present application can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the processor 601, the above-mentioned functions defined in the system of the embodiment of the present application are executed. According to an embodiment of the present application, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0188] This application also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments, or may exist independently and not be incorporated into the device / apparatus / system. The computer-readable storage medium carries one or more programs, and when the one or more programs are executed, the method according to the embodiments of this application is implemented.

[0189] According to embodiments of the present application, a computer-readable storage medium may be a non-volatile computer-readable storage medium. Examples include, but are not limited to, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0190] For example, according to an embodiment of the present application, the computer-readable storage medium may include the ROM 602 and / or the RAM 603 described above and / or one or more memories other than the ROM 602 and the RAM 603 .

[0191] An embodiment of the present application also includes a computer program product, which includes a computer program, which contains program code for executing the method provided by the embodiment of the present application. When the computer program product is run on an electronic device, the program code is used to enable the electronic device to implement the method provided by the embodiment of the present application.

[0192] When the computer program is executed by the processor 601, the above functions defined in the system / device of the embodiment of the present application are performed. According to the embodiment of the present application, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0193] In one embodiment, the computer program may be stored on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may be transmitted and distributed in the form of a signal on a network medium, downloaded and installed via the communication portion 609, and / or installed from a removable medium 611. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0194] According to an embodiment of the present application, the program code for executing the computer program provided by the embodiment of the present application can be written in any combination of one or more programming languages. Specifically, these computer programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect via the Internet).

[0195] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It will be understood by those skilled in the art that the features described in the various embodiments of the present application can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in the present application. In particular, without departing from the spirit and teachings of the present application, the features described in the various embodiments of the present application may be combined and / or coupled in various ways, and all of these combinations and / or couplings fall within the scope of the present application.

[0196] The embodiments of the present application have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present application. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be advantageously used in combination. The present application does not depart from the scope of the present application, and those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present application.

Claims

1. An object perception method, characterized in that: include: Using a wireless device to obtain channel state information transmitted by a wireless terminal at time t; Performing a modulo operation on the channel state information to obtain a signal amplitude matrix, wherein the signal amplitude matrix includes multiple subcarrier amplitudes; Calculating a first amplitude mean according to the plurality of subcarrier amplitudes; generating an autocorrelation function according to the plurality of subcarrier amplitudes and the first amplitude mean, and calculating an antenna index function according to the autocorrelation function; A first detection result is generated according to the antenna index function and a static detection threshold, wherein the first detection result indicates whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

2. The object perception method according to claim 1, characterized in that Before generating the autocorrelation function, the method further includes: Calculating a first standard deviation based on the plurality of subcarrier amplitudes and the first amplitude mean; generating a second detection result according to the first standard deviation and a tth body motion detection threshold, wherein the second detection result indicates whether the detected object exists in the target area; When the second detection result shows that the detected object does not exist, the autocorrelation function is calculated.

3. The object perception method according to claim 2, characterized in that: The tth body motion detection threshold is generated by: averaging and standard deviation-calculating the first standard deviations to obtain a target average and a target standard deviation; The tth body motion detection threshold is calculated according to the target mean value and the target standard deviation.

4. The object perception method according to claim 1, characterized in that: The channel state information includes a plurality of subcarriers having subcarrier indices; Before calculating the first amplitude mean, the method further includes: Acquire multiple pieces of association state information related to the channel state information; For the same subcarrier index in the channel state information and the multiple associated state information, when the multiple subcarrier amplitudes corresponding to the subcarrier index are all preset values, the subcarrier amplitude corresponding to the subcarrier index is deleted from the channel state information to obtain the filtered multiple subcarrier amplitudes.

5. The object perception method according to claim 4, characterized in that: Before obtaining the filtered plurality of channel state information, the method further includes: Calculating a second amplitude mean according to the plurality of subcarrier amplitudes, and calculating a second standard deviation according to the plurality of subcarrier amplitudes and the second amplitude mean; For each of the subcarrier amplitudes, generating an amplitude difference according to the subcarrier amplitude and the second amplitude mean; When the amplitude difference satisfies a preset amplitude threshold, the subcarrier amplitude corresponding to the amplitude difference is deleted from the multiple channel state information to obtain multiple filtered subcarrier amplitudes, wherein the preset amplitude threshold is generated based on the second standard deviation.

6. The object perception method according to claim 1, characterized in that: Generating an autocorrelation function according to the plurality of subcarrier amplitudes and the first amplitude mean, and calculating an antenna index function according to the autocorrelation function, comprising: generating an initial autocorrelation function according to the plurality of subcarrier amplitudes, the index interval parameter and the first amplitude mean; The antenna index function is calculated according to the initial autocorrelation function.

7. The object perception method according to claim 6, characterized in that: Calculating the antenna index function according to the initial autocorrelation function includes: Assigning the index interval parameter multiple times to obtain multiple index interval parameter values; For each index interval parameter value, substituting the index interval parameter value into the initial autocorrelation function to obtain a target autocorrelation function; A summation process is performed on a plurality of the target autocorrelation functions to obtain the antenna index function.

8. The object perception method according to claim 1, characterized in that: Generating a first detection result according to the antenna index function and a static detection threshold includes: determining a maximum value of the antenna index function; When the maximum value satisfies the static detection threshold, generating an object existence result, wherein the object existence result indicates that the detected object exists in the target area; If the maximum value does not meet the static detection threshold, generating an object non-existence result, wherein the object non-existence result indicates that the detected object does not exist in the target area, and the first detection result includes the object presence result or the object non-existence result; Wherein, when the wireless device has multiple antennas, the method further includes: The maximum values ​​corresponding to the plurality of antennas are screened to obtain a screened maximum value, and the screened maximum value is used to compare with the static detection threshold.

9. The object perception method according to claim 2, characterized in that: The wireless device includes a plurality of receiving antennas; Generating a second detection result according to the first standard deviation and the tth body movement detection threshold includes: Calculating a standard deviation mean based on the first standard deviation corresponding to each of the receiving antennas; When the mean of the standard deviation is greater than the t-th body motion detection threshold, generating a detection existence result, wherein the detection existence result indicates that the detected object exists in the target area; In a case where the mean of the standard deviation is not greater than the t-th body motion detection threshold, a detection non-existence result is generated, wherein the detection non-existence result indicates that the detected object does not exist in the target area.

10. An object sensing device, characterized in that: include: An acquisition module, configured to acquire, using a wireless device, the channel state information transmitted by the wireless terminal at time t; An obtaining module is configured to perform a modulo operation on the channel state information to obtain a signal amplitude matrix, wherein the signal amplitude matrix includes multiple subcarrier amplitudes; A first calculation module, configured to calculate a first amplitude mean according to the plurality of subcarrier amplitudes; a second calculation module, configured to generate an autocorrelation function according to the plurality of subcarrier amplitudes and the first amplitude mean, and calculate an antenna index function according to the autocorrelation function; The detection module is configured to generate a first detection result according to the antenna index function and a static detection threshold, wherein the first detection result indicates whether there is a detected object in the target area where the wireless device and the wireless terminal are located.

Images