Method, device, equipment and storage medium for adjusting wireless sensing process

Abstract

The present application relates to the field of wireless communications, and more specifically, to a method, apparatus, device, and storage medium for adjusting a wireless perception process, wherein the method includes an application module setting a current perception state to a first state, obtaining a perception event corresponding to the first state according to a perception application parameter table; the application module sending a perception start message to a communication module, requesting the communication module to perform perception measurement; the application module calculating a second perception state according to the perception measurement result; determining whether the perception event corresponding to the second perception state is the same as the perception event corresponding to the first perception state, and if so, continuing the current perception process; if not, setting the value of the first perception state to the value of the second perception state, and sending a perception update message to the communication module. By using the characteristics and classification management of the application, the measurement and calculation workload is reduced, thereby reducing the consumption of processor resources and the consumption of wireless resources, improving the overall operation smoothness of the device, and reducing data transmission delays.

Description

Technical Field

[0001] The present application relates to the field of wireless communications, and more specifically, to a method, apparatus, device, and storage medium for adjusting a wireless sensing process. Background Art

[0002] WLAN Sensing is a new technology that can leverage existing Wi-Fi networks and devices, using existing Wi-Fi signals to implement motion detection, gesture recognition, and biometric measurement. WLAN Sensing uses CSI- or Radar-based methods to detect changes in the environment caused by the movement of objects, pets, and people, without requiring the detected subjects to wear any equipment.

[0003] Through the implementation of WLAN sensing, more intelligent and richer applications can be provided in smart home, intrusion detection, healthcare, smart remote care and other fields. Summary of the Invention

[0004] The inventors have discovered that when making perception judgments, a large amount of calculation is usually required to calculate the original data and extract different behavioral feature data separately, such as high-frequency data to detect breathing rate, low-frequency data to detect whether there is a person or not, body movements, etc., which causes the device to process a huge amount of data and maintain a high sampling frequency, and consume a lot of processor resources for data calculation, classification and recognition, etc.

[0005] The purpose of the embodiments of the present application is to provide a method, apparatus, device and storage medium for adjusting the wireless perception process, perform classification management according to the status detected in the application, reduce the measurement and calculation workload through the characteristics of the application and classification management, thereby reducing the consumption of processor resources and wireless resources, improving the overall operation smoothness of the device and reducing data transmission delays.

[0006] The method provided in the embodiment of the present application includes:

[0007] The application module sets the current sensing state to the first state, and obtains a sensing event corresponding to the first state according to a sensing application parameter table, wherein the sensing application parameter table includes a parameter representing the sensing state, Sensing state, and a parameter Sensing events representing the sensing event corresponding to the Sensing state;

[0008] The application module sends a sensing start message to the communication module, requesting the communication module to perform sensing measurement;

[0009] The application module receives the sensing measurement results sent by the communication module;

[0010] The application module calculates a second perception state according to the perception measurement result;

[0011] If the perception event corresponding to the second perception state is the same as the perception event corresponding to the first perception state, then the value of the first perception state is set to the value of the second perception state, and the calculation is continued according to the perception measurement result;

[0012] If the perception event corresponding to the second perception state is different from the perception event corresponding to the first perception state, the value of the first perception state is set to the value of the second perception state, and a perception update message is sent to the communication module, requesting the communication module to adjust the perception process sending parameters to continue measurement, and the perception update message includes the perception event corresponding to the second perception state.

[0013] Preferably, the sensing state includes an initial parameter Initial, and the Sensing events corresponding to Initial include Presence or No presence;

[0014] The sensing state includes a parameter "leaving" indicating leaving, and the sensing events corresponding to leaving include "Presence" or "No presence";

[0015] The sensing state includes a parameter indicating playing, and the sensing events corresponding to playing include sleeping, watching, front approaching, and no presence.

[0016] The sensing state includes a parameter Dozing indicating snoring, and the Sensing events corresponding to Dozing include Sleeping or Watching;

[0017] The sensing state includes a parameter Warning indicating a warning, and the Sensing events corresponding to Warning include Presence or No presence.

[0018] Preferably, after receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and the preset event classification information table to continue measuring and obtain the perception measurement results.

[0019] Preferably, the event classification information table includes a parameter SensingCAT representing a preconfigured sensing mode number, a parameter Supported sensing events representing supported sensing events, a parameter Sensing method representing a measurement method, and a parameter Preferred sensing events representing recommended sensing events; wherein, the parameter Supported sensing events of the supported sensing events is used to indicate events that can be detected by the corresponding sensing mode, and the parameter Preferred sensing events of the recommended sensing events is used to indicate events for which the corresponding sensing mode can obtain a higher detection success rate or a higher detection efficiency.

[0020] Preferably, the communication module includes an SME unit and an MLME unit. After receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and a preset event classification information table to continue measurement and obtain the perception measurement result, including the following steps:

[0021] The SME unit receives a sensing update message, where the sensing update message includes sensing events corresponding to the second sensing state;

[0022] If the values ​​of all sensing events are contained in the preferred sensing events values ​​corresponding to the sensing CAT corresponding to the current process, the sensing process and the sensing measurement results will continue to be sent according to the parameters sent by the current sensing process.

[0023] Preferably, the communication module includes an SME unit and an MLME unit. After receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and a preset event classification information table to continue measurement and obtain the perception measurement result, including the following steps:

[0024] The SME unit receives a sensing update message, where the sensing update message includes sensing events corresponding to the second sensing state;

[0025] If the values ​​of sensing events are all contained in the Supported sensing events value corresponding to the sensing CAT, the sensing process and sensing measurement results will continue to be sent according to the parameters sent by the current sensing process.

[0026] Preferably, the communication module includes an SME unit and an MLME unit. After receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and a preset event classification information table to continue measurement and obtain the perception measurement result, including the following steps:

[0027] The SME unit receives a sensing update message, where the sensing update message includes sensing events corresponding to the second sensing state;

[0028] If the values ​​of sensing events are neither fully contained in the Preferred sensing events values ​​corresponding to the sensing CAT corresponding to the current process, nor fully contained in the Supported sensing events corresponding to a certain sensing CAT, then check in the information table whether there is a Preferred sensing events value corresponding to the sensing CAT that fully contains the values ​​of sensing events. If so, construct a new sensing process to send parameters to perform the sensing process and send the sensing measurement results.

[0029] Preferably, the method further comprises the steps of:

[0030] Sending a control instruction to the control module according to the sensing measurement result.

[0031] Preferably, the sending of control instructions to the control module according to the perception measurement result comprises the steps of:

[0032] If the sensing state value is playing, the perception measurement results are subjected to noise reduction processing;

[0033] According to the sensing events corresponding to the playback, the denoised data is behaviorally segmented to obtain the updated sensing state and sensing events.

[0034] Preferably, the behavior segmentation includes the following steps:

[0035] Identify whether the target object is in motion or stationary behavior based on the standard deviation of the CSI phase difference signal in the perception measurement result;

[0036] If the target object is in motion, identify the target object's position; if the target object is within the front angle range of the display device, set the updated sensing state value to warning;

[0037] If the target object is in a stationary state, identify whether the target object is in a sleeping state. If the target object is in a sleeping state, set the updated sensing state value to dozing.

[0038] Preferably, sending a control instruction to the control module according to the updated sensing state and sensing events includes the following steps:

[0039] If the updated sensing state value changes and the updated sensing events value changes, a sensing update message is sent to the SME unit to continue measuring;

[0040] If the updated sensing state value is warning and a presence event is detected, a command is sent to the control module to turn off the light source of the display device;

[0041] If the updated sensing state value is warning and the nopresence event is continuously detected within the time T_warning, a command is sent to the control module to turn on the light source of the display device;

[0042] If the updated sensing state value is dozing and a sleeping event is detected, a command is sent to the control module to turn off the light source of the display device and the speaker of the display device;

[0043] If the updated sensing state value is dozing and no sleeping event is continuously detected within the time T_sleeping, an instruction is sent to the control module to turn on the light source of the display device and the speaker of the display device.

[0044] Preferably, the application module sends a perception start message to the communication module, requesting the communication module to perform perception measurement, including the steps of:

[0045] Sending a sensing start message to the SME unit of the communication module; the sensing start message includes parameters Sensingevents and Sensing interval indicating a measurement interval;

[0046] The SME unit receives the sensing start message and constructs the sensing process sending parameter sensing TX element according to the sensing start message and the event classification information table set by the SME unit;

[0047] The SME unit and the MLME unit negotiate the sensing process to perform sensing measurements.

[0048] Preferably, the SME unit and the MLME unit negotiate a perception process to perform perception measurement, comprising the steps of:

[0049] The SME unit sends the MLME-SENSING.request primitive to the MLME unit. The primitive includes the sensing process sending parameter sensing TX element and the sensing process role information element sensing role element.

[0050] The SME unit receives the MLME-SENSING.response primitive, which includes a parameter Result code indicating the response result;

[0051] If the result code value in the primitive is success, the SME unit waits for the subsequent measurement report. If the result code value in the primitive is failure, the SME unit sends a sensing reject message to inform it that the sensing process has not been successfully executed.

[0052] The SME unit receives the MLME-SENSING.report primitive, which contains the sensing measurement data;

[0053] The SME unit sends a perception measurement result message.

[0054] Preferably, the constructing of the sensing process sending parameter sensing TX element according to the sensing start message and the event classification information table set by the SME unit includes:

[0055] The event classification information table includes a parameter Sensing CAT indicating a preconfigured sensing mode number, a parameter Sensing method indicating a measurement method, and a parameter Preferred sensing events indicating recommended sensing events;

[0056] Search the Preferred sensing events parameter in the event classification information table. If all the values ​​of sensing events are included in the Preferred sensing events parameter, select the measurement method and sensing measurement sending parameters contained in the corresponding sensing CAT to construct the sensing process sending parameter sensing TX element.

[0057] Preferably, after the SME unit receives the MLME-SENSING.response primitive, it includes the following sensing process role negotiation steps:

[0058] The MLME-SENSING.request primitive includes a parameter ResponderAddress indicating the address of the responder of the sensing process;

[0059] If the address of ResponderAddress is the address of the local device, check whether the Sensing method in the Sensing TX element is RADAR mode, indicating that the local device performs signal transmission, receives reflected signals, and measures reflected signals. If so, set the result code parameter value to SUCCESS; if not, set the result code parameter value to FAILURE;

[0060] If the address of ResponderAddress is the address of another device, a sensing session request message is sent to the device corresponding to the address, and the message includes a Sensing TX element and a Sensing role element. If a sensing session response message is received from the other device, indicating that the sensing process is accepted, the result code parameter value is set to SUCCESS. If no sensing session response message is received from the other device, or if a sensing session response message is received from the other device, indicating that the sensing process is rejected, the result code parameter value is set to FAILURE.

[0061] Preferably, the parameters sent by the sensing process include a parameter Operatingband used to indicate a frequency band for performing measurement, a parameter Sensingmethod used to indicate a measurement method, and a parameter Measurementinterval used to indicate a measurement interval.

[0062] In a second aspect, the apparatus provided in the embodiments of the present application includes:

[0063] An application module is used to set the current sensing state to a first state, obtain the sensing event corresponding to the first state according to a sensing application parameter table, wherein the sensing application parameter table includes a parameter representing the sensing state, Sensing state, and a parameter Sensing events of a target event corresponding to the Sensing state; is used to send a sensing start message to the communication module, requesting the communication module to perform sensing measurement; is used to receive the sensing measurement result sent by the communication module; is used to calculate a second sensing state according to the sensing measurement result; and determines whether the sensing event corresponding to the second sensing state is the same as the sensing event corresponding to the first sensing state, if the same, sets the value of the first sensing state to the value of the second sensing state, and continues to calculate according to the sensing measurement result; if different, sets the value of the first sensing state to the value of the second sensing state, and sends a sensing update message to the communication module, requesting the communication module to adjust the sensing process sending parameter to continue measurement, wherein the sensing update message includes the sensing event corresponding to the second sensing state;

[0064] Communication module, used to receive a perception start message; used to perform perception measurement; used to receive a perception update message to adjust the perception process sending parameters to continue measurement;

[0065] The control module generates control instructions and response operations based on the perception measurement results.

[0066] In a third aspect, the device provided in an embodiment of the present application includes a processor and a memory, wherein a computer program is stored in the memory, and the processor is used to execute the computer program to implement the method provided in the above-mentioned first aspect, or any optional implementation method of the first aspect.

[0067] In a fourth aspect, an embodiment of the present application further provides a storage medium having a computer program stored thereon. When the computer program is executed, the method provided by the above-mentioned first aspect or any optional implementation manner of the first aspect is implemented.

[0068] The apparatus, device, and storage medium provided in the embodiments of the present application have the same beneficial effects as the method provided in the first aspect or any optional implementation of the first aspect described above, and are not described in detail here.

[0069] The method provided in the embodiment of the present application detects whether the perception events corresponding to different states are the same. If they are the same, the perception process sending parameters are not reset; if they are different, the perception message is updated. The method determines whether the perception process sending parameters need to be adjusted based on the event classification table. This helps to speed up the response of the perception process and save wireless resources and processor computing resources based on state-event classification. That is, classification management is performed based on the states detected in the application, and the measurement and computing workload is reduced through application characteristics and classification management, thereby reducing the consumption of processor resources and wireless resources, improving the overall operation smoothness of the device and reducing data transmission delay. DETAILED DESCRIPTION

[0070] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described below.

[0071] Wireless Local Area Network (WLAN) sensing: wireless perception;

[0072] Station (STA): terminal equipment;

[0073] Access Point (AP): access device;

[0074] Station Management Entity (SME): equipment management unit;

[0075] MAC Layer Management Entity (MLME): MAC layer management unit;

[0076] sensing start message: sensing start message;

[0077] sensing update message: perception update message;

[0078] sensing session request message: sensing session request message;

[0079] Sensing session response message: sensing session response message;

[0080] CSI (Channel State Information): channel state information;

[0081] Radar: radar;

[0082] sensing reject message: sensing reject message;

[0083] In the 802.11 system, both access devices (AP STAs) and terminal devices (non-AP STAs) are internally deployed with the MAC layer and PHY layer. The main functions of the MAC layer include channel management, connection management, quality of service management, power control, and time synchronization. The main functions of the PHY layer include modulation, coding, and transmission.

[0084] Conceptually, both the MAC layer and the PHY layer include management entities called the MAC layer management element (MLME) and the physical layer management element (PLME) (PHY sublayer management entity), respectively. These elements provide low-layer management service interfaces through which low-layer management functions can be invoked. To ensure proper MAC operation, each STA, including non-AP STAs and AP STAs, has a high-level management element, such as the SME element. The SME element represents the high-level management entity above the MAC layer. The SME element is responsible for functions such as collecting layer-related status from various layer management elements (MLME and PLME). The various layers interact with each other through defined primitives.

[0085] WLAN sensing, as a new technical feature, involves operations such as data acquisition, preprocessing and denoising, anomaly detection, feature extraction, and classification and recognition. Furthermore, the perceived environment is not limited to a single behavior. For example, the presence of a person is accompanied by natural behaviors such as gestures, breathing, and possible falls. The inventors have discovered that when making perception judgments, a large amount of computation is typically required to calculate the raw data and extract different behavioral feature data. For example, high-frequency data is used to detect breathing rate, and low-frequency data is used to detect presence and body movements. This results in the device having to process huge amounts of data and maintain a high sampling frequency, consuming significant processor resources for data calculation, classification, and recognition.

[0086] The purpose of the embodiments of the present application is to provide a method, apparatus, device and storage medium for adjusting the wireless perception process, perform classification management according to the status detected in the application, reduce the measurement and calculation workload through the characteristics of the application and classification management, thereby reducing the consumption of processor resources and wireless resources, improving the overall operation smoothness of the device and reducing data transmission delays.

[0087] In a first aspect, the method provided in an embodiment of the present application is applied to a display device, wherein the display device includes an application module, a communication module, and a control module, including:

[0088] The application module sets the current sensing state to the first state, and obtains a sensing event corresponding to the first state according to a sensing application parameter table, wherein the sensing application parameter table includes a parameter representing the sensing state, Sensing state, and a parameter Sensing events representing the sensing event corresponding to the Sensing state;

[0089] The application module sends a sensing start message to the communication module, requesting the communication module to perform sensing measurement;

[0090] The application module receives the sensing measurement results sent by the communication module;

[0091] The application module calculates a second perception state according to the perception measurement result;

[0092] If the perception event corresponding to the second perception state is the same as the perception event corresponding to the first perception state, then the value of the first perception state is set to the value of the second perception state, and the calculation is continued according to the perception measurement result;

[0093] If the perception event corresponding to the second perception state is different from the perception event corresponding to the first perception state, the value of the first perception state is set to the value of the second perception state, and a perception update message is sent to the communication module, requesting the communication module to adjust the perception process sending parameters to continue measurement, and the perception update message includes the perception event corresponding to the second perception state.

[0094] By detecting whether the perception events corresponding to different states are the same, if they are the same, the perception process sending parameters will not be reset; if they are different, the perception message will be updated. According to the event classification table, it is determined whether the perception process sending parameters need to be adjusted. This is beneficial to speed up the response of the perception process based on state-event classification and save wireless resources and processor computing resources.

[0095] The details are as follows:

[0096] In this embodiment, a projector is used as the display device for illustration.

[0097] Set the projector's sensing application parameter table. The sensing application parameter table includes the parameters Sensing state and Sensing events. Sensing state represents the sensing state, and sensing events represents the sensing events that need to be detected by wireless sensing corresponding to the sensing state. The details of the sensing application parameter table are as follows:

[0098]

[0099]

[0100] Open the projector application module and set the parameter sensing state value to initial;

[0101] When the sensing state value is initial, the application module sends a sensing start message to the SME unit of the communication module (Wi-Fi module). The sensing start message contains the following parameters:

[0102] parameter illustrate value Sensing events Events that require perception; Presence Sensing interval Measurement interval of sensing events SI_Presence

[0103] After receiving the sensing start message, the SME unit determines the sensing measurement sending parameters based on the sensing events and sensing interval;

[0104] The SME unit pre-sets the following event classification information table locally:

[0105]

[0106]

[0107] First, search the Preferred Sensing Events parameter in the event classification information table. If all the values ​​of Sensing Events are included in the Preferred Sensing Events parameter, select the corresponding sensing measurement method and measurement transmission parameters contained in the Sensing CAT to construct the sensing process transmission parameters Sensing TX. The Sensing TX element includes the following parameters:

[0108] parameter illustrate Operating band Frequency band in which the measurement is performed Sensing method Measurement method Measurement interval Measurement interval

[0109] The measurement interval is determined by the sensing interval parameter and can be set as: Measurement interval = sensing interval - 2 × Delay_air - 2 × Delay_internal, where Delay_air is the air interface signaling transmission delay and Delay_internal is the device internal processing delay.

[0110] The SME unit sends the MLME-SENSING.request primitive to the MLME unit of the Wi-Fi module. The primitive contains:

[0111] parameter illustrate ResponderAddress The address of the responder of the sensing process Dialog token Identifies the current session Sensing role element Perception process role information element Sensing TX element Perception process sends parameters

[0112] The sensing TX element is set as in step 4, and the sensing role element is set as follows:

[0113]

[0114]

[0115] After the MLME unit receives the MLME-SENSING.request primitive,

[0116] If the address of ResponderAddress is the address of the local device, check whether the Sensing method in the Sensing TX element is RADAR mode. If so, set the result code parameter value to SUCCESS, and the local device sends the signal and receives and measures the reflected signal. If not, set the result code parameter value to FAILURE.

[0117] If the address of ResponderAddress is the address of another device, a SensingSessionRequest message is sent to the device corresponding to the address, and the message includes a SensingTX element and a SensingRoleElement. If a SensingSessionResponse message is received from the other device, indicating that the sensing process is accepted, the ResultCode parameter value is set to SUCCESS. If no SensingSessionResponse message is received from the other device, or if a SensingSessionResponse message is received from the other device, indicating that the sensing process is rejected, the ResultCode parameter value is set to FAILURE.

[0118] The MLME unit sends the MLME-SENSING.response primitive to the SME unit. The primitive contains:

[0119] Dialog token Identifies the current session Result code Response result, set according to step 6;

[0120] If the address of ResponderAddress is the address of another device, and the transmitter in the sensing role element is set to this device, then this device sends a sensing signal, and the responder device (that is, the aforementioned other device) receives and measures the sensing signal and reports the sensing signal measurement result to this device.

[0121] If the address of ResponderAddress is the address of another device, and the transmitter in the sensing role element is set to another device, the local device receives the sensing signal sent by the responder device and measures the sensing signal to obtain the measurement result;

[0122] After receiving the MLME-SENSING.response primitive, if the result code value in the primitive is success, the SME unit waits for subsequent measurement reports. If the result code value in the primitive is failure, it sends a sensingreject message to the application module to inform it that the sensing process has failed.

[0123] After obtaining the measurement results, the MLME unit sends the MLME-SENSING.report primitive to the SME unit. The primitive contains the sensing measurement data.

[0124] The SME unit sends a sensing result message to the application module, which contains the sensing measurement data;

[0125] After the application module obtains the sensing measurement data, it determines the sensing events based on the current state parameter sensing state, performs data denoising and feature extraction based on the events (presence, no presence) defined in the sensing events, and then performs classification and recognition through the SVM classifier. If the classification and recognition result is no presence, the state parameter sensing state is set to leaving; if the classification and recognition result is presence, the state parameter sensing state is set to playing.

[0126] If the state parameter sensing state value is leaving, the application module sets the initial value of the sensing state to leaving and continues the calculation based on the sensing measurement results;

[0127] If the state parameter sensing state value is playing, the application module sets the initial value of the sensing state to playing and sends a sensing update message to the SME unit, which contains the updated sensing events;

[0128] After the SME unit receives the sensing update message,

[0129] If all the values ​​of sensing events are included in the preferred sensing events values ​​corresponding to the sensing CAT corresponding to the current process, the sensing process and the sensing measurement results will continue to be sent according to the parameters sent by the current sensing process.

[0130] If the values ​​of all sensing events are contained in the Supported sensing events corresponding to a sensing CAT, the sensing process and sensing measurement results are continued to be executed according to the parameters sent by the current sensing process; that is, a method similar to that of constructing the sensing process corresponding to the above-mentioned Preferred sensing events is selected, the sensing measurement method and measurement sending parameters contained in the sensing CAT are selected to construct a new sensing TX element, and the MLME-SENSINGUPDATE.request primitive is sent to the MLME unit, and the primitive includes the updated sensing TX element; after the MLME unit receives the MLME-SENSINGUPDATE.request primitive, if the value of ResponderAddress in the previous step 6 is the local address, the new sensing signal is sent according to the sensing TX element, and is received and measured; if the value of ResponderAddress in the previous step 6 is another address, a sensing session request message is sent to the device corresponding to the address, and the message indicates that the transmission parameters are updated and includes the updated sensing TX element;

[0131] If the values ​​of sensing events are neither fully contained in the Preferred sensing events values ​​corresponding to the sensing CAT corresponding to the current process nor fully contained in the Supported sensing events corresponding to a certain sensing CAT, then check in the information table whether there is a Preferred sensing events value corresponding to the sensing CAT that fully contains the values ​​of sensing events. If so, construct a new sensing TX element and send the MLME-SENSINGUPDATE.request primitive to the MLME unit, which contains the updated sensing TX element.

[0132] After receiving the MLME-SENSINGUPDATE.request primitive, if the value of ResponderAddress in step 6 is the local address, the MLME unit performs new sensing signal transmission, reception and measurement according to the sensing TX element; if the value of ResponderAddress in step 6 is another address, the MLME unit sends a sensing session request message to the device corresponding to the address, and indicates in the message that the transmission parameters are updated and includes the updated sensing TX element;

[0133] The MLME unit sends the updated sensing measurement data to the SME unit;

[0134] The SME unit sends the updated perception measurement data to the application module;

[0135] After the application module receives the sensory measurement data, if the current state parameter "sensing state" is "playing", it performs noise reduction processing on the sensory data. Then, based on the value of "sensing events", it performs behavior segmentation on the noise-reduced data. First, it identifies whether the person is moving or stationary based on the standard deviation of the CSI phase difference signal in the sensory data. Second, in the case of moving behavior, it identifies whether the person is within the front-end angle range of the projector or the rear-end preset range. If the person is within the front-end preset range, it sets the state parameter "sensing state" to "warning". Third, in the case of stationary behavior, it identifies whether the person is sleeping. If so, it sets the state parameter "sensing state" to "dozing".

[0136] therefore:

[0137] If the state parameter sensing state value changes and the sensing events value changes, a sensing update message is sent to the SME unit;

[0138] If the state parameter sensing state value is warning and a presence event is detected, the application module sends a command to turn off the projector's optical engine;

[0139] If the state parameter sensing state value is warning and the nopresence event is continuously detected within the time T_warning, the application module sends a command to turn on the projector's optical engine;

[0140] If the state parameter sensing state value is dozing and a sleeping event is detected, the application module sends a command to turn off the projector's optical engine and the projector's speakers;

[0141] If the state parameter sensing state value is dozing and no sleeping event is continuously detected within the time T_sleeping, the application module sends a command to turn on the projector's optical engine and the projector's speakers.

[0142] Based on the same inventive concept as the above method, an embodiment of the present application further provides a device, comprising:

[0143] An application module is used to set the current sensing state to a first state, obtain the sensing event corresponding to the first state according to a sensing application parameter table, wherein the sensing application parameter table includes a parameter representing the sensing state, Sensing state, and a parameter Sensing events of a target event corresponding to the Sensing state; is used to send a sensing start message to the communication module, requesting the communication module to perform sensing measurement; is used to receive the sensing measurement result sent by the communication module; is used to calculate a second sensing state according to the sensing measurement result; and determines whether the sensing event corresponding to the second sensing state is the same as the sensing event corresponding to the first sensing state, if the same, sets the value of the first sensing state to the value of the second sensing state, and continues to calculate according to the sensing measurement result; if different, sets the value of the first sensing state to the value of the second sensing state, and sends a sensing update message to the communication module, requesting the communication module to adjust the sensing process sending parameter to continue measurement, wherein the sensing update message includes the sensing event corresponding to the second sensing state;

[0144] Communication module, used to receive a perception start message; used to perform perception measurement; used to receive a perception update message to adjust the perception process sending parameters to continue measurement;

[0145] The control module generates control instructions and response operations based on the perception measurement results.

[0146] The application module includes a configuration unit, a judgment unit and a communication unit 1. The configuration unit is used to set a perception application parameter table. The judgment unit is used to calculate whether the perception state corresponds to the same event before and after based on the perception measurement results and change the value of the perception state. The communication unit 1 is used to send a perception start message to the communication module, and send a perception update message to the communication module when the event before and after the perception state is different, requesting the communication module to adjust the perception process sending parameters to continue measurement.

[0147] The communication module includes an SME unit and an MLME unit. The SME unit is used to receive messages sent by the application module and perform primitive communication negotiation and perception process with the MLME unit. The MLME unit is used to perform primitive communication negotiation and perception process with the SME unit.

[0148] The control module includes a control unit, and the control unit is used to generate a control instruction response operation according to the perception measurement result.

[0149] The device may be a display device with wireless sensing capabilities, such as a smart TV or a projection device. Other devices supporting wireless sensing capabilities that participate in the wireless sensing process may be routers, smart refrigerators, smart speakers, and the like.

[0150] Based on the same inventive concept as the above method, an embodiment of the present application further provides a device, including a processor and a memory, wherein a computer program is stored in the memory, and the processor is used to execute the computer program to implement the above method.

[0151] In addition, an embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed, the method provided by the above method embodiment is implemented. For details, please refer to the above method embodiment, which will not be described in detail in the embodiment of the present application.

[0152] In summary, the method provided in the embodiment of the present application detects whether the perception events corresponding to different states are the same. If they are the same, the perception process sending parameters are not reset. If they are different, the perception message is updated. The method determines whether the perception process sending parameters need to be adjusted according to the event classification table. This is beneficial to speeding up the response of the perception process and saving wireless resources and processor computing resources based on state-event classification. That is, classification management is performed according to the state detected in the application, and the measurement and calculation workload is reduced through the characteristics of the application and classification management, thereby reducing the consumption of processor resources and the consumption of wireless resources, improving the overall operation smoothness of the device and reducing data transmission delay.

[0153] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely illustrative.

[0154] In addition, the functional modules in each embodiment of the present application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0155] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a random access memory (RAM), a read-only memory (ROM), a magnetic disk, or an optical disk.

[0156] The above description is merely an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, various modifications and variations of the present application are possible. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

[0157] In addition, it should be noted that, in this document, relational terms such as "first," "second," "third," etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include," "comprise," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus.

Claims

1. A method for adjusting a wireless sensing process, characterized in that: The application module sets the current sensing state to a first state, and obtains sensing events corresponding to the first state according to a sensing application parameter table, wherein the sensing application parameter table includes a parameter Sensing state representing the sensing state and a parameter Sensing events corresponding to the Sensing state, wherein the sensing state Sensing state includes a parameter Initial representing the initial, and the Sensing events corresponding to Initial include Presence or No presence; the sensing state Sensing state includes a parameter Leaving representing leaving, and the Sensing events corresponding to Leaving include Presence or No presence; the sensing state Sensing state includes a parameter Playing representing playing, and the Sensing events corresponding to Playing include Sleeping, Watching, Front Approaching, or No presence; the sensing state Sensing state includes a parameter Dozing representing snoring, and the Sensing events corresponding to Dozing include Sleeping or Watching; the sensing state Sensing state includes a parameter Warning representing warning, and the Sensing events corresponding to Warning include Presence or No presence; The application module sends a sensing start message to the communication module, requesting the communication module to perform sensing measurement; The application module receives the sensing measurement results sent by the communication module; The application module calculates a second perception state according to the perception measurement result; If the perception event corresponding to the second perception state is the same as the perception event corresponding to the first perception state, then the value of the first perception state is set to the value of the second perception state, and the calculation is continued according to the perception measurement result; If the perception event corresponding to the second perception state is different from the perception event corresponding to the first perception state, the value of the first perception state is set to the value of the second perception state, and a perception update message is sent to the communication module, requesting the communication module to adjust the perception process sending parameters to continue measurement, and the perception update message includes the perception event corresponding to the second perception state.

2. The method according to claim 1, characterized in that After receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and the preset event classification information table to continue measuring and obtain the perception measurement results.

3. The method according to claim 2, characterized in that The event classification information table includes a parameter Sensing CAT representing a preconfigured sensing mode number, a parameter Supported sensing events representing supported sensing events, a parameter Sensing method representing a measurement method, and a parameter Preferred sensing events representing recommended sensing events; wherein, the parameter Supported sensing events of the supported sensing events is used to indicate events that can be detected by the corresponding sensing mode, and the parameter Preferred sensing events of the recommended sensing events is used to indicate events for which the corresponding sensing mode can obtain a higher detection success rate or a higher detection efficiency.

4. The method according to claim 2, characterized in that The communication module includes an SME unit and an MLME unit. After receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and a preset event classification information table to continue measurement and obtain perception measurement results, including the following steps: The SME unit receives a sensing update message, where the sensing update message includes sensing events corresponding to the second sensing state; If the values ​​of all sensing events are included in the preferred sensing events values ​​corresponding to the sensing CAT corresponding to the current process, the sensing process and sensing measurement results will continue to be sent according to the parameters sent by the current sensing process.

5. The method according to claim 2, characterized in that The communication module includes an SME unit and an MLME unit. After receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and a preset event classification information table to continue measurement and obtain perception measurement results, including the following steps: The SME unit receives a sensing update message, where the sensing update message includes sensing events corresponding to the second sensing state; If the values ​​of sensing events are all contained in the Supported sensing events values ​​corresponding to the sensing CAT, the sensing process and sensing measurement results will continue to be sent according to the parameters sent by the current sensing process.

6. The method according to claim 2, characterized in that The communication module includes an SME unit and an MLME unit. After receiving the perception update message, the communication module adjusts the perception process sending parameters according to the perception event corresponding to the second perception state in the perception update message and a preset event classification information table to continue measurement and obtain perception measurement results, including the following steps: The SME unit receives a sensing update message, where the sensing update message includes sensing events corresponding to the second sensing state; If the values ​​of sensing events are neither fully contained in the Preferred sensing events values ​​corresponding to the sensing CAT corresponding to the current process, nor fully contained in the Supported sensing events corresponding to a certain sensing CAT, then check in the information table whether there is a Preferred sensing events value corresponding to the sensing CAT that fully contains the values ​​of sensing events. If so, construct a new sensing process to send parameters to perform the sensing process and send the sensing measurement results.

7. The method according to claim 2, characterized in that Also includes the steps: Sending a control instruction to the control module according to the sensing measurement result.

8. The method according to claim 7, characterized in that The sending of control instructions to the control module according to the perception measurement results comprises the steps of: If the sensing state value is playing, the perception measurement results are subjected to noise reduction processing; According to the sensing events corresponding to the playback, the denoised data is behaviorally segmented to obtain the updated sensing state and sensing events.

9. The method according to claim 8, characterized in that The behavior segmentation includes the following steps: Identify whether the target object is in motion or stationary behavior based on the standard deviation of the CSI phase difference signal in the perception measurement result; If the target object is a moving behavior, identify the location of the target object; If the target object is within the front angle range of the display device, set the updated sensing state value to warning; If the target object is in a stationary state, identify whether the target object is in a sleeping state. If the target object is in a sleeping state, set the updated sensing state value to dozing.

10. The method according to claim 9, characterized in that Sending control instructions to the control module based on the updated sensing state and sensing events includes the following steps: If the updated sensing state value changes and the updated sensing events value changes, a sensing update message is sent to the SME unit to continue measuring; If the updated sensing state value is warning and a presence event is detected, a command is sent to the control module to turn off the light source of the display device; If the updated sensing state value is warning and the nopresence event is continuously detected within the time T_warning, a command is sent to the control module to turn on the light source of the display device; If the updated sensing state value is dozing and a sleeping event is detected, a command is sent to the control module to turn off the light source of the display device and the speaker of the display device; If the updated sensing state value is dozing and no sleeping event is continuously detected within the time T_sleeping, an instruction is sent to the control module to turn on the light source of the display device and the speaker of the display device.

11. The method according to claim 1, wherein The application module sends a perception start message to the communication module, requesting the communication module to perform perception measurement, including the following steps: Sending a sensing start message to the SME unit of the communication module; the sensing start message includes parameters Sensingevents and Sensing interval indicating a measurement interval; The SME unit receives the sensing start message and constructs the sensing process sending parameter sensing TX element according to the sensing start message and the event classification information table set by the SME unit; The SME unit and the MLME unit negotiate the sensing process to perform sensing measurements.

12. The method according to claim 11, characterized in that The SME unit and the MLME unit negotiate a sensing process to perform sensing measurement, including the following steps: The SME unit sends the MLME-SENSING.request primitive to the MLME unit. The primitive includes the sensing process sending parameter sensing TX element and the sensing process role information element sensing role element. The SME unit receives the MLME-SENSING.response primitive, which includes a parameter Result code indicating the response result; If the result code value in the primitive is success, the SME unit waits for the subsequent measurement report. If the result code value in the primitive is failure, the SME unit sends a sensing reject message to inform it that the sensing process has not been successfully executed. The SME unit receives the MLME-SENSING.report primitive, which contains the sensing measurement data; The SME unit sends a perception measurement result message.

13. The method according to claim 11, characterized in that The sensing process sending parameter sensing TX element is constructed according to the sensing start message and the event classification information table set by the SME unit, including: The event classification information table includes a parameter Sensing CAT indicating a preconfigured sensing mode number, a parameter Sensing method indicating a measurement method, and a parameter Preferred sensing events indicating a recommended sensing event; Search the Preferred sensing events parameter in the event classification information table. If all the values ​​of the sensing events are included in the Preferred sensing events parameter, select the measurement method and sensing measurement sending parameters contained in the corresponding sensing CAT to construct the sensing process sending parameter sensing TX element.

14. The method according to claim 12, characterized in that After the SME unit receives the MLME-SENSING.response primitive, it includes the following steps for negotiating the role of the sensing process: The MLME-SENSING.request primitive includes a parameter ResponderAddress indicating the address of the responder of the sensing process; If the address of ResponderAddress is the address of the local device, check whether the Sensingmethod in the SensingTX element is RADAR mode, indicating that the local device performs signal transmission, receives reflected signals, and measures reflected signals. If so, set the result code parameter value to SUCCESS; if not, set the result code parameter value to FAILURE; If the address of ResponderAddress is the address of another device, a sensing session request message is sent to the device corresponding to the address, and the message includes a Sensing TX element and a Sensing role element. If a sensing session response message is received from the other device, indicating that the sensing process is accepted, the result code parameter value is set to SUCCESS. If no sensing session response message is received from the other device, or if a sensing session response message is received from the other device, indicating that the sensing process is rejected, the result code parameter value is set to FAILURE.

15. The method according to claim 5, 6, 7 or 11, characterized in that: The parameters sent by the sensing process include a parameter Operating band used to represent the frequency band for performing measurement, a parameter Sensing method used to represent the measurement method, and a parameter Measurement interval used to represent the measurement interval.

16. A device, characterized in that include: an application module, configured to set a current sensing state to a first state and obtain sensing events corresponding to the first state according to a sensing application parameter table, wherein the sensing application parameter table includes a parameter representing the sensing state (Sensing state) and a parameter (Sensing events) representing a target event corresponding to the Sensing state; Used to send a perception start message to the communication module, requesting the communication module to perform perception measurement; Used to receive the perception measurement result sent by the communication module; used to calculate the second perception state according to the perception measurement result; and determine whether the perception event corresponding to the second perception state is the same as the perception event corresponding to the first perception state, if the same, set the value of the first perception state to the value of the second perception state, and continue to calculate according to the perception measurement result; if different, set the value of the first perception state to the value of the second perception state, and send a perception update message to the communication module, requesting the communication module to adjust the perception process sending parameters to continue measurement, the perception update message includes the perception event corresponding to the second perception state, wherein the perception state Sensing state includes the parameter Initial representing the initial, and the Sensing events corresponding to Initial include Presence or No presence; the perception state Sensing state includes the parameter Leaving representing leaving, and the Sensing events corresponding to Leaving include Presence or No presence; the perception state Sensing state includes the parameter Playing representing playing, and the Sensing events corresponding to Playing include Sleeping or Watching or Front Approaching or No presence; the perception state Sensing state includes the parameter Dozing representing snoring, and the Sensing events corresponding to Dozing Events include Sleeping or Watching; the Sensing state includes a parameter Warning indicating a warning, and the Sensing events corresponding to Warning include Presence or No presence; Communication module, used to receive a perception start message; used to perform perception measurement; used to receive a perception update message to adjust the perception process sending parameters to continue measurement; The control module generates control instructions and response operations based on the perception measurement results.

17. A device, characterized in that The method comprises a processor and a memory, wherein the memory stores a computer program, and the processor is configured to execute the computer program to implement the method according to any one of claims 1 to 15.

18. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed, the method according to any one of claims 1 to 15 is implemented.

Images