Wireless sensing method, communication device, and storage medium

Abstract

The present application discloses a wireless sensing method, a communication device, and a storage medium. The method comprises: building a real-time state machine model for a sensing object; and determining an environmental state of the sensing object on the basis of the real-time state machine model.

Description

[0113] As shown in FIG. 6, a state machine set is denoted as S(K), and the initial state of the state machine S(0) is set to be the current channel impulse response vector, i.e. . K is the total number of states, K is an integer, S' is the temporary state of the state machine, K' is the current state number, and K' is an integer.

[0114] In the initial state, the initial state S(0) is the current state, the initial value of K is 0, and the temporary state is S' = S(0), with K' = K, and the switching information of the state machine at the current moment is recorded, i.e., whether the state machine has switching, if yes, it should be recorded from which state to which state, the switching information of the state machine includes, but is not limited to, the time, the number, and the states before and after the switching.

[0115] Wherein, the state of the state machine corresponds to a stable radio propagation environment, and the value of each state corresponds to a stored channel impulse response value for a stable receiving antenna.

[0116] The temporary state of the state machine is introduced in order to find another stable state after the current stable state, the value of the temporary state is changed to a new channel impulse response value of the receiving antenna when an environmental change is detected.

[0117] In the initial state, the timer C is set to 0 and starts counting.

[0118] Wherein, the state type of the sensing object may include the following.

[0119] First: the sensing object is unstable in the current state, for example, the state of the sensing object is judged to be constantly changing through the record information of the state machine, and is unstable in the current state, such as the scenarios where the landslide occurs, people continuously talk or move during a meeting in a conference room, or cars continuously enter and leave a parking lot.

[0120] Second: the sensing object is stable in the current state and is changed relative to the last stable state, as shown in FIG. 7, which is a state machine switching diagram of a room from being unoccupied to occupied and then to unoccupied.

[0121] For example, the conference room transitions from an unoccupied scenario (SO) where no one is holding a meeting to an occupied scenario (SI) during a meeting, and then from the occupied scenario (SI) during a meeting to an unoccupied scenario (S2) after the meeting ends, wherein S' represents the temporary state of the state machine.

[0122] For the state machine, both states S2 and SI can be considered as stable states. However, there might be changes in the furniture arrangement, such as the tables and chairs, in the conference room before and after the meeting. This makes the two states, S2 and SI, different. In the current state S2, the conference room is stable but has undergone a change relative to the last stable state SI. Consequently, by tracking all state machines and their switching moments, the state information of the state machines can be extracted.

[0123] Third: the sensing object is stable in the current state and is not changed relative to the last stable state, i.e. the environment is always in a stable state with no change.

[0124] In an embodiment, real-time sensing modeling may be performed on the sensing object by a state machine, real-time modeling information of the state machine is extracted from a real-time state machine model; a state type of the sensing object is determined based on the real-time modeling information of the state machine, and an environmental state of the sensing object is determined based on the state type of the sensing object.

[0125] In an embodiment, the real-time modeling information of the state machine may include at least one of:

[0126] the switching information of the state machine;

[0127] the current state of the state machine: such as the stable state before people enter the conference room;

[0128] the temporary state of the state machine, which can be used to identify the stable state; and

[0129] the timer information of the state machine.

[0130] In the above solution, the state type of the sensing object is determined according to the realtime modeling information of the state machine, and the determination of the state type may be performed during or after state SI.

[0131] Scenarios are exemplified as follows:

[0132] Scenario 1: if the timer C is smaller than the preset time threshold value 1, it is determined that someone enters the room and is active; and

[0133] whether there is an environmental change in the scenario is determined, and it is determined that someone enters the room and leaves and the environmental change occurs according to room state machine transition; as shown in FIG. 7.

[0134] Scenario 2: a mountain scenario landslide state is judged, according to the mountain pre-landslide state, if the state machine timer C is smaller than the preset time threshold value 1, it is determined to be risky; if the state machine switches to another stable state, it is determined that the landslide is completed.

[0135] Differential information between the channel impulse responses of the antenna and the current states of the state machine at different moments is calculated for the sensing object in an unstable state; an environmental state change law of the sensing object is determined according to the differential information.

[0136] The present embodiment mainly makes sensing determination on the environmental state change law of the sensing object in an unstable state.

[0137] In one embodiment, as a mode of implementation, for the sensing object in an unstable state, the channel impulse responses of the receiving antenna and the current states corresponding to the state machine at different moments are acquired; and differential information between the channel impulse response of the receiving antenna and the current state corresponding to the state machine at different moments is calculated.

[0138] Specifically, at a current moment, the channel impulse response of the receiving antenna and the current state corresponding to the state machine at the current moment are acquired; and differential information between the channel impulse response of the receiving antenna and the current state corresponding to the state machine at the current moment is calculated, as shown in FIG. 8.

[0139] The processed signal information is acquired as:

[0140] ^m’"   — ^m,n (0 _    ) .

[0141] is the differential information between the channel impulse response ^m.n^ of receiving antenna and the current state S(K') corresponding to the state machine at the current moment t.

[0142] Then, the channel impulse response at the next moment is received, the above process is repeated to acquire the differential information between the channel impulse responses of the receiving antenna and the current states corresponding to the state machine at different moments, and then each can be analyzed to acquire signal features such as cycle information and the like, thereby analyzing the real-time changing signal information to acquire the environmental state change law of the sensing object.

[0143] In an embodiment, the differential information is analyzed to extract differential signal features in the differential information, the differential signal features including, but not limited to, phase, amplitude, time period, and the like;

[0144] a state change curve is plotted based on the differential signal features; and

[0145] an environmental state change law of the sensing object is determined according to the state change curve.

[0146] Examples of scenarios are as follows: for instance, the breathing signals of people in a room are sensed, and analyzed to obtain the breathing patterns of those people. This, in turn, derives the state change law when someone is present in the room. Wherein, the environmental state change law after differential signal processing can refer to FIG. 9.

[0147] For another example, after the machines in a factory are turned on, the sound signals emitted by the machines in the factory can be sensed and analyzed to determine whether the movements or sounds of the machines are regular. Both can yield judgment results through the aforementioned method.

[0148] A real-time state machine model is built for a sensing object, the environmental state of the sensing object is determined based on the real-time state machine model, specifically, which involves acquiring a sensing signal of an antenna; a channel impulse response of the antenna is acquired based on the sensing signal of the antenna; a switching mode of a state machine is acquired based on the channel impulse response of the antenna and the current information of the state machine (the current state, temporary state, timer information), and the real-time state machine model is updated; the real-time modeling information of the state machine is extracted from the real-time state machine model; based on real-time modeling information of the state machine, the state type of the sensing object is determined; based on the state type of the sensing object, an environmental state of the sensing object is determined; wherein, for a sensing object in an unstable state, the differential information between the channel impulse response of the receiving antennas and the current state corresponding to the state machine at different moments is calculated; according to the differential information, the environmental state change law of the sensing object is obtained through analysis. Thus, by utilizing a wireless sensing method based on real-time modeling of a state machine in complex multipath environments, the problems of multipath influence in complex environments such as an indoor urban area, as well as the inability to effectively achieve wireless sensing when the number of receiver antennas is limited or the bandwidth is narrow, are overcome. This enhances the accuracy of wireless sensing in complex multipath environments.

[0149] More specifically, the following elaborates on the detailed solution of performing real-time sensing modeling on the sensing object through a state machine, extracting real-time modeling information of the state machine from the real-time state machine model, and determining the state type of the sensing object based on the real-time modeling information of the state machine.

[0150] Taking the scenario shown in FIG. 4 as an example, the sensing signal transmitting base station (RS) transmits a sensing signal S at a set time Tn via radio resources, and the sensing signal receiving base station (Br) receives the sensing signal. The sensing signal transmitted by the sensing signal transmitting base station may be reflected by various environmental objects Pn (Pi, P?... Pn,) in the scenario and projected onto the sensing signal receiving base station.

[0151] Channel impulse responses of the receiving antenna at different moments are acquired by collecting the sensing signal of each receiving antenna of the sensing signal receiving base station, and sensing modeling is performed on the sensing object based on the state machine (abbreviated as a state machine in the following specific embodiments) to determine the state type of the sensing object.

[0152] Specifically, the sensing signal receiving base station receives the sensing signal, samples the sensing signal for each receiving antenna, and acquires a channel impulse response vector m.n v 7 for eac|i receiving antenna at a corresponding moment according to the sampled signals, wherein m, n are oscillator numbers in the antenna array,                    [0?^ 1], anc| N are integers greater than 1, and t is time.

[0153] As shown in FIG. 6, a state machine set is denoted as S(K), and the initial state S(0) of the state machine is set to be the current channel impulse response vector, i.e. . K is the total number of states, K is an integer, S' is the temporary state of the state machine, K' is the current state number, and K' is an integer.

[0154] In the initial state, the initial state S(0) is the current state, the initial value of K is 0, and the temporary state is S' = S(0), with K' = K, and the switching information of the state machine at the current moment is recorded, i.e., whether the state machine has switching, if yes, it should be recorded from which state to which state, the switching information of the state machine includes, but is not limited to, the time, the number, and the states before and after the switching.

[0155] Wherein, the state of the state machine corresponds to a stable radio propagation environment, and the value of each state corresponds to a stored channel impulse response value for a stable receiving antenna.

[0156] The temporary state of the state machine is introduced in order to find another stable state after the current stable state, the value of the temporary state being changed to a new channel impulse response value of the receiving antenna when an environmental change is detected.

[0157] In the initial state, the timer C is set to 0 and starts counting. The timer C is set with a certain timeout duration, and when the time-out duration is reached and a switching condition is reached, the state machine will perform a switching operation. Additionally, regardless of whether the timer's time-out duration has been reached, if a reset condition is satisfied, the timer will be reset. The specific actions of the timer may vary depending on different scenarios, and detailed explanations regarding the timer in relation to different switching types of the state machine will be provided later.

[0158] In an embodiment, performing real-time sensing modeling on the sensing object by the state machine, acquiring the switching mode of the state machine, and updating the real-time state machine model includes:

[0159] a sensing signal of an antenna is collected;

[0160] a channel impulse response of the antenna is acquired based on the sensing signal of the antenna; and

[0161] the switching mode of the state machine is acquired based on the channel impulse response of the antenna and current information (the current state, the temporary state, and the time information) of the state machine, and the real-time state machine model is updated.

[0162] In an embodiment, acquiring the switching mode of the state machine based on the channel impulse response of the antenna and the current information of the state machine includes:

[0163] a current state, a temporary state, and timer information of the state machine are recorded; and

[0164] the switching mode of the state machine is acquired based on the channel impulse response of the antenna as well as the current state, the temporary state and the timer information of the state machine.

[0165] Taking the current moment as an example, the sensing signal receiving base station receives the sensing signal, samples the sensing signal for each receiving antenna, and acquires the channel impulse response for the receiving antenna at the current moment based on the sensing signal of the receiving antenna.

[0166] Then, the current state, temporary state, timer information of the state machine at the current moment are recorded;

[0167] the switching mode of the state machine at the current moment is determined based on the channel impulse response of the receiving antenna at the current moment as well as the current state, the temporary state, and the timer information of the state machine at the current moment; and

[0168] in an embodiment, the state of the state machine is updated in real time based on the switching mode of the state machine at the current moment.

[0169] That is, the switching mode of the state machine is determined and sensed according to the channel impulse response of the receiving antenna at the current moment, the current state (S(K')), the temporary state (S'(K')), and the timer C, and a corresponding operation (e.g., no switching, switching to a new state, or switching to a previously existing state) is performed, to complete updating of the real-time modeling sensing state machine at the current moment, wherein the real-time updating of the state machine is the real-time modeling process.

[0170] The state type of the sensing object can then be determined based on the state update change of the state machine and the current count of the timer.

[0171] In an embodiment, determining the state type of the sensing object based on the real-time modeling information of the state machine may include:

[0172] the state type of the sensing object is determined based on the historical switching record, the current state, the temporary state, and the timer information of the state machine.

[0173] In an embodiment, the step of updating the real-time state machine model includes:

[0174] an update operation is performed on the real-time state machine model based on the switching mode of the state machine.

[0175] In an embodiment, operating the real-time state machine model based on the switching mode of the state machine includes at least one of:

[0176] corresponding to that the state machine maintains the current state, upon the condition that the channel impulse response of the antenna at the current moment is not similar to the temporary state of the state machine at the current moment, the temporary state of the state machine is updated to the channel impulse response of the antenna at the current moment and a timer is reset;

[0177] corresponding to that the state machine maintains the current state, upon the condition that the channel impulse response of the antenna at the current moment is similar to the temporary state of the state machine at the current moment, the timer is kept counting;

[0178] corresponding to that the state machine switches to the historical existing state, a switching operation of the state machine is performed, the temporary state and the current state number are changed to the state and the number corresponding to the maximal similarity existing in the state machine,, the timer is not reset, and switching information of the state machine is recorded; and

[0179] corresponding to that the state machine switches to a new state, a new state generating operation and a switching operation of the state machine are performed, the timer is not reset, and switching information of the state machine is recorded.

[0180] In an embodiment, the method further includes saving a current state of the state machine.

[0181] In an embodiment, the state type of the sensing object includes at least one of:

[0182] the sensing object is unstable in the current state;

[0183] the sensing object is stable in the current state and is changed relative to the last stable state; and

[0184] the sensing object is stable in the current state and is not changed relative the last stable state.

[0185] In particular, the state types of the sensing object include:

[0186] First: the sensing object is unstable in the current state, for example, the state of the sensing object is judged to be constantly changing through the record information of the state machine, and is unstable in the current state, such as the scenarios where the landslide occurs, people continuously talk or move during a meeting in a conference room, or cars continuously enter and leave a parking lot.

[0187] Second: the sensing object is stable in the current state and has a change relative to the last stable state. For example, the conference room transitions from an unoccupied scenario (SO) where no one is holding a meeting to an occupied scenario (SI) during a meeting, and then from the occupied scenario (SI) during a meeting to an unoccupied scenario (S2) after the meeting ends. For the state machine, both states S2 and SI can be considered as stable states. However, there might be changes in the furniture arrangement, such as the tables and chairs, in the conference room before and after the meeting. This makes the two states, S2 and SI, different. In the current state S2, the conference room is stable but has undergone a change relative to the last stable state SI. Consequently, by tracking all state machines and their switching moments, the state information of the state machines can be extracted.

[0188] Third: the sensing object is stable in the current state with no change relative to the last stable state, i.e. the environment is always in a stable state with no change.

[0189] Thus, the state type of the sensing object is determined by collecting the sensing signal of each receiving antenna of the sensing signal receiving base station, acquiring the channel impulse response of the receiving antenna at different moments, and performing sensing modeling on the sensing object based on the state machine.

[0190] In an embodiment, the switching mode of the state machine includes at least one of:

[0191] maintaining a current state;

[0192] switching to a historical existing state (switching to a similar state); and

[0193] switching to a new state.

[0194] In an embodiment, prior to the acquiring the switching mode of the state machine, the method further includes:

[0195] a switching mode of the state machine is determined.

[0196] In an embodiment, a mode for determining that the state machine maintains a current state includes at least one of:

[0197] a count value of the timer does not exceed a set time threshold value;

[0198] the channel impulse response of the antenna at the current moment is not similar to the temporary state of the state machine at the current moment, and the timer is reset; and

[0199] the channel impulse response of the antenna at the current moment is similar to the temporary state of the state machine at the current moment, and the timer continues to keep counting.

[0200] In an embodiment, a mode for determining that the state machine switches to a historical existing state includes at least one of:

[0201] a count value of the timer exceeds a set time threshold value;

[0202] the channel impulse response of the antenna at the current moment is similar to the temporary state of the state machine at the current moment, and the temporary state is not similar to the current state;

[0203] all states saved in the state machine are traversed, the similarity between the temporary state and each state saved in the state machine is compared, there exists a situation where one or more states in the saved states exhibit similarity to the temporary state;

[0204] the temporary state and the current state number are changed into the state and the number corresponding to the maximal similarity existing in the state machine respectively; and

[0205] the timer is not reset.

[0206] In an embodiment, a mode for determining that the state machine switches to a new state includes at least one of:

[0207] a count value of the timer exceeds a set time threshold value;

[0208] the channel impulse response of the receiving antenna at the current moment is similar to the temporary state of the state machine at the current moment, and the temporary state is not similar to all the states saved in the state machine, the state machine generates a new state, and switches to the new state; and

[0209] the timer is not reset.

[0210] The three switching modes of the state machine are described in detail below:

[0211] The first switching mode: the current state is maintained without switching.

[0212] The switching mode of the state machine at the current moment is determined to maintain the current state without switching through the following steps:

[0213] if, based on the timer information, it is determined that the count value of the timer C does not exceed the set time threshold value 1, then whether the channel impulse response         of the receiving antenna at the current moment is similar to the temporary state S' of the state machine at the current moment is determined; 7? 7 / 7

[0214] if the channel impulse response of the receiving antenna at the current moment is not similar to the temporary state S' of the state machine at the current moment, the temporary state 7? 7 / 7 S' is updated as the channel impulse response of the receiving antenna at the current moment, the timer C is reset to zero, and the state machine is maintained in the current state at the current moment without switching; and 7? 7 / 7

[0215] if the channel impulse response of the receiving antenna at the current moment is similar to the temporary state S' of the state machine at the current moment, the timer C continues to keep counting, and the state machine is maintained in the current state at the current moment without switching.

[0216] The second switching mode: the state machine switches to a historically existing state or switches to a similar state.

[0217] The switching mode of the state machine at the current moment is determined to switch to a historically existing state or a similar state through the following steps:

[0218] if, based on the timer information, it is determined that the count value of the timer C exceeds 7? 7 / 7 the set time threshold value 1, then whether the channel impulse response ' of the receiving antenna at the current moment is similar to the temporary state S' of the state machine at the current moment is determined, and also whether the temporary state S' is similar to the current state S is determined; R (t}

[0219] if the channel impulse response m-n^ of the receiving antenna at the current moment is similar to the temporary state S' of the state machine at the current moment, and the temporary state S' is not similar to the current state S, then all current states S(K) saved in the state machine are traversed, the similarity between the temporary state S' and each current state S(i) is compared, wherein i < K; and

[0220] if there exists a situation where one or more states in the saved states S(K) exhibit similarity to the temporary state S', then it is determined that the switching mode of the state machine at the current moment is to switch to a historically existing state. The temporary state and the current state number are respectively changed to the state and the number imax corresponding to the maximal similarity existing in the state machine, i.e., S'(K') = S(imax), K' = imax;

[0221] the timer C is not reset, and the switching information of the state machine is recorded.

[0222] The third switching mode: the state machine switches to a new state.

[0223] The switching mode of the state machine at the current moment is determined to switch to the new state through the following steps:

[0224] if, based on the timer information, it is determined that the count value of the timer C exceeds the preset time threshold value 1, then whether the channel impulse response         of the receiving antenna at the current moment is similar to the temporary state S' of the state machine at the current moment is determined, and whether the temporary state S' is similar to all the current states S(K) saved in the state machine is determined; and

[0225] if the channel impulse response of the receiving antenna at the current moment is similar to the temporary state S' of the state machine at the current moment, and the temporary state S' is not similar to all the current states S(K) saved in the state machine, a new state is generated. The switching mode of the state machine at the current moment is determined to switch to the new state, and the state number is updated as K=K+1. The new state S(K) in the state set is updated as S(K)=S', and the current state and the temporary state are consistent as S'=S(K), and K'=K.

[0226] The timer is not reset and the switching information of the state machine is recorded.

[0227] As an embodiment, in the above solutions, the step of determining whether the channel impulse response of the receiving antenna at the current moment is similar to the temporary state of the state machine at the current moment includes:

[0228] the similarity between the channel impulse response of the receiving antenna at the current moment and the temporary state of the state machine at the current moment is calculated;

[0229] if the similarity does not exceed a preset similarity threshold value, it is determined that the channel impulse response of the receiving antenna at the current moment is not similar to the temporary state of the state machine at the current moment;

[0230] otherwise, it is determined that the channel impulse response of the receiving antenna at the current moment is similar to the temporary state of the state machine at the current moment.

[0231] Wherein, calculating the similarity between the channel impulse response of the receiving antenna at the current moment and the temporary state of the state machine at the current moment includes, but is not limited to, the following solution: R (t}

[0232] 1. A correlation value between the channel impulse response m-n^ of the receiving antenna at the current moment and the temporary state S' of the state machine at the current moment is calculated, and a maximum correlation peak is taken as a similarity contrast; and R (t}

[0233] 2. An included angle between the channel impulse response m-n^ of the receiving antenna at the current moment and the temporary state S' of the state machine at the current moment is calculated, and the cosine of the included angle is taken as a similarity contrast.

[0234] The determination of whether the states are similar includes setting a similarity threshold 2. In response to determining that the similarity exceeds the preset similarity threshold 2, the states are judged to be similar; otherwise, the states are judged to be not similar.

[0235] Based on the above solution, all state machine switching information can be tracked, and the state information can be extracted as needed, which includes, but is not limited to:

[0236] for indoor scenarios, the state with minimal changes within a time threshold can be extracted as an unoccupied state.

[0237] For general scenarios, the switching information of the state machine arranged chronologically within a day can be extracted to represent the scenario changes throughout the day, and laws can be analyzed to obtain the state change laws in different environments, as illustrated in FIG. 10, which is a schematic diagram of one-day channel model changes of a room.

[0238] The detailed description of specific implementations of the present embodiments is further elaborated below in connection with different scenarios:

[0239] Scenario 1

[0240] When the room's state changes from being unoccupied to occupied and then back to unoccupied, the state changes are illustrated in FIG. 7. The specific implementation process is as follows:

[0241] The synchronized sensing signal transmitting base station transmits the sensing signal at a set time via radio resources, and the sensing signal receiving base stations receive the sensing signal. The sensing signal of each antenna is sampled, and based on the sampled signal, the channel impulse R (t} response vector ' for each receiving antenna is acquired. The initial state is set to be S(0), the temporary state S' is set to be S' = S(0), K' = K, and the timer starts at 0. At this point, the room is in the state S(0), as shown in FIG. 7. R (t}

[0242] If ' is not similar to S', then C = 0 (i.e., being reset), otherwise C is not reset.

[0243] The timer C's value is compared with a time threshold value 1. If the timer C exceeds the set state threshold 1 and the temporary state S' is not similar to any one of the states S(K) already saved in the state machine, a new state is generated. This means that the state number is updated as K = 0+1, the new state S(K) in the state set is updated as S(l) = S', and the current state and the temporary state are both set to be S' = S(l), with K' = 1, indicating that the room is in the S(0) state, and is finally in the stable state of being unoccupied, which is S(l).

[0244] Similarly, as shown in FIG. 7, when the state changes from S(l) to S(2), the state number is updated as K = 1 + 1, and the new state S(K) in the state set is updated as S(2) = S'. The current state and the temporary state are both set to be S' = S(2), with K' = 2, indicating that the room is in the stable S(l) state, and then people enter the room and begin activities, causing the temporary state S' to constantly change until it finally reaches the unoccupied stable state of S(2) again.

[0245] Scenario 2

[0246] When breathing monitoring is conducted for people in a room, the state changes are illustrated in FIG. 9. The specific implementation process is as follows:

[0247] the synchronized sensing signal transmitting base station transmits the sensing signal at the set time via the radio resources, and the sensing signal receiving base station receives the sensing signal. Sampling of the sensing signal from each antenna is performed, and based on the sampled J? signal, the channel impulse response vector ' for each antenna is obtained. The initial state is set to be S(0), the temporary state is set to be S' = S(0), with K' = K. The timer C starts counting from 0, at which point the room is in the S(0) state. J?

[0248] If is not similar to S', C = 0, i.e., the timer is reset, otherwise C is not reset.

[0249] The timer C's value is compared with a time threshold value 1. If the timer C exceeds the set time threshold value 1 and the temporary state S' is not similar to any one of the states S(K) already saved in the state machine, a new state is generated. This means that the state number is updated as K = 0 + 1, the new state S(K) in the state set is updated as S(l) = S', and the current state and the temporary state are both set to be S' = S(l), with K' = 1, indicating that the target is in the S(l) state from the S(l) state. The processed signal corresponds to (1) in FIG. 9. J?

[0250] After someone enters the room, if ' is not similar to S', C is set to 0, and the room remains in SI. R (t}

[0251] Upon receiving ' in real-time, a differential signal is obtained:

[0252] ^m’n = Rm’n ” S(k ); and

[0253] by continuously recording and analyzing the differential signal, a regular signal emerges as shown in (4) of FIG. 9.

[0254] By repeatedly performing the above process, the processed state signals can be obtained, and from these processed sensing signals, the changes in human breathing can be analyzed.

[0255] Scenario 3

[0256] Based on the daily changing law of the channel model within the room, the changes in room state can be extracted as illustrated in FIG. 10. The specific implementation process is as follows:

[0257] the synchronized sensing signal transmitting base station transmits the sensing signal at the set time via the radio resources, and the sensing signal receiving base station receives the sensing signal. The sensing signal from each antenna is sampled, and based on the sampled signal, the J? channel impulse response vector ' for each antenna is obtained. The initial state is set to be S(0), the temporary state is set to be S' = S(0), with K' = K. The timer C starts counting, at which point the room is in the stable S(0) state in the morning, as illustrated in FIG. 10.

[0258] The timer C's value is compared with a threshold value. If the timer C exceeds the set threshold value 1 and the temporary state S' is not similar to any one of the states S(K) already saved in the state machine, a new state is generated. This means that the state number is updated as K = 0 + 1, the new state S(K) in the state set is updated as S(l) = S', and the current state and the temporary state are both set to be S' = S(l), with K' = 1. This indicates that during a certain period in the morning, the room's state transitions from the stable state S(0) to another stable state S(l) after undergoing an active period. The dashed box in FIG. 10 represents the temporary active state S' during this transition.

[0259] As depicted in FIG. 10, when the counter C's value exceeds the preset time threshold value 1, the state transitions from S(l) to S(2). Subsequently, all the states S(K) already saved in the state machine are traversed, that is, the similarity between S' and S(0), S(l) is compared. If no similar state is found, the state number is updated as K = 1 + 1, and the new state S(K) in the state set is updated as S(2) = S'. Both the current state and the temporary state are then synchronized as S' = S(2), with K' = 2. This indicates that during a certain period in the afternoon, the room's state transitions from the stable state S(l) to another stable state S(2) after undergoing an active period.

[0260] Additionally, when the counter C's value exceeds the set time threshold value 1, and the state transitions from S(2) to S(3), a traversal is again performed on all the states S(K) within the saved state machine. This involves comparing the similarity between S' and S(0), S(l), S(2). If no similar state is found, the state number index is updated as K = 2 + 1, and the new state S(K) in the state set is updated as S(3) = S'. Both the current state and the temporary state are then synchronized as S' = S(3), with K' = 3. This indicates that during a certain period in the afternoon, the room's state transitions from the stable state S(2) to another stable state S(3) after undergoing an active period.

[0261] As shown in FIG. 10, at this point, the temporary state is S' = S(3) with K' = 3. When the counter C's value exceeds the preset time threshold value 1, and the current is similar to the temporary state S', but S' is not similar to the current state S, all the states S(K) saved within the state machine are traversed. This involves comparing the similarity between S' and S(0), S(l), S(2), and S(3). If no similar state is found, the state number index is updated as K = 3 + 1, and the new state S(K) in the state set is updated as S(4) = S'. Both the current state and the temporary state are then synchronized as S' = S(4), with K' = 4. This indicates that during a certain period in the afternoon, the room's state transitions from the stable state S(3) to another stable state S(4) after undergoing an active period.

[0262] In contrast to the prior art, the present embodiment solution builds the real-time state machine model for the sensing object; and based on the real-time state machine model, determines an environmental state of the sensing object, thereby being able to address state sensing and sensing signal analysis of complex environments, identify different steady state features of the environment, identify environmental real-time changes, and associate a state machine and an actual scenario state type. By utilizing a wireless sensing method based on real-time modeling of a state machine in complex multipath environments, the problems of multipath interference in complex environments such as indoors urban areas, as well as the inability to effectively achieve wireless sensing when the number of receiver antennas is limited or the bandwidth is narrow, are overcome. This enhances the accuracy of wireless sensing in complex multipath environments.

[0263] As shown in FIG. 11, an embodiment of the present application further proposes a wirelesssensing device, including: a type determination module, configured to determine a state type of a sensing object based on sensing modeling; and

[0264] an environment state determination module, configured to determine an environment state of the sensing object based on the state type.

[0265] The principle and implementation of the present embodiment to implement wireless sensing are referred to above embodiments, which will not be described in detail here.

[0266] Further, an embodiment of the present application proposes a wireless sensing apparatus, including:

[0267] a sensing modeling module, configured to build a real-time state machine model for a sensing object; and

[0268] a state determination module, configured to determine an environmental state of the sensing object based on the real-time state machine model.

[0269] For the principle of realizing sensing by the embodiment, please refer to the above embodiments, which will not be described in detail here.

[0270] Furthermore, an embodiment of the present application proposes a communication device including a memory, a processor, and a wireless sensing program stored on the memory and executable on the processor, the wireless sensing program when executed by the processor implementing the wireless sensing method according to the above embodiments.

[0271] Since the present wireless sensing program adopts all the technical solutions of all the embodiments described above when it is executed by a processor, it has at least all the advantageous effects brought by all the technical solutions of all the embodiments described above, which will not be described in detail here.

[0272] In addition, an embodiment of the present application proposes a computer-readable storage medium having stored thereon a wireless sensing program that, when executed by a processor, implements the wireless sensing method according to the above embodiments.

[0273] Since the present wireless sensing program adopts all the technical solutions of all the embodiments described above when it is executed by a processor, it has at least all the advantageous effects brought by all the technical solutions of all the embodiments described above, which will not be described in detail here.

[0274] In contrast to the prior art, the wireless sensing method, apparatus, communication device and storage medium proposed by the embodiments of the present application establish a real-time state machine model for the sensing object; based on the real-time state machine model, an environmental state of the sensing object is determined. Thus, by utilizing a wireless sensing method based on real-time modeling of a state machine in complex multipath environments, the problems of multipath interference in complex environments such as indoors urban areas, as well as the inability to effectively achieve wireless sensing when the number of receiver antennas is limited or the bandwidth is narrow, are overcome. This enhances the accuracy of wireless sensing in complex multipath environments.

[0275] Herein, the terms "comprise", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the sentence "comprising a..." does not exclude the existence of another identical element in a process, method, article or device including the element.

[0276] The above-described sequence numbers of the embodiments of the present application are merely illustrative and do not represent the superiority or inferiority of the embodiments.

[0277] From the above description of the embodiments, those skilled in the art will clearly understand that the methods of the above embodiments can be implemented by software and a necessary general hardware platform, and of course, it can also be implemented by hardware, but the former is a preferred implementation mode in many cases. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above. The computer software product includes several instructions for causing a communication device (which may be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to perform the method of each embodiment of the present application.

[0278] The above description is only preferred embodiments of the present application and is not intended to limit the scope of the present application, and variations of equivalent structures or equivalent processes using the description and drawings, or directly or indirectly applied to other related fields, are intended to be included within the scope of the present application.

Claims

1. A wireless sensing method, comprising:building a real-time state machine model for a sensing object; anddetermining, based on the real-time state machine model, an environmental state of the sensing object.

2. The method according to claim 1, wherein building the real-time state machine model for the sensing object comprises:performing real-time sensing modeling on the sensing object by a state machine, acquiring a switching mode of the state machine, and updating the real-time state machine model.

3. The method according to claim 2, wherein performing real-time sensing modeling on the sensing object by the state machine, acquiring the switching mode of the state machine, and updating the realtime state machine model comprises:collecting a sensing signal of an antenna;acquiring, based on the sensing signal of the antenna, a channel impulse response of the antenna; andacquiring, based on the channel impulse response of the antenna and current information of the state machine, the switching mode of the state machine, and updating the real-time state machine model.

4. The method according to claim 3, wherein acquiring, based on the channel impulse response of the antenna and the current information of the state machine, the switching mode of the state machine comprises:recording a current state, a temporary state, and timer information of the state machine; andacquiring, based on the channel impulse response of the antenna as well as the current state, the temporary state and the timer information of the state machine, the switching mode of the state machine.

5. The method according to claim 4, wherein the switching mode of the state machine comprises at least one of the following:maintaining a current state;switching to a historical existing state; andswitching to a new state.

6. The method according to claim 5, wherein prior to acquiring the switching mode of the state machine, further comprising:determining a switching mode of the state machine.

7. The method according to claim 6, wherein a mode for determining that the state machine maintains a current state comprises at least one of the following:a count value of a timer does not exceed a set time threshold value;a channel impulse response of the antenna at a current moment is not similar to a temporary state of the state machine at the current moment, and a timer is reset; anda channel impulse response of the antenna at a current moment is similar to a temporary state of the state machine at the current moment, and a timer continues counting.

8. The method according to claim 6, wherein a mode for determining that the state machine switches to a historical existing state comprises at least one of the following:a count value of a timer exceeds a set time threshold value;a channel impulse response of the antenna at a current moment is similar to a temporary state of the state machine at the current moment, and the temporary state is not similar to a current state;all states saved in the state machine are traversed, the similarity between a temporary state and each state saved in the state machine is compared, and there is state similar to the temporary state among all the saved states;a temporary state and a current state number are changed into a state and a number corresponding to a maximal similarity existing in the state machine respectively; anda timer is not reset.

9. The method according to claim 6, wherein a mode for determining that the state machine switches to a new state comprises at least one of the following:a count value of a timer exceeds a set time threshold value;a channel impulse response of the receiving antenna at a current moment is similar to a temporary state of the state machine at the current moment, and the temporary state is not similar to all states saved in the state machine, and the state machine generates a new state, and switches to the new state; anda timer is not reset.

10. The method according to claim 7, 8 or 9, wherein a mode for determining whether the channel impulse response of the receiving antenna at the current moment is similar to the temporary state of the state machine at the current moment comprises:calculating a similarity between the channel impulse response of the receiving antenna at the current moment and the temporary state of the state machine at the current moment;wherein in response to that the similarity does not exceed a preset similarity threshold value, determining that the channel impulse response of the receiving antenna at the current moment is not similar to the temporary state of the state machine at the current moment; andin response to that the similarity exceeds a preset similarity threshold value, determining that the channel impulse response of the receiving antenna at the current moment is similar to the temporary state of the state machine at the current moment.

11. The method according to claim 10, wherein calculating the similarity between the channel impulse response of the receiving antenna at the current moment and the temporary state of the state machine at the current moment comprises at least one of the following:calculating a correlation value between the channel impulse response of the receiving antenna at the current moment and the temporary state of the state machine at the current moment, and taking a maximum correlation peak as a similarity contrast; andcalculating an included angle between the channel impulse response of the receiving antenna at the current moment and the temporary state of the state machine at the current moment, and taking the cosine of the included angle as a similarity contrast.

12. The method according to claim 3, wherein the step of updating the real-time state machine model comprises:performing, based on the switching mode of the state machine, an update operation on the real-time state machine model.

13. The method according to claim 12, wherein performing, based on the switching mode of the state machine, the update operation on the real-time state machine model comprises at least one of the following:corresponding to that the state machine maintains a current state, updating a temporary state of the state machine to a channel impulse response of the antenna at a current moment and resetting a timer upon the condition that the channel impulse response of the antenna at the current moment is not similar to the temporary state of the state machine at the current moment;corresponding to that the state machine maintains a current state, continuing keeping a timer counting upon the condition that a channel impulse response of the antenna at a current moment is similar to a temporary state of the state machine at the current moment;corresponding to that the state machine switches to a historical existing state, performing a switching operation of the state machine, changing a temporary state and a current state number to a state and anumber corresponding to a maximal similarity existing in the state machine, not resetting the timer, and recording switching information of the state machine; andcorresponding to that the state machine switches to a new state, performing a new state generating operation and a switching operation of the state machine, not resetting the timer, and recording switching information of the state machine.

14. The method according to claim 13, further comprising:saving a current state of the state machine.

15. The method according to claim 1, wherein determining, based on the real-time state machine model, the environmental state of the sensing object comprises:extracting real-time modeling information of the state machine from the real-time state machine model;determining, based on the real-time modeling information of the state machine, a state type of the sensing object; anddetermining, based on the state type of the sensing object, the environmental state of the sensing object.

16. The method according to claim 15, wherein the real-time modeling information of the state machine comprises at least one of the following:a historical switching record of the state machine;a current state of the state machine;a temporary state of the state machine; andtimer information of the state machine.

17. The method according to claim 15, wherein the state type of the sensing object comprises at least one of the following:the sensing object is unstable in a current state;the sensing object is stable in a current state, and is changed relative to a last stable state; andthe sensing object is stable in a current state, and is not changed relative to a last stable state.

18. The method according to claim 17, wherein determining, based on the state type of the sensing object, the environmental state of the sensing object comprises:for the sensing object in an unstable state, calculating differential information between channel impulse responses of the antenna and current states of the state machine at different moments; anddetermining an environmental state change law of the sensing object according to the differential information.

19. The method according to claim 18, wherein the step of determining the environmental state change law of the sensing object according to the differential information comprises:analyzing the differential information to extract a differential signal feature in the differential information;plotting, based on the differential signal feature, a state change curve; anddetermining the environmental state change law of the sensing object according to the state change curve.

20. The method according to claim 19, wherein the differential signal feature comprises at least one of the following: phase, amplitude and time period.

21. A communication device comprising a memory, a processor, and a wireless sensing program stored on the memory and executable on the processor, the wireless sensing program when executed by the processor implementing the wireless sensing method according to any one of claims 1-20.

22. A computer readable storage medium having stored thereon a wireless sensing program that when executed by a processor implements the wireless sensing method according to any one of claims 120.

Images