Wireless sensing method, communication device, and storage medium

Abstract

This application discloses a wireless sensing method, a communication device, and a storage medium, which includes the steps of establishing a real-time state machine model for a sensing target, and determining an environmental state of the sensing target based on the real-time state machine model.

Description

[Technical field]

[0001] This application claims priority to a Chinese patent application bearing application number 202211035098.5, filed on August 26, 2022, the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the technical field of sensing, and in particular to a modeling-based wireless sensing method, communication device, and storage medium in the field of terrestrial communication sensing integration. [Background technology]

[0003] With technological development, ubiquitous intelligence technology will not only bring greater convenience and new experiences to people's lives, but will also penetrate deeply into various industries, realizing industrial upgrading through intelligence and improving industrial efficiency.

[0004] Ubiquitous intelligence technology mainly includes ubiquitous sensing technology, ubiquitous computing technology, and product research and development, etc. In currently deployed ubiquitous systems, ubiquitous sensing and ubiquitous computing are generally realized through wireless communication networks.

[0005] Among them, in the traditional sensing field, currently it is mainly realized by radar equipment, and the application scenarios of current radar equipment mainly include aircraft sensing such as airport radar, and short-range sensing such as vehicle-mounted radar. Both of these two scenarios belong to simple scenarios. Ubiquitous sensing can realize sensing in various complex scenarios such as indoor multipath environment, ground multi-building, multi-vehicle environment, and shopping mall multi-person environment. At present, in complex multipath environment, especially when the number of antennas is small and the bandwidth is small, the requirements can no longer be met by using traditional sensing technology. Summary of the Invention [Problem to be solved by the invention]

[0006] In response to the above technical problems, the embodiments of the present application provide a wireless sensing method, a communication device, and a storage medium to overcome the problem that wireless sensing cannot be effectively realized when there is a multipath effect in a complex environment and the number of receiver antennas is small or the bandwidth is small, and to improve the accuracy of wireless sensing in a complex environment. [Means for solving the problem]

[0007] The embodiment of the present application is establishing a real-time state machine model for a sensing target; determining an environmental state of the sensing target based on the real-time state machine model.

[0008] The embodiment of the present application is a sensing modeling module for establishing a real-time state machine model for a sensing target; and a state determination module for determining an environmental state of the sensing target based on the real-time state machine model.

[0009] An embodiment of the present application further provides a communications device that includes a memory, a processor, and a wireless sensing program stored in the memory and executable on the processor, and that realizes the wireless sensing method when the wireless sensing program is executed by the processor.

[0010] An embodiment of the present application further provides a computer-readable storage medium having a wireless sensing program stored therein, the wireless sensing program implementing the wireless sensing method when executed by a processor.

[0011] The wireless sensing method, communication device, and storage medium according to the embodiments of the present application establish a real-time state machine model for a sensing object, and determine an environmental state of the sensing object based on the real-time state machine model, thereby overcoming the problem that wireless sensing cannot be effectively realized in the presence of multipath effects in complex environments such as indoors and urban areas, and when the number of receiver antennas is small or the bandwidth is small, and improving the accuracy of wireless sensing in complex multipath environments.

[0012] The drawings herein are incorporated in and constitute a part of the specification, illustrate embodiments that are applicable to the present application, and are used together with the specification to interpret the principles of the present application. In order to more clearly explain the technical solutions of the embodiments of the present application, the drawings necessary for the description of the embodiments are briefly described below, and it is obvious that those skilled in the art can derive other drawings based on these drawings without creative work. [Brief description of the drawings]

[0013] [Figure 1] FIG. 2 is a schematic diagram of the hardware structure of a terminal device for implementing each embodiment of the present application. [Diagram 2] FIG. 1 is an architecture diagram of a communication network system according to an embodiment of the present application. [Diagram 3] 2 is a flowchart of a first embodiment of a wireless sensing method according to the present application. [Figure 4] FIG. 2 is a schematic diagram of a scenario of an embodiment of the wireless sensing method in the present application. [Diagram 5] 5 is a flowchart of a second embodiment of a wireless sensing method according to the present application. [Figure 6] FIG. 2 is a schematic diagram illustrating the layout of a state machine according to an embodiment of the present application. [Figure 7] FIG. 13 is a state machine transition diagram of a room going from unoccupied to occupied to unoccupied again in an embodiment of the present application. [Figure 8]FIG. 2 is a diagram illustrating the principle of differential signal processing and transformation in an embodiment of the present application. [Figure 9] FIG. 2 is a schematic diagram of the state change and environmental state change rules after differential signal processing in one scenario in an embodiment of the present application. [Figure 10] FIG. 1 is a schematic diagram of extracting a room state change based on a one-day channel model change rule of a room in one scenario according to an embodiment of the present application; [Figure 11] FIG. 2 is a schematic diagram of a functional module of a wireless sensing device according to a first embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] The realization of the object, the functional features and advantages of the present application will be further explained with reference to the embodiments and drawings.

[0015]

[0023] Now, exemplary embodiments will be described in detail, examples of which are illustrated in the drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise noted. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application as detailed in the appended claims.

[0016] In this specification, the terms "comprise", "comprises", or any other variations thereof are intended to cover a non-exclusive inclusion, whereby a process, method, article, or apparatus that includes a set of elements includes not only those elements, but also other elements not expressly listed or that are inherent to the process, method, article, or apparatus. In the absence of further limitations, an element qualified with the phrase "comprises a" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element, and components, features, and elements with the same name in different embodiments of the present application may have the same or different meanings, and their specific meanings must be determined by their interpretation in the specific embodiment or further in combination with the context in the specific embodiment.

[0017] Although the present specification may employ terms such as first, second, third, etc. to describe various pieces of information, it should be understood that such information is not limited to these terms. These terms are merely used to distinguish between the same types of information. For example, the first information may be referred to as the second information, and similarly, the second information may be referred to as the first information, without departing from the scope of the present specification. Depending on the context, the word "such as" as used herein may be interpreted as "if..." or "when..." or "in response to determining." Additionally, the singular forms "a," "an," and "the" as used herein are intended to include the plural forms unless the context dictates otherwise. It should be further understood that the terms "comprise," "comprise," and "include" indicate the presence of the features, steps, operations, elements, assemblies, items, types, and / or groups, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, assemblies, items, types, and / or groups. As used herein, the terms "or," "and / or," "including at least one of," and the like may be construed as inclusive or mean any one or any combination. For example, "including at least one of A, B, C" means "any one of A, B, C, A and B, A and C, B and C, and A, B and C," and for example, "A, B or C" or "A, B and / or C" means "any one of A, B, C, A and B, A and C, B and C, and A, B and C." Exceptions to such definitions occur only when combinations of elements, features, steps or operations are inherently mutually exclusive in a particular form.

[0018] Although each step of the flowchart in the embodiment of the present application is displayed in the order shown by the arrows, it should be understood that these steps are not necessarily performed in the order shown by the arrows. Unless otherwise clearly stated in this specification, the execution of these steps is not strictly limited in order and may be performed in other orders. In addition, at least some of the steps in the figures may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily performed at the same time, but may be performed at different times, and the order of execution is not necessarily sequential, and may be performed alternately or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0019] Depending on the context, the words "if" and "if" as used herein can be interpreted as "if" or "when" or "in response to determining" or "in response to detecting." Similarly, depending on the context, the phrases "if determining" or "if detecting (a stated condition or event)" can be interpreted as "when determining" or "in response to determining" or "when detecting (a stated condition or event)" or "in response to detecting (a stated condition or event)."

[0020] In one embodiment, step numbers such as S10, S100, etc. are adopted in this specification, the purpose of which is to express the corresponding content more clearly and concisely, and does not substantially restrict the order.

[0021] It should be understood that the specific examples described herein are used only to interpret the present application, and are not intended to limit the present application.

[0022] In the following description, the suffixes such as "module", "component" or "unit" to indicate an element are only for facilitating the description of the present application and do not have any specific meaning in themselves. Thus, "module", "component" or "unit" can be used interchangeably.

[0023] In this application, the communication device may be a terminal device, a base station device, etc., and should be determined according to a specific context, and if it is a terminal device, the terminal device can be implemented in various forms. For example, the terminal device described in this application may include terminal devices such as mobile phones, tablet personal computers, notebook computers, palmtop computers, personal digital assistants (PDAs), portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, and fixed terminals such as base stations, digital TVs, and desktop computers.

[0024] In the following description, terminal equipment is used as an example, and those skilled in the art will understand that the structures according to the embodiments of the present application can also be applied to fixed terminals, except for elements specifically used for mobile purposes.

[0025] Referring to Fig. 1, Fig. 1 is a schematic diagram of the hardware structure of a terminal device for implementing the embodiments of the present application, where the terminal device 100 may include components such as an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. It can be understood by those skilled in the art that the structure of the terminal device shown in Fig. 1 is not intended to limit the terminal device, and the terminal device may include more or less components than those shown, combine some components, or arrange different components.

[0026] Each component of the terminal device will be specifically described below with reference to FIG.

[0027] The radio frequency unit 101 can be used to receive and transmit signals during information transmission and reception or a call process, specifically, to receive downlink information of a base station and then transmit it to the processor 110 for processing, and also to transmit uplink data to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, and a duplexer. In one embodiment, the radio frequency unit 101 can also communicate with other devices through wireless communication and a network. The wireless communication may use any communication standard or protocol, including, but not limited to, GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), and 5G.

[0028] WiFi is a short-range wireless transmission technology, and the terminal device 100 can assist a user in sending and receiving e-mails, browsing web pages, accessing streaming media, etc., through the WiFi module 102, thereby providing the user with access to wireless broadband Internet. Although the WiFi module 102 is shown in FIG. 1, it is understood that it is not an essential component of the terminal device and may be omitted as necessary without changing the essence of the invention.

[0029] The audio output unit 103 can convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output a sound when the terminal device 100 is in a call signal receiving mode, a conversation mode, a recording mode, a voice recognition mode, a broadcast receiving mode, etc. The audio output unit 103 can also provide audio output related to a specific function performed by the terminal device 100 (e.g., a call signal receiving sound, a message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0030] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The graphics processing unit 1041 processes image data of still or video captured by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the graphics processing unit 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) in an operation mode such as a telephone call mode, a recording mode, a voice recognition mode, etc., and may process such sounds into audio data. The processed audio data may be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 in the telephone call mode, and output. The microphone 1042 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference that occurs during the transmission and reception of audio signals.

[0031] The terminal device 100 further includes at least one type of sensor 105, such as a light sensor, a motion sensor, and other sensors. In one embodiment, the light sensor includes an ambient light sensor and a proximity sensor, and the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the terminal device 100 is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (usually three axes) and can detect the magnitude and direction of gravity when stationary, and can be used for applications that recognize the orientation of the mobile phone (e.g., horizontal screen / vertical screen switching, related games, magnetometer orientation calibration), vibration recognition related functions (e.g., pedometer, tap), etc., and other sensors that can be further arranged on the mobile phone, such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., will not be described in detail here.

[0032] The display unit 106 is used to display information input by a user or information provided to a user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0033] The user input unit 107 can be used to receive input numeric or character information and generate input key signals for user settings and function control of the terminal device. In one embodiment, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also called a touch screen, can collect a user's touch operation on or near the touch panel 1071 (e.g., an operation performed by a user on or near the touch panel 1071 with any suitable object or accessory, such as a finger, a stylus, etc.), and drive a corresponding connected device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. In one embodiment, the touch detection device detects the user's touch direction, detects a signal due to the touch operation, and transmits the signal to the touch controller, and the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then transmits it to the processor 110, and can receive and execute instructions transmitted from the processor 110. In one embodiment, various types of touch panel 1071 can be adopted, such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. In one embodiment, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (e.g., a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., and are not specifically limited here.

[0034] In one embodiment, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation on or near it, the touch panel 1071 may transmit the touch event to the processor 110 to determine the type of the touch event, and then the processor 110 may provide a corresponding visual output to the display panel 1061 according to the type of the touch event. In FIG. 1, the touch panel 1071 and the display panel 1061 are two independent components to realize the input and output functions of the terminal device, but in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to realize the input and output functions of the terminal device, which is not particularly limited herein.

[0035] The interface unit 108 is used as an interface that can connect at least one external device to the terminal device 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having a recognition module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 can be used to receive input (e.g., data information, power, etc.) from the external device and transmit the received input to one or more elements in the terminal device 100, or can be used to transmit data between the terminal device 100 and the external device.

[0036] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a program storage area and a data storage area, and in one embodiment, the program storage area can store an operating system, an application program required for at least one function (e.g., a sound playback function, an image playback function, etc.), and the data storage area can store data generated according to the use of the mobile phone (e.g., audio data, a phone book, etc.). In one embodiment, the memory 109 may include a high-speed random access memory, and may further include, for example, at least one disk storage device, a non-volatile memory such as a flash memory device, or other volatile solid-state storage device.

[0037] The processor 110 is the control center of the terminal device 100, and connects each part of the entire terminal device 100 using various interfaces and lines, operates or executes software programs and / or modules stored in the memory 109, calls up data stored in the memory 109 to perform various functions of the terminal device 100, processes data, and thereby monitors the entire terminal device 100. The processor 110 may include one or more processing units, and preferably, the processor 110 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the modem processor may not be integrated into the processor 110.

[0038] The terminal device 100 may further include a power source 111 (e.g., a battery) for supplying power to each component, and preferably, the power source 111 can be logically connected to the processor 110 via a power management system, so that the power management system can realize functions such as charge / discharge management and power consumption management.

[0039] Although not shown in FIG. 1, the terminal device 100 may further include a Bluetooth module, etc., and detailed description thereof will be omitted here.

[0040] In order to facilitate understanding of the embodiments of the present application, the following describes a communication network system on which the terminal equipment of the present application is based.

[0041] Referring to FIG. 2, FIG. 2 is an architecture diagram of a communication network system according to an embodiment of the present application, the communication network system being a LTE system of universal mobile communication technology, the LTE system including: a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and a carrier's IP service 204, which are communicatively connected in sequence.

[0042] In one embodiment, the UE 201 may be the terminal device 100, and the detailed description is omitted here.

[0043] The E-UTRAN 202 includes an eNodeB 2021 and other eNodeBs 2022. In one embodiment, the eNodeB 2021 can be connected to other eNodeBs 2022 via a backhaul (e.g., an X2 interface), and the eNodeB 2021 can be connected to the EPC 203, and the eNodeB 2021 can provide access from the UE 201 to the EPC 203.

[0044] The EPC 203 may include a Mobility Management Entity (MME) 2031, a Home Subscriber Server (HSS) 2032, other MMEs 2033, a Serving Gate Way (SGW) 2034, a Packet Data Network Gateway (PGW) 2035, and a Policy and Charging Rules Function (PCRF) 2036, etc. In one embodiment, the MME 2031 is a control node that handles signaling between the UE 201 and the EPC 203 and provides bearer and connection management. The HSS 2032 is used to provide several registers for managing functions such as a home location register (not shown), and stores user-specific information such as several related service features, data rates, etc. All user data may be transmitted by the SGW 2034, the PGW 2035 may provide IP address allocation and other functions for the UE 201, and the PCRF 2036 is the policy decision point for policy and charging control of service data streams and IP bearer resources, and selects and provides available policy and charging control decisions to a policy and charging enforcement functional unit (not shown).

[0045] The IP services 204 may include the Internet, an intranet, an IP Multimedia Subsystem (IMS), or other IP services.

[0046] Although the above description is given taking the LTE system as an example, those skilled in the art should recognize that the present application can be applied not only to the LTE system but also to other wireless communication systems such as GSM, CDMA2000, WCDMA (registered trademark), TD-SCDMA, and future new network systems (e.g., 5G), and is not limited thereto.

[0047] Based on the above hardware structure of the terminal device and the communication network system, various embodiments of the present application are provided.

[0048] The main solution of the embodiments of the present application is to establish a real-time state machine model for a sensing object, and determine the environmental state of the sensing object based on the real-time state machine model, thereby overcoming the problem of achieving wireless sensing in the presence of multipath effects in complex environments such as indoors and urban areas, as well as when the number of receiver antennas is small or the bandwidth is small, and improving the accuracy of wireless sensing in complex multipath environments.

[0049] The embodiment of the present application takes into account that in the conventional related means, actual wireless system equipment has various forms, such as those with large antennas, those with only four antennas, those with good synchronization, those with poor synchronization, those with large bandwidth, those with small bandwidth, etc. When the number of antennas is relatively small, it is very difficult to improve the accuracy of angle measurement, and when the bandwidth is small, it is very difficult to improve the ranging accuracy. Therefore, in a complex multipath environment, especially when the number of antennas is small and the bandwidth is small, the conventional sensing method using TOA (Time of Arrival) and AOA (Angle of Arrival) measurement can no longer meet the requirements.

[0050] Therefore, the embodiments of the present application provide a wireless sensing method using a real-time modeling state machine in a complex multipath environment, which overcomes the problem of achieving wireless sensing in the presence of multipath effects in complex environments such as indoors and urban areas, and when the number of receiver antennas is small or the bandwidth is small, and can improve the accuracy of wireless sensing in complex environments.

[0051] Specifically, please refer to FIG. 3, which is a flow chart of a first embodiment of a wireless sensing method in the present application.

[0052] As shown in FIG. 3, a first embodiment of the present application provides a wireless sensing method, which includes steps S10 to S20.

[0053] S10: Establish a real-time state machine model for the sensing target.

[0054] Specifically, the system architecture according to the implementation of this embodiment includes a sensing signal transmitting base station and a sensing signal receiving base station.

[0055] The sensing signal is transmitted by a sensing signal transmitting base station and received by a sensing signal receiving base station.

[0056] For a specific scenario of this embodiment, please refer to FIG.

[0057] As shown in FIG. 4, the sensing signal transmitting base station (RS) transmits the sensing signal at a set time T n The sensing signal S is transmitted on the wireless resource, and the sensing signal receiving base station (Br) receives the sensing signal. The sensing signal transmitted by the sensing signal transmitting base station is used to detect various environmental objects P n (P 1 ,P 2 ...,P n ,) and the sensing signal can be reflected and projected to the receiving base station.

[0058] By collecting the sensing signals of each receiving antenna of the sensing signal receiving base station, the channel impact responses of the receiving antennas at different times are obtained, and real-time sensing modeling is performed for the sensing object by a state machine, the switching method of the state machine is obtained, and the real-time state machine model is updated.

[0059] S20: Determine the environmental state of the sensing target based on the real-time state machine model.

[0060] In one embodiment, extracting real-time modeling information of the state machine from the real-time state machine model; determining a state type of the sensing target based on real-time modeling information of the state machine; An environmental condition of the sensed object is determined based on a condition type of the sensed object.

[0061] In one embodiment, the condition types to be sensed are: The sensing target is currently in an unstable state. The sensing target is stable in its current state and has changed from the previous stable state; and The sensing target may include at least one of being stable in a current state and being unchanged from a previous stable state.

[0062] Based on different condition types of the sensed object, an environmental condition of the sensed object can be determined.

[0063] In one embodiment, the environmental state of the sensing target may include whether the sensing target has a moving object and a change in the moving object's status relative to the environment, such as whether there is a rule.

[0064] In one embodiment, sensing modeling is performed on the sensing object based on a state machine, real-time modeling information of the state machine is extracted from the real-time state machine model based on a real-time state machine model, and a state type of the sensing object can be determined based on the real-time modeling information of the state machine.

[0065] In one embodiment, for a sensing object in an unstable state, difference information between the channel impulse response of the receiving antenna at different times and the current state of the state machine is calculated, and an environmental state change rule of the sensing object is determined according to the difference information.

[0066] In this embodiment, by using the above-mentioned means, sensing modeling is performed on the sensing target based on a state machine, real-time modeling information of the state machine is extracted from the real-time state machine model based on a real-time state machine model, a state type of the sensing target is determined based on the real-time modeling information of the state machine, and an environmental state of the sensing target is determined based on the state type, thereby overcoming the problem that wireless sensing cannot be effectively realized when there is the influence of multipath in complex environments such as indoors or urban areas and the number of receiver antennas is small or the bandwidth is small, and improving the accuracy of wireless sensing in complex multipath environments.

[0067] As shown in FIG. 5, a second embodiment of the present application provides a wireless sensing method, and based on the embodiment shown in FIG. 3, in the embodiment of the wireless sensing method, the above step S10 of establishing a real-time state machine model for the sensing object includes step S101.

[0068] Step S101: perform real-time sensing modeling for the sensing object by a state machine, obtain a switching manner of the state machine, and update the real-time state machine model.

[0069] Specifically, the sensing signal of the antenna is collected, Obtaining a channel impulse response of the antenna based on the sensing signal of the antenna; According to the channel impulse response of the antenna and the current information of the state machine, a switching strategy of the state machine is obtained, and the real-time state machine model is updated.

[0070] In one embodiment, the current information of the state machine may include the current state of the state machine, a temporary state, timer information, and the like.

[0071] The above step S20 of determining the environmental state of the sensing target based on the real-time state machine model includes S201 to S203.

[0072] S201: Extract real-time modeling information of the state machine from the real-time state machine model.

[0073] In one embodiment, the real-time modeling information of the state machine comprises: State machine history switching record, The current state of the state machine, The temporary state of the state machine, and At least one of the timer information of the state machine is included.

[0074] S202: Determine a state type of the sensing target based on real-time modeling information of the state machine.

[0075] In one embodiment, the state type of the sensing target is: The sensing target is currently in an unstable state. The sensing target is stable in its current state and has changed from the previous stable state; and The sensing target includes at least one of being stable in the current state and being unchanged from the previous stable state.

[0076] S203: Determine an environmental state of the sensing target based on a state type of the sensing target.

[0077] For an unstable sensing target, calculating difference information between the channel impulse response of the antenna at different times and the current state of the state machine; A rule of change in the environmental state of the sensing target is determined according to the difference information.

[0078] Specifically, the specific scenario of this embodiment can be seen in FIG.

[0079] As shown in FIG. 4, the sensing signal transmitting base station (RS) transmits the sensing signal at a set time T n The sensing signal S is transmitted on the wireless resource, and the sensing signal receiving base station (Br) receives the sensing signal. The sensing signal transmitted by the sensing signal transmitting base station is used to detect various environmental objects P n (P 1 ,P 2 ...,P n ,) and the sensing signal can be reflected and projected to the receiving base station.

[0080] By collecting the sensing signals of each receiving antenna of the sensing signal receiving base station, the channel impulse responses of the receiving antennas at different times are obtained, and sensing modeling is performed on the sensing object based on the state machine to determine the state type of the sensing object.

[0081] In this embodiment, the state machine may be disposed in the base station or in the server, and this embodiment is not particularly limited thereto.

[0082] A sensing target refers to a specific environment such as a room, a parking lot, or a forest area (e.g., a particular mountain).

[0083] The state machine has the function of sensing calculation, expresses the switching relationship between each stable state, and relates to the state and maintenance state jump relationship, whose input is the sensing signal and whose output is the state switching situation. A timer is set in the state machine, and the state machine information includes the state machine switching information (also called the history switching record), the current state, the temporary state, and timer information, etc. The state machine switching information includes, but is not limited to, the time, number, and the state before and after the switching.

[0084] The state machine may be one or more, and its layout schematic diagram can refer to Figure 6. The real-time update process of the state machine is a real-time modeling process, and one receiving base station may correspond to one or more state machines, and one receiving antenna may correspond to one state machine or multiple state machines, which is not limited in this embodiment.

[0085] Specifically, the sensing signal receiving base station receives the sensing signal, samples the sensing signal of each receiving antenna, and calculates the channel impulse response vector R of each receiving antenna at the corresponding time according to the sampling signal. m,n (t), where m , n is the number of elements in the antenna array, m ∈ [0, M-1], n ∈ [0, N-1], M and N are both integers greater than 1, and t is time.

[0086] As shown in Fig. 6, let the state machine set be S(K), and the initial state of the state machine, S(0), be the current channel impulse response vector, R m,n (t), where K is the number of the total number of states, K is an integer, S' is the temporary state of the state machine, K' is the number of the current state, and K' is an integer.

[0087] In the initial state, the initial state S(0) is the current state, the initial value of K is 0, and the temporary state S'=S(0), K'=K. The state machine switching information at the current time, which is whether the state machine is switching or not, and if there is switching, which state it is switching from and to, is recorded. The state machine switching information includes, but is not limited to, the time, number, and the state before and after the switching.

[0088] A state of the state machine corresponds to one stable radio propagation environment, and each state value is stored in association with one stable channel impulse response value of a receiving antenna.

[0089] A temporary state in the state machine is introduced to find another stable state after the current stable state, and when an environmental change is detected, the value of the temporary state changes to the new channel impulse response value of the receiving antenna.

[0090] Initially, timer C is set to 0 and begins timing.

[0091] The state types to be sensed may include the following types:

[0092] Type 1: The sensing object is in an unstable state in the current state, for example, the state of the sensing object is determined to be constantly changing according to the recorded information of the state machine, and is unstable in the current state, for example, scenarios such as a landslide, having a meeting in a conference room with people constantly talking and walking around, and cars moving back and forth in a parking lot.

[0093] Type 2: The sensing target is stable in the current state, and there is a change from the previous stable state. As shown in Fig. 7, Fig. 7 is a state machine switching diagram in which the room goes from unoccupied to occupied to unoccupied again.

[0094] For example, a conference room can go from an unmanned scenario (S0) with no meeting to a manned scenario (S1) with a meeting, and then from the manned scenario (S1) with a meeting to an unmanned scenario (S2) after the meeting has ended, where S' is a temporary state of the state machine.

[0095] In the case of a state machine, comparing the two states S2 and S1 of the state machine, both are stable states. However, since the tables and chairs in the conference room may change before and after the meeting, the two states S2 and S1 of the state machine are different. The conference room is stable in the current state S2, and there is a change from the previous stable state S1. Therefore, all state machines and their switching times can be tracked and the state information of the state machines can be extracted.

[0096] Type 3: The sensing target is stable in the current state and has no change from the previous stable state, that is, the environment remains stable and has no change.

[0097] In one embodiment, real-time sensing modeling is performed on the sensing target by a state machine, real-time modeling information of the state machine is extracted from the real-time state machine model, a state type of the sensing target is determined based on the real-time modeling information of the state machine, and then an environmental state of the sensing target is determined based on the state type of the sensing target.

[0098] In one embodiment, the real-time modeling information of the state machine comprises: State machine switching information, The current state of a state machine, for example the stable state of a conference room before someone enters; The transient state of the state machine that can be used to find a stable state, and It may include at least one of the timer information of the state machine.

[0099] In the above means, the means for determining the state type of the sensing target according to real-time modeling information of the state machine can determine S1 and after S1.

[0100] An example scenario is as follows:

[0101] Scenario 1: If Timer C is less than a given time threshold 1, it is determined that someone has entered the room and is moving. It is determined whether there is an environment change in the scenario, and according to the transformation of the state machine of the room, it is determined that someone enters the room and then leaves, and a change in the environment occurs, as shown in FIG. 7.

[0102] Scenario 2: Determine the landslide state in the mountain scenario, and depending on the state before the landslide, determine that there is a risk if the timer C of the state machine is less than a predefined time threshold 1, and determine that the landslide is completed if the state machine can be switched to another stable state.

[0103] For a sensing object in an unstable state, difference information between the channel impulse response of the antenna at different times and the current state of the state machine is calculated, and an environmental state change rule of the sensing object is determined according to the difference information.

[0104] In this embodiment, the environmental state change rule of the sensing object that is mainly in an unstable state is sensed and determined.

[0105] In one example, as an embodiment, for a sensing object in an unstable state, the channel impulse response of the receiving antenna at different times and the current state corresponding to the state machine are obtained, and differential information between the channel impulse response of the receiving antenna at different times and the current state corresponding to the state machine is calculated.

[0106] Specifically, for a current time, obtain the channel impulse response of the receiving antenna at the current time and the current state corresponding to the state machine, and calculate the difference information between the channel impulse response of the receiving antenna at the current time and the current state corresponding to the state machine, as shown in FIG. 8.

[0107] The processed signal information is obtained. Δ m,n (t)=R m,n (t) - S(k') Δ m,n (t) is the channel impulse response R of the receiving antenna at the current time t. m,n This is the difference information between (t) and the current state S(K') corresponding to the state machine.

[0108] Then, receive the channel impulse response at the next time, and repeat the above process to obtain the difference information between the channel impulse response of the receiving antenna at different time and the current state corresponding to the state machine, and further each Δ m,n (t) is analyzed to obtain signal features such as period information, and real-time change signal information is analyzed thereby to obtain the change rule of the environmental state of the sensing object.

[0109] In one embodiment, analyzing the difference information and extracting difference signal features in the difference information, the difference signal features including, but not limited to, phase, amplitude, and time period; plotting a state change curve in response to the differential signal characteristics; A rule of change in the environmental state of the sensing target is determined according to the state change curve.

[0110] An example of the scenario is as follows: For example, the breathing signal of a person in a room is sensed, and an analysis is performed according to the sensed breathing signal of the person to obtain the breathing rule of the person in the room, and further obtain the state change rule when there is a person in the room. The environmental state change rule after the differential signal processing can be referred to in FIG.

[0111] Furthermore, for example, after turning on a machine in a factory building, sensing analysis can be performed on the sound signal of the machine in the factory building to determine whether there is a pattern in the operation or sound of the machine, and the judgment result can be obtained by the above method in either case.

[0112] Thus, a real-time state machine model is established for a sensing object, and an environmental state of the sensing object is determined based on the real-time state machine model. Specifically, a sensing signal of an antenna is collected, a channel impulse response of the antenna is obtained based on the sensing signal of the antenna, a switching manner of the state machine is obtained based on the channel impulse response of the antenna and current information (current state, temporary state, timer information) of a state machine, the real-time state machine model is updated, real-time modeling information of the state machine is extracted from the real-time state machine model, and an environmental state of the sensing object is determined based on the real-time modeling information of the state machine. determine a state type of a sensing object, determine an environmental state of the sensing object according to the state type of the sensing object, calculate difference information between the channel impulse responses of the receiving antennas at different times and a current state corresponding to the state machine for the sensing object in an unstable state, and obtain an environmental state change rule of the sensing object by analyzing according to the difference information, thereby overcoming the problem of realizing wireless sensing in the presence of multipath effects in complex environments such as indoors and urban areas, and when the number of receiver antennas is small or the bandwidth is small, and improving the accuracy of wireless sensing in complex multipath environments.

[0113] More specifically, the following describes in detail the specific means of performing real-time sensing modeling on the sensing object using a state machine, extracting real-time modeling information of the state machine from the real-time state machine model, and determining the state type of the sensing object based on the real-time modeling information of the state machine.

[0114] Taking the scenario shown in FIG. 4 as an example, the sensing signal transmitting base station (RS) transmits the sensing signal at a set time T n The sensing signal S is transmitted on the wireless resource, and the sensing signal receiving base station (Br) receives the sensing signal. The sensing signal transmitted by the sensing signal transmitting base station is used to detect various environmental objects P n (P 1 ,P 2 ...,P n ,) and the sensing signal can be reflected and projected to the receiving base station.

[0115] By collecting the sensing signals of each receiving antenna of the sensing signal receiving base station, the channel impact responses of the receiving antennas at different times are obtained, and sensing modeling is performed for the sensing object based on a state machine (abbreviated as state machine in the following specific embodiment), and the state type of the sensing object is determined.

[0116] Specifically, the sensing signal receiving base station receives the sensing signal, samples the sensing signal of each receiving antenna, and calculates the channel impulse response vector R of each receiving antenna at the corresponding time according to the sampling signal. m,n (t), where m, n are the element numbers in the antenna array, m ∈ [0, M-1], n ∈ [0, N-1], M and N are both integers greater than 1, and t is time.

[0117] As shown in Fig. 6, let the state machine set be S(K), and the initial state of the state machine, S(0), be the current channel impulse response vector, R m,n(t), where K is the number of the total number of states, K is an integer, S' is the temporary state of the state machine, K' is the number of the current state, and K' is an integer.

[0118] In the initial state, the initial state S(0) is the current state, the initial value of K is 0, and the temporary state S'=S(0), K'=K. The state machine switching information at the current time, which is whether the state machine is switching or not, and if there is switching, which state it is switching from and to, is recorded. The state machine switching information includes, but is not limited to, the time, number, and the state before and after the switching.

[0119] A state of the state machine corresponds to one stable radio propagation environment, and each state value is stored in association with one stable channel impulse response value of a receiving antenna.

[0120] A temporary state in the state machine is introduced to find another stable state after the current stable state, and when an environmental change is detected, the value of the temporary state changes to the new channel impulse response value of the receiving antenna.

[0121] In the initial state, timer C is set to 0 and starts timing. A certain timeout time is set for timer C, and when the timeout time is reached and the switching condition is met, the state machine performs a switching operation, and when the clearing condition is met, regardless of whether the timer's timeout time is reached or not, the timer performs a clearing operation. The specific operation of the timer varies depending on the scenario, and the timers for different switching types of the state machine will be described in detail later.

[0122] In one embodiment, the step of performing real-time sensing modeling on the sensing target by a state machine, obtaining a switching manner of the state machine, and updating the real-time state machine model includes: collecting a sensing signal of an antenna; obtaining a channel impulse response of the antenna based on a sensing signal of the antenna; and obtaining a switching strategy of the state machine based on the channel impulse response of the antenna and current information of the state machine (current state, temporary state, timer information) and updating the real-time state machine model.

[0123] In one embodiment, the step of obtaining a switching strategy for the state machine based on a channel impulse response of the antenna and current information of the state machine comprises: recording the current state, the temporary state, and timer information of the state machine; and deriving a switching strategy for the state machine based on the channel impulse response of the antenna and the current state, temporary state, and timer information of the state machine.

[0124] Taking the current time as an example, the sensing signal receiving base station receives the sensing signal, samples the sensing signal of each receiving antenna, and calculates the channel impulse response R of the receiving antenna at the current time according to the sensing signal of the receiving antenna. m,n Get (t).

[0125] Thereafter, recording the current state, the temporary state, and timer information of the state machine at the current time; determining a switching strategy for the state machine at a current time based on a channel impulse response of the receive antenna at a current time and a current state, a temporary state, and timer information of the state machine at a current time; In one embodiment, the state of the state machine is updated in real time based on the switching method of the state machine at the current time.

[0126] That is, the channel impulse response R of the receiving antenna at the current time m,n(t), determine a switching manner of the sensing state machine according to the current state (S(K'), the temporary state (S'(K')) and the timer C, and perform a corresponding operation (e.g., a no-switching operation, an operation to switch to a new state, or an operation to switch to the previous existing state), and complete the update of the real-time modeling sensing state machine at the current time, and the real-time update process of the state machine is a real-time modeling process.

[0127] Thereafter, the state type of the sensing target can be determined according to the state update change of the state machine and the current count of the timer.

[0128] In one embodiment, the step of determining a state type of the sensing target based on real-time modeling information of the state machine includes: The method may include determining a state type of the sensing target based on a history switching record of the state machine, a current state, a temporary state, and timer information.

[0129] In one embodiment, the step of updating the real-time state machine model comprises: The method includes performing an update operation on the real-time state machine model based on a switching method of the state machine.

[0130] In one embodiment, the step of performing an operation on the real-time state machine model based on a switching method of the state machine includes: corresponding to the state machine maintaining its current state, if the channel impulse response of the antenna at the current time and the temporary state of the state machine at the current time are not similar, updating the temporary state of the state machine to the channel impulse response of the antenna at the current time and clearing a timer; continuing to count a timer if the channel impulse response of the antenna at the current time is similar to the temporary state of the state machine at the current time in response to the state machine maintaining its current state; corresponding to the state machine being switched to an existing state in history, performing a switching operation of the state machine, changing the temporary state and current state number of the state machine to the corresponding state and number with the highest similarity in the existing state machine, not clearing a timer, and recording the switching information of the state machine; The method includes at least one of steps of performing a new state generation operation and a switching operation of the state machine in response to the state machine switching to a new state, not clearing a timer, and recording switching information of the state machine.

[0131] In one embodiment, the method further comprises saving the current state of the state machine.

[0132] In one embodiment, the state type of the sensing target is: The sensing target is currently in an unstable state. The sensing target is stable in its current state and has changed from the previous stable state; and The sensing target includes at least one of being stable in the current state and being unchanged from the previous stable state.

[0133] Specifically, the state types to be sensed include the following types:

[0134] Type 1: The sensing object is in an unstable state in the current state, for example, the state of the sensing object is determined to be constantly changing according to the recorded information of the state machine, and is unstable in the current state, for example, scenarios such as a landslide, having a meeting in a conference room with people constantly talking and walking around, and cars moving back and forth in a parking lot.

[0135] Type 2: The sensing object is stable in its current state, but there is a change from the previous stable state. For example, the conference room changes from an unmanned scenario without a meeting to an attended scenario (S1), and then from the attended scenario (S1) to an unmanned scenario after the meeting ends (S2). In the case of a state machine, when comparing the two states S2 and S1 of the state machine, both are stable states, but the tables and chairs in the conference room may change before and after the meeting, so the two states S2 and S1 of the state machine are different. The conference room is stable in the current state S2, but there is a change from the previous stable state S1. Therefore, all state machines and their switching times can be tracked, and the state information of the state machines can be extracted.

[0136] Type 3: The sensing target is stable in the current state and has no change from the previous stable state, that is, the environment remains stable and has no change.

[0137] Thus, by collecting the sensing signals of each receiving antenna of the sensing signal receiving base station, the channel impact response of the receiving antenna at different times is obtained, and sensing modeling is performed on the sensing object based on the state machine to determine the state type of the sensing object.

[0138] In one embodiment, the state machine switching scheme is: Maintaining the current state, Switching to an existing state in the history (switching to a similar state), and switching to a new state.

[0139] In one embodiment, prior to the step of obtaining a switching mode of the state machine, The method further includes determining a switching strategy for the state machine.

[0140] In one embodiment, the manner in which the state machine determines to maintain the current state is: The timer count does not exceed the set time threshold, the channel impulse response of the antenna at the current time and the temporary state of the state machine at the current time are not similar, and a timer is cleared; and The channel impulse response of the antenna at a current time and a temporary state of the state machine at a current time are similar, and a timer continues to maintain a count.

[0141] In one embodiment, the manner in which the state machine determines to switch to an existing state in the history is: The timer count exceeds a set time threshold, the channel impulse response of the antenna at the current time is similar to a temporary state of the state machine at the current time, and the temporary state and the current state are dissimilar; traversing all states in the saved state machine and comparing the similarity of the temporary states with each current state in the saved state machine, and determining that all saved states have a similar situation to the temporary state; The temporary state and current state number are changed to the corresponding most similar state and number in the existing state machine; and The timer includes at least one of not clearing.

[0142] In one embodiment, the manner in which the state machine determines to switch to a new state is: The timer count exceeds a set time threshold, The channel impulse response of the receiving antenna at the current time and the temporary state of the state machine at the current time are similar, and the temporary state is not similar to all states in the saved state machine, and the state machine generates a new state and switches to the new state; and The timer includes at least one of not clearing.

[0143] The three types of state machine switching methods are explained in detail below.

[0144] First switching method: Maintain the current state and do not switch.

[0145] The following method determines whether to maintain the current state as the switching method of the state machine at the current time and not to switch.

[0146] If it is determined that the count value of the timer C does not exceed the set time threshold 1 according to the timer information, the channel impulse response R of the receiving antenna at the current time is m,n determining whether a temporary state S' of the state machine at time (t) and the current time are similar; The channel impulse response R of the receiving antenna at the current time m,n If the temporary state S' of the state machine at time t is not similar to the channel impulse response R of the receiving antenna at the current time, m,n (t), and clear timer C, so that the state machine at the current time remains in its current state and does not switch; The channel impulse response R of the receiving antenna at the current time m,n If (t) and the temporary state S' of the state machine at the current time are similar, the timer C continues to count, and the state machine at the current time maintains its current state and does not switch.

[0147] Second switching method: Switch to an existing state in the history or switch to a similar state.

[0148] The following method determines whether the state machine should switch to an existing state in the history or to a similar state at the current time.

[0149] When it is determined that the count value of the timer C exceeds the set time threshold 1 according to the timer information, the channel impulse response R of the receiving antenna at the current time ism,n determining whether a temporary state S' of the state machine at time (t) is similar to a current time and whether the temporary state S' is similar to a current state S; The channel impulse response R of the receiving antenna at the current time m,n If the temporary state S' of the state machine at time (t) and the current time are similar, and the temporary state S' and the current state S are not similar, traverse all current states S(K) in the stored state machine and compare the similarity between the temporary state S' and each current state S(i), where i≦K; If all the stored current states S(K) have a similar situation to the temporary state S', it is determined that the switching method of the state machine at the current time is to switch to an existing state in the history, and the temporary state and the current state number are converted into the state and number i that have the maximum similarity in the existing state machine. max That is, S'(K')=S(i max ), K'=i max and Records state machine switching information without clearing the timer.

[0150] Third switching method: Switch to a new state.

[0151] The following method is used to determine the switching method of the state machine at the current time to switch to a new state:

[0152] When it is determined that the count value of the timer C exceeds the set time threshold 1 according to the timer information, the channel impulse response R of the receiving antenna at the current time is m,n determining whether a temporary state S' of the state machine at time (t) is similar to a current time and whether the temporary state S' is similar to all current states S(K) of the saved state machine; The channel impulse response R of the receiving antenna at the current time m,nIf (t) and the temporary state S' of the state machine at the current time are similar, and the temporary state S' and all current states S(K) in the saved state machine are not similar, generate a new state and determine to switch to the new state as the switching method of the state machine at the current time, i.e., update the state number K=K+1, and update the new state S(K) in the state set to S(K)=S', so that the current state and the temporary state are consistent, S'=S(K), K'=K.

[0153] Records state machine switching information without clearing the timer.

[0154] In one embodiment, in the above method, the step of determining whether the channel impulse response of the receiving antenna at a current time is similar to a temporary state of the state machine at a current time includes: calculating a similarity between the channel impulse response of the receive antenna at a current time and a temporary state of the state machine at a current time; determining that the channel impulse response of the receive antenna at the current time and the temporary state of the state machine at the current time are not similar if the similarity does not exceed a predetermined similarity threshold; Otherwise, determining that the channel impulse response of the receive antenna at the current time and the temporary state of the state machine at the current time are similar.

[0155] Calculating the similarity between the channel impulse response of the receiving antenna at the current time and the temporary state of the state machine at the current time includes, but is not limited to, employing the following means:

[0156] 1. The channel impulse response R of the receiving antenna at the current time m,n Calculate the correlation value between (t) and the temporary state S′ of the state machine at the current time, and use the maximum correlation peak as the similarity comparison amount; 2. The channel impulse response R of the receiving antenna at the current time m,n The angle between (t) and the temporary state S' of the state machine at the current time is calculated, and the cosine of the angle is taken as the similarity comparison amount.

[0157] The determination of whether the states are similar or not includes setting a similarity threshold 2, and determining that the states are similar if the similarity exceeds a predetermined similarity threshold 2, and conversely determining that the states are not similar.

[0158] Based on the above means, all state machine switching information can be tracked and state information can be extracted as needed, including but not limited to:

[0159] In indoor scenarios, states with small changes within a time threshold can be extracted as unoccupied states.

[0160] In a typical scenario, the switching information of the state machine arranged in time for one day can be extracted as the scenario change for one day, and the rules can be analyzed to obtain the state change rules for different environments. As shown in Figure 10, Figure 10 is a channel model change diagram for a room for one day.

[0161] The specific embodiment of this embodiment will be described in further detail below with reference to different scenarios.

[0162] Scenario 1 When the room state changes from unoccupied to occupied and back to unoccupied, the state change is shown in Figure 7. The specific implementation process is as follows:

[0163] The synchronized sensing signal transmitting base station transmits a sensing signal on the set time and radio resource, and the base station receives the sensing signal. Each antenna sensing signal is sampled, and the channel impulse response vector R of each receiving antenna is calculated according to the sampled signal. m,nObtain (t), set the initial state S(0), set the temporary state S'=S(0), K'=K, set the timer to 0, and start timing; at this time, we are in state S(0), as shown in FIG. 7.

[0164] R m,n If (t) and S' are not similar, then C=0, i.e., clear; otherwise, C is not clear.

[0165] Compare the time threshold 1 of the timer C, and if the timer C exceeds the set state threshold 1, and the temporary state S' and all the states S(K) in the saved state machine are not similar, generate a new state, i.e. update the state number to K=0+1, update the new state S(K) in the state set to S(1)=S', the current state and the temporary state are consistent, S'=S(1), and K'=1, that is, the room is in the S(0) state, and finally enters the unoccupied stable state S(1).

[0166] Similarly, as shown in Figure 7, the state changes from S(1) to S(2), the state number number is updated to K=1+1, and the new state S(K) in the state set is updated to S(2)=S', the current state and the temporary state are consistent, S'=S(2), and K'=2, that is, the room is in the S(1) stable state, then someone enters the room and moves, the state is a temporary state, S' continues to change, and finally it becomes the uninhabited stable state S(2).

[0167] Scenario 2 When the person in the room performs respiratory monitoring, the state change is shown in Figure 9. The specific implementation process is as follows:

[0168] The synchronized sensing signal transmitting base station transmits the sensing signal on the set time and radio resource, and the sensing signal receiving base station receives the sensing signal. Each antenna sensing signal is sampled, and the channel impulse response vector R of each antenna is calculated according to the sampled signal. m,n(t) is obtained, the initial state S(0) is set, the temporary states S'=S(0), K'=K, and the timer C starts timing from 0, and is now in the S(0) state.

[0169] R m,n If (t) and S' are not similar, then C=0, i.e., clear; otherwise, C is not clear.

[0170] Compare the time threshold 1 of the timer C, if the timer C exceeds the set time threshold 1 and the temporary state S' and all the states S(K) in the saved state machine are not similar, generate a new state, i.e. update the state number to K=0+1, update the new state S(K) in the state set to S(1)=S', the current state and the temporary state are consistent, S'=S(1), and K'=1, that is, the object changes from the S(0) state to S(1), and obtain the processed signal, which corresponds to the one shown in Figure 9(1).

[0171] After someone enters, R m,n If (t) and S' are not similar, then C = 0 and S1 continues to be maintained.

[0172] R m,n (t) is received in real time to obtain the differential signal. Δ m,n (t)=R m,n (t) - S(k')

[0173] The difference signal was continuously recorded and analyzed to obtain a regular signal, as shown in FIG. 9(4).

[0174] By continuously repeating the above process, a processed state signal can be obtained, and a person's respiratory change process can be analyzed from the processed sensing signal.

[0175] Scenario 3 The room state change is extracted based on the room one-day channel model change rule, which is shown in Figure 10. The specific implementation process is as follows:

[0176] The synchronized sensing signal transmitting base station transmits the sensing signal on the set time and radio resource, and the sensing signal receiving base station receives the sensing signal. Each antenna sensing signal is sampled, and the channel impulse response vector R of each antenna is calculated according to the sampled signal. m,n (t), set the initial state S(0), and the temporary states S'=S(0), K'=K, and the timer C starts timing. At this time, the room is in the steady state of S(0) in the morning, as shown in FIG. 10.

[0177] The timer C threshold is compared, and if the timer C exceeds the set threshold 1 and the temporary state S' and all the states S(K) in the saved state machine are not similar, a new state is generated, that is, the state number is updated to K=0+1, and the new state S(K) in the state set is updated to S(1)=S', the current state and the temporary state are consistent, S'=S(1), and K'=1, that is, during a certain time period in the morning, the state of the room changes from the stable state S(0) to the stable state S(1) after a certain period of moving state, and the dashed box part in Figure 10 is the moving temporary state S'.

[0178] Similarly, as shown in FIG. 10, when the count value of the timer C exceeds the set time threshold 1 and changes from state S(1) to state S(2), all states S(K) in the saved state machine are traversed, i.e., the similarity of S' is compared with S(0) and S(1). If no similar state is found, the state number is updated to K=1+1, and the new state S(K) in the state set is updated to S(2)=S'. The current state and the temporary state are consistent, S'=S(2), and K'=2. That is, at a specific time of noon, the state of the room changes from the stable state S(1) to the stable state S(2) after a certain period of motion.

[0179] In addition, when the count value of the timer C exceeds the set time threshold 1 and changes from state S(2) to state S(3), all states S(K) in the saved state machine are traversed, i.e., the similarity of S' is compared with S(0), S(1), and S(2). If no similar state is found, the state number is updated to K=2+1, and the new state S(K) in the state set is updated to S(3)=S'. The current state and the temporary state are consistent, S'=S(3), and K'=3, i.e., at a specific time of noon, the state of the room changes from the S(2) stable state to the S(3) stable state after a certain period of motion.

[0180] As shown in FIG. 10, the temporary state is S'=S(3) and K'=3. When the count value of the timer C exceeds the set time threshold 1, R m,n (t) is similar to the temporary state S', and the temporary state S' is not similar to the current state S. In this case, traverse all states S(K) in the saved state machine, i.e., compare the similarity of S' with S(0), S(1), S(2) and S(3). If no similar state is found, update the state number to K=3+1, and update the new state S(K) in the state set to S(4)=S', and the current state and the temporary state are consistent, S'=S(4), and K'=4, that is, at a specific time of noon, the state of the room changes from the stable state S(3) to the stable state S(4) after a certain period of motion.

[0181] Compared with the prior art, the means of this embodiment establishes a real-time state machine model for the sensing object, and determines the environmental state of the sensing object based on the real-time state machine model, thereby being able to solve state sensing and sensing signal analysis in complex environments, being able to recognize different stable state characteristics of the environment, being able to recognize real-time changes of the environment, and being able to associate the state machine with the state type in actual scenarios. By using the real-time modeling state machine for wireless sensing in complex multipath environments, the problem that wireless sensing cannot be effectively realized when there is the influence of multipath in complex environments such as indoors and urban areas, and when the number of receiver antennas is small or the bandwidth is small, is overcome, and the accuracy of wireless sensing in complex multipath environments is improved.

[0182] As shown in FIG. 11, an embodiment of the present application further provides a wireless sensing device, the wireless sensing device including: a type determination module for determining a state type of a sensing object based on sensing modeling; and an environmental condition determination module for determining an environmental condition of the sensing target based on the condition type.

[0183] Regarding the principle and implementation process of the wireless sensing in this embodiment, reference may be made to the above embodiments, and a duplicated description will be omitted here.

[0184] Moreover, an embodiment of the present application further provides a wireless sensing device, a sensing modeling module for establishing a real-time state machine model for a sensing target; and a state determination module for determining an environmental state of the sensing target based on the real-time state machine model.

[0185] Regarding the principle by which the present embodiment realizes sensing, reference may be made to the above-mentioned embodiments, and a duplicated explanation will be omitted here.

[0186] In addition, an embodiment of the present application further provides a communication device, the communication device including a memory, a processor, and a wireless sensing program stored in the memory and executable on the processor, the wireless sensing program realizing the wireless sensing method described in each of the above embodiments when executed by the processor.

[0187] When this wireless sensing program is executed by a processor, it employs all the technical solutions of all the above embodiments, and therefore has at least all the beneficial effects of all the technical solutions of all the above embodiments, so duplicated descriptions will be omitted here.

[0188] In addition, an embodiment of the present application further provides a computer-readable storage medium, in which a wireless sensing program is stored, and when the wireless sensing program is executed by a processor, the wireless sensing method described in each of the above embodiments is realized.

[0189] When this wireless sensing program is executed by a processor, it employs all the technical solutions of all the above embodiments, and therefore has at least all the beneficial effects of all the technical solutions of all the above embodiments, so duplicated descriptions will be omitted here.

[0190] Compared with the prior art, the wireless sensing method, device, communication device, and storage medium according to the embodiments of the present application establish a real-time state machine model for a sensing object, and determine the environmental state of the sensing object based on the real-time state machine model, thereby overcoming the problem of achieving wireless sensing in the presence of multipath effects in complex environments such as indoors and urban areas, as well as when the number of receiver antennas is small or the bandwidth is small, and improving the accuracy of wireless sensing in complex multipath environments.

[0191] It should be noted that, as used herein, the terms "comprise," "comprises," or any other variation thereof, are intended to cover a non-exclusive inclusion, whereby a process, method, article, or system that includes a set of elements includes not only those elements, but also other elements not expressly listed or that are inherent to the process, method, article, or system. In the absence of further limitations, an element qualified by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, article, or system that includes the element.

[0192] The numbers of the examples in the present application above are for illustrative purposes only and do not indicate superiority or inferiority of the examples.

[0193] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be realized by software and a necessary general-purpose hardware platform, and of course can be realized by hardware, and in many cases, the former is a more preferred embodiment. Based on this understanding, the essence of the technical solution of the present application or the part that contributes to the related art can be embodied in the form of a software product, and the computer software product is stored in one storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and includes a plurality of instructions for causing one communication device (which may be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the methods in each embodiment of the present application.

[0194] The above are merely preferred embodiments of the present application, and do not limit the scope of the patent of the present application. The modifications of equivalent structures or equivalent processes made using the contents of the specification and drawings of the present application, or direct or indirect applications in other related technical fields, are also included in the scope of patent protection of the present application.

Claims

1. A wireless sensing method, comprising: establishing a real-time state machine model for a sensing target; determining an environmental state of the sensed object based on the real-time state machine model; A wireless sensing method comprising:

2. The step of establishing a real-time state machine model for a sensing target includes: performing real-time sensing modeling on the sensing object by a state machine, obtaining a switching method of the state machine, and updating the real-time state machine model; 2. The method of claim 1, comprising:

3. The step of performing real-time sensing modeling on the sensing object by a state machine, obtaining a switching manner of the state machine, and updating the real-time state machine model includes: collecting a sensing signal of an antenna; obtaining a channel impulse response of the antenna based on a sensing signal of the antenna; obtaining a switching strategy of the state machine according to the channel impulse response of the antenna and current information of the state machine, and updating the real-time state machine model; The method of claim 2 comprising:

4. The step of obtaining a switching strategy of the state machine based on a channel impulse response of the antenna and current information of the state machine includes: recording the current state, the temporary state, and timer information of the state machine; obtaining a switching strategy of the state machine according to a channel impulse response of the antenna and current state, temporary state, and timer information of the state machine; 4. The method of claim 3, comprising:

5. The switching method of the state machine is as follows: Maintaining the current state, Switching to an existing state in the history, and switching to a new state. The method according to claim 4.

6. before the step of obtaining a switching mode of the state machine, determining a switching method for the state machine; The method of claim 5 further comprising:

7. The manner in which the state machine determines to maintain the current state is: The timer count does not exceed the set time threshold, the channel impulse response of the antenna at the current time and the temporary state of the state machine at the current time are not similar, and a timer is cleared; and a channel impulse response of the antenna at a current time and a temporary state of the state machine at a current time are similar, and a timer continues to maintain a count. The method according to claim 6.

8. The manner in which the state machine decides to switch to an existing state in the history is: The timer count exceeds a set time threshold, the channel impulse response of the antenna at the current time is similar to a temporary state of the state machine at the current time, and the temporary state and the current state are dissimilar; traversing all states in the saved state machine and comparing the similarity of the temporary state to each state in the saved state machine, and determining that all saved states have a similar situation to the temporary state; The temporary state and current state number are changed to the corresponding most similar state and number in the existing state machine; and The timer includes at least one of not clearing The method according to claim 6.

9. The manner in which the state machine determines whether to switch to a new state is: The timer count exceeds a set time threshold, The channel impulse response of the receiving antenna at the current time and the temporary state of the state machine at the current time are similar, and the temporary state is not similar to all states in the saved state machine, and the state machine generates a new state and switches to the new state; and The timer includes at least one of not clearing The method according to claim 6.

10. The method of determining whether the channel impulse response of the receiving antenna at a current time is similar to the temporary state of the state machine at a current time may include: calculating a similarity between the channel impulse response of the receive antenna at a current time and a temporary state of the state machine at a current time; determining that the channel impulse response of the receive antenna at the current time and the temporary state of the state machine at the current time are not similar if the similarity does not exceed a predetermined similarity threshold; determining that the channel impulse response of the receive antenna at a current time and the temporary state of the state machine at a current time are similar if the similarity exceeds a predetermined similarity threshold; 10. The method of claim 7, 8 or 9, comprising:

11. said step of calculating a similarity between a channel impulse response of said receiving antenna at a current time and a temporary state of said state machine at a current time, said step comprising: calculating a correlation value between the channel impulse response of the receiving antenna at the current time and the temporary state of the state machine at the current time, and taking the maximum correlation peak as a similarity comparison measure; calculating an included angle between the channel impulse response of the receiving antenna at a current time and a temporary state of the state machine at a current time, and taking the cosine of the included angle as a similarity comparison measure. The method of claim 10.

12. The step of updating the real-time state machine model comprises: performing an update operation on the real-time state machine model based on a switching method of the state machine; The method according to claim 3.

13. The step of performing an update operation on the real-time state machine model based on the switching method of the state machine includes: corresponding to the state machine maintaining its current state, if the channel impulse response of the antenna at the current time and the temporary state of the state machine at the current time are not similar, updating the temporary state of the state machine to the channel impulse response of the antenna at the current time and clearing a timer; continuing to count a timer if the channel impulse response of the antenna at the current time is similar to the temporary state of the state machine at the current time in response to the state machine maintaining its current state; corresponding to the state machine being switched to an existing state in history, performing a switching operation of the state machine, changing the temporary state and current state number of the state machine to the corresponding state and number with the highest similarity in the existing state machine, not clearing a timer, and recording the switching information of the state machine; In response to the state machine being switched to a new state, the method includes at least one of the steps of: executing a new state generation operation and a switching operation of the state machine, not clearing a timer, and recording switching information of the state machine. The method of claim 12.

14. The method further includes the step of saving the current state of the state machine. The method of claim 13.

15. The step of determining the environmental state of the sensing target based on the real-time state machine model further comprises: extracting real-time modeling information of the state machine from the real-time state machine model; determining a state type of the sensing target based on real-time modeling information of the state machine; determining an environmental condition of the sensed object based on a condition type of the sensed object; 2. The method of claim 1, comprising:

16. The real-time modeling information of the state machine includes: State machine history switching record, The current state of the state machine, The temporary state of the state machine, and At least one of the timer information of the state machine is included. The method of claim 15.

17. The state type of the sensing target is The sensing target is currently in an unstable state. The sensing target is stable in its current state and has changed from the previous stable state; and The sensing target includes at least one of the following: the current state is stable, and there is no change from the previous stable state. The method of claim 15.

18. The step of determining the environmental state of the sensing target based on the state type of the sensing target comprises: Calculating difference information between the channel impulse response of the antenna at different times and the current state of the state machine for an unstable sensing target; determining an environmental state change rule of the sensing target in response to the difference information; 20. The method of claim 17, comprising:

19. The step of determining an environmental state change rule of the sensing target in accordance with the difference information includes: analyzing the difference information and extracting difference signal features in the difference information; plotting a state change curve in response to the difference signal characteristics; determining an environmental state change rule of the sensing target according to the state change curve; 20. The method of claim 18, comprising:

20. The differential signal features include at least one of phase, amplitude, and time period.

20. The method of claim 19.

21. A communications device comprising a memory, a processor, and a wireless sensing program stored in the memory and executable on the processor, the communications device realizing the wireless sensing method according to any one of claims 1 to 20 when the wireless sensing program is executed by the processor.

22. A computer-readable storage medium having a wireless sensing program stored therein, the computer-readable storage medium realizing the wireless sensing method according to any one of claims 1 to 20 when the wireless sensing program is executed by a processor.

Images