Wireless sensing method, communication equipment, and communication program

Abstract

This application discloses a wireless sensing method, a communication device, and a storage medium, which includes the steps of establishing a real-time state machine model for a sensing target, and determining an environmental state of the sensing target based on the real-time state machine model.

Description

[Technical Field]

[0001] This application claims priority to a Chinese patent application filed on August 26, 2022, with application number 202211035098.5, the entire contents of which are incorporated into this application by reference.

[0002] This application relates to the field of sensing technology, and more particularly to a modeling-based wireless sensing method, communication equipment, and storage medium in the field of terrestrial communication sensing integration. [Background technology]

[0003] With technological advancements, ubiquitous intelligence technology will bring great convenience and new experiences to people's lives, while also deeply penetrating various industries, upgrading them through intelligence, and improving industrial efficiency.

[0004] Ubiquitous intelligence technology primarily includes ubiquitous sensing technology, ubiquitous computing technology, and product research and development. Currently deployed ubiquitous systems generally achieve ubiquitous sensing and ubiquitous computing through wireless communication networks.

[0005] In the field of conventional sensing, it is currently mainly implemented using radar equipment. Current application scenarios for radar equipment mainly include aircraft sensing, such as airport radar, and short-range sensing, such as automotive radar. Both of these scenarios are relatively simple. Ubiquitous sensing can realize sensing in a variety of complex scenarios, such as indoor multipath environments, ground-based multi-building and multi-vehicle environments, and multi-person environments in shopping malls. Currently, in complex multipath environments, especially when the number of antennas is small and the bandwidth is low, conventional sensing technologies are no longer sufficient to meet the requirements. [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] In view of the above technical problems, embodiments of the present application overcome the problems that there are multi-path effects in a complex environment, the number of antennas of the receiver is small, or the bandwidth is small, and wireless sensing cannot be effectively realized, and provide a wireless sensing method, a communication device, and a storage medium to improve the accuracy of wireless sensing in a complex environment.

Means for Solving the Problems

[0007] Embodiments of the present application include establishing a real-time state machine model for a sensing target; and determining an environmental state of the sensing target based on the real-time state machine model. fruit, The step of establishing a real-time state machine model for the sensing target is: The process includes the steps of performing real-time sensing modeling on the sensing target using a state machine, obtaining the state machine switching method, and updating the real-time state machine model. The step of determining the environmental state of the sensing target based on the real-time state machine model is: The steps include extracting real-time modeling information of the state machine from the real-time state machine model, The steps include determining the state type of the sensing target based on the real-time modeling information of the state machine, The steps include determining the environmental state of the sensing target based on the state type of the sensing target. to provide a wireless sensing method.

[0008] Embodiments of the present application further include a sensing modeling module for establishing a real-time state machine model for a sensing target; and a state determination module for determining an environmental state of the sensing target based on the real-time state machine model.

[0009] Embodiments of the present application further include a communication device including a memory, a processor, and a wireless sensing program stored in the memory and executable on the processor. When the wireless sensing program is executed by the processor, the wireless sensing method is realized.

[0010] Embodiments of the present invention further provide a computer-readable storage medium that stores a wireless sensing program and, when the wireless sensing program is executed by a processor, enables the wireless sensing method.

[0011] The wireless sensing method, communication equipment, and storage medium according to the embodiment of the present application establish a real-time state machine model for a sensing target, determine the environmental state of the sensing target based on the real-time state machine model, thereby overcoming the problem that wireless sensing cannot be effectively realized when the number of receiver antennas is small or the bandwidth is small, as is the case with wireless sensing methods using real-time modeling state machines in complex multipath environments, as well as when there is an influence of multipath in complex environments such as indoors or in urban areas, and thereby improving the accuracy of wireless sensing in complex multipath environments.

[0012] The drawings herein are incorporated into the specification and constitute part of this specification, illustrating embodiments conforming to the present application and are used together with the specification to interpret the principles of the present application. In order to more clearly explain the technical concepts of the embodiments of the present application, the drawings necessary for describing the embodiments are briefly described below, and as will be apparent, those skilled in the art can obtain other drawings based on these drawings without any creative work. [Brief explanation of the drawing]

[0013] [Figure 1] This is a schematic diagram of the hardware structure of terminal equipment that realizes each embodiment of the present invention. [Figure 2] This is an architecture diagram of a communication network system according to an embodiment of the present invention. [Figure 3] This is a flowchart of the first embodiment of the wireless sensing method in this application. [Figure 4] This is a schematic diagram of a scenario for an embodiment of the wireless sensing method in the present application. [Figure 5] This is a flowchart of the second embodiment of the wireless sensing method in this application. [Figure 6] This is a schematic diagram of the arrangement of a state machine according to an embodiment of the present invention. [Figure 7] This is a diagram illustrating the state machine switching mechanism in an embodiment of the present invention, where a room progresses from unoccupied to occupied and then to unoccupied again. [Figure 8] This is a diagram illustrating the principle of differential signal processing and change in an embodiment of the present invention. [Figure 9] This is a schematic diagram of the state change in one scenario in an embodiment of the present invention and the environmental state change rule after differential signal processing. [Figure 10] One scenario in the embodiment of the present invention is a schematic diagram that extracts changes in the state of a room based on a 24-hour channel model change rule for the room. [Figure 11] This is a schematic diagram of a functional module of the first embodiment of the wireless sensing device in the present application. [Modes for carrying out the invention]

[0014] The realization of the objectives, functional features, and advantages of this application will be further described with reference to the examples and drawings.

[0015] Herein, exemplary embodiments are described in detail, and these examples are shown in the drawings. Where the following description relates to the drawings, unless otherwise noted, the same numbers in different drawings indicate the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application detailed in the appended claims.

[0016] In this specification, the terms “includes,” “incorporates,” or any other variation thereof are intended to cover non-exclusive inclusion, thereby including not only those elements but also other elements not expressly enumerated, or elements specific to that process, method, article, or apparatus. Unless otherwise specified, an element limited by the phrase “includes one…” does not preclude the presence of another identical element in a process, method, article, or apparatus that includes that element. Components, features, and elements having the same name in different embodiments of this application may or may have the same meaning, and their specific meaning must be determined by their interpretation in the specific embodiment, or in combination with the context in the specific embodiment.

[0017] In this specification, although terms such as first, second, third, etc. may be used to describe various information, it should be understood that this information is not limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this specification, the first information may be called the second information, and similarly, the second information may be called the first information. Depending on the context, the word "if" used here can be interpreted as "when" or "at the time" or "in response to a determination". Also, the singular forms "1", "one", and "the" used in this specification are intended to include the plural forms as well, unless the context indicates otherwise. The terms "comprising" and "including" indicate the presence of the said features, steps, operations, elements, assemblies, items, types, and / or groups, but do not further exclude the presence, appearance, or addition of one or more other features, steps, operations, elements, assemblies, items, types, and / or groups. It should be further understood that the terms "or", "and / or", "including at least one of the following", etc. used in this application are to be interpreted as inclusive or may mean any one or any combination. For example, "including at least one of A, B, and C" means "any one of A, B, C, A and B, A and C, B and C, and A, B, and C", and for another example, "A, B or C" or "A, B and / or C" means "any one of A, B, C, A and B, A and C, B and C, A, B, and C". An exception to this definition occurs only when the combination of elements, functions, steps, or operations is inherently mutually exclusive in a particular form.

[0018] Although each step of the flowchart in the embodiments of the present application is shown in order as indicated by the arrows, it should be understood that these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise clearly described in this specification, the execution of these steps has no strict order restriction and may be executed in other orders. Also, at least some of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time and may be executed at different times. The order of their execution is not necessarily sequential and may be executed alternately or in alternation with at least a part of other steps or sub-steps or stages of other steps.

[0019] Depending on the context, the words "if", "when" used here can be interpreted as "in the case of...", "when...", "in response to a decision", or "in response to a detection". Similarly, depending on the context, the phrase "if a decision" or "if a detection (of the stated condition or event)" can be interpreted as "when making a decision", "in response to making a decision", "when detecting (the stated condition or event)", or "in response to detecting (the stated condition or event)".

[0020] In one embodiment, in this specification, step numbers such as S10, S100, etc. are adopted. The purpose is to express the corresponding content more clearly and concisely and does not substantially limit the order.

[0021] It should be understood that the specific embodiments described here are only used to interpret the present application and do not limit the present application.

[0022] In the following description, suffixes such as "module", "component", or "unit" for indicating elements are only for facilitating the description of the present application and have no specific meaning in themselves. Therefore, "module", "component", or "unit" can be used interchangeably.

[0023] In this application, communication equipment may be terminal equipment, base station equipment, etc., and the specific type must be determined according to the context. If it is terminal equipment, it can be implemented in various forms. For example, the terminal equipment described in this application may include mobile phones, tablet personal computers, notebook computers, palmtop computers, personal digital assistants (PDAs), portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, and other terminal equipment, as well as base stations, digital TVs, desktop computers, and other fixed terminals.

[0024] In the subsequent explanation, terminal equipment will be used as an example, and those skilled in the art will understand that the structure according to the embodiments of the present invention can also be applied to fixed terminals, with the exception of elements used for mobile purposes.

[0025] As referenced in Figure 1, Figure 1 is a schematic diagram of the hardware structure of a terminal device that implements each embodiment of the present invention, and the terminal device 100 may include components such as an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. As will be understood by those skilled in the art, the structure of the terminal device shown in Figure 1 is not limiting to the terminal device, and the terminal device may include more or fewer components than shown, combine some components, or arrange different components.

[0026] The components of the terminal device will be described in detail below with reference to Figure 1.

[0027] The radio frequency unit 101 can be used to receive and transmit signals during information transmission or communication, specifically by receiving downlink information from a base station and transmitting it to a processor 110 for processing, and also by transmitting uplink data to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, and a duplexer. In one embodiment, the radio frequency unit 101 can also communicate with other devices via wireless communication and a network. The above wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), and 5G.

[0028] WiFi belongs to the category of short-range wireless transmission technology, and terminal device 100, via a WiFi module 102, can assist users in sending and receiving emails, browsing web pages, accessing streaming media, and providing users with access to the wireless broadband internet. Figure 1 shows the WiFi module 102, but it is understood that it is not an essential component of the terminal device and can be omitted as needed without altering the essence of the invention.

[0029] The audio output unit 103 can convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output sound when the terminal device 100 is in a mode such as call signal reception mode, call mode, recording mode, voice recognition mode, or broadcast reception mode. The audio output unit 103 can also provide audio output related to specific functions performed by the terminal device 100 (e.g., call signal reception sound, message reception sound, etc.). The audio output unit 103 may include a speaker and a buzzer, etc.

[0030] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may also include a graphics processing unit (GPU) 1041 and a microphone 1042. The graphics processing unit 1041 processes still images or video image data acquired by an image capture device (e.g., a camera) in video capture mode or image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the graphics processing unit 1041 may be stored in memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) in operating modes such as telephone call mode, recording mode, and voice recognition mode, and can process such sound into audio data. The processed audio (voice) data can be converted to a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 and output in telephone call mode. The microphone 1042 can eliminate (or suppress) noise or interference that occurs during the transmission and reception of audio signals by implementing various types of noise reduction (or suppression) algorithms.

[0031] The terminal device 100 further includes at least one type of sensor 105, such as an optical sensor, a motion sensor, and other sensors. In one embodiment, the optical sensor includes an ambient light sensor and a proximity sensor, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or backlight when the terminal device 100 is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (usually 3 axes), can detect the magnitude and direction of gravity when stationary, and can be used in applications that recognize the orientation of the mobile phone (e.g., horizontal / vertical screen switching, related games, magnetometer orientation calibration), vibration recognition related functions (e.g., pedometer, tap), etc. Further details of other sensors that can be placed on the mobile phone, such as a fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, and infrared sensor, are omitted here.

[0032] The display unit 106 is used to display information entered by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0033] The user input unit 107 can receive input numerical or character information and generate input key signals related to user settings and function control of the terminal device. In one embodiment, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also called a touchscreen, can collect user touch operations on or near it (for example, operations performed by the user on or near the touch panel 1071 with any suitable object or accessory such as a finger or stylus) and drive corresponding connected devices according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. In one embodiment, the touch detection device detects the direction of the user's touch, detects the signal from the touch operation, transmits the signal to the touch controller, the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, then transmits it to the processor 110, and can receive and execute instructions transmitted from the processor 110. In one embodiment, the touch panel 1071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. In one embodiment, the other input devices 1072 may include, but are not limited to, one or more of the following: a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick.

[0034] In one embodiment, the touch panel 1071 can cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. The processor 110 then provides the display panel 1061 with a corresponding visual output according to the type of touch event. In Figure 1, the touch panel 1071 and the display panel 1061 function as two independent components, realizing the input and output functions of the terminal device. However, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to realize the input and output functions of the terminal device, and are not limited thereto.

[0035] The interface unit 108 is used as an interface that allows at least one external device to be connected to the terminal device 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having a recognition module, an audio input / output (I / O) port, a video I / O port, a headphone port, and the like. The interface unit 108 can be used to receive input from the external device (e.g., data information, power, etc.) and transmit the received input to one or more elements within the terminal device 100, or to transmit data between the terminal device 100 and the external device.

[0036] Memory 109 can be used to store software programs and various data. Memory 109 may mainly include a program storage area and a data storage area. In one embodiment, the program storage area can store an operating system, application programs necessary for at least one function (e.g., sound playback function, image playback function, etc.), and the data storage area can store data created in accordance with the use of the mobile phone (e.g., audio data, phone book, etc.). In one embodiment, memory 109 may also include a high-speed random access memory, and may further include, for example, at least one disk storage device, a non-volatile memory such as a flash memory device, or other volatile solid-state storage device.

[0037] The processor 110 is the control center of the terminal device 100, connecting all parts of the terminal device 100 using various interfaces and lines, operating or executing software programs and / or modules stored in memory 109, retrieving data stored in memory 109 to perform various functions of the terminal device 100, processing data, and thereby monitoring the entire terminal device 100. The processor 110 may include one or more processing units, preferably integrating an application processor and a modem processor, where the application processor mainly handles the operating system, user interface, and application programs, and the modem processor mainly handles wireless communication. It can be understood that the above modem processor does not have to be integrated into the processor 110.

[0038] The terminal device 100 may further include a power supply 111 (e.g., a battery) that supplies power to each component. Preferably, the power supply 111 can be logically connected to the processor 110 via a power management system, thereby enabling functions such as charge / discharge management and power consumption management by the power management system.

[0039] Although not shown in Figure 1, terminal device 100 may further include a Bluetooth® module and the like, but a detailed explanation is omitted here.

[0040] To facilitate understanding of the embodiments of this application, the communication network system on which the terminal equipment of this application is based will be described below.

[0041] As shown in Figure 2, Figure 2 is an architecture diagram of a communication network system according to an embodiment of the present invention, the communication network system is an LTE system of general-purpose mobile communication technology, and the LTE system includes, in order, a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and a carrier's IP service 204, all of which are connected to each other.

[0042] In one embodiment, UE201 may be the terminal device 100 described above, and a detailed explanation is omitted here.

[0043] E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. In one embodiment, eNodeB2021 can connect to other eNodeB2022 via backhaul (e.g., X2 interface), eNodeB2021 is connected to EPC203, and eNodeB2021 can provide access to EPC203 from UE201.

[0044] EPC203 may include MME (Mobility Management Entity)2031, HSS (Home Subscriber Server)2032, other MME2033, SGW (Serving Gateway)2034, PGW (PDN Gateway)2035, and PCRF (Policy and Charging Rules Function)2036, etc. In one embodiment, MME2031 is a control node that handles signaling between UE201 and EPC203 and provides bearer and connection management. HSS2032 is used to provide several registers that manage functions such as a home location register (not shown) and stores user-specific information such as several related service features and data rates. All user data can be transmitted by SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, and PCRF2036 is a policy decision point for policy and billing control of service data streams and IP bearer resources, and selects and provides available policy and billing control decisions to the policy and billing execution function unit (not shown).

[0045] IP service 204 may include the Internet, intranet, IMS (IP Multimedia Subsystem), or other IP services.

[0046] Although the above explanation has used the LTE system as an example, those skilled in the art should recognize that this application is applicable not only to the LTE system but also to other wireless communication systems such as GSM, CDMA2000, WCDMA®, TD-SCDMA, and future new network systems (e.g., 5G), and is not limited thereto.

[0047] Based on the hardware structure of the terminal equipment and the communication network system described above, each embodiment of the present invention is provided.

[0048] The main solution of the embodiment of the present invention is to establish a real-time state machine model for the sensing target and determine the environmental state of the sensing target based on the real-time state machine model. This overcomes the problem of wireless sensing using a real-time modeling state machine in a complex multipath environment, where there is the influence of multipath in complex environments such as indoors or in urban areas, and where the number of receiver antennas is small or the bandwidth is small, thereby improving the accuracy of wireless sensing in a complex multipath environment.

[0049] The embodiments of this application take into account that, in conventional related means, actual wireless system equipment comes in various forms, such as those with large antennas, those with only four antennas, those with good synchronization, those with poor synchronization, those with large bandwidth, and those with small bandwidth. When the number of antennas is relatively small, it is very difficult to improve the accuracy of angle measurement, and when the bandwidth is small, it is very difficult to improve the accuracy of distance measurement. Therefore, in complex multipath environments, especially when the number of antennas is small and the bandwidth is small, conventional sensing methods using TOA (Time of Arrival) and AOA (Angle of Arrival) measurements cannot meet the requirements.

[0050] Accordingly, the embodiment of the present invention provides a wireless sensing method using a real-time modeling state machine in a complex multipath environment, overcoming the problems of multipath effects in complex environments such as indoors and urban areas, as well as the challenges of achieving wireless sensing when the number of receiver antennas is small or the bandwidth is small, thereby improving the accuracy of wireless sensing in complex environments.

[0051] Specifically, as shown in Figure 3, Figure 3 is a flowchart of the first embodiment of the wireless sensing method in the present application.

[0052] As shown in Figure 3, the first embodiment of the present invention provides a wireless sensing method, which includes S10 to S20.

[0053] S10: Establish a real-time state machine model for the sensing target.

[0054] Specifically, the system architecture relating to the means of this embodiment includes a sensing signal transmitting base station and a sensing signal receiving base station.

[0055] Sensing signals are transmitted by a sensing signal transmitting base station and received by a sensing signal receiving base station.

[0056] A specific scenario for this embodiment can be seen in Figure 4.

[0057] As shown in Figure 4, the sensing signal transmitting base station (RS) transmits signals at a set time T n The sensing signal S is transmitted over the wireless resource, and the sensing signal receiving base station (Br) receives the sensing signal. The sensing signal transmitted by the sensing signal transmitting base station is transmitted to various environmental objects P in the scenario. n (P1,P2...,P n It can be reflected by (,) and projected to the sensing signal receiving base station.

[0058] By collecting sensing signals from each receiving antenna of a sensing signal receiving base station, the channel impact response of the receiving antenna at different times is obtained, real-time sensing modeling is performed on the sensing target using a state machine, the switching method of the state machine is obtained, and the real-time state machine model is updated.

[0059] S20: Based on the real-time state machine model, the environmental state of the sensing target is determined.

[0060] In one embodiment, real-time modeling information of the state machine is extracted from the real-time state machine model. Based on the real-time modeling information of the state machine, the state type of the sensing target is determined. Based on the state type of the sensing target, the environmental state of the sensing target is determined.

[0061] In one embodiment, the state type of the sensing target is: The object being sensed is currently in an unstable state. The sensing target is currently stable, and there has been a change from the previous stable state, and The sensing target may include at least one of the following conditions: it is currently stable and has not changed from its previous stable state.

[0062] The environmental state of the sensing target can be determined based on different state types of the sensing target.

[0063] In one embodiment, the environmental state of the object to be sensed may include whether or not the object to be sensed has moving objects, and whether or not there are rules, as well as the changes in the moving objects in the environment.

[0064] In one embodiment, sensing modeling can be performed on the sensing target based on a state machine, real-time modeling information of the state machine can be extracted from the real-time state machine model based on the real-time state machine model, and the state type of the sensing target can be determined based on the real-time modeling information of the state machine.

[0065] In one embodiment, for a sensing target in an unstable state, difference information is calculated between the channel shock response of the receiving antenna at different times and the current state of the state machine, and the environmental state change rule for the sensing target is determined according to the difference information.

[0066] This embodiment overcomes the problem of multipath effects in complex environments such as indoors and urban areas, as well as the inability to effectively realize wireless sensing when the number of receiver antennas is small or the bandwidth is small, by performing sensing modeling on the sensing target based on a state machine using the above means, extracting real-time modeling information of the state machine from the real-time state machine model, determining the state type of the sensing target based on the real-time modeling information of the state machine, and determining the environmental state of the sensing target based on the state type. This improves the accuracy of wireless sensing in complex multipath environments.

[0067] As shown in Figure 5, a second embodiment of the present invention provides a wireless sensing method, and in an embodiment of the wireless sensing method based on the embodiment shown in Figure 3, step S10, which establishes a real-time state machine model for the sensing target, includes step S101.

[0068] Step S101: The state machine performs real-time sensing modeling on the sensing target, obtains the state machine switching method, and updates the real-time state machine model.

[0069] Specifically, it collects the sensing signal from the antenna, Based on the sensing signal of the antenna, the channel shock response of the antenna is acquired. Based on the channel shock response of the antenna and the current state machine information, the switching method of the state machine is obtained and the real-time state machine model is updated.

[0070] In one embodiment, the current information of the state machine may include the current state of the state machine, temporary states, and timer information.

[0071] Step S20, which determines the environmental state of the object to be sensed based on the real-time state machine model, includes steps S201 to S203.

[0072] S201: Extract real-time modeling information of the state machine from the real-time state machine model.

[0073] In one embodiment, the real-time modeling information of the state machine is State machine history switching record, The current state of the state machine, Temporary states of a state machine, and It contains at least one of the state machine's timer information.

[0074] S202: Based on the real-time modeling information of the state machine, the state type of the sensing target is determined.

[0075] In one embodiment, the state type of the sensing target is: The object being sensed is currently in an unstable state. The sensing target is currently stable, and there has been a change from the previous stable state, and The sensing target must be stable in its current state and must not have changed from its previous stable state, at least one of the following:

[0076] S203: Based on the state type of the sensing target, the environmental state of the sensing target is determined.

[0077] For a sensing target in an unstable state, the difference information between the antenna's channel shock response at different time points and the current state of the state machine is calculated. Based on the aforementioned difference information, the rules governing the change in the environmental state of the sensing target are determined.

[0078] Specifically, a concrete scenario of this embodiment can be seen in Figure 4.

[0079] As shown in Figure 4, the sensing signal transmitting base station (RS) transmits signals at a set time T n The sensing signal S is transmitted over the wireless resource, and the sensing signal receiving base station (Br) receives the sensing signal. The sensing signal transmitted by the sensing signal transmitting base station is transmitted to various environmental objects P in the scenario. n (P1,P2...,P n It can be reflected by (,) and projected to the sensing signal receiving base station.

[0080] By collecting sensing signals from each receiving antenna of the sensing signal receiving base station, the channel impact response of the receiving antenna at different time points is obtained. Sensing modeling is then performed on the sensing target based on a state machine, and the state type of the sensing target is determined.

[0081] In this embodiment, the state machine may be located at a base station or at a server, and this embodiment is not particularly limited to this configuration.

[0082] A sensing target refers to a specific environment, such as a room, a parking lot, or a mountainous area (for example, a particular mountain).

[0083] A state machine has sensing calculation capabilities, represents the switching relationships between each stable state, and, regarding state and maintenance state jump relationships, its inputs are sensing signals and its outputs are state switching status. A timer is set in the state machine, and the state machine information includes state machine switching information (also called history switching records), the current state, temporary states, and timer information. The state machine switching information includes, but is not limited to, time, number, and state before and after the switch.

[0084] There may be one or more state machines, and the layout diagram thereof can be referred to FIG. 6. The real-time update process of the state machine is a real-time modeling process. One receiving base station may correspond to one or more state machines, and one receiving antenna may correspond to one state machine or multiple state machines. In this embodiment, this is not limited.

[0085] Specifically, the sensing signal receiving base station receives the sensing signal, samples the sensing signal of each receiving antenna, and according to the sampling signal, obtains the channel impulse response vector R m,n (t) of each receiving antenna at the corresponding time, where m , n is the number of elements in the antenna array, m ∈ [0, M - 1], n ∈ [0, N - 1], M and N are both integers greater than 1, and t is time.

[0086] As shown in FIG. 6, the state machine set is S(K), and the initial state S(0) of the state machine is set to R m,n (t) which is the current channel impulse response vector. K is the number of the total number of states, K is an integer, S’ is a temporary state of the state machine, K’ is the number of the current state, and K’ is an integer.

[0087] In the initial state, the initial state S(0) is the current state, the initial value of K is 0, the temporary state S’ = S(0), K’ = K, and record the presence or absence of the state machine switching, which is the switching information of the state machine at the current time, and if there is a switch, from which state to which state it is switched. The switching information of the state machine includes, but is not limited to, time, number, and the states before and after the switch.

[0088] The state of the state machine corresponds to one stable radio propagation environment, and the value of each state stores the channel impulse response value of one stable receiving antenna in association.

[0089] Transient states in a state machine are introduced to find another stable state after the current stable state, and when an environmental change is detected, the value of the transient state changes to the new channel impact response value of the receiving antenna.

[0090] Initially, Timer C is set to 0, and timing begins.

[0091] The state types of the sensing target may include the following types:

[0092] Type 1: The sensing target is currently in an unstable state. For example, the state of the sensing target is determined to be constantly changing based on the state machine's recorded information, and is therefore unstable in its current state. Examples of such scenarios include landslides, constant talking and walking around in a conference room, and cars driving back and forth in a parking lot.

[0093] Type 2: The sensing target is currently stable, and there has been a change from the previous stable state. As shown in Figure 7, Figure 7 is a state machine switching diagram showing the room transitioning from unoccupied to occupied and then to unoccupied again.

[0094] For example, a conference room goes from an unoccupied scenario with no meetings (S0) to an occupied scenario with meetings (S1), then from the occupied scenario with meetings (S1) to an unoccupied scenario after the meetings have ended (S2), where S' is a temporary state of the state machine.

[0095] In the case of a state machine, comparing the two states S2 and S1 of the state machine, both are stable states. However, because the tables and chairs in the conference room may change before and after a meeting, the two states S2 and S1 of the state machine are different. The conference room is stable in the current state S2, and there has been a change from the previous stable state S1. This allows us to track all state machines and their switching times, and extract state information for each state machine.

[0096] Type 3: The sensing target is currently stable and has not changed since the last stable state; in other words, the environment remains stable and unchanged.

[0097] In one embodiment, a state machine can be used to perform real-time sensing modeling on the sensing target, real-time modeling information of the state machine can be extracted from the real-time state machine model, the state type of the sensing target can be determined based on the real-time modeling information of the state machine, and then the environmental state of the sensing target can be determined based on the state type of the sensing target.

[0098] In one embodiment, the real-time modeling information of the state machine is State machine switching information, For example, the current state of a state machine, such as the stable state of a conference room before someone enters. Temporary states of a state machine that can be used to find a stable state, and It may include at least one of the state machine's timer information.

[0099] In the above method, the means for determining the state type of the sensing target according to the real-time modeling information of the state machine can be determined after S1 and S1.

[0100] An example scenario is as follows:

[0101] Scenario 1: If Timer C is less than a predetermined time threshold of 1, it is determined that someone has entered the room and is moving. The system determines whether or not there is an environmental change in the scenario, and based on the transformation of the room's state machine, it determines that someone enters and then leaves the room, and that an environmental change occurs, as shown in Figure 7.

[0102] Scenario 2: In the mountain scenario, the state of the landslide is determined, and depending on the state before the landslide, if the state machine's timer C is less than a predetermined time threshold 1, it is determined that there is a risk, and if the state machine can switch to another stable state, it is determined that the landslide is complete.

[0103] For a sensing target in an unstable state, the system calculates difference information between the antenna's channel shock response at different times and the current state of the state machine, and determines the environmental state change rule for the sensing target based on this difference information.

[0104] This embodiment primarily senses and determines the rules governing changes in the environmental state of the sensing target, which is in an unstable state.

[0105] In one embodiment, for a sensing target in an unstable state, the channel shock response of the receiving antenna at different times and the current state corresponding to the state machine are obtained, and difference information between the channel shock response of the receiving antenna at different times and the current state corresponding to the state machine is calculated.

[0106] Specifically, for the current time, the channel shock response of the receiving antenna at the current time and the current state corresponding to the state machine are obtained, and the difference information between the channel shock response of the receiving antenna at the current time and the current state corresponding to the state machine is calculated, as shown in Figure 8.

[0107] Obtain the signal information after processing. Δ m,n (t)=R m,n (t)-S(k') Δ m,n (t) is the channel shock response R of the receiving antenna at the current time t. m,n This is the difference information between (t) and the current state S(K') corresponding to the state machine.

[0108] Subsequently, the channel shock response at the next time point is received, and the above process is repeated to obtain difference information between the channel shock response of the receiving antenna at different time points and the current state corresponding to the state machine, and further each Δ m,n (t) is analyzed to obtain signal characteristics such as periodic information, and real-time changing signal information is analyzed thereto to obtain the rules for the change in the environmental state of the sensing target.

[0109] In one embodiment, the difference information is analyzed, and the difference signal features in the difference information are extracted, and the difference signal features include, but are not limited to, phase, amplitude, and time period. A state change curve is drawn according to the difference signal characteristics. The rule governing the change in the environmental state of the sensing target is determined according to the state change curve.

[0110] An example scenario is as follows: For instance, the breathing signals of people in a room are sensed, the sensed breathing signals are analyzed to obtain breathing rules for people in the room, and further, rules for changes in the state when people are in the room are obtained. The rules for changes in the environment state after differential signal processing can be seen in Figure 9.

[0111] Furthermore, for example, after turning on the power to the machinery inside the factory building, sensing analysis can be performed on the sound signals of the machinery inside the factory building to determine whether there is a pattern in the machinery's operation or sound, and the results of this determination can be obtained using the method described above.

[0112] This establishes a real-time state machine model for the sensing target, determines the environmental state of the sensing target based on the real-time state machine model, specifically collects the sensing signal from the antenna, obtains the channel shock response of the antenna based on the sensing signal from the antenna, obtains the switching method of the state machine based on the channel shock response of the antenna and the current information of the state machine (current state, temporary state, timer information), updates the real-time state machine model, extracts real-time modeling information of the state machine from the real-time state machine model, and determines the sensing based on the real-time modeling information of the state machine The method determines the state type of the sensing target, determines the environmental state of the sensing target based on the state type of the sensing target, calculates difference information between the channel shock response of the receiving antenna at different times and the current state corresponding to the state machine for the sensing target in an unstable state, and analyzes the difference information to obtain rules for the change in the environmental state of the sensing target. This overcomes the problem of wireless sensing in complex multipath environments, such as indoors or in urban areas, where multipath effects are present, and where the number of receiver antennas is small or the bandwidth is small, thereby improving the accuracy of wireless sensing in complex multipath environments.

[0113] More specifically, the following describes in detail the specific means by which a state machine is used to perform real-time sensing modeling on the sensing target, real-time modeling information of the state machine is extracted from the real-time state machine model, and the state type of the sensing target is determined based on the real-time modeling information of the state machine.

[0114] Using the scenario shown in Figure 4 as an example, the sensing signal transmitting base station (RS) will perform the following actions for a set time T. nThe sensing signal S is transmitted over the wireless resource, and the sensing signal receiving base station (Br) receives the sensing signal. The sensing signal transmitted by the sensing signal transmitting base station is transmitted to various environmental objects P in the scenario. n (P1,P2...,P n It can be reflected by (,) and projected to the sensing signal receiving base station.

[0115] By collecting sensing signals from each receiving antenna of the sensing signal receiving base station, the channel impact response of the receiving antenna at different times is obtained, and sensing modeling is performed on the sensing target based on a state machine (abbreviated as state machine in the specific embodiments below) to determine the state type of the sensing target.

[0116] Specifically, the sensing signal receiving base station receives the sensing signal, samples the sensing signal from each receiving antenna, and, according to the sampled signal, calculates the channel shock response vector R of each receiving antenna at the corresponding time. m,n (t) is obtained, where m and n are the element numbers in the antenna array, m ∈ [0, M-1] and n ∈ [0, N-1], M and N are both integers greater than 1, and t is time.

[0117] As shown in Figure 6, the state machine set is S(K), and the initial state of the state machine S(0) is the current channel shock response vector R m,n Set to (t). K is the number of the total number of states, K is an integer, S' is a temporary state of the state machine, K' is the number of the current state, K' is an integer.

[0118] In the initial state, the initial state S(0) is the current state, the initial value of K is 0, and temporary states S'=S(0) and K'=K are recorded. State machine switching information at the current time is recorded as whether or not a state machine has switched, and if so, which state is being switched from to which state. State machine switching information includes, but is not limited to, the time, number, and the state before and after the switch.

[0119] The state of the state machine corresponds to a single stable radio propagation environment, and the value of each state is stored in association with the channel shock response value of a single stable receiving antenna.

[0120] Transient states in a state machine are introduced to find another stable state after the current stable state, and when an environmental change is detected, the value of the transient state changes to the new channel impact response value of the receiving antenna.

[0121] Initially, Timer C is set to 0 and starts counting. Timer C has a set timeout period. When the timeout period is reached and the switching condition is met, the state machine performs a switching operation. Also, regardless of whether the timer's timeout period is reached, if the clear condition is met, the timer performs a clear operation. The specific operation of the timer varies depending on the scenario, and the timer will be explained in detail later for each different switching type of the state machine.

[0122] In one embodiment, the steps of performing real-time sensing modeling on the sensing target using a state machine, obtaining the switching method of the state machine, and updating the real-time state machine model are as follows: The steps include: collecting the sensing signal from the antenna, The steps include obtaining the channel shock response of the antenna based on the sensing signal of the antenna, The process includes the steps of obtaining the switching method of the state machine and updating the real-time state machine model based on the channel shock response of the antenna and the current information of the state machine (current state, temporary state, timer information).

[0123] In one embodiment, the step of obtaining the switching method of the state machine based on the channel shock response of the antenna and the current information of the state machine is: The steps include recording the current state, temporary state, and timer information of the state machine, The method includes the step of obtaining a switching method for the state machine based on the channel shock response of the antenna and the current state, temporary state, and timer information of the state machine.

[0124] Taking the current time as an example, the sensing signal receiving base station receives the sensing signal, samples the sensing signal from each receiving antenna, and, based on the sensing signal from the receiving antenna, determines the channel shock response R of the receiving antenna at the current time. m,n Get (t).

[0125] Subsequently, the current state, temporary state, and timer information of the state machine at the current time are recorded. Based on the channel shock response of the receiving antenna at the current time and the current state, temporary state, and timer information of the state machine at the current time, the switching method of the state machine at the current time is determined. In one embodiment, the state of the state machine is updated in real time based on the state machine switching method at the current time.

[0126] In other words, the channel shock response R of the receiving antenna at the current time. m,n (t) The switching method of the sensing state machine is determined according to the current state (S(K')), temporary state (S'(K')), and timer C, and the corresponding operation (e.g., no switching, switching to a new state, or switching to the previous existing state) is performed to complete the real-time modeling of the sensing state machine at the current time. The real-time update process of the state machine is a real-time modeling process.

[0127] Subsequently, the state type of the sensing target can be determined based on the state update change of the state machine and the current count of the timer.

[0128] In one embodiment, the step of determining the state type of the sensing target based on the real-time modeling information of the state machine is: The step may include determining the state type of the sensing target based on the state machine's history switching record, current state, temporary state, and timer information.

[0129] In one embodiment, the step of updating the real-time state machine model is: The procedure includes the step of performing an update operation on the real-time state machine model based on the state machine switching method.

[0130] In one embodiment, the step of performing an operation on the real-time state machine model based on the state machine switching method is: In accordance with the state machine maintaining its current state, if the channel shock response of the antenna at the current time and the transient state of the state machine at the current time are not similar, the transient state of the state machine is updated to the channel shock response of the antenna at the current time, and the timer is cleared. In accordance with the state machine maintaining its current state, if the channel shock response of the antenna at the current time and the transient state of the state machine at the current time are similar, the timer count is maintained. In response to the state machine being switched to an existing state in the history, the steps include: performing a state machine switching operation; changing the temporary state and current state number of the state machine to the state and number with the greatest similarity to the corresponding state in the existing state machine; not clearing the timer; and recording the state machine switching information. The process includes at least one of the following steps in response to the state machine being switched to a new state: performing a new state generation operation and a switching operation for the state machine, not clearing the timer, and recording the state machine switching information.

[0131] In one embodiment, the method further includes the step of saving the current state of the state machine.

[0132] In one embodiment, the state type of the sensing target is: The object being sensed is currently in an unstable state. The sensing target is currently stable, and there has been a change from the previous stable state, and The sensing target must be stable in its current state and must not have changed from its previous stable state, at least one of the following:

[0133] Specifically, the types of states to be sensed include the following types:

[0134] Type 1: The sensing target is currently in an unstable state. For example, the state of the sensing target is determined to be constantly changing based on the state machine's recorded information, and is therefore unstable in its current state. Examples of such scenarios include landslides, constant talking and walking around in a conference room, and cars driving back and forth in a parking lot.

[0135] Type 2: The sensing target is currently stable, and there has been a change from the previous stable state. For example, a conference room changes from an unoccupied scenario with no meetings to an occupied scenario with meetings (S1), and then from an occupied scenario with meetings (S1) to an unoccupied scenario after meetings (S2). In the case of a state machine, comparing the two states S2 and S1 of the state machine, both are stable states, but because the tables and chairs in the conference room may change before and after a meeting, the two states S2 and S1 of the state machine are different. The conference room is currently stable in state S2, and there has been a change from the previous stable state S1. As a result, all state machines and their transition times can be tracked, and state information of the state machines can be extracted.

[0136] Type 3: The sensing target is currently stable and has not changed since the last stable state; in other words, the environment remains stable and unchanged.

[0137] This allows us to collect sensing signals from each receiving antenna of a sensing signal receiving base station, obtain the channel impact response of the receiving antenna at different times, perform sensing modeling on the sensing target based on a state machine, and determine the state type of the sensing target.

[0138] In one embodiment, the switching method of the state machine is: Maintaining the current state, Switching to an existing state in the history (switching to a similar state), and This includes at least one of switching to a new state.

[0139] In one embodiment, before the step of acquiring the state machine switching method, The further step includes determining the switching method for the state machine.

[0140] In one embodiment, the method by which the state machine decides to maintain the current state is: The timer count must not exceed the set time threshold. The channel shock response of the antenna at the current time and the transient state of the state machine at the current time are not similar, the timer is cleared, and The channel shock response of the antenna at the current time and the transient state of the state machine at the current time are similar, and the timer includes at least one of the following: maintaining a count.

[0141] In one embodiment, the method by which the state machine decides to switch to an existing state in the history is: The timer count exceeds the set time threshold. The channel shock response of the antenna at the current time and the transient state of the state machine at the current time are similar, and the transient state and the current state are not similar. Traverse all states in the saved state machine, compare the similarity between the temporary state and each current state in the saved state machine, and determine if there are situations in all saved states that are similar to the temporary state. The temporary state and current state number will be changed to the state and number with the highest similarity in the existing state machine, and The timer must include at least one of the following: not clearing it.

[0142] In one embodiment, the method by which the state machine decides to switch to a new state is: The timer count exceeds the set time threshold. The channel impact response of the receiving antenna at the current time and the transient state of the state machine at the current time are similar, and the transient state is not similar to any of the states in the stored state machine, the state machine generates a new state and switches to the new state, and The timer must include at least one of the following: not clearing it.

[0143] The following describes in detail the three types of switching methods used in state machines.

[0144] First switching method: Maintain the current state and do not switch.

[0145] The following method is used to determine whether to maintain the current state and not switch the state machine at the current time.

[0146] If it is determined that the count value of timer C does not exceed the set time threshold 1 according to the timer information, the channel shock response R of the receiving antenna at the current time is determined. m,nDetermine whether (t) and the temporary state S' of the state machine at the current time are similar. The channel shock response R of the receiving antenna at the current time m,n If (t) and the transient state S' of the state machine at the current time are not similar, then the transient state S' is determined by the channel shock response R of the receiving antenna at the current time. m,n (t) is updated, and timer C is cleared, and the state machine at the current time maintains its current state without switching. The channel shock response R of the receiving antenna at the current time m,n If (t) and the temporary state S' of the state machine at the current time are similar, the timer C continues to maintain its count, and the state machine at the current time maintains its current state and does not switch.

[0147] Second switching method: Switch to an existing state in the history or to a similar state.

[0148] The following method is used to determine whether to switch to an existing state in the history or a similar state as the switching method for the state machine at the current time.

[0149] When it is determined that the count value of timer C exceeds the set time threshold 1 according to the timer information, the channel shock response R of the receiving antenna at the current time is determined. m,n Determine whether (t) and the temporary state S' of the state machine at the current time are similar, and whether the temporary state S' and the current state S are similar. The channel shock response R of the receiving antenna at the current time m,n If (t) and the temporary state S' of the state machine at the current time are similar, and the temporary state S' and the current state S are not similar, then traverse all current states S(K) in the saved state machine and compare the similarity between the temporary state S' and each current state S(i), and if i ≤ K, If all saved current states S(K) have a situation similar to a temporary state S', the state machine is determined to switch to an existing state in the history as the switching method at the current time, and the temporary state and the current state number are assigned to the state with the highest similarity in the existing state machine and number i. max This is changed to S'(K')=S(i max ), K'=i max And, The timer is not cleared, and the state machine switching information is recorded.

[0150] Third switching method: Switch to a new state.

[0151] The following method is used to determine whether to switch to a new state as the switching method for the state machine at the current time.

[0152] When it is determined that the count value of timer C exceeds the set time threshold 1 according to the timer information, the channel shock response R of the receiving antenna at the current time is determined. m,n Determine whether (t) is similar to the temporary state S' of the state machine at the current time, and whether the temporary state S' is similar to all the current states S(K) in the saved state machine. The channel shock response R of the receiving antenna at the current time m,n If (t) is similar to the temporary state S' of the state machine at the current time, and the temporary state S' is not similar to all the current states S(K) in the stored state machine, then it is decided to generate a new state and switch to the new state as the switching method for the state machine at the current time, that is, to update the state number to K=K+1, update the new state S(K) in the state set to S(K)=S', so that the current state and the temporary state coincide, S'=S(K), K'=K.

[0153] The timer is not cleared, and the state machine switching information is recorded.

[0154] In one embodiment, the above means includes the step of determining whether the channel shock response of the receiving antenna at the current time and the transient state of the state machine at the current time are similar, A step of calculating the similarity between the channel shock response of the receiving antenna at the current time and the transient state of the state machine at the current time, If the similarity does not exceed a predetermined similarity threshold, the step of determining that the channel impact response of the receiving antenna at the current time and the transient state of the state machine at the current time are not similar, Otherwise, the method may include the step of determining that the channel shock response of the receiving antenna at the current time is similar to the transient state of the state machine at the current time.

[0155] Calculating the similarity between the channel impact response of the receiving antenna at the current time and the transient state of the state machine at the current time includes, but is not limited to, employing the following means.

[0156] 1. Channel shock response R of the receiving antenna at the current time m,n The correlation value between (t) and the temporary state S' of the state machine at the current time is calculated, and the maximum correlation peak is used as the similarity comparison quantity. 2. Channel shock response R of the receiving antenna at the current time m,n The included angle between (t) and the temporary state S' of the state machine at the current time is calculated, and the cosine of the included angle is used as the similarity comparison quantity.

[0157] The determination of whether the states are similar or not includes setting a similarity threshold of 2, and determining that they are similar if the similarity exceeds the predetermined similarity threshold of 2, and conversely, determining that they are not similar.

[0158] Based on the above means, all state machine switching information can be tracked and state information can be extracted as needed. This includes, but is not limited to, the following:

[0159] In indoor scenarios, states with little change within a time threshold can be extracted as unoccupied states.

[0160] In a typical scenario, the switching information of state machines arranged over a day can be extracted as a daytime scenario change, and by analyzing the rules, different environment state change rules can be obtained. As shown in Figure 10, Figure 10 is a daytime channel model change diagram for a room.

[0161] The specific embodiments of this model will be described in more detail below with reference to different scenarios.

[0162] Scenario 1 When the room status changes from unoccupied to occupied and then back to unoccupied, the state changes are shown in Figure 7. The specific implementation process is as follows.

[0163] A synchronized sensing signal transmitting base station transmits sensing signals over a set time and on radio resources, and the sensing signals are received by the base station. Each antenna sensing signal is sampled, and the channel shock response vector R of each receiving antenna is calculated according to the sampled signal. m,n (t) is obtained, the initial state S(0) is set, the temporary state S'=S(0) and K'=K is set, the timer is set to 0 and timing is started, at which point the state is S(0), as shown in Figure 7.

[0164] R m,n If (t) and S' are not similar, then C=0, meaning the condition is cleared; otherwise, C is not cleared.

[0165] The time threshold 1 of Timer C is compared, and if it exceeds the set state threshold 1 of Timer C, and the temporary state S' is not similar to all states S(K) in the stored state machine, a new state is generated. That is, the state number is updated to K=0+1, the new state S(K) in the state set is updated to S(1)=S', the current state and the temporary state match, S'=S(1), K'=1, that is, the room is in state S(0), and finally becomes the unoccupied stable state S(1).

[0166] Similarly, as shown in Figure 7, the state changes from S(1) to S(2), the state number is updated to K=1+1, the new state S(K) in the state set is updated to S(2)=S', the current state and the temporary state coincide, S'=S(2), and K'=2, meaning the room is in the stable state S(1), then someone enters the room and moves around, the state is temporary, S' continues to change, and finally it becomes the unoccupied stable state S(2).

[0167] Scenario 2 When someone in the room monitors the patient's respiration, the changes in their condition are shown in Figure 9. The specific implementation process is as follows:

[0168] A synchronized sensing signal transmitting base station transmits sensing signals over a set time and on radio resources, and a sensing signal receiving base station receives the sensing signals. Each antenna samples the sensing signal, and according to the sampled signal, the channel shock response vector R of each antenna is calculated. m,n (t) is obtained, the initial state S(0) is set, the temporary state S'=S(0) and K'=K, and timer C starts counting from 0, at which point it is in state S(0).

[0169] R m,n If (t) and S' are not similar, then C=0, meaning the condition is cleared; otherwise, C is not cleared.

[0170] The time threshold 1 of Timer C is compared, and if Timer C exceeds the set time threshold 1, and the temporary state S' and all states S(K) in the stored state machine are not similar, a new state is generated. That is, the state number is updated to K=0+1, the new state S(K) in the state set is updated to S(1)=S', the current state and the temporary state match, S'=S(1), K'=1, that is, the target changes from state S(0) to S(1), the processed signal is obtained, and corresponds to what is shown in Figure 9(1).

[0171] After someone enters, R m,n If (t) and S' are not similar, then C=0, and S1 remains constant.

[0172] R m,n (t) is received in real time, and the difference signal is obtained. Δ m,n (t)=R m,n (t)-S(k')

[0173] The difference signals are continuously recorded and analyzed to obtain a regular signal, which is shown in Figure 9(4).

[0174] By continuously repeating the above process, a processed state signal can be obtained, and the process of changes in a person's respiration can be analyzed from the processed sensing signal.

[0175] Scenario 3 Based on the daily channel model change rules for the room, the changes in the room's state are extracted and shown in Figure 10. The specific implementation process is as follows.

[0176] A synchronized sensing signal transmitting base station transmits sensing signals over a set time and on radio resources, and a sensing signal receiving base station receives the sensing signals. Each antenna samples the sensing signal, and according to the sampled signal, the channel shock response vector R of each antenna is calculated. m,n(t) is obtained, the initial state S(0) is set, the temporary state S'=S(0) and K'=K, and timer C starts counting. At this time, the room is in the morning and in the stable state S(0), as shown in Figure 10.

[0177] The threshold of Timer C is compared, and if it exceeds the set threshold of Timer C (1), and the temporary state S' is not similar to all states S(K) in the saved state machine, a new state is generated. That is, the state number is updated to K=0+1, and the new state S(K) in the state set is updated to S(1)=S'. The current state and the temporary state match, S'=S(1), and K'=1. In other words, during a specific time period in the morning, the state of the room changes from a stable state S(0) to a stable state S(1) after going through a moving state for a certain period of time, and the dashed box in Figure 10 represents the moving temporary state S'.

[0178] Similarly, as shown in Figure 10, when the count value of timer C exceeds the set time threshold 1 and the state changes from S(1) to S(2), all states S(K) in the stored state machine are traversed, that is, the similarity of S' to S(0) and S(1) is compared, and if no similar state is found, the state number is updated to K=1+1, and the new state S(K) in the state set is updated to S(2)=S', the current state and the temporary state coincide, S'=S(2), K'=2, that is, at a specific time of noon the state of the room changes from the stable S(1) state to the stable S(2) state after going through a moving state for a certain period of time.

[0179] Furthermore, when the count value of timer C exceeds the set time threshold of 1 and the state changes from S(2) to S(3), all states S(K) in the saved state machine are traversed, that is, the similarity of S' to S(0), S(1), and S(2) is compared, and if no similar state is found, the state number is updated to K=2+1, and the new state S(K) in the state set is updated to S(3)=S', the current state and the temporary state coincide, S'=S(3), and K'=3, meaning that at a specific time of noon, the state of the room changes from the stable S(2) state to the stable S(3) state after going through a moving state for a certain period of time.

[0180] As shown in Figure 10, at this time the temporary state is S'=S(3) and K'=3. When the count value of timer C exceeds the set time threshold 1, the R at this time m,n (t) is similar to the temporary state S', and the temporary state S' is not similar to the current state S. In this case, we traverse all states S(K) in the saved state machine, i.e., we compare the similarity of S' with S(0), S(1), S(2), and S(3). If no similar state is found, we update the state number K=3+1, update the new state S(K) in the state set to S(4)=S', the current state and the temporary state coincide, S'=S(4), K'=4, i.e., at a specific time of noon, the state of the room changes from the S(3) stable state to the S(4) stable state after going through a moving state for a certain period of time.

[0181] Compared to conventional technologies, the means of this embodiment establish a real-time state machine model for the sensing target, determine the environmental state of the sensing target based on the real-time state machine model, thereby enabling the resolution of state sensing and sensing signal analysis in complex environments, recognition of different stable state characteristics of the environment, recognition of real-time changes in the environment, and correlation of the state machine with the state type in actual scenarios. Wireless sensing using a real-time modeling state machine in complex multipath environments overcomes the problems of multipath effects in complex environments such as indoors and urban areas, and the inability to effectively realize wireless sensing when the number of receiver antennas is small or the bandwidth is small, thereby improving the accuracy of wireless sensing in complex multipath environments.

[0182] As shown in Figure 11, an embodiment of the present invention further provides a wireless sensing device, the wireless sensing device comprising a type determination module for determining the state type of the object to be sensed based on sensing modeling, The system includes an environmental state determination module for determining the environmental state of the sensing target based on the aforementioned state type.

[0183] The principles and implementation processes for achieving wireless sensing in this embodiment can be found in the above-described embodiments, and therefore, redundant explanations are omitted here.

[0184] Furthermore, the embodiments of the present application further provide a wireless sensing device. A sensing modeling module for establishing a real-time state machine model for the sensing target, The system includes a state determination module for determining the environmental state of the sensing target based on the real-time state machine model.

[0185] The principle by which this embodiment realizes sensing can be understood by referring to the above-described embodiments, and therefore, a redundant explanation will be omitted here.

[0186] Furthermore, embodiments of the present application provide a communication device comprising a memory, a processor, and a wireless sensing program stored in the memory and executable on the processor, wherein the wireless sensing program, when executed by the processor, realizes the wireless sensing method described in each of the above embodiments.

[0187] When this wireless sensing program is executed by the processor, it employs all the technical proposals of all the embodiments described above, and thus has all the beneficial effects of at least all the technical proposals of all the embodiments described above, and therefore, redundant explanations are omitted here.

[0188] Furthermore, embodiments of the present application provide a computer-readable storage medium in which a wireless sensing program is stored, and when the wireless sensing program is executed by a processor, the wireless sensing method described in each of the above embodiments is realized.

[0189] When this wireless sensing program is executed by the processor, it employs all the technical proposals of all the embodiments described above, and thus has all the beneficial effects of at least all the technical proposals of all the embodiments described above, and therefore, redundant explanations are omitted here.

[0190] Compared to conventional technologies, the wireless sensing method, apparatus, communication equipment, and storage medium according to the embodiment of the present invention establish a real-time state machine model for the sensing target, determine the environmental state of the sensing target based on the real-time state machine model, thereby overcoming the problem of wireless sensing being affected by multipath in complex environments such as indoors and urban areas, and when the number of receiver antennas is small or the bandwidth is small, and improving the accuracy of wireless sensing in complex multipath environments.

[0191] In this specification, the terms “include,” “incorporate,” or any other variation thereof are intended to cover non-exclusive inclusion, thereby including not only those elements but also other elements not expressly enumerated, or elements specific to that process, method, article, or system. Unless otherwise specified, an element limited by the phrase “includes one…” does not preclude the presence of another identical element in a process, method, article, or system that includes that element.

[0192] The numbering of the embodiments in the present application above is for illustrative purposes only and does not indicate any superiority or inferiority among the embodiments.

[0193] Through the above description of embodiments, those skilled in the art will clearly understand that the methods of the above embodiments may be implemented by software and a necessary general-purpose hardware platform, or of course by hardware, but in many cases the former is a more preferred embodiment. Based on this understanding, the essence of the present invention or the portion that contributes to related technologies can be embodied in the form of a software product, which is stored in one storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and includes a number of instructions for causing a single communication device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the methods of each embodiment of the present invention.

[0194] The foregoing are merely preferred embodiments of the present application and do not limit the scope of the patent. Equivalent structural or process modifications and direct or indirect applications in other related technical fields using the contents of the specification and drawings of the present application are also included within the scope of the patent protection of the present application.

Claims

1. A wireless sensing method, The steps include establishing a real-time state machine model for the sensing target, The steps include determining the environmental state of the object to be sensed based on the real-time state machine model, The step of establishing a real-time state machine model for the sensing target is: The process includes the steps of performing real-time sensing modeling on the sensing target using a state machine, obtaining the state machine switching method, and updating the real-time state machine model. The step of determining the environmental state of the sensing target based on the real-time state machine model is: The steps include extracting real-time modeling information of the state machine from the real-time state machine model, The steps include determining the state type of the sensing target based on the real-time modeling information of the state machine, The steps include determining the environmental state of the sensing target based on the state type of the sensing target, A wireless sensing method including

2. The steps of performing real-time sensing modeling on the sensing target using a state machine, obtaining the state machine switching method, and updating the real-time state machine model are as follows: The steps include: collecting the sensing signal from the antenna, The steps include acquiring a response pulse signal from the antenna based on the sensing signal from the antenna, The steps include obtaining the switching method of the state machine and updating the real-time state machine model based on the response pulse signal of the antenna and the current information of the state machine, The wireless sensing method according to claim 1, including the following:

3. The step of obtaining the switching method of the state machine based on the response pulse signal of the antenna and the current information of the state machine is: A step of recording the current state of the state machine, a temporary state which is a state between a stable state of the state machine and another stable state thereafter, and timer information. The steps include obtaining the switching method of the state machine based on the response pulse signal of the antenna, the current state of the state machine, the temporary state, and timer information, The wireless sensing method according to claim 2, including the following:

4. The switching method for the aforementioned state machine is: Maintaining the current state, Switching to the existing state in the history, and This includes at least one of switching to a new state. The wireless sensing method according to claim 3.

5. Before the step of obtaining the state machine switching method, The step further includes determining the switching method for the state machine. The wireless sensing method according to claim 4.

6. The method by which the state machine decides to maintain its current state is: The timer count must not exceed the set time threshold. The response pulse signal of the antenna at the current time and the signal representing the temporary state of the state machine at the current time are not similar, the timer is cleared, and The response pulse signal of the antenna at the current time and the signal representing the transient state of the state machine at the current time are similar, and the timer includes at least one of the following: maintaining a count. The wireless sensing method according to claim 5.

7. The method by which the state machine decides to switch to an existing state in the history is: The timer count exceeds the set time threshold. The response pulse signal of the antenna at the current time and the signal representing the transient state of the state machine at the current time are similar, and the transient state and the current state are not similar. Read all states in the saved state machine, compare the similarity between the temporary state and each state in the saved state machine, and determine if there are situations in all saved states that are similar to the temporary state. The aforementioned temporary state and current state number are changed to the state and number with the highest corresponding similarity in the existing state machine, and The timer must not be cleared, and this must include at least one of the following: The wireless sensing method according to claim 5.

8. The method by which the state machine decides to switch to a new state is: The timer count exceeds the set time threshold. The response pulse signal of the antenna at the current time and the signal representing the temporary state of the state machine at the current time are similar, and the temporary state is not similar to any of the states in the stored state machine, the state machine generates a new state and can be switched to the new state, and The timer must not be cleared, and this must include at least one of the following: The wireless sensing method according to claim 5.

9. A method for determining whether the response pulse signal of the antenna at the current time and the signal representing the temporary state of the state machine at the current time are similar is as follows: A step of calculating the similarity between the response pulse signal of the antenna at the current time and the signal representing the transient state of the state machine at the current time, If the similarity does not exceed a predetermined similarity threshold, the step of determining that the response pulse signal of the antenna at the current time and the signal representing the temporary state of the state machine at the current time are not similar, The step includes determining that, if the similarity exceeds a predetermined similarity threshold, the response pulse signal of the antenna at the current time and the signal representing the transient state of the state machine at the current time are similar. The wireless sensing method according to claim 6.

10. The step of calculating the similarity between the response pulse signal of the antenna at the current time and the signal representing the transient state of the state machine at the current time is: The steps include: calculating the correlation value between the response pulse signal of the antenna at the current time and the signal representing the temporary state of the state machine at the current time, and using the maximum correlation peak as the similarity comparison quantity; The process includes one of the following steps: calculating the included angle between a vector represented by the response pulse signal of the antenna at the current time and a vector represented by the signal representing the transient state of the state machine at the current time, and using the cosine of the included angle as the similarity comparison quantity. The wireless sensing method according to claim 9.

11. The step of updating the real-time state machine model is: The step includes performing an update operation on the real-time state machine model based on the state machine switching method. The wireless sensing method according to claim 2.

12. The step of performing an update operation on the real-time state machine model based on the state machine switching method is: If, in accordance with the state machine maintaining its current state, the response pulse signal of the antenna at the current time and the signal representing a transient state, which is a state between the stable state of the state machine at the current time and another subsequent stable state, are not similar, then the signal representing the transient state of the state machine is updated to the response pulse signal of the antenna at the current time, and the timer is cleared. In accordance with the state machine maintaining its current state, if the response pulse signal of the antenna at the current time and the signal representing the temporary state of the state machine at the current time are similar, the timer count is maintained. In response to the state machine being switched to an existing state in the history, the steps include: performing a state machine switching operation; changing the temporary state and current state number of the state machine to the state and number with the greatest similarity to the corresponding state in the existing state machine; not clearing the timer; and recording the state machine switching information. In response to the state machine being switched to a new state, the procedure includes at least one of the following steps: performing a new state generation operation and a switching operation for the state machine, not clearing the timer, and recording the state machine switching information. The wireless sensing method according to claim 11.

13. The step further includes saving the current state of the state machine. The wireless sensing method according to claim 12.

14. The real-time modeling information of the aforementioned state machine is: State machine history switching record, The current state of the state machine, A transient state is a state between a stable state of a state machine and another stable state that follows, and Includes at least one of the state machine's timer information. The wireless sensing method according to claim 1.

15. The state type of the sensing target is, The object being sensed is currently in an unstable state. The sensing target is currently stable, and there has been a change from the previous stable state, and The sensing target is stable in its current state and has not changed from its previous stable state, including at least one of these conditions. The wireless sensing method according to claim 1.

16. The step of determining the environmental state of the sensing target based on the state type of the sensing target is: For a sensing target in an unstable state, the steps include: calculating difference information between the antenna response pulse signal at different times and the signal representing the current state of the state machine; The steps include determining the rule for changes in the environmental state of the sensing target based on the differential information, The wireless sensing method according to claim 15, including the following:

17. The step of determining the rule for changes in the environmental state of the sensing target according to the differential information is: The steps include analyzing the difference information and extracting the difference signal features from the difference information, The steps include drawing a state change curve according to the difference signal characteristics, The steps include determining the environmental state change rule for the sensing target according to the state change curve, The wireless sensing method according to claim 16, including the following:

18. The difference signal features include at least one of phase, amplitude, and time period. The wireless sensing method according to claim 17.

19. A communication device that implements the wireless sensing method described in any one of claims 1 to 18.

20. A communication program for causing a computer to execute the wireless sensing method described in any one of claims 1 to 18.

Images