A method and apparatus for achieving perception integration through breathing and movement

Abstract

This invention relates to the field of wireless communication technology, specifically providing a method and apparatus for integrated sensing through breathing and movement, comprising the following steps: S1, initiating a sensing request, with the terminal and nodes activating sensing mode; S2, establishing a basic environmental model using the sensing nodes; S3, the terminal performing measurements and reporting based on different sensing beams sent by the nodes; S4, merging indoor reflective objects by combining the calculated three-dimensional model results of each beam on the same indoor environment to construct a low-resolution indoor environment model; S5, using Fresnel effect breathing detection and Doppler target movement sensing technology, identifying detected breathing targets in the indoor environment model established in step S4. Compared with existing technologies, this invention merges the states of sensed moving targets based on the homogeneity of sensed targets. By utilizing the advantages of both algorithms and designing a reasonable processing method, better application results are achieved.

Description

Technical Field

[0001] This invention relates to the field of wireless communication technology, specifically providing a method and apparatus for achieving integrated sensing through breathing and movement. Background Technology

[0002] For indoor environments, such as nursing homes and ordinary homes, there is a need for a means of monitoring and sensing the approximate location and vital signs such as breathing patterns of elderly people living at home. Sensor-integrated technology, which does not require the monitored individual to wear a device and offers privacy protection, has become a promising automated sensing and care method.

[0003] Currently, the technical means for this approach include: wireless sensing theory based on the Fresnel zone model and methods for estimating motion speed and direction based on the fundamental concepts of the relativistic Doppler effect. This method can sense a target's breathing and movement within a room in wireless communication systems based on OFDM signal systems, such as Wi-Fi, 4G, and 5G. However, this technology has certain requirements regarding the location of the sensing and transceiver nodes, as well as the speed, direction, and location of the sensed object; it requires the placement of multiple transceivers, making it relatively cumbersome.

[0004] How to achieve comprehensive perception of indoor personnel through simple configuration is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0005] This invention addresses the shortcomings of the prior art by providing a highly practical method for integrating perception through breathing and movement.

[0006] A further technical objective of this invention is to provide a reasonably designed, safe, and applicable device that integrates sensing through breathing and movement.

[0007] The technical solution adopted by this invention to solve its technical problem is:

[0008] A method for achieving integrated perception through breathing and movement, characterized by the following steps:

[0009] S1. Initiate a perception request, and the terminal and node start the perception mode;

[0010] S2. Establish a basic environmental model using sensing nodes;

[0011] S3. The terminal performs measurement reporting based on the different sensing beams sent by the nodes;

[0012] S4. The computational imaging 3D model results of each beam on the same indoor environment are merged to construct a low-resolution indoor environment model.

[0013] S5. Using Fresnel effect breathing detection and Doppler target movement sensing technology, the detected breathing targets are identified in the indoor environment model established in step S4.

[0014] Furthermore, in step S1, when a terminal in the same environment opens a sleep or breathing sensing application, the sensing application initiates a sensing request to the corresponding application server on the network side through the network. After the application server finds a node in the same sensing area as the UE in the resource pool, it simultaneously instructs the terminal and the node to enable sensing mode.

[0015] Furthermore, the terminal and the node are instructed to activate the sensing mode. The sensing node is a Wi-Fi hotspot or a 4G or 5G home base station deployed indoors, or an outdoor macro base station.

[0016] Furthermore, in step S2, the sensing node is configured with 4 or 8 antennas and operates at a frequency in the Sub6G band or millimeter wave band. When a terminal requesting sensing services connects to the node, the node first begins environmental modeling.

[0017] Furthermore, when starting environment modeling, specifically, it includes sending sensing signals using a selected codebook in a given downlink subframe. The downlink sensing precoding codebook used is selected based on the terminal measurement and reporting information.

[0018] The specific method is as follows: The UE selects the top N PMIs with the largest gain according to the CSI-RS measurement mechanism. The value of N is generally half of the number of antennas M of the node. The top N PMIs reported by the UE correspond to the direct path or the reflected / refracted path with the strongest wireless link gain from the node to the terminal.

[0019] Furthermore, in step S3, using wireless signal imaging technology, a mirrored transmitting and receiving node pair is established, and using the AMP or GAMP algorithm, with the cooperation of the terminal, coarse-grained three-dimensional imaging of the environment within each beam range is performed.

[0020] Furthermore, in step S4, the signal transmitted by the current beam is used as a detection signal to detect various spaces in the area to be imaged. The process includes the following steps:

[0021] (1) When a terminal connects to an indoor Wi-Fi AP or home base station with sensing function and opens an indoor sensing application, the indoor base station sends a sensing policy to the terminal.

[0022] (2) According to the perception strategy, the indoor base station uses a deterministic mode to scan the environment with a sensing beam. The terminal samples the received signal according to the strategy and reconstructs the spatial grid characteristics based on the received signal.

[0023] (3) Under normal circumstances, indoor base stations will save historical environmental information. In addition to the initial environmental setup and updates for environmental changes, they will also reconstruct the same indoor environmental information based on historical data.

[0024] (4) Signal reconstruction.

[0025] Furthermore, in step S5, the beam queue obtained in the second step is traversed by polling. Fresnel effect breathing detection and Doppler target movement sensing technology are used to identify the detected breathing targets in the indoor environment model established in the fourth step. Based on the homology of the sensed targets, the moving targets sensed in this step are merged.

[0026] A device that integrates sensing through breathing and movement includes: at least one memory and at least one processor;

[0027] The at least one memory is used to store a machine-readable program;

[0028] The at least one processor is configured to invoke the machine-readable program to execute a method for achieving sensory integration through breathing and movement.

[0029] Compared with the prior art, the method and apparatus of the present invention for achieving integrated perception through breathing and movement have the following outstanding advantages:

[0030] This invention constructs a low-resolution indoor environment model for nursing homes and home-based elderly care scenarios by using coarse-grained indoor environment modeling and indoor breathing and motion perception, and merging indoor reflective objects based on the homogeneity of the indoor environment.

[0031] Based on the homology of perceived targets, the states of perceived moving targets are merged. By leveraging the advantages of two algorithms and designing a reasonable processing method, good application results are achieved. Attached Figure Description

[0032] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0033] Appendix Figure 1 This is a schematic diagram of a virtual transmission node based on multipath reflection in a method for achieving integrated perception through breathing and movement.

[0034] Appendix Figure 2This is a schematic diagram of the horizontal main lobe direction of a uniform linear array in an embodiment of a method for achieving integrated perception through breathing and movement.

[0035] Appendix Figure 3 A schematic diagram of a method for achieving integrated perception through breathing and movement, in which a beam signal emitted by a base station is reflected by a wall 1 and received by a terminal.

[0036] Appendix Figure 4 A schematic diagram of the direct line of sight from the base station to the terminal and the scattering paths of wall 1 and wall 2 in an embodiment of a method for achieving integrated perception through breathing and movement;

[0037] Appendix Figure 5 A schematic diagram of multiple equivalent indoor transceiver points in an embodiment of a method for achieving integrated perception through breathing and movement.

[0038] Appendix Figure 6 A schematic diagram illustrating the relationship between Doppler frequency shift and target velocity in an embodiment of a method for achieving integrated perception through breathing and movement. Detailed Implementation

[0039] To enable those skilled in the art to better understand the present invention, the present invention will be further described in detail below with reference to specific embodiments. Obviously, the described embodiments are merely some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0040] The following is a preferred embodiment:

[0041] like Figure 1 As shown, a method for achieving integrated perception through breathing and movement in this embodiment includes the following steps:

[0042] S1. Initiate a perception request, and the terminal and node start the perception mode;

[0043] When a terminal in the same environment opens a sleep or breathing awareness application, the application sends a sensing request to the corresponding application server on the network side. After the application server finds a node in the same sensing area as the UE in the resource pool, it instructs the terminal and the node to enable sensing mode.

[0044] The sensing nodes here can be Wi-Fi hotspots and 4G or 5G home base stations deployed indoors, or outdoor macro base stations that meet the sensing requirements.

[0045] S2. Establish a basic environmental model using sensing nodes;

[0046] Sensing nodes require customized functionality and are typically configured with 4 or 8 antennas, operating at frequencies in the Sub-6GHz or millimeter-wave bands. When a terminal requesting sensing services connects to the node, the node first begins environmental modeling.

[0047] Specifically, this includes transmitting sensing signals using a selected codebook in a given downlink subframe. The downlink sensing precoding codebook used here is selected based on the terminal's measurement and reporting information. The specific method is as follows: the UE selects the top N PMIs with the largest gain according to the CSI-RS measurement mechanism, where the value of N is generally half of the number of antennas M in the node, for example, N = M / 2, N is 2 when there are 4 antennas in the node, and so on.

[0048] The first N PMIs reported by the UE correspond to the direct path or the reflected / refracted path with the strongest gain in the node-to-terminal wireless link.

[0049] S3. The terminal performs measurement reporting based on the different sensing beams sent by the nodes;

[0050] like Figure 2-6 As shown, a typical embodiment of this invention patent employs a bistatic radar operating mode where a base station transmits a detection signal and a terminal detects the signal. Taking an 8×1 uniform linear array ULA as an example, quantization weight precoding is used to determine... Figure 2 The eight beam main lobe directions are shown.

[0051] The base station uses different beam main lobes to scan the environment in a time-division manner, and the indoor terminal measures the signals of different main lobes separately.

[0052] like Figure 3 As shown, a directional beam emitted by the base station is reflected by an obstacle such as wall 1 and detected by the terminal. There is a mirror image of the base station on the reverse extension of the equivalent propagation path from wall 1 to the terminal.

[0053] like Figure 4 As shown, multiple reflectors can form multiple mirror images in an indoor environment. (Simplified as follows) Figure 5 As shown.

[0054] like Figure 6 As shown, when sensing target motion, the ability to perceive the direction of target motion is limited by whether the target is moving along the tangent of the ellipse. The estimation error is smallest when moving along the tangent, and largest when moving along the normal. A similar problem exists when estimating the target position.

[0055] In real-world environments, such as homes or nursing homes, typically only one Wi-Fi access point (AP) or home base station is deployed within a specific indoor area, covering that area. Using the method of this invention, under existing conditions, multiple usable "transmitter and receiver node pairs" can be obtained using a user-carried smart terminal or other terminal device, utilizing the image formed by the scattered signal. By selecting a "transmitter and receiver node pair" with better performance through software, indoor target perception can be achieved.

[0056] When establishing a mirrored "transmitter and receiver node pair," computational imaging techniques, such as AMP / GAMP algorithms, are needed to perform coarse-grained 3D imaging of the environment within each beam range, in cooperation with the terminal. This not only improves the positioning accuracy of the sensed target but also better distinguishes the best-performing sensed signal from multiple candidate sensed signals for the same target.

[0057] S4. The computational imaging 3D model results of each beam on the same indoor environment are merged to construct a low-resolution indoor environment model.

[0058] The signal transmitted by the current beam is used as a detection signal to detect various spaces in the area to be imaged. The process includes the following steps:

[0059] (1) When a terminal connects to an indoor Wi-Fi AP or home base station with sensing function and opens an indoor sensing application, the indoor base station sends a sensing policy to the terminal.

[0060] (2) According to the perception strategy, the indoor base station uses a deterministic mode to scan the environment with a sensing beam. The terminal samples the received signal according to the strategy and reconstructs the spatial grid characteristics based on the received signal.

[0061] (3) Under normal circumstances, indoor base stations will save historical environmental information. In addition to the initial environmental setup and updates for environmental changes, they will also reconstruct the same indoor environmental information based on historical data.

[0062] (4) Signal reconstruction.

[0063] S5. Using Fresnel effect breathing detection and Doppler target movement sensing technology, the detected breathing targets are identified in the indoor environment model established in step S4.

[0064] The beam queue obtained in the second step is traversed using a polling method. Fresnel effect breathing detection and Doppler target movement sensing technology are used to identify the detected breathing targets and assign them to the indoor environment model established in the fourth step. Based on the homology of the sensed targets, the moving targets sensed in this step are merged.

[0065] Due to the differences in signal propagation directionality of different beams, the deployment of different transceiver nodes can improve the sensing performance, which is equivalent to deploying multiple different transceiver nodes indoors.

[0066] In practice, by selecting the best-performing perception results in terms of breathing signals, movement speed, and direction of movement, and combining them with the target objects merged in the low-resolution indoor environment model constructed in the fourth step, more accurate and efficient perception results can be obtained.

[0067] A device that integrates sensing through breathing and movement includes: at least one memory and at least one processor;

[0068] The at least one memory is used to store a machine-readable program;

[0069] The at least one processor is configured to invoke the machine-readable program to execute a method for achieving sensory integration through breathing and movement.

[0070] The above-described specific embodiments are merely specific examples of the present invention. The patent protection scope of the present invention includes, but is not limited to, the above-described specific embodiments. Any appropriate changes or substitutions made by a person skilled in the art that conform to the claims of the present invention regarding a method and apparatus for achieving integrated perception through breathing and movement should fall within the patent protection scope of the present invention.

[0071] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A method for achieving sensory integration through respiration and movement, comprising: It has the following steps: S1. Initiate a perception request, and the terminal and node start the perception mode; When a terminal in the same environment opens a sleep or breathing sensing application, the sensing application sends a sensing request to the corresponding application server on the network side. After the application server finds a node in the same sensing area as the terminal in the resource pool, it instructs the terminal and the node to enable sensing mode. The terminal and the node are instructed to activate the sensing mode. The sensing node is a Wi-Fi hotspot or a 4G or 5G home base station deployed indoors, or an outdoor macro base station. S2. Establish a basic environmental model using sensing nodes; The sensing node is equipped with 4 or 8 antennas and operates at a frequency in the Sub6G band or millimeter wave band. When a terminal requesting sensing services connects to the node, the node first begins environmental modeling. When starting environment modeling, specifically, it involves sending sensing signals using a selected codebook in a given downlink subframe. The downlink sensing precoding codebook used is selected based on the terminal measurement and reporting information. The specific method is as follows: The terminal selects the top N PMIs with the largest gain according to the CSI-RS measurement mechanism, where the value of N is half of the number of multiple antennas M of the node. The top N PMIs reported by the terminal correspond to the direct path or the reflected / refracted path with the strongest wireless link gain from the node to the terminal. S3. The terminal performs measurement reporting based on the different sensing beams sent by the nodes; By using wireless signal imaging technology, a mirrored transmitting and receiving node pair is established. Using the AMP or GAMP algorithm, with the cooperation of the terminal, coarse-grained three-dimensional imaging of the environment within each beam range is performed. S4. The computational imaging 3D model results of each beam on the same indoor environment are merged to construct a low-resolution indoor environment model. The signal transmitted by the current beam is used as a detection signal to detect various spaces in the area to be imaged. The process includes the following steps: (1) When a terminal connects to an indoor Wi-Fi AP or home base station with sensing function and opens an indoor sensing application, the indoor base station sends a sensing policy to the terminal. (2) According to the perception strategy, the indoor base station uses a deterministic mode to scan the environment with a sensing beam, and the terminal samples the received signal according to the strategy and reconstructs the spatial grid characteristics based on the received signal. (3) Indoor base stations will save historical environmental information, in addition to the initial environmental setup and updates for environmental changes, and reconstruct the same indoor environmental information based on historical data; (4) Signal reconstruction; S5. Using Fresnel effect breathing detection and Doppler target movement sensing technology, the detected breathing targets are identified in the indoor environment model established in step S4. The beam queue obtained in the second step is traversed by polling. Fresnel effect breathing detection and Doppler target movement sensing technology are used to identify the detected breathing targets in the indoor environment model established in the fourth step. Based on the homology of the sensed targets, the moving targets sensed in this step are merged.

2. A device for achieving sensory integration through respiration and movement, characterized by, include: At least one memory and at least one processor; The at least one memory is configured to store a machine readable program; The at least one processor is configured to invoke the machine readable program to execute the method of claim 1.

Images