Wireless sensing method and system based on GNSS (Global Navigation Satellite System) signal
Through the wireless perception method based on GNSS signals, the signal amplitude and phase are reconstructed, and the diffraction and reflection perception models and dynamic time alignment algorithm are used to solve the problem of small coverage of wireless perception technology outside the outdoors, realizing fine-grained outdoor human movement recognition .
Patent Information
- Application Number
- CN202411028497.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-30
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-07-30
AI Technical Summary
Existing wireless perception technologies have small coverage and high maintenance costs when deployed outdoors on a large scale, making it difficult to effectively deploy in outdoor areas.
Using a wireless perception method based on GNSS signals, the amplitude and phase of the signal are reconstructed through the original GNSS measurement value, diffraction and reflection perception models are analyzed, and signal comparison is performed in combination with dynamic time regularization algorithm to achieve action recognition of the target object.
It effectively improves the coverage of wireless perception, reduces dependence on signal transmitters, and is suitable for fine-grained human body movement recognition in a variety of outdoor environments.
Smart Images

Figure CN119071736A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of wireless sensing technology, and in particular to a wireless sensing method and system based on GNSS signals. Background Art
[0002] Wireless sensing technology has shown broad application prospects in the fields of human-computer interaction and environmental monitoring due to its advantages such as non-contact, low cost and privacy protection. Various wireless signals such as Wi-Fi, LoRa and UWB are widely used in scenarios such as human motion recognition and environmental information monitoring. At present, the sensing coverage of wireless sensing solutions is small, and usually requires dense deployment of signal transmitters and stable power access conditions. The maintenance cost is high and it is difficult to deploy on a large scale in outdoor areas. Summary of the invention
[0003] The main purpose of the present invention is to provide a wireless sensing method and system based on GNSS signals, aiming to solve at least one of the above-mentioned technical problems.
[0004] To achieve the above object, the present invention provides a wireless sensing method based on GNSS signals, comprising:
[0005] Reconstructing the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain a reconstructed amplitude and a reconstructed phase;
[0006] Analyzing the reconstructed amplitude and the reconstructed phase based on a diffraction and reflection perception model to obtain a diffraction sample and a reflection sample;
[0007] Comparing the diffraction sample and the reflection sample with the reference signal sample based on a dynamic time warping algorithm to obtain a dynamic time warping calculation result;
[0008] The action recognition result of the target object is determined according to the dynamic time warping calculation result.
[0009] In some embodiments, reconstructing the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain the reconstructed amplitude and the reconstructed phase includes:
[0010] Obtaining GNSS raw measurement values of the target object reported by the GNSS module; wherein the GNSS raw measurement values include a carrier-to-noise power density ratio and an accumulated carrier phase measurement value;
[0011] Reconstructing the amplitude of the GNSS signal according to the carrier-to-noise power density ratio and the signal amplitude reconstruction formula to obtain a reconstructed amplitude;
[0012] The phase of the GNSS signal is reconstructed according to the accumulated carrier phase measurement value and the phase change formula to obtain a reconstructed phase.
[0013] In some embodiments, the signal amplitude reconstruction formula is:
[0014]
[0015] Where Amplitude is the reconstruction amplitude; C / N 0 is the carrier-to-noise power density ratio.
[0016] In some embodiments, reconstructing the phase of the GNSS signal according to the accumulated carrier phase measurement value and the phase change formula to obtain the reconstructed phase includes:
[0017] The satellite motion speed and the unit direction vector between the satellite and the receiver are calculated based on the satellite ephemeris information;
[0018] Calculating a phase influence parameter of the satellite motion on the GNSS signal according to the satellite motion speed and the unit direction vector;
[0019] Obtaining a clock error of the receiver based on a least squares positioning algorithm and a pseudorange in the original GNSS measurement value;
[0020] The phase of the GNSS signal is reconstructed according to the accumulated carrier phase measurement value, the phase influencing parameter, the clock error of the receiver and a phase change formula to obtain a reconstructed phase.
[0021] In some embodiments, the phase change formula is:
[0022] φ tar (k)=φ(k)-φ(k-1)+φ d (k)-c(t b (k)-t b (k-1))
[0023] Among them, φ tar (k) is the reconstructed phase; φ is the accumulated carrier phase measurement value; φ d is the phase influence parameter of satellite motion on GNSS signal; c is the speed of light; t b is the receiver clock error.
[0024] In some embodiments, analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain the diffraction sample and the reflection sample includes:
[0025] Construct a diffraction and reflection perception model for GNSS signals;
[0026] Determining whether the GNSS signal is a signal that has undergone a diffraction effect or a signal that has undergone a reflection effect according to the azimuth angle of the satellite;
[0027] If the GNSS signal is a signal that experiences a reflection effect, analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain a reflection sample;
[0028] If the GNSS signal is a signal that experiences a diffraction effect, the reconstructed amplitude and the reconstructed phase are analyzed based on the diffraction and reflection perception model to obtain a diffraction sample.
[0029] In some embodiments, the step of comparing the diffraction sample and the reflection sample with a reference signal sample based on a dynamic time warping algorithm to obtain a dynamic time warping calculation result includes:
[0030] Determine a sky distribution map of the satellite based on the azimuth and elevation information reported by the GNSS module, and divide the sky distribution map into a plurality of sectors;
[0031] Selecting the signal with the largest amplitude change value of the satellite in each sector as the sector signal sample;
[0032] Comparing the diffraction sample and the reflection sample of each sector signal sample with the reference signal sample based on a dynamic time warping algorithm to obtain a calculation result of each sector;
[0033] The calculation results of the sectors are weighted summed to obtain a dynamic time warping calculation result.
[0034] In some embodiments, the step of comparing the diffraction sample and the reflection sample of each sector signal sample with the reference signal sample based on the dynamic time warping algorithm to obtain the calculation result of each sector includes:
[0035] Analyzing the diffraction sample and the reflection sample of each sector signal sample based on the diffraction and reflection perception model to obtain a diffraction amplitude change value and a reflection amplitude change value;
[0036] Based on the dynamic time warping algorithm, the calculation result of each sector is obtained according to each sector signal sample, the diffraction amplitude change value, the reflection amplitude change value and the reference signal sample; wherein the calculation result is the action most similar to the reference signal sample.
[0037] In addition, to achieve the above purpose, the present invention also proposes a wireless sensing system based on GNSS signals, comprising:
[0038] A signal reconstruction module is used to reconstruct the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain a reconstructed amplitude and a reconstructed phase;
[0039] A perception analysis module, used to analyze the reconstructed amplitude and the reconstructed phase based on a diffraction and reflection perception model to obtain a diffraction sample and a reflection sample;
[0040] An action recognition module, used for comparing the diffraction sample and the reflection sample with the reference signal sample based on a dynamic time warping algorithm to obtain a dynamic time warping calculation result;
[0041] A result output module is used to determine the action recognition result of the target object according to the dynamic time warping calculation result.
[0042] In some embodiments, the signal reconstruction module is specifically used to: obtain the GNSS original measurement value of the target object reported by the GNSS module; wherein the GNSS original measurement value includes a carrier-to-noise power density ratio and a cumulative carrier phase measurement value;
[0043] Reconstructing the amplitude of the GNSS signal according to the carrier-to-noise power density ratio and the signal amplitude reconstruction formula to obtain a reconstructed amplitude;
[0044] The phase of the GNSS signal is reconstructed according to the accumulated carrier phase measurement value and the phase change formula to obtain a reconstructed phase.
[0045] The present invention provides a wireless sensing method based on GNSS signals, including: reconstructing the amplitude and phase of GNSS signals according to the original GNSS measurement value of the target object to obtain the reconstructed amplitude and the reconstructed phase; analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain diffraction samples and reflection samples; comparing the diffraction samples and the reflection samples with the reference signal samples based on the dynamic time warping algorithm to obtain the dynamic time warping calculation results; determining the action recognition result of the target object according to the dynamic time warping calculation results. In the present invention, the amplitude and phase of the original GNSS measurement value are used to further analyze the relationship between the signal change characteristics and the human body movement based on the diffraction and reflection perception model, and the collected samples are compared with the reference signal samples through the dynamic time warping algorithm to realize multi-GNSS signal fusion human body movement recognition. The present invention uses GNSS signals for wireless sensing, which effectively improves the wireless sensing coverage, and because the GNSS signal is always present, there is no need to equip additional deployment transmitters, which is conducive to deployment and application in a variety of outdoor environments to achieve fine-grained human body movement recognition. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1 It is a flow chart of an embodiment of a wireless sensing method based on GNSS signals of the present invention;
[0047] Figure 2 A block diagram of the technology implementation involved in the embodiment of the present invention;
[0048] Figure 3 A schematic diagram of a phase reconstruction process in a signal reconstruction algorithm involved in an embodiment of the present invention;
[0049] Figure 4 A schematic diagram of a reflection model of a GNSS signal involved in an embodiment of the present invention;
[0050] Figure 5 A schematic diagram of a diffraction model of a GNSS signal involved in an embodiment of the present invention;
[0051] Figure 6 This is a flow chart of human motion recognition using multi-GNSS signal fusion involved in an embodiment of the present invention;
[0052] Figure 7 A schematic diagram of satellite distribution sectors involved in an embodiment of the present invention;
[0053] Figure 8 It is a structural block diagram of an embodiment of a wireless sensing system based on GNSS signals of the present invention;
[0054] Fig. 9 The present invention is a schematic diagram of the structure of an electronic device in a hardware operating environment according to an embodiment of the present invention.
[0055] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0056] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0057] It should be noted that all directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.
[0058] In addition, the descriptions of "first", "second", etc. in the present invention are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in the field to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by the present invention. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0059] GNSS (Global Navigation Satellite System) signals basically cover 95% of the earth's area. The wireless sensing system based on GNSS can use the GNSS signals that exist at all times for wireless sensing. At present, wireless sensing systems usually require the location of fixed transceivers. Unlike the wireless sensing systems in related technologies, the wireless sensing system based on GNSS signals in this application does not need to be equipped with signal transmitters and can receive multiple GNSS signals at the same time. The incident angle of GNSS signals changes rapidly as the satellite moves. Therefore, the wireless sensing method based on GNSS signals in this application takes into account the incident angle of the satellite and reasonably designs the fusion perception algorithm of multiple GNSS signals to improve the performance of the wireless sensing system.
[0060] In view of this, the present invention proposes a wireless sensing method and system based on GNSS signals.
[0061] The embodiment of the present invention provides a wireless sensing method based on GNSS signals. Figure 1 , Figure 1 The figure is a flow chart of an embodiment of a wireless sensing method based on GNSS signals of the present invention.
[0062] like Figure 1 As shown, the wireless sensing method based on GNSS signals includes:
[0063] Step S100: reconstructing the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain a reconstructed amplitude and a reconstructed phase;
[0064] Step S200: analyzing the reconstructed amplitude and the reconstructed phase based on a diffraction and reflection perception model to obtain a diffraction sample and a reflection sample;
[0065] Step S300: comparing the diffraction sample and the reflection sample with the reference signal sample based on a dynamic time warping algorithm to obtain a dynamic time warping calculation result;
[0066] Step S400: Determine the action recognition result of the target object according to the dynamic time warping calculation result.
[0067] It should be noted that the execution subject in this embodiment may be an electronic device, which may be a computer device with data processing functions, or other devices that can achieve the same or similar functions. This embodiment does not limit this. In this embodiment, a computer device is used as an example for explanation.
[0068] It is understandable that, combined with Figure 1 and Figure 2 This embodiment proposes a wireless sensing method based on GNSS signals, performs MATLAB offline processing on the GNSS raw measurement values such as the cumulative carrier phase and carrier-to-noise power density ratio reported by the GNSS module, reconstructs the amplitude and phase of the signal through the signal reconstruction algorithm, and establishes a perception model based on diffraction and reflection based on the reconstructed phase and reconstructed amplitude, further analyzes the relationship between the signal change characteristics and human body movements, compares the collected signal change characteristics with the reference signal characteristics corresponding to the movement through dynamic time warping (DTW), and performs weighted summation on the comparison results according to the azimuth and elevation signals of the satellite, thereby realizing fine-grained human body movement recognition. The specific process of the wireless sensing method based on GNSS signals is described in detail below in conjunction with the accompanying drawings.
[0069] In one embodiment, the amplitude and phase of a GNSS signal are reconstructed according to the GNSS original measurement values of the target object to obtain the reconstructed amplitude and the reconstructed phase, including: obtaining the GNSS original measurement values of the target object reported by the GNSS module; wherein the GNSS original measurement values include a carrier-to-noise power density ratio and a cumulative carrier phase measurement value; reconstructing the amplitude of the GNSS signal according to the carrier-to-noise power density ratio and a signal amplitude reconstruction formula to obtain the reconstructed amplitude; and reconstructing the phase of the GNSS signal according to the cumulative carrier phase measurement value and a phase change formula to obtain the reconstructed phase.
[0070] It should be noted that, in this embodiment, the amplitude and phase of the GNSS signal are reconstructed according to the original GNSS measurement values reported by the GNSS module.
[0071] Specifically, reconstruction amplitude: The amplitude of the signal can be inferred from the calculation formula of the signal-carrier-to-noise power density ratio, which is:
[0072]
[0073] Among them, P n is the noise reference power, P cis the carrier power of the GNSS signal, B is the signal bandwidth, C / N 0 is the carrier-to-noise power density ratio, which can be directly obtained from the original GNSS measurement value. Since perception only requires phase amplitude changes but not absolute amplitude values, the noise reference power P n The signal bandwidth B can be considered to be 1. According to the above signal carrier-to-noise power density ratio calculation formula, the carrier power P of the GNSS signal can be derived. c The calculation formula of the signal amplitude reconstruction can be derived from the fact that the signal power is equal to the square of the amplitude. The signal amplitude reconstruction formula is:
[0074]
[0075] Where Amplitude is the reconstruction amplitude; C / N 0 is the carrier-to-noise power density ratio.
[0076] In one embodiment, the phase of the GNSS signal is reconstructed according to the accumulated carrier phase measurement value and the phase change formula to obtain the reconstructed phase, including: calculating the satellite motion speed and the unit direction vector between the satellite and the receiver according to the satellite ephemeris information; calculating the phase influence parameter of the satellite motion on the GNSS signal according to the satellite motion speed and the unit direction vector; obtaining the clock error of the receiver based on the least squares positioning algorithm and the pseudorange in the GNSS original measurement value; reconstructing the phase of the GNSS signal according to the accumulated carrier phase measurement value, the phase influence parameter, the clock error of the receiver and the phase change formula to obtain the reconstructed phase.
[0077] The phase change formula is:
[0078] φ tar (k)=φ(k)-φ(k-1)+φ d (k)-c(t b (k)-t b (k-1))
[0079] Among them, φ tar (k) is the reconstructed phase; φ is the accumulated carrier phase measurement value; φ d is the phase influence parameter of satellite motion on GNSS signal; c is the speed of light; t b is the receiver clock error.
[0080] Specifically, Figure 3 As shown, the reconstructed phase: The effect of satellite motion on the phase of the GNSS signal can be expressed by the following formula:
[0081] φ d =v s ·en
[0082] Among them, v s is the satellite's speed, e n is the unit direction vector between the satellite and the receiver. It should be noted that the satellite motion speed and unit direction vector can be calculated based on the satellite ephemeris information. The satellite ephemeris information can accurately calculate, predict, depict, and track the time, position, speed, and other operating states of flying objects (such as satellites), express the precise parameters of flying objects such as celestial bodies, satellites, spacecraft, missiles, and space debris, place the flying objects in three-dimensional space, and use time to depict the past, present, and future of celestial bodies. The time of the satellite ephemeris can be calculated according to the Universal Coordinated Time (UTC).
[0083] The accumulated phase measurement values φ(k-1) and φ(k) at time k-1 and k can be directly obtained from the original GNSS measurement values, and the phase change caused by the motion of the target object can be expressed as:
[0084] φ tar (k)=φ(k)-φ(k-1)+φ d (k)-c(t b (k)-t b (k-1))
[0085] Where c is the speed of light, t b is the clock error of the receiver, which can be obtained by the least square positioning algorithm based on the pseudorange in the original GNSS measurement value.
[0086] In one embodiment, the reconstructed amplitude and the reconstructed phase are analyzed based on a diffraction and reflection perception model to obtain diffraction samples and reflection samples, including: constructing a diffraction and reflection perception model of a GNSS signal; judging, based on the azimuth angle of the satellite, whether the GNSS signal is a signal that has undergone a diffraction effect or a signal that has undergone a reflection effect; if the GNSS signal is a signal that has undergone a reflection effect, analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain a reflection sample; if the GNSS signal is a signal that has undergone a diffraction effect, analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain a diffraction sample.
[0087] It is understandable that due to the different azimuths and elevations of different satellites, their corresponding satellite signals produce different degrees of diffraction and reflection effects on the human body surface. Constructing a diffraction and reflection perception model of GNSS signals may include a reflection model and a diffraction model.
[0088] Specifically, reflection model: reflection modeling of moving objects, such as Figure 4As shown in FIG. 1 , a target object (target object) moves forward and backward on a direct path between a satellite and a receiver (e.g., a GNSS receiver). The receiver captures signals from the direct path and reflections of the target object. Figure 4 As shown, the horizontal distance d from the GNSS receiver to the target object can be expressed as:
[0089] d=||(xp)|| cos θ
[0090] Where x and p are the positions of the GNSS receiver and the target object respectively, and e n is the direction vector between the satellite and the receiver, θ is the elevation angle of the satellite, then the phase difference between the direct signal and the reflected signal of the satellite can be expressed as:
[0091]
[0092] Among them, the elevation angle θ of the satellite is approximately constant in a short time, the phase difference between the reflected signal and the direct signal is linearly related to the horizontal distance d, and λ represents the carrier wavelength (λ can be a constant). Due to the combination of coherence and destructiveness between the reflected signal and the direct signal, the received signal intensity will produce periodic peaks and troughs as the object moves. From the above formula, it can be seen that the distance between the object positions corresponding to the two peaks is λ / (2cosθ)). By measuring the number of observed peaks, the distance of the target movement can be inferred.
[0093] It should be noted that the signal received by the receiver contains both reflected signals and direct signals. However, since the GNSS reflected signal is weaker than other wireless signals such as Wi-Fi (e.g. -120dbm), the GNSS reflected signal can only be detected when it is reflected by a larger part of the body (e.g. torso). The reflected signal from the hand is weak and difficult to detect. In order to sense the arms and legs, signals from other satellites that are affected by the diffraction effect can be used. For the diffraction effect, the geometric diffraction theory is used to analyze the relationship between signal changes and human body movements.
[0094] Specifically, the diffraction model: When the human target is very close to or in the direct path of the GNSS signal, the diffraction effect is dominant. When the GNSS signal is blocked by the target object, according to Keller's geometric diffraction theory, the GNSS signal will diffract in the shape of a cone, which is called the Keller cone. Figure 5As shown, consider the scenario where the target moves in the direct signal between the GNSS satellite and the GNSS receiver, and the GNSS signal diffracts at the edge of the moving target. When the edge of the object reaches the direct path, a Keller cone caused by diffraction is generated. At this time, the GNSS receiver receives a combination of the diffracted signal and the direct signal. Since the direct path signal is still dominant, the combined signal strength changes very little. When the target moves further and the direct path is blocked, the received signal strength drops rapidly. At this time, the direct signal is blocked, the diffraction signal dominates, and the signal strength fluctuates regularly. Among them, GNSS signals include but are not limited to GPS signals.
[0095] like Figure 5 As shown in the signal variation pattern in Figure 2, when the GNSS receiver is located at different locations, the signal strength fluctuation pattern is different. Figure 5 , when the GNSS receiver is deployed at position p 1 When the object moves and blocks the direct path, two minimum values appear on the signal change pattern diagram. 2 According to the fluctuation law of the signal, the relative position between the object and the receiver can be inferred.
[0096] It can be understood that, from the above diffraction model and reflection model, the change of GNSS signal is closely related to the satellite position. When the satellite and the target are on the same side relative to the target, the corresponding signal will depend on diffraction, and when the satellite and the target are on opposite sides relative to the receiver, the corresponding signal change depends on reflection. Therefore, according to the azimuth angle of the satellite, it can be judged whether the signal of the satellite has experienced diffraction effect or reflection effect.
[0097] Specifically, the GNSS signal is judged as a signal that has experienced a diffraction effect or a signal that has experienced a reflection effect according to the azimuth angle of the satellite. For a signal that has experienced a diffraction effect, a sample signal (diffraction sample) is obtained based on a diffraction model analysis. The diffraction sample can be expressed as For signals that experience reflection effects, sample signals (reflection samples) are obtained based on reflection model analysis. The reflection samples can be expressed as
[0098] In one embodiment, the diffraction samples and reflection samples are compared with the reference signal samples based on a dynamic time warping algorithm to obtain a dynamic time warping calculation result, including: determining the satellite's sky distribution map based on the azimuth and elevation information reported by the GNSS module, and dividing the sky distribution map into multiple sectors; selecting the signal with the largest amplitude change value of the satellite in each of the sectors as the sector signal sample; comparing the diffraction samples and reflection samples of each of the sector signal samples with the reference signal samples based on a dynamic time warping algorithm to obtain a calculation result for each sector; performing weighted summation on the calculation results of the sectors to obtain a dynamic time warping calculation result.
[0099] In one embodiment, the diffraction samples and reflection samples of each of the sector signal samples are compared with the reference signal samples based on a dynamic time warping algorithm to obtain a calculation result for each sector, including: analyzing the diffraction samples and reflection samples of each of the sector signal samples based on a diffraction and reflection perception model to obtain a diffraction amplitude change value and a reflection amplitude change value; obtaining the calculation result for each sector based on each of the sector signal samples, the diffraction amplitude change value, the reflection amplitude change value and the reference signal sample based on a dynamic time warping algorithm; wherein the calculation result is the action that is most similar to the reference signal sample.
[0100] Specifically, according to the azimuth angle of the satellite, it can be determined whether the satellite signal has experienced a diffraction effect or a reflection effect. For a signal that has experienced a diffraction effect, its sample signal can be expressed as Correspondingly, the signal sample that experiences the reflection effect is The dynamic time warping algorithm is used to compare the current signal sample with the reference signal sample, and the action corresponding to the most similar reference signal sample is selected as the output result:
[0101]
[0102] Where N represents the number of action types. and represents the diffraction samples and reflection samples of the corresponding action reference, and Indicates the amplitude change value of the current signal sample based on the diffraction and reflection perception model, and the amplitude change value is used as a weight to multiply the corresponding DTW result; where, is the reflection amplitude change value based on the reflection model, is the diffraction amplitude change value based on the diffraction model.
[0103] Specifically, Figure 6As shown in the figure, human action recognition based on multi-GNSS signal fusion: First, the sky distribution map of satellites is determined based on the azimuth and elevation information reported by the GNSS module. Since the signal changes of satellites within a certain azimuth and elevation range show similar signal change patterns, the sky map can be subdivided into different sectors based on the division range of azimuth and elevation.
[0104] For example, Figure 7 As shown in the figure, the target is located in the north direction (azimuth is 0°), the azimuth division range is set to 30°, and the elevation division range is set to 20°. After the sectors are divided, the signal with the largest amplitude change of the satellite in each sector is selected as the signal sample of the sector (sector signal sample), where the diffraction feature and the reflection feature are represented by x and D c j and x R c j , weighted sum of the DTW calculation results of all sectors, and select the action corresponding to the most similar reference signal sample as the output result:
[0105]
[0106] Where M represents the total number of sectors. and represents the weights of the diffraction samples and reflection samples of the j-th sector signal, ||x D c j || 2 and ||x R c j || 2 It represents the amplitude change value of the corresponding sector signal sample based on the diffraction and reflection perception model (diffraction model and reflection model), and the amplitude change value is used as a weight to multiply the corresponding DTW result.
[0107] This embodiment discloses a wireless perception method based on GNSS signals, including reconstructing the amplitude and phase of the signal using the original GNSS measurement values, perception model analysis based on diffraction and reflection, and multi-GNSS signal fusion human motion recognition. Specifically, the amplitude and phase of the signal are reconstructed from the original GNSS measurement values such as the cumulative carrier phase and carrier-to-noise power density ratio reported by the GNSS module. Based on the reconstructed phase and reconstructed amplitude, a perception model based on diffraction and reflection is established to further analyze the relationship between the signal change characteristics and human motion. The collected signal change characteristics are compared with the reference signal characteristics corresponding to the action through a dynamic time warping algorithm, and the comparison results are weighted and summed according to the satellite's azimuth and elevation signals, thereby achieving fine-grained human motion recognition.
[0108] This embodiment provides a wireless sensing method based on GNSS signals, including: reconstructing the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain the reconstructed amplitude and the reconstructed phase; analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain diffraction samples and reflection samples; comparing the diffraction samples and reflection samples with the reference signal samples based on the dynamic time warping algorithm to obtain the dynamic time warping calculation results; determining the action recognition result of the target object according to the dynamic time warping calculation results. In this embodiment, the amplitude and phase of the original GNSS measurement value are used to further analyze the relationship between the signal change characteristics and human body movements based on the diffraction and reflection perception model, and the collected samples are compared with the reference signal samples through the dynamic time warping algorithm to realize multi-GNSS signal fusion human body movement recognition. This embodiment uses GNSS signals for wireless sensing, which effectively improves the wireless sensing coverage, and because the GNSS signal is always present, there is no need to equip additional deployment transmitters, which is conducive to deploying applications in a variety of outdoor environments and realizing fine-grained human body movement recognition.
[0109] In addition, an embodiment of the present invention further proposes a storage medium, on which a wireless sensing program based on GNSS signals is stored. When the wireless sensing program based on GNSS signals is executed by a processor, the steps of the wireless sensing method based on GNSS signals as described above are implemented.
[0110] Reference Figure 8 , Figure 8 This is a structural block diagram of an embodiment of a wireless sensing system based on GNSS signals of the present invention.
[0111] like Figure 8 As shown, the wireless sensing system based on GNSS signals includes:
[0112] A signal reconstruction module 10 is used to reconstruct the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain a reconstructed amplitude and a reconstructed phase;
[0113] A perception analysis module 20, configured to analyze the reconstructed amplitude and the reconstructed phase based on a diffraction and reflection perception model to obtain a diffraction sample and a reflection sample;
[0114] The motion recognition module 30 is used to compare the diffraction sample and the reflection sample with the reference signal sample based on the dynamic time warping algorithm to obtain a dynamic time warping calculation result;
[0115] The result output module 40 is used to determine the action recognition result of the target object according to the dynamic time warping calculation result.
[0116] In one embodiment, the signal reconstruction module 10 is specifically used to: obtain the GNSS original measurement value of the target object reported by the GNSS module; wherein the GNSS original measurement value includes a carrier-to-noise power density ratio and a cumulative carrier phase measurement value; reconstruct the amplitude of the GNSS signal according to the carrier-to-noise power density ratio and the signal amplitude reconstruction formula to obtain the reconstructed amplitude; reconstruct the phase of the GNSS signal according to the cumulative carrier phase measurement value and the phase change formula to obtain the reconstructed phase.
[0117] In one embodiment, the signal amplitude reconstruction formula is:
[0118]
[0119] Where Amplitude is the reconstruction amplitude; C / N 0 is the carrier-to-noise power density ratio.
[0120] In one embodiment, the signal reconstruction module 10 is specifically used to: calculate the satellite motion speed and the unit direction vector between the satellite and the receiver based on the satellite ephemeris information; calculate the phase influence parameter of the satellite motion on the GNSS signal based on the satellite motion speed and the unit direction vector; obtain the clock error of the receiver based on the least squares positioning algorithm and the pseudorange in the GNSS original measurement value; reconstruct the phase of the GNSS signal based on the accumulated carrier phase measurement value, the phase influence parameter, the clock error of the receiver and the phase change formula to obtain the reconstructed phase.
[0121] In one embodiment, the phase change formula is:
[0122] φ tar (k)=φ(k)-φ(k-1)+φ d (k)-c(t b (k)-t b (k-1))
[0123] Among them, φ tar (k) is the reconstructed phase; φ is the accumulated carrier phase measurement value; φ d is the phase influence parameter of satellite motion on GNSS signal; c is the speed of light; t b is the receiver clock error.
[0124] In one embodiment, the perception analysis module 20 is specifically used to: construct a diffraction and reflection perception model of the GNSS signal; determine whether the GNSS signal is a signal that has experienced a diffraction effect or a signal that has experienced a reflection effect according to the azimuth angle of the satellite; if the GNSS signal is a signal that has experienced a reflection effect, then analyze the reconstruction amplitude and the reconstruction phase based on the diffraction and reflection perception model to obtain a reflection sample; if the GNSS signal is a signal that has experienced a diffraction effect, then analyze the reconstruction amplitude and the reconstruction phase based on the diffraction and reflection perception model to obtain a diffraction sample.
[0125] In one embodiment, the action recognition module 30 is specifically used to: determine the sky distribution map of the satellite based on the azimuth and elevation information reported by the GNSS module, and divide the sky distribution map into multiple sectors; select the signal with the largest amplitude change value of the satellite in each of the sectors as the sector signal sample; compare the diffraction sample and the reflection sample of each of the sector signal samples with the reference signal sample based on the dynamic time warping algorithm to obtain the calculation result of each sector; perform weighted summation on the calculation results of the sectors to obtain the dynamic time warping calculation result.
[0126] In one embodiment, the action recognition module 30 is specifically used to: analyze the diffraction samples and reflection samples of each of the sector signal samples based on the diffraction and reflection perception model to obtain the diffraction amplitude change value and the reflection amplitude change value; obtain the calculation result of each sector based on the dynamic time warping algorithm according to each of the sector signal samples, the diffraction amplitude change value, the reflection amplitude change value and the reference signal sample; wherein the calculation result is the action most similar to the reference signal sample.
[0127] This embodiment discloses a wireless perception system based on GNSS signals, including reconstructing the amplitude and phase of the signal using the original GNSS measurement values, perceptual model analysis based on diffraction and reflection, and multi-GNSS signal fusion human motion recognition. Specifically, the system reconstructs the amplitude and phase of the signal from the original GNSS measurement values such as the cumulative carrier phase and carrier-to-noise power density ratio reported by the GNSS module. Based on the reconstructed phase and reconstructed amplitude, the system establishes a perception model based on diffraction and reflection to further analyze the relationship between signal change characteristics and human motion. The system compares the collected signal change characteristics with the reference signal characteristics corresponding to the action through the dynamic time warping algorithm (Dynamic Time Warping, DTW), and performs weighted summation on the comparison results according to the satellite's azimuth and elevation signals, thereby achieving fine-grained human motion recognition.
[0128] In this embodiment, the amplitude and phase of the original GNSS measurement values are used to further analyze the relationship between the signal change characteristics and human motion based on the diffraction and reflection perception model, and the collected samples are compared with the reference signal samples through the dynamic time warping algorithm to realize multi-GNSS signal fusion human motion recognition. This embodiment uses GNSS signals for wireless perception, which effectively improves the wireless perception coverage. Since GNSS signals are always present, there is no need to equip additional transmitters, which is conducive to deploying applications in a variety of outdoor environments and realizing fine-grained human motion recognition.
[0129] It should be noted that the technical details that are not described in detail in the embodiment of the wireless sensing system based on GNSS signals can be found in the wireless sensing method based on GNSS signals as described above provided in any embodiment of the present invention, and will not be repeated here.
[0130] In addition, to achieve the above-mentioned purpose, the present invention also proposes an electronic device, which includes: a memory, a processor, and a wireless sensing program based on GNSS signals stored in the memory and executable on the processor, wherein the wireless sensing program based on GNSS signals is configured to implement the wireless sensing method based on GNSS signals as described above.
[0131] Reference Fig. 9 , Fig. 9 The figure is a schematic diagram of the structure of an electronic device of the hardware operating environment involved in the embodiment of the present invention.
[0132] like Fig. 9 As shown, the electronic device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (Wireless-Fidelity, Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM memory) or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0133] Those skilled in the art will understand that Fig. 9 The structure shown in the figure does not constitute a limitation on the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0134] like Fig. 9 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a wireless sensing program based on GNSS signals.
[0135] exist Fig. 9 In the electronic device shown, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the electronic device of the present invention can be set in the electronic device, and the electronic device calls the wireless perception program based on GNSS signals stored in the memory 1005 through the processor 1001, and executes the wireless perception method based on GNSS signals provided in an embodiment of the present invention.
[0136] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.
[0137] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.
[0138] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0139] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0140] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0141] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A wireless sensing method based on GNSS signals, characterized in that: include: Reconstructing the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain a reconstructed amplitude and a reconstructed phase; Analyzing the reconstructed amplitude and the reconstructed phase based on a diffraction and reflection perception model to obtain a diffraction sample and a reflection sample; Comparing the diffraction sample and the reflection sample with the reference signal sample based on a dynamic time warping algorithm to obtain a dynamic time warping calculation result; The action recognition result of the target object is determined according to the dynamic time warping calculation result.
2. The method according to claim 1, characterized in that The reconstructing the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain the reconstructed amplitude and the reconstructed phase includes: Obtaining GNSS raw measurement values of the target object reported by the GNSS module; wherein the GNSS raw measurement values include a carrier-to-noise power density ratio and an accumulated carrier phase measurement value; Reconstructing the amplitude of the GNSS signal according to the carrier-to-noise power density ratio and the signal amplitude reconstruction formula to obtain a reconstructed amplitude; The phase of the GNSS signal is reconstructed according to the accumulated carrier phase measurement value and the phase change formula to obtain a reconstructed phase.
3. The method according to claim 2, characterized in that The signal amplitude reconstruction formula is: Where Amplitude is the reconstruction amplitude; C / N0 is the carrier-to-noise power density ratio.
4. The method according to claim 2, characterized in that The reconstructing the phase of the GNSS signal according to the accumulated carrier phase measurement value and the phase change formula to obtain the reconstructed phase includes: The satellite motion speed and the unit direction vector between the satellite and the receiver are calculated based on the satellite ephemeris information; Calculating a phase influence parameter of the satellite motion on the GNSS signal according to the satellite motion speed and the unit direction vector; Obtaining a clock error of the receiver based on a least squares positioning algorithm and a pseudorange in the original GNSS measurement value; The phase of the GNSS signal is reconstructed according to the accumulated carrier phase measurement value, the phase influencing parameter, the clock error of the receiver and a phase change formula to obtain a reconstructed phase.
5. The method according to claim 4, characterized in that The phase change formula is: φtar(k)φ(k)φ(k1)+φa(k)C(t(k)t(k-1))where φ tar (k) is the reconstructed phase; φ is the accumulated carrier phase measurement value; φd is the phase effect parameter of the satellite motion on the GNSS signal; c is the speed of light; t b is the receiver clock error.
6. The method according to any one of claims 1 to 5, characterized in that The step of analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain a diffraction sample and a reflection sample includes: Construct a diffraction and reflection perception model for GNSS signals; Determining whether the GNSS signal is a signal that has undergone a diffraction effect or a signal that has undergone a reflection effect according to the azimuth angle of the satellite; If the GNSS signal is a signal that experiences a reflection effect, analyzing the reconstructed amplitude and the reconstructed phase based on the diffraction and reflection perception model to obtain a reflection sample; If the GNSS signal is a signal that experiences a diffraction effect, the reconstructed amplitude and the reconstructed phase are analyzed based on the diffraction and reflection perception model to obtain a diffraction sample.
7. The method according to any one of claims 1 to 5, characterized in that The step of comparing the diffraction sample and the reflection sample with the reference signal sample based on the dynamic time warping algorithm to obtain a dynamic time warping calculation result includes: Determine a sky distribution map of the satellite based on the azimuth and elevation information reported by the GNSS module, and divide the sky distribution map into a plurality of sectors; Selecting the signal with the largest amplitude change value of the satellite in each sector as the sector signal sample; Comparing the diffraction sample and the reflection sample of each sector signal sample with the reference signal sample based on a dynamic time warping algorithm to obtain a calculation result of each sector; The calculation results of the sectors are weighted summed to obtain a dynamic time warping calculation result.
8. The method according to claim 7, characterized in that The method of comparing the diffraction sample and the reflection sample of each sector signal sample with the reference signal sample based on the dynamic time warping algorithm to obtain the calculation result of each sector includes: Analyzing the diffraction sample and the reflection sample of each sector signal sample based on the diffraction and reflection perception model to obtain a diffraction amplitude change value and a reflection amplitude change value; Based on the dynamic time warping algorithm, the calculation result of each sector is obtained according to each sector signal sample, the diffraction amplitude change value, the reflection amplitude change value and the reference signal sample; wherein the calculation result is the action most similar to the reference signal sample.
9. A wireless sensing system based on GNSS signals, characterized in that: include: A signal reconstruction module is used to reconstruct the amplitude and phase of the GNSS signal according to the original GNSS measurement value of the target object to obtain a reconstructed amplitude and a reconstructed phase; A perception analysis module, used to analyze the reconstructed amplitude and the reconstructed phase based on a diffraction and reflection perception model to obtain a diffraction sample and a reflection sample; An action recognition module, used for comparing the diffraction sample and the reflection sample with the reference signal sample based on a dynamic time warping algorithm to obtain a dynamic time warping calculation result; A result output module is used to determine the action recognition result of the target object according to the dynamic time warping calculation result.
10. The system according to claim 9, characterized in that The signal reconstruction module is specifically used to: obtain the GNSS original measurement value of the target object reported by the GNSS module; wherein the GNSS original measurement value includes the carrier-to-noise power density ratio and the accumulated carrier phase measurement value; Reconstructing the amplitude of the GNSS signal according to the carrier-to-noise power density ratio and the signal amplitude reconstruction formula to obtain a reconstructed amplitude; The phase of the GNSS signal is reconstructed according to the accumulated carrier phase measurement value and the phase change formula to obtain a reconstructed phase.
Citation Information
Patent Citations
Highly integrated GPS, GALILEO and inertial navigation system
CN101765787A
Indoor satellite positioning method and system for multipath error correction
CN114779298A
Method and apparatus for processing radionavigation signals for atmospheric monitoring
EP2924468A1
Tunnel detection system and method for a motor vehicle
US20190250280A1
3D lidar aided global navigation satellite system and the method for non-line-of-sight detection and correction
US20230033404A1
