Millimeter wave radar heart rate detection method based on multi-channel distance window fusion
Through the combination of multi-channel distance window fusion and variational mode decomposition principal component analysis, the accuracy problem of millimeter-wave radar heartbeat detection in the deviation situation is solved, and high-precision heart rate estimation is achieved.
Patent Information
- Application Number
- CN202411153292.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-21
- Publication Date
- 2024-11-26
AI Technical Summary
The existing heartbeat detection method based on millimeter-wave radar is difficult to ensure the accuracy of heart rate estimation when the research subject is close to the perception boundary of the millimeter-wave radar and deviates from the radar.
Using the multi-channel distance window fusion method, the distance and angle between the measured object and the millimeter wave radar is calculated, and the appropriate distance window is selected, and combined with variational mode decomposition and principal component analysis, the respiratory harmonic interference is eliminated, thereby extracting Heart rate.
When the subjects approached the millimeter-wave radar perception boundary and deviated, the accuracy of heartbeat detection was improved, errors were reduced, and high-precision heart rate estimation was achieved.
Smart Images

Figure CN119014845A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the fields of millimeter wave radar, wireless sensor and heart rate detection. Background Art
[0002] As one of the most important life indicators, heartbeat can reflect not only a person's physical condition but also a person's psychological changes. Traditional heartbeat detection methods require the use of contact sensors, such as electrocardiograms or pulse oximeters. Although these sensors can obtain very accurate heart rates, they bring great inconvenience to humans, especially for patients with burns or infections. In order to overcome the limitations of contact sensors and realize ubiquitous heartbeat detection, many non-contact heartbeat detection methods have emerged in recent years.
[0003] Non-contact heartbeat detection methods can be completed using different signals, such as sound, visible light, infrared, and electromagnetic waves. Compared with other types of signals, electromagnetic waves have obvious advantages in privacy protection and environmental robustness. Most non-contact heartbeat detection methods use electromagnetic waves for heart rate detection, such as WiFi, millimeter wave radar, and ultra-wideband radar. Millimeter wave radar has significant advantages in achieving the accuracy of heartbeat detection due to its shorter wavelength, larger bandwidth, and fine-grained perception capabilities.
[0004] In recent years, many heartbeat monitoring systems based on millimeter-wave radar have been proposed. For example, Fengyu Wang et al. from the University of Maryland used bandpass filters and FFT to process millimeter-wave radar data and estimate the heart rate of the subjects in a paper titled Vimo: Multiperson vital sign monitoring using commodity millimeter-wave radio published in IEEE Internet of Things Journal. Fengyu Wang et al. from the University of Science and Technology of China estimated the heart rate by reconstructing the second harmonic of the heartbeat in a paper titled Driver vital signs monitoring using millimeter wave radio published in 2023IEEE International Conference on Acoustics, Speech and Signal Processing. Xiangyu Xu et al. from Shanghai Jiao Tong University used a method based on hierarchical variational mode decomposition (VMD) to extract heartbeat signals from millimeter-wave radar data in a paper titled mmecg: Monitoring human cardiac cycle in driving environments leveraging millimeter wave published in IEEE Conference on Computer Communications. Toan K. Vo Dai et al. from the University of Tennessee, Knoxville, published a paper titled Remote Vital Sign Monitoring With Reduced Random Body Swaying Motion Using Heartbeat Template and Wavelet Transform Based on Constellation Diagrams in IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology. The paper first amplified the heartbeat signal through a heartbeat template and continuous wavelet transform, and then estimated the heart rate based on a spectral method.
[0005] However, when the research object is close to the millimeter wave radar perception boundary and deviates from the millimeter wave radar, the above method will produce a large heartbeat detection error. In actual situations, the position of the research object often changes, and in most cases it is close to the millimeter wave radar perception boundary and deviates from the radar. The purpose of the present invention is to achieve high-precision heartbeat detection in such a situation where the human body is close to the millimeter wave radar perception boundary and deviates from the millimeter wave radar. Summary of the invention
[0006] When the research object is close to the perception boundary of the millimeter-wave radar and deviates from the millimeter-wave radar, the existing methods cannot guarantee the accuracy of heart rate estimation. In order to accurately estimate the heart rate when it is close to the perception boundary of the millimeter-wave radar and deviates from the millimeter-wave radar, the present invention proposes a millimeter-wave radar heart rate detection method based on multi-channel distance window fusion. The method designed by the present invention first collects the heartbeat information of the object under test through millimeter-wave radar technology in an indoor environment and mixes the transmit signal and the receive signal of the millimeter-wave radar to obtain the intermediate frequency signal on all channels. Then, by calculating the distance and angle between the object under test and the millimeter-wave radar, a suitable distance window across the target chest cavity in all channels is selected. Finally, the interference of respiratory harmonics on the heartbeat frequency is eliminated by a method based on a combination of variational mode decomposition and principal component analysis, thereby extracting the heart rate. The specific technical scheme is as follows:
[0007] During the measurement process, the transmitting antenna of the MIMO millimeter-wave radar continuously transmits radar signals to the human body, and after contacting the human body, a reflected signal is generated and received by the receiving antenna. Since the MIMO millimeter-wave radar has multiple transmitting antennas and multiple receiving antennas, multiple channels of radar data are ultimately generated.
[0008] The present invention is a millimeter wave radar heart rate detection method based on multi-channel range window fusion, which specifically includes the following steps:
[0009] Step 1: In an indoor environment, the heartbeat information of the object under test is collected by millimeter wave radar technology and the transmission signal and the receiving signal of the millimeter wave radar are mixed to obtain the intermediate frequency signal on all channels;
[0010] Step 2: Select the appropriate distance window across the target chest in all channels by calculating the distance and angle between the object under test and the millimeter wave radar;
[0011] Step 3: Eliminate the interference of respiratory harmonics on heart rate by combining variational mode decomposition and principal component analysis to extract the heart rate.
[0012] In step 2, the appropriate distance window across the target chest cavity in all channels is selected by calculating the distance and angle between the object under test and the millimeter wave radar, specifically:
[0013] Step 2-1: First, for each channel (T p ,R q ) performs FFT operation on each chirp of the intermediate frequency signal (i.e., millimeter wave chirp signal) to obtain the range domain signal. For each channel (T p ,R q ), where T p represents the pth transmitting antenna, R q represents the qth receiving antenna, (T p ,R q ) represents the path between the p-th transmitting antenna and the q-th receiving antenna;
[0014] Step 2-2: Then use the MTI (Moving Target Indicator) method on all chirps at each distance point on the range domain signal of each channel to remove the static component;
[0015] Step 2-3: For each distance point, find the sum of the squares of the amplitudes of all chirps in the distance domain signal at that point. The sum of the squares of the amplitudes of the signal at the distance point under all chirps is obtained and regarded as the total energy at the distance point. Among all channels, find the optimal channel with the largest total energy (T p* ,R q* ) and the optimal distance point n*, and then the distance between the measured object and the radar is obtained according to the distance resolution and the optimal distance point, recorded as d obj ;
[0016] Step 2-4: Select two channels, one of which is the optimal channel in distance measurement (T p* ,R q* ), and the other is the channel adjacent to its receiving antenna (T p* ,R q*+1 );
[0017] Step 2-5: Calculate the phase difference between the two channels at the peak of the same chirp, and calculate the angle between the object under test and the radar based on the phase difference, which is recorded as θ;
[0018] Step 2-6: Select a distance window across the chest, that is, a suitable distance window, which can be divided into two parts: a basic distance window and an additional distance window; specifically:
[0019] The first step is to calculate the range of the chest of the object under test on the distance domain signal based on the distance and angle between the object under test and the radar. The calculation formula is:
[0020]
[0021] Where L c is the width of the human chest cavity, is the radian value of the angle θ;
[0022] The second step is to obtain the number of range windows N that span the chest of the measured object based on the range resolution. b , and then according to each channel (T i ,R j ) is the distance window of the maximum total energy in Each channel (T i ,R j ) is:
[0023]
[0024] Where n is the range window number;
[0025] The third step is to calculate the total energy of the range domain signal in each basic range window. Find E in each channel i,j,n The minimum total energy is denoted as
[0026] In the fourth step, the total energy threshold of the additional range window is set to γ can be set to 0.9. If the total energy of the range window around the basic range window is greater than this threshold, it is an additional range window. i ,R j ) is the additional range window sequence
[0027] Furthermore, in step 3, the interference of respiratory harmonics on the heart rate is eliminated by combining variational mode decomposition and principal component analysis, so as to extract the heart rate, specifically:
[0028] Step 3-1: For each channel (T i ,R j ), first extract the phase of the range domain signal, perform phase unwrapping, and calculate the phase difference between adjacent chirps;
[0029] Step 3-2: Then the distance window sequence is The phase difference signal φ i,j,m (n) performing variational mode decomposition;
[0030] Step 3-3: Perform Fourier transform on the decomposed modal component IMF to convert it into a frequency domain signal, and find the modal component IMF with the largest amplitude in each appropriate distance window of each channel through frequency domain analysis and the corresponding frequency point is within the heartbeat frequency range of [0.8, 2] Hz;
[0031] Step 3-4: Since the phase difference signal mainly contains the target's vital signs information, if there are more than one IMFs, select the IMF with the highest correlation with the phase difference signal as the heartbeat signal, recorded as in
[0032] Step 3-5: By applying the same range window from all channels Perform principal component analysis, and then calculate the principal component comprehensive vector Z for each appropriate distance window by the weight of each principal component n ;
[0033] Step 3-6: Principal component synthesis vector Z n Perform FFT and select the frequency point with the largest amplitude in the frequency domain signal of all suitable distance windows, and use this frequency point as the estimated heart rate f of the target * .
[0034] The beneficial effect of the present invention is that the present invention makes full use of radar data of multiple channels of MIMO millimeter wave, and solves the problem of low heartbeat detection accuracy when the object under test is close to the perception boundary of the millimeter wave radar and deviates from the millimeter wave radar with lower complexity. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] Figure 1 Schematic diagram of a millimeter-wave radar heart rate detection method based on multi-channel range window fusion.
[0036] Figure 2 Schematic diagram of the heart rate estimation accuracy of the present invention and the system mmEGC and HBT-CWT at different distances.
[0037] Figure 3 Schematic diagram of the heart rate estimation accuracy of the present invention and the system mmEGC and HBT-CWT at different angles. DETAILED DESCRIPTION
[0038] The following will disclose the embodiments of the present invention with drawings. For the purpose of clear description, many practical details will be described together in the following description. However, it should be understood that these practical details should not be used to limit the present invention. That is to say, in some embodiments of the present invention, these practical details are not necessary.
[0039] The technical solution of the present invention is further described in detail below in conjunction with the accompanying drawings. Figure 1After MIMO millimeter waves are transmitted to the human body and receive reflected signals, radar data of multiple channels are generated. For all channels, the present invention first collects the heartbeat information of the object under test by millimeter wave radar technology in an indoor environment and mixes the transmission signal and the reception signal of the millimeter wave radar to obtain the intermediate frequency signal on all channels. Then, by calculating the distance and angle between the object under test and the millimeter wave radar, a suitable distance window across the target chest cavity in all channels is selected. Finally, the interference of respiratory harmonics on the heartbeat frequency is eliminated by a method based on a combination of variational mode decomposition and principal component analysis, thereby extracting the heart rate. The measurement method of the present invention specifically includes the following steps:
[0040] Step 1: In an indoor environment, the heartbeat information of the object under test is collected by millimeter wave radar technology and the transmission signal and the receiving signal of the millimeter wave radar are mixed to obtain the intermediate frequency signal on all channels;
[0041] Step 2: Select the appropriate distance window across the target chest in all channels by calculating the distance and angle between the object under test and the millimeter wave radar. The specific steps are as follows:
[0042] Step 2-1: First, for each channel (T p ,R q ) performs FFT operation on each chirp of the intermediate frequency signal (i.e., millimeter wave chirp signal) to obtain the range domain signal. For each channel (T p ,R q ), where T p represents the pth transmitting antenna, R q represents the qth receiving antenna, (T p ,R q ) represents the path between the p-th transmitting antenna and the q-th receiving antenna;
[0043] Step 2-2: Then use the MTI (Moving Target Indicator) method on all chirps at each distance point on the range domain signal of each channel to remove the static component;
[0044] Step 2-3: For each distance point, find the sum of the squares of the amplitudes of all chirps in the distance domain signal at that point. The sum of the squares of the amplitudes of the signal at the distance point under all chirps is obtained and regarded as the total energy at the distance point. Among all channels, find the optimal channel with the largest total energy (T p* ,R q* ) and the optimal distance point n*, and then the distance between the measured object and the radar is obtained according to the distance resolution and the optimal distance point, recorded as d obj ;
[0045] Step 2-4: Select two channels, one of which is the optimal channel in distance measurement (T p* ,R q* ), and the other is the channel adjacent to its receiving antenna (T p* ,R q*+1 );
[0046] Step 2-5: Calculate the phase difference between the two channels at the peak of the same chirp, and calculate the angle between the object under test and the radar based on the phase difference, which is recorded as θ;
[0047] Step 2-6: Select a distance window across the chest, that is, a suitable distance window, which can be divided into two parts: a basic distance window and an additional distance window; specifically:
[0048] The first step is to calculate the range of the chest of the object under test on the distance domain signal based on the distance and angle between the object under test and the radar. The calculation formula is:
[0049]
[0050] Where L c is the width of the human chest cavity, is the radian value of the angle θ;
[0051] The second step is to obtain the number of range windows N that span the chest of the measured object based on the range resolution. b , and then according to each channel (T i ,R j ) is the distance window of the maximum total energy in Each channel (T i ,R j ) is:
[0052]
[0053] Where n is the range window number;
[0054] The third step is to calculate the total energy of the range domain signal in each basic range window. Find E in each channel i,j,n The minimum total energy is denoted as
[0055] In the fourth step, the total energy threshold of the additional range window is set to γ can be set to 0.9. If the total energy of the range window around the basic range window is greater than this threshold, it is an additional range window. i ,R j ) is the additional range window sequence
[0056] Step 3: Eliminate the interference of respiratory harmonics on heart rate by combining variational mode decomposition and principal component analysis to extract heart rate. The specific steps are as follows:
[0057] Step 3-1: For each channel (T i ,R j ), first extract the phase of the range domain signal, perform phase unwrapping, and calculate the phase difference between adjacent chirps;
[0058] Step 3-2: Then the distance window sequence is The phase difference signal φ i,j,m (n) performing variational mode decomposition;
[0059] Step 3-3: Perform Fourier transform on the decomposed modal component IMF to convert it into a frequency domain signal, and find the modal component IMF with the largest amplitude in each appropriate distance window of each channel through frequency domain analysis and the corresponding frequency point is within the heartbeat frequency range of [0.8, 2] Hz;
[0060] Step 3-4: Since the phase difference signal mainly contains the target's vital signs information, if there are more than one IMFs, select the IMF with the highest correlation with the phase difference signal as the heartbeat signal, recorded as in
[0061] Step 3-5: By applying the same range window from all channels Perform principal component analysis, and then calculate the principal component comprehensive vector Z for each appropriate distance window by the weight of each principal component n ;
[0062] Step 3-6: Principal component synthesis vector Z n Perform FFT and select the frequency point with the largest amplitude in the frequency domain signal of all suitable distance windows, and use this frequency point as the estimated heart rate f of the target * .
[0063] In order to verify the effect of the present invention, the inventors conducted two sets of experiments. The present invention uses the MIMO millimeter wave radar developed by TI as the sensing front end, and uses a laptop computer to process data in the background. The radar model used is IWR6843, which has 3 transmitting antennas and 4 receiving antennas, and the sensing heartbeat boundary is four to five meters.
[0064] The environment in which the data is collected by the present invention is an indoor environment. During the experiment, the distance between the experimental subject and the radar increased from 1m to 4m. At each distance, the chest of the experimental subject was basically at the same height as the radar. The deviation angle between the experimental subject and the radar gradually increased from 0° to 45°. While measuring the radar data, the experimental subject wore a pulse oximeter to obtain the real heart rate of the human body to further verify the accuracy of the system designed by the present invention.
[0065] The first set of experiments: In order to evaluate whether the present invention can effectively improve the accuracy of heart rate estimation at different distances, the present invention placed the object facing the radar and then compared it with two latest systems, mmEGC and HBT-CWT, at different distances. The experimental results are as follows: Figure 2 As shown (the estimated results under each distance setting are the average values under the corresponding angle).
[0066] The second set of experiments: In order to evaluate whether the present invention can effectively improve the accuracy of heart rate estimation in different orientations, the present invention fixed the distance between the object to be measured and the radar to 4 meters, and then compared it with two latest systems, mmEGC and HBT-CWT, in different orientations. The experimental results are as follows Figure 3 As shown (the estimated results under each angle setting are the average values under the corresponding angle).
[0067] The above description is only an embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent substitution, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.
Claims
1. A millimeter wave radar heart rate detection method based on multi-channel range window fusion, characterized in that: The heart rate estimation method comprises the following steps: Step 1: In an indoor environment, the heartbeat information of the object under test is collected by millimeter wave radar technology and the transmission signal and the receiving signal of the millimeter wave radar are mixed to obtain the intermediate frequency signal on all channels; Step 2: Select the appropriate distance window across the target chest in all channels by calculating the distance and angle between the object under test and the millimeter wave radar; Step 3: Eliminate the interference of respiratory harmonics on heart rate by combining variational mode decomposition and principal component analysis to extract the heart rate.
2. The method for detecting heart rate by millimeter wave radar based on multi-channel range window fusion according to claim 1, characterized in that: The step 2 specifically includes the following steps: Step 2-1: First, for each channel (T p ,R q ) performs FFT operation on each chirp of the intermediate frequency signal (i.e., millimeter wave chirp signal) to obtain the range domain signal. For each channel (T p ,R q ), where T p represents the pth transmitting antenna, R q represents the qth receiving antenna, (T p ,R q ) represents the path between the p-th transmitting antenna and the q-th receiving antenna; Step 2-2: Then use the MTI (Moving Target Indicator) method on all chirps at each distance point on the range domain signal of each channel to remove the static component; Step 2-3: For each distance point, find the sum of the squares of the amplitudes of all chirps in the distance domain signal at that point. The sum of the squares of the amplitudes of the signal at the distance point under all chirps is obtained and regarded as the total energy at the distance point. Among all channels, find the optimal channel with the largest total energy (T p* ,R q* ) and the optimal distance point n*, and then the distance between the measured object and the radar is obtained according to the distance resolution and the optimal distance point, recorded as d obj ; Step 2-4: Select two channels, one of which is the optimal channel in distance measurement (T p* ,R q* ), and the other is the channel adjacent to its receiving antenna (T p* ,R q*+1 ); Step 2-5: Calculate the phase difference between the two channels at the peak of the same chirp, and calculate the angle between the object under test and the radar based on the phase difference, which is recorded as θ; Step 2-6: Select a distance window across the chest, that is, a suitable distance window, which can be divided into two parts: a basic distance window and an additional distance window; specifically: Step 2-6-1: Calculate the range of the chest of the object under test on the range domain signal based on the distance and angle between the object under test and the radar. The calculation formula is: Where L c is the width of the human chest cavity, is the radian value of the angle θ; Step 2-6-2: Obtain the number of range windows N that span the chest of the object being measured based on the range resolution b , and then according to each channel (T i ,R j ) is the distance window of the maximum total energy in Each channel (T i ,R j ) is: Where n is the range window number; Step 2-6-3: Calculate the total energy of the range domain signal in each basic range window Find E in each channel i,j,n The minimum total energy is denoted as Step 2-6-4: Set the total energy threshold of the additional range window to γ can be set to 0.
9. If the total energy of the range window around the basic range window is greater than this threshold, it is an additional range window. i ,R j ) is the additional range window sequence 3. The method for detecting heart rate by millimeter wave radar based on multi-channel range window fusion according to claim 1, characterized in that: The step 3 specifically includes the following steps: Step 3-1: For each channel (T i ,R j ), first extract the phase of the range domain signal, perform phase unwrapping, and calculate the phase difference between adjacent chirps; Step 3-2: Then the distance window sequence is The phase difference signal φ i,j,m (n) performing variational mode decomposition; Step 3-3: Perform Fourier transform on the decomposed modal component IMF to convert it into a frequency domain signal, and find the modal component IMF with the largest amplitude in each appropriate distance window of each channel through frequency domain analysis and the corresponding frequency point is within the heartbeat frequency range of [0.8, 2] Hz; Step 3-4: Since the phase difference signal mainly contains the target's vital signs information, if there are more than one IMFs, select the IMF with the highest correlation with the phase difference signal as the heartbeat signal, recorded as in Step 3-5: By applying the same range window from all channels Perform principal component analysis, and then calculate the principal component comprehensive vector Z for each appropriate distance window by the weight of each principal component n ; Step 3-6: Principal component synthesis vector Z n Perform FFT and select the frequency point with the largest amplitude in the frequency domain signal of all suitable distance windows, and use this frequency point as the estimated heart rate f of the target * .
