Heartbeat detection methods, devices, electronic equipment and storage media

Abstract

This application relates to the field of wireless communication technology, and provides a heartbeat detection method, apparatus, electronic device, and storage medium. The method includes: determining the spatial channel between an edge computing gateway and each target device within a first target area to obtain first breathing information sensed by the spatial channel; determining a second target area where a first object is located based on the first breathing information sensed by the spatial channel; detecting second breathing information of the first object within the second target area using millimeter-wave radar; and determining a second object based on the first and second breathing information, and detecting the heartbeat information of the second object. This application improves the accuracy and efficiency of heartbeat detection by sensing the approximate location of the target in a stationary state through indoor spatial channel sensing connection, and then controlling the millimeter-wave radar to perform heartbeat detection.

Description

Technical Field

[0001] This application relates to the field of wireless communication technology, and in particular to a heartbeat detection method, apparatus, electronic device, and storage medium. Background Technology

[0002] Respiratory and heartbeat signals are important indicators in modern medical testing. Monitoring the characteristic parameters of heartbeat and respiratory signals provides doctors with reliable diagnostic and treatment basis.

[0003] Currently, contact-based detection technologies are mainly used to detect respiratory and heartbeat signals. These technologies rely on wearable sensors or adhesive electrodes that directly contact the user's body to monitor these signals. However, this method requires the user to wear or attach these sensors, making it complex and restricting their movement. Therefore, contactless detection technologies have been proposed, such as millimeter-wave radar for detecting respiratory and heartbeat signals. However, this method suffers from difficulties in target alignment with narrow beams, insufficient energy density with wide beams, and limited detection range. Summary of the Invention

[0004] This application provides a heartbeat detection method, apparatus, electronic device, and storage medium to solve the problem of heartbeat detection. It uses an indoor space channel sensing connection to sense the approximate position of the target in a stationary state, and then controls a millimeter-wave radar to perform heartbeat detection, thereby improving the accuracy and efficiency of heartbeat detection.

[0005] This application provides a heartbeat detection method, including:

[0006] Determine the spatial channel between the edge computing gateway and each target device within the first target area to obtain the first breathing information sensed by the spatial channel;

[0007] Based on the first respiratory information sensed by the spatial channel, the second target area where the first object is located is determined;

[0008] Millimeter-wave radar is used to detect the second respiratory information of the first object within the second target area;

[0009] Based on the first respiratory information and the second respiratory information, a second object is identified, and the heartbeat information of the second object is detected.

[0010] In one embodiment, detecting the heartbeat information of the second object includes:

[0011] Detect the heartbeat signals of the second object in multiple directions;

[0012] Determine the heartbeat signal sensing signal-to-noise ratio for each heartbeat signal, and determine the target sensing direction based on the heartbeat signal sensing signal-to-noise ratio;

[0013] Based on the target perception direction, the heartbeat information of the second object is detected.

[0014] In one embodiment, detecting the heartbeat information of the second object based on the target perception direction includes:

[0015] Based on the target perception direction, detect the heartbeat information of the second object within a set time period;

[0016] If the heartbeat information detected within the set time is lower than the set threshold, then the step of using millimeter-wave radar to detect the second respiratory information of the first object within the second target area is executed.

[0017] In one embodiment, acquiring the first respiratory information sensed by the spatial channel includes:

[0018] Obtain the phase change information of the spatial channel;

[0019] Based on the phase change information, the first breathing information sensed by the spatial channel is determined.

[0020] In one embodiment, the step of using millimeter-wave radar to detect the second respiratory information of the first object within the second target area includes:

[0021] Using the millimeter-wave radar, electromagnetic wave signals are sent to the first object within the second target area;

[0022] The echo signal of the electromagnetic wave signal is received, and the second respiratory information of the first object is determined based on the echo signal.

[0023] In one embodiment, determining the second target region where the first object is located based on the first respiratory information sensed by the spatial channel includes:

[0024] Based on the location information of the edge computing gateway and each target device, as well as the first breathing information of the spatial channel perception, the relative location information of the first object is determined;

[0025] Based on the relative position information of the first object, the second target area where the first object is located is determined.

[0026] In one embodiment, determining the second object based on the first respiratory information and the second respiratory information includes:

[0027] Determine the matching information between the first respiratory information and the second respiratory information;

[0028] Based on the matching information, the second object is identified.

[0029] This application also provides a heartbeat detection device, comprising:

[0030] The first respiratory information determination module is used to determine the spatial channel between the edge computing gateway and each target device within the first target area, so as to obtain the first respiratory information sensed by the spatial channel.

[0031] The second target area determination module is used to determine the second target area where the first object is located based on the first respiratory information sensed by the spatial channel.

[0032] The second respiratory information determination module is used to detect the second respiratory information of the first object within the second target area using millimeter-wave radar.

[0033] The heartbeat detection module is used to identify a second object based on the first respiratory information and the second respiratory information, and to detect the heartbeat information of the second object.

[0034] This application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement any of the heartbeat detection methods described above.

[0035] This application also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the heartbeat detection method as described above.

[0036] The heartbeat detection method, apparatus, electronic device, and storage medium provided in this application obtain first respiratory information sensed by spatial channel perception by determining the spatial channel between the edge computing gateway and each target device within a first target area; based on the first respiratory information sensed by spatial channel perception, determine the second target area where the first object is located; use millimeter-wave radar to detect the second respiratory information of the first object within the second target area; and based on the first and second respiratory information, determine the second object and detect the heartbeat information of the second object. This application improves the accuracy and efficiency of heartbeat detection by sensing the approximate location of the target in a stationary state through indoor spatial channel perception and then controlling the millimeter-wave radar to perform heartbeat detection. Attached Figure Description

[0037] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0038] Figure 1This is one of the flowcharts of the heartbeat detection method provided in this application;

[0039] Figure 2 This is the second flowchart of the heartbeat detection method provided in this application;

[0040] Figure 3 This is a schematic diagram of the deployment scenario for indoor personnel heartbeat sensing and monitoring using millimeter-wave radar provided in this application;

[0041] Figure 4 This is a schematic diagram of moving target sensing based on a star-shaped radiation channel provided in this application;

[0042] Figure 5 This is a schematic diagram of the intelligent device provided in this application detecting and reporting the channel status information of surrounding STAs;

[0043] Figure 6 This is a schematic diagram of the heartbeat detection device provided in this application;

[0044] Figure 7 This is a schematic diagram of the structure of the electronic device provided in this application. Detailed Implementation

[0045] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0046] The following is combined with Figures 1-7 This application describes a heartbeat detection method, apparatus, electronic device, and storage medium.

[0047] Specifically, this application provides a heartbeat detection method, referring to... Figure 1 , Figure 1 This is one of the flowcharts of the heartbeat detection method provided in this application.

[0048] The heartbeat detection method provided in this application includes:

[0049] S100, determine the spatial channel between the edge computing gateway and each target device within the first target area, so as to obtain the first breathing information sensed by the spatial channel;

[0050] It should be noted that the heartbeat detection method provided in this application embodiment is applied to detect the heartbeat of people indoors. For example, it can be applied to home care and nursing home scenarios to track the indoor activity area of ​​the elderly, perceive the heartbeat of the elderly in sitting or lying positions, and predict the health status of the elderly based on the heartbeat pattern using an artificial intelligence model, and automatically issue an alarm when there is a possibility of danger.

[0051] The first target area refers to the area to be detected, such as indoor activity areas like rooms, living rooms, and studies; the edge computing gateway can be a 5G edge computing gateway; the target device can be a device with intelligent sensing capabilities, such as a smart TV, smart refrigerator, smart air conditioner, or smart speaker; the spatial channel refers to the communication channel between the edge computing gateway and the target device, that is, a data signal transmission channel that uses wireless signals as the transmission carrier.

[0052] The first target area deploys various communication devices, such as a 5G edge computing gateway (or a 5G home base station) and multiple target devices connected to the gateway. Simultaneously, an object movement module and a breathing sensing module are added to the channel estimation module of the 5G edge computing gateway's wireless signal receiver to detect indoor object movement and breathing information. In this scenario, various detection and reporting information will converge at the 5G edge computing gateway and devices with intelligent sensing capabilities. By utilizing a home sensing network formed by numerous smart home devices connected to the 5G edge computing gateway, sensing data can remain within the home, protecting home privacy. Furthermore, related alarms and other actions are processed by the intelligent devices before being sent to the network.

[0053] The spatial channels between the edge computing gateway and each target device within the first target area are determined. For example, after a smart speaker, smartphone, and smart refrigerator are connected to the 5G edge computing gateway, three spatial channel sensing connections are formed, i.e., spatial channels. At this time, the first breathing information sensed by each spatial channel is acquired, where the first breathing information refers to the breathing information of the first object within the first target area. For example, the phase change information sensed by each spatial channel is acquired, and based on this phase change information, the first breathing information of the first object within the first target area is determined.

[0054] S200, based on the first respiratory information sensed by the spatial channel, determine the second target area where the first object is located;

[0055] It should be noted that the first object refers to the person located in the first target area, and the second target area refers to the location of the first object. The first target area includes the second target area.

[0056] After determining the first breathing information sensed by each spatial channel, the second target area where the first object is located is determined based on the first breathing information and the location information of each communication node.

[0057] S300, using millimeter-wave radar to detect the second respiratory information of the first object within the second target area;

[0058] It should be noted that the second respiratory information refers to the respiratory information of the first object located within the second target area.

[0059] By deploying one or more heartbeat-sensing millimeter-wave radars at a relatively high position in the center of an indoor space, and by providing the millimeter-wave radars with a rough estimate of the position of a person in a stationary state, the millimeter-wave radars can perform local searches to detect the optimal spatial angle for heartbeat sensing, thereby achieving the perception and monitoring of the target's heartbeat.

[0060] Specifically, a millimeter-wave radar is used to send electromagnetic wave signals to the second target area, and then the second breathing information of the first object is determined based on the echo signal of the electromagnetic wave signal.

[0061] S400, based on the first respiratory information and the second respiratory information, determine the second object and detect the heartbeat information of the second object.

[0062] The first and second respiratory information are matched. If the first and second respiratory information match successfully, the object of the second respiratory information is determined to be the second object. At the same time, the heartbeat information of the second object is detected by millimeter-wave radar.

[0063] The heartbeat detection method provided in this application embodiment determines the spatial channel between the edge computing gateway and each target device within a first target area to obtain first respiratory information sensed by the spatial channel; based on the first respiratory information sensed by the spatial channel, it determines a second target area where a first object is located; it uses millimeter-wave radar to detect the second respiratory information of the first object within the second target area; and based on the first and second respiratory information, it determines a second object and detects the heartbeat information of the second object. This application improves the accuracy and efficiency of heartbeat detection by sensing the approximate location of the target in a stationary state through indoor spatial channel sensing and then controlling the millimeter-wave radar to perform heartbeat detection.

[0064] Based on the above embodiments, detecting the heartbeat information of the second object includes:

[0065] S410, Detect the heartbeat signal of the second object in multiple directions;

[0066] S420, determine the heartbeat signal sensing signal-to-noise ratio for each heartbeat signal, and determine the target sensing direction based on the heartbeat signal sensing signal-to-noise ratio;

[0067] S430, based on the target perception direction, detect the heartbeat information of the second object.

[0068] After identifying the second target, the millimeter-wave radar scans to obtain respiratory and heartbeat sensing information from multiple directions. Since the heartbeat signal is much weaker than the respiratory signal, it's necessary to select the beam with the best heartbeat sensing effect from multiple candidate sources. For example, for multiple spatial directions where heartbeats can be sensed, the direction with the highest "heartbeat signal-to-noise ratio (HBSNR)" is chosen as the optimal heartbeat sensing area (i.e., the target sensing direction). If the optimal heartbeat sensing area is found, heartbeat detection is performed. For instance, the beam is fixed in the direction of the optimal heartbeat sensing area, and heartbeat detection is conducted for a period of time. If the detection signal is interrupted during the detection process, the optimal heartbeat sensing area is redefined. If a heartbeat signal meeting the conditions (i.e., the respiratory information detected by the millimeter-wave radar is the same as the respiratory information detected by the centimeter-wave system, such as the same frequency and phase) is not found within a certain time, or if both the heartbeat and respiratory signals disappear, the process returns to coarse target localization.

[0069] Optionally, when the centimeter-wave system updates the "coarse target location" information, the millimeter-wave radar is restarted to search for the optimal heartbeat sensing area; when the heartbeat information quality is below a threshold, the millimeter-wave radar is restarted to search for the optimal heartbeat sensing area.

[0070] This application embodiment improves the accuracy of heartbeat detection by using the "heartbeat signal-to-noise ratio (HBSNR)" to find the optimal sensing location.

[0071] Based on the above embodiments, obtaining the first respiratory information sensed by the spatial channel includes:

[0072] S210, Obtain the phase change information of the spatial channel;

[0073] S220, Based on the phase change information, determine the first breathing information sensed by the spatial channel.

[0074] It should be noted that the channel estimation module of the wireless signal receiver in the 5G edge computing gateway is used to estimate the frequency response of the wireless channel from the transmitting antenna to the receiving antenna. Based on the received sequence, which has undergone phase and amplitude distortion due to channel influences and is superimposed with Gaussian white noise, the transmission characteristics of the channel in the frequency or time domain are determined. Therefore, the channel estimation module can obtain the phase change information of each spatial channel, and then, based on the phase change information, determine the first breathing information for spatial channel sensing.

[0075] For targets that breathe, such as humans or pets, the phase change pattern in channel estimation can be used to sense respiratory movements. For example, suppose the frequency obtained from the channel estimation of the reference signal RS is:

[0076]

[0077] Among them, h i,j ω represents the channel gain, and ω represents the subcarrier frequency of the reference signal RS. This represents the phase rotation value obtained from channel estimation. It is obtained through continuous detection. Record the data and perform bandpass filtering centered on the breathing frequency. When a stationary target is present, the frequency of the breathing action can be detected.

[0078] Optionally, based on independent or blind-cell separation algorithms, by setting different respiratory frequency thresholds and respiratory amplitudes, the respiratory signals of humans and pets such as cats and dogs can be separated. Furthermore, using a Kalman filter, it is possible to track the respiratory signals of specific targets.

[0079] This application's embodiments improve the accuracy of respiratory information perception by utilizing the phase change law in channel estimation to perceive respiratory motion.

[0080] Based on the above embodiments, the step of using millimeter-wave radar to detect the second respiratory information of the first object within the second target area includes:

[0081] S440, using the millimeter-wave radar, an electromagnetic wave signal is sent to the first object within the second target area;

[0082] S450, receive the echo signal of the electromagnetic wave signal, and determine the second respiratory information of the first object based on the echo signal.

[0083] It should be noted that current non-contact detection of heartbeat signals is typically based on millimeter-wave radar technology. However, due to the propagation loss of millimeter waves and the need for transmission power to meet human radiation safety requirements, the current range at which millimeter-wave radar can detect heartbeat movement is limited. Therefore, this application's embodiments utilize coarse target location information to narrow the target search range of the millimeter-wave radar, thereby reducing target search time and improving the efficiency of target detection.

[0084] After coarsely locating the first object in the first target area, i.e., determining the second target area where the first object is located, the millimeter-wave radar is activated. The millimeter-wave radar sends electromagnetic wave signals to the first object in the second target area, and then receives the echo signals of the electromagnetic wave signals. Based on the echo signals, the second respiratory information of the first object is determined. For example, the echo signals are processed to analyze the heartbeat and respiratory information of the first object.

[0085] This application embodiment utilizes coarse target location information to narrow the target search range of millimeter-wave radar, thereby reducing the target search time and improving the efficiency of target detection.

[0086] Based on the above embodiments, determining the second target region where the first object is located based on the first respiratory information sensed by the spatial channel includes:

[0087] S230, based on the location information of the edge computing gateway and each target device, and the first breathing information of the spatial channel perception, determine the relative position information of the first object;

[0088] S240, based on the relative position information of the first object, determine the second target area where the first object is located.

[0089] Using a 5G edge computing gateway as the control center, this gateway needs to support relative position detection of Wi-Fi STA devices accessing it in the Sub 6GHz band. For one or more "spatial channel-aware connections," the relative position of the target in the indoor space can be obtained using the nodes associated with these connections.

[0090] Specifically, based on the location information of the edge computing gateway and each target device, as well as the first breathing information from spatial channel sensing, the relative location information of the first object is determined. Then, based on the relative location information of the first object, the second target area where the first object is located is determined. For example, the 5G edge computing gateway uses detection and reporting information from various wireless communication nodes of different systems indoors, as well as the absolute location of the nodes (e.g., detection and positioning based on the 5G edge computing gateway), or the relative location (e.g., the topological relationship between nodes), to build an indoor sensing environment model through the sensing application built into the 5G edge computing gateway. Once the target enters, coarse positioning information of the target can be provided based on the relative positions of multiple positioning reference points in the environment, such as wireless printers, laptops, and mobile phones.

[0091] This application embodiment utilizes spatial channel sensing connections and the location information of each device to perform coarse positioning of the first object, thereby preparing for millimeter-wave radar target detection and improving the efficiency and accuracy of millimeter-wave radar target detection.

[0092] Based on the above embodiments, determining the second object based on the first respiratory information and the second respiratory information includes:

[0093] S460, determine the matching information between the first respiratory information and the second respiratory information;

[0094] S470, Based on the matching information, determine the second object.

[0095] When millimeter-wave radar detects a suspected target, it compares the target's breathing information detected by the millimeter-wave radar with the breathing information detected by the centimeter-wave system to achieve mapping and information merging of the two systems' target detection. Specifically, it determines the matching information between the first and second breathing information, and then determines the second target based on the matching information. For example, it determines the breathing waveforms (including frequency, phase, etc.) of the first and second breathing information respectively, and determines the matching degree of the two breathing waveforms. If the matching degree is greater than a set threshold (such as 98%), it means that the first and second breathing information match, and the object of the second breathing information is determined as the second target.

[0096] This application embodiment compares the respiratory information of the target detected by millimeter-wave radar with the respiratory information detected by the centimeter-wave system to identify a second object, thereby achieving precise target positioning and improving the accuracy of heartbeat detection.

[0097] To further explain the heartbeat detection method of this application, please refer to... Figure 2 This application specifically proposes a method for indoor personnel heartbeat sensing and monitoring based on millimeter-wave radar with wireless connection. This method is applicable to the sensing and monitoring of personnel heartbeats in indoor scenes and includes the following steps:

[0098] Step 1: Detect whether anyone has entered the monitored area.

[0099] Before performing heartbeat detection on the bedroom of an elderly person living at home or in a nursing home, it is necessary to determine the target's location within the monitoring area.

[0100] Optionally, one deployment environment applicable to the embodiments of this application is as follows: Figure 1 As shown:

[0101] The monitored area is equipped with various communication devices, such as an indoor (5G) home base station and multiple terminals connected to the base station. Additionally, an object movement module and a human breathing detection module are added to the channel estimation module of the home base station's wireless signal receiver. The system then operates as follows:

[0102] 1) Determining if there are moving objects in the current monitoring area. For example, using Fresnel effect-based target sensing technology, this technology determines whether there are moving objects in the current environment by judging the changes in the reference signal phase in the downlink channel state information output by the channel estimation module in the receiver and setting rules. If there are no moving objects in the current environment, the signal phase is basically stable, and this signal phase needs to be filtered and smoothed. When a moving target enters the monitoring area, the signal phase exhibits irregular and drastic changes. At this time, the zero-crossing rate of the filtered signal can be used to determine whether there is a moving target in the monitoring area.

[0103] 2) When a person's position is relatively fixed, such as when they sit or lie down, the phase change of the signal will disappear. For targets that breathe, such as humans or pets, the phase change pattern in channel estimation can be used to sense breathing movements. For example, suppose the frequency obtained from the channel estimation of the reference signal RS is:

[0104]

[0105] Among them, h i,j ω represents the channel gain, and ω represents the subcarrier frequency of the reference signal RS. This represents the phase rotation value obtained from channel estimation. It is obtained through continuous detection. Record the data and perform bandpass filtering centered on the breathing frequency. When a stationary target is present, the frequency of the breathing action can be detected.

[0106] Based on independent or blind-cell separation algorithms, respiratory signals from humans and pets such as cats and dogs can be separated by setting different respiratory frequency thresholds and respiratory amplitudes. Optionally, by using a Kalman filter, it is possible to further track the respiratory signals of specific targets.

[0107] Furthermore, the above scenario can be extended as follows:

[0108] The determination of a target entering the monitoring area can be achieved through home base stations, terminals, and Wi-Fi devices deployed in the home. Since this function involves observing and processing phase changes in the channel estimation results, the built-in Wi-Fi modules in smart devices that are already widely deployed in the home environment can be used to sense and detect the coherent environment of multiple wireless channels in different directions within the home environment.

[0109] Based on the above ideas, this application proposes a method for collecting sensing information based on a 5G terminal computing gateway. This method collects sensing information from various devices connected to the 5G terminal computing gateway, specifically the aforementioned "continuously detected phase recording," to obtain moving target sensing information in areas related to star-shaped radiation paths within an indoor environment. Figure 3As shown.

[0110] Wi-Fi modules installed in smart home appliances can utilize multiple different Wi-Fi STA modules within the same monitoring area. They typically also support signal detection of adjacent STAs, meaning that the channel estimation modules on different STAs can be used to obtain the status information of another set of star-shaped radiation channels. For example... Figure 4 As shown, the smart speaker detects the channel status information of surrounding STAs and reports it to the AP. Here, STA stands for Station, which refers to each terminal connected to the wireless network, such as laptops, mobile phones and other networked user devices; AP stands for Access Point, which is the creator of a wireless network and the central node of the network. A wireless router used in a home or office is generally an AP.

[0111] Based on the above analysis, a 5G edge computing gateway deployed indoors can make full use of the relevant indoor channel status information provided by various connected wireless devices to achieve the perception of moving targets in the environment.

[0112] Furthermore, the above methods can be extended to 5G networks:

[0113] Assuming the monitored environment contains various devices such as 5G edge computing gateways and 5G smartphones, within the 5G network, the 5G edge computing gateway can report the detected channel state information between itself and the 5G smartphone to the base station, forming more spatial channel-aware connections. This channel state information can be the detection result of sidelink (i.e., the transmission link between devices) channels, or the detection result of signals such as SRS (Sounding Reference Signal).

[0114] In the current scenario, various detection and reporting information will be aggregated on devices such as 5G terminal computing gateways, or on devices with intelligent sensing capabilities. This type of home sensing network can ensure that sensing data does not leave the home, thus protecting family privacy. At the same time, relevant alarms and other actions are processed by the intelligent device before being sent to the network.

[0115] Step 2: Coarse target localization.

[0116] Using the aforementioned 5G edge computing gateway as the control center, this gateway needs to support relative position detection of Wi-Fi STA-type devices accessing it in the Sub 6GHz band. For one or more of the aforementioned "spatial channel-aware connections," the relative position of the target in the indoor space can be obtained using the nodes associated with these connections. Specifically, the 5G edge computing gateway uses detection and reporting information from various wireless communication nodes of different systems within the indoor environment, as well as the absolute position of the nodes (e.g., detection and positioning based on the 5G edge computing gateway) or relative position (e.g., the topological relationship between nodes), to establish an indoor sensing environment model through the sensing applications built into the 5G edge computing gateway. Once a target enters, coarse positioning information of the target can be provided based on the relative positions of multiple positioning reference points in the environment, such as wireless printers, laptops, and mobile phones.

[0117] It should be noted that current non-contact detection of heartbeat signals is usually based on millimeter-wave radar technology. Due to the influence of millimeter-wave propagation loss and the requirement that the transmission power must meet the human body radiation safety requirements, the current range of millimeter-wave radar in detecting heartbeat movement is limited. Typically, one or more heartbeat sensing millimeter-wave radars are deployed at a relatively high position in the center of an indoor space.

[0118] This application embodiment employs a millimeter-wave radar supporting multiple detection beams, utilizing sensing beam gain to increase the sensing range and reduce power consumption. Since this application embodiment can support linear array radars such as 3Tx4Rx, and also 4D radars with more TxRx beams, a hybrid analog-digital radar with a passive phase shifter is used to achieve a balance between performance and cost. As the number of millimeter-wave radar antennas increases, the main lobe width of the beam becomes significantly narrower, resulting in higher resolution and better detection performance, but the difficulty of aligning with the target also increases accordingly. Based on this, this application embodiment utilizes coarse target azimuth information to narrow the target search range of the millimeter-wave radar, enabling the (hybrid analog-digital) millimeter-wave radar to reduce target search time and quickly locate the sensing target. Specifically, this application embodiment uses a centimeter-wave system to locate indoor breathing targets. The centimeter-wave wavelength range is 10cm-1cm, and the frequency range is 3-30GHz. The communication between the 5G terminal computing gateway and the smart device can be centimeter-wave communication.

[0119] Once the approximate location of the breathing target is detected based on centimeter waves, the triggering condition is met, and the process proceeds to step 3. If the target cannot be located within the target area within a certain period of time, the process returns to step 1.

[0120] Step 3: Activate millimeter-wave radar to search for the optimal heartbeat sensing area.

[0121] Millimeter-wave radar searches for target areas based on the following mechanisms: For linear array radars such as 3Tx and 4Rx, mechanical gimbals are typically required to support pointing detection within a certain range. For multi-TxRx 4D radars, a fixed deployment method can be used, utilizing beam scanning for searching.

[0122] When the millimeter-wave radar detects a suspected target, it compares the target's breathing information detected by the millimeter-wave radar with the breathing information detected by the centimeter-wave system to achieve the mapping and merging of target detection information from the two systems.

[0123] For the target area given in step 2, the millimeter-wave radar can obtain respiratory and heartbeat sensing information in multiple directions through scanning. Since the heartbeat signal is much weaker than the respiratory signal, it is necessary to select the beam with the best heartbeat signal sensing effect from multiple candidate heartbeat sensing sources. For example, for multiple spatial directions where heartbeats can be sensed, the direction with the largest "heartbeat signal sensing signal-to-noise ratio (HBSNR)" is taken as the optimal heartbeat sensing area. If the optimal heartbeat sensing area is found, proceed to step 4; if a heartbeat signal that meets the conditions is not found within a certain time (i.e., the respiratory information detected by the millimeter-wave radar is the same as the respiratory information detected by the centimeter-wave system, such as the same frequency and phase) or both the heartbeat and respiratory signals disappear, return to step 2.

[0124] Step 4, heart rate detection.

[0125] The beam is fixed in the direction of the optimal heartbeat sensing area, and heartbeat detection is performed for a period of time. If the detection signal is interrupted during the detection process, the process will return to step 3 to search again.

[0126] When the centimeter-wave system updates the "coarse target location" information, the millimeter-wave radar needs to return to step 3 for relocation; when the heartbeat information quality is below the threshold, the millimeter-wave radar needs to return to step 3 for relocation.

[0127] Step 5: When the stopping conditions are met, shut down the millimeter-wave radar.

[0128] This application embodiment establishes a "spatial channel sensing connection" using a centimeter-wave communication system. First, coarse target localization is performed to narrow the search space. Then, millimeter-wave radar searches the area. When the millimeter-wave radar detects a suspected target, the respiratory information detected by the millimeter-wave radar is compared with the respiratory information detected by the centimeter-wave system, achieving target mapping and information merging between the two systems. Simultaneously, precise localization and heartbeat sensing are achieved based on the signal-to-noise ratio criterion of heartbeat signal sensing. Based on this, the accuracy of heartbeat detection is improved.

[0129] Figure 6This is a schematic diagram of the heartbeat detection device provided in this application, with reference to... Figure 6 The embodiments of this application provide a heartbeat detection device, including a first respiratory information determination module 601, a second target area determination module 602, a second respiratory information determination module 603, and a heartbeat detection module 604.

[0130] The first respiratory information determination module 601 is used to determine the spatial channel between the edge computing gateway and each target device within the first target area, so as to obtain the first respiratory information sensed by the spatial channel.

[0131] The second target area determination module 602 is used to determine the second target area where the first object is located based on the first respiratory information sensed by the spatial channel.

[0132] The second respiratory information determination module 603 is used to detect the second respiratory information of the first object within the second target area using millimeter-wave radar.

[0133] The heartbeat detection module 604 is used to determine the second object based on the first breathing information and the second breathing information, and to detect the heartbeat information of the second object.

[0134] The heartbeat detection device provided in this application obtains first respiratory information sensed by spatial channel perception by determining the spatial channel between the edge computing gateway and each target device within a first target area; based on the first respiratory information sensed by spatial channel perception, it determines a second target area where a first object is located; it uses millimeter-wave radar to detect the second respiratory information of the first object within the second target area; and based on the first and second respiratory information, it determines a second object and detects the heartbeat information of the second object. This application improves the accuracy and efficiency of heartbeat detection by sensing the approximate location of the target in a stationary state through indoor spatial channel perception and then controlling the millimeter-wave radar to perform heartbeat detection.

[0135] In one embodiment, the heartbeat detection module 604 specifically includes:

[0136] Detect the heartbeat signals of the second object in multiple directions;

[0137] Determine the heartbeat signal sensing signal-to-noise ratio for each heartbeat signal, and determine the target sensing direction based on the heartbeat signal sensing signal-to-noise ratio;

[0138] Based on the target perception direction, the heartbeat information of the second object is detected.

[0139] In one embodiment, the heartbeat detection module 604 specifically includes:

[0140] Based on the target perception direction, detect the heartbeat information of the second object within a set time period;

[0141] If the heartbeat information detected within the set time is lower than the set threshold, then the step of using millimeter-wave radar to detect the second respiratory information of the first object within the second target area is executed.

[0142] In one embodiment, the second target region determination module 602 specifically includes:

[0143] Obtain the phase change information of the spatial channel;

[0144] Based on the phase change information, the first breathing information sensed by the spatial channel is determined.

[0145] In one embodiment, the second respiratory information determination module 603 specifically includes:

[0146] Using the millimeter-wave radar, electromagnetic wave signals are sent to the first object within the second target area;

[0147] The echo signal of the electromagnetic wave signal is received, and the second respiratory information of the first object is determined based on the echo signal.

[0148] In one embodiment, the second target region determination module 602 specifically includes:

[0149] Based on the location information of the edge computing gateway and each target device, as well as the first breathing information of the spatial channel perception, the relative location information of the first object is determined;

[0150] Based on the relative position information of the first object, the second target area where the first object is located is determined.

[0151] In one embodiment, the heartbeat detection module 604 specifically includes:

[0152] Determine the matching information between the first respiratory information and the second respiratory information;

[0153] Based on the matching information, the second object is identified.

[0154] Figure 7 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 7 As shown, the electronic device may include: a processor 710, a communication interface 720, a memory 730, and a communication bus 740, wherein the processor 710, the communication interface 720, and the memory 730 communicate with each other through the communication bus 740. The processor 710 can call logical instructions in the memory 730 to execute a heartbeat detection method, which includes:

[0155] Determine the spatial channel between the edge computing gateway and each target device within the first target area to obtain the first breathing information sensed by the spatial channel;

[0156] Based on the first respiratory information sensed by the spatial channel, the second target area where the first object is located is determined;

[0157] Millimeter-wave radar is used to detect the second respiratory information of the first object within the second target area;

[0158] Based on the first respiratory information and the second respiratory information, a second object is identified, and the heartbeat information of the second object is detected.

[0159] Furthermore, the logical instructions in the aforementioned memory 730 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0160] On the other hand, this application also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, is implemented to perform the heartbeat detection methods provided by the above methods, the method comprising:

[0161] Determine the spatial channel between the edge computing gateway and each target device within the first target area to obtain the first breathing information sensed by the spatial channel;

[0162] Based on the first respiratory information sensed by the spatial channel, the second target area where the first object is located is determined;

[0163] Millimeter-wave radar is used to detect the second respiratory information of the first object within the second target area;

[0164] Based on the first respiratory information and the second respiratory information, a second object is identified, and the heartbeat information of the second object is detected.

[0165] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0166] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0167] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for detecting heartbeat, characterized in that, include: Determine the spatial channel between the edge computing gateway and each target device within the first target area to obtain the first breathing information sensed by the spatial channel; The first target area refers to the area to be detected; Based on the first respiratory information sensed by the spatial channel, a second target area is determined where the first object is located; the first object refers to a person located in the first target area. Millimeter-wave radar is used to detect the second respiratory information of the first object within the second target area; Based on the first respiratory information and the second respiratory information, a second object is identified, and the heartbeat information of the second object is detected; The second object refers to the heartbeat detection target determined after verification of respiratory information; The acquisition of the first respiratory information sensed by the spatial channel includes: Obtain the phase change information of the spatial channel; Based on the phase change information, the first breathing information sensed by the spatial channel is determined; The determination of the second target region where the first object is located based on the first respiratory information sensed by the spatial channel includes: Based on the location information of the edge computing gateway and each target device, as well as the first breathing information of the spatial channel perception, the relative location information of the first object is determined; Based on the relative position information of the first object, the second target area where the first object is located is determined.

2. The heartbeat detection method according to claim 1, characterized in that, The detection of the heartbeat information of the second object includes: Detect the heartbeat signals of the second object in multiple directions; Determine the heartbeat signal sensing signal-to-noise ratio for each heartbeat signal, and determine the target sensing direction based on the heartbeat signal sensing signal-to-noise ratio; Based on the target perception direction, the heartbeat information of the second object is detected.

3. The heartbeat detection method according to claim 2, characterized in that, The step of detecting the heartbeat information of the second object based on the target perception direction includes: Based on the target perception direction, detect the heartbeat information of the second object within a set time period; If the heartbeat information detected within the set time is lower than the set threshold, then the step of using millimeter-wave radar to detect the second respiratory information of the first object within the second target area is executed.

4. The heartbeat detection method according to claim 1, characterized in that, The method of using millimeter-wave radar to detect the second respiratory information of the first object within the second target area includes: Using the millimeter-wave radar, electromagnetic wave signals are sent to the first object within the second target area; The echo signal of the electromagnetic wave signal is received, and the second respiratory information of the first object is determined based on the echo signal.

5. The heartbeat detection method according to claim 1, characterized in that, The step of determining the second object based on the first respiratory information and the second respiratory information includes: Determine the matching information between the first respiratory information and the second respiratory information; Based on the matching information, the second object is identified.

6. A heartbeat detection device, characterized in that, include: The first respiratory information determination module is used to determine the spatial channel between the edge computing gateway and each target device within the first target area, so as to obtain the first respiratory information sensed by the spatial channel. The first target area refers to the area to be detected; The second target area determination module is used to determine the second target area where the first object is located based on the first respiratory information sensed by the spatial channel; the first object refers to a person located in the first target area. The second respiratory information determination module is used to detect the second respiratory information of the first object within the second target area using millimeter-wave radar. The heartbeat detection module is used to determine a second object based on the first respiratory information and the second respiratory information, and to detect the heartbeat information of the second object; the second object refers to the heartbeat detection target determined after verification of the respiratory information. The first respiratory information determination module is further configured to acquire phase change information of the spatial channel; and determine the first respiratory information sensed by the spatial channel based on the phase change information. The second target area determination module is further configured to determine the relative position information of the first object based on the position information of the edge computing gateway and each target device, as well as the first breathing information of the spatial channel perception. Based on the relative position information of the first object, the second target area where the first object is located is determined.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the heartbeat detection method as described in any one of claims 1 to 5.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the heartbeat detection method as described in any one of claims 1 to 5.

Images