Vital sign signal monitoring method and related apparatus

Abstract

The application discloses a kind of vital sign signal monitoring method and related device, belong to intelligent driving field.The method includes: the phase of each sample frequency point corresponding in multiple sample frequency points is unfolded, to obtain multiple target phases, according to the time sequence corresponding to the multiple sample frequency points, every adjacent two target phases in the multiple target phases are subtracted, to obtain multiple phase differences, determine radar life signal based on the multiple phase differences, determine vital sign signal based on the radar life signal.Because the heart fluctuation corresponding to adjacent time in heartbeat waveform, or the chest fluctuation corresponding to adjacent time in respiratory waveform is all related to the phase difference between two phases corresponding to adjacent time.So, radar life signal determined based on the multiple phase differences is more accurate, so that vital sign signal can be accurately determined based on the radar life signal, to guarantee the safety of vehicle driving in this way.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of intelligent driving, and in particular, to a vital sign signal monitoring method and related device. BACKGROUND

[0002] With the development of vehicle intelligence, the requirements of drivers for safe driving of vehicles are continuously improved. For example, a vehicle can monitor road conditions through a radar installed outside the vehicle to obtain relative speed, relative distance, relative angle and other road condition information between the vehicle and surrounding vehicles, so that the driver can control the vehicle based on the road condition information, thereby improving the safety of vehicle driving. However, in some cases, when the vital sign signal of the driver is abnormal, it will also affect the safety of vehicle driving. Therefore, how to monitor the vital sign signal has become a problem to be solved at present. SUMMARY

[0003] The present application provides a vital sign signal monitoring method and related device, which can solve the problem that related technologies cannot monitor vital sign signals. The technical solution is as follows:

[0004] On the one hand, a vital sign signal monitoring method is provided, a radar is installed in a vehicle, the radar is used to monitor the vital sign signal of a person in the vehicle, and the method comprises:

[0005] Phase unfolding is performed on the phase corresponding to each sample frequency point in a plurality of sample frequency points to obtain a plurality of target phases, each target phase is located in a target phase range, the radar signal strength corresponding to each sample frequency point is located in a target strength range, and the frequency corresponding to each sample frequency point is located in a target frequency range;

[0006] According to the time sequence of the plurality of sample frequency points, each adjacent two target phases in the plurality of target phases are subtracted to obtain a plurality of phase differences;

[0007] A radar vital signal is determined based on the plurality of phase differences, the radar vital signal comprises at least one of a heartbeat waveform and a breathing waveform, the heartbeat waveform is used to indicate cardiac fluctuation, and the breathing waveform is used to indicate thoracic fluctuation;

[0008] A vital sign signal is determined based on the radar vital signal, in a case where the radar vital signal comprises a heartbeat waveform, the vital sign signal comprises a heartbeat frequency, and in a case where the radar vital signal comprises a breathing waveform, the vital sign signal comprises a breathing frequency.

[0009] Optionally, the radar vital signal is determined based on the plurality of phase differences, comprising:

[0010] inputting the plurality of phase differences into a band-pass filter having a target band-pass frequency to obtain a radar vital signal output by the band-pass filter.

[0011] Optionally, before the determining the radar vital signal based on the plurality of phase differences, the method further comprises:

[0012] rejecting phase differences greater than a phase difference threshold from the plurality of phase differences.

[0013] Optionally, before the phase unwrapping the phase corresponding to each sample frequency point in the plurality of sample frequency points to obtain a plurality of target phases, the method further comprises:

[0014] performing Fourier transform on the time-domain echo signal received by the radar to obtain a frequency-domain echo signal;

[0015] drawing a time-frequency spectrogram based on the time-domain echo signal and the frequency-domain echo signal;

[0016] determining a spectral region in which a radar signal strength is within the target strength range and a frequency is within the target frequency range from the time-frequency spectrogram;

[0017] selecting the plurality of sample frequency points from the spectral region and determining the phase corresponding to each sample frequency point from the time-domain echo signal.

[0018] Optionally, after the determining the vital sign signal based on the radar vital signal, the method further comprises:

[0019] generating an alarm information in a case that the vehicle is in a driving state and the vital sign signal is not within a target vital sign signal range;

[0020] controlling the vehicle to brake based on the alarm information after the alarm information lasts for a preset time length.

[0021] Optionally, after the determining the vital sign signal based on the radar vital signal, the method further comprises:

[0022] acquiring an in-vehicle temperature and / or vehicle unlocking information in a case that the vehicle is not in a driving state and the vital sign signal is not zero;

[0023] generating an alarm information in a case that the in-vehicle temperature is not within a target temperature range or the vehicle unlocking information indicates illegal unlocking.

[0024] In another aspect, a vital sign signal monitoring device is provided, a radar is installed in a vehicle, the radar is used to monitor a vital sign signal of a person in the vehicle, and the device comprises:

[0025] a phase unwrapping module, configured to perform phase unwrapping on the phase corresponding to each of the plurality of sample frequency points to obtain a plurality of target phases, each of the target phases being within a target phase range, the radar signal strength corresponding to each of the plurality of sample frequency points being within a target strength range, and the frequency corresponding to each of the plurality of sample frequency points being within a target frequency range;

[0026] a phase subtraction module, configured to subtract each two adjacent target phases in the plurality of target phases according to a time sequence of the plurality of sample frequency points to obtain a plurality of phase differences;

[0027] a first determination module, configured to determine a radar life signal based on the plurality of phase differences, the radar life signal comprising at least one of a heartbeat waveform and a breathing waveform, the heartbeat waveform being used to indicate heart fluctuation, and the breathing waveform being used to indicate chest fluctuation;

[0028] a second determination module, configured to determine a vital sign signal based on the radar life signal, the vital sign signal comprising a heartbeat frequency in a case where the radar life signal comprises the heartbeat waveform, and the vital sign signal comprising a breathing frequency in a case where the radar life signal comprises the breathing waveform.

[0029] Optionally, the first determination module is specifically configured to:

[0030] input the plurality of phase differences into a band-pass filter having a target band-pass frequency to obtain the radar life signal output by the band-pass filter.

[0031] Optionally, the apparatus further comprises:

[0032] a rejection module, configured to reject a phase difference greater than a phase difference threshold in the plurality of phase differences.

[0033] Optionally, the apparatus further comprises:

[0034] a transformation module, configured to perform Fourier transform on the time-domain echo signal received by the radar to obtain a frequency-domain echo signal;

[0035] a drawing module, configured to draw a time-frequency spectrogram based on the time-domain echo signal and the frequency-domain echo signal;

[0036] a third determination module, configured to determine, from the time-frequency spectrogram, a frequency spectrum region in which the radar signal strength is within the target strength range and the frequency is within the target frequency range;

[0037] a selection module, configured to select the plurality of sample frequency points from the frequency spectrum region, and determine the phase corresponding to each of the plurality of sample frequency points from the time-domain echo signal.

[0038] Optionally, the apparatus further comprises:

[0039] The first generating module is configured to generate an alarm information when the vehicle is in a driving state and the vital sign signal is not in a target vital sign signal range.

[0040] The control module is configured to control braking of the vehicle based on the alarm information when the alarm information lasts for a preset time length.

[0041] Optionally, the device further comprises:

[0042] The acquisition module is configured to acquire an in-vehicle temperature and / or vehicle unlocking information when the vehicle is not in a driving state and the vital sign signal is not zero.

[0043] The second generating module is configured to generate an alarm information when the in-vehicle temperature is not in a target temperature range or the vehicle unlocking information indicates illegal unlocking.

[0044] In another aspect, a vehicle is provided, the vehicle is installed with a radar for monitoring a vital sign signal of a person in the vehicle, the vehicle comprises a memory and a processor, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory to realize the steps of the vital sign signal monitoring method.

[0045] In another aspect, a computer readable storage medium is provided, the storage medium stores a computer program, and the computer program is executed by a processor to realize the steps of the vital sign signal monitoring method.

[0046] In another aspect, a computer program product containing instructions is provided, when the instructions are run on a computer, the computer is caused to execute the steps of the vital sign signal monitoring method.

[0047] The technical scheme provided in the application can bring at least the following beneficial effects:

[0048] Since the adjacent time corresponding heart fluctuation in the heartbeat waveform or the adjacent time corresponding chest fluctuation in the breathing waveform are related to the phase difference between two phases corresponding to the adjacent time, the radar vital signal determined based on the plurality of phase differences is more accurate, and thus the vital sign signal can be accurately determined based on the radar vital signal, so as to guarantee the safety of vehicle driving. BRIEF DESCRIPTION OF DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0050] Figure 1 is a flow chart of a vital sign signal monitoring method provided by an embodiment of the present application;

[0051] Figure 2 is a schematic diagram of a vital sign signal monitoring process provided by an embodiment of the present application;

[0052] Figure 3 is a structural schematic diagram of a vital sign signal monitoring device provided by an embodiment of the present application;

[0053] Figure 4 is a structural schematic diagram of a vital sign signal monitoring device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solutions and advantages of the embodiments of the present application more clear, the following will further describe the embodiments of the present application in combination with the drawings.

[0055] Before the vital sign signal monitoring method provided by the embodiments of the present application is explained in detail, the application scenarios provided by the embodiments of the present application are introduced.

[0056] The vital sign signal monitoring method provided by the embodiments of the present application can be applied to various scenarios. For example, in a vehicle driving scenario, if the vital sign signal of the driver is abnormal, it will affect the safety of vehicle driving. At this time, the vital sign of the driver can be monitored by the radar installed in the vehicle according to the vital sign signal monitoring method provided by the embodiments of the present application, and in the case that the vital sign signal of the driver is abnormal, an alarm information is generated to remind the driver to avoid possible risks in advance.

[0057] The vital sign signal monitoring method provided by the embodiments of the present application can be executed by a vehicle. Further, the vital sign signal monitoring method provided by the embodiments of the present application can also be realized by a vital sign signal monitoring device, and the following will be described taking the vehicle as an example.

[0058] The vital sign signal monitoring device can be any electronic product that can interact with a user through one or more of a keyboard, a touchpad, a touch screen, a remote control, voice interaction, or a handwriting device, such as a PC (Personal Computer), a mobile phone, a smart phone, a PDA (Personal Digital Assistant), a Pocket PC (PPC), a tablet computer, a smart car, a smart television, a smart speaker, and the like.

[0059] Those skilled in the art should understand that the application scenarios and vital sign signal monitoring devices described above are only examples, and other existing or future application scenarios and vital sign signal monitoring devices, such as those applicable to the embodiments of the present application, should also be included in the protection scope of the embodiments of the present application and are hereby incorporated by reference.

[0060] It should be noted that the business scenarios described in the embodiments of the present application are for more clearly illustrating the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems as new business scenarios appear.

[0061] Next, the vital sign signal monitoring method provided by the embodiments of the present application will be explained in detail. Figure 1 is a flowchart of a vital sign signal monitoring method provided by the embodiments of the present application, please refer to Figure 1 The method includes the following steps.

[0062] Step 101: The vehicle phase unfolds the phase corresponding to each sample frequency point in the plurality of sample frequency points to obtain a plurality of target phases, each target phase is located in a target phase range, the radar signal strength corresponding to each sample frequency point is located in a target strength range, and the frequency corresponding to each sample frequency point is located in a target frequency range.

[0063] For any sample frequency point in the plurality of sample frequency points, the phase corresponding to the sample frequency point is determined. If the phase corresponding to the sample frequency point is not located in the target phase range, the phase corresponding to the sample frequency point is phase unfolded to obtain the target phase corresponding to the sample frequency point. If the phase corresponding to the sample frequency point is located in the target phase range, the phase corresponding to the sample frequency point does not need to be phase unfolded, and the phase corresponding to the sample frequency point is directly determined as the target phase.

[0064] Phase unwrapping refers to taking the phase corresponding to the sample frequency point ± 2π to obtain a processed phase. If the processed phase is within the target phase range, the processed phase is determined as the target phase. If the processed phase is still not within the target phase range, the processed phase is continued to be taken ± 2π according to the above steps until the processed phase is within the target phase range. At this time, the processed phase is determined as the target phase corresponding to the sample frequency point. Wherein, the target phase range is

-π, π

[0065] For example, taking sample frequency point A as an example, assuming that the phase corresponding to sample frequency point A is Since the phase corresponding to sample frequency point A is not within the target phase range

-π, π

-π, π

[0066] In some embodiments, before the phase corresponding to each sample frequency point in the plurality of sample frequency points is phase unwrapped to obtain the plurality of target phases, it is necessary to determine the plurality of sample frequency points, and then determine the phase corresponding to each sample frequency point in the plurality of sample frequency points. That is, a radar is installed in the vehicle, and the radar is used to monitor the vital sign signal of the person in the vehicle. The time domain echo signal received by the radar is subjected to Fourier transform to obtain a frequency domain echo signal, and based on the time domain echo signal and the frequency domain echo signal, a time-frequency spectrum is drawn, a frequency spectrum region in which the radar signal strength is within a target strength range and the frequency is within a target frequency range is determined from the time-frequency spectrum, a plurality of sample frequency points are selected from the frequency spectrum region, and the phase corresponding to each sample frequency point is determined from the time domain echo signal.

[0067] The time-frequency spectrum is a three-dimensional graph, and the three dimensions of the three-dimensional graph are represented by the horizontal axis, the vertical axis and the color in the time-frequency spectrum. The horizontal axis of the time-frequency spectrum represents time, the vertical axis represents frequency, and different colors in the time-frequency spectrum correspond to different radar signal strengths. Moreover, the time domain echo signal received by the radar not only includes the vital sign signal of the person in the vehicle, but also includes other radar signals, so that the frequency spectrum region in which the radar signal strength is within the target strength range and the frequency is within the target frequency range is determined from the time-frequency spectrum, and a plurality of sample frequency points are selected from the frequency spectrum region at equal time intervals, and then the phase corresponding to each sample frequency point in the plurality of sample frequency points is determined from the time domain echo signal.

[0068] The target intensity range is determined based on a measurement range of the radar, i.e., the vehicle determines the target intensity range based on the measurement range of the radar installed in the vehicle. In this way, time-domain echo signals in the time-domain echo signals received by the radar that are not located in the measurement range of the radar can be removed to obtain time-domain echo signals located in the measurement range of the radar. The target frequency range is determined based on the vital sign signal, so that time-domain echo signals in the time-domain echo signals received by the radar that cannot represent the vital sign signal can be removed to obtain time-domain echo signals representing the vital sign signal. That is, a spectrum region in the time-frequency spectrum is selected from the time-frequency spectrum by the target intensity range and the target frequency range, and each echo signal in the spectrum region is located in the measurement range of the radar and can represent the vital sign signal.

[0069] For example, the radar for monitoring the vital sign signal of the person in the vehicle can be any one of a pulse radar, a continuous wave radar, a laser radar, and a millimeter wave radar. Of course, in actual applications, the radar can also be other forms of radars, and the embodiments of the present application do not limit this.

[0070] It should be noted that the selection of the plurality of sample frequency points at the equal time intervals from the spectrum region is an example. In other embodiments, the vehicle can also select a plurality of sample frequency points from the spectrum region in other ways, and the embodiments of the present application do not limit this.

[0071] Step 102: The vehicle subtracts each adjacent two target phases in the plurality of target phases in the order of time corresponding to the plurality of sample frequency points to obtain a plurality of phase differences.

[0072] The plurality of sample frequency points are sorted in the order of time corresponding to each sample frequency point in the plurality of sample frequency points to obtain a sorting result. Each adjacent two target phase differences in the sorting result are subtracted to obtain a plurality of phase differences.

[0073] The embodiments of the present application determine the heartbeat frequency or the breathing frequency of the person in the vehicle by transmitting an electromagnetic wave signal by the radar installed in the vehicle and by the time-domain echo signal received by the radar, so as to realize the monitoring of the vital sign signal. Because the heart fluctuation or the chest fluctuation of the person in the vehicle is different at different times, the phases corresponding to different times in the time-domain echo signal received by the radar are also different. In this way, the phase difference between adjacent times can be used to represent the corresponding heart displacement difference, and the phase difference between adjacent times can also be used to represent the corresponding chest displacement difference, and then the heartbeat frequency or the breathing frequency is determined by the phase difference between adjacent times.

[0074] As an example, the heart displacement difference between adjacent times can be represented by the phase difference between adjacent times according to the following formula (1).

[0075]

[0076] wherein in the above formula (1), ΔR represents a corresponding heart displacement difference, λ represents a wavelength of an electromagnetic wave signal, represents a phase difference of adjacent times.

[0077] In the process of installing a radar in a vehicle to receive a time domain echo signal, due to the interference of noise, the phase drifts, so that the time domain echo signal received by the radar is different from the actual radar life signal. At this time, the phase difference between every two adjacent targets in the time domain echo signal can be subtracted to obtain a plurality of phase differences, so as to eliminate the phase drift, so that the radar life signal determined based on the plurality of phase differences is more accurate.

[0078] Step 103: The vehicle determines a radar life signal based on the plurality of phase differences, the radar life signal including at least one of a heartbeat waveform and a breathing waveform, the heartbeat waveform being used to indicate heart fluctuation, and the breathing waveform being used to indicate chest fluctuation.

[0079] The vehicle inputs the plurality of phase differences into a band-pass filter with a target band-pass frequency to obtain a radar life signal output by the band-pass filter. Since the time domain echo signal received by the radar is a superposition of the heartbeat waveform and the breathing waveform of the person in the vehicle, in order to facilitate subsequent determination of the heartbeat frequency and the breathing frequency of the person in the vehicle, it is necessary to separate the heartbeat waveform and the breathing waveform through the band-pass filter.

[0080] In some embodiments, the heartbeat waveform and the breathing waveform can be separated by two band-pass filters in series. That is, the target band-pass frequency of the first band-pass filter is a heartbeat band-pass frequency, and the target band-pass frequency of the second band-pass filter is a breathing band-pass frequency. The plurality of phase differences are input into the first band-pass filter to obtain a heartbeat waveform output by the first band-pass filter. The plurality of phase differences are input into the second band-pass filter to obtain a breathing waveform output by the second band-pass filter.

[0081] In other embodiments, the heartbeat waveform and the breathing waveform can also be separated by one band-pass filter. That is, first, the target band-pass frequency of the band-pass filter is set to the heartbeat band-pass frequency, and the plurality of phase differences are input into the band-pass filter to obtain a heartbeat waveform output by the band-pass filter. Then, the target band-pass frequency of the band-pass filter is set to the breathing band-pass frequency, and the plurality of phase differences are input into the band-pass filter to obtain a breathing waveform output by the band-pass filter.

[0082] Optionally, before determining the radar life signal based on the plurality of phase differences, it is also required to eliminate the phase difference greater than the phase difference threshold from the plurality of phase differences. In this way, the pulse noise caused by electromagnetic interference can be eliminated, thereby improving the accuracy of vital sign monitoring.

[0083] The phase difference threshold is set in advance. Moreover, the phase difference threshold can also be adjusted according to different requirements.

[0084] Step 104: The vehicle determines a vital sign signal based on the radar life signal. In the case that the radar life signal includes a heartbeat waveform, the vital sign signal includes a heartbeat frequency. In the case that the radar life signal includes a breathing waveform, the vital sign signal includes a breathing frequency.

[0085] The vehicle can determine the vital sign signal based on the radar life signal according to the time domain peak value method. For example, the vehicle determines the time interval between two adjacent positive peaks in the radar life signal, and determines the reciprocal of the time interval as the vital sign signal. For another example, the vehicle determines the time interval between two adjacent negative peaks in the radar life signal, and determines the reciprocal of the time interval as the vital sign signal.

[0086] The positive peak is used to indicate the peak in which the maximum value of the radar signal strength in the radar life signal is positive. The negative peak is used to indicate the peak in which the maximum value of the radar signal strength in the radar life signal is negative.

[0087] Optionally, the vehicle includes a spectrum estimation module. The vehicle can determine the vital sign signal through the spectrum estimation module. That is, the spectrum estimation module determines the time interval between two adjacent positive peaks in the radar life signal, and determines the reciprocal of the time interval as the vital sign signal. For another example, the spectrum estimation module determines the time interval between two adjacent negative peaks in the radar life signal, and determines the reciprocal of the time interval as the vital sign signal.

[0088] In some embodiments, before determining the vital sign signal based on the radar life signal, the radar life signal can also be preprocessed. For example, the radar life signal is subjected to windowing processing, or the radar life signal is subjected to gain processing. Of course, in actual applications, the radar life signal can also be preprocessed in other ways, and the embodiments of the present application do not limit this.

[0089] After the vehicle determines the vital sign signal based on the radar life signal, an alarm information can also be generated in combination with the state of the vehicle and the vital sign signal. For example, in the case that the vehicle is in a driving state and the vital sign signal is not located in the target vital sign signal range, the alarm information is generated, and after the alarm information lasts for a preset time length, the vehicle is controlled to brake based on the alarm information. That is, if the vehicle is in a driving state and the vital sign signal is not located in the target vital sign signal range, it indicates that the vital sign signal of the person in the vehicle appears to be abnormal during driving of the vehicle. At this time, the alarm information is generated to prompt the person in the vehicle. After the alarm information lasts for a preset time length, the vehicle sends the alarm information to the central gateway, the central gateway identifies the alarm information, and then issues a control instruction to each component. After each component receives the control instruction issued by the central gateway, the vehicle is controlled to brake.

[0090] The vehicle can send the alarm information to the central gateway through a CAN (Controller Area Network) bus. Of course, in actual application, the alarm information can also be sent to the central gateway through other manners, which are not limited by the embodiments of the application.

[0091] The target vital sign signal range and the preset time length are set in advance. Moreover, the target vital sign signal range and the preset time length can also be adjusted according to different requirements.

[0092] In the vehicle driving scenario, when the vital sign signal of the person in the vehicle appears to be abnormal, the alarm information is generated to prompt the person in the vehicle. In this way, the person in the vehicle can take relevant measures in time to maintain personal safety. Moreover, after the alarm information lasts for a preset time length, the central gateway can also control the vehicle to brake based on the alarm information, further maintaining the personal safety of the person in the vehicle.

[0093] For another example, in the case that the vehicle is not in a driving state and the vital sign signal is not zero, the temperature in the vehicle and / or vehicle unlocking information are acquired, and in the case that the temperature in the vehicle is not located in a target temperature range or the vehicle unlocking information indicates illegal unlocking, the alarm information is generated. That is, if the vehicle is not in a driving state and the vital sign signal is not zero, it indicates that there is a left person in the vehicle or an outsider intrudes into the vehicle. At this time, in the case that the temperature in the vehicle is not located in the target temperature range, the alarm information is generated to prompt the driver that the temperature in the vehicle is currently high and there is a left person in the vehicle. In the case that the vehicle unlocking information indicates illegal unlocking, the alarm information is generated to prompt the driver that there is an outsider who illegally unlocks and intrudes into the vehicle in the vehicle at present.

[0094] The target temperature range is set in advance. Moreover, the target temperature range can also be adjusted according to different requirements.

[0095] In the non-driving scenario of the vehicle, when the vital sign signal of the person in the vehicle is not zero, an alarm information is generated to prompt the driver. In this way, the driver can avoid leaving children or the elderly in the vehicle with high temperature, and can also avoid the problem of loss of property due to the intrusion of outsiders into the vehicle.

[0096] Next, take Figure 2 as an example to completely describe the vital sign signal monitoring process provided by the embodiments of the present application. In Figure 2 , the time domain echo signal received by the radar installed in the vehicle is subjected to Fourier transform to obtain a frequency domain echo signal. Based on the time domain echo signal and the frequency domain echo signal, a time-frequency spectrum is drawn, and a spectrum region in which the radar signal strength is within a target strength range and the frequency is within a target frequency range is determined from the time-frequency spectrum. A plurality of sample frequency points are selected from the spectrum region, and the phase corresponding to each sample frequency point is determined from the time domain echo signal. Then, the phase corresponding to each sample frequency point in the plurality of sample frequency points is phase unfolded to obtain a plurality of target phases, and each adjacent two target phases in the plurality of target phases are subtracted in the order of time corresponding to the plurality of sample frequency points to obtain a plurality of phase differences. Further, the plurality of phase differences are input into a band-pass filter with a target band-pass frequency to obtain a radar vital signal output by the band-pass filter. Finally, the vital sign signal is determined by a spectrum estimation module to obtain a heartbeat frequency and a breathing frequency.

[0097] In the embodiments of the present application, the heart fluctuation corresponding to adjacent time in the heartbeat waveform or the chest fluctuation corresponding to adjacent time in the breathing waveform is related to the phase difference between the two phases corresponding to adjacent time. Therefore, the radar vital signal determined based on the plurality of phase differences is relatively accurate, so that the vital sign signal can be accurately determined based on the radar vital signal, thereby ensuring the safety of vehicle driving. Moreover, before determining the radar vital signal based on the plurality of phase differences, phase differences greater than a phase difference threshold value in the plurality of phase differences need to be removed. In this way, the pulse noise caused by electromagnetic interference can be eliminated, thereby improving the accuracy of vital sign signal monitoring.

[0098] Figure 3 is a structural schematic diagram of a vital sign signal monitoring device provided by the embodiments of the present application. The vital sign signal monitoring device can be realized by software, hardware or a combination of the two to become part or all of a vital sign signal monitoring device. Please refer to Figure 3 , the device comprises a phase unfolding module 301, a phase subtraction module 302, a first determination module 303 and a second determination module 304.

[0099] The phase unwrapping module 301 is configured to perform phase unwrapping on the phase corresponding to each sample frequency point in the plurality of sample frequency points, to obtain a plurality of target phases, each target phase being located in a target phase range, the radar signal strength corresponding to each sample frequency point being located in a target strength range, and the frequency corresponding to each sample frequency point being located in a target frequency range. For details, refer to the corresponding content in the above embodiments, which will not be described here.

[0100] The phase subtraction module 302 is configured to subtract each adjacent two target phases in the plurality of target phases in accordance with the time sequence of the plurality of sample frequency points, to obtain a plurality of phase differences. For details, refer to the corresponding content in the above embodiments, which will not be described here.

[0101] The first determination module 303 is configured to determine a radar life signal based on the plurality of phase differences, the radar life signal including at least one of a heartbeat waveform and a breathing waveform, the heartbeat waveform being used to indicate heart fluctuation, and the breathing waveform being used to indicate chest fluctuation. For details, refer to the corresponding content in the above embodiments, which will not be described here.

[0102] The second determination module 304 is configured to determine a vital sign signal based on the radar life signal, the vital sign signal including a heartbeat frequency in the case where the radar life signal includes the heartbeat waveform, and the vital sign signal including a breathing frequency in the case where the radar life signal includes the breathing waveform. For details, refer to the corresponding content in the above embodiments, which will not be described here.

[0103] Optionally, the first determination module 303 is specifically configured to:

[0104] input the plurality of phase differences into a band-pass filter having a target band-pass frequency, to obtain a radar life signal output by the band-pass filter.

[0105] Optionally, the apparatus further includes:

[0106] The rejection module is configured to reject a phase difference greater than a phase difference threshold value in the plurality of phase differences.

[0107] Optionally, the apparatus further includes:

[0108] The transformation module is configured to perform Fourier transform on the time-domain echo signal received by the radar, to obtain a frequency-domain echo signal.

[0109] The drawing module is configured to draw a time-frequency spectrum based on the time-domain echo signal and the frequency-domain echo signal.

[0110] The third determination module is configured to determine, from the time-frequency spectrum, a frequency spectrum region in which the radar signal strength is located in the target strength range and the frequency is located in the target frequency range.

[0111] The selecting module is configured to select the plurality of sample frequencies from the spectrum region, and determine a phase corresponding to each sample frequency from the time domain echo signal.

[0112] Optionally, the apparatus further comprises:

[0113] The first generating module is configured to generate an alarm information when the vehicle is in a driving state and the vital sign signal is not within a target vital sign signal range.

[0114] The control module is configured to control the vehicle to brake based on the alarm information after the alarm information lasts for a preset time length.

[0115] Optionally, the apparatus further comprises:

[0116] The acquiring module is configured to acquire an in-vehicle temperature and / or vehicle unlocking information when the vehicle is not in a driving state and the vital sign signal is not zero.

[0117] The second generating module is configured to generate an alarm information when the in-vehicle temperature is not within a target temperature range or the vehicle unlocking information indicates illegal unlocking.

[0118] In the embodiments of the present application, the heart fluctuation corresponding to adjacent time in the heartbeat waveform or the chest fluctuation corresponding to adjacent time in the respiration waveform is related to the phase difference between two phases corresponding to adjacent time. Therefore, the radar vital signal determined based on the plurality of phase differences is more accurate, so that the vital sign signal can be accurately determined based on the radar vital signal, thereby ensuring the safety of vehicle driving. Moreover, before the radar vital signal is determined based on the plurality of phase differences, the phase difference greater than the phase difference threshold value in the plurality of phase differences needs to be removed. In this way, the pulse noise caused by electromagnetic interference can be eliminated, thereby improving the accuracy of vital sign signal monitoring.

[0119] It should be noted that: the vital sign signal monitoring apparatus provided in the above embodiments is only exemplified by the division of the above functional modules during vital sign signal monitoring. In actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the apparatus is divided into different functional modules to complete all or part of the functions described above. In addition, the vital sign signal monitoring apparatus and the vital sign signal monitoring method provided in the above embodiments belong to the same concept, and the specific implementation process is described in detail in the method embodiments, which will not be repeated here.

[0120] Figure 4Fig. 1 is a structural block diagram of a vital sign signal monitoring device 400 provided by an embodiment of the present application. The vital sign signal monitoring device 400 can be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player, an MP4 player, a notebook computer, or a desktop computer. The vital sign signal monitoring device 400 can also be referred to as a user equipment, a portable terminal, a laptop terminal, a desktop terminal, or other names.

[0121] Generally, the vital sign signal monitoring device 400 includes a processor 401 and a memory 402.

[0122] The processor 401 can include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 401 can be implemented in at least one of a hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), a PLA (Programmable Logic Array). The processor 401 can also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit). The coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 401 can be integrated with a GPU (Graphics Processing Unit) for rendering and drawing content required to be displayed on a display screen. In some embodiments, the processor 401 can further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.

[0123] The memory 402 can include one or more computer-readable storage media. The computer-readable storage media can be non-transitory. The memory 402 can also include high-speed random access memory and can include non-volatile memory, such as one or more magnetic disk storage devices, optical storage devices, flash memory devices, or other non-volatile solid-state storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 402 stores at least one instruction for execution by the processor 401 to implement the vital sign signal monitoring method provided by the method embodiments of the present application.

[0124] In some embodiments, the vital sign signal monitoring device 400 can also optionally include a peripheral device interface 403 and at least one peripheral device. The processor 401, the memory 402, and the peripheral device interface 403 can be connected through a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 403 through a bus, a signal line, or a circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 404, a touch display screen 405, a camera 406, an audio circuit 407, a positioning component 408, and a power supply 409.

[0125] The peripheral device interface 403 can be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 401 and the memory 402. In some embodiments, the processor 401, the memory 402, and the peripheral device interface 403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 401, the memory 402, and the peripheral device interface 403 can be implemented on a separate chip or circuit board, and the present embodiments are not limited in this regard.

[0126] The radio frequency circuit 404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 404 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 404 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 404 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 404 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G, and 5G), a wireless local area network, and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 404 can also include NFC (Near Field Communication) related circuitry, and the present embodiments are not limited in this regard.

[0127] Display screen 405 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 405 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 401 for processing. In this case, display screen 405 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 405, which serves as the front panel of the vital signs monitoring device 400; in other embodiments, there may be at least two display screens 405, respectively disposed on different surfaces of the vital signs monitoring device 400 or in a folded design; in still other embodiments, display screen 405 may be a flexible display screen, disposed on a curved or folded surface of the vital signs monitoring device 400. Furthermore, display screen 405 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 405 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0128] The camera assembly 406 is used to acquire images or videos. Optionally, the camera assembly 406 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the vital signs monitoring device, and the rear-facing camera is located on the back of the vital signs monitoring device. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 406 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used for light compensation at different color temperatures.

[0129] The audio circuit 407 can include a microphone and a speaker. The microphone is used to collect sound waves of a user and an environment, and convert the sound waves into an electrical signal input to the processor 401 for processing, or input to the radio frequency circuit 404 to realize voice communication. The microphone can be multiple for the purpose of stereo sound collection or noise reduction, and arranged at different parts of the vital sign signal monitoring device 400 respectively. The microphone can also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert an electrical signal from the processor 401 or the radio frequency circuit 404 into sound waves. The speaker can be a traditional diaphragm speaker, or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert an electrical signal into a sound wave audible to humans, but also convert an electrical signal into a sound wave inaudible to humans for ranging purposes. In some embodiments, the audio circuit 407 can also include a headphone jack.

[0130] The positioning component 408 is used to position the current geographic location of the vital sign signal monitoring device 400 to realize navigation or LBS (Location Based Service). The positioning component 408 can be a positioning component based on the GPS (Global Positioning System) of the United States, the Beidou system of China or the Galileo system of Russia.

[0131] The power supply 409 is used to supply power to each component in the vital sign signal monitoring device 400. The power supply 409 can be alternating current, direct current, disposable battery or rechargeable battery. When the power supply 409 includes a rechargeable battery, the rechargeable battery can be a wired charging battery or a wireless charging battery. The wired charging battery is a battery charged through a wired line, and the wireless charging battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0132] Those skilled in the art can understand that the structure shown in the above embodiments does not constitute a limitation on the vital sign signal monitoring device 400, and the vital sign signal monitoring device 400 can include more or fewer components than those shown in the figure, or combine certain components, or adopt a different component arrangement. Figure 4 Those skilled in the art can understand that the structure shown in the above embodiments does not constitute a limitation on the vital sign signal monitoring device 400, and the vital sign signal monitoring device 400 can include more or fewer components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0133] In some embodiments, a computer readable storage medium is also provided, and the computer readable storage medium stores a computer program which, when executed by a processor, implements the steps of the vital sign signal monitoring method in the above embodiments. For example, the computer readable storage medium can be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0134] It is worth noting that the computer readable storage medium mentioned in the embodiments of the present application can be a non-volatile storage medium, in other words, a non-transitory storage medium.

[0135] It should be understood that all or part of the steps of the above-mentioned embodiments can be realized by software, hardware, firmware or any combination thereof. When realized by software, it can be realized in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. The computer instructions can be stored in the computer readable storage medium described above.

[0136] That is, in some embodiments, a computer program product including instructions which, when run on a computer, cause the computer to perform the steps of the vital sign signal monitoring method described above is also provided.

[0137] It should be understood that "at least one" referred to herein means one or more, and "multiple" means two or more. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; "and / or" herein is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist together, and B exists alone. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the same items or similar items with basically the same functions and effects are distinguished by using "first", "second" and the like. The skilled in the art can understand that "first", "second" and the like do not limit the quantity and execution order, and "first", "second" and the like do not necessarily mean different.

[0138] It should be noted that the information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of the present application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the phase corresponding to the sample frequency, the target phase range, the target intensity range and the target frequency range involved in the embodiments of the present application are all obtained under sufficient authorization.

[0139] The above describes the embodiments provided by the present application, and does not limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A vital signs signal monitoring method, characterized by, A radar is installed in a vehicle for monitoring vital sign signals of a person in the vehicle, and the method comprises: performing Fourier transform on a time-domain echo signal received by the radar to obtain a frequency-domain echo signal; drawing a time-frequency spectrogram based on the time-domain echo signal and the frequency-domain echo signal; the time-frequency spectrogram is a three-dimensional graph, a horizontal axis of the time-frequency spectrogram represents time, a vertical axis of the time-frequency spectrogram represents frequency, and different colors in the time-frequency spectrogram correspond to different radar signal strengths; determining a frequency spectrum region in which a radar signal strength is within a target strength range and a frequency is within a target frequency range from the time-frequency spectrogram, and selecting a plurality of sample frequency points at equal time intervals from the frequency spectrum region, and then determining a phase corresponding to each sample frequency point in the plurality of sample frequency points from the time-domain echo signal; wherein the target strength range is determined based on a measurement range of the radar; time-domain echo signals not within the measurement range of the radar are removed from the time-domain echo signal received by the radar to obtain time-domain echo signals within the measurement range of the radar; for any sample frequency point in the plurality of sample frequency points, determining a phase corresponding to the sample frequency point; if the phase corresponding to the sample frequency point is not within a target phase range, performing phase unwrapping on the phase corresponding to the sample frequency point to obtain a target phase corresponding to the sample frequency point; if the phase corresponding to the sample frequency point is within the target phase range, the phase corresponding to the sample frequency point is directly determined as the target phase without phase unwrapping; the phase unwrapping refers to adding / subtracting 2π to the phase corresponding to the sample frequency point to obtain a processed phase; if the processed phase is within the target phase range, the processed phase is determined as the target phase; if the processed phase is still not within the target phase range, the processed phase is continuously added / subtracted by 2π until the processed phase is within the target phase range, and at this time, the processed phase is determined as the target phase corresponding to the sample frequency point; subtracting every two adjacent target phases in the plurality of target phases in a time sequence of the plurality of sample frequency points to obtain a plurality of phase differences; removing phase differences greater than a phase difference threshold value in the plurality of phase differences; the phase difference threshold value is used to eliminate pulse noise generated by electromagnetic interference; determining a radar vital signal based on the plurality of phase differences, the radar vital signal including at least one of a heartbeat waveform and a breathing waveform: inputting the plurality of phase differences into a first band-pass filter to obtain a heartbeat waveform output by the first band-pass filter; inputting the plurality of phase differences into a second band-pass filter to obtain a breathing waveform output by the second band-pass filter; a target band-pass frequency of the first band-pass filter is a heartbeat band-pass frequency; a target band-pass frequency of the second band-pass filter is a breathing band-pass frequency; the heartbeat waveform is used to indicate cardiac fluctuation, and the breathing waveform is used to indicate thoracic fluctuation. determining a time interval between two adjacent positive peaks or two adjacent negative peaks in the radar vital signal, determining the reciprocal of the time interval as the vital sign signal; in the case that the radar vital signal comprises a heartbeat waveform, the vital sign signal comprises a heartbeat frequency, and in the case that the radar vital signal comprises a breathing waveform, the vital sign signal comprises a breathing frequency.

2. The method of claim 1, wherein, After the radar vital signal is used to determine the vital sign signal, the method further comprises: generating an alarm information in the case that the vehicle is in a driving state and the vital sign signal is not within a target vital sign signal range; controlling the vehicle to brake based on the alarm information after the alarm information lasts for a preset time length.

3. The method of claim 1, wherein, After the radar vital signal is used to determine the vital sign signal, the method further comprises: acquiring an in-vehicle temperature and / or vehicle unlocking information in the case that the vehicle is not in a driving state and the vital sign signal is not zero; generating an alarm information in the case that the in-vehicle temperature is not within a target temperature range or the vehicle unlocking information indicates illegal unlocking.

4. A vital signs signal monitoring apparatus, characterized by A radar is installed in a vehicle, and the radar is used to monitor a vital sign signal of a person in the vehicle, and the device comprises: The phase unwrapping module is configured to perform Fourier transform on the time-domain echo signal received by the radar to obtain a frequency-domain echo signal, draw a time-frequency spectrum based on the time-domain echo signal and the frequency-domain echo signal, wherein the time-frequency spectrum is a three-dimensional graph, the horizontal axis of the time-frequency spectrum represents time, the vertical axis represents frequency, and different colors in the time-frequency spectrum correspond to different radar signal strengths, determine a spectrum region in which the radar signal strength is within a target strength range and the frequency is within a target frequency range from the time-frequency spectrum, and select a plurality of sample frequency points at equal time intervals from the spectrum region, and then determine the phase corresponding to each sample frequency point in the plurality of sample frequency points from the time-domain echo signal, wherein the target strength range is determined based on the measurement range of the radar, and the time-domain echo signal not within the measurement range of the radar is removed from the time-domain echo signal received by the radar to obtain a time-domain echo signal within the measurement range of the radar; for any sample frequency point in the plurality of sample frequency points, the phase corresponding to the sample frequency point is determined; if the phase corresponding to the sample frequency point is not within a target phase range, the phase corresponding to the sample frequency point is unwrapped to obtain a target phase corresponding to the sample frequency point; if the phase corresponding to the sample frequency point is within the target phase range, the phase corresponding to the sample frequency point is directly determined as the target phase without unwrapping the phase; the phase unwrapping refers to unwrapping the phase corresponding to the sample frequency point by ±2π to obtain a processed phase; if the processed phase is within the target phase range, the processed phase is determined as the target phase; if the processed phase is still not within the target phase range, the processed phase is continuously unwrapped by ±2π until the processed phase is within the target phase range, and at this time, the processed phase is determined as the target phase corresponding to the sample frequency point; The phase subtraction module is configured to subtract each two adjacent target phases in the plurality of target phases in the order of time of the plurality of sample frequency points to obtain a plurality of phase differences; The first determination module is configured to remove the phase difference greater than a phase difference threshold value in the plurality of phase differences; the phase difference threshold value is used to eliminate pulse noise generated by electromagnetic interference; determine a radar life signal based on the plurality of phase differences, wherein the radar life signal includes at least one of a heartbeat waveform and a breathing waveform; input the plurality of phase differences into a first band-pass filter to obtain a heartbeat waveform output by the first band-pass filter; input the plurality of phase differences into a second band-pass filter to obtain a breathing waveform output by the second band-pass filter; the target band-pass frequency of the first band-pass filter is a heartbeat band-pass frequency; the target band-pass frequency of the second band-pass filter is a breathing band-pass frequency; the heartbeat waveform is used to indicate the fluctuation of the heart, and the breathing waveform is used to indicate the fluctuation of the chest. The second determining module is configured to determine a vital sign signal based on the radar vital signal: determining a time interval between two adjacent positive peaks or two adjacent negative peaks in the radar vital signal, and determining the reciprocal of the time interval as the vital sign signal; in a case where the radar vital signal comprises a heartbeat waveform, the vital sign signal comprises a heartbeat frequency; and in a case where the radar vital signal comprises a breathing waveform, the vital sign signal comprises a breathing frequency.

5. A vehicle characterized by comprising: The vehicle comprises a radar installed therein, the radar being configured to monitor a vital sign signal of a person in the vehicle, and the vehicle comprises a memory and a processor, the memory being configured to store a computer program, and the processor being configured to execute the computer program stored in the memory to implement the steps of the method according to any one of claims 1-3.

6. A computer readable storage medium characterized by, The storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the method according to any one of claims 1-3.

7. A computer program, characterised in that, The computer program comprises instructions which, when executed on the computer, cause the computer to perform the steps of the method according to any one of claims 1-3.

Images