Heart rate detection method and apparatus, wearable device, and medium

Abstract

The application discloses a heart rate detection method and device, a wearable device and a medium, and belongs to the electronic information field. The wearable device comprises a microphone and a target sensor. The heart rate detection method comprises the following steps: acquiring a first sound signal through the microphone and a second interference signal through the target sensor in the case that a user wears the wearable device; and obtaining a target heart rate parameter of the user according to the first sound signal and the second interference signal. In the case that the user wears the wearable device, the microphone and the ear canal of the user form a closed cavity.

Description

TECHNICAL FIELD

[0001] The present application belongs to the field of electronic information, and particularly relates to a heart rate detection method and device, a wearable device and a medium. BACKGROUND

[0002] With the introduction of the concept of universal health, the concept of light exercise is gradually accepted by the public. Wearable products, especially wireless earphone products, have almost become a standard in the sports scene. However, due to the small size of earphones, it is very difficult to integrate a relatively complex vital sensor in the earphone to monitor the real-time heart rate of the human body.

[0003] In the related art, an LED-PD module (i.e., PPG (photoplethysmography)) can be integrated in the earphone to detect the heart rate of the human body; or, the MIC can be used to collect ear canal audio data, and then the frequency band corresponding to the ear canal audio data is filtered and analyzed to detect the heart rate of the human body. However, in the process of collecting the heart rate of the human body through the above two schemes, the interference caused by the noise to the heart rate detection cannot be eliminated, thereby causing abnormal heart rate detection results. SUMMARY

[0004] The purpose of the embodiments of the present application is to provide a heart rate detection method and device, a wearable device and a medium. The problem of noise interference with heart rate detection and abnormal heart rate detection results can be solved.

[0005] In order to solve the above technical problems, the present application is implemented as follows:

[0006] In a first aspect, the embodiments of the present application provide a heart rate detection method applied to a wearable device, the wearable device comprising a microphone and a target sensor, the method comprising: acquiring a first sound signal through the microphone and acquiring a second interference signal through the target sensor in the case that a user wears the wearable device; obtaining a target heart rate parameter of the user according to the first sound signal and the second interference signal; wherein the microphone and the ear canal of the user form a closed cavity in the case that the user wears the wearable device.

[0007] In a second aspect, the embodiments of the present application provide a heart rate detection device applied to a wearable device, the wearable device comprising a microphone and a target sensor, the device comprising: an acquisition module and a processing module. The acquisition module is configured to acquire a first sound signal and a second interference signal in the case that a user wears the wearable device. The processing module is further configured to obtain a target heart rate parameter of the user according to the first sound signal and the second interference signal acquired by the acquisition module. The microphone and the ear canal of the user form a closed cavity in the case that the user wears the wearable device.

[0008] In a third aspect, an embodiment of the present application provides a wearable device, which comprises a processor and a memory, the memory storing programs or instructions executable on the processor, and the programs or instructions, when executed by the processor, implement the steps of the method according to the first aspect.

[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, which stores programs or instructions, and the programs or instructions, when executed by a processor, implement the steps of the method according to the first aspect.

[0010] In a fifth aspect, an embodiment of the present application provides a chip, which comprises a processor and a communication interface, the communication interface being coupled to the processor, and the processor being configured to execute programs or instructions to implement the method according to the first aspect.

[0011] In a sixth aspect, an embodiment of the present application provides a computer program product stored in a storage medium, and the program product is executed by at least one processor to implement the method according to the first aspect.

[0012] In the embodiment of the present application, when a user wears a wearable device comprising a microphone and a target sensor, and the microphone and the ear canal form a closed cavity, a first sound signal can be acquired by the microphone, and a second interference signal can be acquired by the target sensor; then, a target heart rate parameter of the user is obtained according to the first sound signal and the second interference signal. In this way, by taking the first sound signal acquired by the microphone and the second interference signal acquired by the target sensor as the reference input of the heart rate algorithm, the calculation parameter without interference can be acquired, and finally the target heart rate parameter is obtained, so that the interference caused by noise on the heart rate detection is eliminated, and the abnormal heart rate detection result is avoided. BRIEF DESCRIPTION OF DRAWINGS

[0013] Figure 1 is a flowchart of a heart rate detection method provided by an embodiment of the present application;

[0014] Figure 2 is a schematic diagram of a Bluetooth earphone provided by an embodiment of the present application;

[0015] Figure 3 is a schematic diagram of a Bluetooth earphone provided by an embodiment of the present application;

[0016] Figure 4 is a structural schematic diagram of a heart rate detection device provided by an embodiment of the present application;

[0017] Figure 5 is a structural schematic diagram of a wearable device provided by an embodiment of the present application;

[0018] Figure 6 is a hardware schematic diagram of a wearable device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0019] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art are within the scope of protection of the present application.

[0020] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second", and the like are generally of a kind and are not limited in number, for example, the first object can be one or more. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / ", generally indicates that the objects before and after are in an "or" relationship.

[0021] The heart rate detection method, device, wearable device and medium provided by the embodiments of the present application will be described in detail below with reference to the drawings and through specific embodiments and application scenarios.

[0022] The heart rate detection method provided by the embodiments of the present application is applied to a scenario in which a user wears a wearable device to exercise, and the specific application scenario can be determined according to the use requirement, which is not limited by the present application.

[0023] Exemplarily, the scenario in which a user wears a Bluetooth earphone to exercise is taken as an example.

[0024] With the advancement of the trend of mobile phone non-porous, earphones, especially wireless earphones, have been increasingly widely used. In addition, the trend of the intelligence of wearable devices is also increasingly fast. In addition, with the introduction of the concept of universal health, the concept of light exercise is gradually accepted by the public, and wearable products, especially wireless earphone products, have almost become a standard in the exercise scenario. However, due to the small size of earphones, it is very difficult to integrate relatively complex vital sign sensors in them.

[0025] In the heart rate detection method, device, wearable device and medium provided in the embodiments of the present application, in the case that a user wears a wearable device including a microphone and a target sensor, and the microphone and the ear canal form a closed cavity, a first sound signal can be acquired by the microphone, and a second interference signal can be acquired by the target sensor; then, a target heart rate parameter of the user can be obtained according to the first sound signal and the second interference signal. In this way, by taking the first sound signal acquired by the microphone and the second interference signal acquired by the target sensor as the reference input of the heart rate algorithm, the calculation parameter without interference can be acquired, and finally the target heart rate parameter can be obtained, so that the interference caused by noise on the heart rate detection is eliminated, and the abnormal heart rate detection result is avoided.

[0026] The execution subject of the heart rate detection method provided in the embodiments of the present application can be a heart rate detection device. The heart rate detection device can be applied to a wearable device, that is, the heart rate detection device can be a wearable device, a control module or a processing module in the wearable device, or a component such as an integrated circuit or a chip in the wearable device. The wearable device can be a terminal or other devices other than the terminal. Exemplarily, the wearable device includes but is not limited to a Bluetooth headset, smart audio glasses, a wearable sound box, a smart helmet, and the like.

[0027] The embodiments of the present application provide a heart rate detection method applied to a wearable device including a microphone and a target sensor, as shown in the following Figure 1 The heart rate detection method can include the following steps 201 and 202:

[0028] Step 201: In the case that a user wears a wearable device, a first sound signal is acquired by a microphone, and a second interference signal is acquired by a target sensor.

[0029] In the embodiments of the present application, the first sound signal includes a signal generated by heart rate fluctuation.

[0030] It should be noted that due to various sound interferences in the external environment, the first sound signal contains not only the sound signal generated by heart rate fluctuation, but also other interference signals (for example, interference sound signals collected outside the ear, interference sound signals collected around the neck, etc.). In order to avoid the final heart rate detection result being abnormal and make it more accurate, the above interference signals need to be filtered out.

[0031] In the embodiments of the present application, in the case that a user wears a wearable device, the microphone and the ear canal of the user form a closed cavity.

[0032] Step 202: A target heart rate parameter of the user is obtained according to the first sound signal and the second interference signal.

[0033] In the embodiment of the present application, after obtaining the first sound signal and the second interference signal, the heart rate detection device can obtain a first sound signal without interference by processing the first sound signal and the second interference signal, and obtain the final target heart rate parameter by taking the first sound signal without interference as the calculation reference data.

[0034] The target heart rate parameter includes at least one of a heart rate value, a heart rate fluctuation, a blood oxygen saturation, etc.

[0035] In the heart rate detection method provided in the embodiment of the present application, when a user wears a wearable device including a microphone and a target sensor, and the microphone and the ear canal form a sealed cavity, the first sound signal can be obtained by the microphone, and the second interference signal can be obtained by the target sensor; then, the target heart rate parameter of the user is obtained according to the first sound signal and the second interference signal. In this way, by taking the first sound signal obtained by the microphone and the second interference signal obtained by the target sensor as the reference input of the heart rate algorithm, the calculation parameter without interference can be obtained, and the target heart rate parameter can be finally obtained, so that the interference caused by noise on the heart rate detection is eliminated, and the abnormal heart rate detection result is avoided.

[0036] Optionally, in the embodiment of the present application, the second interference signal includes at least one of a second sound signal and a capacitance signal.

[0037] In the embodiment of the present application, the target sensor can include one or more sensors.

[0038] Optionally, in the embodiment of the present application, the target sensor includes a bone conduction sensor, and the bone conduction sensor is configured to detect a sound signal.

[0039] In a possible embodiment, when the target sensor is a bone conduction sensor, the second interference signal is a sound interference signal generated by bone vibration.

[0040] In the embodiment of the present application, taking the target sensor as a bone conduction sensor as an example, the bone conduction sensor conducts vibration by mechanical vibration, collects a sound signal transmitted by human body vibration (mainly bone), and converts the sound signal into an electrical signal.

[0041] For example, as shown in FIG. 1, a wearable device 100 includes a microphone 101 and a target sensor 102. Figure 2 and Figure 3As shown, taking the wearable device as an example, the earphone device can include a bone conduction sensor, a front-end microphone, an in-ear microphone, a rear-end in-ear microphone, a wearing sensor, a loudspeaker, etc. The rear-end in-ear microphone can detect bone conduction data through the bone conduction sensor in the process of collecting ear canal audio data (i.e., the first sound signal), so that the collected ear canal audio data can be subtracted by the bone conduction data for subsequent subtraction fitting as a reference input of the heart rate algorithm.

[0042] In addition, taking the wearable device as an example, if the earphone device is playing music in the process of collecting the first sound signal, the first sound signal will include not only the sound signal generated by the heart rate fluctuation, but also the sound signal caused by the bone vibration due to the movement, and the sound signal generated by the music played by the earphone device. And in different environments, the proportions of the two interference sound signals will be different, for example, when running, the proportion of the bone vibration signal will be larger, and when stationary, the proportion of the music playing sound will be larger.

[0043] Optionally, in the embodiment of the present application, the target sensor includes a wearing detection sensor; wherein the wearing detection sensor is used to detect a capacitance signal.

[0044] In a possible embodiment, in the case that the target sensor is a wearing detection sensor, the second interference signal is a capacitance interference signal generated by the change of skin capacitance.

[0045] In the embodiment of the present application, taking the target sensor as a wearing detection sensor as an example, the wearing detection sensor collects the capacitance signal generated by the unstable wearing state of the earphone by detecting the change of the capacitance signal of the contact point between the earphone and the human skin when the earphone is shaken.

[0046] For example, as shown in Figure 2 and Figure 3 The rear-end in-ear microphone can detect wearing state data through the wearing detection sensor in the process of collecting the ear canal audio data, and then subtract the wearing state data from the collected ear canal audio data for subtraction fitting as a reference input of the heart rate algorithm.

[0047] In this way, the present application can perform algorithm subtraction through the interference data collected by one or more sensors and microphones to achieve the purpose of more targeted filtering, so that the heart rate data can be more accurately calculated.

[0048] Optionally, in the embodiment of the present application, the step 202 of "obtaining the target heart rate parameter of the user according to the first sound signal and the second interference signal" can include steps 202a to 202c:

[0049] Step 202a: converting the first sound signal into a first electric signal and converting the second interference signal into a second electric signal.

[0050] In the embodiments of the present application, the heart rate detection device needs to convert other types of signals into electric signals for processing in the process of processing signals.

[0051] Step 202b: signal alignment of the first electric signal and the second electric signal.

[0052] In the embodiments of the present application, the heart rate detection device can not only perform signal alignment on the first electric signal and the target electric signal, but also perform adaptive filtering on the first electric signal and the target electric signal according to the use scenario (which can be set by the user or sensed by the related sensors of the mobile phone / watch / earphone).

[0053] Exemplarily, different use scenarios are provided with different filtering parameters, and the heart rate detection device can perform filtering according to the filtering parameters corresponding to the current use scenario. It should be noted that the adaptive filtering can be performed before the signal alignment, after the signal alignment, or simultaneously with the signal alignment, and the embodiments of the present application do not limit this.

[0054] Step 202c: subtracting the aligned second electric signal from the aligned first electric signal to obtain a third electric signal.

[0055] In the embodiments of the present application, the original waveform corresponding to the first electric signal of the first sound signal and the original waveform corresponding to the second electric signal of the second interference signal can be subtracted by the parameters of the second electric signal corresponding to the second interference signal obtained by the target sensor, so as to generate a new waveform (i.e. the waveform corresponding to the third electric signal); or the digital signal corresponding to the first electric signal of the first sound signal and the digital signal corresponding to the second electric signal can be subtracted to obtain a new digital signal (i.e. the digital signal corresponding to the third electric signal). In this way, a signal generated by heart rate fluctuation without interference or with slight interference can be obtained.

[0056] In the embodiments of the present application, the heart rate detection device can also extract the frequency signal of the third electric signal from the third electric signal by performing target processing on the third electric signal. The target processing includes at least one of the following: fast Fourier transform processing, discrete cosine transform processing, wavelet analysis processing, etc.

[0057] In this embodiment, after obtaining the aforementioned frequency signal, the heart rate detection device can perform a first processing on the frequency signal to extract feature points from it, and then obtain target heart rate parameters based on the extracted feature points. The target heart rate parameters include at least one of the following: heart rate value, heart rate fluctuation, blood oxygen saturation, etc.

[0058] Thus, by converting the acquired first sound signal into a first electrical signal, converting the second interference signal into a second electrical signal, aligning the first electrical signal with the second electrical signal corresponding to the interference signal of the first sound signal, and subtracting the interference signal portion of the aligned first sound signal according to the parameter information of the aligned second electrical signal, the obtained third electrical signal can be made more accurate, thereby avoiding abnormalities in the heart rate detection results.

[0059] Optionally, in this embodiment of the application, before step 202b above, the heart rate detection method provided in this embodiment of the application may further include the following step 301:

[0060] Step 301: If the first sound signal is obtained, add a first timestamp to the first electrical signal; if the second interference signal is obtained, add a second timestamp to the second electrical signal.

[0061] In this embodiment, the heart rate acquisition device can also add a timestamp to the first electrical signal and a timestamp to the second electrical signal. Frame alignment is then performed based on the timestamp information of each signal.

[0062] For example, the above-mentioned timestamp addition can be performed by converting the acquired sound signal into an electrical signal, or by adding a timestamp to the electrical signal while it is being acquired directly. Specifically, this can be done by adding a timestamp to the electrical signal represented in digital form.

[0063] Further optionally, in conjunction with step 301 above, step 202b, "aligning the first electrical signal with the second electrical signal", may include steps 202b1 and 202b2:

[0064] Step 202b1: Align the amplitudes of the first electrical signal and the second electrical signal.

[0065] In this embodiment, the amplitude alignment refers to adjusting signals with different amplitudes into signals with a uniform amplitude. For example, the amplitudes of the first electrical signal and the second electrical signal can be aligned for subsequent operations.

[0066] Step 202b2: Based on the first timestamp and the second timestamp, perform frame alignment between the first electrical signal and the second electrical signal.

[0067] In this embodiment of the application, the above-mentioned frame alignment is to align multiple signals corresponding to the same time according to the timestamp information for subsequent operations.

[0068] Thus, based on the amplitude alignment of the first and second electrical signals, timestamps are added to the first and second electrical signals respectively, and the above electrical signals are frame-aligned using the timestamp information. Finally, the aligned first electrical signal is subtracted from the aligned second electrical signal, thereby making the final data more accurate and further avoiding abnormalities in the heart rate detection results.

[0069] Optionally, in this embodiment of the application, before obtaining the user's target heart rate parameters as described above, the heart rate detection method provided in this embodiment of the application may further include the following step 302:

[0070] Step 302: When the wearable device outputs audio, acquire the fourth electrical signal corresponding to the audio.

[0071] In this embodiment of the application, the audio may include: music, news, phone calls, etc.

[0072] For example, taking a wearable device as an earphone device, if the earphone device is playing audio when acquiring the first sound signal, the earphone device does not need to acquire the audio and then convert it into an electrical signal. Instead, it can directly acquire the electrical signal corresponding to the audio in the digital signal processor inside the earphone device.

[0073] Optionally, in this embodiment of the application, the wearable device can also emit ultrasonic signals, then use a microphone to receive the echo signals of the ultrasonic signals, process the received echo signals, and use the processed data as reference data for heart rate calculation, thereby making the heart rate detection results more accurate.

[0074] Further optionally, in conjunction with step 302 above, step 202, "obtaining the user's target heart rate parameters based on the first sound signal and the second interference signal," may include step 202d:

[0075] Step 202d: Obtain the user's target heart rate parameters based on the first sound signal, the second interference signal, and the fourth electrical signal.

[0076] In this embodiment of the application, after acquiring the first sound signal, converting it into a first electrical signal, converting the second interference signal acquired by the target sensor into a second electrical signal, and acquiring the fourth electrical signal when the wearable device outputs audio, the first, second, and fourth electrical signals can be processed to obtain the first electrical signal without interference, and this signal can be used as a calculation reference to obtain the final target heart rate parameter.

[0077] Further optionally, in this embodiment, the heart rate detection device can perform signal alignment on the first, second, and fourth electrical signals, and can also perform adaptive filtering on the first, second, and fourth electrical signals according to the usage scenario (which can be user settings or sensing by relevant sensors on a mobile phone / watch / earphone). Moreover, the heart rate detection device can add timestamps to the first, second, and fourth electrical signals, and perform frame alignment based on the timestamp information of each signal.

[0078] For example, adding a timestamp to the fourth electrical signal as described above can be done simultaneously with acquiring the fourth electrical signal. Specifically, this can be done by adding a timestamp to the electrical signal represented in digital signal form.

[0079] Thus, based on the amplitude alignment of the first, second, and fourth electrical signals, timestamps are added to each of the first, second, and fourth electrical signals, and the frames of the above electrical signals are aligned using the timestamp information. Finally, the aligned first electrical signal is subtracted from the aligned second and fourth electrical signals, thereby making the final data more accurate and further avoiding abnormalities in the heart rate detection results.

[0080] In one possible embodiment, the wearable device can also collect more data for interference filtering, such as environmental noise, human voices, and human movement, to more accurately confirm the current state of the headphones, obtain more data for more effective interference filtering, and achieve more accurate heart rate data measurement.

[0081] The heart rate detection method provided in this application can be executed by a heart rate detection device. This application uses a heart rate detection device executing the heart rate detection method as an example to illustrate the heart rate detection device provided in this application.

[0082] This application provides a heart rate detection device, applied to a wearable device including a microphone and a target sensor, such as... Figure 4 As shown, the heart rate detection device 400 includes an acquisition module 401 and a processing module 402, wherein: the acquisition module 401 is used to acquire a first sound signal and a second interference signal when the user is wearing the wearable device; the processing module 402 is used to obtain the user's target heart rate parameters based on the first sound signal and the second interference signal acquired by the acquisition module 401; wherein, when the user is wearing the wearable device, the microphone and the user's ear canal form a sealed cavity.

[0083] Optionally, in this embodiment of the application, the processing module 402 is specifically used to convert the first sound signal into a first electrical signal, convert the second interference signal into a second electrical signal, align the first electrical signal and the second electrical signal, and subtract the aligned second electrical signal from the aligned first electrical signal to obtain a third electrical signal.

[0084] Optionally, in this embodiment of the application, the heart rate detection device further includes: an adding module, wherein the adding module is used to add a first timestamp to the first electrical signal when the acquisition module 401 acquires the first sound signal before the processing module 402 aligns the first electrical signal and the second electrical signal; and to add a second timestamp to the second electrical signal when the acquisition module 401 acquires the second interference signal; the processing module 402 is specifically used to perform amplitude alignment of the first electrical signal and the second electrical signal; and to perform frame alignment of the first electrical signal and the second electrical signal based on the first timestamp and the second timestamp.

[0085] Optionally, in the embodiments of this application, the second interference signal includes at least one of the following: a second sound signal and a capacitance signal; wherein, when the target sensor is a bone conduction sensor, the second sound signal is a sound signal generated by bone vibration; and when the target sensor is a wear detection sensor, the capacitance signal is a capacitance signal of the skin detected by the wear detection sensor.

[0086] Optionally, in this embodiment of the application, the acquisition module 401 is further configured to acquire a fourth electrical signal corresponding to the audio when the wearable device outputs audio before the processing module 402 obtains the user's target heart rate parameters; the processing module 402 is specifically configured to obtain the user's target heart rate parameters based on the first sound signal, the second interference signal and the fourth electrical signal.

[0087] In the heart rate detection device provided in this application embodiment, when the user wears a wearable device including a microphone and a target sensor, and the microphone and ear canal form a sealed cavity, the device can acquire a first sound signal through the microphone and a second interference signal through the target sensor. Then, based on the first sound signal and the second interference signal, the user's target heart rate parameter is obtained. Thus, by using the first sound signal acquired by the microphone and the second interference signal acquired separately by the target sensor as reference inputs for the heart rate algorithm, interference-free calculation parameters can be obtained, ultimately yielding the target heart rate parameter. This eliminates the interference caused by noise to heart rate detection and avoids abnormal heart rate detection results.

[0088] The heart rate detection device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0089] The heart rate detection device provided in this application embodiment can realize all the processes implemented in the above method embodiments, and will not be described again here to avoid repetition.

[0090] Optionally, such as Figure 5 As shown, this application embodiment also provides a wearable device 600, including a processor 601 and a memory 602. The memory 602 stores a program or instructions that can run on the processor 601. When the program or instructions are executed by the processor 601, they implement the various steps of the above-described heart rate detection method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0091] It should be noted that the wearable device in the embodiments of this application includes the mobile wearable device described above.

[0092] Figure 6 A schematic diagram of the hardware structure of a wearable device that implements an embodiment of this application.

[0093] The wearable device 100 includes, but is not limited to, components such as: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, and processor 110.

[0094] Those skilled in the art will understand that the wearable device 100 may also include a power supply (such as a battery) for powering various components. The power supply may be logically connected to the processor 110 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 6 The wearable device structure shown in the figure does not constitute a limitation on the wearable device. Wearable devices may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0095] The input unit 104 is used to acquire a first sound signal and a second interference signal when the user is wearing the wearable device. The processor 110 is used to obtain the user's target heart rate parameters based on the first sound signal and the second interference signal acquired by the input unit 104. When the user is wearing the wearable device, the microphone and the user's ear canal form a sealed cavity. Optionally, in this embodiment, the processor 110 is specifically used to convert the first sound signal into a first electrical signal, convert the second interference signal into a second electrical signal, align the first electrical signal and the second electrical signal, and subtract the aligned second electrical signal from the aligned first electrical signal to obtain a third electrical signal.

[0096] Optionally, in this embodiment of the application, the processor 110 is configured to add a first timestamp to the first electrical signal when the input unit 104 acquires the first audio signal before aligning the first electrical signal with the second electrical signal; and to add a second timestamp to the second electrical signal when the input unit 104 acquires the second interference signal; specifically, the processor 110 is configured to perform amplitude alignment between the first electrical signal and the second electrical signal; and to perform frame alignment between the first electrical signal and the second electrical signal based on the first timestamp and the second timestamp.

[0097] Optionally, in the embodiments of this application, the second interference signal includes at least one of the following: a second sound signal and a capacitance signal; wherein, when the target sensor is a bone conduction sensor, the second sound signal is a sound signal generated by bone vibration; and when the target sensor is a wear detection sensor, the capacitance signal is a capacitance signal of the skin detected by the wear detection sensor.

[0098] Optionally, in this embodiment of the application, the input unit 104 is further configured to acquire a fourth electrical signal corresponding to the audio before the processor 110 obtains the user's target heart rate parameters, when the wearable device outputs audio; the processor 110 is specifically configured to obtain the user's target heart rate parameters based on the first sound signal, the second interference signal and the fourth electrical signal.

[0099] In the wearable device provided in this application embodiment, when the user wears the wearable device including a microphone and a target sensor, and the microphone and ear canal form a sealed cavity, a first sound signal can be acquired through the microphone, and a second interference signal can be acquired through the target sensor. Then, based on the first sound signal and the second interference signal, the user's target heart rate parameter is obtained. In this way, by using the first sound signal acquired by the microphone and the second interference signal acquired separately by the target sensor as reference inputs for the heart rate algorithm, interference-free calculation parameters can be obtained, and the target heart rate parameter can be finally obtained, thereby eliminating the interference caused by noise to heart rate detection and avoiding abnormal heart rate detection results.

[0100] It should be understood that, in this embodiment, the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.

[0101] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 109 may include volatile memory or non-volatile memory, or it may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 109 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0102] Processor 110 may include one or more processing units; optionally, processor 110 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 110.

[0103] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described heart rate detection method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0104] The processor mentioned above is the processor in the wearable device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0105] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described heart rate detection method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0106] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0107] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the heart rate detection method embodiment described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0108] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0109] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0110] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A heart rate detection method, applied to a wearable device, the wearable device comprising a microphone and a target sensor, characterized in that, The method includes: When the user wears the wearable device, a first sound signal is acquired through the microphone, and a second interference signal is acquired through the target sensor. The second interference signal includes a second sound signal and a capacitance signal. The user's target heart rate parameters are obtained based on the first sound signal and the second interference signal; Wherein, when the user wears the wearable device, the microphone and the user's ear canal form a sealed cavity; The target sensor includes a bone conduction sensor and a wear detection sensor; The second sound signal is a sound signal generated by bone vibration during movement, collected by the bone conduction sensor. The capacitance signal is the capacitance signal collected by the wear detection sensor based on the change in capacitance signal at the contact point between the wearable device and the human skin when the device vibrates.

2. The method according to claim 1, characterized in that, The step of obtaining the user's target heart rate parameters based on the first sound signal and the second interference signal includes: The first sound signal is converted into a first electrical signal, and the second interference signal is converted into a second electrical signal; Align the first electrical signal with the second electrical signal; Subtract the aligned second electrical signal from the aligned first electrical signal to obtain the third electrical signal.

3. The method according to claim 2, characterized in that, Before aligning the first electrical signal with the second electrical signal, the method further includes: Upon obtaining the first audio signal, a first timestamp is added to the first electrical signal; Upon receiving the second interference signal, a second timestamp is added to the second electrical signal; The step of aligning the first electrical signal with the second electrical signal includes: Align the first electrical signal with the second electrical signal in terms of amplitude. Based on the first timestamp and the second timestamp, the first electrical signal and the second electrical signal are frame aligned.

4. The method according to claim 1, characterized in that, Before obtaining the user's target heart rate parameters, the method further includes: When the wearable device outputs audio, a fourth electrical signal corresponding to the audio is acquired; The step of obtaining the user's target heart rate parameters based on the first sound signal and the second interference signal includes: The user's target heart rate parameters are obtained based on the first sound signal, the second interference signal, and the fourth electrical signal.

5. A heart rate detection device, applied to a wearable device, the wearable device comprising a microphone and a target sensor, characterized in that, The device includes: an acquisition module and a processing module; The acquisition module is used to acquire a first sound signal and a second interference signal when the user is wearing the wearable device, the second interference signal including the second sound signal and a capacitance signal; The processing module is used to obtain the user's target heart rate parameters based on the first sound signal and the second interference signal obtained by the acquisition module. Wherein, when the user wears the wearable device, the microphone and the user's ear canal form a sealed cavity; The target sensor includes a bone conduction sensor and a wear detection sensor; The second sound signal is a sound signal generated by bone vibration during movement, collected by the bone conduction sensor. The capacitance signal is the capacitance signal collected by the wear detection sensor based on the change in capacitance signal at the contact point between the wearable device and the human skin when the device vibrates.

6. The apparatus according to claim 5, characterized in that, The processing module is specifically used to convert the first sound signal into a first electrical signal, convert the second interference signal into a second electrical signal, and perform signal alignment between the first electrical signal and the second electrical signal. Subtract the aligned second electrical signal from the aligned first electrical signal to obtain the third electrical signal.

7. The apparatus according to claim 6, characterized in that, The device further includes: an addition module; The adding module is configured to add a first timestamp to the first electrical signal when the first sound signal is acquired, and add a second timestamp to the second electrical signal when the second interference signal is acquired, before the processing module aligns the first electrical signal and the second electrical signal; The processing module is specifically used to perform amplitude alignment between the first electrical signal and the second electrical signal; and to perform frame alignment between the first electrical signal and the second electrical signal based on the first timestamp and the second timestamp.

8. The apparatus according to claim 5, characterized in that, The acquisition module is further configured to acquire a fourth electrical signal corresponding to the audio output by the wearable device before the processing module obtains the user's target heart rate parameters. The processing module is specifically used to obtain the user's target heart rate parameters based on the first sound signal, the second interference signal, and the fourth electrical signal.

9. A wearable device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the heart rate detection method as described in any one of claims 1 to 4.

10. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the heart rate detection method as described in any one of claims 1 to 4.

Images