Heart rate monitoring system, method, device, earphone, medium and product
By picking up the resonance signal at the headphone housing and processing it, the problem of infrared monitoring devices being affected by the external environment is solved, and the accuracy and convenience of heart rate monitoring are achieved.
Patent Information
- Application Number
- CN202411410324.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-10
- Publication Date
- 2025-02-25
AI Technical Summary
In the prior art, infrared monitoring devices are susceptible to external environmental factors during heart rate monitoring, resulting in a decrease in monitoring accuracy.
The VPU unit obtains the resonance signal at the headphone housing in real time. The resonance signal is the resonance signal generated between the inner wall of the ear canal and the earphone housing after being transmitted through the heartbeat to the inner wall of the ear canal. The VPU unit processes the resonant signal, obtains denoising data and sends it to the chip unit, which performs feature extraction, determines the heartbeat frequency and feeds back to the user terminal.
It improves the accuracy and convenience of heart rate monitoring, avoids the impact of external environmental factors on the monitoring results, and enhances the reliability of monitoring.
Smart Images
Figure CN119498808A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to heart rate monitoring technology, and more particularly to a heart rate monitoring system, method, device, earphone, medium and product. Background Art
[0002] At present, users are paying more and more attention to healthy exercise and daily heart rate monitoring. Therefore, in the prior art, users wear wearable products (such as bracelets or watches) to monitor the human heart rate through the infrared monitoring device in the wearable products. When the user needs to monitor the heart rate, daily monitoring can be performed without entering the hospital, thereby improving the convenience of user heart rate monitoring.
[0003] However, since infrared monitoring devices are easily affected by external environmental factors (such as light, temperature and humidity) during the monitoring process, the accuracy of heart rate monitoring is affected. Summary of the invention
[0004] Embodiments of the present application provide a heart rate monitoring system, method, device, earphones, medium and product to improve the accuracy and convenience of heart rate monitoring.
[0005] In a first aspect, an embodiment of the present application provides a heart rate monitoring system, comprising:
[0006] The VPU unit is used to obtain a resonance signal at the earphone housing in real time according to a start signal; the resonance signal is processed to obtain denoised data and sent to the chip unit; the resonance signal is transmitted to the earphone housing by the heartbeat after being transmitted to the inner wall epidermis of the ear canal, and the resonance is generated between the inner wall epidermis of the ear canal and the earphone housing;
[0007] The chip unit is used to receive denoised data, perform feature extraction on the denoised data, and obtain feature data; determine the current clean heartbeat data based on the feature data, determine the heartbeat frequency based on the clean heartbeat data, and feed back the heartbeat frequency to the user terminal.
[0008] Optionally, when the chip unit determines the current clean heartbeat data based on the characteristic data, it is specifically used to:
[0009] Obtain a heartbeat data set, and determine the heartbeat data range based on the heartbeat data set;
[0010] Determine the clean heartbeat data corresponding to the feature data based on the heartbeat data range.
[0011] Optionally, when the VPU unit processes the resonance signal to obtain denoised data, it is specifically used to:
[0012] The resonance signal at the earphone housing is picked up by the piezoelectric film and converted into an electrical signal;
[0013] The electrical signal is processed to obtain denoised data.
[0014] Optionally, when the VPU unit processes the electrical signal to obtain denoised data, it is specifically used to:
[0015] The electrical signal is amplified to obtain an amplified electrical signal; the amplified electrical signal is filtered to obtain a denoised electrical signal; the denoised electrical signal is analog-to-digital converted to obtain denoised data.
[0016] Optionally, the chip unit is further used for:
[0017] Detect human ears in real time, and when it is determined that human ears are detected, generate a start signal and output it to the VPU unit.
[0018] In a second aspect, an embodiment of the present application provides a heart rate monitoring method, which is applied to a VPU unit, including:
[0019] Acquire a resonance signal at the earphone housing in real time according to the start signal;
[0020] The resonance signal is processed to obtain denoised data which is sent to the chip unit so that the chip unit receives the denoised data, performs feature extraction on the denoised data to obtain feature data, determines the current clean heartbeat data based on the feature data, determines the heartbeat frequency based on the clean heartbeat data, and feeds back the heartbeat frequency to the user terminal; wherein the resonance signal is transmitted to the inner wall epidermis of the ear canal through the heartbeat, and resonance is generated between the inner wall epidermis of the ear canal and the earphone shell and is transmitted to the earphone shell.
[0021] Optionally, a resonance signal at the earphone housing is picked up by a piezoelectric film, and the resonance signal is converted into an electrical signal;
[0022] The electrical signal is processed to obtain denoised data.
[0023] Optionally, the electrical signal is amplified to obtain an amplified electrical signal; the amplified electrical signal is filtered to obtain a denoised electrical signal; and the denoised electrical signal is analog-to-digital converted to obtain denoised data.
[0024] In a third aspect, an embodiment of the present application provides a heart rate monitoring method, which is applied to a chip unit, including:
[0025] Receive denoised data, perform feature extraction on the denoised data, and obtain feature data; the denoised data is obtained by the VPU unit processing the resonance signal, the resonance signal is transmitted to the ear canal inner wall epidermis through the heartbeat, and the resonance between the ear canal inner wall epidermis and the earphone shell is transmitted to the earphone shell, and the resonance is obtained in real time at the earphone shell by the VPU unit according to the start signal;
[0026] The current clean heartbeat data is determined based on the feature data, the heartbeat frequency is determined based on the clean heartbeat data, and the heartbeat frequency is fed back to the user terminal.
[0027] Optionally, a heartbeat data set is obtained, and a heartbeat data range is determined according to the heartbeat data set;
[0028] Determine the clean heartbeat data corresponding to the feature data based on the heartbeat data range.
[0029] Optionally, the human ear is detected in real time, and when it is determined that the human ear is detected, a start signal is generated and output to the VPU unit.
[0030] In a fourth aspect, an embodiment of the present application provides a heart rate monitoring device, applied to a VPU unit, comprising:
[0031] An acquisition module, used for acquiring a resonance signal at the earphone housing in real time according to a start signal;
[0032] The first processing module is used to process the resonance signal, obtain denoised data and send it to the chip unit, so that the chip unit receives the denoised data, performs feature extraction on the denoised data to obtain feature data, determines the current clean heartbeat data based on the feature data, determines the heartbeat frequency based on the clean heartbeat data, and feeds back the heartbeat frequency to the user terminal; wherein the resonance signal is transmitted to the inner wall epidermis of the ear canal through the heartbeat, and resonance is generated between the inner wall epidermis of the ear canal and the earphone shell and transmitted to the earphone shell.
[0033] Optionally, the first processing module is further used to pick up a resonance signal at the earphone housing through the piezoelectric film and convert the resonance signal into an electrical signal;
[0034] The electrical signal is processed to obtain denoised data.
[0035] Optionally, the first processing module is further used to amplify the electrical signal to obtain an amplified electrical signal; filter the amplified electrical signal to obtain a denoised electrical signal; and perform analog-to-digital conversion on the denoised electrical signal to obtain denoised data.
[0036] In a fifth aspect, an embodiment of the present application provides a heart rate monitoring device, applied to a chip unit, comprising:
[0037] A receiving module is used to receive denoised data, perform feature extraction on the denoised data, and obtain feature data; the denoised data is obtained by the VPU unit processing the resonance signal, the resonance signal is transmitted to the ear canal inner wall epidermis through the heartbeat, and the resonance between the ear canal inner wall epidermis and the earphone shell is transmitted to the earphone shell, and the resonance is obtained in real time at the earphone shell by the VPU unit according to the start signal;
[0038] The second processing module is used to determine the current clean heartbeat data based on the characteristic data, determine the heartbeat frequency according to the clean heartbeat data, and feed back the heartbeat frequency to the user terminal.
[0039] Optionally, the second processing module is further used to obtain a heartbeat data set, and determine a heartbeat data range according to the heartbeat data set;
[0040] Determine the clean heartbeat data corresponding to the feature data based on the heartbeat data range.
[0041] Optionally, the second processing module is also used to detect human ears in real time, and when it is determined that a human ear is detected, a start signal is generated and output to the VPU unit.
[0042] In a sixth aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor;
[0043] Memory stores computer-executable instructions;
[0044] The processor executes the computer-executable instructions stored in the memory, so that the processor executes various possible implementations of the second aspect and / or the third aspect as described above.
[0045] In a seventh aspect, an embodiment of the present application provides an earphone, comprising: a heart rate monitoring system and an earphone shell; the heart rate monitoring system comprises a VPU unit and a chip unit, and the earphone shell comprises an ear rod and an ear bag; wherein the VPU unit is installed at the connection between the ear rod and the ear bag, and the VPU unit is fixed by UV glue;
[0046] The VPU unit is used to execute various possible implementations of the second aspect as described above, and the chip unit is used to execute various possible implementations of the third aspect as described above.
[0047] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-readable storage medium is stored computer execution instructions, which, when executed by a processor, are used to implement various possible implementations of the second aspect and / or the third aspect as described above.
[0048] In a ninth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements various possible implementations of the second aspect and / or the third aspect above.
[0049] The heart rate monitoring system, method, device, earphone, medium and product provided in the embodiments of the present application obtain a resonance signal at the earphone shell in real time according to a start signal through a VPU unit. The resonance signal is transmitted to the inner wall epidermis of the ear canal through the heartbeat, and then transmitted to the earphone shell through the resonance generated between the inner wall epidermis of the ear canal and the earphone shell. The VPU unit processes the obtained resonance signal to obtain denoised data and sends it to the chip unit. The chip unit extracts features of the denoised data to obtain feature data of the denoised data, determines clean heartbeat data corresponding to the current heart vibration according to the obtained feature data, determines the heartbeat frequency according to the clean heartbeat data, and feeds back the heartbeat frequency to the user terminal, thereby improving the accuracy and convenience of heart rate monitoring. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0051] Figure 1 A schematic diagram of the prior art scenario provided for this application;
[0052] Figure 2 A schematic diagram of the structure of the heart rate monitoring system provided for this application;
[0053] Figure 3 Schematic diagram of the principle of earphone monitoring heart rate provided for this application;
[0054] Figure 4 Schematic diagram of the headphones provided for this application;
[0055] Figure 5 A schematic diagram of the structure of the heart rate monitoring device provided in this application Figure 1 ;
[0056] Figure 6 A schematic diagram of the structure of the heart rate monitoring device provided in this application Figure 2 ;
[0057] Figure 7 A schematic diagram of the structure of the electronic device provided in this application.
[0058] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0059] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0060] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards in the relevant regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0061] Figure 1 The schematic diagram of the prior art scenario provided for this application is as follows: Figure 1 As shown, the scene includes a wearable device 10 and a user 20. The wearable device includes an infrared acquisition unit 11 and a display unit 12. The user wears the wearable device (such as a bracelet and a watch) to monitor the heart rate in real time. The wearable device uses the infrared technology of the infrared acquisition unit to penetrate the human skin and / or fat to collect the user's heartbeat signal, generates a heart rate monitoring result based on the heartbeat signal and sends it to the display unit to feed back the heart rate monitoring result to the user.
[0062] However, infrared technology is affected by external factors such as temperature, humidity and light, which can affect the accuracy of heart rate monitoring, so it has great limitations. In addition, infrared technology is difficult to penetrate thick fat layers and / or skin layers, which reduces the accuracy of heart rate monitoring for obese people.
[0063] The heart rate monitoring system provided by the present application detects the user's ear in real time through the chip unit, determines that when the human ear is detected, a start signal is generated and sent to the VPU unit. After receiving the start signal, the VPU unit picks up a resonance signal from the earphone shell through the piezoelectric film. The resonance signal is transmitted to the inner wall epidermis of the ear canal through the heartbeat, and then the resonance is generated between the inner wall epidermis of the ear canal and the earphone shell and transmitted to the earphone shell. After the VPU unit obtains the resonance signal, it converts the resonance signal into an electrical signal through the piezoelectric film, amplifies the electrical signal to obtain an amplified signal, filters the amplified signal to obtain a denoised electrical signal, performs analog-to-digital conversion on the denoised electrical signal, obtains denoised data and sends it to the chip unit. The chip unit determines the characteristic data corresponding to the denoised data, and determines the clean heartbeat data corresponding to the characteristic data, calculates the heartbeat frequency based on the clean heartbeat data and sends it to the user terminal. The present application can directly pick up the resonance signal of the human heartbeat by picking up the signal at the earphone shell through the VPU unit, and determine the heart rate through the chip unit after processing the resonance signal, thereby avoiding the influence of the external environment on the monitoring results, improving the convenience and accuracy of heart rate monitoring, and further improving the reliability of heart rate monitoring.
[0064] The heart rate monitoring system provided in this application is intended to solve the above technical problems in the prior art.
[0065] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0066] Figure 2 The structural diagram of the heart rate monitoring system provided in this application is as follows: Figure 2 As shown, the heart rate monitoring system includes a VPU unit and a chip unit, wherein the VPU unit includes a sound pickup module, a signal amplification module, a signal filtering module and a signal conversion module. The VPU unit is used to obtain the resonance signal at the earphone shell in real time according to the start signal; the resonance signal is processed to obtain denoised data and sent to the chip unit; the resonance signal is transmitted to the ear canal inner wall epidermis through the heartbeat, and the resonance between the ear canal inner wall epidermis and the earphone shell is transmitted to the earphone shell; the chip unit is used to receive the denoised data, extract features from the denoised data, and obtain feature data; determine the current clean heartbeat data based on the feature data, determine the heartbeat frequency based on the clean heartbeat data, and feed the heartbeat frequency back to the user terminal. In this embodiment, the VPU unit picks up the resonance signal at the earphone shell worn by the user, processes the resonance signal to obtain denoised data, and determines the heartbeat frequency based on the feature data of the denoised data through the chip unit, which improves the convenience of heart rate monitoring and further improves the efficiency of heart rate monitoring.
[0067] Exemplarily, the voltage of the VPU unit is 1.8 volts and the current is 55 microamperes.
[0068] Optionally, before the VPU unit obtains the resonance signal at the earphone shell according to the start signal, the chip unit detects the human ear in real time, and when it is determined that the human ear is detected, generates a start signal and outputs it to the VPU unit. In this embodiment, the chip unit can send a start signal to start heart rate monitoring when the human ear is detected by wearing headphones daily, thereby improving the convenience and timeliness of heart rate monitoring in daily life.
[0069] In a possible embodiment, the earphone housing is a housing of a TWS earphone, and the chip unit includes but is not limited to a CPU and a GPU.
[0070] Optionally, the VPU unit processes the resonance signal to obtain denoised data, including: picking up the resonance signal at the earphone housing through the piezoelectric film, converting the resonance signal into an electrical signal; and processing the electrical signal to obtain denoised data. This embodiment does not require contact with the skin of the user's heart corresponding to the area, and uses the piezoelectric film in the VPU unit to accurately monitor and identify the heart rate in a noisy environment, thereby improving the accuracy and reliability of the heart rate monitoring results and the convenience of monitoring.
[0071] In a possible embodiment, the piezoelectric film includes a vibration sensor.
[0072] Optionally, the VPU unit processes the electrical signal to obtain denoised data, including: amplifying the electrical signal to obtain an amplified electrical signal; filtering the amplified electrical signal to obtain a denoised electrical signal; performing analog-to-digital conversion on the denoised electrical signal to obtain denoised data. This embodiment reduces the power consumption of the electrical signal processing process by using a low-power VPU unit to perform amplification, filtering, and analog-to-digital conversion, thereby increasing the duration of heart rate monitoring after a single charge of the headset, achieving convenient heart rate monitoring while reducing the number of charging times, and further improving the stability and reliability of user heart rate monitoring.
[0073] Optionally, the step of the chip unit determining the current clean heartbeat data based on the characteristic data includes: obtaining a heartbeat data set, determining a heartbeat data range according to the heartbeat data set; and determining clean heartbeat data corresponding to the characteristic data based on the heartbeat data range. The heartbeat data set includes multiple heartbeat signals.
[0074] In a possible embodiment, before the chip unit determines the clean heartbeat data, it obtains the heartbeat data set, determines the characteristic information corresponding to each heartbeat signal in the heartbeat data set, and determines the heartbeat data range according to each characteristic information in the heartbeat data set. When the chip receives the denoised data, it performs feature extraction on the denoised data to obtain the characteristic data corresponding to the denoised data, and selects the data within the heartbeat data range from the characteristic data as the clean heartbeat data. This embodiment screens the denoised data, further improving the accuracy and reliability of the heart rate monitoring results.
[0075] Figure 3 The schematic diagram of the principle of the earphone monitoring heart rate provided for this application is as follows Figure 3 As shown, the earphone includes an earphone shell and a heart rate monitoring system, and the heart rate monitoring system includes a VPU unit and a chip unit. When the user wears the earphone into the ear, the chip unit of the earphone generates a start signal when detecting the human ear and sends it to the VPU unit. When the VPU unit receives the start signal, it starts heart rate monitoring.
[0076] Optionally, before heart rate monitoring, the chip unit obtains a heartbeat data set, determines each feature information corresponding to the heartbeat signal in the heartbeat data set, and obtains the heartbeat data range by analyzing each feature information.
[0077] Exemplarily, the heartbeat data range is a heartbeat frequency range.
[0078] Optionally, the real-time heartbeat signal generated by the beating of the user's heart is transmitted to the inner wall epidermis of the user's ear canal through vibration, and the inner wall epidermis of the ear canal transmits the received signal to the earphone shell that contacts the inner wall epidermis of the ear canal in a resonant manner.
[0079] Optionally, when the VPU unit of the headset detects the presence of a signal within the above-mentioned heartbeat frequency range at the headset shell through a vibration sensor, the resonance signal generated by the heartbeat at the headset shell is picked up through a piezoelectric film, and the resonance signal is converted into an electrical signal; the electrical signal is enhanced by a preamplifier to obtain an amplified electrical signal; the amplified electrical signal is filtered by a filter to remove non-heart rate signals (such as voice) to obtain a denoised electrical signal; the analog denoised electrical signal is converted into digital denoised data through an analog-to-digital converter and sent to the chip unit, thereby reducing data loss caused during transmission and improving the convenience of the chip unit in processing denoised data and the reliability of the processing results.
[0080] Optionally, the chip unit receives denoised data, performs feature extraction on the denoised data to obtain corresponding feature data, compares the feature data with the above-mentioned heart rate frequency range, determines clean heartbeat data within the heart rate frequency range from the feature data, and determines the current user's heart rate vibration frequency through the amplitude change corresponding to the clean heartbeat data.
[0081] Optionally, the chip unit sends the heart rate vibration frequency of the current user to the user terminal, and the user terminal provides the heart rate vibration frequency to determine the heartbeat frequency and displays it to the user.
[0082] The heart rate monitoring method provided in the embodiment of the present application uses a low-power and small-sized VPU unit to effectively extract the resonance signal of the heartbeat from a noisy environment, and after processing the resonance signal to obtain denoised data, the chip unit further determines the clean heartbeat data based on the denoised data, thereby calculating the heartbeat frequency, thereby improving the convenience and practicality of heart rate monitoring, as well as the accuracy and stability of heart rate monitoring.
[0083] Optionally, the earphone shell of the present application includes an ear stem and an ear bag, the VPU unit is installed at the connection between the ear stem and the ear bag, and the VPU unit is fixed by UV glue.
[0084] In the prior art, the VPU unit is fixed by using silicone or hot melt adhesive. However, the hardness of silicone or hot melt adhesive is poor, which may easily affect the transmission of the resonance signal.
[0085] The present application fixes the VPU unit at the connection between the ear rod and the ear bag of the earphone shell by hard glue (such as UV glue), thereby improving the accuracy and efficiency of the VPU unit in picking up the resonance signal.
[0086] In one possible embodiment, Figure 4 The schematic diagram of the earphones provided for this application is as follows: Figure 4 As shown, the earphone housing includes an ear rod 401 and an ear bag 402, and the connecting portion 403 between the ear rod and the ear bag is determined as the center of gravity area of the earphone, and the above center of gravity area is determined as the fixed area of the VPU unit.
[0087] Exemplarily, the target position 404 is determined based on the above fixed area, and the VPU unit is fixed to the above target position by UV glue. In this embodiment, the VPU unit that picks up the resonance signal is fixed in the center of gravity area of the earphone, so as to achieve effective resonance between the earphone shell and the VPU unit, reduce the error of the resonance signal picked up by the VPU unit, and further improve the accuracy of heart rate monitoring.
[0088] Currently, headphones include speakers and batteries, and the speakers and batteries are prone to cause electromagnetic interference to the weak signal collection process, resulting in poor signal quality.
[0089] The present application installs a format sheet between the VPU unit and the battery and speaker of the headset, and the format sheet is used to isolate the electromagnetic interference of the speaker and battery of the headset to the VPU unit, thereby enhancing the quality of the picked-up resonance signal.
[0090] It should be noted that Figure 2The user terminal shown can be applicable to different network standards, for example, it can be applicable to Global System of Mobile communication (GSM), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE) system and future 5G and other network standards.
[0091] The above-mentioned user terminal can be a wireless terminal or a wired terminal. The wireless terminal can be a device that provides voice and / or other business data connectivity to the user, a handheld device with wireless connection function, or other processing equipment connected to a wireless modem. The wireless terminal can communicate with one or more core network devices via the Radio Access Network (RAN). The wireless terminal can be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer with a mobile terminal. For example, it can be a portable, pocket-sized, handheld, computer-built-in or vehicle-mounted mobile device that exchanges language and / or data with the wireless access network. For another example, the wireless terminal can also be a Personal Communication Service (PCS) phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) station, a Personal Digital Assistant (PDA) and other devices. A wireless terminal may also be referred to as a system, a subscriber unit, a subscriber station, a mobile station, a mobile station, a remote station, a remote terminal, an access terminal, a user agent, or a user device or user equipment, without limitation herein.
[0092] Figure 5A schematic diagram of the structure of the heart rate monitoring device provided in this application Figure 1 ,like Figure 5 As shown, applied to a VPU unit, the heart rate monitoring device 50 provided in this embodiment includes:
[0093] An acquisition module 501 is used to acquire a resonance signal at the earphone housing in real time according to a start signal;
[0094] The first processing module 502 is used to process the resonance signal, obtain denoised data and send it to the chip unit, so that the chip unit receives the denoised data, performs feature extraction on the denoised data to obtain feature data, determines the current clean heartbeat data based on the feature data, determines the heartbeat frequency based on the clean heartbeat data, and feeds back the heartbeat frequency to the user terminal; wherein the resonance signal is transmitted to the inner wall epidermis of the ear canal through the heartbeat, and resonance is generated between the inner wall epidermis of the ear canal and the earphone shell and transmitted to the earphone shell.
[0095] Optionally, the first processing module 502 is further configured to pick up a resonance signal at the earphone housing through the piezoelectric film and convert the resonance signal into an electrical signal;
[0096] The electrical signal is processed to obtain denoised data.
[0097] Optionally, the first processing module 502 is further used to amplify the electrical signal to obtain an amplified electrical signal; filter the amplified electrical signal to obtain a denoised electrical signal; and perform analog-to-digital conversion on the denoised electrical signal to obtain denoised data.
[0098] The heart rate monitoring device applied to the VPU unit provided in this embodiment can execute the above embodiments, and its implementation principle and technical effects are similar, so this embodiment will not be described in detail here.
[0099] Figure 6 A schematic diagram of the structure of the heart rate monitoring device provided in this application Figure 2 ,like Figure 6 As shown, applied to a chip unit, the heart rate monitoring device 60 provided in this embodiment includes:
[0100] The receiving module 601 is used to receive denoised data, perform feature extraction on the denoised data, and obtain feature data; the denoised data is obtained by the VPU unit processing the resonance signal, and the resonance signal is transmitted to the ear canal inner wall epidermis through the heartbeat, and the resonance between the ear canal inner wall epidermis and the earphone shell is transmitted to the earphone shell, and is obtained in real time at the earphone shell by the VPU unit according to the start signal;
[0101] The second processing module 602 is used to determine the current clean heartbeat data based on the characteristic data, determine the heartbeat frequency according to the clean heartbeat data, and feed back the heartbeat frequency to the user terminal.
[0102] Optionally, the second processing module 602 is further used to obtain a heartbeat data set, and determine a heartbeat data range according to the heartbeat data set;
[0103] Determine the clean heartbeat data corresponding to the feature data based on the heartbeat data range.
[0104] Optionally, the second processing module 602 is further configured to detect a human ear in real time, and when it is determined that a human ear is detected, generate a start signal and output it to the VPU unit.
[0105] The heart rate monitoring device applied to the chip unit provided in this embodiment can execute the above embodiments, and its implementation principle and technical effects are similar, so this embodiment will not be described in detail here.
[0106] Figure 7 This is a schematic diagram of the structure of the electronic device provided in this application. Figure 7 As shown, the electronic device 70 provided in this embodiment includes: at least one processor 701 and a memory 702. Optionally, the device 70 further includes a communication component 703. The processor 701, the memory 702 and the communication component 703 are connected via a bus 704.
[0107] In a specific implementation process, at least one processor 701 executes the computer-executable instructions stored in the memory 702, so that at least one processor 701 executes the above method.
[0108] The specific implementation process of the processor 701 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.
[0109] In the above embodiments, it should be understood that the processor can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the invention can be directly implemented as a hardware processor, or can be implemented by a combination of hardware and software modules in the processor.
[0110] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (NVM), such as at least one disk storage.
[0111] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of this application is not limited to only one bus or one type of bus.
[0112] The present application also provides a computer program product, including a computer program, which implements the above method when executed by a processor.
[0113] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above method is implemented.
[0114] The above-mentioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.
[0115] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.
[0116] The division of units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.
[0117] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0118] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0119] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.
[0120] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.
[0121] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.
[0122] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
Claims
1. A heart rate monitoring system, characterized in that: include: The VPU unit is used to obtain a resonance signal at the earphone housing in real time according to a start signal; process the resonance signal to obtain denoised data and send it to the chip unit; The resonance signal is transmitted to the ear canal inner wall epidermis through the heartbeat, and then the resonance is generated between the ear canal inner wall epidermis and the earphone housing and transmitted to the earphone housing; A chip unit is used to receive the denoised data, perform feature extraction on the denoised data, and obtain feature data; The current clean heartbeat data is determined based on the characteristic data, the heartbeat frequency is determined according to the clean heartbeat data, and the heartbeat frequency is fed back to the user terminal.
2. The system according to claim 1, characterized in that When the chip unit determines the current clean heartbeat data based on the characteristic data, it is specifically used to: Acquire a heartbeat data set, and determine a heartbeat data range according to the heartbeat data set; Clean heartbeat data corresponding to the characteristic data is determined based on the heartbeat data range.
3. The system according to claim 1, characterized in that When the VPU unit processes the resonance signal to obtain denoised data, it is specifically used to: Picking up a resonance signal at the earphone housing through a piezoelectric film and converting the resonance signal into an electrical signal; The electrical signal is processed to obtain denoised data.
4. The system according to claim 3, characterized in that When the VPU unit processes the electrical signal to obtain denoised data, it is specifically used to: The electrical signal is amplified to obtain an amplified electrical signal; the amplified electrical signal is filtered to obtain a denoised electrical signal; the denoised electrical signal is analog-to-digital converted to obtain denoised data.
5. The system according to claim 1, characterized in that The chip unit is also used for: The human ear is detected in real time, and when it is determined that the human ear is detected, a start signal is generated and output to the VPU unit.
6. A heart rate monitoring method, characterized in that: Applicable to VPU units, including: Acquire a resonance signal at the earphone housing in real time according to the start signal; The resonance signal is processed to obtain denoised data which is sent to a chip unit so that the chip unit receives the denoised data, performs feature extraction on the denoised data to obtain feature data, determines current clean heartbeat data based on the feature data, determines the heartbeat frequency based on the clean heartbeat data, and feeds back the heartbeat frequency to a user terminal; wherein the resonance signal is transmitted to the inner wall epidermis of the ear canal through the heartbeat, and resonance is generated between the inner wall epidermis of the ear canal and the earphone shell and is transmitted to the earphone shell.
7. A heart rate monitoring method, characterized in that: Applied to chip units, including: Receive denoised data, perform feature extraction on the denoised data, and obtain feature data; the denoised data is obtained by the VPU unit processing a resonance signal, the resonance signal is transmitted to the ear canal inner wall epidermis through the heartbeat, the ear canal inner wall epidermis and the earphone shell generate resonance and are transmitted to the earphone shell, and the VPU unit obtains the resonance signal in real time at the earphone shell according to the start signal; The current clean heartbeat data is determined based on the characteristic data, the heartbeat frequency is determined according to the clean heartbeat data, and the heartbeat frequency is fed back to the user terminal.
8. An electronic device, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to claim 6 or 7.
9. A headset, characterized in that: include: A heart rate monitoring system and an earphone shell; the heart rate monitoring system includes a VPU unit and a chip unit, and the earphone shell includes an ear rod and an ear bag; wherein the VPU unit is installed at the connection between the ear rod and the ear bag, and the VPU unit is fixed by UV glue; The VPU unit is used to execute the method according to claim 6, and the chip unit is used to execute the method according to claim 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to claim 6 or 7 when executed by a processor.
11. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to claim 6 or 7 when being executed by a processor.