Method, device and storage medium for determining hearing loss curve
By using transfer function and noise signal processing technology in the headphones, combined with speaker loss assessment, selecting a high confidence hearing loss curve for customized compensation, the problem of unstable headphone measurement results is solved, and the accuracy of auxiliary listening function is improved and User experience.
Patent Information
- Application Number
- CN202210452287.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-27
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2042-04-27
AI Technical Summary
When measuring the hearing loss curve, existing earphones with auxiliary listening function are affected by factors such as wearing status, ambient sound and speaker loss, resulting in unstable measurement results, affecting the user experience and product image.
By playing test audio data on the speakers of the headset, obtaining the noise signal collected by the feedforward microphone, determining the noise energy using the first and second transfer functions, combining the noise confidence factor and the speaker loss measure factor, calculating the confidence value, and selecting the Hearing loss curves with high confidence are customized for compensation.
It improves the accuracy and stability of the hearing loss curve, ensures the accuracy of customized compensation, improves the hearing aid effect and user experience of the headphones, and maintains the product image.
Smart Images

Figure CN114979923B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of hearing assistance functions, and in particular to a method, device and storage medium for determining a hearing loss curve. Background Art
[0002] In recent years, the field of hearing health has attracted the attention of major mobile phone and headphone manufacturers. With the opening of the market, headphones with assistive hearing function have been favored by more and more users because they can provide hearing aids for users with mild to moderate hearing loss. At present, when headphones with assistive hearing function achieve hearing aid effects, they need to first measure the user's hearing loss curve, and then implement customized hearing loss compensation based on the user's hearing loss curve. In other words, whether a good hearing aid effect can be achieved depends on the accuracy of the measured hearing loss curve.
[0003] However, in actual applications, different wearing states of the headphones, the volume of ambient sound, and even the degree of component loss of the headphone speakers will affect the measurement results of the hearing loss curve, resulting in obvious differences in the results of two adjacent measurements (or two measurements that are close in time). This will not only make users doubt that the auxiliary hearing function is not perfect, thus affecting the product image, but also make users unclear about which measurement result should be used for hearing loss compensation, thus affecting the user experience. Summary of the invention
[0004] In order to solve the above technical problems, the present application provides a method, device and storage medium for determining a hearing loss curve, aiming to ensure the accuracy of the determined hearing loss curve so that the customized hearing loss compensation achieved according to the hearing loss curve is suitable for the user, thereby improving the hearing aid effect of headphones with auxiliary hearing function, which can not only maintain the product image but also ensure user experience.
[0005] In a first aspect, the present application provides a method for determining a hearing loss curve. The method includes: in response to a received hearing loss measurement instruction, in the process of playing the test audio data of each frequency by the speaker of the headset that establishes a communication connection, obtaining the noise signal collected by the feedforward microphone of the headset; determining the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum according to the first transfer function and the noise signal corresponding to the test audio data of each frequency, the first transfer function is the transfer function from the feedforward microphone to the eardrum; fusing the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum to obtain the target noise energy; determining the noise confidence factor according to the target noise energy; determining the first confidence value according to the noise confidence factor and the loss degree measurement factor of the speaker, the first confidence value is the confidence value of the hearing loss curve corresponding to the current hearing loss measurement; determining the target hearing loss curve according to the first confidence value and the second confidence value, the second confidence value is the confidence value of the hearing loss curve corresponding to the adjacent hearing loss measurement, and the target hearing loss curve is used to guide hearing loss compensation. Therefore, by giving a confidence score to the hearing loss curve corresponding to each hearing loss measurement, and then determining the target hearing loss curve based on the confidence values of the hearing loss curves corresponding to multiple hearing loss measurements, the accuracy of the determined target hearing loss curve is ensured, thereby ensuring that the customized hearing loss compensation achieved according to the target hearing loss curve with higher accuracy is suitable for the user.
[0006] According to the first aspect, after responding to the received hearing loss measurement instruction, the method further includes: obtaining the wearing state of the earphone; determining a second transfer function according to the ear canal fitting algorithm and the wearing state, the second transfer function being the transfer function of the feedback microphone from the speaker to the earphone; and obtaining the first transfer function according to the second transfer function. Thus, it is ensured that the first transfer function and the second transfer function obtained are suitable for the current wearing state and the ear canal characteristics of the current user, so that the target hearing loss curve determined by means of the first transfer function and the second transfer function can better reflect the hearing loss of the current user.
[0007] According to the first aspect, or any implementation of the first aspect above, the noise energy of the noise signal corresponding to each frequency of the test audio data at the eardrum is determined according to the first transfer function and the noise signal of the test audio data corresponding to each frequency, including: transforming the noise signal of the test audio data corresponding to each frequency from the time domain to the frequency domain; determining the noise energy of the noise signal corresponding to each frequency of the test audio data at the eardrum according to the first transfer function and the noise signal transformed to the frequency domain. Thus, by transforming the noise signal from the time domain to the frequency domain, different frequency components in the noise signal can be better analyzed, and interference, noise and jitter in the noise signal can be better discovered.
[0008] According to the first aspect, or any implementation of the first aspect above, the noise energy of the noise signal of the test audio data corresponding to each frequency at the eardrum is fused to obtain the target noise energy, including: using an A-weighted fusion method to fuse the noise energy of the noise signal of the test audio data corresponding to each frequency at the eardrum to obtain the target noise energy. Since the measurement of noise is to reflect the loudness sensation caused by the human ear, it is necessary to fully consider the auditory characteristics of the human ear, and A-weighting can well reflect the auditory characteristics of the human ear. Therefore, by adopting the A-weighted fusion method to fuse the noise energy of the noise signal of the test audio data corresponding to each frequency at the eardrum, it can be ensured that the target noise energy obtained can accurately reflect the auditory characteristics of the human ear, thereby ensuring that the target confidence value finally determined according to the target noise energy is more accurate.
[0009] According to the first aspect, or any implementation of the first aspect above, determining the noise confidence factor according to the target noise energy includes: determining the noise confidence factor according to the target noise energy and a monotonically decreasing function.
[0010] According to the first aspect, or any implementation of the first aspect above, before determining the first confidence value according to the noise confidence factor and the loss degree measurement factor of the speaker, the method also includes: obtaining the current signal and voltage signal of the speaker; determining the current T / S parameter of the speaker according to the current signal and voltage signal; and determining the loss degree measurement factor according to the T / S parameter and the T / S parameter threshold. Thus, by determining the current loss degree measurement factor of the speaker according to the current signal and voltage signal of the speaker, the confidence value determined according to the target noise energy and the loss degree measurement factor can comprehensively consider the user's ear canal characteristics, the wearing state of the earphone, and the state of the speaker, thereby ensuring that the final target hearing loss curve is more accurate.
[0011] According to the first aspect, or any implementation of the first aspect above, before obtaining the current signal and voltage signal of the speaker, the method further includes: determining whether the power amplifier used by the headset is a smart power amplifier SmartPA; if the power amplifier used by the headset is SmartPA, performing the step of obtaining the current signal and voltage signal of the speaker; otherwise, setting the loss degree measurement factor to 1. In this way, for a headset whose power amplifier is not SmartPA, when the current current signal and voltage signal of the speaker cannot be determined through SmartPA, the value of the loss degree measurement factor is directly set to 1, which will not affect the determination of the confidence value.
[0012] According to the first aspect, or any implementation of the first aspect above, a target hearing loss curve is determined according to a first confidence value and a second confidence value, including: when the first confidence value is greater than or equal to the second confidence value, the hearing loss curve corresponding to the first confidence value is determined as the target hearing loss curve; when the first confidence value is less than the second confidence value, the hearing loss curve corresponding to the second confidence value is determined as the target hearing loss curve. Since the higher the confidence value, the higher the accuracy of the hearing loss curve corresponding to it, when the hearing loss curves corresponding to multiple hearing loss measurements within a certain period of time are different, by selecting the hearing loss curve with the highest confidence value as the target hearing loss curve, the accuracy of the target hearing loss curve used to guide hearing loss compensation is guaranteed as much as possible, so that the customized hearing loss compensation based on the target hearing loss curve is more suitable for the current user.
[0013] According to the first aspect, or any implementation of the first aspect above, determining a target hearing loss curve according to a first confidence value and a second confidence value includes: determining the target hearing loss curve according to the first confidence value and the hearing loss curve corresponding to the first confidence value, and the second confidence value and the hearing loss curve corresponding to the second confidence value. Thus, by performing a weighted average operation on the hearing loss curves corresponding to the multiple hearing loss curve measurements based on the confidence values obtained from the multiple hearing loss curve measurements, it is ensured that the target hearing loss curve finally obtained by the weighted average operation comprehensively considers the characteristics of the hearing loss curves corresponding to the multiple hearing loss curve measurements, thereby making the customized hearing loss compensation based on the target hearing loss curve more suitable for the current user.
[0014] In a second aspect, the present application provides an electronic device. The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes instructions of the method in the first aspect or any possible implementation of the first aspect.
[0015] In a third aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.
[0016] In a fourth aspect, the present application provides a computer program, comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.
[0017] In a fifth aspect, the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 is a schematic diagram of a hardware structure of an electronic device shown as an example;
[0019] Figure 2 is a schematic diagram showing an exemplary flow chart of a method for determining a hearing loss curve provided by the present application;
[0020] Figure 3 is a schematic diagram showing an exemplary setting interface of an electronic device;
[0021] Figure 4 is a schematic diagram showing an exemplary hearing loss measurement interface of an electronic device;
[0022] Figure 5 is a schematic diagram of an exemplary Bluetooth headset;
[0023] Figure 6 is a schematic diagram of multiple groups of first transfer functions shown as an example;
[0024] Figure 7 is a schematic diagram of multiple groups of second transfer functions shown as an example;
[0025] Figure 8 is a schematic diagram including multiple hearing loss curves;
[0026] Fig. 9 is another schematic diagram including multiple hearing loss curves, which is exemplarily shown. DETAILED DESCRIPTION
[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0028] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0029] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.
[0030] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0031] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.
[0032] In order to better understand the technical solution provided by the embodiment of the present application, before describing the technical solution of the embodiment of the present application, a brief description of hearing loss is first given.
[0033] Specifically, hearing loss can usually be expressed by three important parameters: the degree of hearing loss (from moderate to profound), the type of hearing loss (from conductive to sensorineural), and the hearing loss curve. Among them, the hearing loss curve is mainly composed of a curve formed by the degree of hearing loss at different frequencies. If it is an ascending hearing loss curve, it is low-frequency hearing loss; if it is a descending hearing loss curve, it is mainly related to sensorineural hearing loss. Therefore, if you want to provide customized hearing loss compensation for users so that the compensated hearing aid effect can meet user needs, the accuracy of the hearing loss curve is very critical.
[0034] Therefore, in order to ensure the accuracy of the determined hearing loss curve, the method for determining the hearing loss curve provided in the present application is proposed, so as to ensure the accuracy of the determined hearing loss curve as much as possible. In this way, customized hearing loss compensation can be achieved according to the determined hearing loss curve to suit the user, thereby improving the hearing aid effect of headphones with auxiliary hearing function, which not only maintains the product image but also guarantees the user experience.
[0035] For example, the electronic device to which the technical solution provided in this application is applicable may be, for example, a mobile phone, a tablet, a PC, etc., and its hardware structure may be, for example, Figure 1 shown.
[0036] For example, see Figure 1The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0037] In addition, it should be noted that, in actual applications, the audio module 170 may include, for example, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and the like.
[0038] Specifically in the technical solution provided by the present application, if the earphones with assistive hearing function are wired earphones, the wired earphones can be connected to the electronic device through the earphone interface 170D, so that after the electronic device responds to the received hearing loss measurement instruction, it can obtain the noise signal required for the technical solution provided by the present application, as well as the wearing status of the wired earphones, the current signal and voltage signal of the speaker of the wired earphones, etc.
[0039] In addition, it is understandable that if the earphone with auxiliary hearing function is a Bluetooth earphone, the Bluetooth earphone can be matched with the Bluetooth (Bluetooth, BT) chip / module in the wireless communication module 160 of the electronic device through the built-in Bluetooth (Bluetooth, BT) chip / module to establish a communication connection with the electronic device. In this way, after the electronic device responds to the received hearing loss measurement instruction, it can obtain the noise signal required by the technical solution provided by this application from the Bluetooth that establishes a communication connection with it through the wireless communication module 160, as well as the wearing status of the wired earphone, the current signal and voltage signal of the speaker of the wired earphone, etc.
[0040] Exemplarily, the sensor module 180 may include, for example, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0041] In addition, it should be noted that, in actual applications, the button 190 may include, for example, a power button (power on button), a home button, a volume button, etc. The button 190 may be a mechanical button. It may also be a touch button. The electronic device 100 may receive a button input and generate a key signal input related to the user settings and function control of the electronic device 100.
[0042] In addition, it should be noted that, in actual applications, the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc.
[0043] It is understandable that, in a specific implementation, different processing units may be independent devices or may be integrated into one or more processors.
[0044] In addition, in some implementations, the controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0045] In addition, the memory in the processor 110 is mainly used to store instructions and data. In some implementations, the memory in the processor 110 is a cache memory.
[0046] In addition, it is understandable that in actual application scenarios, the executable program codes that trigger the electronic device 100 to implement various functional applications and data processing are stored in the internal memory 121, and these executable program codes include instructions.
[0047] The hardware structure of the electronic device 100 is introduced here. It should be understood that: Figure 1 The electronic device 100 shown is only an example. In a specific implementation, the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Figure 1 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0048] The implementation details of the technical solution provided in the embodiment of the present application are described below. The following content is only the implementation details provided for the convenience of understanding and is not necessary for implementing the present solution.
[0049] For example, see Figure 2 , the specific implementation steps of the embodiment of the present application include:
[0050] Step S101, in response to the received hearing loss measurement instruction, in the process of playing the test audio data of each frequency by the speaker of the headset with established communication connection, obtaining the noise signal collected by the feedforward microphone of the headset.
[0051] Exemplarily, in some implementations, the hearing loss measurement instruction may be triggered by a user on a display interface of an electronic device, for example, the user clicks a function button / option displayed on the display interface of the electronic device for triggering hearing loss measurement.
[0052] Exemplarily, in some other implementations, the hearing loss measurement instruction may also be triggered by the user clicking a certain agreed mechanical button.
[0053] Exemplarily, in some other implementations, the hearing loss measurement instruction may also be automatically triggered by the electronic device, for example, when it is detected that a headset with an assistive hearing function has established a communication connection with it (a wired headset is plugged into the headphone jack of the electronic device, and a Bluetooth headset establishes a connection with the wireless communication module of the electronic device).
[0054] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0055] In addition, it should be noted that the hearing loss curve is a measurement result of the user's hearing loss. Therefore, when implementing the technical solution provided in this embodiment, it is necessary to ensure that the headset has established a communication connection with the electronic device and the user wears the headset on the ear. The method for establishing a communication connection between the electronic device and the headset is not described in detail here.
[0056] In addition, it should be noted that, specifically in the technical solution provided in this embodiment, the headphones used to collect noise signals and test signals must have, in addition to a speaker, a feedforward microphone (also called an external microphone, or FF microphone), and a feedback microphone (also called an internal microphone).
[0057] In addition, it is understandable that since the feedforward microphone is set on the side of the earphone shell away from the ear canal, when the user wears the earphone, the isolation between the feedforward microphone and the speaker in the earphone can reach -40dB. Therefore, in this scenario, the noise signal collected by the feedforward microphone can be regarded as the ambient noise of the surrounding environment. The feedback microphone is integrated into the earphone close to the internal speaker, so the test signal collected by the feedback microphone is the test signal of the test audio data played when the speaker outputs the test signal for measuring the hearing loss curve.
[0058] It is understandable that in order to understand the impact of test signals of different frequencies on the user's hearing loss and to obtain a hearing loss curve that can accurately reflect the user's hearing loss, multiple test audio data of different frequencies need to be played during the hearing loss measurement process, and the noise signal collected by the feedforward microphone corresponds to the test audio data of each frequency, that is, the test audio data has several frequencies, and the obtained noise signal also has several frequencies.
[0059] In addition, it should be noted that in actual applications, there are often some users who can hear others talking, but actually have hearing loss, and these hearing losses usually start from high frequencies, which is why users with hearing loss can hear low-frequency speech, but cannot hear or cannot hear clearly high-frequency audio data. Therefore, in order to solve this problem and better determine whether the user has hearing loss, the test audio data played in this embodiment includes pure tone data of different frequencies from low frequency to high frequency, so that pure tone signals (test signals) of different frequencies can be obtained.
[0060] Exemplarily, the test audio data played can be between 125Hz and 8000Hz. For example, a group of test audio data at 125Hz, a group of test audio data at 250Hz, a group of test audio data at 500Hz, a group of test audio data at 1000Hz, a group of test audio data at 2000Hz, a group of test audio data at 4000Hz, and a group of test audio data at 8000Hz can be selected as the test audio data to be played and then played in sequence.
[0061] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0062] In addition, it should be noted that, in this embodiment, the acquired noise signal needs to be processed according to the transfer function from the feedforward microphone to the eardrum, and each frequency test signal needs to be processed according to the transfer function from the speaker to the feedback microphone. For ease of explanation, in this embodiment, the transfer function from the feedforward microphone to the eardrum is referred to as the first transfer function, or expressed as transfer function P j, the transfer function from the speaker to the feedback microphone is called the second transfer function, or G j , where j=1,…,J.
[0063] It can be understood that in this embodiment, the first transfer function is used to determine the impulse response from the feedforward microphone to the eardrum, that is, the noise energy, and the second transfer function is used to determine the first transfer function. Therefore, after responding to the received hearing loss measurement instruction, in addition to performing the above-mentioned operation of obtaining the noise signal, it is also necessary to perform the operation of obtaining the first transfer function, so as to ensure that the subsequent steps S102 to S106 can be smoothly executed.
[0064] Exemplarily, the operation of obtaining the first transfer function may be divided into the following three steps:
[0065] First, obtain the wearing status of the headset.
[0066] It is understandable that due to different wearing conditions, such as the tightness of wearing, the measurement results of the hearing loss curve are very different. Therefore, in order to make the currently used first transfer function and second transfer function better match the current wearing state of the headset, thereby ensuring that the final hearing loss curve matches the current wearing state, it is necessary to obtain the wearing state of the headset before obtaining the first transfer function and the second transfer function.
[0067] Exemplarily, in some implementations, the wearing status of the earphone may be determined, for example, by data collected by various sensors provided in the earphone, which is not described or limited in this embodiment.
[0068] Then, according to the ear canal fitting algorithm and the wearing state, the second transfer function is determined.
[0069] Exemplarily, in this embodiment, according to the ear canal fitting algorithm and the wearing state, the specific implementation process of obtaining the first transfer function and the second transfer function can be, for example: after the earphone is worn, the speaker of the earphone plays the in-ear prompt sound, and after the feedback microphone of the earphone receives the signal corresponding to the prompt sound, channel identification is performed, and the estimated value of the transfer function from the speaker to the feedback microphone in the current environment can be obtained.
[0070] Next, we obtain an estimate of the transfer function from the speaker to the feedback microphone. After that, With all the G currently built j Compare with A group of transfer functions with the smallest difference, such as G0, can be determined as the adapted second transfer function.
[0071] Finally, the first transfer function is obtained according to the determined second transfer function.
[0072] It should be noted that, in actual applications, among the multiple sets of data tested by modeling, each set of data will correspond to a first transfer function and a second transfer function, that is, the first transfer function and the second transfer function appear in pairs, and when the second transfer function is adapted to the ear canal characteristics and wearing state of the current user, the first transfer function belonging to the same group as the second transfer function is also adapted to the ear canal characteristics and wearing state of the current user. Therefore, when the second transfer function is determined to be G0, the first transfer function can be determined to be P0 belonging to the same group as the second transfer function.
[0073] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0074] Thereby, it is ensured that the acquired first transfer function is suitable for the current wearing state and the ear canal characteristics of the current user, so that the target hearing loss curve determined by means of the first transfer function can better reflect the hearing loss of the current user.
[0075] In addition, it should be understood that the above description is only an example listed for a better understanding of the technical solution of this embodiment, and is not the only limitation to this embodiment. In practical applications, after responding to the received hearing loss measurement instruction, the step of obtaining the first transfer function may be performed before or after obtaining the noise signal, and this embodiment does not limit this.
[0076] In addition, it should be noted that, in this embodiment, the obtained first transfer function may be obtained, for example, by modeling from a pre-built modeling library containing multiple groups of first transfer functions.
[0077] Accordingly, the determined second transfer function may also be obtained by modeling from a pre-built modeling library containing a plurality of groups of second transfer functions.
[0078] Exemplarily, in some implementations, a large amount of data on the wearing status of the headphones can be collected in advance, and then the user's ear canal can be modeled based on this data to obtain multiple groups of first transfer functions and multiple groups of second transfer functions, and the first transfer function and the second transfer function obtained by training with one set of data can be associated.
[0079] In addition, taking into account the ear canal characteristics of different users, in order to enable the first transfer function and the second transfer function obtained by modeling to cover different ear canal characteristics and different wearing states, the collected modeling data should not only include data on different wearing states corresponding to the same ear canal characteristics, but also include data on different wearing states corresponding to different ear canal characteristics, thereby ensuring that the first transfer function and the second transfer function obtained by modeling can cover different ear canal characteristics and different wearing states.
[0080] In addition, regarding the specific implementation method of constructing the first transfer function and the second transfer function by modeling, reference may be made to existing standards and will not be repeated here.
[0081] In addition, it is understandable that, in practical applications, the modeling library storing the first transfer function and the modeling library storing the second transfer function may be the same or different, and this embodiment does not limit this.
[0082] In addition, it should be noted that both the first transfer function and the second transfer function are expressed in the form of a curve. The horizontal axis of the curve corresponds to the frequency, and the vertical axis corresponds to the response information (amplitude). In other words, different frequencies correspond to different response information, so one curve includes a group of transfer functions, and multiple curves include multiple groups of transfer functions.
[0083] In addition, it should be noted that when using pure tone data to measure the hearing loss curve, during the playback of the pure tone data, the user can adjust the volume until it can just be heard slightly. The hearing loss curve measured in this way is the user's corresponding hearing loss.
[0084] Step S102: determining the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum according to the first transfer function and the noise signal corresponding to the test audio data of each frequency.
[0085] It should be noted that, since the noise signal collected is usually in the time domain, the frequency domain can better analyze the different frequency components in the noise signal. Therefore, when determining the noise energy at the eardrum according to the first transfer function of the noise signal earring, the noise signal can be first transformed from the time domain to the frequency domain, and then the noise energy at the eardrum can be determined according to the noise signal transformed to the frequency domain and the first transfer function. In this way, interference, noise and jitter in the noise signal can be better found.
[0086] Exemplarily, in some implementations, the operation of determining the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum according to the first transfer function and the noise signal corresponding to the test audio data of each frequency can be implemented according to the following formula (1):
[0087] N(i)=X ff (i)P0(i) (1)
[0088] Wherein, P0 is the first transfer function suitable for the wearing state of the current earphone of the current user matched from the modeling library according to the wearing state of the earphone and / or the ear canal characteristics of the user, i represents the frequency index, X ff (i) is the noise signal spectrum collected by the feedforward microphone when testing the i-th frequency pure tone signal, and N(i) is the noise spectrum at the eardrum at the i-th frequency point that is finally determined.
[0089] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0090] Step S103: The noise energy of the noise signal of the test audio data corresponding to each frequency at the eardrum is fused to obtain the target noise energy.
[0091] Since there are multiple test frequencies, such as the 7 frequencies listed above, there are also multiple noise energies obtained, but only one noise energy is required to determine the confidence value. Therefore, in order to integrate the characteristics of the noise energy corresponding to the test signals of each frequency, this embodiment fuses the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum, and then uses the noise energy obtained after the fusion as the noise energy required to calculate the confidence value. For the convenience of description, this embodiment is referred to as the target noise energy.
[0092] Exemplarily, the method of fusing the noise energy at the eardrum of the noise signal of the test audio data corresponding to each frequency can be selected according to business needs. Since the measurement of noise needs to reflect the loudness sensation caused by the human ear, the auditory characteristics of the human ear need to be fully considered. Therefore, this embodiment adopts an A-weighted fusion method that can well reflect the auditory characteristics of the human ear to fuse the noise energy at the eardrum of the noise signal of the test audio data corresponding to each frequency, thereby ensuring that the final target noise energy can accurately reflect the auditory characteristics of the human ear, and further ensuring that the target confidence value finally determined according to the target noise energy is more accurate.
[0093] For example, regarding the use of the A-weighted fusion method, the operation of fusing the noise energy of the noise signal of the test audio data corresponding to each frequency at the eardrum to obtain the target noise energy can be implemented according to the following formula (2):
[0094]
[0095] Among them, w a,iis the A-weighted weight corresponding to the i-th frequency point, N(i) is the noise spectrum at the eardrum at the i-th frequency point, N A is the target noise energy obtained after fusion, and the value of I is the number of frequencies of the test audio data played.
[0096] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0097] Step S104: determining a noise confidence factor according to the target noise energy.
[0098] Specifically, when determining the noise confidence factor according to the target noise energy, it is necessary to use a monotonically decreasing function.
[0099] Exemplarily, the operation of determining the noise confidence factor according to the target noise energy and the monotonically decreasing function can be implemented according to the following formula (3):
[0100] α=f(N A ) (3)
[0101] Among them, N A is the target noise energy obtained after fusion, f() is a monotonically decreasing function, and α is the determined noise confidence factor.
[0102] In addition, it should be noted that in this embodiment, when the single decreasing function is f(0), its calculated value is 1, that is, f(0)=1; when the single decreasing function is f(∞), its calculated value is 0, that is, f(∞)=0.
[0103] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0104] Step S105: determining a first confidence value according to the noise confidence factor and the speaker loss degree measurement factor.
[0105] It should be noted that in actual usage scenarios, not only the user's ear canal characteristics, the wearing state of the earphone, and the surrounding ambient sound will affect the measured hearing loss curve, but the speaker state of the earphone will also affect the measured hearing loss curve. Therefore, in this embodiment, when determining the confidence value of the hearing loss curve, the loss degree of the speaker is also considered.
[0106] Exemplarily, in this embodiment, the loss degree of the speaker can be characterized by a loss degree measurement factor.
[0107] It is understandable that the loss degree measurement factor of the speaker can be determined by the current T / S parameter of the speaker and the T / S parameter threshold in an ideal state (no loss). The current T / S parameter of the speaker can be determined based on the current current signal and voltage signal of the speaker. Therefore, in order to determine the loss degree measurement factor of the speaker, it is necessary to first obtain the current signal and voltage signal of the speaker.
[0108] It should be noted that the current current signal and voltage signal of the speaker need to be obtained through a power amplifier used to amplify the signal output by the speaker, and the power amplifier needs to be a smart power amplifier, i.e., SmartPA. Therefore, before obtaining the current current signal and voltage signal of the speaker, it is necessary to first determine whether the power amplifier used by the headset is SmartPA.
[0109] Correspondingly, when the power amplifier used by the earphone is SmartPA, the current signal and voltage signal of the speaker are obtained through SmartPA and then provided to the electronic device for processing.
[0110] Exemplarily, after receiving the current signal and voltage signal of the speaker provided by SmartPA, the electronic device determines the current T / S parameters of the speaker based on the current signal and the voltage signal, so that the loss degree measurement factor can be determined based on the obtained current T / S parameters of the speaker and the T / S parameter threshold under ideal conditions.
[0111] It should be noted that the T / S parameters (also denoted as TS parameters) mentioned in this embodiment generally refer to the small signal parameters and large signal parameters listed by the speaker manufacturer in the product manual and standards, which can indicate the performance indicators of the speaker, such as whether it is damaged, the degree of loss, etc. For specific large signal parameters and small signal parameters, please refer to the existing standards and will not be repeated here.
[0112] Specifically in this embodiment, the loss degree measurement factor is determined by considering five independent variables in the T / S parameters, namely, vibration mass, magnetic factor, DC impedance, mechanical damping and suspension system compliance.
[0113] In addition, regarding the T / S parameter threshold under ideal conditions, the T / S parameter of an unused speaker can be obtained through the above five independent variables listed in the product manual and standards, or through measurement methods, and then this T / S parameter can be used as the T / S parameter threshold under ideal conditions.
[0114] Exemplarily, the operation of determining the loss degree measurement factor according to the current T / S parameter of the speaker and the T / S parameter threshold under an ideal state can be determined by an abstract function g(·), and the specific calculation formula is as follows:
[0115] β=g(ts,ts ideal ) (4)
[0116] Among them, β is the loss degree measurement factor, ts is the current T / S parameter of the speaker, and ts ideal is the T / S parameter threshold under ideal conditions.
[0117] For example, on the basis of formula (4), the five independent variables of vibration mass Mms, magnetic factor BI, DC impedance Re, mechanical damping Rms and suspension system compliance Cms are introduced, and the calculation formula for calculating α is changed from formula (4) to the following formula (5):
[0118]
[0119] Among them, Mms is the currently determined vibration mass, is the ideal vibration quality, BI is the currently determined magnetic factor, is the magnetic factor in the ideal state, Re is the DC impedance determined at present, is the ideal DC impedance, Rms is the currently determined mechanical damping, is the ideal mechanical damping, Cms is the compliance of the currently determined suspension system, The suspension system compliance is in ideal state.
[0120] In addition, it should be noted that, specifically in this embodiment, the value range of the loss degree measurement factor determined based on the current T / S parameters of the speaker and the T / S parameter threshold under the ideal state is limited to between 0 and 1 (including the two end values of 0 and 1), and in some implementations the value range can be expressed as β∈[0,1], where 1 represents no loss and 0 represents high loss.
[0121] In addition, it should be noted that if the power amplifier used in the headset is not SmartPA, in order to ensure that the same method of calculating the confidence value can take into account both occasions, the value of the loss degree factor can be set to 1, which will not affect the determination of the confidence value.
[0122] Therefore, by determining the current loss degree measurement factor of the speaker based on the current signal and voltage signal of the speaker, the confidence value determined based on the target noise energy and the loss degree measurement factor can comprehensively consider the user's ear canal characteristics, the wearing status of the earphones and the status of the speaker, thereby ensuring that the final target hearing loss curve is more accurate.
[0123] In addition, it should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0124] Exemplarily, after obtaining the loss degree measurement factor β corresponding to the speaker, the confidence value of the hearing loss curve corresponding to this hearing loss measurement can be determined based on the obtained loss degree measurement factor α and the target noise energy fused in step S104. For the sake of convenience in describing this embodiment, it is referred to as the first confidence value.
[0125] Exemplarily, the operation of determining the first confidence value according to the target noise energy and the loss degree measurement factor of the speaker can be implemented according to the following formula (6):
[0126] c=h(α,β)=α×β (6)
[0127] Among them, β is the loss degree measurement factor, α is the target noise energy obtained after fusion, and c is the confidence value of the hearing loss curve corresponding to this hearing loss measurement, that is, the first confidence value.
[0128] Step S106: determining a target hearing loss curve according to the first confidence value and the second confidence value.
[0129] It can be understood that the second confidence value is the confidence value of the hearing loss curve corresponding to an adjacent hearing loss measurement. The target hearing loss curve determined according to the first confidence value and the second confidence value is used to guide hearing loss compensation, that is, customized hearing loss compensation is achieved according to the target hearing loss curve, so that the hearing aid effect after compensation can better meet the actual situation of the current user.
[0130] In addition, it can be understood that the method for determining the second confidence value is the same as the method for determining the first confidence value, and will not be repeated here.
[0131] In addition, in practical applications, there may be multiple second confidence values, so that the target hearing loss curve selected is a target hearing loss curve that comprehensively considers the characteristics of hearing loss curves corresponding to multiple (greater than 2) hearing loss measurements.
[0132] Regarding the operation of determining the target hearing loss curve according to the first confidence value and the second confidence value, in some implementations, the hearing loss curve with the highest confidence value may be selected as the target hearing loss curve. For example, when the first confidence value is greater than or equal to the second confidence value, the hearing loss curve corresponding to the first confidence value is determined as the target hearing loss curve; when the first confidence value is less than the second confidence value, the hearing loss curve corresponding to the second confidence value is determined as the target hearing loss curve. Since the higher the confidence value, the higher the accuracy of the hearing loss curve corresponding to it, when the hearing loss curves corresponding to multiple hearing loss measurements within a certain period of time are different, by selecting the hearing loss curve with the highest confidence value as the target hearing loss curve, the accuracy of the target hearing loss curve used to guide hearing loss compensation is guaranteed as much as possible, so that the customized hearing loss compensation based on the target hearing loss curve is more suitable for the current user.
[0133] In addition, it should be noted that, considering that the user's hearing condition is changing, it is possible to set a hearing loss curve corresponding to only recent hearing loss measurements, such as within the last month, three months, or six months.
[0134] Exemplarily, the above time setting may be determined by the user, that is, a time setting option is set under the hearing loss compensation function in the electronic device, and the user controls the device.
[0135] In addition, in order to ensure the accuracy of the hearing loss curve determined according to the confidence value, a minimum confidence threshold can also be set, that is, if the confidence value of the hearing loss curve obtained in the recent measurement is lower than the minimum confidence threshold, it will not be considered.
[0136] In addition, if the confidence values of the hearing loss curves obtained from recent measurements are all lower than the minimum confidence threshold, the user may be prompted to re-measure.
[0137] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0138] Exemplarily, in other implementations, the operation of determining the target hearing loss curve according to the first confidence value and the second confidence value may also be to use the hearing loss curve obtained by weighted averaging the hearing loss curves corresponding to the multiple hearing loss curve measurements based on the confidence values obtained from the multiple hearing loss curve measurements as the target hearing loss curve. In this way, it can be ensured that the target hearing loss curve finally obtained by the weighted average operation comprehensively considers the characteristics of the hearing loss curves corresponding to the multiple hearing loss curve measurements, thereby making the customized hearing loss compensation based on the target hearing loss curve more suitable for the current user.
[0139] Regarding the method of using the hearing loss curve obtained by weighted averaging the hearing loss curves corresponding to the multiple hearing loss curve measurements based on the confidence values obtained from the multiple hearing loss curve measurements as the target hearing loss curve, it can be implemented according to the following formula (7):
[0140]
[0141] Among them, L is the target hearing loss curve after fusion, c k is the corresponding confidence value, K represents the number of measurements in recent measurement results whose confidence value is greater than the minimum confidence threshold, and L k represents the k-th hearing loss curve.
[0142] In addition, regarding this method, the confidence value of the hearing loss curve used to calculate the fused target hearing loss curve can also be a confidence value within a preset time and greater than a minimum confidence value.
[0143] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0144] Therefore, the method for determining the hearing loss curve provided in this embodiment performs confidence scoring on the hearing loss curve corresponding to each hearing loss measurement, and then determines the target hearing loss curve based on the confidence values of the hearing loss curves corresponding to multiple loss measurements, thereby ensuring the accuracy of the determined target hearing loss curve, and further ensuring that the customized hearing loss compensation achieved according to the target hearing loss curve with higher accuracy is suitable for the user.
[0145] That is to say, based on the method for determining the hearing loss curve provided in this embodiment, the hearing aid effect of headphones with auxiliary hearing function can be greatly improved, which can not only maintain the product image but also ensure the user experience.
[0146] In order to better understand the method for determining the hearing loss curve provided in the present application, the following examples are combined with Figures 3 to 9 , taking the electronic device as a mobile phone and the headset as a Bluetooth headset as an example, the method for determining the hearing loss curve provided in this application is specifically described.
[0147] See also Figure 3 Exemplarily, the display interface of the mobile phone 100 shows the setting page 10a of the mobile phone, and the setting page 10a includes one or more controls, such as user account setting options, sound setting options, wireless and network setting options, device connection setting options, hearing loss compensation options, etc.
[0148] Exemplarily, in some implementations, when the user clicks on the user account setting option in the setting page 10a, the mobile phone 100 can jump from the setting page 10a to a display list page showing payment and bills, cloud space and other accounts in response to the user's operation, for the user to select the corresponding option.
[0149] Exemplarily, in some implementations, when the user clicks on the sound setting option in the setting page 10a, the mobile phone 100 can jump from the setting page 10a to the page for setting the do not disturb, ringtone, vibration and other functions of the mobile phone 100 in response to the user's operation behavior, so that the user can set them as needed.
[0150] Exemplarily, in some implementations, when the user clicks on the wireless and network settings option in the settings page 10a, the mobile phone 100 can jump from the settings page 10a to the page for setting WLAN, dual-card management, mobile network and other functions in response to the user's operation, so that the user can set them as needed.
[0151] Exemplarily, in some implementations, when the user clicks on the device connection setting option in the setting page 10a, the mobile phone 100 can jump from the setting page 10a to the page for setting Bluetooth, NFC, mobile phone screen projection and other functions in response to the user's operation behavior, so that the user can set it as needed.
[0152] Exemplarily, when the user clicks on the hearing loss compensation setting option in the setting page 10a, the mobile phone 100 jumps from the setting page 10a to the hearing loss test page in response to the user's operation behavior, so that the user can perform a hearing loss test according to the prompt.
[0153] Specifically in this embodiment, when implementing the hearing loss curve determination scheme, it is necessary to first ensure that a communication connection is established between the mobile phone 100 and the Bluetooth headset. From the above functional description of the device connection setting option, it can be seen that when connecting the Bluetooth headset to the mobile phone 100, it is necessary to turn on the Bluetooth functions of both devices at the same time, and then pair them. Figure 2 The interface shown is a schematic diagram of establishing a communication connection with a Bluetooth headset. The specific implementation details of connecting a Bluetooth headset to the mobile phone 100 are not described in detail in this embodiment.
[0154] For example, after determining that a Bluetooth headset with an auxiliary hearing function has been connected to the mobile phone 100, when the user clicks the hearing loss compensation setting option 10a-1 in the setting page 10a, the mobile phone 100 jumps from the setting page 10a to the Figure 4 Hearing loss test page 10b is shown.
[0155] See also Figure 4Exemplarily, the hearing loss test page 10b includes one or more controls, such as a control 10b-1 for determining whether the currently playing pure tone can be heard, a control 10b-2 for determining whether the currently playing pure tone can be heard, a volume adjustment control 10b-3, a control 10b-4 for continuing to play the pure tone of the next frequency, a control 10b-5 for exiting the hearing loss test page, a control 10b-6 for canceling the test result of the currently playing pure tone, etc.
[0156] For example, when the user clicks on the control 10b-1 in the hearing loss test page 10b, the mobile phone 100 responds to the user's operation and locks the current volume value of the control 10b-3. Figure 5 The volume of the pure sound played by the speaker 20b of the Bluetooth headset 200 shown is just enough for the user to hear, and the test signal obtained by the feedback microphone 20c of the Bluetooth headset 200 (since the present embodiment plays pure sound, that is, a sound pressure signal that satisfies a certain frequency, the test signal will be referred to as a pure sound signal in the following) is the pure sound signal corresponding to the current volume value of 10b-3.
[0157] It is understandable that in order to ensure that the volume value locked by control 10b-3 is exactly the volume that the user can hear, when entering the hearing loss test page 10b and starting to play pure sound, it usually starts from a volume value of "0" or a lower volume value. In this way, after continuously adjusting the volume through control 10b-3, the volume value that the user can hear is the volume value that needs to be locked.
[0158] In addition, it is understandable that in actual applications, if the user cannot hear the pure sound currently being played through the Bluetooth headset 200, when the user clicks on the control 10b-2 in the hearing loss test page 10b, the mobile phone 100 can automatically adjust the volume value corresponding to the control 10b-3 according to the preset increment in response to the user's operation behavior, thereby eliminating the need for manual adjustment by the user. This can better ensure that the locked volume value is what the user can just hear, thereby ensuring the accuracy of the hearing loss measurement results.
[0159] In addition, from the description of the above embodiment, it can be seen that in the process of measuring the hearing loss curve, multiple pure tones of different frequencies will be played. Therefore, after locking the current volume value of the control 10b-3, when the user clicks the control 10b-4 in the hearing loss test page 10b, the mobile phone 100 can play the pure tone of the next frequency in response to the user's operation, and then repeat the above operation until the test of pure tones of all frequencies is completed, and the feedback microphone 20c of the Bluetooth headset 200 can collect the pure tone signal of each frequency.
[0160] Continue to see Figure 4For example, in some implementations, if the user wants to end the hearing loss test during the test, the user can click on the control 10b-5. After the user clicks on the control 10b-5 in the hearing loss test page 10b, the mobile phone 100 jumps back to the setting page 10a from the hearing loss test page 10b in response to the user's operation.
[0161] In addition, it should be noted that during the hearing loss test, that is, the display interface of the mobile phone 100 stays on the hearing loss test page 10b, and during the pure sound playing process, the feedforward microphone 20a of the Bluetooth headset 200 will collect the sound information of the current external environment and provide it to the mobile phone 100 as a noise signal.
[0162] Exemplarily, the noise signal collected by the feedforward microphone 20a is in the time domain, that is, a signal within a time period. Therefore, in some implementations, it can be agreed that each pure tone signal of a frequency corresponds to a noise signal. For example, the noise signal corresponding to the pure tone signal of the i-th frequency is the noise signal collected by the feedforward microphone 20a during the time period of playing the pure tone of the i-th frequency, and the noise signal corresponding to the pure tone signal of the i+1th frequency is the noise signal collected by the feedforward microphone 20a during the time period of playing the pure tone of the i+1th frequency. In this way, the signal-to-noise ratio corresponding to the pure tone signal of each frequency is determined based on the noise energy of the pure tone signal of the current frequency and the noise signal corresponding to the pure tone signal of the current frequency.
[0163] Exemplarily, in other implementations, the noise signal used to determine the signal-to-noise ratio corresponding to the pure tone signal of each frequency may be a noise signal collected during the entire test process, that is, the signal-to-noise ratios corresponding to the pure tone signals of all frequencies are determined using the noise energy of the same noise signal.
[0164] Exemplarily, in other implementations, the noise signal collected by the feedforward microphone 20a obtained by the mobile phone 100 may be received during the entire test process, but when determining the signal-to-noise ratio corresponding to the pure tone signal of each frequency, the noise energy is determined by obtaining the portion of the corresponding time period from the complete noise signal according to the playback time period of the pure tone signal of each frequency, and then the signal-to-noise ratio is determined.
[0165] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0166] Furthermore, it is understandable that Figure 3 , Figure 4The above is only a specific display style of the display page of the mobile phone 100 when performing a hearing loss test. It is an example listed for better understanding of the technical solution of this embodiment and is not the only limitation to this embodiment. In practical applications, Figure 4 In the hearing loss test interface shown, an entrance for selecting a left ear test and an entrance for selecting a right ear test may also be provided so as to implement a test of the hearing loss of the user's left and right ears.
[0167] also, Figure 5 What is provided is only one structure of a Bluetooth headset, which is an example listed for a better understanding of the technical solution of this embodiment and is not the only limitation to this embodiment.
[0168] For example, in Figure 4 After the hearing loss test page 10b shown completes playing pure tones of all frequencies, the mobile phone 100 can determine the noise energy at the eardrum based on the noise signal collected by the feedforward microphone 20a and the first transfer function P0 that matches the ear canal characteristics of the current user and the wearing state of the earphone.
[0169] Exemplarily, the first transfer function P0 used in this embodiment may be, for example, Figure 6 The multiple transfer functions P shown j Matched; Regarding the second transfer function G0 used in this embodiment, for example, it can be from Figure 7 The multiple transfer functions G shown j Matched in .
[0170] For example, in some implementations, multiple sets of transfer functions P can be constructed based on different human ear characteristic data and headphone wearing status data. j Specifically, each curve corresponds to a set of first transfer functions, such as Figure 6 As shown, multiple curves are given, indicating that there are multiple groups of first transfer functions, and the currently matched first transfer function P0 is one of these curves.
[0171] For example, in some implementations, multiple groups of transfer functions G can be constructed according to different human ear characteristic data and headphone wearing state data. j , specifically, each curve corresponds to a set of second transfer functions, such as Figure 7 As shown, multiple curves are given, indicating that there are multiple groups of second transfer functions, and the currently matched second transfer function G0 is one of these curves.
[0172] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0173] For example, according to Figure 6 The noise energy at the eardrum is determined by using the first transfer function P0 matched with the noise signal collected by the feedforward microphone 20a. By fusing the noise energy corresponding to all frequency points, for example, by using the A-weighted fusion method described in the above embodiment, a target noise energy that fuses the noise energy characteristics corresponding to all frequency points can be obtained. Next, a noise confidence factor is determined based on the obtained target noise energy. The confidence value of the hearing loss curve corresponding to the current hearing loss measurement can be determined based on the determined noise confidence factor and the determined loss degree measurement factor of the speaker 20b. For example, c n Indicates (where n is an integer greater than 1, indicating the number of tests).
[0174] Accordingly, the confidence value c of the hearing loss curve corresponding to the hearing loss measurement is obtained. n After that, you can search for historical measurement results, such as c n-1 , then according to c n 、c n-1 and agreed selection criteria, such as selecting a hearing loss curve with a high confidence value as the target hearing loss curve, or based on c n and c n-1 The target hearing loss curve can be determined by performing a weighted average operation on the hearing loss curves corresponding to the two hearing loss curve measurements and obtaining the hearing loss curve as the target hearing loss curve.
[0175] For example, see Figure 8 There are two hearing loss curves, hearing loss curve A and hearing loss curve B, where the horizontal axis is frequency and the vertical axis is volume decibels.
[0176] Continue to see Figure 8 For example, assuming that the confidence value corresponding to the hearing loss curve A is c n , the confidence value corresponding to the hearing loss curve B is c n-1 If c n ≥c n-1 According to the selection criteria of the hearing loss curve with a high confidence value as the target hearing loss curve, the hearing loss curve A is the final target hearing loss curve; otherwise, the hearing loss curve B is the final target hearing loss curve.
[0177] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0178] Continue to see Figure 8 , for example, based on the above conditions, if based on c n and cn-1 The hearing loss curve obtained by weighted averaging the hearing loss curves corresponding to the two hearing loss curve measurements is used as the selection criterion for the target hearing loss curve. The target hearing loss curve is determined based on c n and c n-1 The hearing loss curve A and the hearing loss curve B are weighted averaged to obtain the hearing loss curve C, which is the final target hearing loss curve. For example, the relationship between the hearing loss curve A, the hearing loss curve B and the hearing loss curve C is: Fig. 9 shown.
[0179] About C-based n and c n-1 The specific implementation method of performing a weighted average operation on the hearing loss curve A and the hearing loss curve B to obtain the hearing loss curve C can be referred to the above embodiment, which will not be repeated here.
[0180] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0181] This is the end of the specific implementation process of determining the confidence value of the hearing loss curve according to the data provided by the Bluetooth headset, and then determining the target hearing loss curve according to the confidence values of the hearing loss curve obtained by multiple measurements. For details not described in this embodiment, please refer to Figure 2 The description of the illustrated embodiment will not be repeated here.
[0182] In addition, it is understood that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.
[0183] In addition, it should be noted that the method for determining the hearing loss curve provided by the above embodiments implemented by the electronic device in the actual application scenario can also be performed by a chip system included in the electronic device, wherein the chip system may include a processor. The chip system can be coupled to the memory so that when the chip system is running, the computer program stored in the memory is called to implement the steps performed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.
[0184] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method for determining the hearing loss curve in the above-mentioned embodiment.
[0185] In addition, an embodiment of the present application further provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the method for determining the hearing loss curve in the above-mentioned embodiment.
[0186] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the hearing loss curve determination method in the above-mentioned embodiment, so as to control the receiving pin to receive the signal, so as to control the sending pin to send the signal.
[0187] In addition, it can be seen from the above description that the electronic device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0188] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for determining a hearing loss curve, characterized in that: The method comprises: In response to the received hearing loss measurement instruction, during the process of playing the test audio data of each frequency by the speaker of the headset with established communication connection, obtaining the noise signal collected by the feedforward microphone of the headset; Determine the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum according to a first transfer function and the noise signal corresponding to the test audio data of each frequency, wherein the first transfer function is a transfer function from the feedforward microphone to the eardrum; Fusing the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum to obtain the target noise energy; Determining a noise confidence factor according to the target noise energy; Determining a first confidence value according to the noise confidence factor and the loss degree measurement factor of the speaker, wherein the first confidence value is a confidence value of a hearing loss curve corresponding to the current hearing loss measurement; determining a target hearing loss curve according to the first confidence value and the second confidence value, wherein the second confidence value is a confidence value of a hearing loss curve corresponding to an adjacent hearing loss measurement, and the target hearing loss curve is used to guide hearing loss compensation; Wherein, after responding to the received hearing loss measurement instruction, the method further includes: Obtaining the wearing status of the headset; Determine a second transfer function according to the ear canal fitting algorithm and the wearing state, where the second transfer function is a transfer function from the speaker to the feedback microphone of the earphone; The first transfer function is obtained according to the second transfer function.
2. The method according to claim 1, characterized in that: The step of determining the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum according to the first transfer function and the noise signal corresponding to the test audio data of each frequency comprises: transforming the noise signal corresponding to the test audio data at each frequency from the time domain to the frequency domain; The noise energy of the noise signal corresponding to each frequency of the test audio data at the eardrum is determined according to the first transfer function and the noise signal transformed into the frequency domain.
3. The method according to claim 1, characterized in that The step of fusing the noise energy of the noise signal corresponding to the test audio data of each frequency at the eardrum to obtain the target noise energy includes: The noise energy of the noise signal corresponding to each frequency of the test audio data at the eardrum is fused using the A-weighted fusion method to obtain the target noise energy.
4. The method according to claim 1, characterized in that: The determining of the noise confidence factor according to the target noise energy includes: A noise confidence factor is determined according to the target noise energy and a monotonically decreasing function.
5. The method according to claim 1, characterized in that Before determining the first confidence value according to the noise confidence factor and the loss degree measurement factor of the speaker, the method further includes: Acquiring a current signal and a voltage signal of the speaker; Determine a current T / S parameter of the speaker according to the current signal and the voltage signal; The loss degree measurement factor is determined according to the T / S parameter and the T / S parameter threshold.
6. The method according to claim 5, characterized in that Before obtaining the current signal and the voltage signal of the speaker, the method further includes: Determine whether the power amplifier used by the headset is a smart power amplifier SmartPA; If the power amplifier used by the headset is SmartPA, executing the step of obtaining the current signal and the voltage signal of the speaker; Otherwise, the loss degree measurement factor is set to 1.
7. The method according to any one of claims 1 to 6, characterized in that: The step of determining a target hearing loss curve according to the first confidence value and the second confidence value comprises: When the first confidence value is greater than or equal to the second confidence value, determining the hearing loss curve corresponding to the first confidence value as the target hearing loss curve; When the first confidence value is less than the second confidence value, the hearing loss curve corresponding to the second confidence value is determined as the target hearing loss curve.
8. The method according to any one of claims 1 to 6, characterized in that: The step of determining a target hearing loss curve according to the first confidence value and the second confidence value comprises: A target hearing loss curve is determined according to the first confidence value and the hearing loss curve corresponding to the first confidence value, and the second confidence value and the hearing loss curve corresponding to the second confidence value.
9. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the method for determining a hearing loss curve as described in any one of claims 1 to 8.
10. A computer-readable storage medium, characterized in that: It comprises a computer program, and when the computer program is run on an electronic device, the electronic device executes the method for determining a hearing loss curve according to any one of claims 1 to 8.
Citation Information
Patent Citations
Fitting method and device for hearing earphone
CN111447539A
System and method for optimized active controller design in an ANR system
US20050254665A1