Hearing loss compensation method based on hearing aid device, and terminal

Abstract

Disclosed in embodiments of the present application are a hearing loss compensation method based on a hearing aid device, and a terminal, for use in simplifying a hearing loss test process and improving the accuracy of hearing loss compensation. The hearing loss compensation method based on a hearing aid device is executed by a terminal, and a communication connection is established between the terminal and a hearing aid device to be fitted. The method comprises: performing a hearing loss test on a hearing aid subject to obtain a hearing loss test result; on the basis of the hearing loss test result, performing hearing loss compensation to obtain a hearing loss compensation gain; and sending the hearing loss compensation gain to the hearing aid device, wherein the hearing aid device is used for performing hearing loss compensation on a first voice signal on the basis of the hearing loss compensation gain to obtain a second voice signal.

Description

Hearing loss compensation method and terminal based on assistive listening device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on August 2, 2023, with application number 202310972617.9 and invention name “A hearing loss compensation method and terminal based on assistive listening equipment”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a method and terminal for compensating for hearing loss based on an assistive listening device. Background Art

[0003] Hearing loss is a hearing impairment that refers to partial or complete loss of hearing, which can occur in one or both ears. Hearing loss can be graded into four levels: 26-40dB is mild, 41-60dB is moderate, 61-80dB is severe, and greater than 80dB is profound.

[0004] People with hearing loss need to use hearing aids and other assistive listening products to assist their hearing. Hearing loss requires an audiometric test at a fitting center, followed by a professional hearing aid fitter, followed by repeated manual adjustments and testing to complete the entire fitting process.

[0005] The above solution has the problems of low accuracy of manual testing and complicated testing process.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a hearing loss compensation method and terminal based on an assistive listening device, which are used to simplify the hearing loss testing process and improve the accuracy of hearing loss compensation.

[0008] To solve the above technical problems, the embodiments of the present application provide the following technical solutions:

[0009] In a first aspect, an embodiment of the present application provides a hearing loss compensation method based on an assistive listening device, the method being executed by a terminal, and establishing a communication connection between the terminal and the assistive listening device to be fitted. The method includes: performing a hearing loss test on the hearing-assisted hearing subject to obtain a hearing loss test result; performing hearing loss compensation based on the hearing loss test result to obtain a hearing loss compensation gain; and sending the hearing loss compensation gain to the assistive listening device, wherein the assistive listening device is configured to perform hearing loss compensation on a first speech signal based on the hearing loss compensation gain to obtain a second speech signal.

[0010] In the above scheme, the terminal can compensate for the hearing loss of the hearing subject wearing the assistive hearing device, thereby realizing the fitting of the assistive hearing device for the hearing subject. The entire hearing loss compensation process can be realized by the interaction between the terminal and the assistive hearing device, and does not require the help of a doctor for manual testing. Therefore, the hearing loss test process can be performed quickly and easily. The terminal interacts with the assistive hearing device worn by the hearing subject to complete the hearing loss compensation. The hearing loss compensation can be performed for the hearing subject wearing the assistive hearing device, so the accuracy of the hearing loss compensation can be improved.

[0011] In a possible implementation of the first aspect, the performing of a hearing loss test on the assisted hearing object to obtain a hearing loss test result includes: performing a hearing test on the assisted hearing object to obtain a feedback speed of the assisted hearing object; generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the assisted hearing device; obtaining a hearing loss test result according to the first test signal and a first feedback instruction, the first feedback instruction including: a feedback instruction detected by the terminal when the assisted hearing device plays the first test signal. In the above scheme, the feedback speed of the assisted hearing object can be obtained by performing a hearing test on the assisted hearing object, and a first test signal is generated based on the feedback speed. The first test signal can be used to obtain a hearing loss test result. The first test signal sent according to the feedback speed of the assisted hearing object can achieve an accurate hearing loss test on the assisted hearing object and improve the accuracy of the hearing loss test result.

[0012] In one possible implementation of the first aspect, performing a hearing test on an assisted listening subject to obtain the assisted listening subject's feedback speed includes: sending a second test signal to the assisted listening device; and obtaining the feedback speed based on the second test signal and a second feedback instruction, where the second feedback instruction includes a feedback instruction detected by the terminal when the assisted listening device plays the second test signal. In this solution, the assisted listening subject can click a feedback button on the terminal's UI, so that the terminal detects the second feedback instruction sent by the assisted listening subject, and the terminal obtains the feedback speed based on the second test signal and the second feedback instruction.

[0013] In one possible implementation of the first aspect, generating the first test signal based on the feedback speed and a preset first volume includes generating the first test signal of a random length based on the feedback speed and the preset first volume, wherein the first test signal includes test signals of multiple frequencies for measuring the hearing loss level of the hearing aid recipient. In this embodiment, the terminal generates a test signal of a random length within a preset range based on the first volume and feedback speed, thereby preventing inertial fatigue in the hearing aid recipient and improving the accuracy of the hearing loss level test.

[0014] In one possible implementation of the first aspect, the first test signal includes a random mute signal; the method further includes detecting an erroneous operation feedback instruction sent by the assisted listening object when the assisted listening device plays the random mute signal; and sending an erroneous operation prompt signal to the assisted listening device based on the erroneous operation feedback instruction. In the above scheme, by adding a random mute signal to the first test signal, when the user clicks a button during the playback of the mute signal, the terminal can send an erroneous operation prompt signal to the assisted listening device, and the assisted listening device plays the erroneous operation prompt signal to prompt the user to click correctly, thereby avoiding user inertial fatigue, reducing erroneous operations, and improving the user's click accuracy rate.

[0015] In a possible implementation of the first aspect, the generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the assistive listening device includes: generating a plurality of first test signals corresponding to a first frequency point according to the feedback speed, the preset first volume, and a preset volume increase / decrease difference, and sending the plurality of first test signals to the assistive listening device, wherein the volume of one first test signal among the plurality of first test signals is the first volume, and the volumes of the other first test signals among the plurality of first test signals except the one first test signal are determined according to the first volume and the volume increase / decrease difference; and A feedback instruction for obtaining a hearing loss test result includes: determining a first reversal point based on multiple first feedback instructions corresponding to the multiple first test signals, the first reversal point including: a time point at which two adjacent first feedback instructions in the multiple first feedback instructions indicate different listening results; obtaining a second reversal point adjacent to the first reversal point; when the deviation between the first reversal point and the second reversal point is greater than a preset sound pressure threshold, clearing the frequency test result corresponding to the first reversal point; and when the deviation between the first reversal point and the second reversal point is less than or equal to the preset sound pressure threshold, obtaining the hearing loss test result based on the frequency test result of the first reversal point. In the above scheme, the terminal can record the deviation between the adjacent first reversal point and the second reversal point. If the deviation is less than or equal to the preset sound pressure threshold, it indicates that the frequency test result of the currently recorded first reversal point is accurate, and the frequency test can continue. The frequency test result of the first reversal point can be used to obtain the hearing loss test result.

[0016] In a possible implementation of the first aspect, obtaining the hearing loss test result based on the frequency test result at the first reversal point includes: when the number of times the frequency test result reaches an extreme value exceeds a number threshold, and / or the number of first test signals sent at the first frequency exceeds a number threshold, determining the hearing loss test result based on the frequency test result at the first reversal point. In the above scheme, the terminal may further set a frequency test termination condition. When the frequency test result meets the preset frequency test termination condition, the terminal stops testing the first frequency and determines the hearing loss test result based on the frequency test result at the first reversal point. By performing frequency testing, the efficiency of hearing loss testing can be improved.

[0017] In one possible implementation of the first aspect, compensating for hearing loss based on the hearing loss test results to obtain a hearing loss compensation gain includes: performing real-time compensation processing in the time domain and / or frequency domain based on the hearing loss test results to obtain a first compensation gain; and performing speech correction on the first compensation gain based on a preset speech test signal to obtain the hearing loss compensation gain. In this solution, after determining the first compensation gain, the terminal may send a preset speech test signal to the assistive listening device, and speech correction may be performed on the first compensation gain using the speech test signal to obtain the hearing loss compensation gain. This speech correction can improve speech recognition rate.

[0018] In a possible implementation of the first aspect, performing real-time compensation processing in the time domain and / or frequency domain based on the hearing loss test result to obtain a first compensation gain includes: obtaining a first hearing loss value at a first frequency point in the hearing loss test result; determining a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain based on a mapping relationship between the hearing loss value and the correction gain value; and determining the first compensation gain based on the first compensation gain value. In this embodiment, real-time compensation can be performed based on the mapping relationship between the hearing loss value and the correction gain value, thereby improving the accuracy of hearing loss compensation.

[0019] In a possible implementation of the first aspect, performing real-time compensation processing in the time domain and / or frequency domain based on the hearing loss test result to obtain a first compensation gain further includes: determining a hearing curve based on the hearing loss test result; and determining a mapping relationship between the hearing loss value and the correction gain value based on a classification result corresponding to the hearing curve. In the above solution, the hearing loss test result may include one or more hearing curves. The terminal may obtain the hearing curves, classify the hearing curve types based on a predetermined hearing curve library, obtain classification results corresponding to the hearing curves, and select a corresponding mapping relationship between the hearing loss value and the correction gain value based on the classification results, so that this mapping relationship between the hearing loss value and the correction gain value can be used for real-time compensation.

[0020] In a possible implementation of the first aspect, determining a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain based on a mapping relationship between hearing loss values ​​and correction gain values ​​includes: dividing the external input signal collected by the assistive listening device into multiple subbands according to octaves; obtaining speech estimation signals and noise estimation signals corresponding to the multiple subbands; performing speech intelligibility index analysis based on the speech estimation signals and noise estimation signals to obtain the loudness of the hearing loss; determining a first frequency domain compensation gain for the first hearing loss value in the frequency domain based on the mapping relationship between hearing loss values ​​and correction gain values; and iteratively optimizing the first frequency domain compensation gain based on the speech estimation signals and noise estimation signals corresponding to the multiple subbands and the loudness of the hearing loss to obtain a second frequency domain compensation gain that maximizes intelligibility within a preset loudness, wherein the second frequency domain compensation gain corresponds to the first correction gain value. In the above scheme, the accuracy of hearing loss compensation can be improved through the above-mentioned hearing loss compensation in the frequency domain.

[0021] In a possible implementation of the first aspect, determining a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain based on a mapping relationship between the hearing loss value and the correction gain value includes: determining a first time-domain compensation gain for the first hearing loss value in the time domain based on the mapping relationship between the hearing loss value and the correction gain value; extracting envelope information of an external input signal collected by the assistive listening device; when an average value of the envelope information is greater than a preset envelope threshold, linearly attenuating the first time-domain compensation gain to obtain a second time-domain compensation gain, the second time-domain compensation gain belonging to the first correction gain value; and when the average value of the envelope information is less than or equal to the preset envelope threshold, linearly increasing the first time-domain compensation gain to obtain a third time-domain compensation gain, the third time-domain compensation gain belonging to the first correction gain value. In the above solution, the terminal linearly attenuates the first time-domain compensation gain to obtain a second time-domain compensation gain through the linear attenuation process, and determines the first correction gain value based on the second time-domain compensation gain, so that the envelope of the external input signal is linearly attenuated, thereby improving the accuracy of hearing loss compensation. The terminal performs linear enhancement processing on the first time domain compensation gain, obtains a third time domain compensation gain through the linear enhancement processing, and determines the first correction gain value based on the third time domain compensation gain, so that the envelope of the external input signal is linearly enhanced, thereby improving the accuracy of hearing loss compensation.

[0022] In a possible implementation of the first aspect, performing speech correction on the first compensation gain based on a preset language test signal to obtain the hearing loss compensation gain includes: generating a language test signal by dividing the audio spectrum into frequency bands according to the center of gravity of the audio spectrum, the language test signal including test words corresponding to multiple frequency points at different centers of gravity of the audio spectrum; transmitting the language test signal to the assistive listening device; performing speech correction on the first compensation gain based on the language test signal and a third feedback instruction to obtain the hearing loss compensation gain, the third feedback instruction including a feedback instruction detected by the terminal when the assistive listening device plays the third test signal. In the above solution, the terminal performs speech correction on the first compensation gain based on the language test signal and the third feedback instruction to obtain the hearing loss compensation gain. Generating a language test signal in this multiple-choice manner and using the language test signal for speech correction can improve the accuracy of hearing loss compensation.

[0023] In one possible implementation of the first aspect, the method further includes: detecting the ambient noise of the assistive listening device; when the ambient noise is greater than or equal to a preset noise threshold, sending a noise warning signal to the assistive listening device; and when the ambient noise is less than the preset noise threshold, triggering the following steps: performing a hearing loss test on the person being assisted to obtain a hearing loss test result. In this solution, the terminal can first detect the environment in which the assistive listening device is located, thereby ensuring that the subsequent hearing loss compensation process can proceed correctly and improving the accuracy of hearing loss compensation.

[0024] In a possible implementation of the first aspect, performing speech correction on the first compensation gain based on a preset language test signal includes: obtaining the language test signal from a preset corpus, the corpus including: multiple groups of language test signals, wherein each group of language test signals includes: initial consonant word groups divided into the same group according to different octaves based on the center of gravity of the audio spectrum, wherein each initial consonant word group includes: randomly selected and equal to two easily confused words; playing the two or more easily confused words in the same initial consonant word group in a random order through the assistive listening device; detecting a fourth feedback instruction sent by the assistive listening subject; obtaining a consistent error frequency band of the assistive listening subject based on the fourth feedback instruction and the language test signal; and adjusting the first compensation gain based on the consistent error frequency band. In the above scheme, the random extraction and random order playback of each word group can solve the problem of corpus reuse effectiveness, and the consistent error frequency band can be determined through the fourth feedback instruction, thereby solving the differentiated needs of different users for volume, timbre balance, noise reduction, etc. Generating a language test signal and using the language test signal for speech correction can improve the accuracy of hearing loss compensation.

[0025] In a possible implementation of the first aspect, the determining of the first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain based on the mapping relationship between the hearing loss value and the correction gain value also includes: performing human voice separation on the external input signal collected by the assistive listening device to obtain a human voice signal; performing wide dynamic range compression compensation and envelope enhancement on the human voice signal to obtain a compensated and enhanced human voice signal; the dividing of the external input signal collected by the assistive listening device into multiple sub-bands according to the octave includes: dividing the compensated and enhanced human voice signal into multiple sub-bands according to the octave. In the above scheme, wide dynamic range compression compensation and envelope enhancement are performed on the human voice signal to obtain a compensated and enhanced human voice signal, which can be used for subsequent correction gain calculations, can provide a better human voice compensation effect, and improve the speech recognition rate.

[0026] In a second aspect, an embodiment of the present application further provides a terminal, wherein a communication connection is established between the terminal and an assistive hearing device to be fitted, and the terminal includes:

[0027] A testing module is used to perform a hearing loss test on the hearing-assisted subject to obtain a hearing loss test result;

[0028] a compensation module, configured to perform hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain;

[0029] The sending module is configured to send the hearing loss compensation gain to the hearing assistive device, wherein the hearing assistive device is configured to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

[0030] In the above scheme, the terminal can compensate for the hearing loss of the hearing subject wearing the assistive hearing device, thereby realizing the fitting of the assistive hearing device for the hearing subject. The entire hearing loss compensation process can be realized by the interaction between the terminal and the assistive hearing device, and does not require the help of a doctor for manual testing. Therefore, the hearing loss test process can be performed quickly and easily. The terminal interacts with the assistive hearing device worn by the hearing subject to complete the hearing loss compensation. The hearing loss compensation can be performed for the hearing subject wearing the assistive hearing device, so the accuracy of the hearing loss compensation can be improved.

[0031] In the second aspect of the present application, the constituent modules of the terminal may also execute the steps described in the aforementioned first aspect and various possible implementations. For details, please refer to the aforementioned description of the first aspect and various possible implementations.

[0032] In a third aspect, an embodiment of the present application further provides a terminal, comprising: a processor and a memory; the processor and the memory communicate with each other;

[0033] The memory is used to store instructions;

[0034] The processor is used to execute the instructions in the memory and perform the method as described in any one of the first aspects above.

[0035] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, which, when executed on a computer, enables the computer to execute the method described in the first aspect above.

[0036] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method described in the first aspect above.

[0037] In the sixth aspect, an embodiment of the present application provides a communication device, which may include entities such as a terminal device or a chip, and the communication device includes: a processor, a memory; the memory is used to store instructions; the processor is used to execute the instructions in the memory, so that the communication device performs a method as described in any one of the above-mentioned first aspects.

[0038] In a seventh aspect, the present application provides a chip system, which includes a processor for supporting a terminal to implement the functions involved in the above aspects, for example, sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the terminal. The chip system can be composed of a chip or can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] FIG1 is a schematic diagram of the structure of a hearing loss compensation system provided in an embodiment of the present application;

[0040] FIG2 is an interactive schematic diagram of a hearing loss compensation method provided in an embodiment of the present application;

[0041] FIG3 is a flow chart of a hearing loss compensation method according to an embodiment of the present application;

[0042] FIG4 is a schematic diagram of an application framework of a hearing loss compensation system provided in an embodiment of the present application;

[0043] FIG5 is a schematic diagram of a UI of a terminal in a hearing loss compensation system provided by an embodiment of the present application;

[0044] FIG6 is a flow chart of an application scenario of a hearing loss compensation method provided in an embodiment of the present application;

[0045] FIG7 is a flow chart of an audiometry algorithm provided in an embodiment of the present application;

[0046] FIG8a is a schematic diagram of an audiometry configuration UI provided in an embodiment of the present application;

[0047] FIG8b is a schematic diagram of a test guidance UI provided in an embodiment of the present application;

[0048] FIG8c is a schematic diagram of a reaction speed test UI provided in an embodiment of the present application;

[0049] FIG8 d is a schematic diagram of a hearing test UI provided in an embodiment of the present application;

[0050] FIG8e is a schematic diagram of a speech test UI provided in an embodiment of the present application;

[0051] FIG8f is a schematic diagram of a feedback adjustment UI provided in an embodiment of the present application;

[0052] FIG9 is a flow chart of a compensation algorithm provided in an embodiment of the present application;

[0053] FIG10 is a schematic diagram of a speech correction process provided by an embodiment of the present application;

[0054] FIG11 is a schematic diagram of a flow chart of an application scenario of a hearing loss compensation method provided in an embodiment of the present application;

[0055] FIG12 is a schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0056] FIG13 is a schematic diagram of the composition structure of a terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] The embodiments of the present application are described below with reference to the accompanying drawings.

[0058] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, and this is merely a way of distinguishing the objects of the same attributes when describing them in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0059] The technical solution of the embodiment of the present application can be applied to various hearing loss compensation systems, which can realize the automated fitting of auxiliary hearing devices for the auxiliary hearing objects, wherein the auxiliary hearing objects refer to the objects that need to use auxiliary hearing devices, such as the auxiliary hearing objects are the human ears of the users, and the auxiliary hearing devices refer to the audio signal playback terminals, such as the auxiliary hearing devices can be Bluetooth headsets, wired headsets, hearing aids, etc., and the auxiliary hearing devices can also be called auxiliary hearing devices. The user can receive the voice signal sent by the terminal by wearing the auxiliary hearing device, and the voice signal is the voice signal obtained after the terminal performs hearing loss compensation for the auxiliary hearing object. The hearing loss compensation system provided by the embodiment of the present application does not require manual testing by a doctor, can simplify the hearing loss testing process, and improve the accuracy of hearing loss compensation.

[0060] As shown in Figure 1, a hearing loss compensation system provided by an embodiment of the present application includes: a terminal 10 and an assistive listening device 20 to be fitted, wherein a communication connection is established between the terminal 10 and the assistive listening device 20, for example, the terminal 10 and the assistive listening device 20 communicate via a wireless network. The terminal 10 can compensate for the hearing loss of a hearing aid wearing the assistive listening device 20 without the need for manual testing by a physician, thereby enabling a quick and easy hearing loss testing process. The interaction between the terminal 10 and the assistive listening device 20 worn by the hearing aid can improve the accuracy of hearing loss compensation.

[0061] In an embodiment of the present application, the hearing loss compensation system adopts an autonomous fitting architecture that combines software and hardware. Specifically, the hearing loss compensation system includes a terminal and an assistive listening device, wherein the terminal is an operating software carrier end, such as a terminal including a mobile phone, a tablet computer, a personal computer, etc., and the assistive listening device is an audio signal playback end, such as an assistive listening device including a Bluetooth headset, a wired headset, a hearing aid, etc. The terminal can specifically perform hearing loss testing and hearing loss compensation. The terminal compensates the original voice signal for hearing loss to obtain a target voice signal, and then sends the target voice signal to the assistive listening device. After receiving the target voice signal, the assistive listening device plays the target voice signal through the audio playback port, so that the assistive listening object can hear the target voice signal after hearing loss compensation, thereby realizing automatic fitting of the assistive listening device for the assistive listening object.

[0062] Next, the terminal involved in the application embodiments is described. The terminal may also be referred to as a terminal device. The terminal device may include at least one of the following: user equipment (UE), mobile station (MS), mobile terminal (MT), terminal, terminal device, etc., which is a device that provides voice and / or data connectivity to a user, or a chip set in the device, such as a handheld device or vehicle-mounted device with wireless connection capability. Currently, some examples of terminal devices include: mobile phones, tablet computers, laptop computers, PDAs, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, etc. For example, the terminal device can be a vehicle-mounted communication module or other embedded communication module, or it can be a user's handheld communication device, including a mobile phone, tablet computer, etc.

[0063] The hearing loss compensation system provided in the embodiment of the present application includes a terminal that can execute a hearing loss compensation method based on an assistive hearing device. The user does not need to go to a hearing center to find a professional hearing aid fitter for fitting. The user can independently complete the entire fitting process and achieve a good hearing aid effect. The following example illustrates the hearing loss compensation method executed by the terminal. A communication connection is established between the terminal and the assistive hearing device to be fitted, as shown in Figure 2. The method mainly includes the following steps:

[0064] 201. The terminal performs a hearing loss test on the hearing-assisted subject to obtain a hearing loss test result.

[0065] Among them, a communication connection is established between the terminal and the assistive listening device, for example, a Bluetooth connection is established between the terminal and the assistive listening device. After the assisted listening subject wears the assistive listening device, the terminal device first performs a hearing loss test on the assisted listening subject. For example, the hearing loss of the left and right ears of the assisted listening subject can be tested to obtain a hearing loss test result, which can also be called a hearing loss test result. For example, the hearing loss test result may include: the hearing loss test result of the left ear of the assisted listening subject and the test result of the right ear of the assisted listening subject. Specifically, the hearing loss test result may include the parameter value of the hearing loss test, and the hearing loss test result may record the parameter value of the hearing loss test in the form of a set, a list, a curve, etc.

[0066] In the embodiment of the present application, the terminal performs a hearing loss test on the hearing-assisted subject, which does not require manual operation by a doctor and is achieved through interaction between the terminal and the hearing-assisted device.

[0067] Specifically, there are many ways to test hearing loss, which are not limited in the embodiments of this application. Please refer to the examples in the subsequent embodiments for details.

[0068] In some embodiments of the present application, in addition to performing the aforementioned steps, the hearing loss compensation method performed by the terminal further includes:

[0069] A1. The terminal determines that the assistive listening device does not meet the wearing requirements based on the sound signal collected by the assistive listening device, and sends a wearing prompt signal to the assistive listening device.

[0070] After the hearing aid user puts on the assistive hearing device, the terminal detects the tightness of the device. Specifically, the terminal determines whether the device meets the wearing requirements based on the sound signals collected by the device. If the device does not meet the wearing requirements, the terminal sends a wearing reminder signal to the device, allowing the hearing aid user to adjust the device, thereby ensuring that the subsequent hearing loss compensation process can proceed correctly and improving the accuracy of hearing loss compensation.

[0071] For example, the terminal can detect the feedforward (FF) signal or the feedback (FB) signal according to the prompt tone to detect the consistency of wearing. If the wearing is good, the subsequent hearing compensation process is executed; otherwise, the wearing prompt tone is played.

[0072] In some embodiments of the present application, in addition to performing the aforementioned steps, the hearing loss compensation method performed by the terminal further includes:

[0073] B1. The terminal detects the ambient noise of the assistive listening device. When the ambient noise is greater than or equal to a preset noise threshold, the terminal sends a noise warning signal to the assistive listening device.

[0074] When the ambient noise is less than the preset noise threshold, the aforementioned step 201 is triggered to be executed: the terminal performs a hearing loss test on the hearing-assisted object to obtain a hearing loss test result.

[0075] Among them, after the assisted hearing subject wears the assisted hearing device, the terminal can also detect the environmental noise of the assisted hearing device, which can also be called the environmental background noise, to determine whether it is necessary to adjust the wearing method of the assisted hearing device to carry out subsequent processes. Specifically, when the environmental noise is greater than or equal to the preset noise threshold, the terminal sends a noise prompt signal to the assisted hearing device to enable the assisted hearing subject to adjust the environment in which the assisted hearing device is located. When the environmental noise is less than the preset noise threshold, the environment in which the assisted hearing device is located is suitable for hearing loss testing, and the terminal triggers the execution of the aforementioned step 201. The terminal can first detect the environment in which the assisted hearing device is located, so as to ensure that the subsequent hearing loss compensation process can be carried out correctly and improve the accuracy of hearing loss compensation.

[0076] 202. The terminal performs hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain.

[0077] Among them, after the terminal obtains the hearing loss test results, the terminal can determine the hearing loss of the tested hearing aid subject, so that the terminal device needs to compensate for the hearing loss of the hearing aid subject. The terminal determines the hearing loss compensation gain based on the hearing loss test results. The hearing loss compensation gain may include: the gain value required to compensate for the hearing loss of the hearing aid subject. For example, the hearing loss compensation gain may specifically include the frequency domain compensation gain, or the hearing loss compensation gain may specifically include the time domain compensation gain, or the hearing loss compensation gain may specifically include the frequency domain compensation gain and the time domain compensation gain, which are not limited here.

[0078] 203. The terminal device sends a hearing loss compensation gain to an assistive listening device, where the assistive listening device is configured to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

[0079] After obtaining the hearing loss compensation gain, the terminal transmits the hearing loss compensation gain via a communication connection with the assistive listening device, and the assistive listening device receives and stores the hearing loss compensation gain. For example, the assistive listening device may be headphones, which include a digital signal processing (DSP) including a wide dynamic range control (WDRC) module and an envelope modulation module. The WDRC module and the envelope modulation module can amplify the speech signal based on the hearing loss compensation gain.

[0080] The first voice signal refers to the original audio signal that needs to be played to the auxiliary listening object. For example, the first voice signal can be call voice data, or audio channel data included in video data, or the first voice signal can be speech data, sentence data, music data, etc. The auxiliary listening device obtains the first voice signal to be transmitted. For example, the auxiliary listening device can obtain the first voice data from the terminal or cloud server, or the auxiliary listening device can receive the first voice data from other terminals. The auxiliary listening device obtains the first voice signal and compensates for the hearing loss of the first voice signal according to the hearing loss compensation gain determined in the above steps 201 to 202 to obtain a second voice signal. For example, the second voice signal may include at least one of the following: speech data, sentence data, music data, etc. after the hearing loss is compensated according to the hearing loss compensation gain.

[0081] Specifically, the terminal device 203 sends the hearing loss compensation gain to the assistive listening device, including:

[0082] The terminal performs hearing loss compensation on the first voice signal to be transmitted according to the hearing loss compensation gain to obtain a second voice signal, and sends the second voice signal to the auxiliary listening device.

[0083] Among them, the terminal can compensate for the hearing loss on the first voice signal, and then the assistive listening device sends the second voice signal obtained after the hearing loss compensation, so that the assistive listening device receives the second voice signal obtained after the hearing loss compensation. The assistive listening device only needs to play the second voice signal, which can simplify the processing flow of the assistive listening device.

[0084] It can be seen from the examples of the aforementioned embodiments that the terminal in the embodiments of the present application can compensate for the hearing loss of the hearing-assistant subject wearing the hearing-assistant device, thereby realizing the fitting of the hearing-assistant device for the hearing-assistant subject. The entire hearing loss compensation process can be realized by the interaction between the terminal and the hearing-assistant device, and there is no need for manual testing by a doctor. Therefore, the hearing loss test process can be performed quickly and easily. The terminal interacts with the hearing-assistant device worn by the hearing-assistant subject to complete the hearing loss compensation. The hearing loss compensation can be performed for the hearing-assistant subject wearing the hearing-assistant device, so the accuracy of the hearing loss compensation can be improved.

[0085] Please refer to FIG3 , which shows another hearing loss compensation method provided in an embodiment of the present application, and mainly includes the following steps:

[0086] 301. The terminal performs a hearing test on the assisted listening subject to obtain the feedback speed of the assisted listening subject.

[0087] The terminal may first detect the hearing level of the assisted listening subject. Specifically, the terminal performs a hearing test on the assisted listening subject to perform a reaction speed test and obtain the assisted listening subject's feedback speed, which may also be referred to as the reaction speed. For example, the feedback speed may be the time required for the assisted listening subject to react to a voice signal, and the feedback speed may be used to generate a test signal. The feedback speed may include the feedback speed of the assisted listening subject's left ear and the feedback speed of the assisted listening subject's right ear.

[0088] 302. The terminal generates a first test signal according to the feedback speed and a preset first volume, and sends the first test signal to the auxiliary listening device.

[0089] After obtaining the feedback speed of the assisted listening device, the terminal generates a first test signal based on a preset first volume and feedback speed. The first test signal may be a voice signal used to test the hearing loss of the assisted listening device. The first test signal may be one or more first test signals. The first volume may be the initial audio signal volume. After generating the first test signal, the terminal transmits the first test signal via the communication connection between the terminal and the assisted listening device.

[0090] 303. The terminal obtains a hearing loss test result according to the first test signal and the first feedback instruction, where the first feedback instruction includes: a feedback instruction detected by the terminal when the assistive listening device plays the first test signal.

[0091] After the assistive listening device receives the first test signal, it plays the first test signal to the assisted listening subject. If the assisted listening subject hears the audio content of the first test signal, the assisted listening subject can send a first feedback instruction to the terminal. For example, the assisted listening subject clicks a feedback button on the UI, so that the terminal detects the first feedback instruction. This enables accurate hearing loss testing of the assisted listening subject and improves the accuracy of the hearing loss test results. The terminal obtains the hearing loss test results based on the first test signal and the first feedback instruction. For example, the hearing loss test results can include the left and right ear audiometry curves of the assisted listening subject.

[0092] In some embodiments of the present application, the terminal 301 performs a hearing test on the assisted listening object to obtain the feedback speed of the assisted listening object, including:

[0093] C1. The terminal sends a second test signal to the auxiliary listening device;

[0094] C2. The terminal obtains a feedback speed according to the second test signal and the second feedback instruction, where the second feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the second test signal.

[0095] Among them, the terminal sends a second test signal to the auxiliary listening device, and the auxiliary listening device plays the second test signal. The second test signal includes: click speed test audio. If the auxiliary listening object hears the audio content of the second test signal, the auxiliary listening object can send a second feedback instruction to the terminal. For example, the auxiliary listening object can click the feedback button on the UI of the terminal, so that the terminal detects the second feedback instruction sent by the auxiliary listening object, and the terminal obtains the feedback speed according to the second test signal and the second feedback instruction. Specifically, the terminal records the time from the start of playing the second test signal to the auxiliary listening object sending the second feedback instruction, and obtains the feedback speed of the auxiliary listening object.

[0096] In some embodiments of the present application, the terminal 302 generates a first test signal according to the feedback speed and a preset first volume, including:

[0097] D1. The terminal generates a first test signal of random length according to a feedback speed and a preset first volume. The first test signal includes: a test signal of multiple frequencies for measuring the hearing loss level of the hearing-assisted subject.

[0098] The terminal generates a test signal of random length within a preset length range based on the first volume and feedback speed to prevent inertial fatigue of the assisted listening subject. The assisted listening subject can choose monaural or binaural audiometry, for example, to test multiple frequencies. The first test signal includes test signals of multiple frequencies, including key Pure Tone Audiometry (PTA) frequencies for measuring the user's hearing loss level. This can prevent inertial fatigue of the assisted listening subject and improve the accuracy of hearing loss level testing.

[0099] In some embodiments of the present application, the first test signal includes a random silence signal, where the random silence signal refers to an audio signal including randomly generated silence points. In addition to performing the aforementioned steps, the hearing loss compensation method performed by the terminal further includes:

[0100] E1. When the assistive listening device plays a random mute signal, the terminal detects an erroneous operation feedback instruction sent by the assistive listening object.

[0101] The first test signal may include a random mute signal. When the auxiliary listening device plays the random mute signal, the terminal detects an erroneous operation feedback instruction sent by the auxiliary listening object. If the auxiliary listening object does not send an erroneous operation feedback instruction when playing the random mute signal, it means that the auxiliary listening object can correctly identify silence. If the auxiliary listening object sends an erroneous operation feedback instruction to the terminal when playing the random mute signal, the terminal can detect the erroneous operation feedback instruction sent by the auxiliary listening object.

[0102] E2. The terminal sends an erroneous operation prompt signal to the assistive listening device according to the erroneous operation feedback instruction.

[0103] Among them, when the auxiliary listening device plays a random silent signal, the terminal detects the error operation feedback instruction sent by the auxiliary listening object, which means that the auxiliary listening object has made an error operation at this time. The terminal can send an error operation prompt signal to the auxiliary listening device to prompt the auxiliary listening object to make an error operation. In some possible implementations of the present application, when the user continuously clicks the button on the UI of the terminal, it is easy to generate inertial operation. In the embodiment of the present application, by adding a random silent signal to the first test signal, when the user clicks the button during the silent signal playback, the terminal can send an error operation prompt signal to the auxiliary listening device, and the auxiliary listening device plays the error operation prompt signal to prompt the user to click correctly, thereby avoiding user inertial fatigue, reducing error operations, and improving the user's click accuracy.

[0104] In some embodiments of the present application, the first test signal generated by the terminal may be multiple first test signals. For the multiple first test signals, the terminal may determine a reversal point and make a judgment based on the reversal point to determine whether to clear the reversal point to improve the audiometry accuracy. The following is a detailed description:

[0105] 302. The terminal generates a first test signal according to the feedback speed and a preset first volume, and sends the first test signal to the assistive listening device, including:

[0106] F1. Generate multiple first test signals corresponding to a first frequency point based on a feedback speed, a preset first volume, and a preset volume increase / decrease difference, and send the multiple first test signals to the assistive listening device. The volume of one of the multiple first test signals is a first volume, and the volumes of the other first test signals except the one first test signal in the multiple first test signals are determined according to the first volume and the volume increase / decrease difference.

[0107] If the terminal generates multiple first test signals, the terminal can sequentially send the multiple first test signals, and the auxiliary listening device can send multiple corresponding first feedback instructions in response to the multiple first test signals. For example, the terminal can generate two first test signals and then sequentially send these two first test signals to the auxiliary listening device. Upon receiving a first test signal, the auxiliary listening device plays the first test signal, and the auxiliary listening device generates a first feedback instruction in response to the played first test signal, using the first feedback instruction to provide feedback on whether the auxiliary listening device heard the first test signal.

[0108] The volumes of the multiple first test signals generated by the terminal can be obtained respectively according to the preset first volume and the volume rise and fall difference. The preset first volume can be a preset initial volume, and the volume rise and fall difference is used to adjust the first volume. The volume rise and fall difference can specifically be a fixed volume difference, or a set including multiple volume differences. The volume of one first test signal among the multiple first test signals is the first volume, and the volumes of the other first test signals except one first test signal among the multiple first test signals are determined according to the first volume and the volume rise and fall difference. For example, in the embodiment of the present application, the first volume can be adjusted to obtain the second volume. For example, the second volume can be equal to the volume obtained by adding the volume rise and fall difference to the first volume. In addition, the third volume can be obtained according to the second volume and the volume rise and fall difference.

[0109] As illustrated below, the volume increase or decrease difference can be 5dB up, 5dB down, 10dB down, etc. The terminal device generates a first first test signal according to the initial volume, then increases the initial volume by 5dB to obtain a second first test signal, then reduces the volume of the second first test signal by 10dB to obtain a third first test signal, which can achieve rapid iteration of the first test signal, then increases the volume of the third first test signal by 5dB to obtain a fourth first test signal, and reduces the volume of the fourth first test signal by 5dB to obtain a fifth first test signal. In the embodiment of the present application, by iteratively increasing or decreasing the first test signal multiple times, the audiometry accuracy can be improved.

[0110] In the implementation scenario of executing F1 above, 303 obtains the hearing loss test result according to the first test signal and the first feedback instruction, including:

[0111] G1. Determine a first reversal point based on multiple first feedback instructions corresponding to multiple first test signals, where the first reversal point includes: a time point when two adjacent first feedback instructions in the multiple first feedback instructions indicate different listening results.

[0112] When the assistive listening device plays one of the multiple first test signals, it sends a first feedback signal to the terminal, which the terminal can detect. When the assistive listening device plays another first test signal, it sends another first feedback signal to the terminal, which the terminal can detect. A first reversal point is determined based on the multiple detected first feedback instructions. The first reversal point includes a time point at which two adjacent first feedback instructions in the multiple first feedback instructions indicate different listening results. Each of the multiple first feedback instructions can indicate a listening result of the assisted listening subject. For example, one listening result is "hearing sound," while another different listening result is "not hearing sound." For example, if the assisted listening device plays the first test signal of this time, the assisted listening subject hears the signal playback of this time and clicks the "hear sound" test button. If the assisted listening device plays the first test signal of this time, the assisted listening subject does not hear the next signal playback when the assisted listening device plays the next first test signal, and the assisted listening subject does not click the "hear sound" test button, then the time point when hearing transitions to not hearing is called the first reversal point. Therefore, the terminal can determine the first reversal point by detecting whether the listening results indicated by two adjacent first feedback instructions are the same.

[0113] G2. The terminal obtains a second inversion point adjacent to the first inversion point.

[0114] The terminal may determine a second reversal point using the method for detecting reversal points described in G1. The second reversal point is a reversal point adjacent to the first reversal point. For example, the second reversal point is determined before the first reversal point and is adjacent to the first reversal point. The two adjacent reversal points can be used to determine whether the hearing loss test result for the first frequency is accurate. Specifically, steps G3 to G4 may be performed.

[0115] G3. When the deviation between the first reversal point and the second reversal point is greater than the preset sound pressure threshold, the frequency point test result corresponding to the first reversal point is cleared;

[0116] G4. When the deviation value between the first inversion point and the second inversion point is less than or equal to the preset sound pressure threshold, obtain the hearing loss test result according to the frequency test result of the first inversion point.

[0117] The terminal can record the deviation between the adjacent first reversal point and the second reversal point. If the deviation is greater than a preset sound pressure threshold, it indicates that the frequency test result of the currently recorded first reversal point is inaccurate, and the frequency test result corresponding to the first reversal point is cleared. If the deviation is less than or equal to the preset sound pressure threshold, it indicates that the frequency test result of the currently recorded first reversal point is accurate, and the frequency test can continue. The frequency test result of the first reversal point can be used to obtain the hearing loss test result.

[0118] It can be understood that the above-mentioned process from G1 to G4 can be called the reversal point iterative determination process. Next, the application scenarios of G1 to G4 are illustrated by examples: when determining the reversal point, the volume of the first two test signals can be transitioned from 5dB up to 10dB down, and quickly iterated. Subsequently, the volume of the two test signals can be transitioned from 5dB up to 5dB down. By dynamically adjusting the volume of the test signal, the audiometric accuracy can be improved. During the test, the deviation value between adjacent reversal points is recorded for the current frequency point. If the value is greater than the sound pressure threshold, the hearing loss test result of the reversal point is cleared, and the test is continued. After reversing 5 times, the average of the last 3 reversal points is taken as the hearing loss test result for the current frequency point.

[0119] In some embodiments of the present application, G4 obtains a hearing loss test result based on the frequency test result of the first inversion point, including:

[0120] H1. When the number of times the frequency test result reaches an extreme value exceeds the number threshold, and / or the number of times the first test signal is sent at the first frequency exceeds the number threshold, the hearing loss test result is determined based on the frequency test result of the first reversal point.

[0121] The terminal can also set a frequency test termination condition. Taking the test of the first frequency point as an example, the terminal obtains the frequency test result of the first reversal point, and then determines whether the frequency test result meets the preset frequency test termination condition. The frequency test termination condition includes that the number of times the frequency test result reaches an extreme value exceeds a number threshold, and / or the number of first test signals sent at the first frequency point exceeds a number threshold. When the frequency test result meets the preset frequency test termination condition, the terminal stops testing the first frequency point and determines the hearing loss test result based on the frequency test result of the first reversal point. By testing the frequency points, the efficiency of the hearing loss test can be improved.

[0122] For example, to improve test efficiency, when testing a frequency point, if the frequency point test results reach extreme values ​​(such as the maximum and minimum values) three times in a row, or reach extreme values ​​six times cumulatively, the frequency point test is terminated, and the extreme value is used as the hearing loss test result for that frequency point. When the cumulative number of test rounds for a frequency point reaches 30, the test for that frequency point is terminated, and the average of the frequency point test results of the last three reversal points is taken as the hearing loss test result for that frequency point.

[0123] Furthermore, in some embodiments of the present application, in addition to performing the aforementioned steps, the hearing loss compensation method performed by the terminal further includes:

[0124] I1. When the frequency point test result exceeds the frequency point test average result and reaches a preset threshold, the terminal performs feedback instruction detection at the first frequency point again.

[0125] Among them, the terminal can also obtain the average result of the frequency test. After obtaining the frequency test result corresponding to the first frequency point, the terminal compares the frequency test result corresponding to the first frequency point with the frequency test average result. When the frequency test result exceeds the frequency test average result and reaches a preset threshold, the terminal re-performs feedback instruction detection at the first frequency point. By judging whether to re-test the first frequency point, the accuracy of the hearing loss test can be improved.

[0126] Through the above examples, the terminal can use multiple methods when generating hearing loss test results. For example, the terminal can obtain accurate hearing loss test results according to at least one of the following methods: feedback speed of the assisted hearing object, iterative determination of the reversal point, and re-testing of the extreme point. Specifically, at least one of the above methods can be selected in combination with the application scenario to obtain accurate hearing loss test results.

[0127] 304. The terminal performs real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain.

[0128] After obtaining the hearing loss test results, the terminal can perform real-time compensation processing on the hearing aid target. Specifically, real-time compensation processing can be performed in the time domain and / or frequency domain to obtain a first compensation gain. By performing real-time compensation processing, the microphone input signal envelope can be extracted from the first compensation gain. The specific compensation method used is not limited here.

[0129] In some embodiments of the present application, the terminal 304 performs real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain, including:

[0130] J1. The terminal obtains a first hearing loss value at a first frequency point in a hearing loss test result.

[0131] The terminal may perform real-time compensation processing on each frequency point. Taking the first frequency point as an example, the terminal may obtain a first hearing loss value at the first frequency point in the hearing loss test result.

[0132] J2. The terminal determines a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to a mapping relationship between the hearing loss value and the correction gain value.

[0133] The terminal may perform real-time compensation in the time domain to obtain a first correction gain value in the time domain of the hearing loss test result. Alternatively, the terminal may perform real-time compensation in the frequency domain to obtain a first correction gain value in the frequency domain of the hearing loss test result. Alternatively, the terminal may perform real-time compensation in both the time domain and the frequency domain to obtain a first correction gain value in the time domain and a first correction gain value in the frequency domain, respectively.

[0134] The mapping relationship between the hearing loss value and the correction gain value refers to the polynomial formula between the hearing loss value and the correction gain value. The polynomial formula between the hearing loss value and the correction gain value can also be called the fitting formula for the hearing loss value and the correction gain value, and is hereinafter referred to as the fitting formula. Based on the mapping relationship between the hearing loss value and the correction gain value, the terminal can determine the first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain. In the embodiment of the present application, whether the terminal performs real-time compensation in the time domain, or in the frequency domain, or in both the time domain and the frequency domain is determined in combination with the application scenario.

[0135] J3. The terminal determines a first compensation gain according to the first compensation gain value.

[0136] After obtaining the first compensation gain value, the terminal determines the first compensation gain based on the first compensation gain value. For example, the terminal may perform steps J1 to J2 multiple times to obtain multiple sets of first compensation gain values. These multiple sets of first compensation gain values ​​may constitute the first compensation gain. In this embodiment of the present application, real-time compensation can be performed based on the mapping relationship between the hearing loss value and the correction gain value, thereby improving the accuracy of hearing loss compensation.

[0137] Furthermore, in some embodiments of the present application, terminal 304 performs real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain, further comprising:

[0138] J4. The terminal determines the hearing curve according to the hearing loss test result;

[0139] J5. The terminal determines the mapping relationship between the hearing loss value and the correction gain value according to the classification result corresponding to the hearing curve.

[0140] Among them, the hearing loss test results may include one or more hearing curves. The terminal can obtain the hearing curve, classify the type of hearing curve according to a predetermined hearing curve library, and obtain the classification result corresponding to the hearing curve. According to the classification result, the corresponding mapping relationship between the hearing loss value and the correction gain value is selected, so that the mapping relationship between the hearing loss value and the correction gain value can be used for real-time compensation.

[0141] For example, when the hearing curve is linear attenuation type, high-frequency roll-off type, and basin type, different coefficients can be set for the mapping relationship between the hearing loss value and the compensation gain value to match the hearing curve corresponding to the hearing-assisted object. Therefore, the mapping relationship between the corresponding hearing loss value and the compensation gain value can be queried through the hearing curve in the hearing loss test result.

[0142] Furthermore, in some embodiments of the present application, the J2 terminal determines a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain based on a mapping relationship between the hearing loss value and the correction gain value, including:

[0143] J21. The terminal divides the external input signal collected by the assistive listening device into multiple sub-bands according to octaves.

[0144] The external input signal collected by the assistive listening device through the microphone is a time-domain signal. This signal is converted into a frequency-domain signal through Fourier transform. The data of different frequency bands is then selected based on octaves (i.e., frequency-domain multiplication relationships) to obtain multiple sub-bands. For example, the frequency-domain multiplication relationships may include: 125Hz, 250Hz, 500Hz, 1000Hz, 2000Hz, 4000Hz, 8000Hz, and other frequency domains.

[0145] In some embodiments of the present application, the J2 terminal determines the first correction gain value corresponding to the first hearing loss value based on the mapping relationship between the hearing loss value and the correction gain value, and also includes: the terminal performs human voice separation on the external input signal collected by the auxiliary listening device to obtain a human voice signal; performs wide dynamic range compression compensation and envelope enhancement on the human voice signal to obtain a compensated and enhanced human voice signal.

[0146] Among them, after obtaining the external input signal, the terminal can also perform auxiliary hearing enhancement, perform artificial intelligence (AI) separation on the external input signal, and perform wide dynamic range compression compensation and envelope enhancement on the extracted human voice signal, thereby providing better human voice compensation effect and improving speech recognition rate.

[0147] Specifically, the J21 terminal divides the external input signal collected by the assistive listening device into multiple sub-bands according to the octave, including: the terminal divides the compensated and enhanced human voice signal into multiple sub-bands according to the octave.

[0148] Among them, the human voice signal is subjected to wide dynamic range compression compensation and envelope enhancement to obtain a compensated and enhanced human voice signal. This human voice signal can be used for subsequent correction gain calculation, which can provide a better human voice compensation effect and improve the speech recognition rate.

[0149] J22. The terminal obtains speech estimation signals and noise estimation signals corresponding to multiple subbands.

[0150] The terminal may estimate speech signals and noise signals of different sub-bands to obtain speech estimation signals and noise estimation signals corresponding to the multiple sub-bands.

[0151] J23. The terminal performs a speech intelligibility index (SII) analysis based on the speech estimation signal and the noise estimation signal to obtain the loudness of the hearing loss.

[0152] The terminal transmits the speech estimation signal and the noise estimation signal to the SII analysis module included in the terminal for intelligibility optimization analysis to obtain the loudness of the speech signal and the noise signal, which is also called the loudness of hearing loss.

[0153] J24. The terminal determines a first frequency domain compensation gain for the first hearing loss value in the frequency domain according to a mapping relationship between the hearing loss value and the correction gain value.

[0154] Among them, the terminal can perform real-time compensation in the frequency domain, obtain the first hearing loss value in the frequency domain in the hearing loss test result, and then determine the first frequency domain compensation gain of the first hearing loss value in the frequency domain based on the mapping relationship between the hearing loss value and the correction gain value.

[0155] J25. The terminal iteratively optimizes the first frequency domain compensation gain based on the speech estimation signals and noise estimation signals corresponding to multiple subbands and the loudness of the hearing loss to obtain a second frequency domain compensation gain that maximizes intelligibility within a preset loudness, where the second frequency domain compensation gain belongs to the first correction gain value.

[0156] The terminal can obtain the energy of the speech estimation signal and the energy of the noise estimation signal corresponding to multiple subbands, and iteratively optimize the first frequency domain compensation gain based on the energy of the speech estimation signal and the noise estimation signal in different subbands and the hearing loss loudness to obtain a second frequency domain compensation gain that maximizes intelligibility within a preset loudness. The first correction gain value is determined based on the second frequency domain compensation gain. In the embodiments of the present application, the accuracy of hearing loss compensation can be improved through the above-mentioned hearing loss compensation in the frequency domain.

[0157] Furthermore, in some embodiments of the present application, the J2 terminal determines a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain based on a mapping relationship between the hearing loss value and the correction gain value, including:

[0158] J26. The terminal determines a first time-domain compensation gain for the first hearing loss value in the time domain according to a mapping relationship between the hearing loss value and the correction gain value.

[0159] Among them, the terminal can perform real-time compensation in the time domain, obtain the first hearing loss value in the hearing loss test result, and then determine the first time domain compensation gain of the first hearing loss value in the time domain according to the mapping relationship between the hearing loss value and the correction gain value.

[0160] J27. The terminal extracts envelope information of the external input signal collected by the assistive listening device.

[0161] The external input signal collected by the assistive listening device through the microphone is a time domain signal, and the envelope information of the external input signal is obtained.

[0162] J28. When the average value of the envelope information is greater than the preset envelope threshold, the terminal performs linear attenuation processing on the first time domain compensation gain to obtain a second time domain compensation gain, where the second time domain compensation gain belongs to the first correction gain value.

[0163] Among them, there is no limit on the value of the envelope threshold. The average value of the envelope information is greater than the envelope threshold. The terminal performs linear attenuation processing on the first time domain compensation gain, and obtains the second time domain compensation gain through linear attenuation processing. The first correction gain value is determined by the second time domain compensation gain, so that the envelope of the external input signal is linearly attenuated, thereby improving the accuracy of hearing loss compensation.

[0164] J29. When the average value of the envelope information is less than or equal to the preset envelope threshold, the terminal linearly increases the first time domain compensation gain to obtain a third time domain compensation gain, and the third time domain compensation gain belongs to the first correction gain value.

[0165] Among them, the average value of the envelope information is less than or equal to the envelope threshold, the terminal performs linear enhancement processing on the first time domain compensation gain, obtains the third time domain compensation gain through linear enhancement processing, and determines the first correction gain value through the third time domain compensation gain, so that the envelope of the external input signal is linearly enhanced, thereby improving the accuracy of hearing loss compensation.

[0166] Among them, there is no order of precedence between J21 to J25 and J26 to J29.

[0167] Through the above examples, the terminal can adopt multiple methods when generating the first correction gain value. For example, the terminal can obtain an accurate first compensation gain value according to at least one of the following methods: intelligibility analysis to obtain the loudness of hearing loss, and then perform frequency domain compensation based on the loudness of hearing loss; real-time envelope time domain enhancement. Specifically, at least one of the above methods can be selected in combination with the application scenario to obtain an accurate first correction gain value, thereby better improving the fitting effect and enhancing the speech recognition rate.

[0168] 305. The terminal performs speech correction on the first compensation gain according to a preset language test signal to obtain a hearing loss compensation gain.

[0169] Among them, after determining the first compensation gain, the terminal can send a preset language test signal to the auxiliary listening device, and perform speech correction on the first compensation gain through the language test signal, so as to obtain the hearing loss compensation gain. Through the above-mentioned speech correction, the speech recognition rate can be improved.

[0170] In some embodiments of the present application, terminal 305 performs speech correction on the first compensation gain according to a preset language test signal to obtain a hearing loss compensation gain, including:

[0171] K1. The terminal generates a language test signal by dividing the frequency bands according to the center of gravity of the audio spectrum. The language test signal includes: test words at multiple frequency points corresponding to different centers of gravity of the audio spectrum;

[0172] K2. The terminal sends a language test signal to the assistive listening device;

[0173] K3. The terminal performs speech correction on the first compensation gain according to the language test signal and the third feedback instruction to obtain a hearing loss compensation gain. The third feedback instruction includes: a feedback instruction detected by the terminal when the assistive listening device plays the third test signal.

[0174] Among them, the terminal generates a language test signal by dividing the frequency bands according to the centroid of the audio spectrum. For example, the terminal divides the frequency bands according to the centroid of the initial consonant spectrum. For each audio spectrum centroid, a test word is selected from the test words of multiple frequency points to form a language test signal. The method of selecting test words will be called "multiple choice" in the future. Multiple choice means that during speech correction, multiple easily confused words will appear on the UI of the terminal, for example, four easily confused words will appear, and then the audio of one of the words will be played, and the user will click to select the word to hear.

[0175] After the assistive listening device receives the language test signal, it plays the language test signal to the person being assisted. If the person being assisted hears the audio content of the language test signal, the person can send a third feedback instruction to the terminal. For example, the person being assisted can click a feedback button on the UI, so that the terminal detects the third feedback instruction. The terminal then performs speech correction on the first compensation gain based on the language test signal and the third feedback instruction to obtain a hearing loss compensation gain. Generating a language test signal in this multiple-choice manner and using this language test signal for speech correction can improve the accuracy of hearing loss compensation.

[0176] In some embodiments of the present application, the terminal 305 performs speech correction on the first compensation gain according to a preset language test signal, including:

[0177] K4. The terminal obtains a language test signal from a preset corpus, where the corpus includes: multiple groups of language test signals, wherein each group of language test signals includes: initial consonant single word groups that are divided into the same group according to different octaves based on the center of gravity of the audio spectrum, wherein an initial consonant single word group includes: randomly selected greater than or equal to 2 easily confused words.

[0178] Among them, the terminal obtains a corpus, and the corpus provided in the embodiment of the present application may include multiple groups of language test signals, and the language test signals of each group include: initial consonant word groups divided into the same group according to different octaves based on the center of gravity of the audio spectrum, and an initial consonant word group includes: randomly selected more than or equal to 2 easily confused words, and there is no limit on the number of easily confused words included in an initial consonant word group.

[0179] K5. The terminal plays two or more easily confused words in the same initial consonant word group in a random order through the assistive listening device.

[0180] Among them, the terminal controls the auxiliary listening device to play more than or equal to 2 easily confused words in the same initial consonant single word group in the language test signal in a random order, and the auxiliary listening subject can send feedback instructions to the terminal when listening to the easily confused words randomly played by the auxiliary listening device.

[0181] An example is as follows: the terminal can pre-acquire a corpus, which consists of initial consonants and single words, and language test signals divided into 15 groups according to the spectral center of gravity and the octave. The 15 groups are played randomly, and 4 test words are randomly selected from each group. The 4 test words are played in random order to solve the problem of the effectiveness of corpus reuse. At the same time, 5 groups of feedback are set up. Through the two-choice feedback form, the differentiated needs of different users for volume, tone balance, noise reduction, etc. are solved.

[0182] K6. The terminal detects a fourth feedback instruction sent by the auxiliary listening object;

[0183] K7. The terminal obtains a consistent error frequency band of the assisted listening object according to the fourth feedback instruction and the language test signal.

[0184] When the terminal detects the fourth feedback instruction, it obtains a consistency error frequency band according to the language test signal and the fourth feedback instruction. The consistency error frequency band refers to a frequency band where a consistency error occurs, which is determined by the terminal according to the speech recognition rate.

[0185] K8. The terminal adjusts the first compensation gain according to the consistency error frequency band.

[0186] The terminal adjusts the first compensation gain based on the consistent error frequency band to obtain a hearing loss compensation gain. The random extraction and randomized playback of each vocabulary group address the effectiveness of corpus reuse. The fourth feedback instruction determines the consistent error frequency band, addressing the differentiated needs of different users for volume, timbre balance, and noise reduction. Generating a language test signal and using it for speech correction can improve the accuracy of hearing loss compensation.

[0187] Among them, there is no order between K1 to K3 and K4 to K8.

[0188] 306. The terminal device sends the hearing loss compensation gain to the assistive listening device, where the assistive listening device is configured to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

[0189] After acquiring the hearing loss compensation gain, the terminal sends the hearing loss compensation gain through a communication connection with the assistive listening device, and the assistive listening device receives and stores the hearing loss compensation gain.

[0190] Specifically, 306 the terminal device sends the hearing loss compensation gain to the assistive listening device, including:

[0191] The terminal performs hearing loss compensation on the first voice signal to be transmitted according to the hearing loss compensation gain to obtain a second voice signal, and sends the second voice signal to the auxiliary listening device.

[0192] Among them, the terminal can compensate for the hearing loss on the first voice signal, and then the assistive listening device sends the second voice signal obtained after the hearing loss compensation, so that the assistive listening device receives the second voice signal obtained after the hearing loss compensation. The assistive listening device only needs to play the second voice signal, which can simplify the processing flow of the assistive listening device.

[0193] In some embodiments of the present application, in addition to performing the aforementioned steps, the hearing loss compensation method performed by the terminal further includes:

[0194] L1. The terminal detects a fifth feedback instruction sent by the assisted listening object when the assisted listening device plays a second voice signal.

[0195] L2. The terminal determines a listening parameter of the auxiliary listening object according to the fifth feedback instruction. The listening parameter includes at least one of the following: listening volume, noise reduction level, and frequency band gain.

[0196] Among them, after the assistive listening device plays the second voice signal, if the assistive listening subject hears the audio content of the second voice signal, the assistive listening subject can send a fifth feedback instruction to the terminal, for example, the assistive listening subject clicks the feedback button on the UI of the terminal, so that the terminal detects the fifth feedback instruction. The terminal determines the listening parameters of the assistive listening subject based on the fifth feedback instruction. The listening parameters include not only the listening volume, but also the degree of noise reduction, frequency band gain, etc. Through the above-mentioned detection of the fourth feedback instruction, the terminal can determine the listening parameters of the assistive listening subject. The listening parameters can be used to describe the actual hearing sensation of the assistive listening subject, thereby being able to test the accuracy of hearing loss compensation.

[0197] Furthermore, in some embodiments of the present application, in addition to performing the aforementioned steps, the hearing loss compensation method performed by the terminal further includes:

[0198] M1. The terminal performs pure tone audiometry (PTA) according to the hearing loss compensation gain and the hearing parameter of the assisted hearing subject to obtain an audiometry report of the assisted hearing subject.

[0199] The terminal performs PTA on the subject based on the hearing loss compensation gain and the subject's listening parameters and outputs a fitting report. The fitting report includes a hearing loss curve, hearing loss classification, speech recognition rate before gain compensation, and speech recognition rate after gain compensation.

[0200] Through the above examples, the terminal can adopt multiple methods when generating hearing loss compensation gain. For example, the terminal can obtain accurate hearing loss compensation gain according to at least one of the following methods: real-time compensation in the time-frequency domain, speech correction and feedback adjustment. Specifically, at least one of the above methods can be selected in combination with the application scenario to obtain accurate hearing loss compensation gain, thereby better improving the fitting effect and enhancing the speech recognition rate.

[0201] Through the description of the hearing loss compensation method executed by the terminal in the aforementioned embodiment, it can be known that the terminal can execute hearing loss audiometry, fitting formula compensation, speech correction algorithm and feedback adjustment, wherein the hearing loss audiometry is placed on the terminal side to obtain the user's hearing loss test results, the fitting formula compensation is placed on the earphone side, and real-time compensation is performed based on the aforementioned hearing loss test results and external signals, and the speech correction and feedback adjustment are placed on the mobile phone side, and the hearing loss compensation gain is personalized and readjusted according to the speech recognition rate and the feedback from the assisted hearing object. After the fitting is completed, the terminal can output a hearing report, which contains information such as the hearing loss curve of the assisted hearing object and the speech recognition rate after fitting. Through the above process, the embodiment of the present application provides an autonomous fitting solution. The user does not need to go to the hearing center to find a professional fitter for fitting. The user can independently complete the entire fitting process and achieve good hearing aid effects.

[0202] To facilitate a better understanding and implementation of the above solutions in the embodiments of the present application, the following examples are given for specific explanation using corresponding application scenarios.

[0203] An embodiment of the present application provides a hearing loss compensation system, which may include a terminal and an assistive listening device. One embodiment of the present application and some possible implementation methods of the present application exist between a mobile phone and a Bluetooth headset, a mobile phone and a wired headset, and a mobile phone and a hearing aid. This application scenario can also exist between tablets, laptops and desktop computers, and Bluetooth headsets, wired headsets and hearing aids. In the following, taking the terminal as a mobile phone and the assistive listening device as a headset as an example, the assistive listening object is specifically a user who operates the mobile phone and wears the headset.

[0204] The system architecture of the embodiment of the present application is shown in Figure 4, which mainly involves the following processes: wearing headphones, N1: hearing loss audiometry, N2: fitting formula compensation, N3: speech correction, N4: feedback adjustment, and output of fitting report.

[0205] The main method flow includes S1 to S8 as shown below, wherein the N1 flow includes S1 to S4, the N2 flow includes S5-S6, the N3 flow includes S7, and the N4 flow includes S8. The following steps S1 to S8 are briefly introduced:

[0206] S1: The user wears the headset and first detects the feedforward (FF) / feedback (FB) signal based on the prompt tone to check the wearing consistency. If the wear is good, S2 is executed, otherwise prompt tone 1 is played to the user;

[0207] S2: After checking the wearing consistency, the ambient noise level is checked again. If the ambient noise level is less than the noise threshold, S3 is executed. Otherwise, prompt tone 2 is played to the user.

[0208] S3: Play a pure tone test signal to the user, detect the user's click speed, and use the click speed for subsequent hearing loss compensation. This click speed can also be called feedback speed;

[0209] S4: Generate a test signal based on the user's click speed and initial volume, and play it to the user. When the user hears the test signal, he or she clicks the feedback button on the terminal UI. After the test is completed, the audiometry results are generated, including the hearing curves of the left and right ears;

[0210] S5: Classifying the hearing curve according to the audiometry results, and generating a first compensation gain according to the classification results and the corresponding fitting formula. The first compensation gain may include a frequency domain compensation gain and a time domain compensation gain;

[0211] S6: Sending the frequency domain compensation gain and the time domain compensation gain to the WDRC module and the envelope modulation module included in the DSP of the headset. The WDRC module and the envelope modulation module can be used to amplify the uplink and downlink audio signals according to the frequency domain compensation gain and the time domain compensation gain;

[0212] S7: Playing a pre-made speech test signal to the user, detecting the test result fed back by the user, and performing speech correction on the first compensation gain according to the test result to obtain a second compensation gain;

[0213] S8: Play specific sentences to the user and make feedback adjustments based on the user's feedback. Feedback adjustment can also be called feedback testing, which can be used to obtain hearing loss compensation gain and determine the user's optimal listening volume and other conditions.

[0214] Finally, the fitting report for the user is output.

[0215] As shown in Figure 5, the UI function diagram of an embodiment of the present application includes modules such as hearing test, hearing aid compensation, speech correction, feedback test, and historical test report. Users can select the corresponding module as needed. In addition, the function diagram also provides a selection of application scenarios, allowing users to select media, call, transparent transmission, and other scenarios as needed. For example, users can select modules such as audiometry, compensation, speech correction, feedback test, and application modes in the interface. After clicking on different modules, the corresponding test process will be entered. In the audiometry module, the system will play the signal, and the user can click the "Hear" button after hearing the sound; in the compensation module, compensation is performed according to the hearing curve obtained in the audiometry module to obtain the first compensation gain. Specifically, you can choose to compensate for high frequency, medium frequency, and low frequency, and adjust the left and right ear balance, noise reduction, beam strength, overall volume adjustment, etc. through the roller. In addition, the user can also choose traffic, social, music and other scenes in the full-scene listening. The user can choose different frequency band gains, noise reduction, beams and different environments by themselves to obtain better gain compensation effects; in the speech correction module, the user clicks on the words he hears, for example, four alternative words can be provided for the user to choose. The speech correction module will automatically adjust the gain according to the user's speech recognition rate, and can provide the user with options such as too loud sound, normal sound, and too soft sound; in the feedback test module, personalized gain adjustment is made according to the user's choice.

[0216] Please refer to Figure 6, which provides an overall fitting process. Users can operate the terminal to perform self-fitting. The specific steps are described as follows:

[0217] N1: Obtain the user's accurate hearing curve, which may include S1 to S4.

[0218] S1: The user wears the headset and first detects the sound signal collected by the microphone according to the prompt tone, such as the FF / FB signal, to detect the wearing consistency. If the wearing is good, S2 is executed, otherwise the prompt tone 1 is played to the user;

[0219] S2: After checking the wearing consistency, the ambient noise level is checked. If the ambient noise level is less than the noise threshold, S3 is executed. Otherwise, prompt tone 2 is played to the user.

[0220] S3: Play a pure tone test signal to the user, detect the user's reaction speed, and input the click speed into the S4 audiometry algorithm;

[0221] S4: Generate an audiometric test signal based on the user's response speed and initial volume, and play it to the user. When the user hears the test signal, they click a feedback button. After the test is completed, the audiometric result is generated, which includes audiometric curves for the left and right ears.

[0222] S5: Classify the hearing curve according to the audiometry results, and generate corresponding compensation gains according to the classification results and the corresponding fitting formula. The compensation gains include frequency domain compensation gains and time domain compensation gains.

[0223] S6: Send the frequency domain compensation gain and the time domain compensation gain to the WDRC module and envelope modulation module included in the DSP of the headset, and amplify the uplink and downlink audio signals;

[0224] S7: A pre-made speech test signal is played to the user in a multiple-choice mode. The initial consonants of the speech test signal are generated in frequency bands based on the spectral center of gravity, and the compensation gain is fine-tuned based on the test results. The multiple-choice mode means that during speech correction, four easily confused words will appear on the terminal screen, and the audio of one of the words will be played. The user clicks to select the word they want to hear.

[0225] S8: Play a specific sentence to the user and fine-tune the gain based on user feedback to determine the user's optimal listening volume and other conditions.

[0226] S9: Finally, the user is tested for PTA frequency points and a fitting report is output. The fitting report includes the user's hearing loss curve, hearing loss level classification, speech recognition rate before gain compensation, and speech recognition rate after gain compensation.

[0227] As shown in FIG7 , the audiometry process involved in the above S1 to S4 is described below. The detailed process includes:

[0228] S11: The user wears the earphones, and is prompted to check the wearing method and status.

[0229] As shown in FIG8 a , the user is guided to perform audiometric configuration and can be provided with earphones to wear and ensure that the earphones are not loose.

[0230] S12: The FF / FB signal is collected through the microphone (MIC) to detect whether the user is wearing the device properly. If not, the user is prompted to put the device on again through prompt tone 1.

[0231] S13: Detect whether the ambient noise level is less than a threshold. If it is greater than the threshold, send prompt tone 2 to prompt the user to find a good environment before performing a hearing test.

[0232] S14: Start audiometry guidance, play audiometry practice signals, and click a button if the signal is heard, so that the user can become familiar with the audiometry operation.

[0233] As shown in FIG8b , the user is guided to perform the test.

[0234] S15: Play the signal, and the user adjusts the volume value that can be clearly heard according to his hearing, which is used as the initial volume of the audiometry.

[0235] S16: Play the click speed test audio, record the time from the start of the signal playback to the user clicking and hearing it, and obtain the user's average reaction speed.

[0236] As shown in FIG8c , the user's reaction speed is tested.

[0237] S17: Start audiometry. Generate a test signal of random length within a certain range based on the initial volume and average response speed to prevent user fatigue. The user can choose monaural or binaural audiometry. The test frequency points are 1000Hz, 2000Hz, 4000Hz, 8000Hz, 500Hz and 250Hz in the order of 500Hz, 1000Hz, 2000Hz and 4000Hz, which are the key pure tone audiometry (PTA) frequencies for measuring the user's hearing loss level.

[0238] S18: During the audiometry process, when the user hears a sound, he clicks the button. The button is in single state and the test result is not displayed to prevent the user from making mistakes and psychological suggestions.

[0239] As shown in Figure 8d, a hearing test is performed on the user. During the test, when you hear a sound, please quickly click "I heard it". The test is expected to take 7 minutes. Do not click if you do not hear the sound.

[0240] S19: Random silent segments will be added during the test. If the user makes a continuous mistake and clicks the button during the silent segment, a prompt tone will be played to the user, and the user can click the button after hearing it.

[0241] S110:

[0242] Reversal point determination: The volume of the first two test signals is increased by 5dB and decreased by 10dB, with rapid iteration. The volume of subsequent test signals is increased by 5dB and decreased by 5dB to improve audiometric accuracy. During the test, the deviation between adjacent reversal points is recorded. If the value is greater than the threshold, the reversal point record is cleared and the test continues. After five reversals, the average of the frequency test results of the last three reversal points is taken as the hearing loss test result for that frequency point.

[0243] Frequency test termination conditions: To improve test efficiency, when testing a frequency point, if the user reaches the extreme value (maximum and minimum) three times in a row, or reaches the extreme value six times in total, the frequency test ends for that frequency point, and the extreme value is used as the hearing loss test result for that frequency point. When the cumulative number of test rounds for a frequency point reaches 30, the frequency test ends for that frequency point, and the average of the frequency test results of the last three reversal points is used as the hearing loss test result for that frequency point.

[0244] S111: After all frequency points are tested, the average value of the results of all frequency points is calculated, and the frequency points that deviate from the average value and are greater than the threshold are retested.

[0245] As shown in Figure 8e, speech correction is performed on the user. By detecting speech recognition rates under different signal-to-noise ratios, the correction algorithm is used to enhance the hearing aid effect. Feedback adjustment is performed on the user, and the gain strategy is adjusted in different background environments based on user feedback to enhance the hearing aid effect.

[0246] S112: Output a test report based on the test results.

[0247] In the above audiometry process, the user's click speed is detected and a random test signal is generated based on the click speed to prevent user inertia fatigue; the single-state button testing method avoids user misoperation and psychological suggestion; random silent segments are added during the test to detect the accuracy of user clicks; the iterative determination of reversal points and retesting of extreme points reduce random errors and improve accuracy.

[0248] The user is familiarized with the test through a guided process. Random-length test signals and silent segments are used to prevent user fatigue and misoperation. The reversal point clearing mechanism, frequency retest mechanism and frequency end condition are used to improve audiometry accuracy and efficiency.

[0249] As shown in Figure 9, the functional UI of the compensation process first instructs the user to wear headphones through pictures and other means, and prompts the wearing status. Then, the audiometry guidance process is entered. The user is familiar with the operation through simulated audiometry exercises, so that more accurate data can be obtained during normal testing. Then, the reaction speed test and volume adjustment are performed to obtain the user's reaction speed and the most appropriate initial volume. Finally, the audiometry is started, and the user's audiogram data is obtained after the audiometry is completed.

[0250] As shown in FIG9 , the compensation process involved in the above S5-S6 is described below. The detailed process includes:

[0251] S21: inputting the hearing curve, and classifying the hearing curve type according to a predetermined hearing curve library;

[0252] S22: Selecting a corresponding fitting formula based on the classification result to generate a first frequency domain compensation gain;

[0253] S23: The microphone collects the external input signal and divides it into multiple sub-bands according to the octave;

[0254] S24: Estimate the speech and noise signals in different subbands and transmit the relevant information to the speech intelligibility index (SII) and other intelligibility optimization modules;

[0255] S25: estimating the loudness under the hearing loss and transmitting the loudness value to the intelligibility optimization module;

[0256] S26: Iteratively optimize the first frequency domain compensation gain based on the energy of the speech noise signal in different sub-bands and the loudness of the hearing loss to obtain a second frequency domain compensation gain that maximizes intelligibility within an appropriate loudness, send the second frequency domain compensation gain to the WDRC for processing, and output a converted time domain signal;

[0257] S27: generating an initial first time domain compensation gain according to the hearing curve, and extracting the microphone input signal envelope;

[0258] S28: Determine whether the average value of the envelope is greater than a threshold; for example, the average values ​​of several points in the envelope are detected, and when the average value is greater than the threshold, linear gain attenuation takes effect.

[0259] S29: If the envelope is greater than the threshold, the larger the envelope, the more linearly the gain is attenuated, the maximum gain is 1, and the envelope gain is output;

[0260] S210: If the envelope is less than the threshold, the smaller the envelope is, the gain increases linearly, the minimum gain is 1, and the envelope gain is output;

[0261] S211: Processing the time domain signal envelope according to the envelope gain.

[0262] In the above compensation process, a combination of frequency domain compensation and time domain compensation is adopted. In frequency domain compensation, a dynamic compensation method based on environmental signals is introduced. In time domain compensation, envelope enhancement is used to enhance the envelopes of small signals and clear sound signals to achieve the best enhancement effect.

[0263] Specifically, in terms of frequency domain compensation, the environmental signal-to-noise ratio is estimated in real time, and real-time gain adjustment is performed through loudness and SII to achieve the best fitting effect of intelligibility and loudness.

[0264] In terms of time domain compensation, the signal envelope is extracted in real time, and the envelope gain is generated by comparing the envelope amplitude with the threshold and applied to the signal. Small signals such as initial sounds and unvoiced sounds are additionally amplified to further improve speech intelligibility.

[0265] Through the joint frequency domain compensation of intelligibility and loudness, as well as the real-time envelope time domain enhancement, the fitting effect can be better improved and the speech recognition rate can be enhanced.

[0266] As shown in FIG10 , the speech correction and feedback adjustment process involved in S7-S8 is described below. The detailed process includes:

[0267] S31. Speech test.

[0268] S32. There are 15 groups of words in total, divided into octaves, with 3 groups per octave.

[0269] S33, play 15 groups of random plays each time.

[0270] S34. Randomly select 4 corresponding words from the group each time.

[0271] Each group is designed with 12 to 20 similar words.

[0272] S35, the 4 words are played in random order.

[0273] S36. Select the corresponding vocabulary according to what you hear.

[0274] In the speech correction process, a corpus is provided. The corpus consists of initial consonants and words, which are divided into 15 groups according to the spectral center and octave. The 15 groups are played in random order. Each group is designed with 12-20 similar words. Four words are randomly selected from each group, and the four words are played in random order to solve the problem of the effectiveness of corpus reuse.

[0275] S37. Count the frequency bands of user consistency errors.

[0276] S38, enhance the corresponding frequency band by 3 to 6dB.

[0277] Update the corresponding frequency band gain.

[0278] Specifically, five groups of feedback can be set up to count the user's consistent error frequency bands, and the corresponding frequency bands can be increased by 3-6dB based on the consistent error frequency bands, so that WDRC updates the corresponding frequency band gain. Through the two-choice feedback form, the differentiated needs of different users for volume, tone balance, noise reduction, etc. are solved.

[0279] For example, a terminal may employ a gain condition strategy, such as determining whether the speech volume is appropriate. If the speech is too loud, the terminal adjusts the gain by 4dB for the 1000-2000Hz frequency range. If the speech is too soft, the terminal adjusts the gain by 4dB for the 1000-2000Hz frequency range, or by 2dB for the 1000-2000Hz frequency range. If the speech is normal, the terminal maintains the original gain without adjusting it.

[0280] S39. Feedback test.

[0281] S310: Save the configuration.

[0282] By randomly selecting corpora from the corpus, the effectiveness issue of corpus reuse is resolved, and the compensation gain is fine-tuned based on the user's speech recognition rate results. During the feedback adjustment process, the compensation gain is personalized based on user feedback on multiple dimensions such as sentence noise and overall volume.

[0283] In the speech correction module, the terminal interface randomly displays several words and plays an audio clip of one of them. The user selects the audio clip they want to hear, and this is repeated multiple times. Once the test is complete, the module calculates and applies the required gain adjustments for different frequency bands based on the speech recognition rate. In the feedback adjustment module, the terminal plays a specific sentence, and the user selects the sentence based on their listening experience. Based on the user's selection, the module then performs personalized adjustments for noise reduction, overall loudness, gain, and other aspects.

[0284] The above fitting process executed by the terminal guides users to independently complete a series of fitting steps such as accurate audiometry, real-time compensation in the time and frequency domains, speech correction and feedback adjustment, and ensures high-quality personalized fitting results.

[0285] The embodiments of the present application have the following advantages. In terms of audiometry, the embodiments of the present application detect the user's click speed and generate a random test signal within a certain range based on the user's click speed to prevent user inertial fatigue. At the same time, the single-state button avoids user misoperation and psychological suggestion. Random silent segments are added during the test to detect the accuracy of user clicks. The iterative determination of reversal points and retesting of extreme points reduce random errors and improve accuracy.

[0286] In addition, the fitting formula of the embodiment of the present application adopts a combination of frequency domain compensation and time domain compensation. In frequency domain compensation, a dynamic compensation method based on environmental signals is introduced. In time domain compensation, envelope enhancement is used to enhance the envelope of small signals and unvoiced signals to achieve the best enhancement effect. In terms of speech correction, a corpus is designed. The corpus consists of initial consonants and words, and is divided into 15 groups according to the octave according to the spectral center of gravity. The 15 groups are played randomly, and 4 words are randomly selected from each group. The 4 words are played in random order to solve the problem of the effectiveness of repeated use of the corpus. At the same time, 5 groups of feedback are set, and through the A / B feedback form, the differentiated needs of different users for volume, timbre balance, noise reduction, etc. are solved.

[0287] As shown in Figure 11, in another embodiment provided by the present application, compared with that shown in the aforementioned Figure 6, the terminal adopts an assisted listening enhancement mode, performs artificial intelligence (AI) separation on the headphone microphone pickup signal, performs WDRC compensation and envelope enhancement on the extracted human voice, which can provide a better human voice compensation effect and improve the speech recognition rate.

[0288] As shown in Figure 11, the main process steps are described as follows:

[0289] S1: The user puts on the headset. First, the FF / FB signal is detected according to the prompt tone to check the wearing consistency. If the wearing is good, S2 is executed. Otherwise, prompt tone 1 is played to the user.

[0290] S2: After checking the wearing consistency, the ambient noise level is checked. If the noise level is less than a certain value, S3 is executed. Otherwise, prompt tone 2 is played to the user.

[0291] S3: Play a pure tone test signal to the user, detect the user's click speed, and send the click speed to the audiometry algorithm;

[0292] S4: Generate an audiometric test signal based on the user's click speed and initial volume, and play it to the user. When the user hears the test signal, they click a feedback button. After the test is complete, audiometric curves for the left and right ears are generated.

[0293] S5: Classify the hearing curves according to the audiometry results, and generate the corresponding frequency domain compensation gain and time domain compensation gain according to the classification results and the corresponding fitting formula;

[0294] S6: Sends the frequency domain compensation gain and time domain compensation gain to the headset DSP WDRC and envelope modulation module, and amplifies the uplink and downlink signals;

[0295] S7: Play a pre-made language test signal to the user and fine-tune the compensation gain according to the test results;

[0296] S8: Play a specific sentence to the user and determine the user's optimal listening volume and other conditions based on user feedback;

[0297] S9: Finally, perform PTA frequency audiometry on the user and output a fitting report;

[0298] S10: Through AI separation, it separates the human voice in the environment and sends it to S6 for amplification and enhancement.

[0299] By introducing AI technology, the human voice can be separated from the signal picked up by the mobile phone microphone, and WDRC frequency domain compensation and time domain envelope enhancement can be performed on the human voice signal separately, which can further improve the clarity of the human voice and the signal-to-noise ratio, thereby improving the speech recognition rate and achieving better fitting results.

[0300] The embodiment of the present application provides a full-process autonomous fitting process, which can maximize the approximation to the manual fitting effect through precise audiometry, time-frequency domain compensation, and speech correction and feedback adjustment after compensation.

[0301] It should be noted that for the aforementioned method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0302] In order to better implement the above-mentioned solutions of the embodiments of the present application, relevant devices for implementing the above-mentioned solutions are also provided below.

[0303] As shown in FIG12 , an embodiment of the present application provides a terminal 1200, which establishes a communication connection with an assistive hearing device to be fitted. The terminal includes: a testing module 1201, a compensation module 1202, and a sending module 1203, wherein:

[0304] A testing module is used to perform a hearing loss test on the hearing-assisted subject to obtain a hearing loss test result;

[0305] a compensation module, configured to perform hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain;

[0306] The sending module is configured to send the hearing loss compensation gain to the hearing assistive device, wherein the hearing assistive device is configured to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

[0307] It should be noted that the information interaction, execution process, etc. between the various modules / units of the above-mentioned device are based on the same concept as the method embodiment of the present application, and the technical effects they bring are the same as those of the method embodiment of the present application. For specific contents, please refer to the description in the method embodiment shown above in this application, and no further details will be given here.

[0308] An embodiment of the present application further provides a computer storage medium, wherein the computer storage medium stores a program, and the program executes some or all of the steps recorded in the above method embodiment.

[0309] Next, another terminal provided in an embodiment of the present application is introduced. Referring to FIG. 13 , the terminal 1300 includes:

[0310] Receiver 1301, transmitter 1302, processor 1303, and memory 1304 (wherein the number of processors 1303 in terminal 1300 may be one or more, and FIG13 takes one processor as an example). In some embodiments of the present application, the receiver 1301, transmitter 1302, processor 1303, and memory 1304 may be connected via a bus or other means, wherein FIG13 takes connection via a bus as an example.

[0311] Memory 1304 may include read-only memory and random access memory, and provides instructions and data to processor 1303. A portion of memory 1304 may also include non-volatile random access memory (NVRAM). Memory 1304 stores an operating system and operating instructions, executable modules, or data structures, or subsets or extended sets thereof. The operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic services and processing hardware-based tasks.

[0312] Processor 1303 controls the operation of the terminal and may also be referred to as a central processing unit (CPU). In specific applications, the various components of the terminal are coupled together via a bus system. In addition to a data bus, the bus system may also include a power bus, a control bus, and a status signal bus. However, for clarity, all bus systems are referred to as a bus system in the figure.

[0313] The methods disclosed in the above embodiments of the present application can be applied to or implemented by processor 1303. Processor 1303 can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits or software instructions in processor 1303. The above processor 1303 can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software modules can be located in storage media well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory 1304 , and the processor 1303 reads the information in the memory 1304 and completes the steps of the above method in combination with its hardware.

[0314] The receiver 1301 may be used to receive input digital or character information, and generate signal input related to the terminal's relevant settings and function control. The transmitter 1302 may include a display device such as a display screen, and the transmitter 1302 may be used to output digital or character information through an external interface.

[0315] In the embodiment of the present application, the processor 1303 is configured to execute the hearing loss compensation method shown in FIG. 2 or FIG. 3 .

[0316] In another possible design, when the terminal is a chip in a device, the chip includes: a processing unit and a communication unit, wherein the processing unit may be, for example, a processor, and the communication unit may be, for example, an input / output interface, a pin, or a circuit, etc. The processing unit may execute computer-executable instructions stored in the storage unit so that the chip in the terminal executes any one of the methods of the first aspect above. In some embodiments of the present application, the storage unit is a storage unit in the chip, such as a register, a cache, etc. The storage unit may also be a storage unit in the terminal located outside the chip, such as a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), etc.

[0317] The processor mentioned in any of the above places can be a general-purpose central processing unit, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the above-mentioned first aspect method.

[0318] It should also be noted that the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. In addition, in the drawings of the device embodiments provided in this application, the connection relationship between the modules indicates that there is a communication connection between them, which can be specifically implemented as one or more communication buses or signal lines.

[0319] Through the description of the above embodiments, it is clear to those skilled in the art that the present application can be implemented by means of software plus necessary general-purpose hardware, and of course it can also be implemented by means of dedicated hardware including application-specific integrated circuits, dedicated CPUs, dedicated memories, dedicated components, etc. In general, all functions performed by computer programs can be easily implemented with corresponding hardware, and the specific hardware structures used to implement the same function can also be various, such as analog circuits, digital circuits, or dedicated circuits, etc. However, for the present application, software program implementation is a better implementation method in most cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer's floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0320] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0321] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, a computer, a server, or a data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode to another website, a computer, a server, or a data center. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium can be a magnetic medium, (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state drive (SSD)).

Claims

1. A hearing loss compensation method based on an assistive listening device, characterized in that: The method is executed by a terminal, and a communication connection is established between the terminal and the auxiliary hearing device to be fitted. The method includes: Conducting hearing loss tests on the hearing-assisted subjects to obtain hearing loss test results; Performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain; The hearing loss compensation gain is sent to the auxiliary listening device, wherein the auxiliary listening device is used to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

2. The method according to claim 1, characterized in that The performing of a hearing loss test on the hearing-assisted subject to obtain a hearing loss test result includes: Performing a hearing test on the assisted listening subject to obtain a feedback speed of the assisted listening subject; generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the auxiliary listening device; A hearing loss test result is obtained according to the first test signal and a first feedback instruction, wherein the first feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the first test signal.

3. The method according to claim 2, characterized in that The performing hearing test on the assisted hearing object to obtain the feedback speed of the assisted hearing object includes: Sending a second test signal to the auxiliary listening device; The feedback speed is acquired according to the second test signal and a second feedback instruction, where the second feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the second test signal.

4. The method according to claim 2 or 3, characterized in that: The step of generating a first test signal according to the feedback speed and a preset first volume includes: The first test signal of random length is generated according to the feedback speed and a preset first volume, wherein the first test signal includes: a test signal of multiple frequency points for measuring the hearing loss level of the hearing aid object.

5. The method according to any one of claims 2 to 4, characterized in that The first test signal includes: a random mute signal; The method further comprises: When the auxiliary listening device plays the random mute signal, detecting an erroneous operation feedback instruction sent by the auxiliary listening object; Sending a wrong operation prompt signal to the auxiliary listening device according to the wrong operation feedback instruction.

6. The method according to any one of claims 2 to 5, characterized in that The generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the auxiliary listening device includes: generating a plurality of first test signals corresponding to a first frequency point according to the feedback speed, a preset first volume, and a preset volume rise and fall difference, and sending the plurality of first test signals to the auxiliary listening device, wherein the volume of one first test signal among the plurality of first test signals is the first volume, and the volumes of other first test signals among the plurality of first test signals except the one first test signal are determined according to the first volume and the volume rise and fall difference; The obtaining of the hearing loss test result according to the first test signal and the first feedback instruction includes: Determine a first reversal point according to a plurality of first feedback instructions corresponding to the plurality of first test signals, the first reversal point comprising: a time point when two adjacent first feedback instructions in the plurality of first feedback instructions indicate different listening results; Acquire a second inversion point adjacent to the first inversion point; When the deviation value between the first inversion point and the second inversion point is greater than a preset sound pressure threshold, clearing the frequency point test result corresponding to the first inversion point; When the deviation value between the first inversion point and the second inversion point is less than or equal to a preset sound pressure threshold, the hearing loss test result is obtained according to the frequency point test result of the first inversion point.

7. The method according to claim 6, characterized in that The obtaining the hearing loss test result according to the frequency test result of the first inversion point includes: When the number of times the frequency test result reaches an extreme value exceeds a number threshold, and / or the number of first test signals sent at the first frequency exceeds a number threshold, the hearing loss test result is determined according to the frequency test result of the first reversal point.

8. The method according to any one of claims 1 to 7, characterized in that The performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain includes: Performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain; The first compensation gain is speech-corrected according to a preset language test signal to obtain the hearing loss compensation gain.

9. The method according to claim 8, characterized in that The performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain includes: Obtaining a first hearing loss value at a first frequency point in the hearing loss test result; Determining a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to a mapping relationship between the hearing loss value and the correction gain value; The first compensation gain is determined according to the first compensation gain value.

10. The method according to claim 9, characterized in that The method further comprises: performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain; determining a hearing curve according to the hearing loss test result; The mapping relationship between the hearing loss value and the correction gain value is determined according to the classification result corresponding to the hearing curve.

11. The method according to claim 9 or 10, characterized in that: The determining, according to the mapping relationship between the hearing loss value and the correction gain value, a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain comprises: Dividing the external input signal collected by the auxiliary listening device into a plurality of sub-bands according to octaves; Acquire speech estimation signals and noise estimation signals corresponding to the multiple sub-bands; Performing speech intelligibility index analysis based on the speech estimation signal and the noise estimation signal to obtain the loudness of the hearing loss; Determining a first frequency domain compensation gain of the first hearing loss value in the frequency domain according to a mapping relationship between the hearing loss value and the correction gain value; The first frequency domain compensation gain is iteratively optimized according to the speech estimation signals and the noise estimation signals corresponding to the multiple sub-bands and the loudness of the hearing loss to obtain a second frequency domain compensation gain that maximizes intelligibility within a preset loudness, and the second frequency domain compensation gain belongs to the first correction gain value.

12. The method according to claim 9 or 10, characterized in that: The determining, according to the mapping relationship between the hearing loss value and the correction gain value, a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain comprises: Determining a first time domain compensation gain of the first hearing loss value in the time domain according to a mapping relationship between the hearing loss value and the correction gain value; Extracting envelope information of an external input signal collected by the auxiliary listening device; When the average value of the envelope information is greater than a preset envelope threshold, linear attenuation processing is performed on the first time domain compensation gain to obtain a second time domain compensation gain, where the second time domain compensation gain belongs to the first correction gain value; When the average value of the envelope information is less than or equal to a preset envelope threshold, the first time domain compensation gain is linearly increased to obtain a third time domain compensation gain, and the third time domain compensation gain belongs to the first correction gain value.

13. The method according to any one of claims 8 to 12, characterized in that The performing speech correction on the first compensation gain according to a preset language test signal to obtain the hearing loss compensation gain includes: Generate a language test signal in a frequency band manner according to the centroid of the audio spectrum, the language test signal comprising: test words corresponding to a plurality of frequency points at different centroids of the audio spectrum; sending the language test signal to the auxiliary listening device; The first compensation gain is speech-corrected according to the language test signal and a third feedback instruction to obtain the hearing loss compensation gain, wherein the third feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the third test signal.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: Detecting the ambient noise of the auxiliary listening device, and sending a noise prompt signal to the auxiliary listening device when the ambient noise is greater than or equal to a preset noise threshold; When the environmental noise is less than a preset noise threshold, the following steps are triggered: a hearing loss test is performed on the hearing aid object to obtain a hearing loss test result.

15. The method according to any one of claims 8 to 12, characterized in that The performing speech correction on the first compensation gain according to a preset language test signal comprises: Acquire the language test signal from a preset corpus, the corpus comprising: a plurality of groups of language test signals, wherein each group of language test signals comprises: initial consonant single word groups divided into the same group according to different octaves based on the center of gravity of the audio spectrum, wherein an initial consonant single word group comprises: randomly selected more than or equal to 2 easily confused words; Playing the easily confused words of greater than or equal to 2 in the same initial consonant single word group in a random order through the auxiliary listening device; detecting a fourth feedback instruction sent by the auxiliary listening object; Acquire a consistent error frequency band of the auxiliary hearing object according to the fourth feedback instruction and the language test signal; The first compensation gain is adjusted according to the consistency error frequency band.

16. The method according to claim 11, characterized in that The determining, according to the mapping relationship between the hearing loss value and the correction gain value, a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain further includes: performing human voice separation on the external input signal collected by the auxiliary hearing device to obtain a human voice signal; performing wide dynamic range compression compensation and envelope enhancement on the human voice signal to obtain a compensated and enhanced human voice signal; The dividing the external input signal collected by the auxiliary listening device into a plurality of sub-bands according to the octave includes: dividing the compensated and enhanced human voice signal into a plurality of sub-bands according to the octave.

17. A terminal, characterized in that: The terminal establishes a communication connection with the hearing aid to be fitted, and the terminal includes: A test module is used to perform a hearing loss test on the hearing-assisted object to obtain a hearing loss test result; A compensation module, used for performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain; The sending module is used to send the hearing loss compensation gain to the auxiliary listening device, wherein the auxiliary listening device is used to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

18. A terminal, characterized in that: The terminal comprises: a processor and a memory; the processor and the memory communicate with each other; The memory is used to store instructions; The processor is configured to execute the instructions in the memory to perform the method according to any one of claims 1 to 16.

19. A computer-readable storage medium comprising instructions, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 16.

20. A computer program product comprising instructions, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 16.

Images