Hearing loss compensation method based on hearing aid device and terminal

Abstract

The embodiment of the invention discloses a hearing loss compensation method based on hearing aid equipment and a terminal, which are used for simplifying a hearing loss test process and improving the accuracy of hearing loss compensation. The hearing loss compensation method based on the hearing aid device is executed by a terminal, communication connection is established between the terminal and the hearing aid device to be fitted, and the method comprises the following steps: performing a hearing loss test on a hearing aid object to obtain a hearing loss test result; performing hearing loss compensation according to the hearing loss test result to obtain hearing loss compensation gain; the hearing loss compensation gain is sent to the hearing aid device, and the hearing aid device is used for conducting hearing loss compensation on a first voice signal according to the hearing loss compensation gain to obtain a second voice signal.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a hearing loss compensation method and terminal based on an auxiliary hearing device. Background Art

[0002] Hearing loss is a type of hearing impairment, which refers to partial or complete loss of hearing, which may occur in one or both ears. Hearing loss can be divided into four levels: 26-40dB is mild, 41-60dB is moderate, 61-80dB is severe, and greater than 80dB is extremely severe.

[0003] Users with hearing loss need to use hearing aids and other auxiliary hearing products to assist hearing. Users with hearing loss undergo audiometry at a fitting center, and then professional fitters select hearing aids, and then perform manual repeated debugging and testing to complete the entire fitting process.

[0004] The above scheme has the problems of low accuracy of manual testing and complicated testing process. Summary of the invention

[0005] The embodiments of the present application provide a hearing loss compensation method and terminal based on an assistive listening device, which are used to simplify the hearing loss test process and improve the accuracy of hearing loss compensation.

[0006] To solve the above technical problems, the present application provides the following technical solutions:

[0007] In a first aspect, an embodiment of the present application provides a hearing loss compensation method based on an assistive hearing device, the method being executed by a terminal, and a communication connection being established between the terminal and the assistive hearing device to be fitted, the method comprising: performing a hearing loss test on the assisted hearing object to obtain a hearing loss test result; performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain; and sending the hearing loss compensation gain to the assistive hearing device, wherein the assistive hearing device is used to perform hearing loss compensation on a first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

[0008] In the above scheme, the terminal can compensate for the hearing loss of the hearing subject wearing the hearing assistive device, thereby realizing the fitting of the hearing assistive device for the hearing subject. The entire hearing loss compensation process can be realized by the interaction between the terminal and the hearing assistive device, and there is no need for manual testing by a doctor. Therefore, the hearing loss test process can be performed quickly and easily. The terminal interacts with the hearing assistive device worn by the hearing subject to complete the hearing loss compensation. The hearing loss compensation can be performed for the hearing subject wearing the hearing assistive device, so the accuracy of the hearing loss compensation can be improved.

[0009] In a possible implementation of the first aspect, the performing of a hearing loss test on the auxiliary hearing object to obtain a hearing loss test result includes: performing a hearing test on the auxiliary hearing object to obtain a feedback speed of the auxiliary hearing object; generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the auxiliary hearing device; obtaining the hearing loss test result according to the first test signal and a first feedback instruction, the first feedback instruction including: a feedback instruction detected by the terminal when the auxiliary hearing device plays the first test signal. In the above scheme, the feedback speed of the auxiliary hearing object can be obtained by performing a hearing test on the auxiliary hearing object, and a first test signal is generated based on the feedback speed. The first test signal can be used to obtain the hearing loss test result. The first test signal sent according to the feedback speed of the auxiliary hearing object can realize an accurate hearing loss test on the auxiliary hearing object and improve the accuracy of the hearing loss test result.

[0010] In a possible implementation of the first aspect, the performing of a hearing test on the auxiliary listening object to obtain the feedback speed of the auxiliary listening object includes: sending a second test signal to the auxiliary listening device; obtaining the feedback speed according to the second test signal and a second feedback instruction, wherein the second feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the second test signal. In the above scheme, the auxiliary listening object can click a feedback button on the UI of the terminal, so that the terminal detects the second feedback instruction sent by the auxiliary listening object, and the terminal obtains the feedback speed according to the second test signal and the second feedback instruction.

[0011] In a possible implementation of the first aspect, the generating of the first test signal according to the feedback speed and the preset first volume includes: generating the first test signal of random length according to the feedback speed and the preset first volume, the first test signal including: test signals of multiple frequencies for measuring the hearing loss level of the auxiliary hearing object. In the above scheme, the terminal generates a test signal of random length within a preset length range according to the first volume and the feedback speed, thereby preventing inertial fatigue of the auxiliary hearing object and improving the accuracy of the hearing loss level test.

[0012] In a possible implementation of the first aspect, the first test signal includes: a random mute signal; the method further includes: when the auxiliary listening device plays the random mute signal, detecting the error operation feedback instruction sent by the auxiliary listening object; and sending an error operation prompt signal to the auxiliary listening device according to the error operation feedback instruction. In the above scheme, by adding a random mute signal to the first test signal, when the user clicks a button during the playback of the mute signal, the terminal can send an error operation prompt signal to the auxiliary listening device, and the auxiliary listening device plays the error operation prompt signal to prompt the user to click correctly, thereby avoiding user inertial fatigue, reducing error operations, and improving the user's click accuracy.

[0013] In a possible implementation manner of the first aspect, the generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the auxiliary listening device includes: generating a plurality of first test signals corresponding to a first frequency point according to the feedback speed, a preset first volume, and a preset volume rise and fall difference, and sending the plurality of first test signals to the auxiliary listening device, wherein the volume of a first test signal among the plurality of first test signals is the first volume, and the volumes of other first test signals among the plurality of first test signals except the first test signal are determined according to the first volume and the volume rise and fall difference; and A feedback instruction obtains a hearing loss test result, including: determining a first reversal point according to a plurality of first feedback instructions corresponding to the plurality of first test signals, the first reversal point including: a time point at which two adjacent first feedback instructions in the plurality of first feedback instructions indicate different listening results; obtaining a second reversal point adjacent to the first reversal point; when the deviation value between the first reversal point and the second reversal point is greater than a preset sound pressure threshold, clearing the frequency test result corresponding to the first reversal point; when the deviation value between the first reversal point and the second reversal point is less than or equal to the preset sound pressure threshold, obtaining the hearing loss test result according to the frequency test result of the first reversal point. In the above scheme, the terminal can record the deviation value between the adjacent first reversal point and the second reversal point. If the deviation value is less than or equal to the preset sound pressure threshold, it means that the frequency test result of the first reversal point currently recorded is accurate, and the frequency test can continue. The frequency test result of the first reversal point can be used to obtain the hearing loss test result.

[0014] In a possible implementation of the first aspect, the obtaining of the hearing loss test result according to the frequency test result of the first reversal point includes: when the number of times the frequency test result reaches an extreme value exceeds a number threshold, and / or the number of first test signals sent at the first frequency exceeds a number threshold, the hearing loss test result is determined according to the frequency test result of the first reversal point. In the above scheme, the terminal can also set a frequency test end condition. When the frequency test result meets the preset frequency test end condition, the terminal stops testing the first frequency, and determines the hearing loss test result according to the frequency test result of the first reversal point. The efficiency of the hearing loss test can be improved by testing the frequency points.

[0015] In a possible implementation of the first aspect, the performing of hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain includes: performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain; and performing speech correction on the first compensation gain according to a preset language test signal to obtain the hearing loss compensation gain. In the above scheme, after determining the first compensation gain, the terminal can send a preset language test signal to the auxiliary listening device, and perform speech correction on the first compensation gain through the language test signal, so as to obtain the hearing loss compensation gain. Through the above speech correction, the speech recognition rate can be improved.

[0016] In a possible implementation of the first aspect, performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain includes: obtaining a first hearing loss value at a first frequency point in the hearing loss test result; determining a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to a mapping relationship between the hearing loss value and the correction gain value; and determining the first compensation gain according to the first compensation gain value. In the above scheme, real-time compensation can be performed according to the mapping relationship between the hearing loss value and the correction gain value, thereby improving the accuracy of hearing loss compensation.

[0017] In a possible implementation of the first aspect, the real-time compensation processing is performed in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain, and further includes: determining a hearing curve according to the hearing loss test result; and determining a mapping relationship between the hearing loss value and the correction gain value according to a classification result corresponding to the hearing curve. In the above scheme, the hearing loss test result may include one or more hearing curves, and the terminal may obtain the hearing curve, classify the type of the hearing curve according to a predetermined hearing curve library, obtain the classification result corresponding to the hearing curve, and select the corresponding mapping relationship between the hearing loss value and the correction gain value according to the classification result, so that the mapping relationship between the hearing loss value and the correction gain value can be used for real-time compensation.

[0018] In a possible implementation of the first aspect, the first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to the mapping relationship between the hearing loss value and the correction gain value includes: dividing the external input signal collected by the auxiliary listening device into multiple sub-bands according to octaves; obtaining speech estimation signals and noise estimation signals corresponding to the multiple sub-bands; performing speech intelligibility index analysis according to the speech estimation signals and noise estimation signals to obtain the loudness of the hearing loss; determining the first frequency domain compensation gain of the first hearing loss value in the frequency domain according to the mapping relationship between the hearing loss value and the correction gain value; iteratively optimizing the first frequency domain compensation gain according to the speech estimation signals and noise estimation signals corresponding to the multiple sub-bands and the loudness of the hearing loss to obtain a second frequency domain compensation gain that maximizes intelligibility within a preset loudness, and the second frequency domain compensation gain belongs to the first correction gain value. In the above scheme, the accuracy of hearing loss compensation can be improved by the above hearing loss compensation in the frequency domain.

[0019] In a possible implementation of the first aspect, the determining the first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to the mapping relationship between the hearing loss value and the correction gain value includes: determining the first time domain compensation gain of the first hearing loss value in the time domain according to the mapping relationship between the hearing loss value and the correction gain value; extracting the envelope information of the external input signal collected by the auxiliary hearing device; when the average value of the envelope information is greater than a preset envelope threshold, performing linear attenuation processing on the first time domain compensation gain to obtain a second time domain compensation gain, and the second time domain compensation gain belongs to the first correction gain value; when the average value of the envelope information is less than or equal to the preset envelope threshold, performing linear enhancement processing on the first time domain compensation gain to obtain a third time domain compensation gain, and the third time domain compensation gain belongs to the first correction gain value. In the above scheme, the terminal performs linear attenuation processing on the first time domain compensation gain, obtains the second time domain compensation gain through the linear attenuation processing, and determines the first correction gain value through the second time domain compensation gain, so that the envelope of the external input signal is linearly attenuated, thereby improving the accuracy of hearing loss compensation. The terminal performs linear boost processing on the first time domain compensation gain, obtains a third time domain compensation gain through the linear boost processing, and determines the first correction gain value through the third time domain compensation gain, so that the envelope of the external input signal is linearly boosted, thereby improving the accuracy of hearing loss compensation.

[0020] In a possible implementation of the first aspect, the speech correction of the first compensation gain according to the preset language test signal to obtain the hearing loss compensation gain includes: generating a language test signal in a frequency band manner according to the centroid of the audio spectrum, the language test signal including: test words corresponding to multiple frequency points of different centroids of the audio spectrum; sending the language test signal to the auxiliary listening device; speech correction of the first compensation gain according to the language test signal and a third feedback instruction to obtain the hearing loss compensation gain, the third feedback instruction including: a feedback instruction detected by the terminal when the auxiliary listening device plays the third test signal. In the above scheme, the terminal performs speech correction on the first compensation gain according to the language test signal and the third feedback instruction to obtain the hearing loss compensation gain, and the language test signal is generated by the above-mentioned multiple-choice method, and the language test signal is used for speech correction, which can improve the accuracy of hearing loss compensation.

[0021] In a possible implementation of the first aspect, the method further includes: detecting the ambient noise of the auxiliary listening device, and when the ambient noise is greater than or equal to a preset noise threshold, sending a noise prompt signal to the auxiliary listening device; when the ambient noise is less than the preset noise threshold, triggering the following steps: performing a hearing loss test on the auxiliary listening object to obtain a hearing loss test result. In the above scheme, the terminal can first detect the environment where the auxiliary listening device is located, so as to ensure that the subsequent hearing loss compensation process can be carried out correctly and improve the accuracy of hearing loss compensation.

[0022] In a possible implementation of the first aspect, the speech correction of the first compensation gain according to the preset language test signal includes: obtaining the language test signal from a preset corpus, the corpus includes: multiple groups of language test signals, wherein each group of language test signals includes: initial consonant single word groups divided into the same group according to different octaves according to the center of gravity of the audio spectrum, wherein each initial consonant single word group includes: randomly selected more than or equal to 2 easily confused words; playing more than or equal to 2 easily confused words in the same initial consonant single word group in a random order through the auxiliary listening device; detecting the fourth feedback instruction sent by the auxiliary listening object; obtaining the consistent error frequency band of the auxiliary listening object according to the fourth feedback instruction and the language test signal; and adjusting the first compensation gain according to the consistent error frequency band. In the above scheme, the problem of the effectiveness of corpus reuse can be solved by randomly extracting each group of words and playing them in random order, and the consistent error frequency band can be determined by the fourth feedback instruction, which solves the differentiated needs of different users for volume, timbre balance, noise reduction, etc. Generating a language test signal and using the language test signal for speech correction can improve the accuracy of hearing loss compensation.

[0023] In a possible implementation of the first aspect, the method of determining the first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to the mapping relationship between the hearing loss value and the correction gain value also includes: performing human voice separation on the external input signal collected by the auxiliary listening device to obtain a human voice signal; performing wide dynamic range compression compensation and envelope enhancement on the human voice signal to obtain a compensated and enhanced human voice signal; and dividing the external input signal collected by the auxiliary listening device into multiple sub-bands according to the octave, including: dividing the compensated and enhanced human voice signal into multiple sub-bands according to the octave. In the above scheme, wide dynamic range compression compensation and envelope enhancement are performed on the human voice signal to obtain a compensated and enhanced human voice signal, which can be used for subsequent correction gain calculations, can provide a better human voice compensation effect, and improve speech recognition rate.

[0024] In a second aspect, an embodiment of the present application further provides a terminal, wherein a communication connection is established between the terminal and an auxiliary hearing device to be fitted, and the terminal includes:

[0025] A test module is used to perform a hearing loss test on the hearing-assisted object to obtain a hearing loss test result;

[0026] A compensation module, used for performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain;

[0027] The sending module is used to send the hearing loss compensation gain to the auxiliary listening device, wherein the auxiliary listening device is used to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

[0028] In the above scheme, the terminal can compensate for the hearing loss of the hearing subject wearing the hearing assistive device, thereby realizing the fitting of the hearing assistive device for the hearing subject. The entire hearing loss compensation process can be realized by the interaction between the terminal and the hearing assistive device, and there is no need for manual testing by a doctor. Therefore, the hearing loss test process can be performed quickly and easily. The terminal interacts with the hearing assistive device worn by the hearing subject to complete the hearing loss compensation. The hearing loss compensation can be performed for the hearing subject wearing the hearing assistive device, so the accuracy of the hearing loss compensation can be improved.

[0029] In the second aspect of the present application, the constituent modules of the terminal may also execute the steps described in the aforementioned first aspect and various possible implementations, see the aforementioned description of the first aspect and various possible implementations for details.

[0030] In a third aspect, an embodiment of the present application further provides a terminal, the terminal comprising: a processor and a memory; the processor and the memory communicate with each other;

[0031] The memory is used to store instructions;

[0032] The processor is used to execute the instructions in the memory to perform the method as described in any one of the first aspects above.

[0033] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer executes the method described in the first aspect above.

[0034] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method described in the first aspect above.

[0035] In the sixth aspect, an embodiment of the present application provides a communication device, which may include entities such as a terminal device or a chip, and the communication device includes: a processor, a memory; the memory is used to store instructions; the processor is used to execute the instructions in the memory, so that the communication device performs a method as described in any one of the above-mentioned first aspects.

[0036] In a seventh aspect, the present application provides a chip system, which includes a processor for supporting a terminal to implement the functions involved in the above aspects, for example, sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the terminal. The chip system can be composed of a chip, or it can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A schematic diagram of the structure of a hearing loss compensation system provided in an embodiment of the present application;

[0038] Figure 2 An interactive schematic diagram of a hearing loss compensation method provided in an embodiment of the present application;

[0039] Figure 3 A flowchart diagram of a hearing loss compensation method provided in an embodiment of the present application;

[0040] Figure 4 A schematic diagram of an application framework of a hearing loss compensation system provided in an embodiment of the present application;

[0041] Figure 5 A UI schematic diagram of a terminal in a hearing loss compensation system provided in an embodiment of the present application;

[0042] Figure 6 A flowchart of an application scenario of a hearing loss compensation method provided in an embodiment of the present application;

[0043] Figure 7 A schematic diagram of an audiometry algorithm flow chart provided in an embodiment of the present application;

[0044] Figure 8a A schematic diagram of an audiometry configuration UI provided in an embodiment of the present application;

[0045] Figure 8b A test guide UI schematic diagram provided in an embodiment of the present application;

[0046] Figure 8c A schematic diagram of a reaction speed test UI provided in an embodiment of the present application;

[0047] Figure 8d A hearing test UI schematic diagram provided in an embodiment of the present application;

[0048] Figure 8e A schematic diagram of a speech test UI provided in an embodiment of the present application;

[0049] Figure 8f A schematic diagram of a feedback adjustment UI provided in an embodiment of the present application;

[0050] Fig. 9 A schematic diagram of a compensation algorithm flow chart provided in an embodiment of the present application;

[0051] Fig.10 A schematic diagram of a speech correction process provided in an embodiment of the present application;

[0052] Fig.11 A flowchart of an application scenario of a hearing loss compensation method provided in an embodiment of the present application;

[0053] Fig.12 A schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0054] Fig.13 A schematic diagram of the structure of a terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The embodiments of the present application are described below in conjunction with the accompanying drawings.

[0056] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0057] The technical solution of the embodiment of the present application can be applied to various hearing loss compensation systems, which can realize the automated fitting of auxiliary hearing devices for auxiliary hearing objects, wherein the auxiliary hearing object refers to the object that needs to use the auxiliary hearing device, for example, the auxiliary hearing object is the user's human ear, and the auxiliary hearing device refers to the audio signal playback end, for example, the auxiliary hearing device can be a Bluetooth headset, a wired headset, a hearing aid, etc., and the auxiliary hearing device can also be called an auxiliary hearing device. The user can receive the voice signal sent by the terminal by wearing the auxiliary hearing device, and the voice signal is the voice signal obtained by the terminal after the hearing loss compensation is performed on the auxiliary hearing object. The hearing loss compensation system provided in the embodiment of the present application does not require manual testing by a doctor, can simplify the hearing loss test process, and improve the accuracy of hearing loss compensation.

[0058] like Figure 1 As shown, a hearing loss compensation system provided by an embodiment of the present application includes: a terminal 10 and an auxiliary hearing device 20 to be fitted, wherein a communication connection is established between the terminal 10 and the auxiliary hearing device 20, for example, the terminal 10 and the auxiliary hearing device 20 communicate through a wireless network. The terminal 10 can compensate for the hearing loss of the hearing aid subject wearing the auxiliary hearing device 20, without the need for manual testing by a physician, so the hearing loss test process can be performed quickly and easily, and the terminal 10 interacts with the auxiliary hearing device 20 worn by the hearing aid subject, which can improve the accuracy of the hearing loss compensation.

[0059] In an embodiment of the present application, the hearing loss compensation system adopts an autonomous fitting architecture that combines software and hardware. Specifically, the hearing loss compensation system includes a terminal and an auxiliary listening device, wherein the terminal is an operating software carrier end, such as a terminal including a mobile phone, a tablet computer, a personal computer, etc., and the auxiliary listening device is an audio signal playback end, such as an auxiliary listening device is a Bluetooth headset, a wired headset, a hearing aid, etc. The terminal can specifically perform hearing loss testing and hearing loss compensation. The terminal compensates the original voice signal for hearing loss to obtain a target voice signal, and then sends the target voice signal to the auxiliary listening device. After receiving the target voice signal, the auxiliary listening device plays the target voice signal through the audio playback port, so that the auxiliary listening object can hear the target voice signal after hearing loss compensation, thereby realizing automatic fitting of the auxiliary listening device for the auxiliary listening object.

[0060] Next, the terminal involved in the application embodiment is described. The terminal can also be called a terminal device. The terminal device can include at least one of the following: user equipment (UE), mobile station (MS), mobile terminal (MT), terminal, terminal device, etc., which is a device that provides voice and / or data connectivity to users, or a chip set in the device, for example, a handheld device with wireless connection function, a vehicle-mounted device, etc. At present, some examples of terminal devices are: mobile phones, tablet computers, laptops, PDAs, mobile Internet devices (MID), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, etc. For example, the terminal device may be a vehicle-mounted communication module or other embedded communication module, or may be a user's handheld communication device, including a mobile phone, a tablet computer, etc.

[0061] The hearing loss compensation system provided in the embodiment of the present application includes a terminal that can execute a hearing loss compensation method based on an auxiliary hearing device. The user does not need to go to a hearing center to find a professional hearing aid fitter for fitting. The user can complete the entire fitting process independently and achieve a good hearing aid effect. The following is an example of the hearing loss compensation method executed by the terminal. A communication connection is established between the terminal and the auxiliary hearing device to be fitted. Please refer to Figure 2 As shown, it mainly includes the following steps:

[0062] 201. The terminal performs a hearing loss test on the hearing-assisted object to obtain a hearing loss test result.

[0063] Among them, a communication connection is established between the terminal and the auxiliary listening device, for example, a Bluetooth connection is established between the terminal and the auxiliary listening device. After the assisted listening subject wears the auxiliary listening device, the terminal device first performs a hearing loss test on the assisted listening subject. For example, the hearing loss of the left and right ears of the assisted listening subject can be tested to obtain a hearing loss test result, which can also be called a hearing loss test result. For example, the hearing loss test result may include: a hearing loss test result of the left ear of the assisted listening subject and a test result of the right ear of the assisted listening subject. Specifically, the hearing loss test result may include parameter values ​​of the hearing loss test, and the hearing loss test result may record the parameter values ​​of the hearing loss test in the form of a set, a list, a curve, etc.

[0064] In the embodiment of the present application, the terminal performs a hearing loss test on the hearing-assisted object without the need for manual operation by a physician, and is implemented by the interaction between the terminal and the hearing-assisted device.

[0065] Specifically, there are many ways to test hearing loss, which are not limited in the embodiments of the present application. Please refer to the examples in the subsequent embodiments for details.

[0066] In some embodiments of the present application, in addition to executing the aforementioned steps, the hearing loss compensation method executed by the terminal further includes:

[0067] A1. The terminal determines that the assistive listening device does not meet the wearing requirements based on the sound signal collected by the assistive listening device, and sends a wearing prompt signal to the assistive listening device.

[0068] Among them, after the hearing aid subject wears the hearing aid device, the terminal detects the tightness of the wearing. Specifically, the terminal determines whether the hearing aid device meets the wearing requirements based on the sound signal collected by the hearing aid device. When the hearing aid device does not meet the wearing requirements, the terminal sends a wearing prompt signal to the hearing aid device so that the hearing aid subject can adjust the wearing of the hearing aid device, thereby ensuring that the subsequent hearing loss compensation process can be carried out correctly and improving the accuracy of hearing loss compensation.

[0069] For example, the terminal can detect a feedforward (FF) signal or a feedback (FB) signal based on the prompt tone to detect the consistency of wearing. If the wearing is good, the subsequent hearing compensation process is executed, otherwise the wearing prompt tone is played.

[0070] In some embodiments of the present application, in addition to executing the aforementioned steps, the hearing loss compensation method executed by the terminal further includes:

[0071] B1. The terminal detects the ambient noise of the auxiliary listening device. When the ambient noise is greater than or equal to the preset noise threshold, the terminal sends a noise prompt signal to the auxiliary listening device;

[0072] When the ambient noise is less than the preset noise threshold, the aforementioned step 201 is triggered to be executed: the terminal performs a hearing loss test on the hearing-assisted object to obtain a hearing loss test result.

[0073] Among them, after the assisted hearing object wears the assisted hearing device, the terminal can also detect the environmental noise of the assisted hearing device, which can also be called the environmental background noise, to determine whether it is necessary to adjust the wearing method of the assisted hearing device to carry out the subsequent process. Specifically, when the environmental noise is greater than or equal to the preset noise threshold, the terminal sends a noise prompt signal to the assisted hearing device so that the assisted hearing object adjusts the environment in which the assisted hearing device is located. When the environmental noise is less than the preset noise threshold, the environment in which the assisted hearing device is located is suitable for hearing loss testing, and the terminal triggers the execution of the aforementioned step 201. The terminal can first detect the environment in which the assisted hearing device is located, so as to ensure that the subsequent hearing loss compensation process can be carried out correctly and improve the accuracy of hearing loss compensation.

[0074] 202. The terminal performs hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain.

[0075] Among them, after the terminal obtains the hearing loss test result, the terminal can determine the hearing loss of the tested auxiliary hearing object, so that the terminal device needs to compensate for the hearing loss of the auxiliary hearing object, and the terminal determines the hearing loss compensation gain according to the hearing loss test result, and the hearing loss compensation gain may include: the gain value required to compensate for the hearing loss of the auxiliary hearing object. For example, the hearing loss compensation gain may specifically include the frequency domain compensation gain, or the hearing loss compensation gain may specifically include the time domain compensation gain, or the hearing loss compensation gain may specifically include the frequency domain compensation gain and the time domain compensation gain, which are not limited here.

[0076] 203. The terminal device sends a hearing loss compensation gain to an assistive listening device, wherein the assistive listening device is configured to perform hearing loss compensation on the first voice signal according to the hearing loss compensation gain to obtain a second voice signal.

[0077] After the terminal obtains the hearing loss compensation gain, the terminal sends the hearing loss compensation gain through the communication connection with the auxiliary hearing device, and the auxiliary hearing device receives and stores the hearing loss compensation gain. For example, the auxiliary hearing device can be a headset, and the headset includes: a digital signal processor (digital signal processing, DSP), and the DSP includes: a wide dynamic range control (wide dynamic ratio control, WDRC) module and an envelope modulation module, and the WDRC module and the envelope modulation module can amplify the voice signal according to the hearing loss compensation gain.

[0078] The first voice signal refers to the original audio signal that needs to be played to the auxiliary listening object. For example, the first voice signal can be call voice data, or audio channel data included in video data, or the first voice signal can be speech data, sentence data, music data, etc. The auxiliary listening device obtains the first voice signal to be transmitted. For example, the auxiliary listening device can obtain the first voice data from the terminal or the cloud server, or the auxiliary listening device can receive the first voice data from other terminals. The auxiliary listening device obtains the first voice signal, and performs hearing loss compensation on the first voice signal according to the hearing loss compensation gain determined in the aforementioned steps 201 to 202 to obtain a second voice signal. For example, the second voice signal may include at least one of the following: speech data, sentence data, music data, etc. after hearing loss compensation according to the hearing loss compensation gain.

[0079] Specifically, 203 the terminal device sends the hearing loss compensation gain to the assistive listening device, including:

[0080] The terminal performs hearing loss compensation on the first voice signal to be transmitted according to the hearing loss compensation gain to obtain a second voice signal, and sends the second voice signal to the auxiliary listening device.

[0081] Among them, the terminal can perform hearing loss compensation on the first voice signal, and then the auxiliary listening device sends a second voice signal obtained after the hearing loss compensation, so that the auxiliary listening device receives the second voice signal obtained after the hearing loss compensation. The auxiliary listening device only needs to play the second voice signal, which can simplify the processing flow of the auxiliary listening device.

[0082] It can be seen from the examples of the aforementioned embodiments that the terminal in the embodiments of the present application can compensate for the hearing loss of the hearing subject wearing the hearing assistive device, thereby realizing the fitting of the hearing assistive device for the hearing subject. The entire hearing loss compensation process can be achieved by the interaction between the terminal and the hearing assistive device, and there is no need for manual testing by a doctor. Therefore, the hearing loss test process can be performed quickly and easily. The terminal interacts with the hearing assistive device worn by the hearing subject to complete the hearing loss compensation. The hearing loss compensation can be performed on the hearing subject wearing the hearing assistive device, so the accuracy of the hearing loss compensation can be improved.

[0083] See also Figure 3 As shown, another hearing loss compensation method provided by the embodiment of the present application mainly includes the following steps:

[0084] 301. The terminal performs a hearing test on the assisted listening object to obtain a feedback speed of the assisted listening object.

[0085] Among them, the terminal can first detect the hearing level of the auxiliary listening object. Specifically, the terminal performs a hearing test on the auxiliary listening object to perform a reaction speed test to obtain the feedback speed of the auxiliary listening object, and the feedback speed can also be called the reaction speed. For example, the feedback speed can be the time required for the auxiliary listening object to react to the voice signal, and the feedback speed can be used to generate a test signal. The feedback speed can include the feedback speed of the left ear of the auxiliary listening object and the feedback speed of the right ear of the auxiliary listening object.

[0086] 302. The terminal generates a first test signal according to a feedback speed and a preset first volume, and sends the first test signal to an auxiliary listening device.

[0087] After obtaining the feedback speed of the auxiliary listening object, the terminal generates a first test signal according to the preset first volume and feedback speed. The first test signal may be a voice signal for testing the hearing loss of the auxiliary listening object. The first test signal may be one or more first test signals. The first volume may be the initial audio signal volume. After generating the first test signal, the terminal sends the first test signal through the communication connection between the terminal and the auxiliary listening device.

[0088] 303. The terminal obtains a hearing loss test result according to the first test signal and the first feedback instruction, where the first feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the first test signal.

[0089] Among them, after the auxiliary listening device receives the first test signal, the auxiliary listening device plays the first test signal to the auxiliary listening object. If the auxiliary listening object hears the audio content of the first test signal, the auxiliary listening object can send a first feedback instruction to the terminal, for example, the auxiliary listening object clicks a feedback button on the UI, so that the terminal detects the first feedback instruction. It is possible to perform an accurate hearing loss test on the auxiliary listening object and improve the accuracy of the hearing loss test results. The terminal obtains the hearing loss test result based on the first test signal and the first feedback instruction. For example, the hearing loss test result may include the left and right ear audiometry curves of the auxiliary listening object.

[0090] In some embodiments of the present application, the terminal 301 performs hearing detection on the auxiliary listening object to obtain the feedback speed of the auxiliary listening object, including:

[0091] C1. The terminal sends a second test signal to the auxiliary listening device;

[0092] C2. The terminal obtains a feedback speed according to the second test signal and the second feedback instruction, where the second feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the second test signal.

[0093] Among them, the terminal sends a second test signal to the auxiliary listening device, and the auxiliary listening device plays the second test signal. The second test signal includes: click speed test audio. If the auxiliary listening object hears the audio content of the second test signal, the auxiliary listening object can send a second feedback instruction to the terminal. For example, the auxiliary listening object can click a feedback button on the UI of the terminal, so that the terminal detects the second feedback instruction sent by the auxiliary listening object, and the terminal obtains the feedback speed according to the second test signal and the second feedback instruction. Specifically, the terminal records the time from the start of playing the second test signal to the auxiliary listening object sending the second feedback instruction, and obtains the feedback speed of the auxiliary listening object.

[0094] In some embodiments of the present application, the terminal 302 generates a first test signal according to the feedback speed and a preset first volume, including:

[0095] D1. The terminal generates a first test signal of random length according to a feedback speed and a preset first volume. The first test signal includes: a test signal of multiple frequencies used to measure the hearing loss level of the hearing aid object.

[0096] Among them, the terminal generates a test signal of random length within a preset length range according to the first volume and feedback speed to prevent the inertial fatigue of the assisted listening object. The assisted listening object can choose single ear or binaural audiometry, for example, to test multiple frequency points. The first test signal includes test signals of multiple frequency points, and the multiple frequency points include key pure tone audiometry (PTA) frequency points for measuring the user's hearing loss level. Therefore, it is possible to prevent the inertial fatigue of the assisted listening object and improve the accuracy of the hearing loss level test.

[0097] In some embodiments of the present application, the first test signal includes: a random mute signal, where the random mute signal refers to an audio signal including randomly generated mute points. In addition to performing the aforementioned steps, the hearing loss compensation method performed by the terminal also includes:

[0098] E1. When the auxiliary listening device plays a random mute signal, the terminal detects the wrong operation feedback instruction sent by the auxiliary listening object.

[0099] The first test signal may include a random mute signal. When the auxiliary listening device plays the random mute signal, the terminal detects the error operation feedback instruction sent by the auxiliary listening object. When the random mute signal is played, if the auxiliary listening object does not send an error operation feedback instruction, it means that the auxiliary listening object can correctly identify the mute. If the auxiliary listening object sends an error operation feedback instruction to the terminal when the random mute signal is played, the terminal can detect the error operation feedback instruction sent by the auxiliary listening object.

[0100] E2. The terminal sends an erroneous operation prompt signal to the auxiliary listening device according to the erroneous operation feedback instruction.

[0101] Among them, when the auxiliary listening device plays a random mute signal, the terminal detects the error operation feedback instruction sent by the auxiliary listening object, which means that the auxiliary listening object has made an error operation at this time. The terminal can send an error operation prompt signal to the auxiliary listening device to prompt the auxiliary listening object to make an error operation. In some possible implementations of the present application, when the user continuously clicks the button on the UI of the terminal, it is easy to generate inertial operation. In the embodiment of the present application, by adding a random mute signal to the first test signal, when the user clicks the button during the playback of the mute signal, the terminal can send an error operation prompt signal to the auxiliary listening device, and the auxiliary listening device plays the error operation prompt signal to prompt the user to click correctly, thereby avoiding user inertial fatigue, reducing error operations, and improving the user's click accuracy.

[0102] In some embodiments of the present application, the first test signal generated by the terminal may be multiple first test signals. For the multiple first test signals, the terminal may determine a reversal point and make a judgment based on the reversal point to determine whether to clear the reversal point to improve the audiometry accuracy. The following is a detailed description:

[0103] 302. The terminal generates a first test signal according to the feedback speed and a preset first volume, and sends the first test signal to the auxiliary listening device, including:

[0104] F1. Generate multiple first test signals corresponding to the first frequency point according to the feedback speed, the preset first volume and the preset volume increase and decrease difference, send the multiple first test signals to the auxiliary listening device, the volume of one of the multiple first test signals is the first volume, and the volumes of other first test signals except one of the multiple first test signals are determined according to the first volume and the volume increase and decrease difference.

[0105] Among them, if the terminal generates multiple first test signals, the terminal can send multiple first test signals in sequence, and the auxiliary listening object can send corresponding multiple first feedback instructions for the multiple first test signals. For example, the terminal can generate two first test signals respectively, and then send the two first test signals to the auxiliary listening device in sequence. When the auxiliary listening device receives a first test signal, the first test signal is played, and the auxiliary listening object generates a first feedback instruction for the played first test signal, and the first feedback instruction is used to feedback whether the auxiliary listening object has heard the first test signal.

[0106] The volumes of multiple first test signals generated by the terminal can be obtained according to the preset first volume and the volume rise and fall difference, respectively. The preset first volume can be a preset initial volume, and the volume rise and fall difference is used to adjust the first volume. The volume rise and fall difference can specifically be a fixed volume difference, or a set including multiple volume differences. The volume of a first test signal among the multiple first test signals is the first volume, and the volumes of other first test signals except one first test signal among the multiple first test signals are determined according to the first volume and the volume rise and fall difference. For example, in an embodiment of the present application, the first volume can be adjusted to obtain a second volume. For example, the second volume can be equal to the volume obtained by adding the volume rise and fall difference to the first volume. In addition, a third volume can be obtained according to the second volume and the volume rise and fall difference.

[0107] An example is given below, where the volume rise and fall difference can be 5dB up, 5dB down, 10dB down, etc. The terminal device generates a first first test signal according to the initial volume, then increases the initial volume by 5dB to obtain a second first test signal, then reduces the volume of the second first test signal by 10dB to obtain a third first test signal, which can achieve rapid iteration of the first test signal, then increases the volume of the third first test signal by 5dB to obtain a fourth first test signal, and reduces the volume of the fourth first test signal by 5dB to obtain a fifth first test signal. In the embodiment of the present application, the audiometric accuracy can be improved by multiple iterative increases and decreases of the first test signal.

[0108] In the implementation scenario of executing F1 above, 303 obtains the hearing loss test result according to the first test signal and the first feedback instruction, including:

[0109] G1. Determine a first reversal point according to a plurality of first feedback instructions corresponding to a plurality of first test signals, where the first reversal point includes: a time point when two adjacent first feedback instructions in the plurality of first feedback instructions indicate different listening results.

[0110] When the auxiliary listening device plays one of the first test signals, the auxiliary listening device sends a first feedback signal to the terminal, and the terminal can detect the first feedback signal. When the auxiliary listening device plays another first test signal, the auxiliary listening device sends another first feedback signal to the terminal, and the terminal can detect the other first feedback signal. The first reversal point is determined according to the detected multiple first feedback instructions, wherein the first reversal point includes: the time point when two adjacent first feedback instructions in the multiple first feedback instructions indicate different listening results, and each of the multiple first feedback instructions can indicate the listening result of the auxiliary listening object. For example, one listening result is "hearing the sound", and another listening result different from the listening result is "not hearing the sound". An example is given below: if the assisted listening device plays the first test signal of this time, the assisted listening subject hears the signal playback of this time and clicks the "hear sound" test button; if the assisted listening device plays the first test signal of the next time, the assisted listening subject does not hear the next signal playback and does not click the "hear sound" test button, then the time point when the assisted listening device transitions from hearing to not hearing is called the first reversal point. Therefore, the terminal detects whether the listening results indicated by two adjacent first feedback instructions are the same, and thus the first reversal point can be determined.

[0111] G2. The terminal obtains a second inversion point adjacent to the first inversion point.

[0112] Among them, the terminal can determine the second reversal point in the manner of detecting the reversal point described in G1, and the second reversal point is a reversal point adjacent to the first reversal point. For example, the second reversal point is determined before the first reversal point and is adjacent to the first reversal point. Through the two adjacent reversal points, it can be determined whether the hearing loss test result of the first frequency point is accurate. Specifically, the following steps G3 to G4 can be performed.

[0113] G3. When the deviation value between the first reversal point and the second reversal point is greater than the preset sound pressure threshold, the frequency point test result corresponding to the first reversal point is cleared;

[0114] G4. When the deviation value between the first inversion point and the second inversion point is less than or equal to the preset sound pressure threshold, the hearing loss test result is obtained according to the frequency test result of the first inversion point.

[0115] Among them, the terminal can record the deviation value between the adjacent first reversal point and the second reversal point. If the deviation value is greater than the preset sound pressure threshold, it means that the frequency test result of the first reversal point currently recorded is inaccurate, and the frequency test result corresponding to the first reversal point is cleared. If the deviation value is less than or equal to the preset sound pressure threshold, it means that the frequency test result of the first reversal point currently recorded is accurate, and the frequency test can continue. The frequency test result of the first reversal point can be used to obtain the hearing loss test result.

[0116] It can be understood that the above-mentioned process from G1 to G4 can be called the reversal point iterative determination process. Next, the application scenarios of G1 to G4 are illustrated by examples: when determining the reversal point, the volume of the first two test signals can be transitioned from 5dB up to 10dB down, and iterated quickly. Subsequently, the volume of the two test signals can be transitioned from 5dB up to 5dB down. By dynamically adjusting the volume of the test signal, the audiometry accuracy can be improved. During the test, the deviation value between adjacent reversal points is recorded for the current frequency. If the value is greater than the sound pressure threshold, the hearing loss test result of the reversal point is cleared, and the test is continued. After 5 reversals, the average of the last 3 reversal points is taken as the hearing loss test result for the current frequency.

[0117] In some embodiments of the present application, G4 obtains the hearing loss test result according to the frequency test result of the first inversion point, including:

[0118] H1. When the number of times the frequency test result reaches an extreme value exceeds the number threshold, and / or the number of first test signals sent at the first frequency exceeds the number threshold, the hearing loss test result is determined based on the frequency test result of the first reversal point.

[0119] Among them, the terminal can also set the frequency test end condition. Taking the test of the first frequency point as an example, the terminal obtains the frequency test result of the first reversal point, and then the terminal determines whether the frequency test result meets the preset frequency test end condition. The frequency test end condition includes that the number of times the frequency test result reaches the extreme value exceeds the number threshold, and / or the number of first test signals sent at the first frequency point exceeds the number threshold. When the frequency test result meets the preset frequency test end condition, the terminal stops testing the first frequency point, and determines the hearing loss test result according to the frequency test result of the first reversal point. The efficiency of the hearing loss test can be improved by testing the frequency points.

[0120] An example is given below. To improve test efficiency, when testing a certain frequency point, if the frequency point test result reaches an extreme value (such as the maximum and minimum values) three times in a row, or reaches an extreme value six times in total, the frequency point test is terminated, and the extreme value is taken as the hearing loss test result of the frequency point. When the cumulative number of test rounds for a certain frequency point reaches 30 rounds, the test of the frequency point is terminated, and the average of the frequency point test results of the last three reversal points is taken as the hearing loss test result of the frequency point.

[0121] Further, in some embodiments of the present application, in addition to executing the aforementioned steps, the hearing loss compensation method executed by the terminal further includes:

[0122] I1. When the frequency point test result exceeds the frequency point test average result and reaches a preset threshold, the terminal performs feedback instruction detection at the first frequency point again.

[0123] Among them, the terminal can also obtain the average result of the frequency test. After obtaining the frequency test result corresponding to the first frequency, the terminal compares the frequency test result corresponding to the first frequency with the average result of the frequency test. When the frequency test result exceeds the average result of the frequency test and reaches a preset threshold, the terminal re-performs feedback instruction detection at the first frequency. By judging whether to re-test the first frequency, the accuracy of the hearing loss test can be improved.

[0124] Through the above examples, the terminal can use multiple methods when generating hearing loss test results. For example, the terminal can obtain accurate hearing loss test results according to at least one of the following methods: feedback speed of the hearing aid object, iterative determination of the reversal point, and re-testing of the extreme point. Specifically, at least one of the above methods can be selected according to the application scenario to obtain accurate hearing loss test results.

[0125] 304. The terminal performs real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain.

[0126] Among them, after obtaining the hearing loss test results, the terminal can perform real-time compensation processing on the auxiliary hearing object. Specifically, real-time compensation processing can be performed in the time domain and / or frequency domain to obtain a first compensation gain. By performing real-time compensation processing, the microphone input signal envelope can be extracted from the first compensation gain. The specific compensation method used is not limited here.

[0127] In some embodiments of the present application, the terminal 304 performs real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain, including:

[0128] J1. The terminal obtains a first hearing loss value at a first frequency point in a hearing loss test result.

[0129] Among them, the terminal can perform real-time compensation processing on each frequency point. Taking the first frequency point as an example, the terminal obtains the first hearing loss value at the first frequency point in the hearing loss test result.

[0130] J2. The terminal determines a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to a mapping relationship between the hearing loss value and the correction gain value.

[0131] Among them, the terminal can perform real-time compensation in the time domain to obtain the first correction gain value in the time domain in the hearing loss test result. Alternatively, the terminal can perform real-time compensation in the frequency domain to obtain the first correction gain value in the frequency domain in the hearing loss test result. Alternatively, the terminal can perform real-time compensation in the time domain and the frequency domain respectively, and obtain the first correction gain value in the time domain and the first correction gain value in the frequency domain respectively.

[0132] The mapping relationship between the hearing loss value and the correction gain value refers to the polynomial formula between the hearing loss value and the correction gain value. The polynomial formula between the hearing loss value and the correction gain value can also be called the fitting formula of the hearing loss value and the correction gain value, which is hereinafter referred to as the fitting formula. The terminal can determine the first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain based on the mapping relationship between the hearing loss value and the correction gain value. In the embodiment of the present application, whether the terminal performs real-time compensation in the time domain, or in the frequency domain, or in both the time domain and the frequency domain, is determined in combination with the application scenario.

[0133] J3. The terminal determines the first compensation gain according to the first compensation gain value.

[0134] Among them, after the terminal obtains the first compensation gain value, the first compensation gain is determined according to the first compensation gain value. For example, the terminal executes J1 to J2 multiple times to obtain multiple groups of first compensation gain values, and these multiple groups of first compensation gain values ​​can constitute the first compensation gain. In the embodiment of the present application, real-time compensation can be performed according to the mapping relationship between the hearing loss value and the correction gain value, thereby improving the accuracy of hearing loss compensation.

[0135] Further, in some embodiments of the present application, the terminal 304 performs real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain, and further includes:

[0136] J4. The terminal determines the hearing curve according to the hearing loss test result;

[0137] J5. The terminal determines the mapping relationship between the hearing loss value and the correction gain value according to the classification result corresponding to the hearing curve.

[0138] Among them, the hearing loss test results may include one or more hearing curves. The terminal can obtain the hearing curve, classify the type of hearing curve according to a predetermined hearing curve library, and obtain the classification result corresponding to the hearing curve. According to the classification result, the corresponding mapping relationship between the hearing loss value and the correction gain value is selected, so that the mapping relationship between the hearing loss value and the correction gain value can be used for real-time compensation.

[0139] An example is given below. When the hearing curve is a linear attenuation type, a high-frequency drop type, or a basin type, different coefficients can be set for the mapping relationship between the hearing loss value and the compensation gain value to match the hearing curve corresponding to the hearing aid object. Therefore, the mapping relationship between the corresponding hearing loss value and the compensation gain value can be queried through the hearing curve in the hearing loss test result.

[0140] Further, in some embodiments of the present application, the J2 terminal determines a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to a mapping relationship between the hearing loss value and the correction gain value, including:

[0141] J21. The terminal divides the external input signal collected by the auxiliary listening device into multiple sub-bands according to octaves.

[0142] Among them, the external input signal collected by the assistive listening device through the microphone is a time domain signal, which is converted into a frequency domain signal through Fourier transform, and then the data of different frequency bands are selected according to the octave (i.e., the frequency domain multiplication relationship), thereby obtaining multiple sub-bands. For example, the frequency domain multiplication relationship may specifically include: 125Hz, 250Hz, 500Hz, 1000Hz, 2000Hz, 4000Hz, 8000Hz and other frequency domains.

[0143] In some embodiments of the present application, the J2 terminal determines a first correction gain value corresponding to the first hearing loss value based on a mapping relationship between the hearing loss value and the correction gain value, and also includes: the terminal performs human voice separation on the external input signal collected by the auxiliary listening device to obtain a human voice signal; performs wide dynamic range compression compensation and envelope enhancement on the human voice signal to obtain a compensated and enhanced human voice signal.

[0144] Among them, after obtaining the external input signal, the terminal can also perform auxiliary hearing enhancement, perform artificial intelligence (AI) separation on the external input signal, and perform wide dynamic range compression compensation and envelope enhancement on the extracted voice signal, thereby providing a better voice compensation effect and improving the speech recognition rate.

[0145] Specifically, the J21 terminal divides the external input signal collected by the auxiliary listening device into multiple sub-bands according to the octave, including: the terminal divides the compensated and enhanced human voice signal into multiple sub-bands according to the octave.

[0146] Among them, the human voice signal is subjected to wide dynamic range compression compensation and envelope enhancement to obtain a compensated and enhanced human voice signal, which can be used for subsequent correction gain calculation, providing a better human voice compensation effect and improving the speech recognition rate.

[0147] J22. The terminal obtains speech estimation signals and noise estimation signals corresponding to multiple sub-bands.

[0148] The terminal may estimate speech signals and noise signals of different sub-bands to obtain speech estimation signals and noise estimation signals corresponding to multiple sub-bands.

[0149] J23. The terminal performs speech intelligibility index (SII) analysis based on the speech estimation signal and the noise estimation signal to obtain the loudness of the hearing loss.

[0150] The terminal transmits the speech estimation signal and the noise estimation signal to the SII analysis module included in the terminal for intelligibility optimization analysis to obtain the loudness of the speech signal and the noise signal, which is also called the loudness of hearing loss.

[0151] J24. The terminal determines a first frequency domain compensation gain of the first hearing loss value in the frequency domain according to a mapping relationship between the hearing loss value and the correction gain value.

[0152] Among them, the terminal can perform real-time compensation in the frequency domain, obtain a first hearing loss value in the frequency domain in the hearing loss test result, and then determine a first frequency domain compensation gain of the first hearing loss value in the frequency domain according to a mapping relationship between the hearing loss value and the correction gain value.

[0153] J25. The terminal iteratively optimizes the first frequency domain compensation gain according to the speech estimation signals and noise estimation signals corresponding to multiple subbands and the loudness of the hearing loss to obtain a second frequency domain compensation gain that maximizes intelligibility within a preset loudness, and the second frequency domain compensation gain belongs to the first correction gain value.

[0154] Among them, the terminal can obtain the energy of the speech estimation signal and the energy of the noise estimation signal corresponding to multiple subbands, and iteratively optimize the first frequency domain compensation gain according to the energy of the speech estimation signal and the noise estimation signal of different subbands and the hearing loss loudness, and obtain the second frequency domain compensation gain that maximizes the intelligibility within the preset loudness, and determine the first correction gain value through the second frequency domain compensation gain. In the embodiment of the present application, the accuracy of hearing loss compensation can be improved through the above-mentioned hearing loss compensation in the frequency domain.

[0155] Further, in some embodiments of the present application, the J2 terminal determines a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to a mapping relationship between the hearing loss value and the correction gain value, including:

[0156] J26. The terminal determines a first time domain compensation gain of the first hearing loss value in the time domain according to a mapping relationship between the hearing loss value and the correction gain value.

[0157] Among them, the terminal can perform real-time compensation in the time domain, obtain the first hearing loss value in the hearing loss test result, and then determine the first time domain compensation gain of the first hearing loss value in the time domain according to the mapping relationship between the hearing loss value and the correction gain value.

[0158] J27. The terminal extracts envelope information of the external input signal collected by the auxiliary listening device.

[0159] The external input signal collected by the auxiliary listening device through the microphone is a time domain signal, and the envelope information of the external input signal is obtained.

[0160] J28. When the average value of the envelope information is greater than a preset envelope threshold, the terminal performs linear attenuation processing on the first time domain compensation gain to obtain a second time domain compensation gain, and the second time domain compensation gain belongs to the first correction gain value.

[0161] Among them, there is no limitation on the value of the envelope threshold, the average value of the envelope information is greater than the envelope threshold, the terminal performs linear attenuation processing on the first time domain compensation gain, obtains the second time domain compensation gain through linear attenuation processing, and determines the first correction gain value through the second time domain compensation gain, so that the envelope of the external input signal is linearly attenuated, thereby improving the accuracy of hearing loss compensation.

[0162] J29. When the average value of the envelope information is less than or equal to the preset envelope threshold, the terminal performs linear enhancement processing on the first time domain compensation gain to obtain a third time domain compensation gain, and the third time domain compensation gain belongs to the first correction gain value.

[0163] Among them, the average value of the envelope information is less than or equal to the envelope threshold, the terminal performs linear enhancement processing on the first time domain compensation gain, obtains the third time domain compensation gain through linear enhancement processing, and determines the first correction gain value through the third time domain compensation gain, so that the envelope of the external input signal is linearly enhanced, thereby improving the accuracy of hearing loss compensation.

[0164] Among them, there is no order of precedence between J21 to J25 and J26 to J29.

[0165] Through the above examples, the terminal can adopt multiple methods when generating the first correction gain value. For example, the terminal can obtain an accurate first compensation gain value according to at least one of the following methods: intelligibility analysis to obtain the loudness of hearing loss, and then perform frequency domain compensation based on the loudness of hearing loss; real-time envelope time domain enhancement. Specifically, at least one of the above methods can be selected in combination with the application scenario to obtain an accurate first correction gain value, thereby better improving the fitting effect and enhancing the speech recognition rate.

[0166] 305. The terminal performs speech correction on the first compensation gain according to a preset language test signal to obtain a hearing loss compensation gain.

[0167] Among them, after determining the first compensation gain, the terminal can send a preset language test signal to the auxiliary listening device, and perform speech correction on the first compensation gain through the language test signal, so as to obtain the hearing loss compensation gain. Through the above-mentioned speech correction, the speech recognition rate can be improved.

[0168] In some embodiments of the present application, the terminal 305 performs speech correction on the first compensation gain according to a preset language test signal to obtain a hearing loss compensation gain, including:

[0169] K1. The terminal generates a language test signal in a frequency band manner according to the center of gravity of the audio spectrum, wherein the language test signal includes: a test word corresponding to a plurality of frequency points at different centers of gravity of the audio spectrum;

[0170] K2. The terminal sends a language test signal to the auxiliary listening device;

[0171] K3. The terminal performs speech correction on the first compensation gain according to the language test signal and the third feedback instruction to obtain a hearing loss compensation gain. The third feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the third test signal.

[0172] Among them, the terminal generates a language test signal in a manner of dividing the frequency bands according to the centroid of the audio spectrum, for example, dividing the frequency bands according to the centroid of the initial consonant spectrum, and selecting a test word from the test words of multiple frequency points for each audio spectrum centroid to form a language test signal. The method of selecting test words will be referred to as "multiple choice". Multiple choice means that during speech correction, multiple easily confused words will appear on the UI of the terminal, for example, four easily confused words will appear, and then the audio of one of the words will be played, and the user will click to select the word to hear.

[0173] After the auxiliary listening device receives the language test signal, the auxiliary listening device plays the language test signal to the auxiliary listening object. If the auxiliary listening object hears the audio content of the language test signal, the auxiliary listening object can send a third feedback instruction to the terminal, for example, the auxiliary listening object clicks a feedback button on the UI, so that the terminal detects the third feedback instruction. The terminal performs speech correction on the first compensation gain according to the language test signal and the third feedback instruction to obtain the hearing loss compensation gain. The language test signal is generated by the above-mentioned multiple-choice method, and the language test signal is used for speech correction, which can improve the accuracy of hearing loss compensation.

[0174] In some embodiments of the present application, the terminal 305 performs speech correction on the first compensation gain according to a preset language test signal, including:

[0175] K4. The terminal obtains a language test signal from a preset corpus, the corpus comprising: a plurality of groups of language test signals, wherein each group of language test signals comprises: initial consonant single word groups that are divided into the same group according to different octaves based on the center of gravity of the audio spectrum, wherein an initial consonant single word group comprises: randomly selected more than or equal to 2 easily confused words.

[0176] Among them, the terminal obtains a corpus, and the corpus provided in the embodiment of the present application may include multiple groups of language test signals, and each group of language test signals includes: initial consonant single word groups divided into the same group according to different octaves based on the center of gravity of the audio spectrum, and an initial consonant single word group includes: randomly selected more than or equal to 2 easily confused words, and there is no limit on the number of easily confused words included in an initial consonant single word group.

[0177] K5. The terminal plays two or more easily confused words in the same initial consonant single word group in a random order through an auxiliary listening device.

[0178] The terminal controls the auxiliary listening device to play two or more easily confused words in the same initial consonant single word group in the language test signal in a random order, and the auxiliary listening subject can send feedback instructions to the terminal when listening to the easily confused words randomly played by the auxiliary listening device.

[0179] An example is as follows: the terminal can obtain a corpus in advance. The corpus consists of initial consonants and single words, and is divided into 15 groups of language test signals according to the octave according to the spectral center of gravity. The 15 groups are played randomly, and 4 test words are randomly selected from each group. The 4 test words are played in random order to solve the problem of the effectiveness of repeated use of the corpus. At the same time, 5 groups of feedback are set. Through the feedback form of choosing one from two, the differentiated needs of different users for volume, timbre balance, noise reduction, etc. are solved.

[0180] K6, the terminal detects a fourth feedback instruction sent by the auxiliary listening object;

[0181] K7. The terminal obtains a consistent error frequency band of the auxiliary listening object according to the fourth feedback instruction and the language test signal.

[0182] When the terminal detects the fourth feedback instruction, it obtains a consistency error frequency band according to the language test signal and the fourth feedback instruction. The consistency error frequency band refers to a frequency band where a consistency error occurs, which is determined by the terminal according to the speech recognition rate.

[0183] K8. The terminal adjusts the first compensation gain according to the consistency error frequency band.

[0184] Among them, the terminal adjusts the first compensation gain according to the consistent error frequency band to obtain the hearing loss compensation gain. The above-mentioned random extraction of each group of words and random order playback can solve the problem of the effectiveness of corpus reuse. The consistent error frequency band can be determined through the fourth feedback instruction, which solves the differentiated needs of different users for volume, timbre balance, noise reduction, etc. Generating a language test signal and using the language test signal for speech correction can improve the accuracy of hearing loss compensation.

[0185] Among them, there is no order of precedence between K1 to K3 and K4 to K8.

[0186] 306. The terminal device sends a hearing loss compensation gain to an assistive listening device, wherein the assistive listening device is configured to perform hearing loss compensation on the first voice signal according to the hearing loss compensation gain to obtain a second voice signal.

[0187] After acquiring the hearing loss compensation gain, the terminal sends the hearing loss compensation gain through a communication connection with the auxiliary hearing device, and the auxiliary hearing device receives and stores the hearing loss compensation gain.

[0188] Specifically, 306 the terminal device sends the hearing loss compensation gain to the assistive listening device, including:

[0189] The terminal performs hearing loss compensation on the first voice signal to be transmitted according to the hearing loss compensation gain to obtain a second voice signal, and sends the second voice signal to the auxiliary listening device.

[0190] Among them, the terminal can perform hearing loss compensation on the first voice signal, and then the auxiliary listening device sends a second voice signal obtained after the hearing loss compensation, so that the auxiliary listening device receives the second voice signal obtained after the hearing loss compensation. The auxiliary listening device only needs to play the second voice signal, which can simplify the processing flow of the auxiliary listening device.

[0191] In some embodiments of the present application, in addition to executing the aforementioned steps, the hearing loss compensation method executed by the terminal further includes:

[0192] L1. The terminal detects a fifth feedback instruction sent by the auxiliary listening object when the auxiliary listening device plays the second voice signal.

[0193] L2. The terminal determines a listening parameter of the auxiliary listening object according to the fifth feedback instruction, where the listening parameter includes at least one of the following: a listening volume, a noise reduction level, and a frequency band gain.

[0194] Among them, after the auxiliary listening device plays the second voice signal, if the auxiliary listening object hears the audio content of the second voice signal, the auxiliary listening object can send a fifth feedback instruction to the terminal, for example, the auxiliary listening object clicks the feedback button on the UI of the terminal, so that the terminal detects the fifth feedback instruction. The terminal determines the listening parameters of the auxiliary listening object according to the fifth feedback instruction. In addition to the listening volume, the listening parameters also include the degree of noise reduction, the gain of the frequency band, etc. Through the above-mentioned detection of the fourth feedback instruction, the terminal can determine the listening parameters of the auxiliary listening object, and the listening parameters can be used to describe the actual hearing sense of the auxiliary listening object, so as to test the accuracy of hearing loss compensation.

[0195] Further, in some embodiments of the present application, in addition to executing the aforementioned steps, the hearing loss compensation method executed by the terminal further includes:

[0196] M1. The terminal performs pure tone audiometry (PTA) according to the hearing loss compensation gain and the hearing parameters of the assisted hearing object to obtain an audiometry report of the assisted hearing object.

[0197] The terminal performs PTA processing on the assisted hearing object according to the hearing loss compensation gain and the hearing parameters of the assisted hearing object, and outputs a fitting report. The fitting report includes the hearing loss curve of the assisted hearing object, the hearing loss level classification, the speech recognition rate before gain compensation, and the speech recognition rate after gain compensation.

[0198] Through the above examples, the terminal can adopt multiple methods when generating hearing loss compensation gain. For example, the terminal can obtain accurate hearing loss compensation gain according to at least one of the following methods: real-time compensation in time-frequency domain, speech correction and feedback adjustment. Specifically, at least one of the above methods can be selected according to the application scenario to obtain accurate hearing loss compensation gain, so as to better improve the fitting effect and enhance the speech recognition rate.

[0199] Through the description of the hearing loss compensation method executed by the terminal in the aforementioned embodiment, it can be known that the terminal can execute hearing loss audiometry, fitting formula compensation, speech correction algorithm and feedback adjustment, wherein the hearing loss audiometry is placed on the terminal side to obtain the user's hearing loss test results, the fitting formula compensation is placed on the headphone side, and real-time compensation is performed based on the aforementioned hearing loss test results and external signals, and the speech correction and feedback adjustment are placed on the mobile phone side, and the hearing loss compensation gain is personalized and readjusted according to the speech recognition rate and the feedback from the hearing aid object. After the fitting is completed, the terminal can output a hearing report, which contains information such as the hearing loss curve of the hearing aid object and the speech recognition rate after fitting. Through the above process, the embodiment of the present application provides an autonomous fitting solution, and the user does not need to go to the hearing center to find a professional fitter for fitting, and can independently complete the entire fitting process and achieve good hearing aid effects.

[0200] In order to better understand and implement the above-mentioned solutions in the embodiments of the present application, the following examples are given for specific explanation by using corresponding application scenarios.

[0201] The embodiment of the present application provides a hearing loss compensation system, which may include a terminal and an auxiliary listening device. An embodiment of the present application and some possible implementation methods of the present application exist between a mobile phone and a Bluetooth headset, a mobile phone and a wired headset, and a mobile phone and a hearing aid. This application scenario can also exist between tablets, laptops and desktop computers, and Bluetooth headsets, wired headsets and hearing aids. In the following, taking the terminal as a mobile phone and the auxiliary listening device as a headset as an example, the auxiliary listening object is specifically a user who operates the mobile phone and wears the headset.

[0202] The system architecture of the embodiment of the present application is as follows Figure 4 As shown, the main processes involved are as follows: wearing headphones, N1: hearing loss audiometry, N2: fitting formula compensation, N3: speech correction, N4: feedback adjustment, and outputting fitting report.

[0203] The main method flow includes S1 to S8 as shown below, wherein the N1 flow includes S1 to S4, the N2 flow includes S5-S6, the N3 flow includes S7, and the N4 flow includes S8. Next, the following steps S1 to S8 are briefly introduced:

[0204] S1: The user wears the headset and first detects the feedforward (FF) / feedback (FB) signal according to the prompt tone to detect the wearing consistency. If the wearing is good, S2 is executed, otherwise the prompt tone 1 is played to the user;

[0205] S2: After detecting the wearing consistency, detect the ambient noise floor. If the ambient noise floor is less than the noise threshold, execute S3, otherwise play prompt tone 2 to the user;

[0206] S3: Play a pure tone test signal to the user, detect the user's click speed, and use the click speed for subsequent hearing loss compensation. The click speed can also be called feedback speed;

[0207] S4: Generate a test signal according to the user's click speed and initial volume, and play it to the user. When the user hears the test signal, he clicks a feedback button on the UI of the terminal. After the test is completed, the audiometry result is generated, which includes the hearing curves of the left and right ears.

[0208] S5: classifying the hearing curve according to the audiometry result, and generating a first compensation gain according to the classification result and the corresponding fitting formula, where the first compensation gain may include a frequency domain compensation gain and a time domain compensation gain;

[0209] S6: Sending the frequency domain compensation gain and the time domain compensation gain to the WDRC module and the envelope modulation module included in the DSP of the headset, the WDRC module and the envelope modulation module can be used to amplify the uplink and downlink audio signals according to the frequency domain compensation gain and the time domain compensation gain;

[0210] S7: Playing a pre-made language test signal to the user, detecting the test result fed back by the user, and performing speech correction on the first compensation gain according to the test result to obtain a second compensation gain;

[0211] S8: Play specific sentences to the user and make feedback adjustments based on the user's feedback. Feedback adjustment can also be called feedback testing, to obtain hearing loss compensation gain and determine the user's optimal listening volume and other conditions.

[0212] Finally, the fitting report for the user is output.

[0213] like Figure 5 As shown, it is a UI function diagram of an embodiment of the present application, which may include: hearing detection, hearing aid compensation, speech correction, feedback test and historical test report modules, and users can choose to enter the corresponding module as needed. In addition, the function diagram also provides a selection of application scenarios, and users can select media, call, transparent transmission and other scenarios as needed. For example, users can select audiometry, compensation, speech correction, feedback test and other modules and application modes in the interface. After clicking on different modules, the corresponding test process will be entered. In the audiometry module, the system will play the signal, and the user can click the "Hear" button after hearing the sound; in the compensation module, compensation is performed according to the hearing curve obtained in the audiometry module to obtain the first compensation gain. Specifically, you can choose to compensate for the high frequency, medium frequency, and low frequency, and adjust the left and right ear balance, noise reduction, beam strength, and overall volume adjustment through the roller. In addition, the user can also choose traffic, social, music and other scenes in the full-scene listening. The user can choose different frequency band gains, noise reduction, beams, and different environments by themselves to obtain a better gain compensation effect; in the speech correction module, the user clicks on the words he hears, for example, four alternative words can be provided for the user to choose. The speech correction module will automatically adjust the gain according to the user's speech recognition rate, and can provide the user with the sound is too loud, the sound is normal, and the sound is too soft to choose; in the feedback test module, personalized gain adjustment is made according to the user's choice.

[0214] See also Figure 6 As shown, an overall fitting process is provided, and the user can operate the terminal to perform self-fitting. The specific steps are described as follows:

[0215] N1: Obtain the user's accurate hearing curve, which may include S1 to S4.

[0216] S1: The user wears the headset and first detects the sound signal collected by the microphone according to the prompt tone, such as the FF / FB signal, to detect the wearing consistency. If the wearing is good, S2 is executed, otherwise the prompt tone 1 is played to the user;

[0217] S2: After detecting the wearing consistency, detect the ambient noise floor. If the ambient noise floor is less than the noise threshold, execute S3. Otherwise, play prompt tone 2 to the user.

[0218] S3: Play a pure tone test signal to the user, detect the user's reaction speed, and input the click speed into the S4 audiometry algorithm;

[0219] S4: Generate an audiometric test signal according to the user's response speed and initial volume, and play it to the user. When the user hears the test signal, he clicks a feedback button. After the test is completed, an audiometric result is generated, which includes audiometric curves for the left and right ears.

[0220] S5: Classifying the hearing curve according to the audiometry results, and generating corresponding compensation gains according to the classification results and the corresponding fitting formula, wherein the compensation gains include frequency domain compensation gains and time domain compensation gains;

[0221] S6: Send the frequency domain compensation gain and the time domain compensation gain to the WDRC module and the envelope modulation module included in the DSP of the headset, and amplify the uplink and downlink audio signals;

[0222] S7: Play a pre-made language test signal to the user in a multiple-choice mode. The initial consonants of the language test signal are generated in frequency bands according to the center of gravity of the spectrum, and the compensation gain is fine-tuned according to the test results. Multiple-choice means that during speech correction, four easily confused words will appear on the screen of the terminal, and then the audio of one of the words will be played, and the user will click to select the word to be heard.

[0223] S8: Play specific sentences to the user and fine-tune the gain based on user feedback to determine the user's optimal listening volume and other conditions.

[0224] S9: Finally, the user is tested for PTA frequency points and a fitting report is output, which includes the user's hearing loss curve, hearing loss level classification, speech recognition rate before gain compensation, and speech recognition rate after gain compensation.

[0225] like Figure 7 As shown, the audiometry process involved in the above S1-S4 is described below, and the detailed process includes:

[0226] S11: The user wears the headset, and the user is prompted to check the wearing method and status.

[0227] like Figure 8aAs shown, start to guide the user to perform audiometric configuration. The user can be provided with headphones to wear and ensure that the headphones are not loose.

[0228] S12: The FF / FB signal is collected through the microphone (MIC) to detect whether the user is wearing the headset properly. If the user is not wearing the headset properly, a prompt tone 1 is used to prompt the user to put the headset on again.

[0229] S13: Detect whether the ambient noise level is less than a threshold. If it is greater than the threshold, send a prompt tone 2 to prompt the user to find a good environment before conducting a hearing test.

[0230] S14: Start audiometry guidance, play audiometry practice signals, and click a button if the signal is heard, so that the user can become familiar with the audiometry operation.

[0231] like Figure 8b As shown, the user is guided to perform the test.

[0232] S15: Play the signal, and the user adjusts the volume value that can be clearly heard according to hearing as the initial volume of the audiometry.

[0233] S16: Play the click speed test audio, record the time from the start of playing the signal to the user clicking and hearing it, and obtain the user's average reaction speed.

[0234] like Figure 8c As shown, the user's reaction speed is tested.

[0235] S17: Start audiometry. Generate a test signal of random length within a certain range based on the initial volume and average response speed to prevent user fatigue. The user can choose single-ear or binaural audiometry to test six frequency points in the order of 1000Hz, 2000Hz, 4000Hz, 8000Hz, 500Hz and 250Hz. Among them, 500Hz, 1000Hz, 2000Hz and 4000Hz are the key pure tone audiometry (PTA) frequencies for measuring the user's hearing loss level.

[0236] S18: During the audiometry process, when the user hears a sound, he clicks the button. The button is in single state and the test result is not displayed to prevent user misoperation and psychological suggestion.

[0237] like Figure 8d As shown, the user's hearing is tested. During the test, when you hear a sound, please quickly click "I heard it". The test is expected to take 7 minutes. Do not click if you do not hear a sound.

[0238] S19: Random silent segments will be added during the test. If the user makes continuous mistakes and clicks the button during the silent segment, a prompt tone will be played to the user, and the user will click the button after hearing it.

[0239] S110:

[0240] Reversal point determination: The volume of the first two test signals is increased by 5dB and decreased by 10dB, and the volume of the subsequent test signals is increased by 5dB and decreased by 5dB for rapid iteration to improve the accuracy of audiometry. During the test, the deviation value between adjacent reversal points is recorded. If the value is greater than the threshold, the reversal point record is cleared and the test is continued. After 5 reversals, the average of the frequency test results of the last 3 reversal points is taken as the hearing loss test result of the frequency point.

[0241] Frequency point test end condition: In order to improve test efficiency, when testing a certain frequency point, if the user reaches the extreme value (maximum and minimum value) three times in a row, or reaches the extreme value six times in total, the frequency point test will be ended, and the extreme value will be taken as the hearing loss test result of the frequency point. When the cumulative number of test rounds of a certain frequency point reaches 30 rounds, the frequency point test will be ended, and the average of the frequency point test results of the last three reversal points will be taken as the hearing loss test result of the frequency point.

[0242] S111: After all frequency points are tested, the average value of the results of all frequency points is calculated, and the frequency points that deviate from the average value and are greater than the threshold are retested.

[0243] like Figure 8e As shown, speech correction is performed on the user, and the speech recognition rate under different signal-to-noise ratios is detected, and the hearing aid effect is enhanced through the correction algorithm. Feedback adjustment is performed on the user, and the gain strategy under different background environments is adjusted according to the user feedback to enhance the hearing aid effect.

[0244] S112: Output a test report based on the test results.

[0245] In the above audiometric process, the user's click speed is detected, and a random test signal is generated based on the click speed to prevent user inertial fatigue; the single-state button test method avoids user misoperation and psychological suggestion; random silent segments are added during the test to detect the accuracy of user clicks; the iterative determination of reversal points and retesting of extreme points reduce random errors and improve accuracy.

[0246] The user is made familiar with the test through a guided process, and test signals and silent segments of random length are used to prevent user fatigue and misoperation. The reversal point clearing mechanism, frequency retest mechanism and frequency end condition are used to improve audiometry accuracy and efficiency.

[0247] like Fig. 9As shown in the figure, it is the functional UI of the compensation process. First, the user is instructed to wear headphones through pictures and the wearing status is prompted. Then the audiometry guidance process is entered. The user is familiar with the operation through simulated audiometry exercises. More accurate data can be obtained during normal testing. Then, the reaction speed test and volume adjustment are performed to obtain the user's reaction speed and the most appropriate initial volume. Finally, the audiometry is started. After the audiometry is completed, the user's audiogram data is obtained.

[0248] like Fig. 9 As shown, the compensation process involved in the above S5-S6 is described below, and the detailed process includes:

[0249] S21: inputting the hearing curve, and classifying the hearing curve type according to a predetermined hearing curve library;

[0250] S22: According to the classification result, a corresponding fitting formula is selected to generate a first frequency domain compensation gain;

[0251] S23: The microphone collects an external input signal and divides it into multiple sub-bands according to the octave;

[0252] S24: Estimate the speech signals and noise signals of different sub-bands, and transmit the relevant information to the intelligibility optimization module such as speech intelligibility index (SII);

[0253] S25: estimating the loudness under the hearing loss, and transmitting the loudness value to the intelligibility optimization module;

[0254] S26: iteratively optimizing the first frequency domain compensation gain according to the energy of different sub-band speech noise signals and the loudness of hearing loss, obtaining the second frequency domain compensation gain that maximizes the intelligibility within the appropriate loudness, sending it to WDRC for processing, and outputting the converted time domain signal;

[0255] S27: generating an initial first time domain compensation gain according to the hearing curve, and extracting an envelope of a microphone input signal;

[0256] S28: Determine whether the average value of the envelope is greater than a threshold; for example, the average values ​​of several points in the envelope are detected, and when the average value is greater than the threshold, gain linear attenuation takes effect.

[0257] S29: If the envelope is greater than the threshold, the larger the envelope, the more linearly the gain decays, the maximum gain is 1, and the envelope gain is output;

[0258] S210: If the envelope is less than the threshold, the smaller the envelope is, the more linearly the gain increases, the minimum gain is 1, and the envelope gain is output;

[0259] S211: Processing the time domain signal envelope according to the envelope gain.

[0260] In the above compensation process, the frequency domain compensation and time domain compensation methods are combined. In the frequency domain compensation, a dynamic compensation method based on the environmental signal is introduced. In the time domain compensation, envelope enhancement is used to enhance the envelope of small signals and clear sound signals to achieve the best enhancement effect.

[0261] Specifically, in terms of frequency domain compensation, the environmental signal-to-noise ratio is estimated in real time, and real-time gain adjustment is performed through loudness and SII to achieve the best fitting effect of intelligibility and loudness.

[0262] In terms of time domain compensation, the signal envelope is extracted in real time, and the envelope gain is generated by comparing the envelope amplitude with the threshold and applied to the signal. Small signals such as initial sounds and unvoiced sounds are additionally amplified to further improve speech intelligibility.

[0263] Through the joint frequency domain compensation of intelligibility and loudness, as well as the real-time envelope time domain enhancement, the fitting effect can be better improved and the speech recognition rate can be enhanced.

[0264] like Fig.10 As shown, the speech correction and feedback adjustment process involved in the above S7-S8 is described below. The detailed process includes:

[0265] S31. Language test.

[0266] S32, there are 15 groups of words in total, divided by octaves, 3 groups per octave.

[0267] S33, play 15 groups randomly each time.

[0268] S34, randomly select 4 corresponding words from the group each time.

[0269] Each group is designed to contain 12 to 20 similar words.

[0270] S35, the 4 words are played in random order.

[0271] S36. Select corresponding words according to what you hear.

[0272] In the speech correction process, a corpus is provided. The corpus consists of initial consonants and words, which are divided into 15 groups according to the spectral center of gravity and the octaves. The 15 groups are played in random order. Each group is designed with 12-20 similar words. Four words are randomly selected from each group. The four words are played in random order to solve the problem of the effectiveness of repeated use of the corpus.

[0273] S37. Count the frequency band of user consistency errors.

[0274] S38, enhance the corresponding frequency band by 3 to 6dB.

[0275] Update the corresponding frequency band gain.

[0276] Specifically, 5 groups of feedback can be set to count the user's consistent error frequency bands, and the corresponding frequency bands can be increased by 3-6dB based on the consistent error frequency bands, so that WDRC updates the corresponding frequency band gain. Through the two-choice feedback form, the differentiated needs of different users for volume, tone balance, noise reduction, etc. are solved.

[0277] As an example, the gain condition strategy that the terminal can adopt may specifically include: the terminal determines whether the speech sound volume is appropriate. When the speech sound is too loud, the gain is reduced by 4dB for the 1000…2000Hz frequency point. When the speech sound is too soft, the gain is increased by 4dB for the 1000…2000Hz frequency point, or the gain is increased by 2dB for the 1000…2000Hz frequency point. When the speech sound is normal, the original gain is kept unchanged and no adjustment is made.

[0278] S39. Feedback test.

[0279] S310. Save the configuration.

[0280] By randomly selecting corpora from the corpus, the problem of the effectiveness of corpus reuse is solved, and the compensation gain is fine-tuned according to the user's speech recognition rate results. In the feedback adjustment process, the compensation gain is adjusted individually based on the user's feedback on the sentence in multiple dimensions such as noise and overall volume.

[0281] In the speech correction module, several words will appear randomly on the terminal interface, and the audio of one of the words will be played. The user will select the audio to be heard, and the test will be repeated multiple times. When the test is completed, the module will calculate the gain that the user needs to fine-tune in different frequency bands based on the speech recognition rate and apply it. In the feedback adjustment module, the terminal will play a specific sentence, and the user will select it based on the actual hearing experience. Based on the user's selection results, the module will perform personalized adjustments such as noise reduction, overall loudness, and gain.

[0282] The above fitting process executed by the terminal guides the user to independently complete a series of fitting steps such as accurate audiometry, real-time compensation in the time and frequency domains, speech correction and feedback adjustment, and ensures high-quality personalized fitting results.

[0283] The embodiments of the present application have the following advantages. In terms of audiometry, the embodiments of the present application detect the user's click speed and generate a random test signal within a certain range based on the user's click speed to prevent user inertial fatigue. At the same time, the single-state button avoids user misoperation and psychological suggestion. A random silent segment is added during the test to detect the accuracy of the user's click. The reversal point is iteratively determined and the extreme point is re-tested, which reduces random errors and improves accuracy.

[0284] In addition, the fitting formula of the embodiment of the present application combines the frequency domain compensation and time domain compensation methods. In the frequency domain compensation, a dynamic compensation method based on the environmental signal is introduced. In the time domain compensation, envelope enhancement is used to enhance the envelope of small signals and unvoiced signals to achieve the best enhancement effect. In terms of speech correction, a corpus is designed. The corpus consists of initial consonants and words, and is divided into 15 groups according to the octave according to the spectral center of gravity. The 15 groups are played randomly, and 4 words are randomly selected from each group. The 4 words are played in random order to solve the problem of the effectiveness of repeated use of the corpus. At the same time, 5 groups of feedback are set, and the differentiated needs of different users for volume, timbre balance, noise reduction, etc. are solved through A / B feedback.

[0285] like Fig.11 As shown, in another embodiment provided by the present application, compared with the aforementioned Figure 6 As shown, the terminal adopts the auxiliary listening enhancement mode, performs artificial intelligence (AI) separation on the headphone microphone pickup signal, performs WDRC compensation and envelope enhancement on the extracted human voice, which can provide a better human voice compensation effect and improve the speech recognition rate.

[0286] like Fig.11 As shown, the main process steps are described as follows:

[0287] S1: The user wears the headset and first detects the FF / FB signal based on the prompt tone to check the wearing consistency. If the headset is well worn, S2 is executed. Otherwise, prompt tone 1 is played to the user.

[0288] S2: After detecting the wearing consistency, the ambient noise level is detected. If the ambient noise level is less than a certain value, S3 is executed. Otherwise, prompt tone 2 is played to the user.

[0289] S3: Play a pure tone test signal to the user, detect the user's click speed, and send the click speed to the audiometry algorithm;

[0290] S4: Generate an audiometric test signal according to the user's click speed and initial volume, and play it to the user. When the user hears the test signal, he clicks a feedback button. After the test is completed, the left and right ear audiometric curves are generated.

[0291] S5: Classify the hearing curves according to the audiometry results, and generate corresponding frequency domain compensation gain and time domain compensation gain according to the classification results and the corresponding fitting formula;

[0292] S6: Send the frequency domain compensation gain and time domain compensation gain to the headset DSP WDRC and envelope modulation module, and amplify the uplink and downlink signals;

[0293] S7: Play a pre-made language test signal to the user, and fine-tune the compensation gain according to the test result;

[0294] S8: Play a specific sentence to the user and determine the user's optimal listening volume and other conditions based on the user's feedback;

[0295] S9: Finally, perform PTA frequency audiometry on the user and output a fitting report;

[0296] S10: Through AI separation, it separates the human voice in the environment and sends it to S6 for amplification and enhancement.

[0297] By introducing AI technology, the human voice can be separated from the signal picked up by the mobile phone microphone, and WDRC frequency domain compensation and time domain envelope enhancement can be performed on the human voice signal separately. This can further improve the clarity of the human voice and the signal-to-noise ratio, thereby improving the speech recognition rate and achieving better fitting results.

[0298] The embodiment of the present application provides a full-process autonomous fitting process, which can maximize the approach to the manual fitting effect through precise audiometry, time-frequency domain compensation, and compensated speech correction and feedback adjustment.

[0299] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence, because according to the present application, some steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modes involved are not necessarily required by the present application.

[0300] In order to better implement the above-mentioned solution of the embodiment of the present application, relevant devices for implementing the above-mentioned solution are also provided below.

[0301] See also Fig.12 As shown, an embodiment of the present application provides a terminal 1200, wherein a communication connection is established between the terminal and an auxiliary hearing device to be fitted, and the terminal includes: a testing module 1201, a compensation module 1202, and a sending module 1203, wherein:

[0302] A test module is used to perform a hearing loss test on the hearing-assisted object to obtain a hearing loss test result;

[0303] A compensation module, used for performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain;

[0304] The sending module is configured to send the hearing loss compensation gain to the auxiliary listening device, wherein the auxiliary listening device is configured to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

[0305] It should be noted that the information interaction, execution process, etc. between the modules / units of the above-mentioned device are based on the same concept as the method embodiment of the present application, and the technical effects they bring are the same as those of the method embodiment of the present application. For specific contents, please refer to the description in the method embodiment shown above in the present application, and will not be repeated here.

[0306] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a program, and the program executes some or all of the steps recorded in the above method embodiment.

[0307] Next, another terminal provided by the embodiment of the present application is introduced. Fig.13 As shown, the terminal 1300 includes:

[0308] Receiver 1301, transmitter 1302, processor 1303 and memory 1304 (wherein the number of processor 1303 in terminal 1300 may be one or more, Fig.13 In some embodiments of the present application, the receiver 1301, the transmitter 1302, the processor 1303 and the memory 1304 may be connected via a bus or other means, wherein: Fig.13 The example of connecting through bus is taken in the following.

[0309] The memory 1304 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1303. A portion of the memory 1304 may also include a non-volatile random access memory (NVRAM). The memory 1304 stores an operating system and operating instructions, executable modules or data structures, or a subset thereof, or an extended set thereof, wherein the operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic services and processing hardware-based tasks.

[0310] The processor 1303 controls the operation of the terminal, and the processor 1303 may also be referred to as a central processing unit (CPU). In a specific application, the various components of the terminal are coupled together through a bus system, wherein the bus system may include a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, various buses are referred to as bus systems in the figure.

[0311] The method disclosed in the above embodiment of the present application can be applied to the processor 1303, or implemented by the processor 1303. The processor 1303 can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 1303. The above processor 1303 can be a general processor, a digital signal processor (digital signal processing, DSP), an application specific integrated circuit (application specific integrated circuit, ASIC), a field programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software modules in the decoding processor can be executed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 1304, and the processor 1303 reads the information in the memory 1304 and completes the steps of the above method in combination with its hardware.

[0312] The receiver 1301 may be used to receive input digital or character information, and generate signal input related to the relevant settings and function control of the terminal. The transmitter 1302 may include a display device such as a display screen, and the transmitter 1302 may be used to output digital or character information through an external interface.

[0313] In the embodiment of the present application, the processor 1303 is used to execute the above Figure 2 or Figure 3 The hearing loss compensation method shown in .

[0314] In another possible design, when the terminal is a chip in a device, the chip includes: a processing unit and a communication unit, the processing unit may be, for example, a processor, and the communication unit may be, for example, an input / output interface, a pin or a circuit, etc. The processing unit may execute computer-executable instructions stored in the storage unit so that the chip in the terminal executes any one of the methods of the first aspect above. In some embodiments of the present application, the storage unit is a storage unit in the chip, such as a register, a cache, etc. The storage unit may also be a storage unit in the terminal located outside the chip, such as a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), etc.

[0315] The processor mentioned in any of the above places may be a general-purpose central processing unit, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the above-mentioned first aspect method.

[0316] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. In addition, in the device embodiment drawings provided in the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0317] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including application-specific integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented with corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0318] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0319] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

Claims

1. A hearing loss compensation method based on an assistive listening device, characterized in that: The method is executed by a terminal, and a communication connection is established between the terminal and the auxiliary hearing device to be fitted. The method includes: Conducting hearing loss tests on the hearing-assisted subjects to obtain hearing loss test results; Performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain; The hearing loss compensation gain is sent to the auxiliary listening device, wherein the auxiliary listening device is used to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

2. The method according to claim 1, characterized in that The performing of a hearing loss test on the hearing-assisted subject to obtain a hearing loss test result includes: Performing a hearing test on the assisted listening subject to obtain a feedback speed of the assisted listening subject; generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the auxiliary listening device; A hearing loss test result is obtained according to the first test signal and a first feedback instruction, wherein the first feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the first test signal.

3. The method according to claim 2, characterized in that The performing hearing test on the assisted hearing object to obtain the feedback speed of the assisted hearing object includes: Sending a second test signal to the auxiliary listening device; The feedback speed is acquired according to the second test signal and a second feedback instruction, where the second feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the second test signal.

4. The method according to claim 2 or 3, characterized in that: The step of generating a first test signal according to the feedback speed and a preset first volume includes: The first test signal of random length is generated according to the feedback speed and a preset first volume, wherein the first test signal includes: a test signal of multiple frequency points for measuring the hearing loss level of the hearing aid object.

5. The method according to any one of claims 2 to 4, characterized in that The first test signal includes: a random mute signal; The method further comprises: When the auxiliary listening device plays the random mute signal, detecting an erroneous operation feedback instruction sent by the auxiliary listening object; Sending a wrong operation prompt signal to the auxiliary listening device according to the wrong operation feedback instruction.

6. The method according to any one of claims 2 to 5, characterized in that The generating a first test signal according to the feedback speed and a preset first volume, and sending the first test signal to the auxiliary listening device includes: generating a plurality of first test signals corresponding to a first frequency point according to the feedback speed, a preset first volume, and a preset volume rise and fall difference, and sending the plurality of first test signals to the auxiliary listening device, wherein the volume of one first test signal among the plurality of first test signals is the first volume, and the volumes of other first test signals among the plurality of first test signals except the one first test signal are determined according to the first volume and the volume rise and fall difference; The obtaining of the hearing loss test result according to the first test signal and the first feedback instruction includes: Determine a first reversal point according to a plurality of first feedback instructions corresponding to the plurality of first test signals, the first reversal point comprising: a time point when two adjacent first feedback instructions in the plurality of first feedback instructions indicate different listening results; Acquire a second inversion point adjacent to the first inversion point; When the deviation value between the first inversion point and the second inversion point is greater than a preset sound pressure threshold, clearing the frequency point test result corresponding to the first inversion point; When the deviation value between the first inversion point and the second inversion point is less than or equal to a preset sound pressure threshold, the hearing loss test result is obtained according to the frequency point test result of the first inversion point.

7. The method according to claim 6, characterized in that The obtaining the hearing loss test result according to the frequency test result of the first inversion point includes: When the number of times the frequency test result reaches an extreme value exceeds a number threshold, and / or the number of first test signals sent at the first frequency exceeds a number threshold, the hearing loss test result is determined according to the frequency test result of the first reversal point.

8. The method according to any one of claims 1 to 7, characterized in that The performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain includes: Performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain; The first compensation gain is speech-corrected according to a preset language test signal to obtain the hearing loss compensation gain.

9. The method according to claim 8, characterized in that The performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain includes: Obtaining a first hearing loss value at a first frequency point in the hearing loss test result; Determining a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain according to a mapping relationship between the hearing loss value and the correction gain value; The first compensation gain is determined according to the first compensation gain value.

10. The method according to claim 9, characterized in that The method further comprises: performing real-time compensation processing in the time domain and / or frequency domain according to the hearing loss test result to obtain a first compensation gain; determining a hearing curve according to the hearing loss test result; The mapping relationship between the hearing loss value and the correction gain value is determined according to the classification result corresponding to the hearing curve.

11. The method according to claim 9 or 10, characterized in that: The determining, according to the mapping relationship between the hearing loss value and the correction gain value, a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain comprises: Dividing the external input signal collected by the auxiliary listening device into a plurality of sub-bands according to octaves; Acquire speech estimation signals and noise estimation signals corresponding to the multiple sub-bands; Performing speech intelligibility index analysis based on the speech estimation signal and the noise estimation signal to obtain the loudness of the hearing loss; Determining a first frequency domain compensation gain of the first hearing loss value in the frequency domain according to a mapping relationship between the hearing loss value and the correction gain value; The first frequency domain compensation gain is iteratively optimized according to the speech estimation signals and the noise estimation signals corresponding to the multiple sub-bands and the loudness of the hearing loss to obtain a second frequency domain compensation gain that maximizes intelligibility within a preset loudness, and the second frequency domain compensation gain belongs to the first correction gain value.

12. The method according to claim 9 or 10, characterized in that: The determining, according to the mapping relationship between the hearing loss value and the correction gain value, a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain comprises: Determining a first time domain compensation gain of the first hearing loss value in the time domain according to a mapping relationship between the hearing loss value and the correction gain value; Extracting envelope information of an external input signal collected by the auxiliary listening device; When the average value of the envelope information is greater than a preset envelope threshold, linear attenuation processing is performed on the first time domain compensation gain to obtain a second time domain compensation gain, where the second time domain compensation gain belongs to the first correction gain value; When the average value of the envelope information is less than or equal to a preset envelope threshold, the first time domain compensation gain is linearly increased to obtain a third time domain compensation gain, and the third time domain compensation gain belongs to the first correction gain value.

13. The method according to any one of claims 8 to 12, characterized in that The performing speech correction on the first compensation gain according to a preset language test signal to obtain the hearing loss compensation gain includes: Generate a language test signal in a frequency band manner according to the centroid of the audio spectrum, the language test signal comprising: test words corresponding to a plurality of frequency points at different centroids of the audio spectrum; sending the language test signal to the auxiliary listening device; The first compensation gain is speech-corrected according to the language test signal and a third feedback instruction to obtain the hearing loss compensation gain, wherein the third feedback instruction includes: a feedback instruction detected by the terminal when the auxiliary listening device plays the third test signal.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: Detecting the ambient noise of the auxiliary listening device, and sending a noise prompt signal to the auxiliary listening device when the ambient noise is greater than or equal to a preset noise threshold; When the environmental noise is less than a preset noise threshold, the following steps are triggered: a hearing loss test is performed on the hearing aid object to obtain a hearing loss test result.

15. The method according to any one of claims 8 to 12, characterized in that The performing speech correction on the first compensation gain according to a preset language test signal comprises: Acquire the language test signal from a preset corpus, the corpus comprising: a plurality of groups of language test signals, wherein each group of language test signals comprises: initial consonant single word groups divided into the same group according to different octaves based on the center of gravity of the audio spectrum, wherein an initial consonant single word group comprises: randomly selected more than or equal to 2 easily confused words; Playing the easily confused words of greater than or equal to 2 in the same initial consonant single word group in a random order through the auxiliary listening device; detecting a fourth feedback instruction sent by the auxiliary listening object; Acquire a consistent error frequency band of the auxiliary hearing object according to the fourth feedback instruction and the language test signal; The first compensation gain is adjusted according to the consistency error frequency band.

16. The method according to claim 11, characterized in that The determining, according to the mapping relationship between the hearing loss value and the correction gain value, a first correction gain value corresponding to the first hearing loss value in the time domain and / or frequency domain further includes: performing human voice separation on the external input signal collected by the auxiliary hearing device to obtain a human voice signal; performing wide dynamic range compression compensation and envelope enhancement on the human voice signal to obtain a compensated and enhanced human voice signal; The dividing the external input signal collected by the auxiliary listening device into a plurality of sub-bands according to the octave includes: dividing the compensated and enhanced human voice signal into a plurality of sub-bands according to the octave.

17. A terminal, characterized in that: The terminal establishes a communication connection with the hearing aid to be fitted, and the terminal includes: A test module is used to perform a hearing loss test on the hearing-assisted object to obtain a hearing loss test result; A compensation module, used for performing hearing loss compensation according to the hearing loss test result to obtain a hearing loss compensation gain; The sending module is used to send the hearing loss compensation gain to the auxiliary listening device, wherein the auxiliary listening device is used to perform hearing loss compensation on the first speech signal according to the hearing loss compensation gain to obtain a second speech signal.

18. A terminal, characterized in that: The terminal comprises: a processor and a memory; the processor and the memory communicate with each other; The memory is used to store instructions; The processor is configured to execute the instructions in the memory to perform the method according to any one of claims 1 to 16.

19. A computer-readable storage medium comprising instructions, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 16.

20. A computer program product comprising instructions, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 16.

Images