Hearing aid capable of suppressing howling, unvarnished transmission earphone and control method

By playing preset audio signals in hearing aids and transmissive headphones and judging the correlation characteristics of audio signals in the ear, the problem of howling when the equipment is not worn correctly or the sound is leaked is solved, effectively suppressing howling and improving User experience and device performance.

CN118984437APending Publication Date: 2024-11-19HENGXUAN TECH (BEIJING) CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411026740.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

Existing hearing aids and transmissive headphones are prone to howling when not worn correctly or when sound is leaked, affecting the user experience.

Method used

By introducing a processing unit into the hearing aid and transmissive headphones, preset audio signals are played and in-ear audio signals are collected using in-ear microphones, correlation characteristics are calculated to judge the sound leakage situation, and if the conditions are met, the hearing aid or transmissive module will be reduced. Amplify the ability to suppress howling.

Benefits of technology

It effectively reduces the impact of howling, improves the experience of the equipment in case of improper wear or sound leakage, and reduces the complexity and power consumption of howling suppression.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118984437A_ABST
    Figure CN118984437A_ABST
Patent Text Reader

Abstract

The invention provides a howling suppression hearing aid, an unvarnished transmission earphone and a control method, the howling suppression hearing aid comprises a processing unit, an in-ear microphone, a loudspeaker and a hearing aid module, and the hearing aid realizes a hearing aid function through the hearing aid module; the processing unit is used for controlling the loudspeaker to play a preset audio signal in response to an instruction for controlling the starting of the hearing aid function; obtaining an in-ear audio signal including a preset audio signal propagated in the ear through the in-ear microphone; judging whether the in-ear audio signal meets a sound leakage condition or not through the preset audio signal; and when it is determined that the in-ear audio signal satisfies the sound leakage condition, reducing the amplification capability of the hearing aid module. According to the hearing aid, the influence of howling can be inhibited, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of audio equipment, and in particular to a hearing aid with howling suppression, a transparent earphone and a control method. Background Art

[0002] Headphone devices (such as transparent headphones, hearing aids, etc.) have the function of helping the wearer to listen to external sounds.

[0003] In a transparent transmission earphone, there are an external microphone, a transparent transmission filter, and a speaker. The sound collected by the external microphone passes through the transparent transmission filter and is output through the speaker. However, the sound of the speaker may leak. For example, if the earphone device is not worn correctly or the earphone device is pressed, the sound will be collected by the external microphone after leakage. When the filtered sound is amplified again through the transparent transmission filter, howling may occur.

[0004] Hearing aids are similar to transparent headphones. The difference is that hearing aids use hearing aid modules to filter the sound collected by the external microphone. There may also be a problem of howling when the filtered sound is amplified again by the hearing aid module.

[0005] Howling affects the user experience and needs to be suppressed. Summary of the invention

[0006] In view of this, the present application aims to provide a howling suppression hearing aid, a transparent earphone and a control method to reduce the howling generated in the earphone device.

[0007] In a first aspect, an embodiment of the present application provides a howling suppression hearing aid, comprising: a processing unit, an in-ear microphone, a speaker, and a hearing aid module, wherein the hearing aid implements a hearing aid function through the hearing aid module; the processing unit is used to: in response to an instruction to control the activation of the hearing aid function, control the speaker to play a preset audio signal; obtain an in-ear audio signal including a preset audio signal after propagation in the ear through the in-ear microphone; determine whether the in-ear audio signal meets a sound leakage condition through the preset audio signal; and when it is determined that the in-ear audio signal meets the sound leakage condition, reduce the amplification capacity of the hearing aid module.

[0008] Howling often occurs when the sound of a speaker leaks out of the ear and is picked up by an external microphone. Therefore, in an embodiment of the present application, a preset audio signal can be played and collected using an in-ear microphone to determine whether the sound has leaked through the collected in-ear audio signal and the preset audio signal. In the event of sound leakage, the amplification capacity of the hearing aid module can be reduced in a timely manner to suppress the impact of howling.

[0009] In one embodiment, the processing unit is specifically used to: calculate the value of the correlation feature between the preset audio signal and the in-ear audio signal; if the value of the correlation feature is less than the first preset threshold, determine that the in-ear audio signal meets the sound leakage condition.

[0010] If the sound of the speaker is not leaked, there is a high correlation between the in-ear audio signal and the preset audio signal. Therefore, in the embodiment of the present application, the value of the correlation feature between the preset audio signal and the in-ear audio signal can be calculated to determine whether the in-ear audio signal is leaked, and then determine whether to perform howling suppression. The calculation of the correlation feature is simple, and this method can reduce the complexity of howling suppression while achieving howling suppression.

[0011] In one embodiment, the correlation feature includes a cross-correlation result in the time domain and / or a cross-correlation result in the frequency domain between the preset audio signal and the in-ear audio signal. The processing unit is specifically used to: perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the time domain to obtain the cross-correlation result in the time domain; and / or perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the frequency domain to obtain the cross-correlation result in the frequency domain.

[0012] Whether the cross-correlation result in the frequency domain or the time domain, it can be used to characterize the correlation. Therefore, in the embodiment of the present application, the preset audio signal and the in-ear audio signal can be cross-correlated in the frequency domain and / or the time domain to obtain a cross-correlation result that characterizes the correlation. In the case where two audio signals have been obtained, it is easy to perform cross-correlation processing on the two audio signals. This method can reduce the power consumption required to determine whether the sound is leaked, thereby reducing the power consumption of howling suppression.

[0013] In one embodiment, if the correlation feature is the cross-correlation result in the time domain, the processing unit is specifically used to: convert the in-ear audio signal and the preset audio signal into vectors; calculate the vector dot product operation result of the in-ear audio signal and the preset audio signal, and the vector dot product operation result is the cross-correlation result of the preset audio signal and the in-ear audio signal in the time domain.

[0014] In an embodiment of the present application, the in-ear audio signal and the preset audio signal are converted into vectors, and the vector dot product operation results of the two are calculated, which can reduce the calculation complexity of the cross-correlation results and further reduce the difficulty of implementing howling suppression and the required power consumption.

[0015] In one embodiment, the processing unit is specifically used to: determine the parameter value of a target parameter of a specified frequency band in the in-ear audio signal that matches the frequency band in which the preset audio signal is located, the target parameter including at least one of power, energy or amplitude; if the parameter value of any one of the target parameters is less than a second preset threshold corresponding to the target parameter, it is determined that the in-ear audio signal meets the sound leakage condition.

[0016] In an embodiment of the present application, if sound leakage occurs, the in-ear microphone cannot accurately collect the preset audio signal, so that the power, energy and amplitude values ​​of the specified frequency band where the preset audio signal is located in the in-ear audio signal are low. Therefore, the parameter value of the target parameter of the specified frequency band in the in-ear audio signal can be determined to determine whether the parameter value is less than the second preset threshold, thereby determining that sound leakage has occurred.

[0017] In one embodiment, the hearing aid also includes an outside-ear microphone; the processing unit is also used to: obtain the outside-ear audio signal collected by the outside-ear microphone and passed through the hearing aid module and the initial signal collected by the inside-ear microphone including the preset audio signal after propagation in the ear; estimate the outside-ear audio signal after passing through the hearing aid module based on a first transfer function to obtain a hearing aid signal; the first transfer function is the transfer function between the speaker and the inside-ear microphone; and subtract the hearing aid signal from the initial signal to obtain the inside-ear audio signal.

[0018] In a hearing aid, when playing audio, the audio signal is transmitted to the speaker for direct playback on the one hand, and on the other hand, when the active noise reduction channel where the in-ear microphone is located is turned on, the audio signal to be played will be offset by the audio component to be played in the active noise reduction channel through the audio echo module, so that the sound collected in the active noise reduction channel where the in-ear microphone is located is not affected by the audio to be played. Therefore, in order to more accurately determine whether sound leakage occurs and whether howling may occur, in an embodiment of the present application, the first transfer function can be used to estimate the audio signal outside the ear to obtain a hearing aid signal, and the initial signal collected in the ear is subtracted from the hearing aid signal, so as to obtain a more accurate and more realistic in-ear audio signal, and the result of determining whether there is sound leakage based on the in-ear audio signal is more accurate, so that howling suppression can be performed more accurately.

[0019] In one embodiment, the hearing aid also includes an outside-ear microphone, which is a microphone of a feedforward hearing aid channel; the processing unit is also used to: obtain an initial signal including the preset audio signal collected by the in-ear microphone, and obtain an outside-ear audio signal collected by the outside-ear microphone; estimate the outside-ear audio signal based on a second transfer function to obtain passive noise in the ear; the second transfer function is a transfer function between the audio signal collected by the microphone of the feedforward hearing aid channel and the audio signal collected by the in-ear microphone when the hearing aid function is turned off; and subtract the passive noise in the ear from the initial signal to obtain the in-ear audio signal.

[0020] In the hearing aid, when the active noise reduction channel where the in-ear microphone is located is turned on, the output of the feedforward hearing aid channel offsets the feedforward hearing aid signal component in the active noise reduction channel where the in-ear microphone is located through the audio echo module, so that the sound collected in the feedback noise reduction path is not affected by the feedforward hearing aid signal. In order to more accurately determine whether sound leakage occurs and whether howling may occur, in an embodiment of the present application, the second transfer function can be used to estimate the external audio signal of the ear to obtain the external noise signal, and the initial signal collected in the ear is subtracted from the external noise signal, so as to obtain a more accurate and more realistic in-ear audio signal, and the result of determining whether there is sound leakage based on the in-ear audio signal is more accurate, so that howling suppression can be performed more accurately.

[0021] In one embodiment, the preset audio signal is an infrasound audio signal or a prompt tone of the hearing aid.

[0022] In the embodiment of the present application, infrasound cannot be heard by humans, and the infrasound audio signal is selected as the preset audio signal, so that the howling suppression can be performed without the user being aware of it. Accordingly, the prompt sound of the hearing aid is selected as the preset audio signal, and the prompt sound has little impact on the user and may even be ignored. Therefore, using the prompt sound as the preset audio signal can reduce the impact of the howling suppression process on the user.

[0023] In a second aspect, an embodiment of the present application provides a transparent transmission headset, comprising: a processing unit, an in-ear microphone, a speaker, and a transparent transmission module, wherein the transparent transmission headset implements a transparent transmission function through the transparent transmission module; the processing unit is used to: in response to an instruction to control the activation of the transparent transmission function, control the speaker to play a preset audio signal; obtain an in-ear audio signal including a preset audio signal after propagation in the ear through the in-ear microphone; determine whether the in-ear audio signal meets a sound leakage condition through the preset audio signal; and when it is determined that the in-ear audio signal meets the sound leakage condition, reduce the amplification capability of the transparent transmission module.

[0024] In a third aspect, an embodiment of the present application provides a howling suppression control method, which is applied to a processing unit of a hearing aid or a transparent transmission earphone, wherein the hearing aid and the transparent transmission earphone also include an in-ear microphone and a speaker, and the hearing aid also includes a hearing aid module, and the transparent transmission earphone also includes a transparent transmission module; the howling suppression control method includes: in response to an instruction to control the activation of the target function, controlling the speaker to play a preset audio signal; the target function is a transparent transmission function based on the transparent transmission module or a hearing aid function based on the hearing aid module; acquiring an in-ear audio signal including a preset audio signal after propagation in the ear through the in-ear microphone; judging whether the in-ear audio signal meets a sound leakage condition through the preset audio signal; and when it is determined that the in-ear audio signal meets the sound leakage condition, reducing the amplification capability of the target module.

[0025] In a fourth aspect, an embodiment of the present application provides a readable storage medium, in which a program is stored. When the program runs on a processing unit, the processing unit executes the control method for howling suppression as described in the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 A schematic diagram of the structure of a hearing aid with howling suppression provided by an embodiment of the present application;

[0028] Figure 2 A schematic diagram of an audio processing structure of a hearing aid provided in one embodiment of the present application;

[0029] Figure 3 A schematic diagram of a first hearing aid module provided in an embodiment of the present application;

[0030] Figure 4 A schematic diagram of a second hearing aid module provided in an embodiment of the present application;

[0031] Figure 5 A schematic diagram of a transparent earphone with howling suppression provided by an embodiment of the present application;

[0032] Figure 6 A flow chart of a howling suppression control method provided in one embodiment of the present application.

[0033] Icon: hearing aid 100; processing unit 110; in-ear microphone 120; speaker 130; hearing aid module 140; outside-ear microphone 150; analog gain unit 151; analog-to-digital converter 152; low-pass and downsampling filter 153; limiter 154; feedback active noise reduction filter 155; digital-to-analog converter 156; transparent transmission earphone 300; transparent transmission module 340. DETAILED DESCRIPTION

[0034] In order to make the purpose, technical solution and advantages of the embodiments of the present application more clear, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application and are not used to limit the present application.

[0035] First, the present application embodiment provides a hearing aid with howling suppression, see Figure 1 , Figure 1 This is a structural diagram of a hearing aid with howling suppression provided by an embodiment of the present application, and the hearing aid 100 includes: a processing unit 110, an in-ear microphone 120, a speaker 130, and a hearing aid module 140. The processing unit can respectively connect the in-ear microphone 120, the speaker 130, and the hearing aid module 140, so as to control the in-ear microphone 120, the speaker 130, and the hearing aid module 140. The earphone of the hearing aid 100 can be an in-ear earphone, a semi-in-ear earphone, a headphone, etc.

[0036] For ease of understanding, the audio processing structure of the hearing aid 100 is described here. The audio processing structure of the hearing aid 100 includes a feedforward hearing aid channel and a feedback active noise reduction channel. Figure 2 , Figure 2Schematic diagram of the audio processing structure of the hearing aid 100. The feedforward hearing aid channel includes an external ear microphone 150, an analog gain unit 151, an analog-to-digital converter 152, a low-pass and down-sampling filter 153, a hearing aid module 140 and a limiter 154 connected in sequence. The audio signal collected by the external ear microphone 150 passes through the external ear microphone 150, the analog gain unit 151, the analog-to-digital converter 152, the low-pass and down-sampling filter 153, the hearing aid module 140 in sequence, and finally outputs to the digital-to-analog converter 156 through the limiter 154, and is converted into an analog signal by the digital-to-analog converter 156 and then output to the speaker 130 for playback. Among them, the microphone of the feedforward hearing aid channel is placed outside the earphone for collecting sounds outside the ear, so it can be called an external ear microphone 150. In other scenarios, it can also be called a feedforward microphone or a feedforward hearing aid microphone. The feedforward microphone can be composed of multiple microphones, and the audio signal collected by the feedforward microphone can be beamformed first, and then passed through the hearing aid module 140 to reduce noise. In other embodiments, the external ear microphone 150 may also be a separately provided microphone, which is not limited here.

[0037] Similarly, the microphone of the feedback active noise reduction channel is placed inside the earphone, close to the ear canal when worn, and is used to collect the sound inside the ear, so it can be called an in-ear microphone 120, which can also be called a feedback microphone or a feedback noise reduction microphone, etc. Among them, the feedback active noise reduction channel of the hearing aid is an optional structure and is not necessary. In some embodiments, the in-ear microphone 120 can also be a separately set microphone, which is not limited to multiplexing the microphone of the feedback active noise reduction channel or not setting the feedback active noise reduction channel.

[0038] Take a hearing aid including a feedback active noise reduction channel as an example, Figure 2 As shown, the feedback active noise reduction channel includes an in-ear microphone 120, an analog gain unit 151, an analog-to-digital converter 152, a low-pass and down-sampling filter 153, a feedback active noise reduction filter 155 and a limiter 154 connected in sequence.

[0039] In addition, the hearing aid 100 also includes an audio echo module. In the hearing aid 100, when playing audio, the audio to be played can be output to the digital-to-analog converter 156 for conversion and played by the speaker 130. On the other hand, when the feedback active noise reduction channel is turned on, the audio signal to be played passes through the audio echo module to offset the audio component to be played in the feedback active noise reduction channel, so that the sound collected in the feedback active noise reduction channel is not affected by the audio to be played. Specifically, the audio signal to be played is added or subtracted from the output of the audio echo module and the low-pass and down-sampling filter 153 module in the feedback active noise reduction channel. After eliminating the influence of the audio to be played on the feedback active noise reduction channel, the remaining environmental noise is sent to the feedback active noise reduction filter 155 and the limiter 154 as the input of the digital-to-analog converter 156.

[0040] In some embodiments, when the feedback active noise reduction channel is turned on, the output of the feedforward hearing aid channel passes through the audio echo module to offset the feedforward hearing aid signal component in the feedback active noise reduction channel, so that the sound collected in the feedback active noise reduction channel is not affected by the feedforward hearing aid signal. In some scenarios, the output of the feedforward hearing aid channel is added to the played audio as input to the audio echo module.

[0041] In some embodiments, limiter 1542 and limiter 1543 are optional.

[0042] In some embodiments, an upsampling and filtering module (not shown in the figure) is provided before the digital-to-analog converter 156. After the aforementioned signals are added, they first pass through an upsampling and filtering module and then serve as the input of the digital-to-analog converter 156.

[0043] The analog gain unit 151, analog-to-digital converter 152, low-pass and down-sampling filter 153 and limiter 154 of the feedback active noise reduction channel and the feedforward hearing aid channel each play the same role, and their structures can be the same or different, which is not limited here, and in some other embodiments, the limiter 154 may not be set.

[0044] In some embodiments, the in-ear microphone 120 and the out-ear microphone 150 may also be digital microphones. In this case, there is no need to set the analog gain unit 151 and the analog-to-digital converter 152.

[0045] In some embodiments, the feedback active noise reduction filter 155 may be an IIR (Infinite Impulse Response) filter structure, or an FIR (Finite Impulse Response) filter structure, or a hybrid filter structure of IIR and FIR.

[0046] In the embodiment of the present application, the hearing aid module 140 is used to filter and amplify the collected audio signal. Figure 3 , Figure 3 A schematic diagram of a first hearing aid module 140 provided in an embodiment of the present application, the hearing aid module 140 may include a low-pass and down-sampling filter 153, an analysis filter, a sub-band gain adjustment unit, a sub-band dynamic range control module, a comprehensive filter group, and an up-sampling and low-pass filter connected in sequence. The hearing aid module includes an analysis filter group, the analysis filter group is used to divide the input audio signal into multiple frequency bands, and the comprehensive filter group synthesizes the audio signals of multiple frequency bands into one audio signal. In some embodiments, a gamma tone filter (a filter) can be used, and multiple groups of crossover filters (a filter) can also be used to implement the analysis filter group and the comprehensive filter group.

[0047] like Figure 3 As shown, in some embodiments, there is a low-pass and down-sampling filter 153 before the analysis filter group, and a corresponding up-sampling and low-pass filter after the synthesis filter group. The low-pass and down-sampling filter 153 and the up-sampling and low-pass filter can adjust the sampling rate, so that each module from the analysis filter group to the synthesis filter group can operate at a lower sampling rate, reducing the amount of calculation of the hearing aid module 140.

[0048] The analysis filter group can decompose the audio signal into multiple sub-bands, and the comprehensive filter group re-synthesizes the audio signal from multiple sub-bands. The sub-band gain adjustment unit can adjust the gain of each sub-band audio signal split by the analysis filter, so as to achieve the effect of reducing the noise of the audio signal. In some cases, the audio signal is subjected to speech noise reduction by adjusting the gain of each sub-band audio signal. The sub-band dynamic range control module is used to control the dynamic range of each sub-band.

[0049] See also Figure 4 , Figure 4 This is a schematic diagram of a second hearing aid module 140 provided in an embodiment of the present application. In this embodiment, the hearing aid module 140 includes a low-pass and down-sampling filter 153, a frequency domain transformation unit, a noise reduction processing unit, a frequency domain inverse transformation unit and an up-sampling and low-pass filter connected in sequence.

[0050] In some embodiments, a low-pass and down-sampling filter 153 is provided before the frequency domain transformation unit, and a corresponding up-sampling and low-pass filter is provided after the frequency domain inverse transformation unit, so that each module between the frequency domain transformation and the frequency domain inverse transformation can operate at a lower sampling rate, thereby reducing the amount of calculation of the hearing aid module 140. The noise reduction processing unit can be obtained by performing different attenuation on each frequency signal based on the signal-to-noise ratio of each frequency after the frequency domain transformation, or it can be other various speech noise reduction algorithms. In some embodiments, each module between the frequency domain transformation and the frequency domain inverse transformation can be completed by the processing unit through a software program, which saves separate hardware resources and makes the processing of the hearing aid 100 more flexible and independent of specific hardware modules.

[0051] The basic structure and functions of the hearing aid 100 can be referred to in the prior art and will not be further elaborated here.

[0052] In the embodiment of the present application, the hearing aid 100 realizes the hearing aid function through the hearing aid module 140. It can be understood that when the user is not wearing headphones, he can normally hear various external sounds, but when the user wears headphones, due to the obstruction of the headphones, it is not easy for the user to easily hear various external sounds, which seriously affects the user's experience when wearing headphones, or the user himself has hearing impairment and has a weak ability to hear external sounds. This requires the hearing aid function of the hearing aid to enable the user to listen to external sounds. Therefore, in the embodiment of the present application, the hearing aid function can be a function that enables the user to better hear various external sounds when wearing headphones. The hearing aid function can enable the headphone wearer to better receive external voices or external environmental noise or various external alarm sounds, etc.

[0053] In addition, the hearing aid function is also used to enable the user to better hear the voices of other users after wearing headphones. Therefore, the hearing aid function will also reduce noise and amplify the collected voice signals / audio signals and output them through the speaker 130. In addition, the hearing aid function can also include beamforming the audio signals collected by multiple external microphones 150 and then outputting them through the speaker 130, so as to better listen to voices from certain directions.

[0054] The audio signal outside the ear is filtered and amplified by the hearing aid module 140 and then played by the speaker 130. This type of audio signal has a large gain in some frequency bands, such as 800Hz-3KHz. If the sound of the speaker 130 leaks out of the earphone, such as improper wearing, pressing the earphone, etc., the sound of the speaker 130 leaks out of the earphone and is collected by the external microphone 150. The hearing aid module 140 will filter and amplify this type of audio signal again, causing the earphone to howl. Howling refers to the earphone emitting a single-frequency or narrow-frequency or multiple single-frequency or narrow-frequency harsh sound, and this sound is generated by the earphone itself.

[0055] In an embodiment of the present application, the processing unit 110 can be configured to: in response to an instruction to control the hearing aid function to be turned on, control the speaker 130 to play a preset audio signal; obtain an in-ear audio signal including the preset audio signal after propagation in the ear through the in-ear microphone 120; determine whether the in-ear audio signal meets the sound leakage condition through the preset audio signal; and when it is determined that the in-ear audio signal meets the sound leakage condition, reduce the amplification capacity of the hearing aid module 140.

[0056] Turning on the hearing aid function means turning on the hearing aid module 140 to filter the external audio signal collected by the external microphone 150. In the embodiment of the present application, the generation of howling is caused by the multiple amplification of the audio signal by the hearing aid module 140. Therefore, when the hearing aid module 140 is required to perform filtering (also referred to as turning on the hearing aid function), it can be determined whether howling is likely to occur. If howling is likely to occur, corresponding measures to suppress howling are taken.

[0057] In an embodiment of the present application, when or before the hearing aid function is turned on, the speaker 130 can be controlled to play a preset audio signal, and the in-ear audio signal including the preset audio signal after propagation in the ear can be collected through the in-ear microphone 120, so as to determine whether sound leakage occurs through the in-ear audio signal, and then determine whether howling is possible.

[0058] Among them, the in-ear audio signal collected by the in-ear microphone 120 includes a preset audio signal, but because the preset audio signal may change, such as attenuation, after propagating in the ear, therefore, in order to distinguish the preset audio signal of the collected in-ear audio signal from the preset audio signal stored in the hearing aid 100, the preset audio signal in the in-ear audio signal can be characterized as the preset audio signal after propagating in the ear.

[0059] In one embodiment of the present application, the preset audio signal may be an infrasonic audio signal, which refers to a low-frequency audio signal below 20 Hz. Low-frequency audio signals below 20 Hz cannot be heard by human ears, so by playing the infrasonic audio signal, it can be determined whether sound leakage and howling suppression are satisfied without the user being aware of it, so that howling suppression does not affect the user.

[0060] In addition, when the preset audio signal is an infrasound audio signal, the detection interval duration of the in-ear microphone 120 collecting the in-ear audio signal including the propagated preset audio signal can be extended to reduce power consumption.

[0061] In other embodiments, the preset audio signal may also be a prompt sound of an earphone device, for example, a prompt sound played by the earphone in the ear, a prompt sound to remind the user to turn on the hearing aid function, such as "ding", "hearing aid turned on", "in ear" and other prompt sounds. The frequency of the preset audio signal of the prompt sound is not limited, but should be within the acceptable range for humans. The preset audio signal of the prompt sound may also be a mixture of multiple single-frequency audio signals. For example, the prompt sound includes a combination of multiple audio signals with frequencies such as 1KHz, 1.5KHz, and 2KHz.

[0062] The prompt tone usually does not bring a bad experience to the user, and usually does not affect the user's normal use. In fact, in most scenarios, the user will ignore the prompt tone. Therefore, using the prompt tone as the preset audio signal for playback will also not affect the user's experience.

[0063] The preset audio signal may also be other audio signals, which are not limited here, and the infrasound audio signal and the prompt tone will not have a significant impact on the actual user experience, and either one may be selected as the preset audio signal.

[0064] If sound leakage occurs in the earphone, the preset audio signal in the in-ear audio signal collected by the in-ear microphone 120 will undergo a significant change. Therefore, in an embodiment of the present application, the preset audio signal can be used to determine whether the in-ear audio signal meets the howling condition and the sound leakage condition.

[0065] In one embodiment, the processing unit 110 is specifically used to: calculate the value of the correlation feature between the preset audio signal and the in-ear audio signal; if the value of the correlation feature is less than a first preset threshold, determine that the in-ear audio signal meets the sound leakage condition.

[0066] In this embodiment, the space in the ear is small. In the absence of sound leakage, when the preset audio signal played by the speaker 130 is collected by the in-ear microphone 120, the preset audio signal changes little. Therefore, the in-ear audio signal and the preset audio signal generally have a high correlation. However, when the sound is leaked, the in-ear microphone 120 may not be able to collect the preset audio signal more accurately and completely, so that the correlation between the in-ear audio signal and the preset audio signal is reduced.

[0067] Therefore, in an embodiment of the present application, the value of the correlation feature between the in-ear audio signal and the preset audio signal can be calculated to determine whether the value of the correlation feature is less than a first preset threshold, thereby determining whether leakage of the in-ear audio signal occurs.

[0068] In one embodiment of the present application, the correlation feature may include a cross-correlation result in the time domain and / or a cross-correlation result in the frequency domain between the preset audio signal and the in-ear audio signal. Accordingly, the processing unit 110 is specifically configured to: perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the time domain to obtain a cross-correlation result in the time domain; and / or perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the frequency domain to obtain a cross-correlation result in the frequency domain.

[0069] The cross-correlation result may be a coherence coefficient. Taking the frequency domain as an example, the coherence coefficient in the frequency domain may be calculated as follows:

[0070]

[0071] Among them, C y1y2 (w) is the frequency domain coherence coefficient, Φ y1y2 (w) is the cross power spectral density of the first audio signal (i.e., the preset audio signal) and the second audio signal (i.e., the in-ear audio signal), Φ y1y1 (w) is the power spectrum density of the first audio signal, Φ y2y2 (w) is the power spectrum density of the second audio signal, and w is the digital angular frequency.

[0072] In other embodiments, other methods may be used to calculate the coherence coefficient, as well as other cross-correlation parameters. The cross-correlation processing method may refer to the prior art and will not be elaborated here.

[0073] When cross-correlation processing is performed in the time domain, the cross-correlation result may be a correlation vector, or may be a partial correlation value selected from the correlation vector as the correlation result of the two.

[0074] In one embodiment, if the correlation feature is a cross-correlation result in the time domain, the processing unit 110 is specifically used to: convert the in-ear audio signal and the preset audio signal into vectors; calculate the vector dot product operation result of the in-ear audio signal and the preset audio signal, wherein the vector dot product operation result is the cross-correlation result of the preset audio signal and the in-ear audio signal in the time domain.

[0075] In other embodiments, the cross-correlation result can also be calculated by normalizing the amplitude or power of the preset audio signal and / or the in-ear audio signal. The correlation characteristics provided above are only examples and should not be a limitation to the present application.

[0076] Similarly, correlation and similarity are similar, therefore, in other embodiments, the processing unit 110 may also be specifically used to: calculate the similarity between the preset audio signal and the in-ear audio signal; if the similarity is less than a third preset threshold, determine that the in-ear audio signal meets the sound leakage condition. When calculating the similarity, the calculation may be performed from the signal of the frequency band in the in-ear audio signal that matches the frequency band in which the preset audio signal is located, wherein matching means that the frequency band range is the same, or slightly larger than the frequency band in which the preset audio signal is located.

[0077] If sound leakage occurs in the earphone, the power, amplitude and energy of the audio signal collected by the in-ear microphone 120 will also change greatly. Therefore, in the embodiment of the present application, the processing unit 110 is specifically used to: determine the parameter value of the target parameter of the specified frequency band in the in-ear audio signal that matches the frequency band of the preset audio signal; if the parameter value of any target parameter is less than the second preset threshold value corresponding to the target parameter, it is determined that the in-ear audio signal meets the howling condition and the sound leakage condition. The target parameter includes at least one of power, energy or amplitude.

[0078] In this embodiment, since the in-ear audio signal includes audio signals of different frequency bands, that is, it includes audio signals other than the preset audio signal, it is possible to extract a specified frequency band that matches the frequency band of the preset audio signal from the in-ear audio signal, and then calculate the parameter value of the target parameter of the specified frequency band. The calculation of power, energy and amplitude can refer to the prior art and will not be expanded here. Among them, matching the frequency band of the preset audio signal means that the intercepted frequency band is the same as the frequency band of the preset audio signal, or slightly larger than the frequency band of the preset audio signal. For example, the intercepted frequency band is ±5Hz, ±10Hz, etc. of the frequency band of the preset audio signal.

[0079] During calculation, any one of power, energy and amplitude can be selected as the target parameter to determine whether the value of the target parameter is less than the second preset threshold corresponding to the target parameter. The second preset threshold can be determined according to the power, energy and amplitude of the preset audio signal. For example, if the power of the preset audio signal is M, the second preset threshold corresponding to the power can be 0.75M, 0.5M, 0.25M, etc. If the energy of the preset audio signal is N, the second preset threshold corresponding to the energy can be 0.75N, 0.5N, 0.25N. Similarly, if the amplitude of the preset audio signal is P, the second preset threshold corresponding to the amplitude can be 0.75F, 0.5F, 0.25F. The above second preset threshold is only an example and should not be a limitation to the present application.

[0080] When playing audio, the audio signal to be played is transmitted to the digital-to-analog converter 156 for playing. On the other hand, when the feedback active noise reduction channel is turned on, the audio signal to be played passes through the audio echo module to offset the audio component to be played in the feedback noise reduction channel, so that the sound collected in the feedback noise reduction channel is not affected by the audio to be played. Therefore, when determining whether sound leakage or howling occurs, the in-ear audio signal used can be a signal minus the influence of the speaker 130.

[0081] Therefore, in one embodiment of the present application, the processing unit 110 is also used to: obtain the initial signal including the extra-ear audio signal collected by the extra-ear microphone 150 and noise-reduced by the hearing aid module 140 and the preset audio signal collected by the intra-ear microphone 120 after propagation in the ear; estimate the extra-ear audio signal based on the first transfer function to obtain a hearing aid signal; and subtract the hearing aid signal from the initial signal to obtain an intra-ear audio signal.

[0082] In this embodiment, the external ear microphone can be the microphone of the feedforward active noise reduction channel or a separately arranged microphone, and the internal ear microphone can be the microphone of the feedback active noise reduction channel or a separately arranged microphone, which is not limited here.

[0083] In this embodiment, the first transfer function is the transfer function between the speaker 130 and the microphone of the feedback active noise reduction channel, or referred to as Sz. The first transfer function can also be the transfer function between the speaker 130 and the in-ear microphone, that is, after the user wears the headphones, the input is the input audio signal of the headphone speaker 130, and the output is the audio signal collected by the in-ear microphone 120. The transfer function / transmission function between the input and output is the first transfer function in the embodiment of the present application. The initial signal is calculated using the first transfer function to obtain a hearing aid signal (which can be recorded as Sig1), and the in-ear audio signal can be obtained by subtracting the hearing aid signal from the initial signal.

[0084] In this embodiment, the signal directly collected by the in-ear microphone 120 is regarded as the initial signal, and the hearing aid signal affected by the speaker 130 is subtracted from the initial signal to obtain the in-ear audio signal. In this way, the influence of the audio signal of the speaker 130 on the in-ear audio signal can be reduced, thereby improving the effectiveness and accuracy of the in-ear audio signal, and further improving the effectiveness and accuracy of the calculated power, amplitude and energy.

[0085] Similarly, when the feedback active noise reduction channel is turned on, the output of the feedforward hearing aid channel is passed through the audio echo module to offset the component of the audio signal collected by the in-ear microphone, so that the sound collected by the in-ear microphone is not affected by the feedforward hearing aid signal. Therefore, when judging whether sound leakage or howling occurs, the in-ear audio signal used can be the signal with the influence of the feedforward hearing aid channel subtracted.

[0086] Therefore, in the embodiment of the present application, the processing unit 110 can also be used to: obtain the initial signal including the preset audio signal collected by the in-ear microphone 120, and obtain the out-of-ear audio signal collected by the out-of-ear microphone 150; estimate the out-of-ear audio signal based on the second transfer function to obtain the in-ear passive noise; subtract the in-ear passive noise from the initial signal to obtain the in-ear audio signal. The second transfer function is the transfer function between the audio signal collected by the microphone of the feedforward hearing aid channel and the audio signal collected by the in-ear microphone when the hearing aid function is turned off.

[0087] In this embodiment, the signal directly collected by the in-ear microphone 120 is regarded as the initial signal, and the passive noise in the ear affected by the feedforward hearing aid module 140 is subtracted from the initial signal to obtain the in-ear audio signal. In this way, the influence of the audio signal of the feedforward hearing aid module 140 on the in-ear audio signal can be reduced, thereby improving the effectiveness and accuracy of the in-ear audio signal, and further improving the effectiveness and accuracy of the calculated power, amplitude and energy.

[0088] In the embodiment of the present application, if the parameter value of the target parameter is less than the corresponding second preset threshold, or the value of the correlation feature is less than the corresponding first preset threshold, it indicates that there is a high possibility of sound leakage between the speaker 130 and the in-ear microphone 120, and the sound leakage may be caused by the earphone not being worn correctly or being pressed by the hand, etc. In this case, the sound of the speaker 130 may be exposed from the ear, thereby being collected by the external ear microphone 150, and then filtered and amplified again by the hearing aid module 140, resulting in howling. Therefore, if the parameter value of the target parameter is less than the corresponding second preset threshold, or the value of the correlation feature is less than the corresponding first preset threshold, it can be confirmed whether the internal audio signal meets the sound leakage condition, and then the amplification ability of the hearing aid module 140 to the sound is reduced to suppress the influence of howling.

[0089] In the embodiment of the present application, the processing unit 110 reduces the amplification capability of the hearing aid module 140 , which may be to reduce the gain and / or bandwidth of the hearing aid module 140 .

[0090] In this embodiment, the amplification capability of the hearing aid module 140 for the collected audio signal is related to the gain and bandwidth of the filter in the hearing aid module 140, and is proportional to the gain and bandwidth. Therefore, the amplification capability of the hearing aid module 140 can be reduced by reducing the gain and / or bandwidth of the hearing aid module 140.

[0091] In one embodiment of the present application, when reducing the amplification capability of the hearing aid module 140 by reducing the gain of the hearing aid module 140, the gain of the hearing aid module 140 for the frequency band where the audio signal prone to howling is located can also be reduced. For example, howling often occurs when the audio signal of 800Hz-3KHz is processed, therefore, the gain of the hearing aid module 140 for the audio signal of 800Hz-3KHz can be reduced.

[0092] Through the above-mentioned method, in the case where sound leakage or howling may occur, the sound amplification capability of the hearing aid module 140 is reduced, thereby suppressing the influence of the howling.

[0093] See also Figure 5 , Figure 5 Schematic diagram of a transparent earphone with howling suppression provided by an embodiment of the present application. Figure 5 As shown, the transparent transmission earphone 300 includes: an in-ear microphone 120, a speaker 130, a processing unit 110 and a transparent transmission module 340.

[0094] In the embodiment of the present application, the transparent transmission earphone 300 includes a feedback active noise reduction channel and a feedforward transparent transmission channel. The feedforward transparent transmission channel is similar to the feedforward hearing aid channel of the aforementioned hearing aid earphone. The difference is that the hearing aid module 140 is used in the feedforward hearing aid channel of the hearing aid 100, while the transparent transmission earphone 300 uses a transparent transmission module 340. The transparent transmission module 340 is used to filter and reduce noise on the audio signal collected by the external microphone 150, and then played by the speaker 130 after digital-to-analog conversion. The role of the transparent transmission module 340 is similar to that of the aforementioned hearing aid module 140, and the audio signal can also be filtered and amplified. There is also the problem of howling. Therefore, the transparent transmission earphone 300 of the present application can also suppress howling based on the concept of the above-mentioned hearing aid 100. Similarly, the feedback noise reduction channel of the transparent transmission earphone 300 is also an optional structure, and it is not necessary.

[0095] Therefore, the processing unit 110 in the transparent transmission earphone 300 can be used to: control the speaker 130 to play a preset audio signal in response to an instruction to control the transparent transmission function to be turned on; obtain the in-ear audio signal including the preset audio signal after propagation in the ear through the in-ear microphone 120; determine whether the in-ear audio signal meets the sound leakage condition through the preset audio signal; and when it is determined that the in-ear audio signal meets the sound leakage condition, reduce the amplification capability of the transparent transmission module 340.

[0096] In one embodiment, the processing unit 110 is specifically used to: calculate the value of the correlation feature between the preset audio signal and the in-ear audio signal; if the value of the correlation feature is less than a first preset threshold, determine that the in-ear audio signal meets the sound leakage condition.

[0097] In one embodiment, the correlation feature includes a cross-correlation result in the time domain and / or a cross-correlation result in the frequency domain between the preset audio signal and the in-ear audio signal, and the processing unit 110 is specifically used to: perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the time domain to obtain a cross-correlation result in the time domain; and / or perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the frequency domain to obtain a cross-correlation result in the frequency domain.

[0098] In one embodiment, if the correlation feature is a cross-correlation result in the time domain, the processing unit 110 is specifically used to: convert the in-ear audio signal and the preset audio signal into vectors; calculate the vector dot product operation result of the in-ear audio signal and the preset audio signal, and the vector dot product operation result is the cross-correlation result of the preset audio signal and the in-ear audio signal in the time domain.

[0099] In one embodiment, the processing unit 110 is specifically used to: determine the parameter value of a target parameter of a specified frequency band in the in-ear audio signal that matches the frequency band in which a preset audio signal is located, the target parameter including at least one of power, energy or amplitude; if the parameter value of any target parameter is less than a second preset threshold value corresponding to the target parameter, it is determined that the in-ear audio signal meets the sound leakage condition.

[0100] In one embodiment, the processing unit 110 is specifically used to: determine the parameter value of a target parameter of a specified frequency band in the in-ear audio signal that matches the frequency band in which a preset audio signal is located, the target parameter including at least one of power, energy or amplitude; if the parameter value of any target parameter is less than a second preset threshold value corresponding to the target parameter, it is determined that the in-ear audio signal meets the sound leakage condition.

[0101] In one embodiment, the transparent transmission earphone 300 also includes an external ear microphone 150, and the processing unit 110 is also used to: obtain an initial signal including an external ear audio signal collected by the external ear microphone and passed through the transparent transmission module and an initial signal including a preset audio signal after propagation in the ear collected by the internal ear microphone; estimate the external ear audio signal after passing through the transparent transmission module based on a first transfer function to obtain a transparent transmission signal; the first transfer function is a transfer function between the speaker and the internal ear microphone; and subtract the transparent transmission signal from the initial signal to obtain an internal ear audio signal.

[0102] In one embodiment, the transparent transmission earphone 300 also includes an external ear microphone 150, which is the microphone of the feedforward hearing aid channel; the processing unit 110 is also used to: obtain the initial signal including the preset audio signal collected by the in-ear microphone 120, and obtain the external ear audio signal collected by the external ear microphone 150; estimate the external ear audio signal based on the second transfer function to obtain the passive noise in the ear; the second transfer function is the transfer function between the audio signal collected by the microphone of the feedforward hearing aid channel and the audio signal collected by the microphone of the feedback active noise reduction channel when the transparent transmission function is turned off; subtract the passive noise in the ear from the initial signal to obtain the in-ear audio signal.

[0103] In one embodiment, the preset audio signal is an infrasound audio signal or a prompt tone of the transparent earphone 300 .

[0104] It can be understood that the difference between the transparent transmission earphone 300 and the hearing aid 100 lies in the difference between the transparent transmission module 340 and the hearing aid module 140. The rest of the structures are similar, and the transparent transmission module 340 and the hearing aid module 140 play similar roles. Therefore, the functions and structures implemented by the transparent transmission earphone 300 can refer to the contents of the aforementioned hearing aid 100 and will not be expanded here.

[0105] Based on the same inventive concept, an embodiment of the present application also provides a howling suppression control method, which can be applied to the processing unit 110 of the hearing aid 100 or the transparent transmission earphone 300, wherein the hearing aid 100 and the transparent transmission earphone 300 also include an in-ear microphone 120, a speaker 130, and the hearing aid 100 also includes a hearing aid module 140, and the transparent transmission earphone 300 also includes a transparent transmission module 340.

[0106] See also Figure 6 , Figure 6 A flowchart of a method for controlling howling suppression provided in an embodiment of the present application, the method is applied to a processing unit of a hearing aid or a transparent transmission earphone, the hearing aid and the transparent transmission earphone further include an in-ear microphone and a speaker, the hearing aid further includes a hearing aid module, and the transparent transmission earphone further includes a transparent transmission module, the method for controlling howling suppression includes:

[0107] S610, in response to an instruction to control the target function to be turned on, controlling a speaker to play a preset audio signal.

[0108] In this embodiment, the target function is the transparent transmission function based on the transparent transmission module 340 or the hearing aid function based on the hearing aid module 140. If the control method is applied to the processing unit of the hearing aid, the target function is the hearing aid function, and if the control method is applied to the processing unit of the transparent transmission earphone, the target function is the transparent transmission function.

[0109] In this embodiment, the preset audio signal is an infrasound audio signal or a prompt tone of an earphone device, wherein the earphone device refers to a hearing aid 100 or a transparent earphone 300 .

[0110] S620, obtaining an in-ear audio signal including a preset audio signal propagated in the ear through the in-ear microphone 120.

[0111] In one embodiment, the transparent transmission earphone includes an external ear microphone, and S620 may include: obtaining an initial signal including an external ear audio signal collected by the external ear microphone 150 and passed through the hearing aid module 140 and an initial signal including a preset audio signal after propagation in the ear collected by the in-ear microphone 120; estimating the external ear audio signal after passing through the transparent transmission module based on a first transfer function to obtain a transparent transmission signal; the first transfer function is a transfer function between the speaker 130 and the in-ear microphone; and subtracting the transparent transmission signal from the initial signal to obtain an in-ear audio signal.

[0112] In one embodiment, the hearing aid 100 and the transparent transmission earphone 300 both include an external ear microphone 150, and the external ear microphone 150 is a microphone of a feedforward hearing aid channel or a microphone of a feedforward transparent transmission channel. S620 may include: obtaining an initial signal including a preset audio signal collected by the in-ear microphone 120, and obtaining an external ear audio signal collected by the external ear microphone 150; estimating the external ear audio signal based on a second transfer function to obtain the passive noise in the ear; the second transfer function is a transfer function between the audio signal collected by the microphone of the feedforward hearing aid channel and the audio signal collected by the microphone of the feedback active noise reduction channel when the transparent transmission function is turned off;

[0113] The in-ear audio signal is obtained by subtracting the in-ear passive noise from the initial signal.

[0114] S630: Determine whether the in-ear audio signal satisfies a sound leakage condition through a preset audio signal.

[0115] In one embodiment, S630 may include: calculating a value of a correlation feature between a preset audio signal and the in-ear audio signal; if the value of the correlation feature is less than the first preset threshold, determining that the in-ear audio signal meets the sound leakage condition.

[0116] In one embodiment, the correlation feature includes a cross-correlation result in the time domain and / or a cross-correlation result in the frequency domain between the preset audio signal and the in-ear audio signal, and the processing unit 110 is specifically used to: perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the time domain to obtain a cross-correlation result in the time domain; and / or perform cross-correlation processing on the preset audio signal and the in-ear audio signal in the frequency domain to obtain a cross-correlation result in the frequency domain.

[0117] In one embodiment, if the correlation feature is a cross-correlation result in the time domain, the processing unit 110 is specifically used to: convert the in-ear audio signal and the preset audio signal into vectors; calculate the vector dot product operation result of the in-ear audio signal and the preset audio signal, and the vector dot product operation result is the cross-correlation result of the preset audio signal and the in-ear audio signal in the time domain.

[0118] In one embodiment, S630 may also include: determining a parameter value of a target parameter in a specified frequency band in the in-ear audio signal that matches the frequency band in which a preset audio signal is located, the target parameter including at least one of power, energy or amplitude; if the parameter value of any target parameter is less than a second preset threshold value corresponding to the target parameter, it is determined that the in-ear audio signal meets the sound leakage condition.

[0119] S640: When it is determined that the in-ear audio signal meets the sound leakage condition, reduce the amplification capability of the target module.

[0120] The control method of howling suppression is the same as the function implemented by the processing unit 110 of the hearing aid 100 and the transparent earphone 300. For details, please refer to the above content and will not be elaborated here.

[0121] Based on the same inventive concept, an embodiment of the present application further provides a readable storage medium, in which instructions are stored. The instructions can be executed by one or more processing units to implement the control method for howling suppression provided in the above embodiment.

[0122] The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more available media. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD (digital video disc)), or a semiconductor medium (e.g., an SSD (Solid State Disk)).

[0123] If the control method for howling suppression is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, ROM, RAM, disk or optical disk, and other media that can store program codes.

[0124] In the embodiments provided in the present application, it should be understood that the disclosed method can also be implemented in other ways. The functional modules in the various embodiments of the present application can be integrated together to form an independent part, or each module can exist separately, or two or more modules can be integrated to form an independent part.

[0125] The above embodiments can be freely combined without conflict, and the embodiments obtained by the combination are included in the protection scope of this application.

[0126] The above detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0127] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0128] In the description of this application, it is also necessary to explain that, unless otherwise clearly specified and limited, the term "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0129] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A hearing aid with howling suppression, characterized in that: include: A processing unit, an in-ear microphone, a speaker, and a hearing aid module, wherein the hearing aid realizes a hearing aid function through the hearing aid module; The processing unit is used for: In response to the instruction for controlling the hearing aid function to be turned on, controlling the speaker to play a preset audio signal; Acquiring an in-ear audio signal including a preset audio signal after propagation in the ear through the in-ear microphone; Determining whether the in-ear audio signal meets the sound leakage condition by using the preset audio signal; When it is determined that the in-ear audio signal satisfies the sound leakage condition, the amplification capability of the hearing aid module is reduced.

2. The howling suppression hearing aid according to claim 1, characterized in that: The processing unit is specifically used for: Calculating a value of a correlation feature between the preset audio signal and the in-ear audio signal; If the value of the correlation feature is less than a first preset threshold, it is determined that the in-ear audio signal meets the sound leakage condition.

3. The howling suppression hearing aid according to claim 2, characterized in that: The correlation feature includes a cross-correlation result in the time domain and / or a cross-correlation result in the frequency domain between the preset audio signal and the in-ear audio signal, and the processing unit is specifically configured to: Performing cross-correlation processing on the preset audio signal and the in-ear audio signal in the time domain to obtain a cross-correlation result in the time domain; And / or, cross-correlation processing is performed on the preset audio signal and the in-ear audio signal in the frequency domain to obtain a cross-correlation result in the frequency domain.

4. The howling suppression hearing aid according to claim 2, characterized in that: If the correlation feature is a cross-correlation result in the time domain, the processing unit is specifically configured to: Converting the in-ear audio signal and the preset audio signal into vectors; A vector dot product operation result of the in-ear audio signal and the preset audio signal is calculated, where the vector dot product operation result is a cross-correlation result of the preset audio signal and the in-ear audio signal in the time domain.

5. The howling suppression hearing aid according to claim 1, characterized in that: The processing unit is specifically used for: Determine a parameter value of a target parameter of a specified frequency band in the in-ear audio signal that matches the frequency band in which the preset audio signal is located, wherein the target parameter includes at least one of power, energy or amplitude; If the parameter value of any one of the target parameters is less than the second preset threshold corresponding to the target parameter, it is determined that the in-ear audio signal meets the sound leakage condition.

6. The howling suppression hearing aid according to claim 5, characterized in that: The hearing aid also includes an extra-ear microphone; The processing unit is also used for: Acquire the external-ear audio signal collected by the external-ear microphone and after passing through the hearing aid module and the initial signal collected by the internal-ear microphone including the preset audio signal after propagation in the ear; The external-ear audio signal after passing through the hearing aid module is estimated based on a first transfer function to obtain a hearing aid signal; the first transfer function is a transfer function between the speaker and the in-ear microphone; The hearing aid signal is subtracted from the initial signal to obtain the in-ear audio signal.

7. The howling suppression hearing aid according to claim 5, characterized in that: The hearing aid further includes an external ear microphone, which is a microphone of a feedforward hearing aid channel. The processing unit is also used for: Acquire an initial signal including the preset audio signal collected by the in-ear microphone, and acquire an external-ear audio signal collected by the external-ear microphone; The external audio signal is estimated based on a second transfer function to obtain the passive noise in the ear; the second transfer function is a transfer function between the audio signal collected by the microphone of the feedforward hearing aid channel and the audio signal collected by the in-ear microphone when the hearing aid function is turned off; The in-ear audio signal is obtained by subtracting the in-ear passive noise from the initial signal.

8. The howling suppression hearing aid according to any one of claims 1 to 7, characterized in that: The preset audio signal is an infrasound audio signal or a prompt tone of the hearing aid.

9. A transparent earphone with howling suppression, characterized in that: include: A processing unit, an in-ear microphone, a speaker, and a transparent transmission module, wherein the transparent transmission earphone realizes a transparent transmission function through the transparent transmission module; The processing unit is used for: In response to the instruction for controlling the transparent transmission function to be turned on, controlling the speaker to play a preset audio signal; Acquiring an in-ear audio signal including a preset audio signal after propagation in the ear through the in-ear microphone; Determining whether the in-ear audio signal meets the sound leakage condition by using the preset audio signal; When it is determined that the in-ear audio signal meets the sound leakage condition, the amplification capability of the transparent transmission module is reduced.

10. The transparent earphone with howling suppression according to claim 9, characterized in that: The processing unit is specifically used for: Calculating a value of a correlation feature between the preset audio signal and the in-ear audio signal; If the value of the correlation feature is less than a first preset threshold, it is determined that the in-ear audio signal meets the sound leakage condition.

11. The transparent earphone with howling suppression according to claim 10, characterized in that: The correlation feature includes a cross-correlation result in the time domain and / or a cross-correlation result in the frequency domain between the preset audio signal and the in-ear audio signal, and the processing unit is specifically configured to: Performing cross-correlation processing on the preset audio signal and the in-ear audio signal in the time domain to obtain a cross-correlation result in the time domain; And / or, cross-correlation processing is performed on the preset audio signal and the in-ear audio signal in the frequency domain to obtain a cross-correlation result in the frequency domain.

12. The transparent earphone with howling suppression according to claim 10, characterized in that: If the correlation feature is a cross-correlation result in the time domain, the processing unit is specifically configured to: Converting the in-ear audio signal and the preset audio signal into vectors; A vector dot product operation result of the in-ear audio signal and the preset audio signal is calculated, where the vector dot product operation result is a cross-correlation result of the preset audio signal and the in-ear audio signal in the time domain.

13. The transparent earphone with howling suppression according to claim 9, characterized in that: The processing unit is specifically used for: Determine a parameter value of a target parameter of a specified frequency band in the in-ear audio signal that matches the frequency band in which the preset audio signal is located, wherein the target parameter includes at least one of power, energy or amplitude; If the parameter value of any one of the target parameters is less than the second preset threshold corresponding to the target parameter, it is determined that the in-ear audio signal meets the sound leakage condition.

14. The transparent earphone with howling suppression according to claim 13, characterized in that: The transparent transmission earphone also includes an external ear microphone; The processing unit is also used for: Acquire the external-ear audio signal collected by the external-ear microphone and after passing through the transparent transmission module and the initial signal collected by the internal-ear microphone including the preset audio signal after propagation in the ear; The external-ear audio signal after passing through the transparent transmission module is estimated based on a first transfer function to obtain a transparent transmission signal; the first transfer function is a transfer function between the speaker and the in-ear microphone; The in-ear audio signal is obtained by subtracting the transparent signal from the initial signal.

15. The transparent earphone with howling suppression according to claim 13, characterized in that: The transparent transmission earphone also includes an external ear microphone, which is a microphone of a feedforward hearing aid channel; The processing unit is also used for: Acquire an initial signal including the preset audio signal collected by the in-ear microphone, and acquire an external-ear audio signal collected by the external-ear microphone; The external audio signal is estimated based on a second transfer function to obtain the passive noise in the ear; the second transfer function is a transfer function between the audio signal collected by the microphone of the feedforward hearing aid channel and the audio signal collected by the microphone in the ear when the transparent transmission function is turned off; The in-ear audio signal is obtained by subtracting the in-ear passive noise from the initial signal.

16. The howling suppression hearing aid according to any one of claims 9 to 15, characterized in that: The preset audio signal is an infrasound audio signal or a prompt tone of the transparent earphone.

17. A method for controlling howling suppression, characterized in that: A processing unit applied to a hearing aid or a transparent transmission earphone, wherein the hearing aid and the transparent transmission earphone further include an in-ear microphone and a speaker, and the hearing aid further includes a hearing aid module, and the transparent transmission earphone further includes a transparent transmission module; The control method for howling suppression includes: In response to an instruction to control the activation of a target function, the speaker is controlled to play a preset audio signal; the target function is a transparent transmission function based on the transparent transmission module or a hearing aid function based on the hearing aid module; Acquiring an in-ear audio signal including a preset audio signal after propagation in the ear through the in-ear microphone; Determining whether the in-ear audio signal meets the sound leakage condition by using the preset audio signal; When it is determined that the in-ear audio signal satisfies the sound leakage condition, the amplification capability of the target module is reduced, and the target module is the transparent transmission module or the hearing aid module.

18. A readable storage medium, characterized in that: The readable storage medium stores a program, and when the program runs on the processing unit, the processing unit executes the control method for howling suppression according to claim 17.

Citation Information

Cited By

  • Audio data processing method for personal hearing aid product and personal hearing aid product

    CN119697562A

  • Active noise reduction method, system and device

    CN120032619A