Hearing aid space information identification and adjustment method and system based on double microphones

Abstract

The invention discloses a hearing aid spatial information identification and adjustment method and system based on double microphones, and the method comprises the steps: firstly collecting an environment sound signal through employing a double-microphone array pickup module, and obtaining a main microphone signal and a secondary microphone signal; processing the primary microphone signal and the secondary microphone signal to obtain a relatively large energy value of each frequency point of the two microphone signals, then calculating a modulation quantity of the relatively large energy value of each frequency point on each frequency point, and then based on the modulation quantity of the relatively large energy value of each frequency point on each frequency point; according to the method, the function of identifying different use scenes by fully utilizing the spatial orientation information of the double microphones of the hearing aid is realized, and the algorithm architecture of the hearing aid can be finely adjusted according to the specific scenes, so that better use experience is provided, and the voice definition and the wearing comfort are remarkably improved; the communication confidence and life quality of the user in daily life and social occasions are enhanced, and the method is suitable for being widely popularized and used.

Description

Technical Field

[0001] The present invention relates to the technical field of hearing aid equipment, and in particular to a dual-microphone-based hearing aid spatial information recognition and adjustment method and system. Background Art

[0002] With the development of society and the intensification of the aging population, hearing impairment has become an increasingly serious social problem. Hearing aids are an important tool to improve the quality of life of the hearing-impaired. From the initial analog hearing aids to today's digital hearing aids, signal processing technology has continued to advance. Modern hearing aids can not only amplify sound, but also perform complex signal processing to provide a clearer and more natural listening experience. The current mainstream digital hearing aid core algorithms include WDRC and noise reduction, which are used to compress and compensate for the patient's hearing loss in a specific frequency band and reduce background noise to improve wearing comfort. In addition, some hearing aids are equipped with feedback suppression algorithms to prevent hearing aid feedback howling, as well as directional sound pickup algorithms based on multiple microphones. However, the usage scenarios of hearing aids are complex and changeable. In some scenarios of patients' use, hearing aids cannot provide a good user experience. For example, hearing aids are prone to feedback howling during wearing, and the noise reduction algorithm in a noisy environment will reduce the patient's hearing intelligibility, easily introduce and amplify wind noise, and easily amplify the patient's own voice too much. Existing hearing aids generally rely on a single microphone for sound collection and processing. Although this method can meet basic needs in simple usage scenarios, it is difficult to effectively identify and utilize the spatial information contained in the sound signal, and thus cannot obtain a better listening experience. Therefore, it is necessary to design a hearing aid spatial information recognition and adjustment method and system based on dual microphones. Summary of the invention

[0003] The purpose of the present invention is to overcome the deficiencies of the prior art and to better and effectively solve the problem that hearing aids cannot provide a good user experience in some patient usage scenarios, such as the hearing aids are prone to feedback howling during wearing, and the noise reduction algorithm in a noisy environment will reduce the patient's hearing intelligibility, easily introduce and amplify wind noise, and easily amplify the patient's own voice too much. A dual-microphone based hearing aid spatial information recognition and adjustment method and system are provided, which realizes the function of fully utilizing the spatial orientation information of the dual microphones of the hearing aid to identify different usage scenarios, and can refine the algorithm architecture of the hearing aid according to the specific scenario to provide a better user experience, significantly improve the speech clarity and wearing comfort, and enhance the user's communication confidence and quality of life in daily life and social occasions.

[0004] In order to achieve the above object, the technical solution adopted by the present invention is: A dual-microphone-based hearing aid spatial information recognition and calibration method comprises the following steps: Step A, using a dual-microphone array pickup module to collect ambient sound signals and obtain a main microphone signal s1 and a secondary microphone signal s2, then processing the main microphone signal s1 and the secondary microphone signal s2 and obtaining a larger energy value of each frequency point of the two microphone signals; Step B, calculating the modulation amount of each frequency point with the largest energy value at each frequency point; Step C, based on the modulation amount of the largest energy value at each frequency point, using the minimum mean square error method to calculate the background noise coherence coefficient and the activation signal coherence coefficient at each frequency point in each state; Step D, respectively calculating and judging the background noise coherence coefficient and the activation signal coherence coefficient and each scene parameter stored in the spatial information recognition module to obtain the spatial scene corresponding to the ambient sound signal; Step E: Perform hearing aid adjustment processing according to the obtained ambient sound signal corresponding to the spatial scene to complete the spatial information recognition and adjustment operation of the hearing aid.

[0005] The aforementioned dual-microphone-based hearing aid spatial information recognition and adjustment method, step A, uses a dual-microphone array pickup module to collect ambient sound signals and obtain a main microphone signal s1 and a secondary microphone signal s2, then processes the main microphone signal s1 and the secondary microphone signal s2 and obtains the maximum energy value of each frequency point of the two microphone signals. The specific steps are as follows: Step A1, perform short-time Fourier transform on the main microphone signal s1 and the secondary microphone signal s2 respectively, and then decompose the main microphone signal s1 and the secondary microphone signal s2 into complex representations in the frequency domain, as shown in formula (1), S1 = STFT(s1), S2 = STFT(s2)(1) Wherein, S1 is the complex number of the primary microphone signal s1 in the frequency domain, S2 is the complex number of the secondary microphone signal s2 in the frequency domain, and STFT represents the short-time Fourier transform operator; Step A2, calculate the energy of the complex number S1 of the main microphone signal s1 in the frequency domain and the complex number S2 of the secondary microphone signal s2 in the frequency domain at each frequency point, as shown in formula (2), P1 = abs(S1) 2 , P2 = abs(S2) 2 (2) Where P1 is the energy of the complex number S1 at each frequency point, P2 is the energy of the complex number S2 at each frequency point, and abs is the modulus of the complex number; Step A3, compare the energy P1 at each frequency point of the complex number S1 and the energy P2 at each frequency point of the complex number S2 and obtain the maximum energy value P3 of each frequency point, as shown in formula (3). P3 = max(P1, P2) (3) Among them, max is the maximum value between the two sequences.

[0006] The aforementioned dual-microphone-based hearing aid spatial information recognition and adjustment method, step B, calculates the modulation amount of each frequency point with the largest energy value at each frequency point, and the specific steps are as follows: Step B1, calculate the short-time envelope of the first-order smoothing signal energy, as shown in formula (4), P a = a1 P3+(1-a1) P a (4) Among them, P a is the short-time energy envelope of each frequency point, and a1 is the smoothing factor; Step B2: the short-time energy envelope P of each frequency point a Perform long-term minimum statistics and obtain the long-term minimum value P b , as shown in formula (5), P b =a2 P a +(1- a2) P b , when P b ≤P a ; P b =P a , when P b > P a (5) Among them, a2 is the smoothing factor; Step B3, calculate the short-time energy envelope P of each frequency point a and the long-term energy minimum P b The difference between the two and the modulation amount M is obtained, as shown in formula (6): M = 10 lg(P a )-10 lg(P b )(6); Step B4, set the threshold Th1 and threshold Th2 for determining the energy activation state of each frequency point. If the modulation amount M is not greater than the threshold Th1, the frequency point signal is in an unactivated state. If the modulation amount M is not less than the threshold Th2, the frequency point signal is in an activated state. If the threshold Th1<modulation amount M<threshold Th2, the frequency point signal is in a transitional state.

[0007] In the aforementioned dual-microphone-based hearing aid spatial information recognition and adjustment method, step C, based on the modulation amount of the larger energy value of each frequency point at each frequency point, the background noise coherence coefficient and the activation signal coherence coefficient under each frequency point and each state are calculated using the minimum mean square error method. Specifically, the minimum mean square error method is used to respectively count the background noise coherence coefficient W1 and the activation signal coherence coefficient W2 under each frequency point and each state, as shown in formula (7), W1=W1+d1 (S2-W1 S1) conj(S1), if M≤Th1; W2=W2+d2 (S2-W2 S1) conj(S1), if M ≥ Th2 (7) Where d1 is the background noise update rate and d2 is the activation signal update rate.

[0008] In the aforementioned dual-microphone-based hearing aid spatial information recognition and adjustment method, step D is to calculate and distinguish the background noise coherence coefficient and the activation signal coherence coefficient with each scene parameter stored in the spatial information recognition module to obtain the spatial scene corresponding to the ambient sound signal. The specific steps are as follows: Step D1, calculate the first scene discrimination parameter y1 and judge whether the ambient sound signal is a coherent noise scene, as shown in formula (8), y1 = sum(abs(W1) 2 C1)+b1(8) Wherein, sum is a sequence summation operator, C1 and b1 are corresponding spatial information identification parameters, if the result of the first scene discrimination parameter y1 is greater than 0, it is determined that the ambient sound signal is in a coherent noise scene, if the result of the first scene discrimination parameter y1 is less than 0, it is determined that the ambient sound signal is in an incoherent noise scene; Step D2, if it is determined that the ambient sound signal is in an incoherent noise scene, then continue to calculate the second scene discrimination parameter y2, the third scene discrimination parameter y3 and the third scene discrimination parameter y4. The specific steps are as follows: Step D21, calculate the second scene discrimination parameter y2, as shown in formula (9), y2 = sum(abs(W2) 2 C2)+b2(9) Wherein, C2 and b2 are both corresponding spatial information identification parameters. If the calculation result of the second scene discrimination parameter y2 is greater than 0, it is determined that the ambient sound signal has a wind noise scene; Step D22, calculate the third scene discrimination parameter y3, as shown in formula (10), y3 = sum(abs(W2-W3) 2 C3)+b3(10) Wherein, W3, C3 and b3 are all corresponding spatial information identification parameters. If the calculation result of the third scene discrimination parameter y3 is greater than 0, it is determined that the ambient sound signal has a howling scene; Step D23, calculate the fourth scene discrimination parameter y4, as shown in formula (11), y4 = sum(abs(W2-W4) 2 C4)+b4(11) Among them, W4, C4 and b4 are all corresponding spatial information recognition parameters. If the calculation result of the fourth scene discrimination parameter y4 is greater than 0, it is determined that the ambient sound signal is the wearer's own sound scene.

[0009] The aforementioned method for spatial information recognition and adjustment of a hearing aid based on dual microphones, step E, performs hearing aid adjustment processing according to the obtained ambient sound signal corresponding to the spatial scene, and completes the spatial information recognition and adjustment operation of the hearing aid, wherein if the ambient sound signal is identified as a coherent noise scene, the microphone array is adjusted to the omnidirectional sound pickup signal of the main microphone signal s1 and the noise reduction depth of the noise reduction algorithm is reduced; if the ambient sound signal is identified as an incoherent noise scene, the directional sound pickup signals of the main microphone signal s1 and the secondary microphone signal s2 are turned on and the noise reduction depth of the noise reduction algorithm is increased; if the ambient sound signal is identified as a wind noise scene, the single microphone pickup signal of the secondary microphone signal s2 is used and the low-frequency compensation gain in the noise reduction algorithm is reduced; if the ambient sound signal is identified as a howling risk, the high-frequency compensation gain in the noise reduction algorithm is reduced and the tracking speed of the howling suppression algorithm is increased; if the ambient sound signal is identified as a wearer's own sound scene, the low-frequency compensation gain in the noise reduction algorithm is reduced.

[0010] In the aforementioned dual-microphone-based hearing aid spatial information recognition and adjustment method, the directional sound pickup output signal s3 in step E is as shown in formula (12): S3=S2+W2 S1 k-W1 S2 (1-k) (12) Among them, S3 is the complex number of the directional sound pickup output signal s3 in the frequency domain, and the larger the modulation amount M is, the larger the parameter k is, and the smaller the modulation amount M is, the smaller the parameter k is.

[0011] A hearing aid spatial information recognition and adjustment system based on dual microphones, comprising a signal acquisition module, a modulation amount calculation module, a coherence coefficient calculation module, a spatial scene discrimination module and a spatial scene adjustment module, wherein the signal acquisition module is used to use a dual microphone array pickup module to collect environmental sound signals and obtain a main microphone signal and a secondary microphone signal, and then process the main microphone signal and the secondary microphone signal to obtain the maximum energy value of each frequency point of the two microphone signals, the modulation amount calculation module is used to calculate the modulation amount of each frequency point with the maximum energy value, the coherence coefficient calculation module is used to calculate the background noise coherence coefficient and the activation signal coherence coefficient under each state of each frequency point based on the modulation amount of each frequency point with the maximum energy value and the minimum mean square error method, the spatial scene discrimination module is used to calculate and discriminate the background noise coherence coefficient and the activation signal coherence coefficient with each scene parameter stored in the spatial information recognition module and obtain the corresponding spatial scene of the environmental sound signal, and the spatial scene adjustment module is used to adjust the hearing aid according to the corresponding spatial scene of the obtained environmental sound signal and complete the spatial information recognition and adjustment operation of the hearing aid.

[0012] The beneficial effects of the present invention are as follows: a dual-microphone-based hearing aid spatial information recognition and adjustment method and system of the present invention first uses a dual-microphone array pickup module to collect ambient sound signals and obtain a main microphone signal and a secondary microphone signal, then processes the main microphone signal and the secondary microphone signal and obtains the maximum energy value of each frequency point of the two microphone signals, then calculates the modulation amount of each frequency point with the maximum energy value, and then calculates the background noise coherence coefficient and the activation signal coherence coefficient under each state at each frequency point based on the modulation amount of each frequency point with the maximum energy value and using the minimum mean square error method, then calculates the background noise coherence coefficient and the activation signal coherence coefficient and each scene parameter stored in the spatial information recognition module respectively to obtain the spatial scene corresponding to the ambient sound signal. Then, the hearing aid is adjusted and processed according to the corresponding spatial scene based on the obtained ambient sound signal, and the spatial information recognition and adjustment operation of the hearing aid is completed, which effectively realizes that the hearing aid spatial information recognition and adjustment method and system have the function of fully utilizing the spatial orientation information of the hearing aid dual microphones to identify different usage scenarios, and can refine the algorithm architecture of the hearing aid according to the specific scenario to provide a better user experience. At the same time, the hearing aid can automatically identify the corresponding usage scenario through the spatial information of the dual microphones during complex and changeable use, and then use the adaptive parameter adjustment module to automatically adjust the pickup method and various algorithm parameters so that the user does not need to make frequent manual adjustments, which significantly improves the voice clarity and wearing comfort, and enhances the user's communication confidence and quality of life in daily life and social occasions. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1It is a flow chart of a dual-microphone-based hearing aid spatial information recognition and adjustment method of the present invention; Figure 2 It is a schematic diagram of the spatial information recognition process of the present invention; Figure 3 It is a schematic diagram of the spatial information adjustment process of the present invention. DETAILED DESCRIPTION

[0014] The present invention will be further described below in conjunction with the accompanying drawings.

[0015] like Figure 1 As shown, a dual-microphone-based hearing aid spatial information recognition and adjustment method of the present invention comprises the following steps: Step A, using a dual microphone array pickup module to collect ambient sound signals and obtain a main microphone signal s1 and a secondary microphone signal s2, then processing the main microphone signal s1 and the secondary microphone signal s2 and obtaining the maximum energy value of each frequency point of the two microphone signals. The specific steps are as follows: Step A1, perform short-time Fourier transform on the main microphone signal s1 and the secondary microphone signal s2 respectively, and then decompose the main microphone signal s1 and the secondary microphone signal s2 into complex representations in the frequency domain, as shown in formula (1), S1 = STFT(s1), S2 = STFT(s2)(1) Wherein, S1 is the complex number of the primary microphone signal s1 in the frequency domain, S2 is the complex number of the secondary microphone signal s2 in the frequency domain, and STFT represents the short-time Fourier transform operator; Step A2, calculate the energy of the complex number S1 of the main microphone signal s1 in the frequency domain and the complex number S2 of the secondary microphone signal s2 in the frequency domain at each frequency point, as shown in formula (2), P1 = abs(S1) 2 , P2 = abs(S2) 2 (2) Where P1 is the energy of the complex number S1 at each frequency point, P2 is the energy of the complex number S2 at each frequency point, and abs is the modulus of the complex number; Step A3, compare the energy P1 at each frequency point of the complex number S1 and the energy P2 at each frequency point of the complex number S2 and obtain the maximum energy value P3 of each frequency point, as shown in formula (3). P3 = max(P1, P2) (3) Among them, max is the maximum value between the two sequences.

[0016] like Figure 2 As shown, step B calculates the modulation amount of each frequency point with the largest energy value at each frequency point. The specific steps are as follows: Step B1, calculate the short-time envelope of the first-order smoothing signal energy, as shown in formula (4), P a = a1 P3+(1-a1) P a (4) Among them, P a is the short-time energy envelope of each frequency point, and a1 is the smoothing factor; Step B2: the short-time energy envelope P of each frequency point a Perform long-term minimum statistics and obtain the long-term minimum value P b , as shown in formula (5), P b =a2 P a +(1- a2) P b , when P b ≤P a ; P b =P a , when P b > P a (5) Among them, a2 is the smoothing factor; Step B3, calculate the short-time energy envelope P of each frequency point a and the long-term energy minimum P b The difference between the two and the modulation amount M is obtained, as shown in formula (6): M = 10 lg(P a )-10 lg(P b )(6); Step B4, set the threshold Th1 and threshold Th2 for determining the energy activation state of each frequency point. If the modulation amount M is not greater than the threshold Th1, the frequency point signal is in an unactivated state. If the modulation amount M is not less than the threshold Th2, the frequency point signal is in an activated state. If the threshold Th1<modulation amount M<threshold Th2, the frequency point signal is in a transitional state.

[0017] Step C, based on the modulation amount of the largest energy value of each frequency point at each frequency point, the minimum mean square error method is used to calculate the background noise coherence coefficient and the activation signal coherence coefficient under each frequency point and each state. Specifically, the minimum mean square error method is used to calculate the background noise coherence coefficient W1 and the activation signal coherence coefficient W2 under each frequency point and each state, as shown in formula (7), W1=W1+d1 (S2-W1 S1) conj(S1), if M≤Th1; W2=W2+d2 (S2-W2 S1) conj(S1), if M ≥ Th2 (7) Where d1 is the background noise update rate and d2 is the activation signal update rate.

[0018] like Figure 3 As shown, step D is to calculate and distinguish the background noise coherence coefficient and the activation signal coherence coefficient with each scene parameter stored in the spatial information recognition module to obtain the spatial scene corresponding to the ambient sound signal. The specific steps are as follows: Step D1, calculate the first scene discrimination parameter y1 and judge whether the ambient sound signal is a coherent noise scene, as shown in formula (8), y1 = sum(abs(W1) 2 C1)+b1(8) Wherein, sum is a sequence summation operator, C1 and b1 are corresponding spatial information identification parameters, if the result of the first scene discrimination parameter y1 is greater than 0, it is determined that the ambient sound signal is in a coherent noise scene, if the result of the first scene discrimination parameter y1 is less than 0, it is determined that the ambient sound signal is in an incoherent noise scene; Step D2, if it is determined that the ambient sound signal is in an incoherent noise scene, then continue to calculate the second scene discrimination parameter y2, the third scene discrimination parameter y3 and the third scene discrimination parameter y4. The specific steps are as follows: Step D21, calculate the second scene discrimination parameter y2, as shown in formula (9), y2 = sum(abs(W2) 2 C2)+b2(9) Wherein, C2 and b2 are both corresponding spatial information identification parameters. If the calculation result of the second scene discrimination parameter y2 is greater than 0, it is determined that the ambient sound signal has a wind noise scene; Step D22, calculate the third scene discrimination parameter y3, as shown in formula (10), y3 = sum(abs(W2-W3) 2 C3)+b3(10) Wherein, W3, C3 and b3 are all corresponding spatial information identification parameters. If the calculation result of the third scene discrimination parameter y3 is greater than 0, it is determined that the ambient sound signal has a howling scene; Step D23, calculate the fourth scene discrimination parameter y4, as shown in formula (11), y4 = sum(abs(W2-W4) 2 C4)+b4(11) Among them, W4, C4 and b4 are all corresponding spatial information recognition parameters. If the calculation result of the fourth scene discrimination parameter y4 is greater than 0, it is determined that the ambient sound signal is the wearer's own sound scene.

[0019] Step E, adjusting the hearing aid according to the spatial scene corresponding to the obtained ambient sound signal, and completing the spatial information recognition and adjustment operation of the hearing aid, wherein if the ambient sound signal is identified as a coherent noise scene, the microphone array is adjusted to the omnidirectional sound pickup signal of the main microphone signal s1 and the noise reduction depth of the noise reduction algorithm is reduced; if the ambient sound signal is identified as an incoherent noise scene, the directional sound pickup signals of the main microphone signal s1 and the secondary microphone signal s2 are turned on and the noise reduction depth of the noise reduction algorithm is increased; if the ambient sound signal is identified as a wind noise scene, the single microphone pickup signal of the secondary microphone signal s2 is used and the low-frequency compensation gain in the noise reduction algorithm is reduced; if the ambient sound signal is identified as a howling risk, the high-frequency compensation gain in the noise reduction algorithm is reduced and the tracking speed of the howling suppression algorithm is increased; if the ambient sound signal is identified as the wearer's own sound scene, the low-frequency compensation gain in the noise reduction algorithm is reduced.

[0020] The directional sound pickup output signal s3 in step E is as shown in formula (12): S3=S2+W2 S1 k-W1 S2 (1-k) (12) Among them, S3 is the complex number of the directional sound pickup output signal s3 in the frequency domain, and the larger the modulation amount M is, the larger the parameter k is, and the smaller the modulation amount M is, the smaller the parameter k is.

[0021] A hearing aid spatial information recognition and adjustment system based on dual microphones, comprising a signal acquisition module, a modulation amount calculation module, a coherence coefficient calculation module, a spatial scene discrimination module and a spatial scene adjustment module, wherein the signal acquisition module is used to use a dual microphone array pickup module to collect environmental sound signals and obtain a main microphone signal and a secondary microphone signal, and then process the main microphone signal and the secondary microphone signal to obtain the maximum energy value of each frequency point of the two microphone signals, the modulation amount calculation module is used to calculate the modulation amount of each frequency point with the maximum energy value, the coherence coefficient calculation module is used to calculate the background noise coherence coefficient and the activation signal coherence coefficient under each state of each frequency point based on the modulation amount of each frequency point with the maximum energy value and the minimum mean square error method, the spatial scene discrimination module is used to calculate and discriminate the background noise coherence coefficient and the activation signal coherence coefficient with each scene parameter stored in the spatial information recognition module and obtain the corresponding spatial scene of the environmental sound signal, and the spatial scene adjustment module is used to adjust the hearing aid according to the corresponding spatial scene of the obtained environmental sound signal and complete the spatial information recognition and adjustment operation of the hearing aid.

[0022] In summary, the present invention provides a dual-microphone-based hearing aid spatial information recognition and adjustment method and system, first using a dual-microphone array pickup module to collect ambient sound signals and obtain a main microphone signal and a secondary microphone signal, then processing the main microphone signal and the secondary microphone signal to obtain the maximum energy value of each frequency point of the two microphone signals, then calculating the modulation amount of each frequency point with the maximum energy value, and then based on the modulation amount of each frequency point with the maximum energy value and the minimum mean square error method, respectively calculate the background noise coherence coefficient and the activation signal coherence coefficient under each frequency point and each state, then respectively calculate and distinguish the background noise coherence coefficient and the activation signal coherence coefficient with each scene parameter stored in the spatial information recognition module to obtain the spatial scene corresponding to the ambient sound signal, and then based on The hearing aid is adjusted and processed according to the obtained ambient sound signal corresponding to the spatial scene, and the spatial information recognition and adjustment operation of the hearing aid is completed. The hearing aid spatial information recognition and adjustment method and system effectively realize the function of fully utilizing the spatial orientation information of the hearing aid dual microphones to identify different usage scenarios, and can refine the algorithm architecture of the hearing aid according to the specific scenario to provide a better user experience. At the same time, the hearing aid can automatically identify the corresponding usage scenario through the spatial information of the dual microphones during complex and changeable use, and then use the adaptive parameter adjustment module to automatically adjust the pickup method and various algorithm parameters so that the user does not need to make frequent manual adjustments, which significantly improves the voice clarity and wearing comfort, and enhances the user's communication confidence and quality of life in daily life and social occasions.

[0023] The above shows and describes the basic principles, main features and advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. A hearing aid spatial information recognition and calibration method based on dual microphones, characterized in that: The following steps are included: Step A, using a dual-microphone array pickup module to collect ambient sound signals and obtain a main microphone signal s1 and a secondary microphone signal s2, then processing the main microphone signal s1 and the secondary microphone signal s2 and obtaining a larger energy value of each frequency point of the two microphone signals; Step B, calculating the modulation amount of each frequency point with the largest energy value at each frequency point; Step C, based on the modulation amount of the largest energy value at each frequency point, using the minimum mean square error method to calculate the background noise coherence coefficient and the activation signal coherence coefficient at each frequency point in each state; Step D, respectively calculating and judging the background noise coherence coefficient and the activation signal coherence coefficient and each scene parameter stored in the spatial information recognition module to obtain the spatial scene corresponding to the ambient sound signal; Step E: Perform hearing aid adjustment processing according to the obtained ambient sound signal corresponding to the spatial scene to complete the spatial information recognition and adjustment operation of the hearing aid.

2. The method for spatial information recognition and adjustment of a hearing aid based on dual microphones according to claim 1, characterized in that: Step A, using a dual microphone array pickup module to collect ambient sound signals and obtain a main microphone signal s1 and a secondary microphone signal s2, then processing the main microphone signal s1 and the secondary microphone signal s2 and obtaining the maximum energy value of each frequency point of the two microphone signals. The specific steps are as follows: Step A1, perform short-time Fourier transform on the main microphone signal s1 and the secondary microphone signal s2 respectively, and then decompose the main microphone signal s1 and the secondary microphone signal s2 into complex representations in the frequency domain, as shown in formula (1), S1 = STFT(s1), S2 = STFT(s2)(1) Wherein, S1 is the complex number of the primary microphone signal s1 in the frequency domain, S2 is the complex number of the secondary microphone signal s2 in the frequency domain, and STFT represents the short-time Fourier transform operator; Step A2, calculate the energy of the complex number S1 of the main microphone signal s1 in the frequency domain and the complex number S2 of the secondary microphone signal s2 in the frequency domain at each frequency point, as shown in formula (2), P1 = abs(S1) 2 ,P2 = abs(S2) 2 (2) Where P1 is the energy of the complex number S1 at each frequency point, P2 is the energy of the complex number S2 at each frequency point, and abs is the modulus of the complex number; Step A3, compare the energy P1 at each frequency point of the complex number S1 and the energy P2 at each frequency point of the complex number S2 and obtain the maximum energy value P3 of each frequency point, as shown in formula (3). P3 = max(P1, P2) (3) Among them, max is the maximum value between the two sequences.

3. The method for spatial information recognition and adjustment of a hearing aid based on dual microphones according to claim 2, characterized in that: Step B, calculate the modulation amount of each frequency point with the largest energy value at each frequency point, the specific steps are as follows: Step B1, calculate the short-time envelope of the first-order smoothing signal energy, as shown in formula (4), P a = a1 P3+(1-a1) P a (4) Among them, P a is the short-time energy envelope of each frequency point, and a1 is the smoothing factor; Step B2: the short-time energy envelope P of each frequency point a Perform long-term minimum statistics and obtain the long-term minimum value P b , as shown in formula (5), P b =a2 P a +(1- a2) P b , when P b ≤P a ; P b =P a , when P b > P a (5) Among them, a2 is the smoothing factor; Step B3, calculate the short-time energy envelope P of each frequency point a and the long-term energy minimum P b The difference between the two and the modulation amount M is obtained, as shown in formula (6): M = 10 lg(P a )-10 lg(P b )(6); Step B4, set the threshold Th1 and threshold Th2 for determining the energy activation state of each frequency point. If the modulation amount M is not greater than the threshold Th1, the frequency point signal is in an unactivated state. If the modulation amount M is not less than the threshold Th2, the frequency point signal is in an activated state. If the threshold Th1<modulation amount M<threshold Th2, the frequency point signal is in a transitional state.

4. The method for spatial information recognition and adjustment of a hearing aid based on dual microphones according to claim 3, characterized in that: Step C, based on the modulation amount of the largest energy value of each frequency point at each frequency point, the minimum mean square error method is used to calculate the background noise coherence coefficient and the activation signal coherence coefficient under each frequency point and each state. Specifically, the minimum mean square error method is used to calculate the background noise coherence coefficient W1 and the activation signal coherence coefficient W2 under each frequency point and each state, as shown in formula (7), W1=W1+d1 (S2-W1 S1) conj(S1), if M≤Th1; W2 = W2 + d2 (S2 - W2 S1) conj(S1), if M ≥ Th2(7) Where d1 is the background noise update rate and d2 is the activation signal update rate.

5. The method for spatial information recognition and adjustment of a hearing aid based on dual microphones according to claim 4, characterized in that: Step D, respectively calculating and distinguishing the background noise coherence coefficient and the activation signal coherence coefficient with each scene parameter stored in the spatial information recognition module, and obtaining the spatial scene corresponding to the ambient sound signal. The specific steps are as follows: Step D1, calculate the first scene discrimination parameter y1 and judge whether the ambient sound signal is a coherent noise scene, as shown in formula (8), y1= sum(abs(W1) 2 C1)+b1(8) Wherein, sum is a sequence summation operator, C1 and b1 are corresponding spatial information identification parameters, if the result of the first scene discrimination parameter y1 is greater than 0, it is determined that the ambient sound signal is in a coherent noise scene, if the result of the first scene discrimination parameter y1 is less than 0, it is determined that the ambient sound signal is in an incoherent noise scene; Step D2, if it is determined that the ambient sound signal is in an incoherent noise scene, then continue to calculate the second scene discrimination parameter y2, the third scene discrimination parameter y3 and the third scene discrimination parameter y4. The specific steps are as follows: Step D21, calculate the second scene discrimination parameter y2, as shown in formula (9), y2 = sum(abs(W2) 2 C2)+b2(9) Wherein, C2 and b2 are both corresponding spatial information identification parameters. If the calculation result of the second scene discrimination parameter y2 is greater than 0, it is determined that the ambient sound signal has a wind noise scene; Step D22, calculate the third scene discrimination parameter y3, as shown in formula (10), <h2 style=";text-align:left;direction:ltr">y3= sum(abs(W2-W3)<h2 style=";text-align:left;direction:ltr"> 2 <h2 style=";text-align:left;direction:ltr"> <h2 style=";text-align:left;direction:ltr"> C3)+b3(10) Wherein, W3, C3 and b3 are all corresponding spatial information identification parameters. If the calculation result of the third scene discrimination parameter y3 is greater than 0, it is determined that the ambient sound signal has a howling scene; Step D23, calculate the fourth scene discrimination parameter y4, as shown in formula (11), y4 = sum(abs(W2-W4) 2 C4)+b4(11) Among them, W4, C4 and b4 are all corresponding spatial information recognition parameters. If the calculation result of the fourth scene discrimination parameter y4 is greater than 0, it is determined that the ambient sound signal is the wearer's own sound scene.

6. The method for spatial information recognition and adjustment of a hearing aid based on dual microphones according to claim 5, characterized in that: Step E, adjusting the hearing aid according to the spatial scene corresponding to the obtained ambient sound signal, and completing the spatial information recognition and adjustment operation of the hearing aid, wherein if the ambient sound signal is identified as a coherent noise scene, the microphone array is adjusted to the omnidirectional sound pickup signal of the main microphone signal s1 and the noise reduction depth of the noise reduction algorithm is reduced; if the ambient sound signal is identified as an incoherent noise scene, the directional sound pickup signals of the main microphone signal s1 and the secondary microphone signal s2 are turned on and the noise reduction depth of the noise reduction algorithm is increased; if the ambient sound signal is identified as a wind noise scene, the single microphone pickup signal of the secondary microphone signal s2 is used and the low-frequency compensation gain in the noise reduction algorithm is reduced; if the ambient sound signal is identified as a howling risk, the high-frequency compensation gain in the noise reduction algorithm is reduced and the tracking speed of the howling suppression algorithm is increased; if the ambient sound signal is identified as the wearer's own sound scene, the low-frequency compensation gain in the noise reduction algorithm is reduced.

7. The method for spatial information recognition and adjustment of a hearing aid based on dual microphones according to claim 6, characterized in that: The directional sound pickup output signal s3 in step E is as shown in formula (12): <h2 style=";text-align:left;direction:ltr">S3=S2+W2<h2 style=";text-align:left;direction:ltr"> <h2 style=";text-align:left;direction:ltr"> S1<h2 style=";text-align:left;direction:ltr"> <h2 style=";text-align:left;direction:ltr"> k-W1<h2 style=";text-align:left;direction:ltr"> <h2 style=";text-align:left;direction:ltr"> S2<h2 style=";text-align:left;direction:ltr"> <h2 style=";text-align:left;direction:ltr"> (1-k)(12) Among them, S3 is the complex number of the directional sound pickup output signal s3 in the frequency domain, and the larger the modulation amount M is, the larger the parameter k is, and the smaller the modulation amount M is, the smaller the parameter k is.

8. A hearing aid spatial information recognition and calibration system based on dual microphones, wherein the spatial information recognition and calibration process of the spatial information recognition and calibration system is based on the spatial information recognition and calibration method according to any one of claims 1 to 7, characterized in that: It includes a signal acquisition module, a modulation amount calculation module, a coherence coefficient calculation module, a space scene discrimination module and a space scene adjustment module. The signal acquisition module is used to use a dual-microphone array pickup module to collect environmental sound signals and obtain a main microphone signal and a secondary microphone signal, and then process the main microphone signal and the secondary microphone signal to obtain a larger energy value of each frequency point of the two microphone signals; The modulation amount calculation module is used to calculate the modulation amount of each frequency point with the largest energy value; The coherence coefficient calculation module is used to calculate the background noise coherence coefficient and the activation signal coherence coefficient at each frequency point in each state based on the modulation amount of the larger energy value at each frequency point and using the minimum mean square error method; The spatial scene identification module is used to calculate and identify the background noise coherence coefficient and the activation signal coherence coefficient and each scene parameter stored in the spatial information identification module and obtain the spatial scene corresponding to the ambient sound signal; The spatial scene adjustment module is used to perform hearing aid adjustment processing according to the obtained ambient sound signal corresponding to the spatial scene and complete the spatial information recognition and adjustment operation of the hearing aid.

Images