Headphone wind noise recognition method and device

The signal is obtained through the dual microphone inside and outside the headphones and frequency-domain filtering process, and the signal coherence is used to identify wind noise, solving the problem of accurate and cost of stroke noise recognition in the prior art, and achieving efficient wind noise recognition effect.

CN114697783BActive Publication Date: 2024-11-26LITTLE BIRD CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011559850.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-25
Publication Date
2024-11-26
Estimated Expiration
2040-12-25

AI Technical Summary

Technical Problem

In the prior art, the recognition accuracy of the headphone wind noise recognition method is poor or the recognition cost is high, and there is a lack of an identification solution for both internal and external dual microphones.

Method used

The headphones are equipped with dual microphones inside and outside to obtain signals, and the signal coherence calculation is used to identify wind noise. Using the existing microphone structure, there is no need to set up additional hardware, which reduces costs and improves recognition accuracy.

Benefits of technology

It achieves a good wind noise recognition effect, reduces hardware costs, and effectively recognizes wind noise in active noise reduction and non-active noise reduction scenarios, improving auditory experience and call clarity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114697783B_ABST
    Figure CN114697783B_ABST
Patent Text Reader

Abstract

The present application discloses a headphone wind noise recognition method and device. The headphone includes a first microphone located outside the ear and a second microphone located inside the ear, and the method includes: obtaining a first microphone signal collected by the first microphone and a second microphone signal collected by the second microphone; obtaining a first frequency domain filter signal based on the first microphone signal and the second microphone signal; obtaining a headphone wind noise recognition result based on the signal coherence of the first microphone signal and the first frequency domain filter signal. The headphone wind noise recognition method of the embodiment of the present application utilizes the first microphone located outside the ear and the second microphone located inside the ear of the headphone to perform wind noise recognition, without the need to set up other microphones, thereby reducing hardware costs and having a better wind noise recognition effect, and is suitable for different wind noise recognition scenarios.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of earphone wind noise recognition, and in particular to an earphone wind noise recognition method and device. Background Art

[0002] In noisy scenarios, people often wear active noise-cancelling headphones to reduce the noise actually heard by the human ear and achieve a better auditory experience. General active noise-cancelling headphones contain a feedforward noise-cancelling microphone outside the ear and a feedback noise-cancelling microphone inside the ear. It uses the feedforward noise-cancelling microphone outside the ear to detect the noise outside the ear, generates an electrical signal through feedforward noise reduction, and transmits it to the speaker to generate an acoustic signal with the same amplitude and opposite direction as the noise inside the ear, thereby achieving the purpose of reducing the noise inside the ear. Since the feedforward noise reduction effect is limited, the feedback noise-cancelling microphone inside the ear can also be used to further reduce the residual noise in the ear through feedback noise reduction, thereby achieving a better noise reduction experience. In addition, the existing feedforward noise-cancelling microphone and feedback noise-cancelling microphone of the active noise-cancelling headphones can also be used for calls, that is, when the user is making a voice call, the noise influence in the uplink voice signal (that is, the voice signal sent to the other party) is suppressed through a processing algorithm.

[0003] In other usage scenarios, although the headset has dual microphones, one inside the ear and one outside the ear, such a headset may not work in active noise reduction mode (neither of the dual microphones works as a noise reduction microphone), or only one of the microphones works as a noise reduction microphone.

[0004] It is inevitable to encounter wind noise during the use of headphones. The principle of wind noise is: when wind encounters an obstacle, it will generate turbulence (also known as spoiler). The turbulence causes the air pressure near the cavity of the microphone to fluctuate. By resonating with the air column in the cavity of the microphone, the noise generated by the turbulence is amplified. This amplified noise is picked up by the microphone, and wind noise is generated. Wind noise is not generated in the human ear, but only at the microphone end. Therefore, after turning on the feedforward noise reduction, the wind noise will be transmitted to the human ear, resulting in a poor experience when listening to music. At the same time, wind noise also affects calls, resulting in reduced call clarity. In order to reduce the impact of wind noise, you must first identify the wind noise, and then take some measures to reduce the impact of wind noise.

[0005] However, the inventors have found that the wind noise recognition method in the prior art needs to be further improved in terms of recognition accuracy or recognition cost, etc. Moreover, in the prior art, there is no solution for wind noise recognition for an internal and external dual-microphone headset. Summary of the invention

[0006] In view of this, the main purpose of the present application is to provide a headphone wind noise recognition method and device, which are used to solve the technical problems of poor recognition accuracy or high recognition cost of wind noise recognition methods in the prior art.

[0007] According to a first aspect of the present application, a method for identifying wind noise in an earphone is provided, wherein the earphone comprises a first microphone located outside the ear and a second microphone located inside the ear, and the method comprises:

[0008] Acquire a first microphone signal collected by the first microphone and a second microphone signal collected by the second microphone;

[0009] Acquire a first frequency domain filtered signal based on the first microphone signal and the second microphone signal;

[0010] A headphone wind noise recognition result is obtained based on the signal coherence of the first microphone signal and the first frequency domain filtered signal.

[0011] According to a second aspect of the present application, a headphone wind noise recognition device is provided, the headphone comprising a first microphone located outside the ear and a second microphone located inside the ear, the device comprising:

[0012] a microphone signal acquisition unit, configured to acquire a first microphone signal acquired by the first microphone and a second microphone signal acquired by the second microphone;

[0013] A frequency domain filtered signal acquisition unit, configured to acquire a first frequency domain filtered signal based on the first microphone signal and the second microphone signal;

[0014] The wind noise recognition unit is used to obtain a headphone wind noise recognition result based on the signal coherence of the first microphone signal and the first frequency domain filtered signal.

[0015] According to a third aspect of the present application, there is provided an earphone, comprising: a first microphone located outside the ear, a second microphone located inside the ear, a speaker, a processor, and a memory storing computer executable instructions.

[0016] When the executable instructions are executed by the processor, the aforementioned headphone wind noise recognition method is implemented.

[0017] According to a fourth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the aforementioned headphone wind noise recognition method is implemented.

[0018] The beneficial effects of the present application are as follows: the earphones used in the earphone wind noise recognition method of the embodiment of the present application include structures such as a first microphone located outside the ear and a second microphone located inside the ear. When performing wind noise recognition, firstly, a first microphone signal collected by the first microphone and a second microphone signal collected by the second microphone can be obtained; then, based on the first microphone signal and the second microphone signal, a first frequency domain filtered signal is obtained; finally, based on the signal coherence of the first microphone signal and the first frequency domain filtered signal, an earphone wind noise recognition result is obtained. The earphone wind noise recognition method of the embodiment of the present application utilizes the earphone's existing first microphone located outside the ear and the second microphone located inside the ear to perform wind noise recognition, without the need to set up other microphones, thereby reducing hardware costs and having a better wind noise recognition effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0020] Figure 1 This is a flow chart of a headphone wind noise recognition method according to an embodiment of the present application;

[0021] Figure 2 This is a schematic diagram of the structure of an earphone in one embodiment of the present application;

[0022] Figure 3 A schematic diagram of a flow chart of a headphone wind noise recognition method according to an embodiment of the present application;

[0023] Figure 4 This is a block diagram of a headphone wind noise recognition device according to an embodiment of the present application;

[0024] Figure 5 This is a schematic diagram of the structure of headphones in another embodiment of the present application. DETAILED DESCRIPTION

[0025] The exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. These embodiments are provided to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art. Although exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein.

[0026] In the prior art, there is a solution that uses a single microphone outside the ear to identify wind noise. This solution requires the establishment of a database of wind noise signals with different wind speeds and directions in advance in order to extract wind noise features and perform comparative identification. This solution is not only highly complex but also has a large computational workload. Once wind noise that is not in the database is encountered, the recognition accuracy will be greatly reduced.

[0027] Another solution is to use dual microphones outside the ear to identify wind noise. It uses information such as the correlation of signals obtained by the dual microphones outside the ear to identify wind noise (the correlation between the noise signals generated by the two microphones outside the ear is very low, while the correlation between other external sounds is higher). It has high accuracy, but requires adding another microphone outside the ear on the basis of the active noise reduction headphones, which will increase hardware costs and processing overhead.

[0028] In addition, when the headphones turn on feedforward noise reduction or hybrid noise reduction (that is, feedforward noise reduction and feedback noise reduction are turned on at the same time), the wind noise outside the ear will be transmitted into the ear after the feedforward noise reduction, making the coherence of the microphone signals inside and outside the ear high. At this time, the coherence information cannot be used to identify the presence of wind noise.

[0029] Based on this, the present invention hopes to use only two microphones, one inside and one outside, to identify wind noise without using the dual microphone solution outside the ear. The present invention proposes a new method to solve the problem of using dual microphones inside and outside the ear to identify wind when using feedforward noise reduction or hybrid noise reduction. At the same time, for non-active noise reduction headphones, dual microphones inside and outside the ear can also be used to identify wind noise and reduce the impact of wind noise. Specifically, Figure 1 A schematic diagram of a flow chart of a method for identifying wind noise in headphones according to an embodiment of the present application is shown. Figure 2 A schematic diagram of the structure of an earphone provided according to an embodiment of the present application is shown, wherein the earphone includes a first microphone 21 located outside the ear, located at a position of the earphone shell close to the outside of the ear, for picking up environmental noise signals outside the ear, a second microphone 22 located inside the ear, located at the front end of the speaker, for picking up noise signals inside the ear, and a speaker 23 for playing sound sources.

[0030] like Figure 1 As shown, the headphone wind noise recognition method of the embodiment of the present application specifically includes the following steps S110 to S130:

[0031] Step S110: acquiring a first microphone signal collected by the first microphone and a second microphone signal collected by the second microphone.

[0032] The first microphone of the embodiment of the present application is arranged outside the ear, and can be used to pick up the first microphone signal outside the ear. The first microphone here can be a feedforward noise reduction microphone with a feedforward noise reduction function, and of course it can also be an ordinary microphone without a feedforward noise reduction function. The second microphone of the embodiment of the present application is arranged inside the ear, and can be used to pick up the second microphone signal inside the ear. The second microphone here can be a feedback noise reduction microphone with a feedback noise reduction function, and of course it can also be an ordinary microphone without a feedback noise reduction function.

[0033] Step S120: acquiring a first frequency domain filtered signal based on the first microphone signal and the second microphone signal.

[0034] To facilitate subsequent calculation and processing of signals, the first microphone signal collected by the first microphone and the second microphone signal collected by the second microphone here can be understood as frequency domain signals obtained after Fourier transform processing. Then, according to different usage scenarios of the headphones, the first microphone signal and the second microphone signal can be subjected to corresponding filtering processing, etc., to obtain a first frequency domain filtered signal as the basic signal for subsequent identification of wind noise.

[0035] Step S130: obtaining a headphone wind noise recognition result based on the signal coherence of the first microphone signal and the first frequency domain filtered signal.

[0036] After obtaining the first frequency domain filtered signal, the signal coherence of the first frequency domain filtered signal and the first microphone signal can be calculated, and the wind noise recognition result can be determined according to the signal correlation, including the recognition results with wind noise and without wind noise.

[0037] The headphone wind noise recognition method of the embodiment of the present application utilizes the existing first microphone located outside the ear and the second microphone located inside the ear of the headphone to recognize wind noise, without the need to set up other additional microphones, thereby reducing hardware costs and achieving better wind noise recognition effects.

[0038] In one embodiment of the present application, if the earphone is not an active noise reduction earphone, the second microphone signal is used as the first frequency domain filtering signal.

[0039] If the earphones of the embodiment of the present application are not active noise reduction earphones, the wind noise outside the ear will not enter the ear, that is, it will not affect the second microphone signal in the ear. Therefore, the second microphone signal can be directly used as the first frequency domain filtering signal.

[0040] In the presence of wind noise, the first microphone signal outside the ear and the second microphone signal inside the ear are not highly correlated, because the wind noise signal caused by turbulence outside the ear microphone basically does not affect the ear. In the absence of wind noise, the ambient sound outside the ear can partially penetrate into the ear, thereby increasing the correlation between the first and second microphone signals. Therefore, calculating the coherence value of the two can facilitate wind noise judgment.

[0041] In another embodiment of the present application, if the headset is an active noise reduction headset and the first microphone is a feedforward noise reduction microphone and the second microphone does not participate in active noise reduction, the following processing is performed on the first microphone signal and the second microphone signal to obtain a first frequency domain filtered signal:

[0042] FB inv =FBmic-FFmic×H ff ×G, (1)

[0043] Among them, FB inv is the first frequency domain filtered signal, FBmic is the second microphone signal, FFmic is the first microphone signal, H ff is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction, and G is the transfer function from the speaker in the headset to the second microphone.

[0044] The above formula (1) can be understood as restoring the signal picked up by the second microphone in the ear to the state when the headphone does not turn on the feedforward noise reduction, so as to obtain the first frequency domain filtering signal of the headphone when only the feedforward noise reduction is turned on. Since the frequency domain signal of the feedforward noise reduction microphone is generated outside the ear and is not affected by the active noise reduction, it is only necessary to consider the influence of the frequency domain signal of the feedforward noise reduction microphone in the ear on the frequency domain signal of the second microphone.

[0045] It can be seen that this solution restores the signal picked up by the second microphone in the ear to the state when the headphone does not turn on feedforward noise reduction through frequency domain filtering. If there is wind noise outside the ear at this time, the restored signals of the first microphone signal outside the ear and the second microphone signal inside the ear will not be relatively correlated; if there is no wind noise outside the ear at this time, the restored signals of the first microphone signal outside the ear and the second microphone signal inside the ear will be relatively correlated. Therefore, by calculating the coherence value of the two, it is convenient to judge the wind noise.

[0046] In another embodiment of the present application, if the headset is an active noise reduction headset and the second microphone is a feedback noise reduction microphone and the first microphone does not participate in active noise reduction, the following processing may be performed to obtain the first frequency domain filtered signal:

[0047] FB inv =FBmic×(1-Hfb ×G), (2)

[0048] Among them, FB inv is the first frequency domain filtered signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, and G is the transfer function from the speaker in the headset to the second microphone.

[0049] Here, the second microphone signal FBmic is multiplied by the gain (1-H fb ×G), the obtained first frequency domain filtered signal FBinv is a frequency domain signal collected by the second microphone without the feedback noise reduction processing.

[0050] It can be seen that this solution restores the signal picked up by the second microphone in the ear to the state when the headset does not turn on feedback noise reduction through frequency domain filtering. If there is wind noise outside the ear at this time, the restored signals of the first microphone signal outside the ear and the second microphone signal inside the ear will not be relatively correlated; if there is no wind noise outside the ear at this time, the restored signals of the first microphone signal outside the ear and the second microphone signal inside the ear will be relatively correlated. Therefore, calculating the coherence value of the two can facilitate wind noise judgment.

[0051] According to a variation of this embodiment, when the headset is an active noise reduction headset and the second microphone is a feedback noise reduction microphone and the first microphone does not participate in active noise reduction, the above-mentioned filtering process may not be performed, and the second microphone signal may be directly used as the first frequency domain filtering signal. At this time, since the first microphone does not participate in active noise reduction, the wind noise outside the ear will not be transmitted to the ear, that is, it will not affect the second microphone signal in the ear. Therefore, the second microphone signal can be directly used as the first frequency domain filtering signal. There is no substantial difference between this and the judgment result of the first frequency domain filtering signal calculated according to formula (2). Because whether the second microphone signal FBmic is multiplied by a gain or not, it will not affect the result of the subsequent calculation of the coherence value with the first microphone signal.

[0052] In another embodiment of the present application, if the headset is an active noise reduction headset, the first microphone is a feedforward noise reduction microphone, and the second microphone is a feedback noise reduction microphone, the following processing is performed on the first microphone signal and the second microphone signal to obtain a first frequency domain filtered signal:

[0053] FB invfb =FBmic×(1-H fb ×G), (3)

[0054] FB inv =FB invfb -FFmic×H ff×G, (4)

[0055] Among them, FB invfb is the inverse feedback filtering result of the second microphone signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, G is the transfer function from the speaker in the headset to the second microphone; FB inv is the first frequency domain filtered signal, FFmic is the first microphone signal, H ff This is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction.

[0056] The above formula (3) can be regarded as an inverse feedback filtering process for the frequency domain signal picked up by the second microphone, i.e., the feedback noise reduction microphone in the ear. The purpose of the inverse feedback filtering process is to restore the frequency domain signal picked up by the feedback noise reduction microphone in the ear to the state when the feedback noise reduction of the headset is not turned on. The above formula (4) can be regarded as further restoring the signal after the inverse feedback filtering process to the state when the headset is not turned on for feedforward noise reduction. Therefore, the embodiment of the present application can obtain the inverse feedback filtering process result before the feedback noise reduction of the headset is turned on through the above formula (3), and can obtain the inverse hybrid filtering process result before the hybrid noise reduction is turned on through the above formula (4), and use the inverse hybrid filtering process result as the first frequency domain filtering signal, which can provide an accurate frequency domain signal basis for subsequent wind noise recognition. The specific calculation process is similar to the previous one and will not be repeated here.

[0057] The transfer function G in the above formulas (1)-(4) can be determined by collecting the loudspeaker sound source signal and the second microphone signal picked up by the second microphone, and calculating the corresponding relationship between the two. There are two ways of calculation here: one is to calculate it offline in advance (that is, to determine it by measurement in the laboratory), and the transfer function G calculated offline in advance can be directly called when it is used, which takes less time. Taking into account that different people wear different earphones, there are also some differences in the structure inside the ear, and the coupling degree between the earphone and the human ear of different people is different, resulting in differences in the collected signals. Therefore, the signal data of multiple people can be collected in advance and then determined by statistical methods to improve the calculation accuracy. Another calculation method is to calculate it in real time, which can calculate a more accurate transfer function G according to the coupling degree between the human ear and the earphone of different people, and the accuracy is relatively higher. The specific method of calculating the transfer function G can be flexibly selected by technicians in this field according to the actual situation, and no specific limitation is made here.

[0058] Specifically, the transfer function G obtained by real-time measurement can be calculated based on the following formula (5):

[0059]

[0060] Where E[] is the expected operation, Ref(f,t) is the frequency domain signal of the sound source played by the speaker at time t, FBmic(f,t) is the second microphone signal at time t, and Ref * is the conjugate signal of the Ref signal.

[0061] In one embodiment of the present application, based on the signal coherence of the first microphone signal and the first frequency domain filtered signal, the headphone wind noise recognition result is obtained, including: if the signal coherence is less than a preset threshold, the headphone wind noise recognition result is determined to be wind noise; if the signal coherence is not less than the preset threshold, the headphone wind noise recognition result is determined to be no wind noise.

[0062] After the first microphone signal and the first frequency domain filtered signal are obtained, the signal coherence between the two can be calculated according to the first microphone signal and the first frequency domain filtered signal, so as to perform wind noise judgment according to the signal coherence.

[0063] Specifically, when the noise outside the ear is normal (non-wind noise), the signal coherence is high, and when the noise outside the ear is wind noise, the signal coherence is low. Based on this, a threshold T can be set in advance, Among them, E[] is the expected operation, FB inv (f, t) is the first frequency domain filtered signal at time t, FFmic(f, t) is the first microphone signal at time t, FB i * nv For FB inv The conjugate signal of the signal. When C is greater than the preset threshold value T, the headphone wind noise recognition result is determined to be no wind noise, and it is considered that the scene outside the ear is non-wind noise; when C is less than the preset threshold value T, the headphone wind noise recognition result is determined to be wind noise, that is, it is considered that the scene outside the ear is wind noise.

[0064] In one embodiment of the present application, after obtaining the first frequency domain filtered signal, it also includes: obtaining a speaker sound source frequency domain signal played by the speaker in the earphone; and performing echo cancellation processing on the first frequency domain filtered signal according to the speaker sound source frequency domain signal.

[0065] When the headset of the embodiment of the present application is in use, the speaker will play the sound source and generate a speaker sound source signal (Ref), such as a music signal and a downlink signal during a call. After the speaker sound source signal is emitted through the speaker, it will cause an echo when it is transmitted to the microphone, resulting in poor audio effect heard by the user on the other side of the call, and will also affect the accuracy of subsequent wind noise recognition. Therefore, echo cancellation processing can be performed here. When performing echo cancellation processing, the embodiment of the present application first obtains the sound source signal played by the speaker, and then converts the speaker sound source signal to the frequency domain through Fourier transform to obtain the speaker sound source frequency domain signal for subsequent calculations.

[0066] Since the echo signal and the loudspeaker sound source signal (Ref) in the signal received by the microphone are related, that is, there is a transfer function (H) from the loudspeaker sound source signal to the microphone echo signal. This related information can be used to estimate the echo information in the signal received by the microphone through the loudspeaker sound source signal, thereby removing the echo signal part of the microphone signal.

[0067] Specifically, the first frequency domain filtered signal obtained above can be used as the target signal (des), and the loudspeaker sound source signal can be used as the reference signal (Ref). The Normalized Least Mean Square algorithm (NLMS) adaptive algorithm can be used to obtain the best filter weights. This filter is the impulse response of the transfer function (H). The echo signal part in the target signal is estimated based on the convolution result of the filter weights and the reference signal. By subtracting this echo signal part from the target signal, the target signal after echo elimination can be obtained. It should be noted that the above echo elimination processing step is only an optional step. If the speaker of the headset does not play the sound source, that is, no loudspeaker sound source signal is generated, there is no echo problem at this time, so the echo elimination step can be omitted.

[0068] In one embodiment of the present application, the method further includes: judging whether the current environment is quiet based on the energy of the first microphone signal and / or the second microphone signal; if it is judged to be a quiet environment, it is not considered to be a wind noise environment even if the signal coherence is less than a preset threshold.

[0069] In a quiet scene with basically no wind noise, the coherence of the microphone signals inside and outside the ear is also low. At this time, an energy threshold can be set based on the energy of the first microphone signal and the second microphone signal to identify whether the environment is quiet. If the signal energy picked up by at least one of the first microphone signal and the second microphone signal is lower than the energy threshold, it can be considered a quiet scene. In other words, although the coherence of the microphone signals inside and outside the ear may also be low at this time, it should not be considered a scene with wind noise. Only when the signal energy picked up by the first microphone signal and the second microphone signal is greater than the energy threshold, the coherence judgment is considered meaningful. The size of the above signal energy can be measured by the size of the sound pressure level. Of course, those skilled in the art can also use other parameters to measure according to actual conditions, which is not specifically limited here.

[0070] In one embodiment of the present application, the method also includes: if the headphone wind noise recognition result determines that the current environment is a wind noise environment, the wind noise is suppressed by any one or more of the following methods: reducing the gain of the first microphone, turning off the first microphone, or attenuating the low-frequency band signal in the first microphone signal collected by the first microphone.

[0071] After identifying that the current scene is a scene with wind noise, corresponding follow-up measures can be taken to reduce the adverse effects of wind noise. For example, the gain of the feedforward noise reduction microphone can be reduced to reduce the wind noise entering the ear due to the feedforward noise reduction being turned on; or the feedforward noise reduction microphone can be turned off to avoid the wind noise entering the ear when the feedforward noise reduction is turned on when there is wind noise; or only the low-frequency signal of the feedforward noise reduction microphone is attenuated, because wind noise is mainly concentrated in the low frequency. This can reduce the wind noise entering the ear due to the feedforward noise reduction being turned on, and retain a certain noise reduction effect in other frequency bands.

[0072] like Figure 3 As shown, taking the embodiment in which both the inner and outer microphones of the ear are used as active noise reduction microphones as an example, a schematic diagram of the headphone wind noise recognition process is provided. First, the first microphone signal collected by the first microphone mic1 and the second microphone signal collected by the second microphone mic2 are obtained, and then the second microphone signal is subjected to inverse feedback filtering to obtain the inverse feedback filtering result FB of the second microphone signal invfb , combined with the first microphone signal, the inverse feedback filtering result FB invfb Then perform inverse feedforward filtering to obtain the inverse hybrid filtering result FB inv , and the inverse hybrid filtering result FB inv As the first frequency domain filtered signal. Then, according to the speaker sound source signal Ref played by the speaker, the first frequency domain filtered signal is subjected to echo cancellation processing. Finally, wind noise is identified according to the signal coherence between the first frequency domain filtered signal after the echo cancellation processing and the first microphone signal, so as to perform subsequent processing such as wind noise suppression and the like according to the wind noise identification result.

[0073] The present application also provides a headphone wind noise recognition device, which is based on the same technical concept as the aforementioned headphone wind noise recognition method. The headphone includes a feedforward noise reduction microphone located outside the ear and a feedback noise reduction microphone located inside the ear. Figure 4 A block diagram of an earphone wind noise recognition device according to an embodiment of the present application is shown. Figure 4 The headphone wind noise recognition device 400 includes: a microphone signal acquisition unit 410, a frequency domain filter signal acquisition unit 420 and a wind noise recognition unit 430.

[0074] A microphone signal acquisition unit 410 is used to acquire a first microphone signal acquired by a first microphone and a second microphone signal acquired by a second microphone;

[0075] A frequency domain filtered signal acquisition unit 420, configured to acquire a first frequency domain filtered signal based on the first microphone signal and the second microphone signal;

[0076] The wind noise recognition unit 430 is used to obtain a headphone wind noise recognition result based on the signal coherence of the first microphone signal and the first frequency domain filtered signal.

[0077] In one embodiment of the present application, the frequency domain filtered signal acquisition unit 420 is specifically used to: if the earphone is not an active noise reduction earphone, use the second microphone signal as the first frequency domain filtered signal.

[0078] In one embodiment of the present application, the frequency domain filtered signal acquisition unit 420 is used to:

[0079] If the headset is an active noise reduction headset and the first microphone is a feedforward noise reduction microphone and the second microphone does not participate in active noise reduction, the following processing is performed on the first microphone signal and the second microphone signal to obtain a first frequency domain filtered signal:

[0080] FB inv =FBmic-FFmic×H ff ×G, (1)

[0081] Among them, FBinv is the first frequency domain filtered signal, FBmic is the second microphone signal, FFmic is the first microphone signal, H ff is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction, and G is the transfer function from the speaker in the headset to the second microphone.

[0082] In one embodiment of the present application, the frequency domain filtered signal acquisition unit 420 is specifically used for:

[0083] If the headset is an active noise reduction headset and the second microphone is a feedback noise reduction microphone and the first microphone does not participate in active noise reduction, the second microphone signal is used as the first frequency domain filtered signal; or

[0084] For the second microphone signal, the following processing is performed to obtain a first frequency domain filtered signal:

[0085] FB inv =FBmic×(1-H fb ×G), (2)

[0086] Among them, FB inv is the first frequency domain filtered signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, and G is the transfer function from the speaker in the headset to the feedback noise reduction microphone.

[0087] In one embodiment of the present application, the frequency domain filtered signal acquisition unit 420 is specifically used for:

[0088] If the headset is an active noise reduction headset, the first microphone is a feedforward noise reduction microphone, and the second microphone is a feedback noise reduction microphone, the following processing is performed on the first microphone signal and the second microphone signal to obtain a first frequency domain filtered signal:

[0089] FB invfb =FBmic×(1-H fb ×G), (3)

[0090] FB inv =FB invfb -FFmic×H ff ×G, (4)

[0091] Among them, FB invfb is the inverse feedback filtering result of the second microphone signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, G is the transfer function from the speaker in the headset to the second microphone; FB inv is the first frequency domain filtered signal, FFmic is the first microphone signal, H ff This is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction.

[0092] In one embodiment of the present application, the wind noise recognition unit 430 is specifically used to: if the signal coherence is less than a preset threshold, determine that the headphone wind noise recognition result is wind noise; if the signal coherence is not less than the preset threshold, determine that the headphone wind noise recognition result is no wind noise.

[0093] In one embodiment of the present application, the device also includes: a speaker sound source frequency domain signal acquisition unit, used to acquire the speaker sound source frequency domain signal played by the speaker in the headset; an echo elimination unit, used to perform echo elimination processing on the first frequency domain filtered signal according to the speaker sound source frequency domain signal.

[0094] In one embodiment of the present application, the device also includes: an environment judgment unit, which is used to judge whether the current environment is quiet based on the energy of the first microphone signal and / or the second microphone signal. If it is judged to be a quiet environment, it is not considered to be a wind noise environment even if the signal coherence is less than a preset threshold.

[0095] In one embodiment of the present application, the device also includes: a wind noise suppression unit, which is used to suppress wind noise by any one or more of the following methods if the headphone wind noise recognition result determines that the current environment is a wind noise environment: reducing the gain of the first microphone, turning off the first microphone, or attenuating the low-frequency band signal in the first microphone signal collected by the first microphone.

[0096] It should be noted that:

[0097] Figure 5 The schematic diagram of the headset is shown in Figure 1. Figure 5 At the hardware level, the headset includes a first microphone, a second microphone, a speaker, a memory and a processor, and optionally also includes an interface module, a communication module, etc. The memory may include a memory, such as a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage, etc. Of course, the headset may also include hardware required for other services.

[0098] The processor, interface module, communication module and memory can be interconnected through an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0099] The memory is used to store computer executable instructions. The memory provides computer executable instructions to the processor through an internal bus.

[0100] The processor executes the computer executable instructions stored in the memory and is specifically used to implement the following operations:

[0101] Acquire a first microphone signal acquired by the first microphone and a second microphone signal acquired by the second microphone;

[0102] Based on the first microphone signal and the second microphone signal, obtaining a first frequency domain filtered signal;

[0103] Based on the signal coherence of the first microphone signal and the first frequency domain filtered signal, a headphone wind noise recognition result is obtained.

[0104] The above application Figure 4The functions performed by the headphone wind noise recognition device disclosed in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in software form. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0105] The headset can also perform Figure 1 The steps of the headphone wind noise recognition method are implemented in Figure 1 The functions of the illustrated embodiment will not be described in detail in the embodiments of the present application.

[0106] The embodiment of the present application further proposes a computer-readable storage medium, which stores one or more programs. When the one or more programs are executed by a processor, the aforementioned headphone wind noise recognition method is implemented, and is specifically used to execute:

[0107] Acquire a first microphone signal acquired by the first microphone and a second microphone signal acquired by the second microphone;

[0108] Based on the first microphone signal and the second microphone signal, obtaining a first frequency domain filtered signal;

[0109] Based on the signal coherence of the first microphone signal and the first frequency domain filtered signal, a headphone wind noise recognition result is obtained.

[0110] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program codes.

[0111] The present application is described by flowcharts and / or block diagrams of the methods, devices (systems), and computer program products of the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0112] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0113] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0114] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0115] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0116] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0117] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0118] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) characterized in that it contains computer-usable program code.

[0119] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A method for identifying wind noise in an earphone, wherein the earphone comprises a first microphone located outside the ear and a second microphone located inside the ear, wherein: The method comprises: Acquire a first microphone signal collected by the first microphone and a second microphone signal collected by the second microphone; Based on the first microphone signal and the second microphone signal, obtaining a first frequency domain filtered signal; Obtaining a headphone wind noise recognition result based on the signal coherence of the first microphone signal and the first frequency domain filtered signal; The acquiring a first frequency domain filtered signal based on the first microphone signal and the second microphone signal comprises: If the headset is an active noise reduction headset and the second microphone is a feedback noise reduction microphone and the first microphone does not participate in active noise reduction, use the second microphone signal as the first frequency domain filtered signal; or For the second microphone signal, the following processing is performed to obtain the first frequency domain filtered signal: Among them, FB inv is the first frequency domain filtered signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, and G is the transfer function from the speaker in the headset to the feedback noise reduction microphone.

2. The method according to claim 1, wherein: If the headset is an active noise reduction headset and the first microphone is a feedforward noise reduction microphone and the second microphone does not participate in active noise reduction, the following processing is performed on the first microphone signal and the second microphone signal to obtain the first frequency domain filtered signal: Among them, FBinv is the first frequency domain filtered signal, FBmic is the second microphone signal, FFmic is the first microphone signal, H ff is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction, and G is the transfer function from the speaker in the headset to the second microphone.

3. The method according to claim 1, wherein: If the headset is an active noise reduction headset, the first microphone is a feedforward noise reduction microphone, and the second microphone is a feedback noise reduction microphone, the following processing is performed on the first microphone signal and the second microphone signal to obtain the first frequency domain filtered signal: Among them, FB invfb is the inverse feedback filtering result of the second microphone signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, G is the transfer function from the speaker in the headset to the second microphone; FB inv is the first frequency domain filtered signal, FFmic is the first microphone signal, H ff This is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction.

4. The method according to any one of claims 1 to 3, characterized in that The headphone wind noise recognition result is obtained based on the signal coherence of the first microphone signal and the first frequency domain filtered signal, including: If the signal coherence is less than a preset threshold, the headphone wind noise recognition result is determined to be wind noise; if the signal coherence is not less than the preset threshold, the headphone wind noise recognition result is determined to be no wind noise.

5. The method according to claim 4, characterized in that After obtaining the first frequency domain filtered signal, the method further includes: Obtaining a frequency domain signal of a speaker sound source played by a speaker in the earphone; According to the loudspeaker sound source frequency domain signal, echo cancellation processing is performed on the first frequency domain filtered signal.

6. The method according to claim 4, characterized in that Also includes: Based on the energy of the first microphone signal and / or the second microphone signal, it is determined whether the current environment is quiet. If it is determined to be a quiet environment, it is not considered to be a wind noise environment even if the signal coherence is less than a preset threshold.

7. The method according to any one of claims 1 to 3, characterized in that The method further comprises: If the headphone wind noise recognition result determines that the current environment is a wind noise environment, the wind noise is suppressed by any one or more of the following methods: reducing the gain of the first microphone, turning off the first microphone, or attenuating the low-frequency band signal in the first microphone signal collected by the first microphone.

8. An earphone wind noise recognition device, the earphone comprising a first microphone located outside the ear and a second microphone located inside the ear, characterized in that: The device comprises: a microphone signal acquisition unit, configured to acquire a first microphone signal acquired by the first microphone and a second microphone signal acquired by the second microphone; A frequency domain filtered signal acquisition unit, configured to acquire a first frequency domain filtered signal based on the first microphone signal and the second microphone signal; A wind noise recognition unit is used to obtain a headphone wind noise recognition result based on the signal coherence of the first microphone signal and the first frequency domain filtered signal; the frequency domain filtered signal acquisition unit is specifically used to: If the headset is an active noise reduction headset and the second microphone is a feedback noise reduction microphone and the first microphone does not participate in active noise reduction, use the second microphone signal as the first frequency domain filtered signal; or For the second microphone signal, the following processing is performed to obtain the first frequency domain filtered signal: Among them, FB inv is the first frequency domain filtered signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, and G is the transfer function from the speaker in the headset to the feedback noise reduction microphone.

9. The device according to claim 8, wherein: The frequency domain filtering signal acquisition unit is used for: If the headset is an active noise reduction headset and the first microphone is a feedforward noise reduction microphone and the second microphone does not participate in active noise reduction, the following processing is performed on the first microphone signal and the second microphone signal to obtain the first frequency domain filtered signal: Among them, FBinv is the first frequency domain filtered signal, FBmic is the second microphone signal, FFmic is the first microphone signal, H ff is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction, and G is the transfer function from the speaker in the headset to the second microphone.

10. The device according to claim 8, wherein: The frequency domain filtering signal acquisition unit is specifically used for: If the headset is an active noise reduction headset, the first microphone is a feedforward noise reduction microphone, and the second microphone is a feedback noise reduction microphone, the following processing is performed on the first microphone signal and the second microphone signal to obtain the first frequency domain filtered signal: Among them, FB invfb is the inverse feedback filtering result of the second microphone signal, FBmic is the second microphone signal, H fb is the frequency response of the feedback filter used when the headset currently turns on feedback noise reduction, G is the transfer function from the speaker in the headset to the second microphone; FB inv is the first frequency domain filtered signal, FFmic is the first microphone signal, H ff This is the frequency response of the feedforward filter used when the headset currently turns on feedforward noise reduction.

11. The device according to any one of claims 8 to 10, characterized in that: The wind noise recognition unit is specifically used for: If the signal coherence is less than a preset threshold, the headphone wind noise recognition result is determined to be wind noise; if the signal coherence is not less than the preset threshold, the headphone wind noise recognition result is determined to be no wind noise.

12. The device according to claim 11, characterized in that The device also includes: A loudspeaker sound source frequency domain signal acquisition unit, used to acquire a loudspeaker sound source frequency domain signal played by a loudspeaker in the earphone; The echo cancellation unit is used to perform echo cancellation processing on the first frequency domain filtered signal according to the loudspeaker sound source frequency domain signal.

13. The device according to claim 11, characterized in that The device also includes: The environment judgment unit is used to judge whether the current environment is quiet based on the energy of the first microphone signal and / or the second microphone signal. If it is judged to be a quiet environment, it is not considered to be a wind noise environment even if the signal coherence is less than a preset threshold.

14. The device according to any one of claims 8 to 10, characterized in that: The device also includes: A wind noise suppression unit is used to suppress wind noise by any one or more of the following methods if the headphone wind noise recognition result determines that the current environment is a wind noise environment: reducing the gain of the first microphone, turning off the first microphone, or attenuating the low-frequency band signal in the first microphone signal collected by the first microphone.

15. An earphone, characterized in that: include: a first microphone located outside the ear, a second microphone located inside the ear, a speaker, a processor, a memory storing computer executable instructions, When the executable instructions are executed by the processor, the headphone wind noise recognition method of any one of claims 1 to 7 is implemented.