Method, system and device for processing earphone wind noise, earphone and program product

Abstract

The invention provides a method, a system and a device for processing wind noise of an earphone, the earphone and a program product. The method comprises the following steps: acquiring a plurality of environmental noise acquisition signals through a plurality of feed-forward microphones of the earphone; wind noise information in the wind noise environment is determined according to the multiple environment noise collection signals, and the wind noise information comprises the target wind direction and the target wind noise intensity; according to the wind noise information, controlling a target on-off state and a target filtering coefficient of a filter on each first path to obtain a target noise signal; in different target wind directions and target wind noise intensity states, the target on-off states and target filtering coefficients of the filter are different; controlling a loudspeaker to output a target noise signal to form a secondary sound source; and the secondary sound source is used for offsetting the environmental noise in-ear signal reaching the human ear through the second path. According to the method, the target on-off states and the target filtering coefficients of the filters are controlled under the conditions of different wind directions and different wind noise intensities, and noise reduction can be carried out in different wind noise environments.

Description

Technical Field

[0001] The present application belongs to the technical field of audio noise reduction, and in particular, relates to a method, system, device, earphone and program product for processing earphone wind noise. Background Art

[0002] Since in-ear and semi-in-ear headphones are uncomfortable to wear for a long time, open-ear headphones have become popular in the market in recent years due to their comfort and safety. However, compared with other types of headphones, open-ear headphones lack passive noise reduction, and it is impossible to hear music and call voices in some noisy scenes. Therefore, active noise reduction of open-ear headphones is necessary.

[0003] However, active noise-cancelling headphones have always been troubled by wind noise. Open-type headphones have a low frequency response at low frequencies. To achieve a certain active noise reduction effect, the filter needs a higher gain. When encountering wind noise, the microphone signal is easily saturated and emits a whirring noise. When facing wind noise, current noise-cancelling headphones turn off the feedforward microphone to prevent the speaker from emitting a whirring noise. Summary of the invention

[0004] The embodiments of the present application provide a method, system, device, earphone and program product for processing earphone wind noise, which can solve the problem of how to reduce noise of earphones in a wind noise environment.

[0005] In a first aspect, an embodiment of the present application provides a method for processing earphone wind noise, which is applied to earphones, and the method includes:

[0006] Acquire multiple environmental noise collection signals through multiple feedforward microphones of the headset; each of the feedforward microphones corresponds to a first path; each of the environmental noise collection signals is transmitted via one of the first paths;

[0007] Determining wind noise information in a wind noise environment according to the multiple environmental noise acquisition signals, the wind noise information including a target wind direction and a target wind noise intensity;

[0008] According to the wind noise information, the target on / off state and the target filter coefficient of each filter on the first path are controlled to obtain a target noise signal; the target on / off state and the target filter coefficient of the filter are different under different target wind directions and target wind noise intensity states;

[0009] The loudspeaker is controlled to output the target noise signal to form a secondary sound source; the secondary sound source is used to cancel the ambient noise ear signal reaching the human ear through the second path.

[0010] This embodiment can obtain multiple environmental noise collection signals through multiple feedforward microphones in the earphones, and determine the wind direction and wind noise intensity based on the multiple environmental noise collection signals, so as to adjust the filter coefficient in a targeted manner to obtain the target noise signal, and when the environmental noise in-ear signal reaches the speaker, the target noise signal can be played through the speaker to form a secondary sound source, thereby realizing active cancellation of the environmental noise in-ear signal entering the human ear.

[0011] In an optional implementation of the first aspect, the method further includes:

[0012] Acquire a preset adjustment strategy, wherein the preset adjustment strategy at least includes the target opening and closing state and the target filter coefficient of each filter under each target wind noise intensity for different target wind directions;

[0013] The step of controlling the target on / off state and the target filter coefficient of each filter on the first path according to the wind noise information to obtain a target noise signal includes:

[0014] According to the wind noise information, determining the target on / off state and the target filter coefficient of each filter corresponding to the wind noise information from the preset adjustment strategy;

[0015] Each filter is controlled according to the target on / off state and the target filter coefficient corresponding to each filter to obtain the target noise signal.

[0016] This embodiment uses a preset adjustment strategy to specifically adjust the two filters under different wind directions and different wind noise intensities, thereby achieving a better noise reduction effect.

[0017] In an optional implementation of the first aspect, the filter includes a first filter and a second filter;

[0018] The step of determining the target on / off state and the target filter coefficient of each filter corresponding to the wind noise information from the preset adjustment strategy according to the wind noise information includes:

[0019] When the target wind noise intensity is at a first intensity level, the filter coefficients of the first filter and the second filter are controlled to be first filter coefficients;

[0020] When the target wind noise intensity is at the second intensity level, controlling the filter coefficient of one of the first filter and the second filter to be the second filter coefficient and the filter coefficient of the other filter to be the third filter coefficient, or controlling the first filter and the second filter to be the second filter coefficient, wherein the second filter coefficient is smaller than the first filter coefficient and the third filter coefficient is larger than the first filter coefficient;

[0021] When the target wind noise intensity is the third intensity level, one of the first filter and the second filter is controlled to be turned off, and the filter coefficient of the other filter is controlled to be a fourth filter coefficient, or both the first filter and the second filter are controlled to be turned off, wherein the fourth filter coefficient is greater than the first filter coefficient.

[0022] This embodiment specifically designs different filter coefficients for wind noises of three different intensity levels. When the target wind noise intensity is determined, the two filters are controlled to perform filtering with the filter coefficients corresponding to the target wind noise intensity.

[0023] In an optional implementation of the first aspect, when the target wind noise intensity is a second intensity level, controlling a filter coefficient of one of the first filter and the second filter to be a second filter coefficient and a filter coefficient of the other filter to be a third filter coefficient, or controlling both the first filter and the second filter to be the second filter coefficient, includes:

[0024] The target wind direction is forward wind, and when the target wind noise intensity is at the second intensity level, the filter coefficient of the first filter is controlled to be the second filter coefficient, and the filter coefficient of the second filter is controlled to be the third filter coefficient;

[0025] The target wind direction is backward wind, the filter coefficient of the first filter is controlled to be the third filter coefficient, and the filter coefficient of the second filter is controlled to be the second filter coefficient;

[0026] The target wind direction is side wind, and the first filter and the second filter are controlled to have a second filter coefficient.

[0027] In this embodiment, when the target wind noise intensity is the second intensity level, different adjustment strategies are formulated for the forward wind, backward wind, and side wind, so that under different target wind directions, the two filters are controlled to filter with the filter coefficients corresponding to the target wind directions.

[0028] In an optional implementation of the first aspect, when the target wind noise intensity is at a third intensity level, controlling one of the first filter and the second filter to be turned off, and controlling a filter coefficient of the other filter to be a fourth filter coefficient, or controlling both the first filter and the second filter to be turned off, includes:

[0029] The target wind direction is forward wind, and when the target wind noise intensity is at the third intensity level, the first filter is controlled to be closed, and the filter coefficient of the second filter is controlled to be the fourth filter coefficient;

[0030] The target wind direction is backward wind, the filter coefficient of the first filter is controlled to be the fourth filter coefficient, and the second filter is controlled to be closed;

[0031] The target wind direction is side wind, and the first filter and the second filter are controlled to be closed.

[0032] In this embodiment, when the target wind noise intensity is the third intensity level, different adjustment strategies are formulated for the forward wind, backward wind, and side wind, so that under different target wind directions, the two filters are controlled to filter with the filter coefficients corresponding to the target wind directions.

[0033] In an optional implementation of the first aspect, the multiple environmental noise collection signals include a first environmental noise collection signal and a second environmental noise collection signal; and determining the target wind direction in the wind noise information according to the multiple environmental noise collection signals includes:

[0034] Preprocessing the first environmental noise collection signal and the second environmental noise collection signal to retain the frequency band of the wind noise signal;

[0035] Extracting the maximum delay time, energy difference and phase difference characteristics between the first environmental noise acquisition signal and the second environmental noise acquisition signal after preprocessing;

[0036] The target wind direction is determined according to the maximum delay time, energy difference and phase difference characteristics.

[0037] This embodiment can accurately determine the wind direction by analyzing the maximum delay time, energy difference and phase difference characteristics between the first environmental noise collection signal and the second environmental noise collection signal.

[0038] In an optional implementation of the first aspect, determining the target wind direction according to the maximum delay time, energy difference, and phase difference characteristics includes:

[0039] Satisfy τ max <-τ thresh , ΔE low>E thresh,low , |Δφ|<φ thresh , determined as forward wind;

[0040] Satisfy τ max >τ thresh , ΔR low <-E thresh,low , |Δφ|<φ thresh , determined as the back wind;

[0041] Satisfy |τ max |<τ thresh , |ΔE low | <E thresh,low , |Δφ|>φ thresh , determined as side wind;

[0042] Among them, τ max is the maximum delay time; τ thresh is the delay time threshold; ΔE low is the energy difference; E thresh,low is the energy difference threshold; Δφ is the phase difference; φ thresh is the phase difference threshold.

[0043] This embodiment can accurately determine the wind direction through the above algorithm.

[0044] In an optional implementation of the first aspect, the target wind noise intensity is determined by a wind noise intensity score, and the wind noise intensity score is determined based on one or more of a delay time score, an energy difference score, a phase difference score, an autocorrelation score, and a spectrum concentration score;

[0045] determining the target wind noise intensity according to the wind noise intensity score; the wind noise intensity includes at least three intensity levels of wind noise; the at least three intensity levels of wind noise include a first intensity level, a second intensity level and a third intensity level; the third intensity level is greater than the second intensity level, and the second intensity level is greater than the first intensity level;

[0046] The delay time score is determined according to the relationship between the maximum delay time between the first environmental noise collection signal and the second environmental noise collection signal and the delay time threshold;

[0047] The energy difference score is determined according to a relationship between an energy difference between the first environmental noise acquisition signal and the second environmental noise acquisition signal and an energy difference threshold;

[0048] The phase difference score is determined according to a relationship between a phase difference between the first environmental noise acquisition signal and the second environmental noise acquisition signal and a phase difference threshold;

[0049] The autocorrelation score is determined according to the autocorrelation between the first environmental noise acquisition signal and the second environmental noise acquisition signal after preprocessing;

[0050] The spectrum concentration score is determined according to the spectrum concentration between the first environmental noise collection signal and the second environmental noise collection signal after preprocessing.

[0051] This implementation can accurately determine the wind noise intensity through a scoring mechanism.

[0052] In an optional implementation of the first aspect, the first filter and the second filter both include a plurality of second-order IIR filters connected in series, and each of the second-order IIR filters has a different frequency range.

[0053] In this embodiment, two filters are designed as a plurality of second-order IIR filters connected in series, so that a specific frequency band can be adjusted in a targeted manner to achieve a better noise reduction effect.

[0054] In a second aspect, an embodiment of the present application provides a headphone wind noise processing system, including a headphone and a test device;

[0055] The test equipment is used to:

[0056] Performing system identification on a plurality of first systems in the earphone through a frequency sweep signal to determine a filter coefficient of each filter in the earphone; any of the first systems includes any feedforward microphone and a speaker;

[0057] The earphone is used to perform the method as described in any one of the first aspects.

[0058] In a third aspect, an embodiment of the present application provides a headphone wind noise processing device, which is applied to a headphone, and the device includes:

[0059] An acquisition module, configured to acquire a plurality of environmental noise acquisition signals through a plurality of feedforward microphones of the headset; each of the feedforward microphones corresponds to a first path; and each of the environmental noise acquisition signals is transmitted via a first path;

[0060] A determination module, configured to determine wind noise information in a wind noise environment according to the plurality of environmental noise acquisition signals, wherein the wind noise information includes a target wind direction and a target wind noise intensity;

[0061] A control module, configured to control a target on / off state and a target filter coefficient of each filter on the first path according to the wind noise information, so as to obtain a target noise signal; the target on / off state and the target filter coefficient of the filter are different under different target wind directions and target wind noise intensity states;

[0062] The playing module is used to control the loudspeaker to output the target noise signal to form a secondary sound source; the secondary sound source is used to offset the ambient noise ear signal reaching the human ear through the second path.

[0063] In a fourth aspect, an embodiment of the present application provides a headset, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in any one of the first aspects when executing the computer program.

[0064] In a possible implementation of the fourth aspect, the earphone is an open-type earphone, comprising a body, an ear hook and a hinge connection part; and the multiple feedforward microphones are located on one or more of the body, the ear hook and the hinge connection part.

[0065] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method as described in any one of the first aspects is implemented.

[0066] In a sixth aspect, an embodiment of the present application provides a computer program product, which, when executed on a headset, enables the headset to execute the method as described in any one of the first aspects.

[0067] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0068] The beneficial effects of the embodiments of the present application compared with the prior art are as follows: the embodiments of the present application design multiple feedforward microphones in the earphones, at least one of the multiple feedforward microphones can obtain the environmental noise collection signal in advance of the speaker on the noise propagation path, determine the wind direction and wind noise intensity according to the multiple environmental noise collection signals, and control the on / off state and filter coefficient of each filter for different wind directions and wind noise intensities, so as to obtain the target noise signal. When the environmental noise in-ear signal reaches the speaker, the secondary sound source generated by the speaker playing the target noise signal has an amplitude equivalent to that of the environmental noise in-ear signal, an opposite phase, and the same frequency, thereby being able to offset or partially offset the environmental noise in-ear signal reaching the human ear, thereby completing noise reduction for different wind noise environments. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0070] Figure 1 A top view of a conventional single feed-forward microphone active noise reduction headset worn on a person's head is shown;

[0071] Figure 2 A top view of a conventional single feed-forward microphone active noise reduction headset worn on a person's head in a wind noise environment;

[0072] Figure 3a A front view of an open-type earphone disclosed in an embodiment of the present application is shown;

[0073] Figure 3b A rear view of an open-type earphone disclosed in an embodiment of the present application is shown;

[0074] Figure 4 A top view showing a pair of headphones in a wind noise environment according to an embodiment of the present application being worn on a person's head;

[0075] Figure 5 A schematic diagram showing a flow chart of a method for processing headphone wind noise disclosed in an embodiment of the present application is shown;

[0076] Figure 6 A schematic diagram showing a method for processing headphone wind noise disclosed in an embodiment of the present application is shown;

[0077] Figure 7 A top view showing a pair of headphones according to an embodiment of the present application being worn on a person's head;

[0078] Figure 8 A schematic diagram showing the principle of a headphone wind noise processing system provided in an embodiment of the present application is shown;

[0079] Fig. 9 A structural block diagram of headphone wind noise processing provided by an embodiment of the present application is shown. DETAILED DESCRIPTION

[0080] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0081] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0082] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0083] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0084] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0085] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0086] Figure 1 A top view showing a conventional single feedforward microphone active noise reduction headset being worn on a person's head, Figure 2 FIG. 1 is a top view of a conventional single feedforward microphone 110 active noise reduction headset worn on a person's head in a wind noise environment, from Figure 1 and Figure 2 It can be seen that the traditional single feedforward microphone 110 active noise reduction headset can actively reduce noise in a narrow direction and the frequency band (ie, the frequency range of the ambient noise signal eliminated) is also narrow.

[0087] In addition, when wearing headphones in an environment with wind noise, you can often hear a whirring sound. This is caused by the following reasons: (1) Wind noise. Wind blowing directly on the headphones, especially the two feedforward microphones of the headphones, will produce wind noise. This noise will be captured and amplified by the feedforward microphones, and then played through the speakers of the headphones. (2) Wind speed and direction. The speed and direction of the wind will also affect the size of the wind noise. The greater the wind speed, the more obvious the wind noise is usually; if the wind direction is directly facing the headphones, it will also cause greater wind noise.

[0088] Traditional noise-canceling headphones will produce a whirring noise when encountering wind noise. Especially for open-type noise-canceling headphones, the filter needs a higher gain. When encountering wind noise, the low-frequency signal collected by the feedforward microphone is more likely to be saturated, making it easier to produce a whirring noise.

[0089] To this end, an embodiment of the present application provides a method for processing headphone wind noise, which can be applied to various types of headphones. For example, depending on the wearing method, it can include open-type headphones, earbud headphones, head-mounted headphones, in-ear headphones, semi-in-ear headphones, neck-hanging headphones, bone conduction headphones, ear clip headphones, headphones with feedback microphones, etc.

[0090] Figure 3a A front view of an open-type earphone disclosed in an embodiment of the present application is shown. Figure 3b A rear view of an open-type headset disclosed in an embodiment of the present application is shown. The open-type headset includes a body 170, an ear hook 190 and a shaft connection portion 180, and the ear hook is rotatably mounted on the body via the shaft connection portion. A speaker 120, a control circuit, a first feedforward microphone 130, a second feedforward microphone 140, a first filter 150, a second filter 160, etc. are installed in the body. The distance between one end of the first feedforward microphone for collecting sound and one end of the second feedforward microphone for collecting sound is greater than a preset distance. It is easy to understand that the preset distance between the first feedforward microphone and the second feedforward microphone is different for headphones of different models and types. When the user is in an upright state and the earphones are worn on the user's ears, the speaker is located on the side of the main body close to the user's eardrum, the first feedforward microphone and the second feedforward microphone are both located on the side of the main body away from the user's eardrum, and the first feedforward microphone is positioned as far forward as possible (the front refers to the front when the user is in an upright state), and the second feedforward microphone is positioned as far back as possible (the back refers to the back when the user is in an upright state). As a result, the two feedforward microphones can obtain ambient noise collection signals from different directions in advance at the front and back positions relative to the speaker and process them through filters, thereby suppressing the ambient noise in-ear signals entering the human ear.

[0091] Figure 4The top view of a pair of headphones in a wind noise environment according to an embodiment of the present application is shown. The wind direction of the headphones may be forward wind, side wind or rear wind.

[0092] It is easy to understand that the first feedforward microphone and the second feedforward microphone can be located on the body, or on one or more of the body, the ear hook, and the shaft connection portion. For example, the first feedforward microphone can be installed on the body, and the second feedforward microphone can be installed on the ear hook; or, the first feedforward microphone can be installed on the shaft connection portion, and the second feedforward microphone can be installed on the ear hook; or, the first feedforward microphone can be installed on the body, and the second feedforward microphone can be installed on the shaft connection portion; or, both the first feedforward microphone and the second feedforward microphone can be installed on the ear hook.

[0093] Figure 5 The schematic diagram of the method for processing headphone wind noise disclosed in an embodiment of the present application is shown. The ambient noise signal reaches the human ear through three paths. The first feedforward microphone and the first filter are located on the first reference path; the second feedforward microphone and the second filter are located on the second reference path. The first ambient noise collection signal collected by the first feedforward microphone is filtered by the first filter, and the second ambient noise collection signal collected by the second feedforward microphone is filtered by the second filter. After the two filtered ambient noise signals are superimposed, a secondary sound source is formed through a speaker (located on the secondary path); the ambient noise in-ear signal is directly transmitted through the second path (i.e., Figure 5 The secondary sound source is used to cancel the ambient noise signal. Regardless of whether the noise is transmitted from the front, back or side, one of the two feedforward microphones can filter the collected ambient noise signal before the speaker, and play the secondary sound source when the ambient noise signal reaches the speaker, thereby suppressing or canceling the ambient noise signal.

[0094] Currently, neither open-type headphones (without passive noise reduction function) nor in-ear headphones (with passive noise reduction function) can prevent the ambient noise signal from entering the human ear.

[0095] Figure 6 A flow chart of a method for processing headphone wind noise disclosed in an embodiment of the present application is shown, and the method includes S210-S240.

[0096] S210: Acquire multiple environmental noise collection signals through multiple feedforward microphones of the headset; each feedforward microphone corresponds to a first path; and each environmental noise collection signal is transmitted via a first path.

[0097] It should be noted that the multiple feedforward microphones refer to more than two (including two) feedforward microphones, and each feedforward microphone corresponds to an environmental noise collection signal.

[0098] Exemplarily, the multiple feedforward microphones include a first feedforward microphone and a second feedforward microphone, the first path includes a first reference path and a second reference path, and the multiple ambient noise collection signals include a first ambient noise collection signal and a second ambient noise collection signal, then S210 is: obtaining the first ambient noise collection signal through the first feedforward microphone of the headset, and obtaining the second ambient noise collection signal through the second feedforward microphone. The first feedforward microphone corresponds to the first reference path, the second feedforward microphone corresponds to the second reference path, the first ambient noise collection signal is transmitted via the first reference path, and the second ambient noise collection signal is transmitted via the second reference path.

[0099] S220: Determine wind noise information in a wind noise environment according to the multiple environmental noise collection signals, where the wind noise information includes a target wind direction and a target wind noise intensity.

[0100] Taking two feedforward microphones as an example, S220 is: determining wind noise information in a wind noise environment according to the first environmental noise collection signal and the second environmental noise collection signal.

[0101] It is easy to understand that in the embodiment of the present application, there may be more than two feedforward microphones. If the headset includes two feedforward microphones, the target wind direction may be forward wind, backward wind, and side wind; if the headset includes three or more feedforward microphones, the wind direction recognized by the headset may be forward wind, side wind, backward wind, front side wind, rear side wind, forward wind above X°, backward wind above X°, etc. The target wind noise intensity can be set to multiple wind noise intensity levels, such as no wind (corresponding to the first intensity level), weak wind (corresponding to the second intensity level), and strong wind (corresponding to the third intensity level).

[0102] The wind direction and wind noise intensity will greatly affect the noise reduction effect of headphones. Therefore, by accurately determining the wind direction and wind noise intensity, targeted noise reduction can be performed.

[0103] When the headphones are in a wind noise environment, the amplitude of the low-frequency signal collected by the feedforward microphone blown by the wind will increase, which will be higher than the amplitude of the real ambient noise signal in the low frequency band. If it is not processed, the speaker will make a whirring sound.

[0104] S230: According to the wind noise information, the target on / off state and the target filter coefficient of each filter on the first path are controlled to obtain a target noise signal; under different target wind directions and target wind noise intensity states, the target on / off state and the target filter coefficient of the filter are different.

[0105] It should be noted that the feedforward microphone and the filter in the earphone are in one-to-one correspondence, and each first path has a feedforward microphone and a filter (the filter can be a series connection of multiple second-order IIR filters of different frequency bands).

[0106] Taking two feedforward microphones as an example, the two feedforward microphones correspond to two filters, namely the first filter and the second filter, then S230 is: according to the wind noise information, control the target opening and closing state and the target filter coefficient of the first filter on the first reference path and the second filter on the second reference path to obtain the target noise signal; under different target wind directions and target wind noise intensity states, the target opening and closing state and the target filter coefficient of the first filter and the second filter are different.

[0107] Optionally, after the wind noise information is determined, you can first obtain a preset adjustment strategy, and then determine the target on / off state according to the preset adjustment strategy and adjust the current filter coefficient / default filter coefficient to the target filter coefficient; or, you can determine to switch the current filter coefficient to the corresponding target filter coefficient based on the correspondence between the wind noise information stored in the earphones and the target on / off state and the target filter coefficient.

[0108] Exemplarily, the embodiments of the present application have different adjustment strategies for the first filter and the second filter for different wind directions and different wind noise intensities, specifically adjusting the filter coefficients of the two filters or opening and closing the filters, wherein the filter coefficients include gain, weight, etc., wherein the weights include the first weight of the first filter and the second weight of the second filter, and the sum of the first weight and the second weight is 1. Optionally, the first weight and the second weight can be preset fixed values, or they can be adjusted specifically in the face of different scenarios. By adjusting the gain of the first filter, the amplitude of the first environmental noise acquisition signal can be enhanced or weakened. Similarly, by adjusting the gain of the second filter, the amplitude of the second environmental noise acquisition signal can be enhanced or weakened. Based on these preset adjustment strategies, after filtering the first environmental noise acquisition signal and the second environmental noise acquisition signal by the first filter and the second filter, the problem of increasing or decreasing the amplitude of the first environmental noise acquisition signal and the second environmental noise acquisition signal in the low frequency band due to wind noise can be eliminated or partially eliminated.

[0109] The target noise signal is formed by superposition of a first noise reduction signal obtained by filtering with the first filter and a second noise reduction signal obtained by filtering with the second filter.

[0110] S240: Control the loudspeaker to output the target noise signal to form a secondary sound source; the secondary sound source is used to cancel the ambient noise in-ear signal reaching the human ear through the second path.

[0111] The target noise signal is an electrical signal, the secondary sound source is a sound wave signal, and the ambient noise input signal reaching the human ear is also a sound wave signal.

[0112] See also Figure 1 The traditional single feedforward microphone has a small angle range for suppressing ambient noise. This is because the single feedforward microphone is restricted by the installation position. Ambient noise signals beyond its collection range will reach the human ear at the same time or faster, causing the headphones to not have time to process these ambient noise signals. The previous method was to predict the amplitude, phase and frequency of the noise, and then process the predicted values ​​to form a secondary sound source to offset the ambient noise in-ear signal. However, the amplitude and frequency of the secondary sound source may not match the ambient noise in-ear signal entering the human ear, and the phase may not be opposite, resulting in poor noise reduction effect of single feedforward microphone noise reduction headphones.

[0113] Figure 7 A top view of a pair of headphones according to an embodiment of the present application being worn on a person's head is shown, wherein the first feedforward microphone can collect a first ambient noise collection signal from the front and sides, and the second feedforward microphone can collect a second ambient noise collection signal from the rear and sides. By providing two feedforward microphones and corresponding filters, the embodiment of the present application can suppress a wider range of ambient noise in-ear signals entering the ear. Regardless of forward wind, backward wind or side wind, at least one of the two feedforward microphones can first process the collected ambient noise collection signal through two filters and then generate a secondary sound source through the speaker, and then wait until the ambient noise in-ear signal reaches the speaker to play the secondary sound source, so that the phase of the secondary sound source can be opposite to the phase of the ambient noise in-ear signal, with the same amplitude and frequency, thereby improving the noise reduction effect. For example, when the earphone faces the wind, the path of the wind noise signal entering the human ear is first through the first feedforward microphone, then through the speaker, and then into the human ear. During the period of time when the ambient noise in-ear signal goes from the first feedforward microphone to the speaker, the first feedforward microphone will collect the wind noise signal and pass it to the filter for filtering. At the same time, the second feedforward microphone will filter synchronously according to the adjustment strategy. After the signal is superimposed, when the ambient noise in-ear signal reaches the speaker, the speaker plays the secondary sound source. The secondary sound source has basically the same frequency and amplitude as the ambient noise in-ear signal entering the human ear, and the phase is opposite, so that the secondary sound source can better eliminate the ambient noise in-ear signal entering the human ear. Therefore, noise reduction based on two feedforward microphones has a better noise reduction effect.

[0114] The embodiment of the present application designs multiple feedforward microphones in the earphones, at least one of the multiple feedforward microphones can obtain multiple environmental noise collection signals in advance of the speaker on the noise propagation path, determine the wind direction and wind noise intensity according to the multiple environmental noise collection signals, and control the on and off state and filter coefficient of each filter for different wind directions and wind noise intensities, so as to obtain the target noise signal. When the environmental noise in-ear signal reaches the speaker, the speaker plays the target noise signal to generate a secondary sound source, whose amplitude is equivalent to the amplitude of the environmental noise in-ear signal, the phase is opposite, and the frequency is the same, thereby offsetting or partially offsetting the environmental noise in-ear signal reaching the human ear, thereby completing noise reduction in different wind noise environments.

[0115] As an optional implementation, in this embodiment, the multiple environmental noise collection signals include a first environmental noise collection signal and a second environmental noise collection signal. In S220, the target wind direction in the wind noise information is determined according to the multiple environmental noise collection signals, including S221-S223.

[0116] S221: Preprocess the first environmental noise collection signal and the second environmental noise collection signal to retain the frequency band of the wind noise signal.

[0117] Optionally, the preprocessing includes filtering out irrelevant frequencies, removing DC offsets, and retaining the main frequency band of the wind noise signal, for example, retaining the frequency band from 20 Hz to 500 Hz.

[0118] The first environmental noise signal collected by the first feedforward microphone is recorded as x f (t), the second ambient noise signal collected by the second feedforward microphone is recorded as x r (t), the preprocessing steps are as follows:

[0119] (1) Removing DC offset: Calculate the mean of the first environmental noise acquisition signal and the second environmental noise acquisition signal and remove the mean:

[0120]

[0121] in and is the first environmental noise acquisition signal and the second environmental noise acquisition signal x f (t) and x r The mean of (t).

[0122] (2) Bandpass filtering: In order to retain the main frequency band of the wind noise signal (for example, 20 Hz to 500 Hz), a bandpass filter is used for filtering:

[0123] x f ″(t)=Bandpass(x f ′(t),20,500),xr ″(t)=Bandpass(x r ′(t),20,500)

[0124] ″″

[0125] The first environmental noise acquisition signal and the second environmental noise acquisition signal x obtained after filtering f (t) and x r (t) as input for subsequent analysis.

[0126] S222: Extracting the maximum delay time, energy difference and phase difference characteristics between the preprocessed first environmental noise collection signal and the second environmental noise collection signal.

[0127] Optionally, the delay time between the first ambient noise collection signal and the second ambient noise collection signal is calculated first, and then the wind noise intensity is inferred based on the delay value.

[0128] (1) Delay time calculation (based on cross-correlation): Calculate the first environmental noise acquisition signal and the second environmental noise acquisition signal after filtering.

[0129] ″″

[0130] Acoustic signal x f (t) and x r The cross-correlation function R between (t) fr (τ), and then find the maximum delay time τ max :

[0131]

[0132] Among them, τ max = argmax τ R fr (τ), that is, the delay time τ max is the maximum point of the cross-correlation function.

[0133] (2) Calculate the low frequency band energy difference: the filtered first environmental noise acquisition signal and the second environmental noise acquisition signal

[0134] ″″

[0135] x f (t) and x r (t) Perform Fourier transform to obtain the spectrum:

[0136]

[0137] Then calculate the energy of the low frequency band (20–250Hz):

[0138]

[0139] (3) Calculation of energy difference ΔE low :

[0140] ΔE low =E low,f -E low,r

[0141] Phase difference calculation:

[0142]

[0143] S223: Determine the target wind direction according to the maximum delay time, energy difference and phase difference characteristics.

[0144] Combination delay time τ max , energy difference ΔE low And the phase difference Δφ is used to determine the target wind direction.

[0145] When the following conditions are met, it is considered forward wind:

[0146] τ max <-τ thresh , ΔE low >E thresh,low , |Δφ|<φ thresh

[0147] When the following conditions are met, it is considered as backwind:

[0148] τ max >τ thresh , ΔE low <-E thresh,low , |Δφ|<φ thresh

[0149] When the following conditions are met, it is determined to be a side wind:

[0150] |τ max |<τ thresh , |ΔE low | <E thresh,low , |Δφ|>φ thresh

[0151] Among them, τ thresh is the delay time threshold, E thresh,low is the energy difference threshold, φ thresh These thresholds can be empirical values ​​or determined based on actual measured values.

[0152] As some optional implementations, in S220, the target wind noise intensity is determined by a wind noise intensity score, and the wind noise intensity score is determined based on one or more of a delay time score, an energy difference score, a phase difference score, an autocorrelation score, and a spectrum concentration score.

[0153] The target wind noise intensity is determined according to the wind noise intensity score; the wind noise intensity includes no wind and at least three intensity levels of wind noise; the at least three intensity levels of wind noise include a first intensity level, a second intensity level and a third intensity level; the third intensity level is greater than the second intensity level, and the second intensity level is greater than the first intensity level.

[0154] The delay time score is determined according to the relationship between the maximum delay time and the delay time threshold;

[0155] The energy difference score is determined based on the relationship between the energy difference and the energy difference threshold;

[0156] The phase difference score is determined based on the relationship between the phase difference and the phase difference threshold;

[0157] The autocorrelation score is determined based on the autocorrelation between the preprocessed first environmental noise acquisition signal and the second environmental noise acquisition signal;

[0158] The spectrum concentration score is determined according to the spectrum concentration between the preprocessed first environmental noise acquisition signal and the second environmental noise acquisition signal.

[0159] Exemplarily, based on the determination of the wind direction, the wind noise intensity is quantified by the following scoring mechanism:

[0160] (1) Delay score calculation Sτ: Based on the maximum delay time τ max The absolute value of thresh The scoring rules are as follows:

[0161]

[0162] (2) Energy difference score calculation S E :

[0163]

[0164] (3) Phase difference score calculation S φ :

[0165]

[0166] (4) Autocorrelation score calculation S R : Autocorrelation is used to quantify the strength of repeated patterns in the signal. In wind noise environments, the peak value of the autocorrelation will drop significantly, so the wind noise intensity can be quantified by calculating the peak value of the autocorrelation.

[0167] Calculation steps:

[0168] ″″

[0169] 1) Compare the filtered first environmental noise acquisition signal and the second environmental noise acquisition signal x f (t) and x r (t) Calculate the autocorrelation function respectively:

[0170]

[0171] 2) Normalize the autocorrelation peak and calculate the autocorrelation index:

[0172]

[0173] Where R f (0) and Rr(0) are the values ​​(maximum values) of the autocorrelation function at zero lag.

[0174] Take the average of the two as the total autocorrelation:

[0175]

[0176] 3) Calculate the autocorrelation score S based on the normalized autocorrelation ρ R

[0177]

[0178] Where: min and ρ max The threshold may be set empirically or determined based on measured values, and is used to define the range of autocorrelation in a low noise environment.

[0179] (5) Spectrum concentration score calculation S spec : Spectral concentration reflects the degree of energy concentration of a signal in a specific frequency band. Wind noise signals are usually distributed in low frequency bands, and their spectral concentration is low.

[0180] Calculation steps:

[0181] 1) Perform fast Fourier transform (FFT) on the front and rear microphone signals to obtain the power spectrum P f (ω) and P r (ω):

[0182] P f (ω)=|X f (ω)| 2 , P r (ω)=|X r (ω)| 2

[0183] 2) Calculate the center of gravity of the spectrum (i.e. the frequency mean):

[0184]

[0185] 3) Normalized spectrum concentration:

[0186]

[0187] where f max is the maximum frequency of the analysis band.

[0188] 4) Calculate the spectrum concentration score S spec :

[0189]

[0190] in η min and η max It can be an empirical threshold or determined based on actual measured values.

[0191] (6) Calculate the weighted average S of each score:

[0192] S=0.25S τ +0.25S E +0.2S φ +0.15S R +0.15S spec

[0193] Determine the wind noise intensity based on the final score S (the specific value is subject to the actual situation):

[0194] No wind (i.e. the first intensity level): S<30;

[0195] Weak wind (second intensity level): 30≤S<70;

[0196] Strong wind (i.e. the third intensity level): S≥70.

[0197] Comprehensive classification output:

[0198] Combine wind direction and wind noise intensity to form a complete classification result:

[0199] Forward wind: no wind, weak wind, strong wind;

[0200] Backwind: no wind, weak wind, strong wind;

[0201] Side wind: calm, weak, strong.

[0202] Through this scoring mechanism, the direction and intensity of wind noise can be accurately identified, making it easier to subsequently adjust the two filters in a targeted manner.

[0203] As some optional implementations, the first filter and the second filter each include a plurality of second-order IIR (Infinite Impulse Response) filters connected in series, and each second-order IIR filter has a different frequency range.

[0204] The second-order IIR filter is a digital filter that has an infinite impulse response. Unlike FIR (Finite Impulse Response) filters, the output of the IIR filter depends not only on the current and past input signals, but also on the past output signals. This feature enables the IIR filter to achieve higher filtering performance at a lower order.

[0205] By adjusting the coefficients of the second-order IIR filter, the shape of the signal can be changed, for example, certain frequency components can be enhanced or weakened.

[0206] As some optional implementations, the method further includes S250: obtaining a preset adjustment strategy, the preset adjustment strategy at least including target opening and closing states and target filter coefficients of the first filter and the second filter at each target wind noise intensity for different target wind directions.

[0207] In S230 , according to the wind noise information, the first filter on the first path and the second filter on the second path are controlled to obtain a target noise signal, including S231 - S232 .

[0208] S231: According to the wind noise information, determine the target on / off states and target filter coefficients of the first filter and the second filter corresponding to the wind noise information from a preset adjustment strategy.

[0209] Specifically, different target wind directions have corresponding target on / off states and target filter coefficients at each target wind noise intensity. The target on / off state is one of an on state and a closed state, and the target filter coefficient is one of a first filter coefficient, a second filter coefficient, a third filter coefficient, and a fourth filter coefficient. It should be noted that the first filter coefficient is a default optimal filter coefficient, which can be stored in the memory of the headset; and the second filter coefficient, the third filter coefficient, and the fourth filter coefficient can be stored in the memory of the headset, or the second filter coefficient, the third filter coefficient, and the fourth filter coefficient can be obtained by adjusting the first filter coefficient.

[0210] S232: Control the first filter and the second filter according to the target on / off states and the target filter coefficients corresponding to the first filter and the second filter, respectively, to obtain a target noise signal.

[0211] It is easy to understand that if the target on / off state of the first filter is the off state, the first filter is controlled to be off; if the target filter coefficient of the first filter is the first filter coefficient, the first filter is controlled to filter with the first filter coefficient.

[0212] As some optional implementations, S231: according to the wind noise information, determine the target on / off states and target filter coefficients of the first filter and the second filter corresponding to the wind noise information from a preset adjustment strategy, including S2311-S2313.

[0213] S2311: When the target wind noise intensity is at the first intensity level, control the filter coefficients of the first filter and the second filter to be the first filter coefficients.

[0214] The first filter coefficient in this embodiment may be a default optimal filter coefficient. It should be noted that the first filter coefficient of the first filter and the first filter coefficient of the second filter may be the same or different.

[0215] In this embodiment, the first intensity level is equivalent to a windless state. In the windless state, both the first filter and the second filter use various default optimal filter coefficients.

[0216] S2312: When the target wind noise intensity is the second intensity level, control the filter coefficient of one of the first filter and the second filter to be the second filter coefficient, and the filter coefficient of the other filter to be the third filter coefficient, or control the first filter and the second filter to be the second filter coefficient, wherein the second filter coefficient is smaller than the first filter coefficient, and the third filter coefficient is larger than the first filter coefficient.

[0217] In this embodiment, the second intensity level is equivalent to weak wind, and weak wind has different wind directions, such as forward wind, backward wind, and side wind, and each wind direction corresponds to a different adjustment strategy. The details are as follows:

[0218] The target wind direction is forward wind, the filter coefficient of the first filter is controlled to be the second filter coefficient, and the filter coefficient of the second filter is controlled to be the third filter coefficient.

[0219] It should be noted that the second filter coefficient and the third filter coefficient can be called from the memory of the headset, or the second filter coefficient and the third filter coefficient can be obtained by adjusting the first filter.

[0220] Exemplarily, in the state of forward wind and weak wind, the gain of one or more second-order IIR filters (i.e., low-frequency second-order IIR filters) in the first filter whose frequency range is lower than the set frequency threshold is reduced to obtain the second filter coefficient of the first filter; the gain of one or more second-order IIR filters (i.e., low-frequency second-order IIR filters) in the second filter whose frequency range is lower than the set frequency threshold is enhanced to obtain the third filter coefficient of the second filter.

[0221] When there is wind, the earphones will be affected by wind noise, and because the positions of the first feedforward microphone and the second feedforward microphone are different, they are affected differently by wind noise. Specifically, when the wind direction is forward wind, because the first feedforward microphone faces the forward wind and the second feedforward microphone faces away from the forward wind, the first feedforward microphone is greatly affected by wind noise. After the first feedforward microphone is affected by wind noise, the first ambient noise collection signal collected by it will not be a real ambient noise signal, specifically, the amplitude of the first ambient noise collection signal will be higher than the real ambient noise signal. If the first filter and the second filter still filter the first ambient noise collection signal and the second ambient noise collection signal according to their respective default optimal filter coefficients, the secondary sound source played by the speaker will be superimposed with the ambient noise in-ear signal in the human ear, and a whirring sound will be emitted. The noise reduction effect is even worse than no noise reduction, and the meaning of noise reduction is lost.

[0222] At present, some noise-cancelling headphones will directly turn off the noise-cancelling function when facing wind noise. In the state of forward wind and weak wind, the embodiment of the present application reduces the gain of one or more second-order IIR filters in the first filter whose frequency range is lower than the set frequency threshold; and enhances the gain of one or more second-order IIR filters in the second filter whose frequency range is lower than the set frequency threshold. When the first environmental noise acquisition signal is filtered by the first filter with reduced gain, the amplitude of the first environmental noise acquisition signal in the low frequency band will be reduced, so that the amplitude of the filtered first environmental noise acquisition signal in the low frequency band is equal to or close to the amplitude of the real environmental noise signal in the low frequency band.

[0223] Specifically, the gain of the second-order IIR filter of which low frequency is to be enhanced / reduced can be determined in the test stage before the headphones leave the factory. The gain enhanced / reduced can be the gain of a certain frequency band in the second-order IIR filter, or the gain of one or more frequency points. The amount of enhancement / reduction can also be a fixed coefficient determined by experiments.

[0224] Depending on the type of headphones or the positions of the two feedforward microphones, the second feedforward microphone may be affected differently by wind noise in a forward wind or weak wind environment, or even not be affected by wind noise, so the second filter needs to be adjusted in a targeted manner. In this embodiment, since the forward wind cannot reach the second feedforward microphone, the amplitude of the second ambient noise collection signal collected by the second feedforward microphone in a forward wind or weak wind environment is lower than the amplitude of the normal ambient noise in the low frequency band, so it is necessary to enhance the gain of the second filter in the low frequency band. After the gain of the first filter is enhanced, the amplitude of the second ambient noise collection signal in the low frequency band will be enhanced, so that it is equal to or close to the amplitude of the real ambient noise signal in the low frequency band.

[0225] Therefore, the first ambient noise collection signal and the second ambient noise collection signal are filtered by two filters after adjusting the filter coefficients. After the secondary sound source played by the speaker is superimposed on the ambient noise intrusion signal in the human ear, the ambient noise intrusion signal in the human ear will be offset or even eliminated to a large extent.

[0226] The target wind direction is backward wind, the filter coefficient of the first filter is controlled to be the third filter coefficient, and the filter coefficient of the second filter is controlled to be the second filter coefficient.

[0227] Exemplarily, in the state of backwind and weak wind, the gain of one or more second-order IIR filters in the first filter whose frequency range is lower than the set frequency threshold is enhanced; and the gain of one or more second-order IIR filters in the second filter whose frequency range is lower than the set frequency threshold is reduced.

[0228] Since the adjustment strategies of the first filter and the second filter in the state of backward wind and weak wind are opposite to the adjustment strategies of the first filter and the second filter in the state of forward wind and weak wind, this embodiment will not be repeated here.

[0229] The target wind direction is side wind, and the first filter and the second filter are controlled to have the second filter coefficient.

[0230] It should be noted that the second filter coefficient of the first filter and the second filter coefficient of the second filter may be the same or different.

[0231] Exemplarily, in the state of side wind and weak wind, the gain of one or more second-order IIR filters in the first filter whose frequency range is lower than the set frequency threshold is reduced; the gain of one or more second-order IIR filters in the second filter whose frequency range is lower than the set frequency threshold is reduced.

[0232] In the case of side wind or weak wind, both the first feedforward microphone and the second feedforward microphone will be blown by the wind and thus will be affected by wind noise. Therefore, the adjustment strategy is to reduce the gain of one or more second-order IIR filters at low frequencies in the first filter, and reduce the gain of one or more second-order IIR filters at low frequencies in the second filter. This reduces the amplitude of the first ambient noise acquisition signal and the second ambient noise acquisition signal in the low frequency band.

[0233] S2313: When the target wind noise intensity is the third intensity level, control one of the first filter and the second filter to be turned off, and control the filter coefficient of the other filter to be the fourth filter coefficient, or control both the first filter and the second filter to be turned off, wherein the fourth filter coefficient is greater than the first filter coefficient.

[0234] In this embodiment, the third intensity level is equivalent to strong wind, and strong wind has different wind directions, such as forward wind, backward wind, and side wind, and each wind direction corresponds to a different adjustment strategy. The details are as follows:

[0235] The target wind direction is forward wind, and when the target wind noise intensity is at the third intensity level, the first filter is controlled to be closed, and the filter coefficient of the second filter is controlled to be the fourth filter coefficient.

[0236] It should be noted that the fourth filter coefficient can be called from the memory of the headset, or can be obtained by adjusting the first filter.

[0237] Exemplarily, in the state of forward wind and strong wind, the first filter is turned off; the gains of all second-order IIR filters in the second filter are enhanced to obtain the fourth filter coefficient of the second filter.

[0238] In the state of forward wind and strong wind, the first feedforward microphone is too affected by the wind noise, and the low frequency of the first feedforward microphone is saturated. Therefore, the adjustment strategy is to directly turn off the first filter and enhance the gain of all second-order IIR filters in the second filter. Only the second filter is allowed to filter the second environmental noise collection signal, and the second filter works at full power with a weight of 1.

[0239] The target wind direction is backward wind, the filter coefficient of the first filter is controlled to be the fourth filter coefficient, and the second filter is controlled to be closed.

[0240] Exemplarily, in the state of backwind and strong wind, the second filter is turned off; the gains of all second-order IIR filters in the first filter are enhanced to obtain the fourth filter coefficient of the first filter.

[0241] In the state of backwind and strong wind, the second feedforward microphone is too affected by the wind noise, and the low frequency of the second feedforward microphone is saturated. Therefore, the adjustment strategy is to directly turn off the second filter and enhance the gain of all second-order IIR filters in the first filter. Only the first filter is allowed to filter the first environmental noise collection signal, and the first filter works at full power with a weight of 1.

[0242] The target wind direction is side wind, and both the first filter and the second filter are controlled to be closed.

[0243] Exemplarily, in the case of side wind or strong wind, the first filter and the second filter are turned off.

[0244] In the case of side wind and strong wind, the first feedforward microphone and the second feedforward microphone are greatly affected by wind noise, and the low frequencies of the first feedforward microphone and the second feedforward microphone are saturated. Therefore, the adjustment strategy is to directly turn off the first filter and the second filter, that is, to turn off the noise reduction function to avoid the speaker from emitting whistling wind noise.

[0245] This adjustment strategy can not only achieve better active noise reduction effects under normal circumstances, but also achieve good noise reduction effects when encountering wind noise by using the first feedforward microphone and the second feedforward microphone to cooperate with each other, unlike the traditional method of turning off the active noise reduction function when encountering wind noise.

[0246] In some other implementations, a feedback microphone is further installed in the earphone of this embodiment, and the feedback microphone is used for active noise reduction and detecting the noise inside the earphone, and feeding it back to the control circuit to further optimize the noise reduction effect.

[0247] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0248] Figure 8 The present invention is a schematic diagram of the principle of a headphone wind noise processing system disclosed in an embodiment of the present application, including headphones and testing equipment.

[0249] Performing system identification on multiple adjustment systems in the earphones through frequency sweep signals to determine the filter coefficient of each filter in the earphones; any adjustment system includes any feedforward microphone and a speaker;

[0250] The earphones are used to turn on active noise reduction and execute the method of any one of the above embodiments.

[0251] Exemplarily, the earphone includes a first feedforward microphone and a first feedforward microphone, the filter includes a first filter and a second filter, and the adjustment system includes a first adjustment system and a second adjustment system. Correspondingly, the test equipment is used to perform system identification on the first adjustment system in the earphone through a frequency sweep signal to determine a first filter coefficient of the first filter in the earphone; the first system includes a first feedforward microphone and a speaker; perform system identification on the second system in the earphone through a frequency sweep signal to determine a second filter coefficient of the second filter in the earphone; the second system includes a second feedforward microphone and a speaker; and write the first filter coefficient and the second filter coefficient into the processor of the earphone.

[0252] A swept frequency signal is a test signal used to evaluate and test the noise reduction performance of headphones. A swept frequency signal is a signal whose frequency changes over time, and its frequency range covers the entire frequency range audible to the human ear (usually 20Hz to 20kHz). This signal can help testers understand the noise reduction effect of headphones at different frequencies. In addition, the frequency, amplitude, and phase of the swept frequency signal are all known.

[0253] Specifically, the first adjustment system composed of the first feedforward microphone and the speaker is first identified by a frequency sweep signal, and then the first filter coefficient (including the first weight) of the first filter is designed by the feedforward noise reduction principle and written into the processor. Similarly, the second adjustment system composed of the second feedforward microphone and the speaker is identified by a frequency sweep signal, and then the second filter coefficient (including the second weight) of the second filter is designed by the feedforward noise reduction principle and written into the processor. Finally, the headset turns on active noise reduction to achieve a noise reduction effect. Among them, the headset performs scene recognition in real time, and adjusts the filter coefficients of the first filter and the second filter respectively to achieve accurate and efficient noise reduction effects.

[0254] System identification refers to the testing of some transfer functions of the entire headphone system, such as the transfer function from the feedforward microphone signal to the artificial ear signal, and the transfer function from the headphone speaker signal to the artificial ear signal. These transfer functions mainly characterize some path information of the headphone structure and are used to calculate the filter coefficients of the filter. The artificial ear signal refers to the process of simulating the human ear's reception and processing of sound, which is used to test and evaluate the performance of noise reduction headphones.

[0255] In some other optional implementations, the test device further performs system identification on the first system and the second system through a plurality of known wind noise information, obtains the second filter coefficient, the third filter coefficient, and the fourth filter coefficient of the first filter and the second filter, respectively, and writes the second filter coefficient, the third filter coefficient, and the fourth filter coefficient of the first filter and the second filter into the processor of the headset. When the headset recognizes the target wind direction and the target wind noise intensity, the corresponding filter coefficient is called for filtering.

[0256] Corresponding to the method described in the above embodiment, Fig. 9 A structural block diagram of a headphone wind noise processing device provided in an embodiment of the present application is shown. The device is applied to headphones. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0257] Reference Fig. 9 , the device comprises:

[0258] An acquisition module 310 is used to acquire multiple environmental noise collection signals through multiple feedforward microphones of the headset; each of the feedforward microphones corresponds to a first path; and each of the environmental noise collection signals is transmitted via one of the first paths;

[0259] A determination module 320, configured to determine wind noise information in a wind noise environment according to the plurality of environmental noise collection signals, wherein the wind noise information includes a target wind direction and a target wind noise intensity;

[0260] A control module 330, configured to control a target on / off state and a target filter coefficient of each filter on the first path according to the wind noise information, so as to obtain a target noise signal; the target on / off state and the target filter coefficient of the filter are different under different target wind directions and target wind noise intensity states;

[0261] The playing module 340 is used to control the loudspeaker to output the target noise signal to form a secondary sound source; the secondary sound source is used to offset the ambient noise entering the ear signal reaching the human ear through the second path.

[0262] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0263] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0264] An embodiment of the present application also provides an earphone, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps in any of the above-mentioned method embodiments when executing the computer program.

[0265] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0266] An embodiment of the present application provides a computer program product. When the computer program product is run on an earphone, the earphone can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0267] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the headset, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0268] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0269] The computer program code for performing the operation of the embodiment of the application can be written with one or more programming languages ​​or their combination, and the programming language includes object-oriented programming languages, such as python, Java, Smalltalk, C++, and also includes conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed completely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on the remote computer, or executed completely on the remote computer or server. In the case of a remote computer, the remote computer can include a local area network (LAN) or a wide area network (WAN)--connected to the user's computer through any type of network, or, can be connected to an external computer (for example, utilizing an Internet service provider to connect through the Internet).

[0270] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0271] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0272] In the embodiments provided in the present application, it should be understood that the disclosed devices / earphones and methods can be implemented in other ways. For example, the device / earphone embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0273] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0274] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for processing wind noise in headphones, characterized in that: Applied to headphones, the method comprises: Acquire multiple environmental noise collection signals through multiple feedforward microphones of the headset; each of the feedforward microphones corresponds to a first path; each of the environmental noise collection signals is transmitted via one of the first paths; Determining wind noise information in a wind noise environment according to the multiple environmental noise acquisition signals, the wind noise information including a target wind direction and a target wind noise intensity; According to the wind noise information, the target on / off state and the target filter coefficient of each filter on the first path are controlled to obtain a target noise signal; the target on / off state and the target filter coefficient of the filter are different under different target wind directions and target wind noise intensity states; The loudspeaker is controlled to output the target noise signal to form a secondary sound source; the secondary sound source is used to cancel the ambient noise ear signal reaching the human ear through the second path.

2. The method for processing headphone wind noise according to claim 1, characterized in that: The method further comprises: Acquire a preset adjustment strategy, wherein the preset adjustment strategy at least includes the target opening and closing state and the target filter coefficient of the filter on each first path at each target wind noise intensity for different target wind directions; The step of controlling the target on / off state and the target filter coefficient of each filter on the first path according to the wind noise information to obtain a target noise signal includes: According to the wind noise information, determining the target on / off state and the target filter coefficient of each filter corresponding to the wind noise information from the preset adjustment strategy; Each filter is controlled according to the target on / off state and the target filter coefficient corresponding to each filter to obtain the target noise signal.

3. The method for processing headphone wind noise according to claim 2, characterized in that: The filter comprises a first filter and a second filter; The step of determining the target on / off state and the target filter coefficient of each filter corresponding to the wind noise information from the preset adjustment strategy according to the wind noise information includes: When the target wind noise intensity is at a first intensity level, the filter coefficients of the first filter and the second filter are controlled to be first filter coefficients; When the target wind noise intensity is at the second intensity level, controlling the filter coefficient of one of the first filter and the second filter to be the second filter coefficient and the filter coefficient of the other filter to be the third filter coefficient, or controlling the first filter and the second filter to be the second filter coefficient, wherein the second filter coefficient is smaller than the first filter coefficient and the third filter coefficient is larger than the first filter coefficient; When the target wind noise intensity is the third intensity level, one of the first filter and the second filter is controlled to be turned off, and the filter coefficient of the other filter is controlled to be a fourth filter coefficient, or both the first filter and the second filter are controlled to be turned off, wherein the fourth filter coefficient is greater than the first filter coefficient.

4. The method for processing headphone wind noise according to claim 3, characterized in that: The step of controlling the filter coefficient of one of the first filter and the second filter to be the second filter coefficient and the filter coefficient of the other filter to be the third filter coefficient when the target wind noise intensity is the second intensity level, or controlling the first filter and the second filter to be the second filter coefficient, comprises: The target wind direction is forward wind, and when the target wind noise intensity is at the second intensity level, the filter coefficient of the first filter is controlled to be the second filter coefficient, and the filter coefficient of the second filter is controlled to be the third filter coefficient.

5. The method for processing headphone wind noise according to claim 3, characterized in that: The step of controlling the filter coefficient of one of the first filter and the second filter to be the second filter coefficient and the filter coefficient of the other filter to be the third filter coefficient when the target wind noise intensity is the second intensity level, or controlling the first filter and the second filter to be the second filter coefficient, comprises: The target wind direction is backward wind, the filter coefficient of the first filter is controlled to be the third filter coefficient, and the filter coefficient of the second filter is controlled to be the second filter coefficient.

6. The method for processing headphone wind noise according to claim 3, characterized in that: The step of controlling the filter coefficient of one of the first filter and the second filter to be the second filter coefficient and the filter coefficient of the other filter to be the third filter coefficient when the target wind noise intensity is the second intensity level, or controlling the first filter and the second filter to be the second filter coefficient, comprises: The target wind direction is side wind, and the first filter and the second filter are controlled to have a second filter coefficient.

7. The method for processing headphone wind noise according to claim 3, characterized in that: When the target wind noise intensity is at the third intensity level, controlling one of the first filter and the second filter to be turned off, and controlling the filter coefficient of the other filter to be a fourth filter coefficient, or controlling both the first filter and the second filter to be turned off, includes: The target wind direction is forward wind, and when the target wind noise intensity is at the third intensity level, the first filter is controlled to be closed, and the filter coefficient of the second filter is controlled to be the fourth filter coefficient.

8. The method for processing headphone wind noise as claimed in claim 3, characterized in that: When the target wind noise intensity is at the third intensity level, controlling one of the first filter and the second filter to be turned off, and controlling the filter coefficient of the other filter to be a fourth filter coefficient, or controlling both the first filter and the second filter to be turned off, includes: The target wind direction is backward wind, the filter coefficient of the first filter is controlled to be the fourth filter coefficient, and the second filter is controlled to be closed.

9. The method for processing headphone wind noise as claimed in claim 3, characterized in that: When the target wind noise intensity is at the third intensity level, controlling one of the first filter and the second filter to be turned off, and controlling the filter coefficient of the other filter to be a fourth filter coefficient, or controlling both the first filter and the second filter to be turned off, includes: The target wind direction is side wind, and the first filter and the second filter are controlled to be closed.

10. The method for processing headphone wind noise according to any one of claims 1 to 9, characterized in that: The multiple environmental noise collection signals include a first environmental noise collection signal and a second environmental noise collection signal; Determining the target wind direction in the wind noise information according to the multiple environmental noise collection signals includes: Preprocessing the first environmental noise collection signal and the second environmental noise collection signal to retain the frequency band of the wind noise signal; Extracting the maximum delay time, energy difference and phase difference characteristics between the first environmental noise acquisition signal and the second environmental noise acquisition signal after preprocessing; The target wind direction is determined according to the maximum delay time, energy difference and phase difference characteristics.

11. The method for processing headphone wind noise according to claim 10, characterized in that: Determining the target wind direction according to the maximum delay time, energy difference and phase difference characteristics includes: Satisfy τ max <-τ thresh , ΔE low >E thresh,low , |Δφ|<φ thresh , determined as forward wind; Satisfy τ max >τ thresh , αE low <-E thresh,low , |Δφ|<φ thresh , determined as the back wind; Satisfy |τ max |<τ thresh , |ΔE low | <E thresh,low , |Δφ|>φ thresh , determined as side wind; Among them, τ max is the maximum delay time; τ thresh is the delay time threshold; ΔE low is the energy difference; E thresh,low is the energy difference threshold; Δφ is the phase difference; φ thresh is the phase difference threshold.

12. The method for processing headphone wind noise according to claim 10, characterized in that: The target wind noise intensity is determined by a wind noise intensity score, and the wind noise intensity score is determined based on one or more of a delay time score, an energy difference score, a phase difference score, an autocorrelation score, and a spectrum concentration score; determining the target wind noise intensity according to the wind noise intensity score; the wind noise intensity includes at least three intensity levels of wind noise; the at least three intensity levels of wind noise include a first intensity level, a second intensity level and a third intensity level; the third intensity level is greater than the second intensity level, and the second intensity level is greater than the first intensity level; The delay time score is determined according to the relationship between the maximum delay time between the first environmental noise collection signal and the second environmental noise collection signal and the delay time threshold; The energy difference score is determined according to a relationship between an energy difference between the first environmental noise acquisition signal and the second environmental noise acquisition signal and an energy difference threshold; The phase difference score is determined according to a relationship between a phase difference between the first environmental noise acquisition signal and the second environmental noise acquisition signal and a phase difference threshold; The autocorrelation score is determined according to the autocorrelation between the first environmental noise acquisition signal and the second environmental noise acquisition signal after preprocessing; The spectrum concentration score is determined according to the spectrum concentration between the first environmental noise collection signal and the second environmental noise collection signal after preprocessing.

13. The method for processing headphone wind noise according to any one of claims 1 to 9, characterized in that: Each of the filters includes a plurality of second-order IIR filters connected in series, and each of the second-order IIR filters has a different frequency range.

14. A headphone wind noise processing system, characterized in that: Includes headphones and test equipment; The test equipment is used to: Performing system identification on multiple adjustment systems in the earphones through frequency sweep signals to determine the filter coefficient of each filter in the earphones; any of the adjustment systems includes any feedforward microphone and a speaker; The earphone is used to execute the method according to any one of claims 1-13.

15. A headphone wind noise processing device, characterized in that: Applied to headphones, the device comprises: An acquisition module, configured to acquire a plurality of environmental noise acquisition signals through a plurality of feedforward microphones of the headset; each of the feedforward microphones corresponds to a first path; and each of the environmental noise acquisition signals is transmitted via a first path; A determination module, configured to determine wind noise information in a wind noise environment according to the plurality of environmental noise acquisition signals, wherein the wind noise information includes a target wind direction and a target wind noise intensity; A control module, configured to control a target on / off state and a target filter coefficient of each filter on the first path according to the wind noise information, so as to obtain a target noise signal; the target on / off state and the target filter coefficient of the filter are different under different target wind directions and target wind noise intensity states; The playing module is used to control the loudspeaker to output the target noise signal to form a secondary sound source; the secondary sound source is used to offset the ambient noise ear signal reaching the human ear through the second path.

16. A headset comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 13 is implemented.

17. The earphone according to claim 16, wherein: The earphone is an open-type earphone, comprising a body, an ear hook and a rotating shaft connecting part; the multiple feedforward microphones are located on one or more of the body, the ear hook and the rotating shaft connecting part.

18. A computer program product, characterized in that When the computer program product runs on the headset, the headset is caused to execute the method according to any one of claims 1 to 13.

Images