Wind noise detection method, device and equipment
By setting two microphones on the audio device and performing phase adjustments to calculate the wind noise coefficient, the problem of inaccurate stroke detection in the prior art is solved, and more accurate wind noise detection is achieved.
Patent Information
- Application Number
- CN202210519258.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-12
- Publication Date
- 2025-05-16
- Estimated Expiration
- 2042-05-12
AI Technical Summary
The prior art stroke noise detection is inaccurate, especially in the use of audio equipment, the sound of the user speaking is easily misjudged as wind noise, resulting in inaccurate representation of the degree of wind noise.
A wind noise detection method is adopted to obtain the adjusted signal by setting two microphones on the audio device, obtaining the first signal and the second signal, and adjusting them in phase. Then, the wind noise coefficient is calculated based on the differential signal of the adjusted signal and the second target signal to characterize the degree of wind noise.
This method can effectively reduce the influence of user speaking sound on wind noise coefficient, improve the accuracy of wind noise detection, and make the wind noise coefficient more accurately represent the degree of wind noise.
Smart Images

Figure CN114974288B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a wind noise detection method, device and equipment. Background Art
[0002] In addition to the sounds of nature and various sounds in the social environment, people will also actively seek entertainment that contains sound, such as music, television, movies, etc. Various audio equipment are also produced accordingly to meet people's needs.
[0003] When audio devices meet people's audio needs, ambient noise from air movement can negatively impact the sound quality they provide. Accurately identifying wind noise and guiding audio devices to eliminate its impact will help better meet users' audio quality needs. Summary of the Invention
[0004] The present application provides a wind noise detection method, device and equipment to solve the problem of inaccurate wind noise detection in the prior art.
[0005] In a first aspect, the present application provides a wind noise detection method, which includes: obtaining a first signal and a second signal, wherein the first signal is obtained based on an original signal collected by a first microphone, and the second signal is obtained based on an original signal collected by the second microphone, and the first microphone and the second microphone are respectively arranged at different positions of the audio device; using one of the first signal and the second signal as a first target signal, and the other as a second target signal; performing phase adjustment on the first target signal to obtain an adjusted signal; and obtaining a wind noise coefficient based on a differential signal between the adjusted signal and the second target signal, wherein the wind noise coefficient indicates the degree of wind noise.
[0006] In an optional embodiment of the present specification, before performing phase adjustment on the first target signal to obtain the adjusted signal, the method further includes: using the microphone that collects the original signal of the first target signal as the designated microphone; determining the phase adjustment coefficient of the designated microphone based on the target angular frequency vector, the target distance, and the target angle, wherein the target angular frequency vector is a vector composed of multiple angular frequency values distributed at equal intervals, the target distance is the straight-line distance between the first microphone and the second microphone, and the target angle is the angle between the vector formed by the first microphone and the sound source and the vector formed by the first microphone and the second microphone.
[0007] In an optional embodiment of the present specification, performing phase adjustment on the first target signal to obtain an adjusted signal includes: multiplying the first target signal by a phase adjustment coefficient as the adjusted signal.
[0008] In an optional embodiment of the present specification, the phase adjustment coefficient is obtained using the following formula:
[0009]
[0010] Where B is the phase adjustment coefficient, i is the imaginary unit, d is the target distance, is the target angle, w is the target angular frequency, and v is the speed of sound.
[0011] In an optional embodiment of the present specification, a wind noise coefficient is obtained based on a differential signal between the adjusted signal and the second target signal, specifically including: determining the difference between the differential signal between the adjusted signal and the second target signal, and determining a statistical value of a specified signal, wherein the statistical value includes any one of a minimum value and an average value of a power spectrum of the specified signal, and the specified signal includes one of a first signal and a second signal; and taking a ratio of the difference between the differential signal and the statistical value of the specified signal as the wind noise coefficient.
[0012] In an optional embodiment of the present specification, determining the difference between the differential signal of the adjusted signal and the second target signal specifically includes: using a fast Fourier filter to perform amplitude compensation on the differential signal of the adjusted signal and the second target signal; dividing the power spectrum of the differential signal into multiple sub-bands as a preset number of first sub-bands, and obtaining the difference of the differential signal based on the preset number of first sub-bands; and determining the statistical value of the specified signal specifically includes: dividing the power spectrum of the specified signal into multiple sub-bands as a preset number of second sub-bands, and obtaining the statistical value of the specified signal based on the preset number of second sub-bands.
[0013] In an optional embodiment of the present specification, the method further includes: the original signal is a time domain signal, and the first signal and the second signal are frequency domain signals; obtaining the first signal specifically includes: performing a fast Fourier transform on the original signal collected by the first microphone to obtain the first signal; obtaining the second signal specifically includes: performing a fast Fourier transform on the original signal collected by the second microphone to obtain the second signal.
[0014] In an optional embodiment of the present specification, after obtaining the wind noise coefficient, the method further includes: if the wind noise coefficient is greater than a preset wind noise threshold, controlling the audio device to turn on a wind noise reduction mode.
[0015] In a second aspect, the present application provides a wind noise detection device, the device comprising:
[0016] a signal acquisition module configured to: acquire a first signal and a second signal, wherein the first signal is obtained based on an original signal collected by a first microphone, and the second signal is obtained based on an original signal collected by a second microphone, and the first microphone and the second microphone are respectively arranged at different positions of the audio device;
[0017] A signal determination module configured to: use one of the first signal and the second signal as a first target signal and the other as a second target signal;
[0018] The signal adjustment module is configured to: perform phase adjustment on the first target signal to obtain an adjusted signal;
[0019] The wind noise coefficient determination module is configured to obtain a wind noise coefficient according to a differential signal between the adjusted signal and the second target signal, wherein the wind noise coefficient represents the degree of wind noise.
[0020] In an optional embodiment of this specification, the device further includes:
[0021] a phase adjustment coefficient determination module configured to: use the microphone that collects the original signal of the first target signal as the designated microphone; and determine the phase adjustment coefficient of the designated microphone based on a target angular frequency vector, a target distance, and a target angle, wherein the target angular frequency vector refers to a vector of angular frequency values distributed at equal intervals, the target distance is the straight-line distance between the first microphone and the second microphone, and the target angle is the angle between the vector formed by the first microphone and the sound source and the vector formed by the first microphone and the second microphone;
[0022] The signal adjustment module is specifically configured to: perform phase adjustment on the first target signal to obtain an adjusted signal, specifically including: taking the product of the first target signal and the phase adjustment coefficient as the adjusted signal.
[0023] In a third aspect, the present application provides a wind noise detection device, comprising a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;
[0024] a memory, at least for storing computer programs;
[0025] The processor is configured to implement any step of the wind noise detection method in the first aspect when executing a program stored in the memory.
[0026] The above technical solution provided by the embodiment of the present application has the following advantages compared with the prior art:
[0027] The wind noise detection method, apparatus, and device described in this application characterize wind noise using a wind noise coefficient. During the process of determining the wind noise coefficient, at least two microphones as described above are used to collect wind noise in the environment to obtain audio data containing spatial information in the environment. Based on this, an adjusted signal is obtained based on the phase adjustment results of one of the collected original signals. This phase adjustment operation effectively reduces the impact of the user's voice in the environment on the accuracy of the wind noise coefficient. The wind noise coefficient is then determined based on the difference between the adjusted signal and the other signal. This effectively expresses the identified wind noise in the environment through the wind noise coefficient, making the wind noise coefficient more accurate in representing the degree of wind noise. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0029] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0030] Figure 1 A schematic diagram of a flow chart of a wind noise detection process provided in an embodiment of the present application;
[0031] Figure 2 A schematic diagram of the installation position of a microphone on an audio device provided in an embodiment of the present application;
[0032] Figure 3 To correspond to Figure 1 A schematic diagram of a wind noise detection device showing some steps of the method process;
[0033] Figure 4 A schematic diagram of the circuit structure of a wind noise detection device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0034] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0035] Wind noise is an artifact caused by turbulent airflow around audio equipment. While audio equipment is functioning, it may be affected by wind noise in its environment. Low-intensity wind noise has a minimal impact, and its negative effects on the operation of audio equipment can be ignored. High-intensity wind noise, on the other hand, has a significant impact, and its negative effects on the operation of audio equipment should be taken seriously. Objectively and accurately measuring wind noise intensity can influence the effectiveness of subsequent wind noise mitigation measures.
[0036] In related technologies, when detecting wind noise, the noise data collected by the microphone is often directly used as the data representing wind noise. However, in actual use scenarios of audio devices, the user is often near the audio device and their mouth is close to the microphone. Therefore, the data corresponding to the vibration caused by the user's speech will also be considered as noise data. Therefore, the user's speech can interfere with the determination of wind noise intensity.
[0037] In order to solve the problem of inaccurate wind noise determination in the prior art, this specification provides a wind noise detection method. The execution subject of the wind noise detection method in this specification is a wind noise detection device. The wind noise detection device can be a device with an entity structure at the physical level, or it can be a virtual device. The wind noise detection method in this specification is used to determine the degree of wind noise caused by the environment to the audio device, wherein the degree of wind noise can be used to characterize the size of the wind noise. The wind noise detection device can be set on the audio device, or on a cloud device, and be communicated with the audio device.
[0038] In an optional embodiment of the present specification, the audio device may be an audio collection device, i.e., a device that converts collected sound into audio data, such as a pickup or microphone. In another optional embodiment of the present specification, the audio device may be an audio playback device, i.e., a device that converts audio data into sound, such as headphones, an amplifier, or a speaker. In yet another optional embodiment of the present specification, the audio device may be a device that has both the aforementioned sound collection and audio playback functions, such as a loudspeaker.
[0039] like Figure 1 As shown, the wind noise detection method in this manual includes the following steps:
[0040] S100: Acquire a first signal and a second signal.
[0041] Combine Figure 2As shown, the audio device in this specification is provided with a first microphone and a second microphone. The distances between the first microphone and the second microphone and the sound-emitting end of the audio device are relatively fixed. When the audio device is used to collect audio data, the first microphone and the second microphone are the ends of the audio device used to collect audio; when the audio device is used to play audio, the sound-emitting end is the end of the audio device used to play audio and emit sound that can be heard by the human ear. The arrangement positions of the first microphone and the second microphone on the audio device are exemplarily shown as follows: Figure 2 As shown, the straight-line distance between the first microphone and the second microphone can be set to a range of 10 mm to 40 mm.
[0042] The first signal used in the wind noise detection process of this specification is obtained based on the original signal collected by the first microphone, and the second signal is obtained based on the original signal collected by the second microphone.
[0043] In an optional embodiment of the present specification, the original signal collected by the first microphone can be directly used as the first signal, and the original signal collected by the second microphone can be directly used as the second signal. In the case where the original signal is a time series signal, the subsequent steps of determining the wind noise coefficient are performed directly based on the original signal. In another optional embodiment of the present specification, the original signal collected by the first microphone is subjected to a fast Fourier transform (FFT), and the obtained frequency domain signal is determined as the first signal; the original signal collected by the second microphone is subjected to a fast Fourier transform, and the obtained frequency domain signal is determined as the second signal, and then the subsequent steps of determining the wind noise coefficient are performed based on the frequency domain signal.
[0044] S102: One of the first signal and the second signal is used as a first target signal, and the other is used as a second target signal.
[0045] The first target signal and the second target signal in this specification are used to distinguish the signals for different signal processing in subsequent steps. In an optional embodiment, one of the first signal and the second signal can be randomly determined as the first target signal; in another optional embodiment, the first signal and the second signal with the larger signal strength (which can be the average strength within the first specified time period) within a historical time period of a first specified time period (preset time period) from the current moment can be used as the first target signal to ensure that the processing of the first target signal does not significantly affect the wind noise situation represented by the first target signal.
[0046] S104: Perform phase adjustment on the first target signal to obtain an adjusted signal.
[0047] S106: Obtaining a wind noise coefficient according to a differential signal between the adjusted signal and the second target signal, wherein the wind noise coefficient indicates the degree of wind noise.
[0048] The wind noise coefficient (WNC) in this manual is used to indicate the degree of wind noise. The WNC is positively correlated with the degree of wind noise. A higher WNC indicates more severe wind noise.
[0049] In the actual signal acquisition process, the signals collected by the microphone will have more or less errors. If the audio device moves in the environment, characteristics and parameters may also drift due to environmental factors. This manual can effectively reduce the errors caused by the microphone itself during the signal acquisition process by performing phase adjustment on the first target signal (see the example below for specific methods) and differentiating the obtained adjusted signal with the second target signal.
[0050] Furthermore, if a user is near the audio device (if the audio device is headphones, the user may be wearing headphones), the vibrations generated by the user's speech may affect the data collected by the microphone. If the vibrations caused by the user's speech are interpreted as wind noise, it will negatively impact the determination of the wind noise level. The process described in this manual differentiates the adjusted signal from the second target signal, which can avoid inaccurate wind noise coefficients obtained in subsequent steps due to user speech and improve robustness.
[0051] The wind noise detection method described in this specification uses a wind noise coefficient to characterize wind noise. In determining the wind noise coefficient, two microphones collect ambient sound to obtain ambient audio data containing spatial information. Based on this, an adjusted signal is obtained based on the phase adjustment results of the collected original signal. Subsequently, the wind noise coefficient is determined based on the adjusted signal, effectively reducing the impact of the user's voice in the environment on the accuracy of the wind noise coefficient. The wind noise coefficient is then determined based on the differential signal between the adjusted signal and a second target signal. This effectively expresses the wind noise in the identified environment through the wind noise coefficient, making the wind noise coefficient's representation of the degree of wind noise more accurate.
[0052] In this description, by adjusting the phase of the first target signal, it is possible to avoid the phenomenon that the difference D of the specified differential signal caused by the user speaking is too large, which in turn leads to a large wind noise coefficient R and inaccurate wind noise determination. How to perform phase adjustment is now described.
[0053] In an optional embodiment of the present specification, before performing phase adjustment, the microphone that captures the original signal of the first target signal is designated as the designated microphone. A phase adjustment coefficient for the designated microphone is determined based on a target angular frequency vector, a target distance, and a target angle, where the target angular frequency vector is a vector consisting of multiple angular frequency values distributed at equal intervals, the target distance is the straight-line distance between the first microphone and the second microphone, and the target angle is the angle between the vector formed by the first microphone and the sound source and the vector formed by the first microphone and the second microphone.
[0054] It should be noted that phase adjustment can be performed on the first target signal corresponding to the first microphone, the second target signal corresponding to the second microphone, or both signals, and all three methods can achieve the same effect. Therefore, in other implementations, the microphone that collects the original signal of the second target signal, that is, the second microphone, can also be used as the designated microphone. The subsequent processing is the same as when the first microphone is used as the designated microphone and will not be repeated here.
[0055] Optionally, the phase adjustment coefficient can be calculated using the following formula (1).
[0056]
[0057] Where B is the phase adjustment coefficient, i is the imaginary unit, d is the target distance, is the target angle, w is the target angular frequency, and v is the speed of sound. The target distance is the straight-line distance between the first and second microphones and can be measured in advance. The target angle is the angle between the vector formed by the first microphone and the sound source and the vector formed by the first and second microphones. After determining the sound source location, the first vector from the first microphone to the sound source and the second vector from the first microphone to the second microphone are constructed, thereby measuring the angle between the first and second vectors. The target angular frequency can be calculated using the formula w = 2*pi*f, where f is the multiple linear frequency signal components obtained by decomposing the sound signal.
[0058] After the phase adjustment coefficient is obtained, the product of the first target signal and the phase adjustment coefficient is used as the adjusted signal.
[0059] Thereafter, the wind noise coefficient may be determined based on the adjusted signal obtained through the aforementioned steps.
[0060] In an optional embodiment of the present specification, the process of determining the wind noise coefficient may specifically be:
[0061] Determine the difference between the adjusted signal and the differential signal of the second target signal, and determine the statistical value of the specified signal, wherein the statistical value includes any one of the minimum value and the average value of the power spectrum of the specified signal, and the specified signal includes one of the first signal and the second signal; and use the ratio of the difference between the differential signal and the statistical value of the specified signal as the wind noise coefficient.
[0062] The above process in this specification to determine the wind noise level (which can be represented by the wind noise coefficient) can be used in various actual application scenarios. For example, when the audio device is a headset, the wind noise level determined by the above process in this specification can be used for real-time wind noise detection and function control when the headset plays audio to the user. For another example, the wind noise detection process in this specification can also be used in scenarios where the real-time use of the determined wind noise level is not required.
[0063] In an optional embodiment of the present specification, if the process described herein is applied to a scenario where real-time requirements are high during wind noise detection, the signal with the smaller power spectrum between the first and second signals can be determined as the designated signal. If the process described herein is applied to a scenario where real-time requirements are low during wind noise detection, the power spectra of the first and second signals within a historical time period of a second specified time duration (preset time duration) from the current moment can be averaged to obtain a specified average value. This specified average value can roughly measure the noise in the environment. If the average value is greater than a preset first threshold, it indicates that there is a high probability of wind noise in the environment. The signal with the smaller average value between the first and second signals within the second specified time duration is determined as the designated signal. This allows the wind noise coefficient value to be increased to a certain extent when there is a high probability of wind noise, or to be reduced to a certain extent when there is a low probability of wind noise, thereby widening the gap between the wind noise coefficient values in windy and windless situations, which is beneficial to the accuracy of wind noise determination.
[0064] Before determining the statistical value of the difference between the differential signal and the designated signal, a power spectrum of the differential signal is obtained by calculation according to the differential signal; and a power spectrum of the designated signal is obtained by calculation according to the designated signal.
[0065] The first target signal and the second target signal can both be transmitted through X j (n, k) representation. Where j = 1 represents the first target signal; j = 2 represents the second target signal; n is the time period index; and k is the frequency domain index corresponding to n. The differential signal can be represented by D, the wind noise coefficient can be represented by R, and the adjusted signal can be represented by X′. The wind noise coefficient can then be calculated using the following formula:
[0066]
[0067] In the aforementioned embodiment, one of the first signal and the second signal can be directly used as the designated signal, and the wind noise coefficient can be obtained based on this. As can be seen from the above formula, the wind noise coefficient R obtained by this specification is small when there is no wind (i.e., the wind noise is close to 0). As the wind grows stronger, the wind noise generated also increases accordingly, and the R value increases, and is positively correlated with the wind noise.
[0068] In a further optional embodiment of the present specification, a fast Fourier filter may be used to perform amplitude compensation on the differential signal to obtain the difference of the differential signal, specifically including: using a fast Fourier filter to perform amplitude compensation on the differential signal between the adjusted signal and the second target signal; dividing the power spectrum of the differential signal into multiple sub-bands as a preset number of first sub-bands, and obtaining the difference of the differential signal based on the preset number of first sub-bands.
[0069] In a further optional embodiment of the present specification, determining the statistical value of the specified signal specifically includes: dividing the power spectrum of the specified signal into multiple sub-bands as a preset number of second sub-bands, and obtaining the statistical value of the specified signal based on the preset number of second sub-bands.
[0070] Optionally, the fast Fourier filter can be a frequency-domain low-pass FFT filter. In this embodiment, if the wind noise in the environment is low, the obtained wind noise coefficient will be close to 1. If the wind noise in the environment is high, the obtained wind noise coefficient will be much greater than 1. This is beneficial for determining the wind noise threshold and for widening the distance between the wind noise coefficients corresponding to different levels of wind noise, thereby facilitating the determination of the degree of wind noise.
[0071] The definition of wind noise may differ in different scenarios, and this difference can be reflected in the different frequencies of wind noise. For example, in one scenario, signals between 200 Hz and 500 Hz can be used for wind noise detection, while in another scenario, signals between 600 Hz and 800 Hz can be used for wind noise detection, and in another scenario, signals between 200 Hz and 1500 Hz can be used for wind noise detection. In addition, the division into sub-bands can enhance the stability of wind noise detection and also achieve grading of wind noise of different intensities.
[0072] To enable wind noise determination across different frequency ranges, in an optional embodiment of this specification, the power spectrum of the differential signal is divided to obtain a number of sub-bands, which serve as a predetermined number of first sub-bands. This specification does not specifically limit how the predetermined number is determined; for example, the predetermined number can be an integer such as 3 or 5.
[0073] Then, for each first subband, a differential value for each first subband is determined. The differential value of at least one first subband is used as the difference value of the differential signal. For example, if a total of three (i.e., a preset number equals three) first subbands are obtained by division, the differential value of the second first subband is used as the difference value of the differential signal.
[0074] Correspondingly, the process of determining the statistical value of the designated signal may include dividing the power spectrum of the designated signal into a plurality of subbands as a preset number of second subbands, and using one of the statistics of each second subband as the statistical value of the designated signal. Continuing with the above embodiment, the statistical value of the second second subband is used as the statistical value of the designated signal.
[0075] In another optional embodiment of the present specification, after the first and second sub-bands are divided, for each of the first sub-bands, a second sub-band in each of the second sub-bands having the same frequency as the first sub-band is used as the second sub-band corresponding to the first sub-band. The average of multiple sub-band difference values in the low frequency range of the first sub-band is used as the difference value of the difference signal, and the average of multiple sub-band statistical values in the low frequency range of the second sub-band corresponding to the first sub-band is used as the statistical value of the designated signal.
[0076] In addition, in other optional embodiments, the average of the differential values of the first sub-bands can be used as the difference value of the overall differential signal, and the average of the statistical values of the second sub-bands can be used as the statistical value of the overall designated signal.
[0077] Following the aforementioned embodiment, the corresponding differences and statistical values of the three first sub-bands and the three second sub-bands can be determined respectively. Based on the corresponding differences and statistical values of the sub-bands, the wind noise coefficients of the different sub-bands can be determined respectively. For the frequency ranges corresponding to the different sub-bands, the wind noise levels can be measured respectively using the wind noise coefficients.
[0078] As can be seen from the foregoing, the wind noise coefficient obtained through the process described in this manual can objectively and accurately represent the degree of wind noise. After obtaining the wind noise coefficient, the wind noise coefficient can be compared with a preset wind noise threshold. If the wind noise coefficient is greater than the wind noise threshold, indicating that the wind noise is strong, the device can activate the wind noise reduction function. For example, the ANC (Active Noise Cancellation) function provided by audio equipment such as headphones can be switched to wind noise reduction mode.
[0079] When the wind noise coefficient is determined separately for more than one sub-band (including the first sub-band and the second sub-band), a wind noise threshold corresponding to each sub-band can be set separately for the sub-band. If the wind noise coefficients of the more than one sub-bands are all greater than their corresponding wind noise thresholds, the audio device is controlled to turn on the wind noise reduction mode.
[0080] Based on the same idea, this specification further provides a wind noise detection device, such as Figure 3 As shown, the wind noise detection device includes one or more of the following modules:
[0081] The signal acquisition module 400 is configured to: acquire a first signal and a second signal, wherein the first signal is obtained based on an original signal collected by a first microphone, and the second signal is obtained based on an original signal collected by a second microphone, and the first microphone and the second microphone are both arranged at different positions of the audio device, for example, the first microphone is arranged at the top of the audio device, and the second microphone is arranged at the bottom of the audio device;
[0082] The signal determination module 402 is configured to: use one of the first signal and the second signal as a first target signal and the other as a second target signal;
[0083] The signal adjustment module 404 is configured to: perform phase adjustment on the first target signal to obtain an adjusted signal;
[0084] The wind noise coefficient determination module 406 is configured to obtain a wind noise coefficient according to a differential signal between the adjusted signal and the second target signal, wherein the wind noise coefficient indicates the degree of wind noise.
[0085] In an optional embodiment of the present specification, the device also includes a phase adjustment coefficient determination module, which is configured to: use the microphone that collects the original signal of the first target signal as the designated microphone; determine the phase adjustment coefficient of the designated microphone according to the target angular frequency vector, the target distance and the target angle, wherein the target angular frequency vector is a vector composed of multiple angular frequency values distributed at equal intervals, the target distance is the straight-line distance between the first microphone and the second microphone, and the target angle is the angle between the vector formed by the first microphone and the sound source and the vector formed by the first microphone and the second microphone.
[0086] In an optional embodiment of the present specification, the signal adjustment module 404 is specifically configured to: use the product of the first target signal and the phase adjustment coefficient as the adjusted signal.
[0087] In an optional embodiment of the present specification, the parameter determination module is specifically configured to determine the phase adjustment coefficient using the following formula:
[0088]
[0089] Where B is the phase adjustment coefficient, i is the imaginary unit, d is the target distance, φ is the target angle, w is the target angular frequency, and v is the speed of sound. The target distance is the straight-line distance between the first and second microphones and can be measured in advance. The target angle is the angle between the vector formed by the first microphone and the sound source and the vector formed by the first and second microphones. After determining the sound source location, the first vector from the first microphone to the sound source and the second vector from the first microphone to the second microphone are constructed, and the angle between the first and second vectors is measured. The target angular frequency can be calculated using the formula w = 2*pi*f, where f is the multiple linear frequency signal components obtained by decomposing the sound signal.
[0090] In an optional embodiment of the present specification, the wind noise coefficient determination module 406 is specifically configured to: determine the difference between the adjusted signal and the differential signal of the second target signal, and determine the statistical value of the specified signal, wherein the statistical value includes any one of the minimum value and the average value of the power spectrum of the specified signal, and the specified signal includes one of the first signal and the second signal; and use the ratio of the difference between the differential signal and the statistical value of the specified signal as the wind noise coefficient.
[0091] In an optional embodiment of the present specification, the device further includes a differential signal determination module configured to: use a fast Fourier filter to perform amplitude compensation on the differential signal between the adjusted signal and the second target signal to obtain a differential signal.
[0092] In an optional embodiment of the present specification, the wind noise coefficient determination module 406 is further configured to: divide the power spectrum of the differential signal into a plurality of sub-bands as a preset number of first sub-bands, and take one of the differential values of each first sub-band as the overall difference value of the differential signal.
[0093] In an optional embodiment of the present specification, the wind noise coefficient determination module 406 is further configured to: divide the power spectrum of the specified signal to obtain a number of sub-bands as a preset number of second sub-bands, and use one of the statistical values of each second sub-band as the statistical value of the entire specified signal.
[0094] In an optional embodiment of the present specification, the original signal is a time domain signal, and the first and second signals are frequency domain signals. The signal acquisition module 400 is specifically configured to perform a fast Fourier transform on the original signal collected by the first microphone to obtain the first signal. Furthermore, the signal acquisition module 400 performs a fast Fourier transform on the original signal collected by the second microphone to obtain the second signal.
[0095] In an optional embodiment of the present specification, the audio device is an audio collecting device and / or an audio playing device, such as a headset.
[0096] In an optional embodiment of the present specification, the apparatus further includes a noise reduction control module configured to control the audio device to enable the above-mentioned wind noise reduction mode if the wind noise coefficient is greater than a preset wind noise threshold.
[0097] like Figure 4 As shown, the embodiment of the present application provides a wind noise detection device, including a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 respectively communicate with each other through the communication bus 114, wherein,
[0098] Memory 113, for storing computer programs and various types of data;
[0099] In one embodiment of the present application, the processor 111 is configured to implement the wind noise detection method provided by any one of the aforementioned method embodiments when executing a program stored in the memory 113 .
[0100] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. After the computer program is executed by the processor 111, the steps of wind noise detection provided in any of the aforementioned method embodiments are implemented.
[0101] The wind noise detection device of the present application includes the wind noise detection device described in any of the above embodiments, which will not be described in detail here.
[0102] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device that includes the element.
[0103] The foregoing is merely a detailed description of the present invention, intended to enable those skilled in the art to understand and implement the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not limited to the embodiments shown herein, but is to be construed in the widest manner consistent with the principles and novel features claimed herein.
Claims
1. A wind noise detection method, characterized in that: The method comprises: Acquire a first signal and a second signal, wherein the first signal is obtained based on an original signal collected by a first microphone, and the second signal is obtained based on an original signal collected by a second microphone, and the first microphone and the second microphone are respectively arranged at different positions of the audio device; Taking one of the first signal and the second signal as a first target signal and the other as a second target signal; Performing phase adjustment on the first target signal to obtain an adjusted signal; Obtaining a wind noise coefficient according to a differential signal between the adjusted signal and the second target signal, wherein the wind noise coefficient indicates the degree of wind noise; The step of obtaining the wind noise coefficient according to the differential signal between the adjusted signal and the second target signal specifically includes: determining the difference between the differential signal between the adjusted signal and the second target signal, and determining a statistical value of a designated signal, wherein the statistical value includes any one of a minimum value and an average value of a power spectrum of the designated signal, and the designated signal includes one of the first signal and the second signal; and taking a ratio of the difference between the differential signal and the statistical value of the designated signal as the wind noise coefficient; The method also includes determining the designated signal in any one of the following ways: determining the first signal and the second signal with the smaller power spectrum as the designated signal; averaging the power spectra of the first signal and the second signal within a historical time period of a second designated time length from the current moment to obtain a designated average value, and if the designated average value is greater than a preset first threshold, the first signal and the second signal with the smaller average value within the second designated time length is determined as the designated signal.
2. The method according to claim 1, characterized in that: Before performing phase adjustment on the first target signal to obtain an adjusted signal, the method further includes: The microphone that collects the original signal of the first target signal is used as the designated microphone; the phase adjustment coefficient of the designated microphone is determined according to the target angular frequency vector, the target distance and the target angle, wherein the target angular frequency vector is a vector composed of multiple angular frequency values distributed at equal intervals, the target distance is the straight-line distance between the first microphone and the second microphone, and the target angle is the angle between the vector formed by the first microphone and the sound source and the vector formed by the first microphone and the second microphone; further, Performing phase adjustment on the first target signal to obtain an adjusted signal specifically includes: taking the product of the first target signal and the phase adjustment coefficient as the adjusted signal.
3. The method according to claim 2, characterized in that The phase adjustment coefficient is obtained using the following formula: Wherein, B is the phase adjustment coefficient, i is the imaginary unit, d is the target distance, is the target angle, w is the target angular frequency, and v is the speed of sound.
4. The method according to claim 1, characterized in that: Determining a difference between the adjusted signal and a differential signal of the second target signal specifically includes: Using a fast Fourier filter, performing amplitude compensation on a differential signal between the adjusted signal and the second target signal; Using a plurality of sub-bands obtained by dividing the power spectrum of the differential signal as a preset number of first sub-bands, and obtaining a difference value of the differential signal according to the preset number of first sub-bands; And, determining the statistical value of the designated signal specifically includes: The multiple sub-bands obtained by dividing the power spectrum of the designated signal are used as a preset number of second sub-bands, and the statistical value of the designated signal is obtained according to the preset number of second sub-bands.
5. The method according to claim 1, characterized in that The original signal is a time domain signal, and the first signal and the second signal are frequency domain signals; The obtaining of the first signal specifically includes: performing a fast Fourier transform on the original signal collected by the first microphone to obtain the first signal; The acquiring the second signal specifically includes: performing a fast Fourier transform on the original signal collected by the second microphone to obtain the second signal.
6. The method according to claim 1, characterized in that After obtaining the wind noise coefficient, the method further includes: If the wind noise coefficient is greater than a preset wind noise threshold, the audio device is controlled to turn on a wind noise reduction mode.
7. A wind noise detection device, characterized in that: The device comprises: A signal acquisition module, configured to: acquire a first signal and a second signal, wherein the first signal is obtained based on an original signal collected by a first microphone, and the second signal is obtained based on an original signal collected by a second microphone, and the first microphone and the second microphone are respectively arranged at different positions of the audio device; a signal determination module, configured to: use one of the first signal and the second signal as a first target signal and the other as a second target signal; A signal adjustment module is configured to: perform phase adjustment on the first target signal to obtain an adjusted signal; a wind noise coefficient determination module, configured to: obtain a wind noise coefficient according to a differential signal between the adjusted signal and the second target signal, wherein the wind noise coefficient indicates the degree of wind noise; The wind noise coefficient determination module is specifically used to: determine the difference between the differential signal of the adjusted signal and the second target signal, and determine the statistical value of the designated signal, wherein the statistical value includes any one of the minimum value and the average value of the power spectrum of the designated signal, and the designated signal includes one of the first signal and the second signal; and use the ratio of the difference between the differential signal and the statistical value of the designated signal as the wind noise coefficient; The wind noise coefficient determination module is also used to determine the designated signal in any one of the following ways: determining the one with the smaller power spectrum between the first signal and the second signal as the designated signal; averaging the power spectra of the first signal and the second signal within a historical time period of a second designated time length from the current moment to obtain a designated average value, and if the designated average value is greater than a preset first threshold, then determining the first signal and the second signal with the smaller average value in the second designated time length as the designated signal.
8. The wind noise detection device according to claim 7, characterized in that: The device also includes: A phase adjustment coefficient determination module is configured to: use a microphone that collects an original signal of the first target signal as a designated microphone; determine the phase adjustment coefficient of the designated microphone according to a target angular frequency vector, a target distance, and a target angle, wherein the target angular frequency vector refers to an angular frequency value vector distributed at equal intervals, the target distance is a straight-line distance between the first microphone and the second microphone, and the target angle is an angle between a vector formed by the first microphone and a sound source and an angle between a vector formed by the first microphone and the second microphone; The signal adjustment module is specifically configured to: use the product of the first target signal and the phase adjustment coefficient as the adjusted signal.
9. A wind noise detection device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory respectively communicate with each other through the communication bus; The memory is at least used to store computer programs; The processor is used to implement the steps of the wind noise detection method according to any one of claims 1 to 6 when executing the program stored in the memory.
Citation Information
Patent Citations
Noise suppression device
CN102792373A
Differential wave beam forming method and module, signal processing method and device, and chip
CN110383378A