Noise reduction method and device, test method and device, electronic equipment and storage medium

By acquiring the spectral characteristics of environmental noise and utilizing the pre-stored correspondence between spectral characteristics and filter coefficients, the most suitable filter coefficients are determined to generate noise-reduced frequencies, thus solving the problem of poor noise reduction effect in existing technologies and achieving precise noise reduction based on the direction of noise.

CN115767359BActive Publication Date: 2026-04-14VERISILICON MICROELECTRONICS (SHANGHAI) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
VERISILICON MICROELECTRONICS (SHANGHAI) CO LTD
Filing Date
2022-11-29
Publication Date
2026-04-14

AI Technical Summary

Technical Problem

Due to limitations in computing power, existing active noise-canceling headphones cannot determine the most suitable filter coefficients based on sounds from different directions, resulting in poor noise cancellation performance.

Method used

By acquiring the spectral characteristics of environmental noise and utilizing the pre-stored correspondence between spectral characteristics and filter coefficients, the most suitable filter coefficients are determined to generate noise-reducing frequencies, thus achieving precise noise reduction based on the direction of noise.

Benefits of technology

The noise reduction effect has been improved, ensuring optimal noise reduction performance under noise from different directions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115767359B_ABST
    Figure CN115767359B_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide a noise reduction method and device, a test method and device, electronic equipment and a storage medium, and relate to the field of acoustics and audio. The noise reduction method comprises: obtaining environmental noise and obtaining an environmental spectrum feature of the environmental noise; obtaining a spectrum feature-filter coefficient correspondence relationship; obtaining a target spectrum feature unit from the spectrum feature-filter coefficient correspondence relationship according to the environmental spectrum feature; obtaining a filter coefficient in a filter coefficient unit corresponding to the target spectrum feature unit in the spectrum feature-filter coefficient correspondence relationship as an environmental filter coefficient; and generating noise reduction audio according to the environmental filter coefficient. The noise reduction method and device, the test method and device, the electronic equipment and the storage medium provided by the embodiments of the present application can determine the most suitable filter coefficient according to the direction of noise, thereby improving the noise reduction effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the fields of acoustics and audio, and more specifically, to a noise reduction method and apparatus, a testing method and apparatus, an electronic device, and a storage medium. Background Technology

[0002] With the increasing frequency of headphone use, environmental noise has seriously affected the quality of headphone use. Traditional noise reduction methods mainly include sound insulation and material absorption, but their application is not ideal due to limitations in placement space, material properties, and cost. Therefore, active noise cancellation is gradually becoming a mainstream solution. Unlike traditional noise reduction methods, active noise control works on the principle of sound wave interference cancellation. It uses a filter in a built-in processing chip to generate a noise-reducing wave with a waveform opposite to the ambient noise. Playing this noise-reducing wave cancels out the original ambient noise, thus eliminating it.

[0003] However, existing active noise-canceling headphones, due to limitations in the computing power of their built-in chips, typically calculate a fixed noise-canceling filter coefficient offline. Ambient noise is directly passed through this fixed-coefficient filter to obtain the inverse waveform of the noise corresponding to that coefficient, which is then played back through the speaker. However, sound is directional, and the filter coefficients for noise from different directions vary significantly. Currently, noise-canceling filters using only a single coefficient cannot determine the most suitable coefficient based on the direction of sound, resulting in poor noise cancellation performance. Summary of the Invention

[0004] The purpose of this invention is to provide a noise reduction method and apparatus, a testing method and apparatus, an electronic device, and a storage medium, which can determine the most suitable filter coefficients according to the direction of noise, thereby improving the noise reduction effect.

[0005] In a first aspect, the present invention provides a noise reduction method, comprising: acquiring ambient noise and acquiring the ambient spectral characteristics of the ambient noise; acquiring a spectral characteristic-filter coefficient correspondence, wherein the spectral characteristic-filter coefficient correspondence is a correspondence between a plurality of spectral characteristic units and a plurality of filter coefficient units, each spectral characteristic unit corresponding to a unique filter coefficient unit, the plurality of spectral characteristic units being spectral characteristics of a plurality of audio signals from different directions acquired by an audio acquisition device; acquiring a target spectral characteristic unit from the spectral characteristic-filter coefficient correspondence based on the ambient spectral characteristics; acquiring the filter coefficients in the filter coefficient units corresponding to the target spectral characteristic unit in the spectral characteristic-filter coefficient correspondence as ambient filter coefficients; and generating a noise-reduced frequency based on the ambient filter coefficients.

[0006] In an optional implementation, obtaining the environmental spectrum characteristics of the environmental noise includes: obtaining one or more of the following as the environmental spectrum characteristics: the degree of dispersion of the environmental noise spectrum, harmonic parameters, and degree of convergence.

[0007] In an optional implementation, before obtaining the environmental spectrum characteristics of the environmental noise, the method further includes: removing audio signals in the environmental noise with frequencies lower than a first preset threshold and frequencies higher than a second preset threshold; the second preset threshold is greater than the first preset threshold.

[0008] In an optional implementation, the plurality of spectral feature units are the spectral features of the same audio signal in several different directions.

[0009] In an optional implementation, obtaining the target spectral feature unit from the plurality of spectral feature units based on the environmental spectral features includes: calculating the similarity between the environmental spectral features and each of the spectral feature units respectively; and obtaining the target spectral feature unit based on the similarity.

[0010] In an optional implementation, calculating the similarity between the environmental spectral features and each of the spectral feature units includes: calculating the Euclidean distance between the environmental spectral features and each of the spectral feature units; and using the Euclidean distance to characterize the similarity.

[0011] Secondly, the present invention provides a filter coefficient testing method, applied to a filter coefficient testing system, the filter coefficient testing system including an audio acquisition device, an audio playback device, an audio analysis device, and a position adjustment device. The method includes: the position adjustment device controlling the audio playback device to sequentially play preset audio in multiple different directions of the audio acquisition device; the audio acquisition device acquiring the sound of the preset audio played by the audio playback device in multiple different directions, obtaining multiple input audio; the audio analysis device acquiring the spectral characteristics of each input audio, and calculating the corresponding filter coefficients based on each spectral characteristic, constructing a spectral characteristic-filter coefficient correspondence between the filter coefficients and the spectral characteristics.

[0012] Thirdly, the present invention provides a filter coefficient testing system, comprising: an audio acquisition device, an audio playback device, an audio analysis device, and a position adjustment device; wherein, the position adjustment device is used to control the audio playback device to sequentially play preset audio in multiple different directions of the audio acquisition device; the audio playback device is used to sequentially play the preset audio in multiple different directions of the audio acquisition device under the control of the position adjustment device; the audio acquisition device is used to acquire the sound of the preset audio played by the audio playback device in multiple different directions, thereby obtaining multiple input audio; the audio analysis device is used to acquire the spectral characteristics of each input audio, and calculate the corresponding filter coefficients based on each spectral characteristic, thereby constructing a spectral characteristic-filter coefficient correspondence between the filter coefficients and the spectral characteristics.

[0013] Fourthly, the present invention provides a noise reduction device, comprising: an audio acquisition module for acquiring ambient noise; a feature acquisition module for acquiring the environmental spectrum features of the ambient noise; a parameter determination module for acquiring a spectrum feature-filter coefficient correspondence, wherein the spectrum feature-filter coefficient correspondence is a correspondence between a plurality of spectrum feature units and a plurality of filter coefficient units, each spectrum feature unit corresponds to a unique filter coefficient unit, the plurality of spectrum feature units are the spectrum features of a plurality of audio signals from different directions acquired by an audio acquisition device, and the filter coefficients in the filter coefficient units corresponding to the target spectrum feature unit in the spectrum feature-filter coefficient correspondence are acquired as environmental filter coefficients; and an audio generation module for generating noise-reduced audio based on the environmental filter coefficients.

[0014] Fifthly, the present invention provides an electronic device, comprising: at least one processor; and a memory, an audio acquisition device, and an audio playback device communicatively connected to the at least one processor; wherein the audio acquisition device is used to acquire ambient noise, the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform a noise reduction method as described in any of the foregoing embodiments to generate a noise-reduced frequency based on the ambient noise, and the audio playback device is used to play the noise-reduced frequency.

[0015] In a sixth aspect, the present invention provides a computer-readable storage medium storing a computer program, which is executed by a processor to implement the noise reduction method described in any of the foregoing embodiments.

[0016] In the noise reduction method, testing method, noise reduction device, electronic device, and storage medium provided in the embodiments of the present invention, after obtaining the environmental noise, a spectrum analysis is performed on the environmental noise to obtain the spectral characteristics of the environmental noise as environmental spectrum characteristics. Then, based on the environmental spectrum characteristics, the target spectrum feature unit is obtained from the pre-stored spectrum feature and filter coefficient spectrum feature-filter coefficient correspondence relationship. Since each spectrum feature unit in the pre-stored spectrum feature-filter coefficient correspondence relationship is the spectrum feature of audio signals from different directions collected by the audio acquisition device, the data of the target spectrum feature unit contains the direction information of the sound. The filter coefficient corresponding to the target spectrum feature unit is obtained from the pre-stored spectrum feature and filter coefficient spectrum feature-filter coefficient correspondence relationship as the environmental filter coefficient. The environmental filter coefficient is the optimal filter coefficient in that direction. That is, the most suitable filter coefficient is determined according to the direction of the noise. The noise reduction frequency is generated according to the environmental filter coefficient to achieve the purpose of improving the noise reduction effect. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart illustrating the noise reduction method provided in Embodiment 1 of the present invention;

[0019] Figure 2 This is a schematic flowchart of the noise reduction method provided in Embodiment 2 of the present invention;

[0020] Figure 3 This is a flowchart illustrating the filter coefficient testing method provided in Embodiment 3 of the present invention;

[0021] Figure 4 This is a schematic diagram of the noise reduction device provided in Embodiment 4 of the present invention;

[0022] Figure 5 This is a schematic diagram of the electronic device provided in Embodiment 5 of the present invention;

[0023] Figure 6 This is a schematic diagram of the filter coefficient testing system provided in Embodiment Six of the present invention. Detailed Implementation

[0024] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0025] Therefore, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the invention without inventive effort are within the scope of protection of the invention.

[0026] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0027] In the description of this invention, it should be noted that if terms such as "upper," "lower," "inner," or "outer" are used to indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, or the orientation or positional relationship in which the product of this invention is usually placed, they are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this invention.

[0028] Furthermore, the terms "first" and "second" are used only to distinguish descriptions and should not be interpreted as indicating or implying relative importance.

[0029] It should be noted that, where there is no conflict, the features in the embodiments of the present invention can be combined with each other.

[0030] Embodiment 1 of the present invention provides a noise reduction method, applied to a noise reduction device, such as... Figure 1 As shown, it includes the following steps:

[0031] Step S101: Obtain ambient noise.

[0032] In different embodiments of the present invention, environmental noise can be acquired using different methods. For example, in this embodiment, a sound acquisition device can be set in the noise reduction device to collect the ambient sound of the environment in which the noise reduction device is currently located in real time as environmental noise. In other embodiments of the present invention, a sound acquisition device can be set outside the noise reduction device, connected to the noise reduction device, and the sound acquisition device can transmit the ambient sound to the noise reduction device as environmental noise, or other methods can be used. The specific settings and uses can be flexibly configured according to actual needs.

[0033] Step S102: Obtain the environmental spectrum characteristics of environmental noise.

[0034] After acquiring the environmental noise, an audio analysis algorithm can be used to perform spectral analysis on the environmental noise to obtain its spectrum. The calculated spectrum then provides the spectral characteristics of the environmental noise, which can be used as the environmental spectral features. In this embodiment, the Fast Fourier Transform (FFT) algorithm can be used as the audio analysis algorithm to perform spectral analysis on the environmental noise to obtain its environmental spectral features. It is understood that using the FFT algorithm to perform spectral analysis on the environmental noise to obtain its environmental spectral features is merely a specific example in this embodiment and does not constitute a limitation. In other embodiments of this invention, other spectral analysis algorithms, such as the Chirp-Z transform algorithm, the Goertzel algorithm, and other types of spectral analysis algorithms, can be used to perform spectral analysis on the environmental noise to obtain its environmental spectral features. The specific algorithm can be flexibly used according to the actual situation.

[0035] Furthermore, in this embodiment, the environmental spectrum features include one or more of the following: the degree of dispersion of the spectrum, harmonic parameters, and convergence degree. That is, in this embodiment, the FFT algorithm is used to obtain one or more of the following as environmental spectrum features: the degree of dispersion of the spectrum, harmonic parameters, and convergence degree. It is understood that the aforementioned environmental spectrum features, including one or more of the following: the degree of dispersion of the spectrum, harmonic parameters, and convergence degree, are only a specific example in this embodiment. In other embodiments of the present invention, the environmental spectrum features may also include other types of spectrum features such as high-frequency-low-frequency distribution features and energy distribution of the spectrum graph. The specific features can be flexibly used according to actual needs.

[0036] Step S103: Obtain the correspondence between spectral features and filter coefficients.

[0037] Specifically, in this embodiment, the spectral feature-filter coefficient correspondence is a pre-stored correspondence table in the noise reduction device. This correspondence represents the relationship between several spectral feature units and several filter coefficient units, with each spectral feature unit corresponding to a unique filter coefficient unit. The several spectral feature units are the spectral features of audio signals from several different directions acquired by the audio acquisition device. That is, the spectral feature-filter coefficient correspondence is obtained by measuring the spectral features and filter coefficients multiple times in an experimental environment beforehand, and then stored in the correspondence table. Each measured spectral feature is stored in one cell of the correspondence table, forming a spectral feature unit, and each measured filter coefficient is stored in one cell of the correspondence table, forming a filter coefficient unit. Each spectral feature unit corresponds to a unique filter coefficient unit. It is understood that in this embodiment, each spectral feature unit corresponds to a unique filter coefficient unit, while each filter coefficient unit can correspond to a unique spectral feature unit or multiple spectral feature units, depending on the actual measurement results.

[0038] In this embodiment, the plurality of spectral feature units are the spectral features of audio signals from several different directions acquired by the audio acquisition device. Specifically, preset audio is played in several different directions by the audio acquisition device. Each time, the audio acquisition device acquires the sound of the preset audio played in a single direction, obtains an audio signal, and performs spectral analysis on the audio signal using the same audio analysis algorithm as in step S102 to obtain the spectral features of the audio signal. Then, the optimal filter coefficients of the preset audio signal in the current direction are calculated. The measured spectral features of the audio signal are stored in a corresponding table as the spectral features in the current direction to form a spectral feature unit, and the calculated optimal filter coefficients are stored in the corresponding table as the filter coefficients in the current direction to form a filter coefficient unit uniquely corresponding to that spectral feature unit.

[0039] Preferably, in one embodiment of the present invention, the plurality of spectral feature units are the spectral features of the same audio signal in several different directions, that is, the same preset audio is played in several different directions of the audio acquisition device. Using the same audio signal to play in several different directions, so that the audio acquisition device can acquire spectral features in several different directions, can reduce the influence of different audio signals on the spectral features and improve the correlation between spectral features and audio direction.

[0040] It is understood that the aforementioned correspondence between spectral features and filter coefficients, which is a pre-stored correspondence table in the noise reduction device, is only a specific example in this embodiment and does not constitute a limitation. In other embodiments of the present invention, the correspondence table may be stored in a server and then sent to the noise reduction device through a communication device, or other methods may be used. The specific settings can be flexibly configured according to actual needs.

[0041] Step S104: Obtain the target spectral feature unit from the correspondence between spectral features and filter coefficients based on the environmental spectral features.

[0042] Specifically, in this embodiment, the spectral feature unit in the spectral feature-filter coefficient correspondence that is identical to the environmental spectral feature is used as the target spectral feature unit. It is understood that the foregoing is merely a specific example in this embodiment and does not constitute a limitation. In other embodiments of the present invention, other methods may be used, such as selecting the spectral feature unit in the spectral feature-filter coefficient correspondence that has the highest similarity to the environmental spectral feature as the target spectral feature unit. The appropriate method can be flexibly selected according to actual needs.

[0043] Furthermore, in one embodiment of the present invention, if the spectral feature unit with the highest similarity to the environmental spectral feature in the spectral feature-filter coefficient correspondence is selected as the target spectral feature unit, it is necessary to calculate the similarity between the environmental spectral feature and the spectral features stored in each spectral feature unit, and then select the spectral feature unit with the highest similarity as the target spectral feature unit. The similarity can be calculated by measuring the Euclidean distance between the environmental spectral feature and the spectral features stored in each spectral feature unit. When using Euclidean distance to characterize similarity, the spectral feature unit with the smallest Euclidean distance to the environmental spectral feature has the greatest similarity to the environmental spectral feature. Euclidean distance, also known as the Euclidean metric, is a distance definition referring to the true distance between two points in multidimensional space, or the natural length of a vector (i.e., the distance from that point to the origin).

[0044] Step S105: Obtain the filter coefficients in the filter coefficient unit corresponding to the target spectral feature unit in the spectral feature-filter coefficient correspondence relationship as the environmental filter coefficients.

[0045] Specifically, in this step, a filter coefficient unit that uniquely corresponds to the target spectral feature is obtained from the correspondence between spectral features and filter coefficients, and the filter coefficients in this filter coefficient unit are used as environmental filter coefficients.

[0046] Step S106: Generate noise-reduced frequencies based on environmental filter coefficients.

[0047] Specifically, in this step, a filter is constructed based on the environmental filter coefficients. This filter is then used to filter environmental noise, generating a noise-reduced frequency that is the inverse of the environmental noise. The noise-reducing device or an audio playback device connected to the noise-reducing device can then play this noise-reduced frequency to cancel out the environmental noise, thereby eliminating it.

[0048] In the noise reduction method provided in this embodiment, after obtaining the environmental noise, a spectrum analysis is performed on the environmental noise to obtain the spectral characteristics of the environmental noise as environmental spectrum characteristics. Then, based on the environmental spectrum characteristics, the target spectrum feature unit is obtained from the pre-stored spectrum feature and filter coefficient spectrum feature-filter coefficient correspondence. Since each spectrum feature unit in the pre-stored spectrum feature-filter coefficient correspondence is the spectrum feature of audio signals from different directions collected by the audio acquisition device, the data of the target spectrum feature unit contains the direction information of the sound. The filter coefficient corresponding to the target spectrum feature unit is obtained from the pre-stored spectrum feature and filter coefficient spectrum feature-filter coefficient correspondence as the environmental filter coefficient. The environmental filter coefficient is the optimal filter coefficient in that direction. That is, the most suitable filter coefficient is determined according to the direction of the noise. The noise reduction frequency is generated according to the environmental filter coefficient to achieve the purpose of improving the noise reduction effect.

[0049] Embodiment 2 of the present invention provides a noise reduction method, applied to a noise reduction device, such as... Figure 2 As shown, it includes the following steps:

[0050] Step S201: Obtain ambient noise.

[0051] Step S202: Remove audio signals from the ambient noise that have a frequency lower than the first preset frequency and a frequency higher than the second preset frequency, wherein the second preset frequency is greater than the first preset frequency.

[0052] In this step, the first and second preset frequencies are merely pre-set frequency thresholds. In practical applications, the proportion of audio signals with excessively low and high frequencies in the actual acquired environmental noise is relatively small. However, since the frequencies of these audio signals may have extreme values, including maxima and minima, they significantly affect the acquisition of the environmental spectrum characteristics of the overall environmental noise. Therefore, in this embodiment, audio signals with frequencies lower than the first preset frequency and frequencies higher than the second preset frequency are removed from the environmental noise before acquiring its environmental spectrum characteristics, forming new environmental noise. The environmental noise in subsequent steps of this embodiment is the new environmental noise processed in this step.

[0053] Preferably, in some embodiments of the present invention, the first preset frequency is 20Hz and the second preset frequency is 20kHz. It is understood that the first preset frequency of 20Hz and the second preset frequency of 20kHz are merely specific examples in this embodiment and do not constitute a limitation. In other embodiments of the present invention, other values ​​may be used, and the specific settings can be made according to actual needs. Removing audio signals with frequencies below 20Hz and above 20kHz from environmental noise to form new environmental noise, since these frequencies are inaudible to the human ear, does not negatively impact the noise reduction effect. Furthermore, removing these frequencies reduces the computational load in the environmental noise processing and improves the accuracy of the environmental spectrum characteristics obtained subsequently from the environmental noise, thereby enhancing the accuracy of the selection of environmental filter coefficients and improving the noise reduction effect.

[0054] Step S203: Obtain the environmental spectrum characteristics of environmental noise.

[0055] Step S204: Obtain the correspondence between spectral features and filter coefficients.

[0056] Step S205: Obtain the target spectral feature unit from the correspondence between spectral features and filter coefficients based on the environmental spectral features.

[0057] Step S206: Obtain the filter coefficients in the filter coefficient unit corresponding to the target spectrum feature unit in the spectrum feature-filter coefficient correspondence relationship as the environment filter coefficients.

[0058] Step S207: Generate noise-reduced frequencies based on environmental filter coefficients.

[0059] It is understood that steps S201, S203 to S207 in the noise reduction method provided in Embodiment 2 of the present invention are largely the same as steps S101 to S106 in Embodiment 1. For details, please refer to the specific description of the foregoing embodiments.

[0060] The noise reduction method provided in this embodiment retains all the technical features of Embodiment 1 and also possesses all the technical effects of Embodiment 1. For details, please refer to the specific description of Embodiment 1. Furthermore, in this second embodiment, a portion of the audio signal with a frequency lower than the first preset frequency and a frequency higher than the second preset frequency in the environmental noise is removed to form new environmental noise. Since the proportion of excessively low and high frequency audio signals in the actual collected environmental noise is small, but these frequencies may have extreme values, including maxima and minima, which significantly affect the acquisition of the environmental spectrum characteristics of the entire environmental noise, removing the portion of the audio signal with a frequency lower than the first preset frequency and a frequency higher than the second preset frequency in the environmental noise can improve the accuracy of the subsequent acquisition of the environmental spectrum characteristics based on the environmental noise, thereby improving the accuracy of the selection of environmental filter coefficients and enhancing the noise reduction effect. In addition, removing the portion of the audio signal with a frequency lower than the first preset frequency and a frequency higher than the second preset frequency in the environmental noise can reduce the computational load of the environmental noise processing process.

[0061] Embodiment 3 of the present invention provides a filter coefficient testing method, applied to a filter coefficient testing system. The filter coefficient testing system includes an audio acquisition device, an audio playback device, an audio analysis device, and a position adjustment device, specifically as follows: Figure 3 As shown, it includes the following steps:

[0062] Step S301: The position adjustment device controls the audio playback device to play preset audio sequentially in multiple different directions of the audio acquisition device.

[0063] Specifically, in this step, the position adjustment device is used to adjust the position of the audio playback device, thereby placing the audio playback device in different directions from the audio acquisition device. Each time the position adjustment device adjusts the position of the audio playback device, the audio playback device plays the preset audio at that current position. After the audio playback device finishes playing the preset audio at one position, the position adjustment device adjusts the audio playback device to another position until the audio playback device has played the preset audio in all directions from the audio acquisition device. It can be understood that the position where the audio playback device plays the preset audio can be a position pre-set in the position adjustment device, or a position randomly generated by an algorithm; the specific setting can be flexibly configured according to actual needs.

[0064] Step S302: The audio acquisition device acquires the sound of the preset audio played by the audio playback device in multiple different directions, and obtains multiple input audio.

[0065] In this step, the audio acquisition device collects the sound generated by the audio playback device playing preset audio, and obtains the sound played by the audio playback device at various positions, that is, in various directions of the audio acquisition device, thus obtaining multiple input audio.

[0066] Step S303: The audio analysis device acquires the spectral features of each input audio, and calculates the corresponding filter coefficients based on each spectral feature, and constructs the spectral feature-filter coefficient correspondence between the filter coefficients and the spectral features.

[0067] In this step, the audio analysis device uses the same audio analysis algorithm as the noise reduction method provided in Embodiments 1 and 2 above to perform audio analysis on each input audio, obtain the spectral characteristics of each input audio, and then calculate the optimal filter coefficients under each different spectral characteristics. The spectral characteristics of the measured audio signal are stored in the corresponding table to form a spectral feature unit, and the optimal filter coefficients under each spectral characteristic are stored in the corresponding table to form a filter coefficient unit that uniquely corresponds to the spectral feature unit. The spectral feature-filter coefficient correspondence between the filter coefficients and the spectral characteristics is thus established.

[0068] The filter coefficient testing method provided in Embodiment 3 of the present invention uses a filter coefficient testing system outside the noise reduction device to pre-measure the spectral characteristics of audio signals in different directions and the optimal filter coefficients under each spectral characteristic to obtain the spectral characteristic-filter coefficient correspondence. This spectral characteristic-filter coefficient correspondence can be directly used by the noise reduction device without the need for the noise reduction device to perform professional calculations. This greatly reduces the requirements for the chip computing power of the noise reduction device during the noise reduction process while ensuring the noise reduction effect.

[0069] Embodiment 4 of the present invention relates to a noise reduction device, such as... Figure 4As shown, the system includes: an audio acquisition module 401, which is used to acquire ambient noise. In different embodiments of the present invention, the audio acquisition module 401 can be an audio acquisition device, such as a microphone, or a communication device used to communicate with the audio acquisition device to acquire the ambient noise acquired by the audio acquisition device. The specific configuration can be adjusted according to actual conditions. A feature acquisition module 402 is used to acquire the environmental spectrum features of the ambient noise. A parameter determination module 403 is used to acquire the spectrum feature-filter coefficient correspondence. The spectrum feature-filter coefficient correspondence is a correspondence between several spectrum feature units and several filter coefficient units. Each spectrum feature unit corresponds to a unique filter coefficient unit. The several spectrum feature units are the spectrum features of several audio signals from different directions acquired by the audio acquisition device. The filter coefficients in the filter coefficient units corresponding to the target spectrum feature unit in the spectrum feature-filter coefficient correspondence are acquired as environmental filter coefficients. An audio generation module 404 is used to generate noise-reduced audio based on the environmental filter coefficients.

[0070] In the noise reduction device provided in Embodiment 4 of the present invention, after the audio acquisition module 401 acquires the environmental noise, the feature acquisition module 402 performs spectral analysis on the environmental noise to obtain the spectral features of the environmental noise as environmental spectral features. Then, the parameter determination module 403 obtains the target spectral feature unit based on the environmental spectral features in the pre-stored spectral feature and filter coefficient spectral feature-filter coefficient correspondence relationship. Since each spectral feature unit in the pre-stored spectral feature-filter coefficient correspondence relationship is the spectral feature of audio signals from different directions acquired by the audio acquisition device, the data of the target spectral feature unit contains the direction information of the sound. The parameter determination module 403 obtains the filter coefficient corresponding to the target spectral feature unit as the environmental filter coefficient from the pre-stored spectral feature and filter coefficient spectral feature-filter coefficient correspondence relationship. The environmental filter coefficient is the optimal filter coefficient in that direction. That is, the most suitable filter coefficient is determined according to the direction of the noise. The audio generation module 404 generates the noise-reduced audio based on the environmental filter coefficient to achieve the purpose of improving the noise reduction effect.

[0071] Embodiment 5 of the present invention relates to an electronic device, such as... Figure 5As shown, it includes: at least one processor 501; and a memory 502, an audio acquisition device 503, and an audio playback device 504 communicatively connected to the at least one processor 501; wherein, the audio acquisition device 503 is used to acquire ambient noise, the memory 502 stores instructions that can be executed by the at least one processor 501, the instructions being executed by the at least one processor 501 to enable the at least one processor 501 to perform the noise reduction method provided in the foregoing embodiments to generate noise-reduced frequencies based on ambient noise, and the audio playback device 504 is used to play the noise-reduced frequencies.

[0072] The memory and processor are connected via a bus, which can include any number of interconnecting buses and bridges, connecting various circuits of one or more processors and memories. The bus can also connect various other circuits, such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and will not be described further herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be a single element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices over a transmission medium. Data processed by the processor is transmitted over the wireless medium via an antenna, which further receives data and transmits it to the processor.

[0073] The processor manages the bus and general processing, and also provides various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory is used to store data used by the processor during operation.

[0074] Embodiment 6 of the present invention relates to a filter coefficient testing system, such as... Figure 6 As shown, it includes: an audio acquisition device 601, an audio playback device 602, an audio analysis device 603, and a position adjustment device 604.

[0075] The position adjustment device 604 controls the audio playback device 602 to sequentially play preset audio in multiple different directions from the audio acquisition device 601. In practical applications, the position adjustment device 604 can be, for example, as shown below. Figure 6The guide rail 604 shown surrounds the audio acquisition device 601. The audio playback device 602 rotates around the audio acquisition device 601 on the guide rail 604, thereby controlling the audio playback device 602 to play preset audio sequentially in multiple different directions of the audio acquisition device 601. It is understood that the guide rail surrounding the audio acquisition device 601 and the position adjustment device 604 are merely illustrative examples in some embodiments of the present invention and do not constitute a limitation. In other embodiments of the present invention, the position adjustment device 604 can also be other structures such as automated robots or automated vehicles, and can be flexibly configured according to actual needs.

[0076] The audio playback device 602 is used to play preset audio in multiple different directions of the audio acquisition device 601 in sequence under the control of the position adjustment device 604.

[0077] The audio acquisition device 601 is used to acquire the sound generated by the audio playback device 602 playing preset audio in multiple different directions, thereby obtaining multiple input audio;

[0078] The audio analysis device 603 is used to acquire the spectral features of each input audio, and calculate the corresponding filter coefficients based on each spectral feature, and construct the spectral feature-filter coefficient correspondence between the filter coefficients and the spectral features.

[0079] The filter coefficient testing system provided in Embodiment 6 of this invention controls the audio playback device 602 to sequentially play preset audio in multiple different directions of the audio acquisition device 601 via the position adjustment device 604. This allows the audio acquisition device 601 to acquire the sounds generated by the preset audio played in multiple different directions, obtaining the input audio. Finally, the audio analysis device 603 obtains the spectral characteristics of each input audio, and calculates the corresponding filter coefficients based on each spectral characteristic, constructing a spectral characteristic-filter coefficient correspondence between the filter coefficients and the spectral characteristics. The spectral characteristic-filter coefficient correspondence between the spectral characteristics of the audio signals in each different direction and the optimal filter coefficients is pre-measured. This spectral characteristic-filter coefficient correspondence can be directly used by the noise reduction device without requiring professional calculations from the noise reduction device. This significantly reduces the computational requirements of the noise reduction device's chip during the noise reduction process while ensuring the noise reduction effect.

[0080] Embodiment 7 of the present invention relates to a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the above-described method embodiments.

[0081] That is, those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing related hardware. This program is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0082] The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A noise reduction method, characterized in that, include: Acquire environmental noise and obtain the environmental spectrum characteristics of the environmental noise; Obtain the correspondence between spectral features and filter coefficients. The correspondence between spectral features and filter coefficients is a correspondence between several spectral feature units and several filter coefficient units. Each spectral feature unit corresponds to a unique filter coefficient unit. The several spectral feature units are the spectral features of several audio signals from different directions collected by the audio acquisition device. The target spectral feature unit is obtained from the spectral feature-filter coefficient correspondence based on the environmental spectral features; The filter coefficients in the filter coefficient unit corresponding to the target spectral feature unit in the spectral feature-filter coefficient correspondence are obtained as environmental filter coefficients; Noise reduction frequency is generated based on the environmental filter coefficients; The step of obtaining the target spectral feature unit from the spectral feature-filter coefficient correspondence based on the environmental spectral features includes: calculating the similarity between the environmental spectral features and each of the spectral feature units respectively; The target spectral feature unit is obtained based on the similarity.

2. The method according to claim 1, characterized in that, The acquisition of the environmental spectrum characteristics of the environmental noise includes: The environmental noise spectrum is obtained by taking one or more of the following parameters as characteristics: the degree of dispersion, harmonic parameters, and degree of convergence.

3. The method according to claim 1, characterized in that, Before obtaining the environmental spectrum characteristics of the environmental noise, the method further includes: Remove audio signals from the environmental noise whose frequency is below a first preset threshold and whose frequency is above a second preset threshold; The second preset threshold is greater than the first preset threshold.

4. The method according to claim 1, characterized in that, The aforementioned spectral feature units are the spectral features of the same audio signal in several different directions.

5. The method according to claim 1, characterized in that, The step of calculating the similarity between the environmental spectral features and each of the spectral feature units includes: Calculate the Euclidean distance between the environmental spectral features and each of the spectral feature units respectively; The similarity is represented by the Euclidean distance.

6. A method for testing filter coefficients, characterized in that, An application is made in a filter coefficient testing system, the filter coefficient testing system including an audio playback device, an audio analysis device, a position adjustment device, and the audio acquisition device as described in claim 1, the method comprising: The position adjustment device controls the audio playback device to sequentially play preset audio in multiple different directions of the audio acquisition device; The audio acquisition device acquires the sound of the preset audio played by the audio playback device in multiple different directions, thereby obtaining multiple input audio; The audio analysis device acquires the spectral features of each input audio, and calculates the corresponding filter coefficients based on each spectral feature, thereby constructing a spectral feature-filter coefficient correspondence between the filter coefficients and the spectral features.

7. A filter coefficient testing system, characterized in that, include: Audio playback device, audio analysis device, position adjustment device, and audio acquisition device as described in claim 1; The position adjustment device is used to control the audio playback device to play preset audio sequentially in multiple different directions of the audio acquisition device; The audio playback device is used to play preset audio sequentially in multiple different directions of the audio acquisition device under the control of the position adjustment device. The audio acquisition device is used to acquire the sound of the preset audio played by the audio playback device in multiple different directions, thereby obtaining multiple input audio; The audio analysis device is used to acquire the spectral features of each input audio, and calculate the corresponding filter coefficients based on each spectral feature, thereby constructing a spectral feature-filter coefficient correspondence between the filter coefficients and the spectral features.

8. A noise reduction device, characterized in that, include: An audio acquisition module, wherein the audio acquisition module is used to acquire ambient noise; A feature acquisition module, wherein the feature acquisition module is used to acquire the environmental spectrum features of the environmental noise; The parameter determination module is used to obtain the correspondence between spectral features and filter coefficients. The correspondence between spectral features and filter coefficients is a correspondence between several spectral feature units and several filter coefficient units. Each spectral feature unit corresponds to a unique filter coefficient unit. The several spectral feature units are the spectral features of several audio signals from different directions collected by the audio acquisition device. The filter coefficients in the filter coefficient units corresponding to the target spectral feature unit in the spectral feature-filter coefficient correspondence are obtained as environmental filter coefficients. An audio generation module, wherein the audio generation module is used to generate noise-reduced audio based on the environmental filter coefficients; The parameter determination module is used to calculate the similarity between the environmental spectral features and each of the spectral feature units; and to obtain the target spectral feature unit based on the similarity.

9. An electronic device, characterized in that, include: At least one processor; In addition, a memory, an audio acquisition device, and an audio playback device are communicatively connected to the at least one processor; The audio acquisition device is used to acquire ambient noise, the memory stores instructions that can be executed by the at least one processor, the instructions are executed by the at least one processor to enable the at least one processor to perform the noise reduction method as described in any one of claims 1 to 5 to generate a noise-reduced frequency based on the ambient noise, and the audio playback device is used to play the noise-reduced frequency.

10. A computer-readable storage medium storing a computer program, characterized in that, The computer program is executed by a processor to implement the noise reduction method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Noise reducing method and device and earphone

    CN108847208A

  • Beamformer and acoustic echo canceller (AEC) system

    CN112236820A