Headphone Noise Reduction Method, Device, Electronic Device and Computer Readable Storage Medium

Abstract

The present application provides a headphone noise reduction method, apparatus, electronic device, and computer-readable storage medium, relating to the technical field of headphones. The method includes: testing first frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to a first feedforward noise reduction filter coefficient; testing second frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to a second feedforward noise reduction filter coefficient; calculating a target frequency response of the feedforward noise reduction filter based on the first frequency response data and the second frequency response data; and adjusting the feedforward noise reduction filter based on the target frequency response. By testing multiple frequency response data corresponding to the headphone device when different feedforward noise reduction filter coefficients are set, the present application determines the target frequency response of the feedforward noise reduction filter under ideal conditions, so as to adjust the feedforward noise reduction filter according to the target frequency response, effectively improving the noise reduction effect of the headphone device and being applicable to various different wearing situations.

Description

Technical Field

[0001] This application relates to the technical field of earphones, and more specifically, to an earphone noise reduction method, device, electronic device, and computer-readable storage medium. Background Art

[0002] In current ANC (Active Noise Control) noise-canceling earphones, generally, an external microphone is configured on the outside of the earphone to collect ambient sound, and an internal microphone is configured inside the earphone to collect residual sound. The feedforward noise reduction module processes the audio data collected by the external microphone, and after being filtered by the feedforward noise reduction filter, it is played by the speaker. Therefore, by designing the feedforward noise reduction filter, the original ambient sound residue in the ear canal can be canceled, achieving the purpose of active noise reduction.

[0003] Since the frequency responses of the speakers and microphones of each earphone are different, during the production stage, calibration is usually performed according to the acoustic characteristics of different earphones to make the earphones achieve a better noise reduction effect. Also, in order to calibrate the differences between the human ear and the ear canal environment used during testing, the feedforward noise reduction filter can be calibrated when the earphones are actually worn on the human ear to further improve the noise reduction effect of the earphones. However, the current calibration methods have a large delay, a large workload, a long search time, and are greatly affected by sudden noises, resulting in a poor calibration effect on the filter, and thus a poor noise reduction effect after the earphones are calibrated, unable to meet the wearing needs of different users in different scenarios. Summary of the Invention

[0004] In view of this, the purpose of the embodiments of this application is to provide an earphone noise reduction method, device, electronic device, and computer-readable storage medium to improve the problem of poor noise reduction effect of earphone devices in the existing technology.

[0005] To solve the above problems, in a first aspect, the embodiments of this application provide an earphone noise reduction method, and the method includes:

[0006] When the feedforward noise reduction filter of the earphone device is set to the first feedforward noise reduction filter coefficient, test the first frequency response data corresponding to the earphone device;

[0007] When the feedforward noise reduction filter of the earphone device is set to the second feedforward noise reduction filter coefficient, test the second frequency response data corresponding to the earphone device;

[0008] Calculate the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data;

[0009] Adjust the feedforward noise reduction filter based on the target frequency response.

[0010] In the above implementation process, when the user wearing the headphone device turns on the noise reduction function of the headphones, the feedforward noise reduction filter in the headphone device can be set to different feedforward noise reduction filter coefficients on the premise of maintaining the current stable noise reduction effect, and multiple frequency response data corresponding to the headphone device under different coefficients can be tested. Through the multiple frequency response data, the target frequency response of the feedforward noise reduction filter under ideal conditions can be calculated, so as to perform adjustment operations such as compensation or update on the coefficients of the feedforward noise reduction filter according to the target frequency response, and optimize the noise reduction effect when performing feedforward active noise reduction on the feedforward noise reduction filter. It can adaptively adjust and optimize the noise reduction effect of the headphone device during the noise reduction process, and is applicable to different wearing situations of multiple different users.

[0011] Optionally, when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, testing the first frequency response data corresponding to the headphone device includes:

[0012] When the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, collect the first headphone data of the headphone device;

[0013] According to the first headphone data and the first feedforward noise reduction filter coefficient, determine the first frequency response data corresponding to the headphone device.

[0014] In the above implementation process, by collecting the first headphone data corresponding to setting the feedforward noise reduction filter to the first feedforward noise reduction filter coefficient, the current first frequency response data of the headphone device is calculated according to the first headphone data and the first feedforward noise reduction filter coefficient, effectively improving the accuracy and real-time performance of the first frequency response data.

[0015] Optionally, the first headphone data includes first audio data and second audio data; collecting the first headphone data of the headphone device includes:

[0016] Collect the first audio data of the in-ear microphone in the headphone device;

[0017] Collect the second audio data of the out-ear microphone in the headphone device;

[0018] The first frequency response data includes a first noise reduction frequency response and a first feedforward noise reduction filter frequency response; according to the first headphone data and the first feedforward noise reduction filter coefficient, determining the first frequency response data corresponding to the headphone device includes:

[0019] According to the first audio data and the second audio data, calculate the first noise reduction frequency response between the in-ear microphone and the out-ear microphone;

[0020] Determine the frequency response of the first feedforward noise reduction filter according to the first feedforward noise reduction filter coefficients.

[0021] In the above implementation process, the first frequency response data includes the frequency response of the first feedforward noise reduction filter during feedforward active noise reduction by the feedforward noise reduction filter and the first noise reduction frequency response during active noise reduction by the headphone device. Among them, the first noise reduction frequency response is the difference data of the frequency response between the first audio data of the in-ear microphone and the second audio data of the out-ear microphone in the headphone device when the headphone device operates with the first feedforward noise reduction filter coefficients. By respectively collecting the current real-time audio data of the two microphones, the first noise reduction frequency response of the frequency response difference between the in-ear microphone and the out-ear microphone can be calculated according to the frequency domain characteristics of the two audio data. And by setting the first feedforward noise reduction filter coefficients, the corresponding frequency response of the first feedforward noise reduction filter is determined, so as to determine the actual noise reduction frequency response when the feedforward noise reduction filter performs noise reduction, improving the accuracy and real-time performance of the first frequency response data.

[0022] Optionally, when the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficients, testing the second frequency response data corresponding to the headphone device includes:

[0023] Determine the corresponding second feedforward noise reduction filter coefficients according to the first feedforward noise reduction filter coefficients;

[0024] When the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficients, collect the second headphone data of the headphone device;

[0025] Determine the second frequency response data corresponding to the headphone device according to the second headphone data and the second feedforward noise reduction filter coefficients.

[0026] In the above implementation process, the second feedforward noise reduction filter coefficients different from the first feedforward noise reduction filter coefficients are determined through the first feedforward noise reduction filter coefficients, and the second headphone data corresponding to the second feedforward noise reduction filter coefficients set for the feedforward noise reduction filter is collected, so as to calculate the current second frequency response data of the headphone device according to the second headphone data and the second feedforward noise reduction filter coefficients, effectively improving the accuracy and real-time performance of the second frequency response data.

[0027] Optionally, the second headphone data includes third audio data and fourth audio data; the collecting the second headphone data of the headphone device includes:

[0028] Collect the third audio data of the in-ear microphone in the headphone device;

[0029] Collect the fourth audio data of the out-ear microphone in the headphone device;

[0030] The second frequency response data includes a second noise reduction frequency response and a second feedforward noise reduction filter frequency response; determining the second frequency response data corresponding to the headphone device according to the second headphone data and the second feedforward noise reduction filter coefficients includes:

[0031] Calculating the second noise reduction frequency response between the in-ear microphone and the out-ear microphone according to the third audio data and the fourth audio data;

[0032] Determining the second feedforward noise reduction filter frequency response according to the second feedforward noise reduction filter coefficients.

[0033] In the above implementation process, the second frequency response data includes the second feedforward noise reduction filter frequency response when the feedforward noise reduction filter performs feedforward active noise reduction and the second noise reduction frequency response when the headphone device performs active noise reduction. Among them, the second noise reduction frequency response is the difference data of the frequency response between the third audio data of the in-ear microphone and the fourth audio data of the out-ear microphone collected when the headphone device works with the second feedforward noise reduction filter coefficients. By respectively collecting the current real-time audio data of the two microphones, the second noise reduction frequency response of the frequency response difference between the in-ear microphone and the out-ear microphone can be calculated according to the frequency domain characteristics of the two audio data, and the corresponding second feedforward noise reduction filter frequency response can be determined through the set second feedforward noise reduction filter coefficients, so as to determine the actual noise reduction frequency response when the feedforward noise reduction filter performs noise reduction, improving the accuracy and real-time performance of the second frequency response data.

[0034] Optionally, adjusting the feedforward noise reduction filter based on the target frequency response includes:

[0035] Adjusting the current filter coefficients of the feedforward noise reduction filter according to the target frequency response to obtain adjusted filter coefficients;

[0036] Configuring the feedforward noise reduction filter to work with the adjusted filter coefficients.

[0037] In the above implementation process, according to the calculated target frequency response of the feedforward noise reduction filter under ideal conditions, an optimization algorithm is used to optimize the current filter coefficients of the feedforward noise reduction filter, and the corresponding adjusted filter coefficients can be obtained, and the feedforward noise reduction filter is configured to perform feedforward active noise reduction and other operations with the adjusted filter coefficients, reducing the difference between the actual frequency response and the target frequency response of the feedforward noise reduction filter, effectively optimizing the noise reduction effect of the feedforward noise reduction filter, so as to adaptively iteratively calibrate and adjust the noise reduction effect in the headphone device according to the specific wearing situation of the headphone device during the noise reduction process.

[0038] Optionally, the method further includes:

[0039] Test the first noise reduction effect of the headphone device before adjusting the feedforward noise reduction filter;

[0040] Test the second noise reduction effect of the headphone device after adjusting the feedforward noise reduction filter;

[0041] Determine the optimization result of the headphone device according to the first noise reduction effect and the second noise reduction effect.

[0042] In the above implementation process, by respectively testing the two noise reduction effects before and after adjusting the feedforward noise reduction filter in the headphone device, and comparing the two tested noise reduction effects, the result after the noise reduction optimization of the headphone device can be determined, so as to determine whether the headphone device is optimized or whether it is necessary to continue to optimize the noise reduction effect of the headphone device according to the optimization result.

[0043] In a second aspect, an embodiment of the present application further provides a headphone noise reduction device, and the device includes:

[0044] A first test module, configured to test the first frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to a first feedforward noise reduction filter coefficient;

[0045] A second test module, configured to test the second frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to a second feedforward noise reduction filter coefficient;

[0046] A calculation module, configured to calculate the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data;

[0047] An adjustment module, configured to adjust the feedforward noise reduction filter based on the target frequency response.

[0048] In a third aspect, an embodiment of the present application further provides an electronic device, and the electronic device includes a memory and a processor. When the processor reads and runs the program instructions stored in the memory, the steps in any implementation manner of the above headphone noise reduction method are executed.

[0049] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, and computer program instructions are stored in the readable storage medium. When the computer program instructions are read and run by a processor, the steps in any implementation manner of the above headphone noise reduction method are executed.

[0050] In summary, the present application provides a headphone noise reduction method, apparatus, electronic device, and computer-readable storage medium. During the noise reduction process, different feedforward noise reduction filter coefficients are set and tested according to the specific wearing situation of the headphone device, and the target frequency response of the feedforward noise reduction filter under ideal conditions is determined based on multiple noise reduction frequency response data in different situations, so as to adjust the feedforward noise reduction filter according to the target frequency response, effectively improving the noise reduction effect of the headphone device and being applicable to various different wearing situations. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] To more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required to be used in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the present application and should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.

[0052] Figure 1 A block diagram of an electronic device provided by an embodiment of the present application;

[0053] Figure 2 A flowchart of a headphone noise reduction method provided by an embodiment of the present application;

[0054] Figure 3 A detailed flowchart of step S200 provided by an embodiment of the present application;

[0055] Figure 4 A detailed flowchart of step S300 provided by an embodiment of the present application;

[0056] Figure 5 A detailed flowchart of step S500 provided by an embodiment of the present application;

[0057] Figure 6 A flowchart of another headphone noise reduction method provided by an embodiment of the present application;

[0058] Figure 7 A structural diagram of a headphone noise reduction apparatus provided by an embodiment of the present application.

[0059] Reference numerals: 100 - electronic device; 111 - memory; 112 - storage controller; 113 - processor; 114 - peripheral interface; 115 - communication unit; 116 - display unit; 700 - headphone noise reduction apparatus; 710 - first test module; 720 - second test module; 730 - calculation module; 740 - adjustment module. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0060] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts belong to the scope protected by the embodiments of the present application.

[0061] In current various Bluetooth earphones, such as TWS (True Wireless Stereo) earphones, generally an ANC (Active Noise Control) function is provided. It can collect the external noise signal recorded by the microphone in the earphone device, process it through the filter inside the system, and play it out at the speaker. By reasonably designing the frequency response of the filter, the noise signal heard by the human ear can be made smaller, achieving the noise reduction effect. For example, an external microphone is configured outside the earphone device to collect ambient sound; an internal microphone is configured inside the earphone device to collect residual sound. The feedforward noise reduction module will process the audio data collected by the external microphone, and after being filtered by the feedforward noise reduction filter, it will be played by the speaker, etc. An adaptive ANC function can also be set, which has a corresponding impact on the noise reduction effect according to the wearing of different people and the usage environment. For example, during the user's wearing process, the internal chip of the earphone measures the current environment and adjusts the internal active noise reduction strategy to achieve the optimal noise reduction effect in the current environment, etc.

[0062] With the continuous development and progress of the earphone market, users' requirements for the noise reduction function of earphone devices are getting higher and higher. Generally, during the production process of earphone devices, a set of relatively good active noise reduction parameters have been calibrated according to the acoustic characteristics of the earphones, and better noise reduction performance can be obtained when users use them. For example, since the frequency responses of the speakers and microphones of each earphone device are different, during the production process, calibration is usually carried out according to the acoustic characteristics of different earphone devices to make the earphone devices achieve better noise reduction effects. Moreover, in order to calibrate the differences between the human ear and the ear canal environment used during testing, the feedforward noise reduction filter can be optimized when the earphone device is actually worn on the human ear, so as to calibrate the noise reduction effect of the feedforward noise reduction filter and further improve the noise reduction effect of the earphone device, etc.

[0063] In the calibration methods adopted in the prior art, there are various problems such as large delay, large workload, long search time, and being greatly affected by sudden noises, resulting in poor calibration effect on the filter, and thus the noise reduction effect after calibration of the earphone device is still poor. The active noise reduction parameters calibrated during the production process do not fully conform to the acoustic characteristics when users use them, and cannot meet the wearing requirements of different users in different scenarios.

[0064] To solve the above problems, embodiments of the present application provide a headphone noise reduction method, apparatus, electronic device, and computer-readable storage medium, which are applied to an electronic device. The electronic device may include various models of noise-canceling headphone devices, or electronic devices with logical computing functions such as a server, a personal computer (PC), a tablet computer, a smart phone, and a personal digital assistant (PDA) connected to the headphone device. It can calibrate the feedforward noise reduction filter of the headphone device according to the measured noise reduction frequency response to improve the noise reduction effect of the headphone device.

[0065] Optionally, please refer to Figure 1 , Figure 1 which is a block diagram of an electronic device provided by an embodiment of the present application. The electronic device 100 may include a memory 111, a storage controller 112, a processor 113, a peripheral interface 114, a communication unit 115, and a display unit 116. Those of ordinary skill in the art can understand that Figure 1 the structure shown is only illustrative and does not limit the structure of the electronic device 100. For example, the electronic device 100 may further include more or fewer components than those shown in Figure 1 , or have a different configuration from that shown in Figure 1 .

[0066] The above-mentioned memory 111, storage controller 112, processor 113, peripheral interface 114, communication unit 115, and display unit 116 are electrically connected to each other directly or indirectly to realize data transmission or interaction. For example, these components may be electrically connected to each other through one or more communication buses or signal lines. The above-mentioned processor 113 is used to execute the executable module stored in the memory.

[0067] Among them, the memory 111 can be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electric Erasable Programmable Read-Only Memory (EEPROM), etc. Among them, the memory 111 is used to store programs. After receiving an execution instruction, the processor 113 executes the program. The method executed by the electronic device 100 defined by the process disclosed in any embodiment of the embodiments of the present application can be applied to the processor 113 or implemented by the processor 113.

[0068] The above-mentioned processor 113 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor 113 may be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it may also be a digital signal processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0069] The above-mentioned peripheral interface 114 couples various input / output devices to the processor 113 and the memory 111. In some embodiments, the peripheral interface 114, the processor 113, and the memory controller 112 may be implemented in a single chip. In some other instances, they may be implemented by separate chips respectively.

[0070] The above-mentioned communication unit 115 is used to enable the electronic device to communicate with external devices. The communication unit 115 can be, but is not limited to, various communication chips, etc.

[0071] The above-mentioned display unit 116 provides an interaction interface (such as a user operation interface) between the electronic device 100 and the user or is used to display image data for the user to refer to. In this embodiment, the display unit may be a liquid crystal display or a touch display. If it is a touch display, it may be a capacitive touch screen or a resistive touch screen that supports single-point and multi-point touch operations, etc. Supporting single-point and multi-point touch operations means that the touch display can sense touch operations generated simultaneously at one or more positions on the touch display and hand over the sensed touch operations to the processor for calculation and processing. In the embodiments of the present application, the display unit 116 may display relevant data such as the spectral curve of the frequency response data.

[0072] The electronic device in this embodiment can be used to execute each step in the various headphone noise reduction methods provided by the embodiments of the present application. The implementation process of the headphone noise reduction method will be described in detail through several embodiments below.

[0073] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a headphone noise reduction method provided by the embodiments of the present application. The method may include steps S200 - S500.

[0074] Step S200, when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, test the first frequency response data corresponding to the headphone device.

[0075] Among them, during the process of turning on the noise reduction function of the headphone device for noise reduction, on the premise of maintaining the current stable noise reduction effect, the feedforward noise reduction filter in the headphone device can be first set to the first feedforward noise reduction filter coefficient to test the first frequency response data corresponding to the current headphone device.

[0076] Optionally, in order to improve the accuracy during calibration, the user can be made to wear the headphone device correctly before testing the noise reduction frequency response data to ensure the stable position of the headphone device and prevent it from changing significantly with the adjustment of the human body posture. If the headphone device is an in-ear noise reduction headphone, generally, it is required that the user select a suitable earplug size and ensure a tight fit without air leakage. During the test, in order to improve the accuracy during calibration, the user can be kept quiet to reduce situations such as swallowing, speaking, playing music, and answering calls, and the surrounding ambient sound can be made moderate to facilitate the testing and adjustment of the noise reduction effect.

[0077] Step S300, when the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficient, test the second frequency response data corresponding to the headphone device.

[0078] Among them, after testing the first frequency response data, the feedforward noise reduction filter in the headphone device can also be set to a second feedforward noise reduction filter coefficient different from the first feedforward noise reduction filter coefficient, so as to test the noise reduction frequency responses under different wearing personnel and usage scenarios respectively, and the second frequency response data corresponding to the current headphone device can be tested.

[0079] Optionally, both the first frequency response data and the second frequency response data are difference data reflecting the frequency response differences between multiple audio data during the active noise reduction of the headphone device, and can be in the form of a frequency response curve.

[0080] Step S400, calculate the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data.

[0081] Among them, the target frequency response of the feedforward noise reduction filter in the ideal case can be calculated according to the noise reduction effect and the difference between the noise reduction frequency responses between the first frequency response data and the second frequency response data.

[0082] Optionally, more different feedforward noise reduction filter coefficients can also be set to calculate the target frequency response, such as testing the third frequency response data corresponding to the third feedforward noise reduction filter coefficient, etc., to improve the accuracy of the target frequency response.

[0083] Optionally, when calculating the target frequency response, multiple parameters corresponding to multiple frequency response data in the feedforward noise reduction filter can also be combined for calculation to improve the accuracy of the target frequency response.

[0084] Step S500, adjust the feedforward noise reduction filter based on the target frequency response.

[0085] Among them, according to the calculated target frequency response of the feedforward noise reduction filter in the ideal case, the coefficients in the feedforward noise reduction filter can be updated, so as to optimize the noise reduction effect of the headphone device.

[0086] Optionally, an adaptive feedforward noise reduction filter can also be cascaded after the feedforward noise reduction filter. After calculating the target frequency response of the feedforward noise reduction filter, the coefficients of the adaptive feedforward noise reduction filter can also be updated according to the target frequency response, so that the actual frequency response of the cascaded feedforward noise reduction filter and the adaptive feedforward noise reduction filter approaches the target frequency response, thereby optimizing the active noise reduction effect of the feedforward noise reduction filter.

[0087] In Figure 2 the shown embodiment, the noise reduction effect of the headphone device can be adaptively adjusted and optimized during the noise reduction process, and it is applicable to different wearing situations when used by multiple different users.

[0088] Optionally, please refer to Figure 3 , Figure 3This is a detailed flowchart diagram of step S200 provided by an embodiment of the present application. Step S200 may further include steps S210 - S220.

[0089] Step S210, when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, collect the first headphone data of the headphone device;

[0090] Among them, during the noise reduction process, the feedforward noise reduction filter remains in the on state all the time. When the feedforward noise reduction filter works with different feedforward noise reduction filter coefficients, the corresponding frequency response data is also different. Therefore, when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, the first headphone data in each microphone of the headphone device can be collected in real time.

[0091] Optionally, the headphone device may include an in-ear microphone and an out-ear microphone. The first headphone data may include first audio data and second audio data. The method during collection may include: collecting the first audio data of the in-ear microphone in the headphone device; collecting the second audio data of the out-ear microphone in the headphone device. It can collect the audio data of different microphones in the headphone device respectively to improve the pertinence and effectiveness of the first headphone data.

[0092] Optionally, in common usage scenarios, the out-ear microphone may be a microphone for feedforward noise reduction collection. In some other usage scenarios, the out-ear microphone may also be other microphones, such as a call microphone.

[0093] Step S220, determine the first frequency response data corresponding to the headphone device according to the first headphone data and the first feedforward noise reduction filter coefficient.

[0094] Among them, the first frequency response data corresponding to the headphone device under the first feedforward noise reduction filter coefficient can be determined according to the frequency response difference between the audio data of each microphone in the first headphone data and the first feedforward noise reduction filter coefficient.

[0095] Optionally, the first frequency response data includes the first feedforward noise reduction filter frequency response when the feedforward noise reduction filter performs feedforward active noise reduction and the first noise reduction frequency response when the headphone device performs active noise reduction. The first noise reduction frequency response between the in-ear microphone and the out-ear microphone can be calculated according to the first audio data and the second audio data. Since the feedforward noise reduction filter frequency response of the feedforward noise reduction filter corresponds to the feedforward noise reduction filter coefficient, therefore, the first feedforward noise reduction filter frequency response can also be determined according to the first feedforward noise reduction filter coefficient, or the corresponding first feedforward noise reduction filter frequency response can be preset in the headphone device. When the headphone device works with the first feedforward noise reduction filter coefficient, the corresponding first feedforward noise reduction filter frequency response can be determined.

[0096] Exemplarily, when calculating the first noise reduction frequency response, the first noise reduction frequency response can be calculated by first comparing the frequency domain characteristics between the first audio data and the second audio data collected by the in-ear microphone and the out-of-ear microphone. For example, within the same time period, the data of the two microphones can be windowed and then subjected to FFT (Fast Fourier Transformation) processing to obtain the frequency domain response. Then, the frequency domain responses at multiple frequency points are divided, and the complex domain value is the first noise reduction frequency response corresponding to the frequency point.

[0097] Optionally, in order to obtain a more accurate first noise reduction frequency response, the results of multiple FFTs can be averaged in the complex domain. Time domain averaging can be performed on a single frequency point, or averaging can be performed on multiple nearby frequency points. For example, multiple frequency points can be first averaged in the frequency domain and then in the time domain, or first averaged in the time domain and then in the frequency domain to obtain a more accurate first noise reduction frequency response. Exemplarily, when the external noise energy is low, data for a longer time can be selected for averaging to obtain a stable and accurate first noise reduction frequency response.

[0098] Optionally, during the long-term averaging process, the data after each FFT can be screened to remove points with significantly abnormal indicators such as noise reduction depth, further improving stability.

[0099] Optionally, the frequency point selection can be determined by the frequency band where the feedforward noise reduction takes effect, for example, set between 50 Hz and 3 kHz. Within this range, different feedforward noise reduction filter coefficients have a greater impact on the final noise reduction frequency response. K frequency points can be selected within this range, and the value range of a certain frequency point k is k = 0, 1,..., K - 1. The first noise reduction frequency response at the k-th frequency point in the first frequency response data under the first feedforward noise reduction filter coefficient can be denoted as H1(k), and the feedforward noise reduction filter frequency response of the first can be denoted as F1(k).

[0100] In Figure 3 the embodiment shown, the actual noise reduction frequency response when the headphone device performs noise reduction with the first feedforward noise reduction filter coefficient can be determined, improving the accuracy and real-time performance of the first frequency response data.

[0101] Optionally, please refer to Figure 4 , Figure 4 which is a detailed flowchart of step S300 provided by the embodiment of the present application. Step S300 can further include steps S310 - S330.

[0102] Step S310, determining the corresponding second feedforward noise reduction filter coefficient according to the first feedforward noise reduction filter coefficient.

[0103] Among them, different second feedforward noise reduction filter coefficients that are different from the first feedforward noise reduction filter coefficients can be determined according to the first feedforward noise reduction filter coefficients.

[0104] Optionally, multiple different feedforward noise reduction filter coefficients can be pre-stored in the earphone, or a fixed gain can be added to or subtracted from the first feedforward noise reduction filter coefficients to determine the second feedforward noise reduction filter coefficients.

[0105] Optionally, the second feedforward noise reduction filter coefficients can also be designed to have a certain difference from the first feedforward noise reduction filter coefficients, but both have sufficient noise reduction effects, so that the user will not feel a particularly obvious difference in noise reduction before and after the switch. By reasonably setting the second feedforward noise reduction filter coefficients and the first feedforward noise reduction filter coefficients, the discomfort caused by the change in the noise reduction effect during the update process to the human ear can be reduced during the test, making the test more natural and not having a significant impact on the user's use, effectively improving the user's experience.

[0106] Step S320, when the feedforward noise reduction filter of the earphone device is set to the second feedforward noise reduction filter coefficients, collect the second earphone data of the earphone device.

[0107] Among them, when the feedforward noise reduction filter of the earphone device is set to the second feedforward noise reduction filter coefficients, the second earphone data in each microphone in the earphone device can be collected in real time.

[0108] Optionally, the second earphone data includes third audio data and fourth audio data; the method during collection can include: collecting the third audio data of the in-ear microphone in the earphone device; collecting the fourth audio data of the out-of-ear microphone in the earphone device. The audio data of different microphones in the earphone device can be collected respectively to improve the pertinence and effectiveness of the second earphone data.

[0109] Step S330, determine the second frequency response data corresponding to the earphone device according to the second earphone data and the second feedforward noise reduction filter coefficients.

[0110] Among them, the second frequency response data corresponding to the earphone device under the second feedforward noise reduction filter coefficients can be determined according to the frequency response differences between the audio data of each microphone in the second earphone data and the second feedforward noise reduction filter coefficients.

[0111] Optionally, the second frequency response data includes the second feedforward noise reduction filter frequency response when the feedforward noise reduction filter performs feedforward active noise reduction and the second noise reduction frequency response when the headphone device performs active noise reduction. The second noise reduction frequency response between the in-ear microphone and the out-of-ear microphone can be calculated based on the third audio data and the fourth audio data. Since the feedforward noise reduction filter frequency response of the feedforward noise reduction filter corresponds to the feedforward noise reduction filter coefficients, therefore, the second feedforward noise reduction filter frequency response can also be determined based on the second feedforward noise reduction filter coefficients, or the corresponding second feedforward noise reduction filter frequency response can be preset in the headphone device. When the headphone device operates with the second feedforward noise reduction filter coefficients, the corresponding second feedforward noise reduction filter frequency response can be determined. The second noise reduction frequency response at the k-th frequency point in the second frequency response data under the second feedforward noise reduction filter coefficients can be denoted as H2(k), and the second feedforward noise reduction filter frequency response can be denoted as F2(k).

[0112] Optionally, the calculation method of the second noise reduction frequency response is the same as that of the first noise reduction frequency response, and will not be elaborated here.

[0113] It should be noted that when calculating the target frequency response of the feedforward noise reduction filter based on the first frequency response data and the second frequency response data, the calculation method can be as follows:

[0114] Assume that the ideal feedforward target frequency response at frequency point k is T(k), then the noise reduction effects corresponding to different noise reduction frequency responses are:

[0115]

[0116] Since other conditions are the same, the difference between different noise reduction frequency responses is:

[0117]

[0118] Therefore, the calculated target frequency response is:

[0119]

[0120] Thus, the target frequency response of the feedforward noise reduction filter under ideal conditions is calculated based on the feedforward noise reduction filter frequency response and the noise reduction frequency response in multiple frequency response data.

[0121] In Figure 4 In the shown embodiment, the actual noise reduction frequency response when the headphone device performs noise reduction with the second feedforward noise reduction filter coefficients can be determined, improving the accuracy and real-time performance of the second frequency response data.

[0122] Optionally, please refer to Figure 5 , Figure 5 which is a detailed flowchart of step S500 provided by an embodiment of the present application. The method may include steps S510 - S520.

[0123] Step S510: Adjust the current filter coefficients of the feedforward noise reduction filter according to the target frequency response to obtain adjusted filter coefficients.

[0124] Among them, for the target frequency response of the feedforward noise reduction filter under ideal conditions obtained through calculation, an optimization algorithm can be used to optimize the current filter coefficients of the feedforward noise reduction filter to obtain the corresponding adjusted filter coefficients.

[0125] Optionally, the optimization algorithm can be various algorithms such as gradient descent, grid search, neural network, etc., which can reduce the difference between the actual frequency response and the target frequency response of the feedforward noise reduction filter.

[0126] Step S520: Configure the feedforward noise reduction filter to work with the adjusted filter coefficients.

[0127] Among them, configure the adjusted filter coefficients of the feedforward noise reduction filter to take effect, so that the feedforward noise reduction filter filters with the adjusted filter coefficients, and performs operations such as feedforward active noise reduction with an actual frequency response close to the target frequency response, effectively optimizing the noise reduction effect of the feedforward noise reduction filter.

[0128] Optionally, the feedforward noise reduction filter can be a filter with an IIR structure, which can reduce the delay of the system, or can also be a filter with other structures.

[0129] In Figure 5 the shown embodiment, during the noise reduction process, according to the specific wearing situation of the headphone device, the noise reduction effect in the headphone device can be adaptively iteratively calibrated and adjusted.

[0130] Optionally, please refer to Figure 6 , Figure 6 which is a schematic flowchart of another headphone noise reduction method provided by the embodiment of the present application. This method may further include steps S610 - S630.

[0131] Step S610: Test the first noise reduction effect of the headphone device before adjusting the feedforward noise reduction filter.

[0132] Among them, before adjusting the feedforward noise reduction filter, configure the headphone device to work in the feedforward active noise reduction mode of the unadjusted feedforward noise reduction filter, and test the current corresponding first noise reduction effect.

[0133] Step S620: Test the second noise reduction effect of the headphone device after adjusting the feedforward noise reduction filter.

[0134] Among them, after adjusting the feedforward noise reduction filter, configure the headphone device to work in the feedforward active noise reduction mode of the adjusted feedforward noise reduction filter, and test the current corresponding second noise reduction effect.

[0135] Step S630: Determine the optimization result of the headphone device according to the first noise reduction effect and the second noise reduction effect.

[0136] Specifically, the two tested noise reduction effects can be compared to determine the optimization result of the headphone device. When the second noise reduction effect is better than the first noise reduction effect, the calibrated noise reduction result is improved compared with the noise reduction result before calibration, and the optimization result of the headphone device is successful optimization; when the second noise reduction effect is lower than or equal to the first noise reduction effect, the calibrated noise reduction result is not improved compared with the noise reduction result before calibration, and the optimization result of the headphone device is failed optimization.

[0137] In Figure 6 the illustrated embodiment, the result after the noise reduction optimization of the headphone device can be determined, so as to determine whether the headphone device is optimized or whether it is necessary to continue to optimize the noise reduction effect of the headphone device according to the optimization result.

[0138] Please refer to Figure 7 , Figure 7 which is a schematic structural diagram of a headphone noise reduction device provided by an embodiment of the present application. The headphone noise reduction device 700 may include:

[0139] A first test module 710, configured to test the first frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient;

[0140] A second test module 720, configured to test the second frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficient;

[0141] A calculation module 730, configured to calculate the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data;

[0142] An adjustment module 740, configured to adjust the feedforward noise reduction filter based on the target frequency response.

[0143] In an optional implementation manner, the first test module 710 may further include a first acquisition sub-module and a first determination sub-module;

[0144] The first acquisition sub-module is configured to acquire the first headphone data of the headphone device when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient;

[0145] The first determination sub-module is configured to determine the first frequency response data corresponding to the headphone device according to the first headphone data and the first feedforward noise reduction filter coefficient.

[0146] In an alternative embodiment, the first headphone data includes first audio data and second audio data; the first acquisition sub-module may further include a first acquisition unit and a second acquisition unit;

[0147] The first acquisition unit is configured to acquire first audio data of an in-ear microphone in the headphone device;

[0148] The second acquisition unit is configured to acquire second audio data of an out-ear microphone in the headphone device;

[0149] The first frequency response data includes a first noise reduction frequency response and a first feedforward noise reduction filter frequency response; the first determination sub-module is further configured to calculate, based on the first audio data and the second audio data, a first noise reduction frequency response between the in-ear microphone and the out-ear microphone; and determine the first feedforward noise reduction filter frequency response according to the first feedforward noise reduction filter coefficients.

[0150] In an alternative embodiment, the second test module 720 may further include a coefficient determination sub-module, a second acquisition sub-module, and a second determination sub-module;

[0151] The coefficient determination sub-module is configured to determine corresponding second feedforward noise reduction filter coefficients according to the first feedforward noise reduction filter coefficients;

[0152] The second acquisition sub-module is configured to acquire second headphone data of the headphone device when the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficients;

[0153] The second determination sub-module is configured to determine second frequency response data corresponding to the headphone device according to the second headphone data and the second feedforward noise reduction filter coefficients.

[0154] In an alternative embodiment, the second headphone data includes third audio data and fourth audio data; the second acquisition sub-module may further include a third acquisition unit and a fourth acquisition unit;

[0155] The third acquisition unit is configured to acquire third audio data of an in-ear microphone in the headphone device;

[0156] The fourth acquisition unit is configured to acquire fourth audio data of an out-ear microphone in the headphone device;

[0157] The second frequency response data includes a second noise reduction frequency response and a second feedforward noise reduction filter frequency response; the second determination sub-module is further configured to calculate, based on the third audio data and the fourth audio data, a second noise reduction frequency response between the in-ear microphone and the out-ear microphone; and determine the second feedforward noise reduction filter frequency response according to the second feedforward noise reduction filter coefficients.

[0158] In an alternative embodiment, the adjustment module 740 may further include an adjustment sub-module and a configuration sub-module;

[0159] An adjustment sub-module, configured to adjust the current filter coefficients of the feedforward noise reduction filter according to a target frequency response to obtain adjusted filter coefficients;

[0160] A configuration sub-module, configured to configure the feedforward noise reduction filter to operate with the adjusted filter coefficients.

[0161] In an optional embodiment, the headphone noise reduction device 700 may further include an effect module and a comparison module;

[0162] The effect module is configured to test a first noise reduction effect of the headphone device before the adjustment of the feedforward noise reduction filter; and test a second noise reduction effect of the headphone device after the adjustment of the feedforward noise reduction filter;

[0163] The comparison module is configured to determine an optimization result of the headphone device according to the first noise reduction effect and the second noise reduction effect.

[0164] Since the principle of solving the problem by the headphone noise reduction device 700 in the embodiments of the present application is similar to that of the embodiments of the foregoing headphone noise reduction method, the implementation of the headphone noise reduction device 700 in this embodiment may refer to the description in the embodiments of the foregoing headphone noise reduction method, and repeated parts will not be described again.

[0165] The embodiments of the present application further provide a computer-readable storage medium. Computer program instructions are stored in the computer-readable storage medium. When the computer program instructions are read and run by a processor, the steps in any one of the headphone noise reduction methods provided in this embodiment are executed.

[0166] In summary, the embodiments of the present application provide a headphone noise reduction method, device, electronic device, and computer-readable storage medium. During the noise reduction process, different feedforward noise reduction filter coefficients are set and tested according to the specific wearing conditions of the headphone device, and the target frequency response of the feedforward noise reduction filter under ideal conditions is determined based on multiple noise reduction frequency response data in different situations, so as to adjust the feedforward noise reduction filter according to the target frequency response, effectively improving the noise reduction effect of the headphone device and being applicable to a variety of different wearing conditions.

[0167] In several embodiments provided in the present application, it should be understood that the disclosed device can also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the block diagrams in the accompanying drawings show the possible architectures, functions, and operations of the devices according to multiple embodiments of the present application. In this regard, each block in the block diagram can represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order from that marked in the accompanying drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram, as well as combinations of the block diagrams, can be implemented by a dedicated hardware-based system for performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0168] In addition, each functional module in various embodiments of the present application can be integrated together to form an independent part, or each module can exist separately, or two or more modules can be integrated to form an independent part.

[0169] If the above functions are implemented in the form of software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.

[0170] The above description is only for the embodiments of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application can have various changes and modifications. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.

[0171] As described above, it is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should all be covered within the protection scope of the present application.

[0172] It should be noted that in this text, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, the elements defined by the statement "comprising..." do not exclude the presence of additional identical elements in the process, method, article or device comprising the said elements.

Claims

1. A method for noise reduction of earphones, characterized in that, The method includes: When the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, testing the first frequency response data corresponding to the headphone device; When the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficient, testing the second frequency response data corresponding to the headphone device; Wherein, both the first frequency response data and the second frequency response data are difference data reflecting the frequency response between multiple audio data during active noise reduction of the headphone device; the first frequency response data includes a first noise reduction frequency response and a first feedforward noise reduction filter frequency response, the first noise reduction frequency response is difference data calculated from the frequency domain characteristics of audio data of different microphones collected when the headphone device performs active noise reduction based on the first feedforward noise reduction filter coefficient, and the first feedforward noise reduction filter frequency response is the frequency response data when the feedforward noise reduction filter performs feedforward active noise reduction; the second frequency response data includes a second noise reduction frequency response and a second feedforward noise reduction filter frequency response, the second noise reduction frequency response is difference data calculated from the frequency domain characteristics of audio data of different microphones collected when the headphone device performs active noise reduction based on the second feedforward noise reduction filter coefficient, and the second feedforward noise reduction filter frequency response is the frequency response data when the feedforward noise reduction filter performs feedforward active noise reduction; Calculating the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data; Adjusting the feedforward noise reduction filter based on the target frequency response; Wherein, an adaptive feedforward noise reduction filter is cascaded after the feedforward noise reduction filter, and the method further includes: updating the coefficients of the adaptive feedforward noise reduction filter according to the target frequency response.

2. The method according to claim 1, characterized in that, The step of, when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, testing the first frequency response data corresponding to the headphone device, includes: When the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficient, collecting the first headphone data of the headphone device; Determining the first frequency response data corresponding to the headphone device according to the first headphone data and the first feedforward noise reduction filter coefficient.

3. The method according to claim 2, characterized in that, The first headphone data includes first audio data and second audio data; the step of collecting the first headphone data of the headphone device includes: Collecting the first audio data of the in-ear microphone in the headphone device; Collecting the second audio data of the out-ear microphone in the headphone device; The step of, according to the first headphone data and the first feedforward noise reduction filter coefficient, determining the first frequency response data corresponding to the headphone device, includes: Calculating the first noise reduction frequency response between the in-ear microphone and the out-ear microphone according to the first audio data and the second audio data; Determining the first feedforward noise reduction filter frequency response according to the first feedforward noise reduction filter coefficient.

4. The method according to claim 1, characterized in that, The step of, when the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficient, testing the second frequency response data corresponding to the headphone device, includes: Determine the corresponding second feedforward noise reduction filter coefficients according to the first feedforward noise reduction filter coefficients; When the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficients, collect the second headphone data of the headphone device; Determine the second frequency response data corresponding to the headphone device according to the second headphone data and the second feedforward noise reduction filter coefficients.

5. The method according to claim 4, characterized in that, The second headphone data includes third audio data and fourth audio data; the collecting of the second headphone data of the headphone device includes: Collect the third audio data of the in-ear microphone in the headphone device; Collect the fourth audio data of the out-ear microphone in the headphone device; The determining of the second frequency response data corresponding to the headphone device according to the second headphone data and the second feedforward noise reduction filter coefficients includes: Calculate the second noise reduction frequency response between the in-ear microphone and the out-ear microphone according to the third audio data and the fourth audio data; Determine the feedforward noise reduction filter frequency response according to the second feedforward noise reduction filter coefficients.

6. The method according to claim 1, characterized in that, The adjusting of the feedforward noise reduction filter based on the target frequency response includes: Adjust the current filter coefficients of the feedforward noise reduction filter according to the target frequency response to obtain adjusted filter coefficients; Configure the feedforward noise reduction filter to work with the adjusted filter coefficients.

7. The method according to claim 1, characterized in that, The method further includes: Test the first noise reduction effect of the headphone device before the feedforward noise reduction filter is adjusted; Test the second noise reduction effect of the headphone device after the feedforward noise reduction filter is adjusted; Determine the optimization result of the headphone device according to the first noise reduction effect and the second noise reduction effect.

8. A headphone noise reduction device, characterized in that, The device includes: A first test module, configured to test the first frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to the first feedforward noise reduction filter coefficients; A second test module, configured to test the second frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficients; Wherein, both the first frequency response data and the second frequency response data are difference data reflecting the frequency response differences between multiple audio data during the active noise reduction of the headphone device; the first frequency response data includes a first noise reduction frequency response and a first feedforward noise reduction filter frequency response, the first noise reduction frequency response is difference data calculated from the frequency domain characteristics of audio data of different microphones collected when the headphone device performs active noise reduction based on the first feedforward noise reduction filter coefficients, and the first feedforward noise reduction filter frequency response is the frequency response data when the feedforward noise reduction filter performs feedforward active noise reduction; the second frequency response data includes a second noise reduction frequency response and a second feedforward noise reduction filter frequency response, the second noise reduction frequency response is difference data calculated from the frequency domain characteristics of audio data of different microphones collected when the headphone device performs active noise reduction based on the second feedforward noise reduction filter coefficients, and the second feedforward noise reduction filter frequency response is the frequency response data when the feedforward noise reduction filter performs feedforward active noise reduction; A calculation module, configured to calculate a target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data; An adjustment module, configured to adjust the feedforward noise reduction filter based on the target frequency response; Wherein, an adaptive feedforward noise reduction filter is cascaded after the feedforward noise reduction filter, and the adjustment module is further configured to: update coefficients of the adaptive feedforward noise reduction filter according to the target frequency response.

9. An electronic device, characterized in that, The electronic device includes a memory and a processor. Program instructions are stored in the memory, and when the processor runs the program instructions, the steps in the method according to any one of claims 1-7 are executed.

10. A computer-readable storage medium, characterized in that, Computer program instructions are stored in the readable storage medium, and when the computer program instructions are run by a processor, the steps in the method according to any one of claims 1-7 are executed.

Images