Headphone Noise Reduction Method, Device, Electronic Device and Computer Readable Storage Medium

Abstract

The present application provides a headphone noise reduction method, device, electronic device and computer-readable storage medium, relating to the technical field of headphones. The method includes: determining a target noise reduction depth corresponding to a feedforward noise reduction filter of a headphone device; calculating a target frequency response of the feedforward noise reduction filter according to the target noise reduction depth; and updating an adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response. By testing the noise reduction depth during the noise reduction process of the feedforward noise reduction filter, the present application can calculate the target frequency response of the feedforward noise reduction filter according to the obtained noise reduction depth, so as to quickly and accurately update the adaptive feedforward noise reduction filter according to the target frequency response, calibrate the noise reduction effect of the headphone device during the noise reduction process triggered by the user, effectively improve the noise reduction effect of the headphone device, and is applicable to various different wearing situations.

Description

Technical Field

[0001] The present application relates to the technical field of earphones, and more particularly, to an earphone noise reduction method, device, electronic device, and computer-readable storage medium. Background Art

[0002] In current ANC (Active Noise Control) noise-canceling earphone devices, generally, an external microphone is configured on the outside of the earphone device to collect ambient sound; an internal microphone is configured inside the earphone device to collect residual sound. The feedforward noise reduction module processes the audio data collected by the external microphone, and after filtering by the feedforward noise reduction filter, it is played by the speaker. Therefore, by designing the feedforward noise reduction filter, the original ambient sound residue can be canceled in the ear canal, achieving the purpose of active noise reduction.

[0003] Since the frequency responses of the speakers and microphones of each earphone device are different, during the production process, calibration is usually performed according to the acoustic characteristics of different earphone devices to make the earphone device achieve a better noise reduction effect. Also, in order to calibrate the differences between the human ear and the ear canal environment used during testing, the feedforward noise reduction filter can be optimized when the earphone device is actually worn on the human ear, for example, performing adaptive feedforward ANC noise reduction processing to further improve the noise reduction effect of the earphone device.

[0004] In the prior art, for adaptive feedforward ANC noise reduction processing, usually, a filter is connected in series after the fixed ANC filter obtained from the original production test; or the feedforward noise reduction filter is directly modified to make up for the difference between the actual wearing environment and the preset filter. However, the methods currently adopted have a large delay, a large workload, a long search time, and are greatly affected by sudden noises, resulting in a poor calibration effect on the filter, and thus a poor noise reduction effect after calibration of the earphone device, unable to meet the wearing needs of different users in different scenarios. Summary of the Invention

[0005] In view of this, the purpose of the embodiments of the present application is to provide an earphone noise reduction method, device, electronic device, and computer-readable storage medium to improve the problem of poor noise reduction effect of earphone devices existing in the prior art.

[0006] To solve the above problems, in a first aspect, an embodiment of the present application provides an earphone noise reduction method, the method including:

[0007] Determine the target noise reduction depth corresponding to the feedforward noise reduction filter of the earphone device;

[0008] Calculate the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth;

[0009] Update the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response.

[0010] In the above implementation process, by testing the noise reduction depth of the feedforward noise reduction filter of the headphone device, the target noise reduction depth related to the ear canal characteristics of the wearing user can be obtained, and the target frequency response of the feedforward noise reduction filter under ideal conditions can be calculated based on the target noise reduction depth. Then, the coefficients of the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter are updated according to the target frequency response, so as to optimize the noise reduction effect of the headphone device. It can quickly and accurately adjust and update the adaptive feedforward noise reduction filter of the headphone device, effectively improve the accuracy of calibrating the adaptive feedforward noise reduction filter, thereby improving the noise reduction effect of the headphone device, and is applicable to different wearing situations when used by a variety of different users.

[0011] Optionally, determining the target noise reduction depth corresponding to the feedforward noise reduction filter of the headphone device includes:

[0012] Test the test noise reduction depth when the feedforward noise reduction filter of the headphone device is turned on;

[0013] Determine the target noise reduction depth of the feedforward noise reduction filter according to the test noise reduction depth and the initial noise reduction depth of the headphone device.

[0014] In the above implementation process, when the feedforward noise reduction filter is turned on, the corresponding test noise reduction depth can be tested. To improve the accuracy of the obtained target noise reduction depth, the actual target noise reduction depth can be calculated based on the initial noise reduction depth and the test noise reduction depth when the feedforward noise reduction filter is turned off, so as to reduce the adverse impact of the initial noise reduction depth on the test noise reduction depth, and effectively improve the accuracy and effectiveness of the target noise reduction depth when the feedforward noise reduction filter is turned on.

[0015] Optionally, determining the target noise reduction depth of the feedforward noise reduction filter according to the test noise reduction depth and the initial noise reduction depth of the headphone device includes:

[0016] Determine the initial noise reduction depth when the feedforward noise reduction filter of the headphone device is turned off;

[0017] Calculate the corresponding feedforward noise reduction depth according to the test noise reduction depth and the initial noise reduction depth;

[0018] When there are multiple feedforward noise reduction depths, screen the multiple feedforward noise reduction depths based on the screening rule to obtain the target noise reduction depth.

[0019] In the above implementation process, the feedforward noise reduction filter can be turned off to obtain the corresponding initial noise reduction depth. Then, by combining the initial noise reduction depth when it is turned off with the measured noise reduction depth when it is turned on, the actual feedforward noise reduction depth of the feedforward noise reduction filter can be calculated. Multiple feedforward noise reduction depths can also be screened through a screening rule, so as to screen out an effective target noise reduction depth for subsequent calculations, effectively improving the effectiveness and real-time performance of the target noise reduction depth.

[0020] Optionally, determining the initial noise reduction depth when the feedforward noise reduction filter of the headphone device is turned off includes:

[0021] When the feedforward noise reduction filter of the headphone device is turned off, collect the in-ear microphone data and out-ear microphone data of the headphone device;

[0022] Based on the in-ear microphone data and the out-ear microphone data, calculate the initial noise reduction depth of the headphone device.

[0023] In the above implementation process, the initial noise reduction depth when the feedforward noise reduction filter is turned off can be calculated according to the audio data of the in-ear microphone and out-ear microphone of the headphone device, so as to improve the accuracy and effectiveness of the feedforward noise reduction depth.

[0024] Optionally, testing the measured noise reduction depth when the feedforward noise reduction filter of the headphone device is turned on includes:

[0025] When the feedforward noise reduction filter of the headphone device is turned on, set the filter coefficients of the feedforward noise reduction filter to multiple different feedforward noise reduction filter coefficients;

[0026] For each feedforward noise reduction filter coefficient, test the multiple measured noise reduction depths corresponding to the headphone device when the feedforward noise reduction filter operates at multiple gain parameters under this feedforward noise reduction filter coefficient.

[0027] In the above implementation process, when the user operates the headphone device to turn on the feedforward noise reduction filter in the headphone device, the feedforward noise reduction filter can be set to work with multiple different feedforward noise reduction filter coefficients. Different gain parameters can also be set when the feedforward noise reduction filter works with each feedforward noise reduction filter coefficient, so as to measure multiple measured noise reduction depths with different gains under different filter coefficients, and the noise reduction depths of various different feedforward noise reduction filters can be tested respectively to improve the calculation accuracy and accuracy of the target frequency response.

[0028] Optionally, calculating the target frequency response of the feedforward noise reduction filter based on the target noise reduction depth includes:

[0029] Determine the feedforward frequency response corresponding to the feedforward noise reduction filter according to the feedforward noise reduction filter coefficients;

[0030] Calculate the target frequency response of the feedforward noise reduction filter based on the target noise reduction depth and the feedforward frequency response.

[0031] In the above implementation process, according to the current feedforward noise reduction filter coefficients of the feedforward noise reduction filter, the corresponding feedforward frequency response can be obtained. By calculating the effective target noise reduction depth and the feedforward frequency response, the target frequency response of the feedforward noise reduction filter under ideal conditions can be obtained, effectively improving the accuracy of the target frequency response.

[0032] Optionally, the updating of the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response includes:

[0033] Determine the adaptive frequency response of the adaptive feedforward noise reduction filter based on the target frequency response and the feedforward frequency response, where the adaptive feedforward noise reduction filter is cascaded with the feedforward noise reduction filter;

[0034] Update the adaptive feedforward noise reduction filter according to the adaptive frequency response.

[0035] In the above implementation process, since the feedforward frequency response is the actual frequency response corresponding to the feedforward noise reduction filter with a certain feedforward noise reduction filter coefficient, therefore, the adaptive frequency response of the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter can be calculated according to the actual feedforward frequency response and the target frequency response under ideal conditions. Through an optimization algorithm, relevant parameters in the adaptive feedforward noise reduction filter are updated according to the adaptive frequency response, so that the actual frequency response of the adaptive feedforward noise reduction filter approaches the adaptive frequency response, which can effectively optimize the noise reduction effect of the adaptive feedforward noise reduction filter, and quickly and accurately optimize the noise reduction effect of the headphone device in a short time after the headphone device starts the headphone noise reduction method provided by this application.

[0036] In a second aspect, an embodiment of the present application further provides a headphone noise reduction device, and the device includes:

[0037] A determination module, configured to determine the target noise reduction depth corresponding to the feedforward noise reduction filter of the headphone device;

[0038] A calculation module, configured to calculate the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth;

[0039] An update module, configured to update the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response.

[0040] In a third aspect, an embodiment of the present application further provides an electronic device, which includes a memory and a processor. Program instructions are stored in the memory. When the processor reads and runs the program instructions, the steps in any implementation manner of the above headphone noise reduction method are executed.

[0041] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium. Computer program instructions are stored in the readable storage medium. When the computer program instructions are read and run by a processor, the steps in any implementation manner of the above headphone noise reduction method are executed.

[0042] In summary, the present application provides a headphone noise reduction method, device, electronic device, and computer-readable storage medium. During the triggering process of the headphone device by the wearing user, the noise reduction depth of the feedforward noise reduction filter is tested, and the target frequency response of the feedforward noise reduction filter can be determined according to the noise reduction depth. Then, the cascaded adaptive feedforward noise reduction filter is updated according to the target frequency response, so as to optimize the noise reduction effect of the headphone device. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings required to be used in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.

[0044] Figure 1 It is a block diagram of an electronic device provided by an embodiment of the present application;

[0045] Figure 2 It is a flowchart of a headphone noise reduction method provided by an embodiment of the present application;

[0046] Figure 3 It is a detailed flowchart of step S200 provided by an embodiment of the present application;

[0047] Figure 4 It is a detailed flowchart of step S220 provided by an embodiment of the present application;

[0048] Figure 5 It is a detailed flowchart of step S221 provided by an embodiment of the present application;

[0049] Figure 6 It is a detailed flowchart of step S210 provided by an embodiment of the present application;

[0050] Figure 7It is a detailed flowchart diagram of step S300 provided by an embodiment of the present application;

[0051] Figure 8 It is a detailed flowchart diagram of step S400 provided by an embodiment of the present application;

[0052] Figure 9 It is a structural schematic diagram of a headphone noise reduction device provided by an embodiment of the present application.

[0053] Icons: 100 - electronic device; 111 - memory; 112 - storage controller; 113 - processor; 114 - peripheral interface; 115 - communication unit; 116 - display unit; 500 - headphone noise reduction device; 510 - determination module; 520 - calculation module; 530 - update module. Detailed implementation manners

[0054] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the embodiments of the present application.

[0055] In current various Bluetooth headsets, such as TWS (True Wireless Stereo) headsets, generally an ANC (Active Noise Control) function is provided, which can collect the external noise signal recorded by the microphone in the headset device, process it through the filter inside the system, and play it out at the speaker; by reasonably designing the frequency response of the filter, the noise signal heard by the human ear can be made smaller to achieve the noise reduction effect. For example, an external microphone is configured outside the headset device to collect ambient sound; an internal microphone is configured inside the headset device to collect residual sound. The feedforward noise reduction module will process the audio data collected by the external microphone, filter it through the feedforward noise reduction filter, and then play it by the speaker, etc. An adaptive ANC function can also be set, which has a corresponding impact on the noise reduction effect according to the wearing of different people and the usage environment. For example, during the user's wearing process, the internal chip of the headset adjusts the measurement of the current environment and adjusts the internal noise reduction strategy to achieve the optimal noise reduction strategy in the current environment, etc.

[0056] With the continuous development and progress of the headphone market, users have an increasingly high demand for the noise reduction function of headphone devices. Generally, during the production process of headphone devices, a set of relatively good active noise reduction parameters have been calibrated according to the acoustic characteristics of the headphones, and good noise reduction performance can be obtained when users use them. For example, since the frequency responses of the speakers and microphones of each headphone device are different, during the production process, calibration is usually carried out according to the acoustic characteristics of different headphone devices to make the headphone devices achieve better noise reduction effects. Moreover, in order to calibrate the differences between the human ear and the ear canal environment used during testing, the feedforward noise reduction filter can be optimized when the headphones are actually worn on the human ear, such as performing adaptive feedforward ANC noise reduction processing to further improve the noise reduction effect of the headphone device, etc.

[0057] In the prior art, for adaptive feedforward ANC noise reduction processing, usually a filter is connected in series after the fixed ANC filter obtained from the original production test; or the feedforward noise reduction filter is directly modified to make up for the difference between the actual wearing environment and the preset filter. However, in the current calibration methods adopted, there are various problems such as large delay, large workload, long search time and being greatly affected by sudden noises, resulting in poor calibration effect of the filter, and thus the noise reduction effect of the headphone device after calibration is still poor. The active noise reduction parameters calibrated during the production process cannot fully conform to the acoustic characteristics when users use them, and cannot meet the wearing requirements of different users in different scenarios.

[0058] To solve the above problems, the embodiments of the present application provide a headphone noise reduction method, device, electronic device and computer-readable storage medium, which are applied to an electronic device. The electronic device can include various models of noise reduction headphone devices, or electronic devices with logical computing functions such as a server, a personal computer (PC), a tablet computer, a smart phone, a personal digital assistant (PDA), etc. connected to the headphone device, and can calibrate the adaptive feedforward noise reduction filter of the headphone device according to the measured noise reduction depth to improve the noise reduction effect of the headphone device.

[0059] Optionally, please refer to Figure 1 , Figure 1 which is a block diagram of an electronic device provided by an embodiment of the present application. The electronic device 100 may include a memory 111, a storage controller 112, a processor 113, a peripheral interface 114, a communication unit 115, and a display unit 116. Those of ordinary skill in the art can understand that Figure 1 the structure shown is only schematic and does not limit the structure of the electronic device 100. For example, the electronic device 100 may further include more Figure 1more or fewer components shown, or having a configuration different from that Figure 1 shown.

[0060] Each of the above-mentioned memory 111, storage controller 112, processor 113, peripheral interface 114, communication unit 115 and display unit 116 is electrically connected directly or indirectly to each other to achieve data transmission or interaction. For example, these components can be electrically connected to each other through one or more communication buses or signal lines. The above-mentioned processor 113 is used to execute an executable module stored in the memory.

[0061] Among them, the memory 111 can be, but is not limited to, a random access memory (Random Access Memory, abbreviated as RAM), a read-only memory (Read Only Memory, abbreviated as ROM), a programmable read-only memory (Programmable Read-Only Memory, abbreviated as PROM), an erasable programmable read-only memory (Erasable Programmable Read-Only Memory, abbreviated as EPROM), an electrically erasable programmable read-only memory (Electric Erasable Programmable Read-Only Memory, abbreviated as EEPROM), etc. Among them, the memory 111 is used to store a program. After receiving an execution instruction, the processor 113 executes the program. The method executed by the electronic device 100 defined by the process disclosed in any embodiment of the present application can be applied to the processor 113 or implemented by the processor 113.

[0062] The above-mentioned processor 113 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor 113 can be a general-purpose processor, including a central processing unit (Central Processing Unit, abbreviated as CPU), a network processor (Network Processor, abbreviated as NP), etc.; it can also be a digital signal processor (digital signal processor, abbreviated as DSP), an application specific integrated circuit (Application Specific Integrated Circuit, abbreviated as ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0063] The above-mentioned peripheral interface 114 couples various input / output devices to the processor 113 and the memory 111. In some embodiments, the peripheral interface 114, the processor 113, and the memory controller 112 may be implemented on a single chip. In some other instances, they may be implemented by separate chips respectively.

[0064] The above-mentioned communication unit 115 is used to enable the electronic device to communicate with external devices. The communication unit 115 may be, but is not limited to, various communication chips, etc.

[0065] The above-mentioned display unit 116 provides an interaction interface (such as a user operation interface) between the electronic device 100 and the user or is used to display image data for the user to refer to. In this embodiment, the display unit may be a liquid crystal display or a touch display. If it is a touch display, it may be a capacitive touch screen or a resistive touch screen that supports single-point and multi-point touch operations, etc. Supporting single-point and multi-point touch operations means that the touch display can sense touch operations simultaneously generated at one or more positions on the touch display and hand over the sensed touch operations to the processor for calculation and processing. In the embodiments of the present application, the display unit 116 may display specific data of multiple noise reduction depths tested and spectral curves of frequency responses and other related data.

[0066] The electronic device in this embodiment can be used to execute each step in the various headphone noise reduction methods provided in the embodiments of the present application. The implementation process of the headphone noise reduction method is described in detail through several embodiments below.

[0067] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a headphone noise reduction method provided in the embodiments of the present application. The method may include steps S200 - S400.

[0068] Step S200, determine the target noise reduction depth corresponding to the feedforward noise reduction filter of the headphone device.

[0069] Among them, the noise reduction depth is data reflecting the degree of noise reduction. For example, a noise reduction depth of -20 dB means that the in-ear noise is 0.01 times the energy of the out-ear noise. The noise reduction depth has a great relationship with the wearing tightness of the wearing user and the user's ear canal characteristics. Its size can reflect the noise reduction effect of the headphone device and the user's usage experience. The smaller the noise reduction depth, the better the noise reduction effect. Therefore, in order to calibrate the noise reduction effect of the headphone device, the target noise reduction depth of the feedforward noise reduction filter in the headphone device can be tested and determined.

[0070] Optionally, to improve the accuracy during calibration, the user may be required to correctly wear the headphone device before testing the noise reduction depth, so as to ensure the stable position of the headphone device and prevent it from changing significantly with the adjustment of the body posture. If the headphone device is an in-ear noise reduction headphone, generally the user is required to select a suitable earplug size and ensure a tight fit without air leakage. During the test, to improve the accuracy during calibration, the user may be asked to keep quiet, reduce swallowing, talking, playing music, answering calls, etc., and keep the ambient sound at an appropriate level to facilitate the testing and adjustment of the noise reduction effect.

[0071] Step S300: Calculate the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth.

[0072] Among them, the target frequency response of the feedforward noise reduction filter in the ideal case can be calculated according to the effective target noise reduction depth. The target frequency response is the frequency response of the feedforward noise reduction filter and can be in the form of a frequency response curve.

[0073] Step S400: Update the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response.

[0074] Among them, an adaptive feedforward noise reduction filter can be cascaded after the feedforward noise reduction filter. According to the calculated target frequency response of the feedforward noise reduction filter in the ideal case, the coefficients in the adaptive feedforward noise reduction filter can be updated, so as to optimize the noise reduction effect of the headphone device.

[0075] Optionally, before calibration, the coefficients of the adaptive feedforward noise reduction filter can be set to preset values, such as set to the through state. The coefficient update of the adaptive feedforward noise reduction filter can be triggered automatically or manually. For example, the user can click the start and update operations of the adaptive feedforward noise reduction filter in the adapted mobile phone software; it can also be triggered by the headphone button, voice assistant trigger, etc. to start the update operation of the adaptive feedforward noise reduction filter; or the coefficient update can be triggered automatically after switching the noise reduction mode; or it can be triggered periodically. During the calibration of the adaptive feedforward noise reduction filter, the original adaptive feedforward noise reduction filter can be kept effective or ineffective.

[0076] Optionally, after calculating the target frequency response of the feedforward noise reduction filter, the coefficients of the feedforward noise reduction filter can also be updated according to the target frequency response, so that the actual frequency response of the feedforward noise reduction filter approaches the target frequency response, thereby optimizing the feedforward active noise reduction effect of the feedforward noise reduction filter.

[0077] Optionally, it is also possible to test the first noise reduction effect of the headphone device before the adaptive feedforward noise reduction filter is updated; test the second noise reduction effect of the headphone device after the adaptive feedforward noise reduction filter is updated; and determine the optimization result of the headphone device based on the first and second noise reduction effects.

[0078] Among them, before the adaptive feedforward noise reduction filter is updated, the headphone device can be configured to work in the feedforward active noise reduction mode of the feedforward noise reduction filter and the adaptive feedforward active noise reduction mode of the unupdated adaptive feedforward noise reduction filter, and the current corresponding first noise reduction effect can be tested. After the adaptive feedforward noise reduction filter is updated, the headphone device can be configured to work in the feedforward active noise reduction mode of the feedforward noise reduction filter and the adaptive feedforward active noise reduction mode of the updated adaptive feedforward noise reduction filter, and the current corresponding second noise reduction effect can be tested.

[0079] Optionally, the two tested noise reduction effects can also be compared to determine the optimization result of the headphone device. When the second noise reduction effect is better than the first noise reduction effect, the calibrated noise reduction result has an improvement compared to the noise reduction result before calibration, and the optimization result of the headphone device is successful optimization; when the second noise reduction effect is lower than or equal to the first noise reduction effect, the calibrated noise reduction result has no improvement compared to the noise reduction result before calibration, and the optimization result of the headphone device is failed optimization.

[0080] Optionally, when the optimization result of the headphone device is failed optimization, the headphone noise reduction method provided in this application can be continued to be repeated to calibrate the noise reduction effect of the headphone device until the optimization result of the headphone device is successful optimization. Determine whether the headphone device is optimized or whether it is necessary to continue to optimize the noise reduction effect of the headphone device according to the optimization result.

[0081] In Figure 2 the illustrated embodiment, the adaptive feedforward noise reduction filter of the headphone device can be adjusted and updated quickly and accurately, effectively improving the accuracy of calibrating the adaptive feedforward noise reduction filter, thereby improving the noise reduction effect of the headphone device, and being applicable to different wearing situations when used by a variety of different users.

[0082] Optionally, please refer to Figure 3 , Figure 3 which is a detailed flowchart of step S200 provided by an embodiment of this application, and the method may include steps S210 - S220.

[0083] Step S210, test the test noise reduction depth when the feedforward noise reduction filter of the headphone device is turned on.

[0084] Among them, when the feedforward noise reduction filter is turned on, one or more test noise reduction depths can be obtained by measuring and calculating the audio data of the external microphone and the internal microphone of the headphone device.

[0085] Step S220: Determine the target noise reduction depth of the feedforward noise reduction filter according to the measured noise reduction depth and the initial noise reduction depth of the headphone device.

[0086] Among them, since the measured noise reduction depth obtained by testing is affected by the initial noise reduction depth of the feedforward noise reduction filter, therefore, in order to improve the accuracy of the obtained target noise reduction depth, the initial noise reduction depth when the feedforward noise reduction filter is turned off and the measured noise reduction depth can be calculated to determine the target noise reduction depth.

[0087] In Figure 3 the illustrated embodiment, the adverse effect brought by the initial noise reduction depth in the noise reduction depth of the feedforward noise reduction filter can be effectively reduced, and the accuracy and effectiveness of the target noise reduction depth when the feedforward noise reduction filter is turned on are improved.

[0088] Optionally, please refer to Figure 4 , Figure 4 which is a detailed flowchart of step S220 provided by an embodiment of the present application. Step S220 may further include steps S221 - S223.

[0089] Step S221: Determine the initial noise reduction depth when the feedforward noise reduction filter of the headphone device is turned off.

[0090] Among them, the initial noise reduction depth is the noise reduction depth of other noise reduction functions in the headphone device. The feedforward noise reduction filter of the headphone device can be turned off to determine the initial noise reduction depth of the headphone device in the off state.

[0091] Step S222: Calculate the corresponding feedforward noise reduction depth according to the measured noise reduction depth and the initial noise reduction depth.

[0092] Among them, combining the initial noise reduction depth when turned off and the measured noise reduction depth when turned on, the actual feedforward noise reduction depth of the feedforward noise reduction filter is calculated.

[0093] Exemplarily, the calculation method can be to subtract the initial noise reduction depth H 1 (k) from the measured noise reduction depth H 0 (n,k) at the k-th frequency point during the n-th (n = 0, 1,..., N - 1) measurement corresponding to a certain feedforward noise reduction filter coefficient, so as to use the obtained value as the feedforward noise reduction depth H FF (n,k), that is, H FF (n,k) = H 1 (n,k) - H 0 (k).

[0094] Step S223: When there are multiple feedforward noise reduction depths, screen the multiple feedforward noise reduction depths based on the screening rule to obtain the target noise reduction depth.

[0095] Among them, if the noise reduction depth of the headphone device in different situations is tested, multiple test noise reduction depths can be obtained. Correspondingly, the multiple test noise reduction depths can be calculated respectively with the initial noise reduction depth to determine multiple feedforward noise reduction depths. Considering that during actual testing, there may be situations where the headphones are not worn properly or the measurement environment is inappropriate. In such cases, the effectiveness and accuracy of the feedforward noise reduction depth obtained by testing are relatively low, which will have an adverse impact on subsequent frequency response calculations. Therefore, in order to improve the effectiveness and accuracy of the noise reduction depth, the feedforward noise reduction depths in different situations can be screened according to a preset screening rule, so as to screen out some feedforward noise reduction depths with poor noise reduction effects and retain the effective feedforward noise reduction depths as the target noise reduction depths for subsequent calculations.

[0096] Exemplarily, the preset screening rule can be a rule that limits the magnitude of the noise reduction depth. For example, a noise reduction depth threshold is set, and the feedforward noise reduction depth lower than the threshold is set as a sufficiently deep noise reduction depth that meets the screening rule. Or when the energy of the in-ear microphone reflected by the feedforward noise reduction depth is very small and lower than the background noise, the feedforward noise reduction depth smaller than the background noise is used as the noise reduction depth that does not meet the screening rule.

[0097] In Figure 4 the illustrated embodiment, the effectiveness and real-time performance of the target noise reduction depth can be effectively improved through calculation and screening.

[0098] Optionally, please refer to Figure 5 , Figure 5 which is a detailed flowchart of step S221 provided by an embodiment of the present application. Step S221 may further include steps S2211 - S2212.

[0099] Step S2211, when the feedforward noise reduction filter of the headphone device is turned off, collect the in-ear microphone data and out-ear microphone data of the headphone device.

[0100] Among them, before testing the noise reduction depth of the feedforward noise reduction filter of the headphone device in different situations, the feedforward noise reduction filter can also be turned off, and the audio data of the in-ear microphone and the out-ear microphone in the off state can be collected respectively.

[0101] Optionally, in common usage scenarios, the out-ear microphone can be a microphone for feedforward noise reduction collection. In some other usage scenarios, the out-ear microphone can also be other microphones, such as a call microphone.

[0102] Step S2212, calculate the initial noise reduction depth of the headphone device according to the in-ear microphone data and the out-ear microphone data.

[0103] Among them, when measuring the initial noise reduction depth, the noise reduction depth can be calculated by comparing the frequency domain characteristics of the audio data collected by the in-ear microphone and the out-of-ear microphone. For example, within the same time period, the data of the two microphones can be windowed and then subjected to FFT (Fast Fourier Transformation) processing to obtain the frequency domain response. Then, the frequency domain responses at multiple frequency points are divided, and the amplitude energy is the initial noise reduction depth corresponding to the frequency point. The data is transferred to the dB domain and denoted as H 0 (k).

[0104] Optionally, in order to obtain a more accurate initial noise reduction depth, the results of multiple FFTs can be averaged. The averaging process can be complex averaging or energy averaging; it can also be averaging for a single frequency point or averaging for multiple nearby frequency points. For example, multiple frequency points are first subjected to frequency domain averaging and then time domain averaging, or first time domain averaging and then frequency domain averaging to obtain a more accurate initial noise reduction depth.

[0105] Optionally, during the long-term averaging process, the data after each FFT can be screened to remove points with significantly abnormal indicators such as the noise reduction depth, further improving stability.

[0106] Optionally, the selection of frequency points can be determined by the frequency band where the feedforward noise reduction takes effect, for example, set between 50 Hz and 3 kHz. Within this interval, different feedforward noise reduction filter coefficients have a greater impact on the final noise reduction depth. K frequency points can be selected within this interval, and the value range of a certain frequency point k is k = 0, 1,..., K - 1.

[0107] In Figure 5 the shown embodiment, the initial noise reduction depth when the feedforward noise reduction filter is turned off can be calculated based on the audio data of the in-ear microphone and the out-of-ear microphone of the headphone device, so as to improve the accuracy and effectiveness of the feedforward noise reduction depth.

[0108] Optionally, please refer to Figure 6 , Figure 6 which is a detailed process schematic diagram of step S210 provided by the embodiment of the present application. The method may include steps S211 - S212.

[0109] Step S211, when the feedforward noise reduction filter of the headphone device is turned on, set the filter coefficients of the feedforward noise reduction filter to multiple different feedforward noise reduction filter coefficients.

[0110] Among them, the noise reduction effects corresponding to different users in different wearing scenarios are different. In order to test different noise reduction depths in different situations, multiple sets of different feedforward noise reduction filter coefficients can be preset in the feedforward noise reduction filter. Thus, when the user operates the headphone device to turn on the feedforward noise reduction filter in the headphone device, the feedforward noise reduction filter can work with different feedforward noise reduction filter coefficients to provide different noise reduction effects.

[0111] Optionally, the number and values of the feedforward noise reduction filter coefficients can be set and adjusted according to the actual situation or test requirements, or only one set of feedforward monitoring noise reduction filter coefficients can be set for operation.

[0112] Step S212, for each feedforward noise reduction filter coefficient, test the multiple test noise reduction depths corresponding to the headphone device when the feedforward noise reduction filter works with multiple gain parameters under this feedforward noise reduction filter coefficient.

[0113] Among them, in order to improve the accuracy of testing the noise reduction depth, different situations under the same feedforward noise reduction filter coefficient can be tested multiple times, and the number of tests can be N (≥2). Considering the stability of the data, more measurement times can obtain more accurate results. For example, under the working condition of any feedforward noise reduction filter coefficient, different gain parameters are preset, so as to measure multiple test noise reduction depths with different gains under different filter coefficients. There should be a certain difference in the gain parameters during different measurements. Optionally, different gain parameters can be set to 0dB, 2dB, -2dB, etc., and the number and values of the groups of gain parameters can also be set and adjusted according to the actual situation or test requirements, or the gains in multiple sets of feedforward noise reduction filter coefficients can all be set to 0 gain. It is possible to test the multiple test noise reduction depths of the headphone device under each feedforward noise reduction filter coefficient at different gains respectively. Denote the test noise reduction depth at the kth frequency point during the nth measurement as H 1 (n,k), with the unit of dB.

[0114] In Figure 6 the shown embodiment, it is possible to test the noise reduction depths of the feedforward noise reduction filter in various different situations respectively to provide feedback on the noise reduction effects of the headphone device in different wearing scenarios and environments.

[0115] Optionally, please refer to Figure 7 , Figure 7 which is a detailed flowchart of a step S300 provided by an embodiment of the present application. This method may include steps S310 - S320.

[0116] Step S310, determine the feedforward frequency response corresponding to the feedforward noise reduction filter according to the feedforward noise reduction filter coefficient.

[0117] Among them, the feedforward frequency responses corresponding to the feedforward noise reduction filters with different feedforward noise reduction filter coefficients are also different. Therefore, the actual feedforward frequency response corresponding to the current feedforward noise reduction filter coefficient to be effective can be determined. For example, the feedforward frequency response of the feedforward noise reduction filter at the k-th frequency point during the n-th measurement when it works under the corresponding feedforward noise reduction filter coefficient is denoted as F(n,k).

[0118] Step S320: Calculate the target frequency response of the feedforward noise reduction filter based on the target noise reduction depth and the feedforward frequency response.

[0119] Among them, by calculating the effective target noise reduction depth and the feedforward frequency response, the target frequency response of the feedforward noise reduction filter under ideal conditions can be obtained.

[0120] Optionally, the calculation method can be as follows: Assume that at the frequency point k, the target frequency response of the feedforward noise reduction filter under ideal conditions is T(k). Then, for the k-th frequency point of the n-th measurement, the theoretical value of the target noise reduction depth H FF (n,k) is as follows:

[0121]

[0122] Among them, since T(k) is a complex number, its real part and imaginary part can be regarded as independent variables. Taking the difference between the theoretical value and the measured value as the cost function, it can be the absolute value of the difference or the relative absolute value of the difference, etc. For example, the absolute value of the difference distance can be:

[0123]

[0124] During the calculation, different weights can also be used for weighting at different frequency points. On this basis, according to the optimization algorithm, such as the gradient descent method, etc., the optimal value of T(k) can be calculated as the target frequency response of the feedforward noise reduction filter.

[0125] In the above embodiments, the minimum difference in the dB domain is used as the optimization target. Optionally, the minimum difference in the linear domain can also be used as the optimization target.

[0126] In Figure 7 the embodiments shown, the accuracy of the target frequency response can be effectively improved.

[0127] Optionally, please refer to Figure 8 , Figure 8 which is a detailed flowchart of step S400 provided by an embodiment of the present application. The method may include steps S410 - S420.

[0128] Step S410: Determine the adaptive frequency response of the adaptive feedforward noise reduction filter based on the target frequency response and the feedforward frequency response.

[0129] Among them, the adaptive feedforward noise reduction filter is cascaded with the feedforward noise reduction filter. The adaptive feedforward noise reduction filter can be a filter with an FIR structure or a filter with other structures. According to the relationship between the adaptive feedforward noise reduction filter and the feedforward noise reduction filter, the adaptive frequency response of the adaptive feedforward noise reduction filter that needs to be supplemented in the current scenario or environment can be determined based on the target frequency response and the feedforward frequency response.

[0130] Optionally, after integrating the feedforward frequency response F(n,k) of the feedforward noise reduction filter coefficients at any feedforward noise reduction filter coefficients, it can be denoted as F(k), and the adaptive frequency response of the most suitable adaptive feedforward noise reduction filter

[0131] Step S420, update the adaptive feedforward noise reduction filter according to the adaptive frequency response.

[0132] Among them, according to various optimization algorithms, such as gradient descent, grid search, neural network, etc., the coefficients of the adaptive feedforward noise reduction filter can be updated according to the adaptive frequency response to minimize the difference between the current frequency response of the adaptive feedforward noise reduction filter and the adaptive frequency response, and configure the headphone device to work with the updated adaptive feedforward noise reduction filter, effectively optimizing the noise reduction effect of the adaptive feedforward noise reduction filter.

[0133] In Figure 8 the illustrated embodiment, it is possible to quickly and accurately optimize the noise reduction effect of the adaptive feedforward noise reduction filter of the headphone device in a short time when the user actively triggers the headphone device.

[0134] Please refer to Figure 9 , Figure 9 which is a schematic structural diagram of a headphone noise reduction device provided by an embodiment of the present application. The headphone noise reduction device 500 may include:

[0135] A determination module 510, configured to determine the target noise reduction depth corresponding to the feedforward noise reduction filter of the headphone device;

[0136] A calculation module 520, configured to calculate the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth;

[0137] An update module 530, configured to update the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response.

[0138] In an optional implementation manner, the determination module 510 may further include a test sub-module and a determination sub-module;

[0139] The test sub-module is configured to test the test noise reduction depth when the feedforward noise reduction filter of the headphone device is turned on;

[0140] The first determination sub-module is configured to determine the target noise reduction depth of the feedforward noise reduction filter according to the test noise reduction depth and the initial noise reduction depth of the headphone device.

[0141] In an optional embodiment, the first determination sub-module may further include an initial unit, a calculation unit, and a screening unit;

[0142] The initial unit is configured to determine the initial noise reduction depth when the feedforward noise reduction filter of the headphone device is turned off;

[0143] The calculation unit is configured to calculate the corresponding feedforward noise reduction depth according to the test noise reduction depth and the initial noise reduction depth;

[0144] The screening unit is configured to screen multiple feedforward noise reduction depths based on a screening rule to obtain the target noise reduction depth when there are multiple feedforward noise reduction depths.

[0145] In an optional embodiment, the initial unit is further configured to collect the in-ear microphone data and the out-ear microphone data of the headphone device when the feedforward noise reduction filter of the headphone device is turned off; and calculate the initial noise reduction depth of the headphone device according to the in-ear microphone data and the out-ear microphone data.

[0146] In an optional embodiment, the test sub-module may further include a coefficient unit and a gain unit;

[0147] The coefficient unit is configured to set the filter coefficients of the feedforward noise reduction filter to multiple different feedforward noise reduction filter coefficients when the feedforward noise reduction filter of the headphone device is turned on;

[0148] The gain unit is configured to test multiple test noise reduction depths corresponding to the headphone device when the feedforward noise reduction filter operates at multiple gain parameters for each feedforward noise reduction filter coefficient.

[0149] In an optional embodiment, the calculation module 520 may further include a feedforward sub-module and a target sub-module;

[0150] The feedforward sub-module is configured to determine the feedforward frequency response corresponding to the feedforward noise reduction filter according to the feedforward noise reduction filter coefficient;

[0151] The target sub-module is configured to calculate the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth and the feedforward frequency response.

[0152] In an optional embodiment, the update module 530 may further include a second determination sub-module and an update sub-module;

[0153] A second determination sub-module, configured to determine an adaptive frequency response of an adaptive feedforward noise reduction filter based on a target frequency response and a feedforward frequency response, where the adaptive feedforward noise reduction filter is cascaded with a feedforward noise reduction filter;

[0154] An update sub-module, configured to update the adaptive feedforward noise reduction filter according to the adaptive frequency response.

[0155] Since the principle of solving problems by the headphone noise reduction device 500 in the embodiments of the present application is similar to that of the embodiments of the foregoing headphone noise reduction method, the implementation of the headphone noise reduction device 500 in this embodiment can refer to the description in the embodiments of the above headphone noise reduction method, and repeated parts will not be described again.

[0156] The embodiments of the present application further provide a computer-readable storage medium. Computer program instructions are stored in the computer-readable storage medium. When the computer program instructions are read and run by a processor, the steps in any one of the headphone noise reduction methods provided in this embodiment are executed.

[0157] In summary, the embodiments of the present application provide a headphone noise reduction method, device, electronic device, and computer-readable storage medium. During the triggering process of the headphone device by the wearing user, the noise reduction depth of the feedforward noise reduction filter is tested, and the target frequency response of the feedforward noise reduction filter can be determined according to the noise reduction depth, so as to update the cascaded adaptive feedforward noise reduction filter according to the target frequency response, realizing the optimization of the noise reduction effect of the headphone device.

[0158] In several embodiments provided by the present application, it should be understood that the disclosed device can also be implemented in other ways. The device embodiments described above are only illustrative. For example, the block diagrams in the drawings show the possible architectures, functions, and operations of the devices according to multiple embodiments of the present application. In this regard, each block in the block diagram may represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram, as well as the combination of block diagrams, can be implemented by a dedicated hardware-based system for performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0159] In addition, in each embodiment of the present application, the functional modules can be integrated together to form an independent part, or each module can exist alone, or two or more modules can be integrated to form an independent part.

[0160] If the above-mentioned functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art or a part of this technical solution can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The foregoing storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs.

[0161] The above are only the embodiments of this application and are not used to limit the protection scope of this application. For those skilled in the art, this application can have various changes and modifications. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection scope of this application. It should be noted that similar reference numerals and letters represent similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.

[0162] The above is only the specific implementation manner of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by this application, and all should be covered by the protection scope of this application.

[0163] It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, the elements defined by the statement "including..." do not exclude the existence of additional identical elements in the process, method, article or device including the said elements.

Claims

1. A method for noise reduction of headphones, characterized in that, the method includes: determining a target noise reduction depth corresponding to a feedforward noise reduction filter of a headphone device; calculating a target frequency response of the feedforward noise reduction filter according to the target noise reduction depth; updating an adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response; wherein, calculating the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth includes: determining a feedforward frequency response corresponding to the feedforward noise reduction filter according to the feedforward noise reduction filter coefficients; calculating the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth and the feedforward frequency response; wherein, updating the adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response includes: determining an adaptive frequency response of the adaptive feedforward noise reduction filter based on the target frequency response and the feedforward frequency response, wherein the adaptive feedforward noise reduction filter is cascaded with the feedforward noise reduction filter; updating the adaptive feedforward noise reduction filter according to the adaptive frequency response.

2. The method according to claim 1, characterized in that, determining the target noise reduction depth corresponding to the feedforward noise reduction filter of the headphone device includes: testing a test noise reduction depth when the feedforward noise reduction filter of the headphone device is turned on; determining the target noise reduction depth of the feedforward noise reduction filter according to the test noise reduction depth and an initial noise reduction depth of the headphone device.

3. The method according to claim 2, characterized in that, determining the target noise reduction depth of the feedforward noise reduction filter according to the test noise reduction depth and the initial noise reduction depth of the headphone device includes: determining the initial noise reduction depth when the feedforward noise reduction filter of the headphone device is turned off; calculating a corresponding feedforward noise reduction depth according to the test noise reduction depth and the initial noise reduction depth; when there are multiple feedforward noise reduction depths, screening the multiple feedforward noise reduction depths based on a screening rule to obtain a target noise reduction depth.

4. The method according to claim 3, characterized in that, determining the initial noise reduction depth when the feedforward noise reduction filter of the headphone device is turned off includes: collecting in-ear microphone data and out-ear microphone data of the headphone device when the feedforward noise reduction filter of the headphone device is turned off; calculating the initial noise reduction depth of the headphone device according to the in-ear microphone data and the out-ear microphone data.

5. The method according to claim 2, characterized in that, testing the test noise reduction depth when the feedforward noise reduction filter of the headphone device is turned on includes: when the feedforward noise reduction filter of the headphone device is turned on, setting filter coefficients of the feedforward noise reduction filter to multiple different feedforward noise reduction filter coefficients; for each feedforward noise reduction filter coefficient, testing multiple test noise reduction depths corresponding to the headphone device when the feedforward noise reduction filter operates with multiple gain parameters at the feedforward noise reduction filter coefficient.

6. A headphone noise reduction device, It is characterized in that the device includes: a determination module, configured to determine a target noise reduction depth corresponding to a feedforward noise reduction filter of a headphone device; a calculation module, configured to calculate a target frequency response of the feedforward noise reduction filter according to the target noise reduction depth; an update module, configured to update an adaptive feedforward noise reduction filter cascaded with the feedforward noise reduction filter based on the target frequency response; specifically, the calculation module is configured to: determine a feedforward frequency response corresponding to the feedforward noise reduction filter according to the feedforward noise reduction filter coefficients; calculate the target frequency response of the feedforward noise reduction filter according to the target noise reduction depth and the feedforward frequency response; specifically, the update module is configured to: determine an adaptive frequency response of the adaptive feedforward noise reduction filter based on the target frequency response and the feedforward frequency response, where the adaptive feedforward noise reduction filter is cascaded with the feedforward noise reduction filter; update the adaptive feedforward noise reduction filter according to the adaptive frequency response.

7. An electronic device It is characterized in that the electronic device includes a memory and a processor, and program instructions are stored in the memory. When the processor runs the program instructions, the steps in the method according to any one of claims 1-5 are executed.

8. A computer-readable storage medium It is characterized in that computer program instructions are stored in the readable storage medium. When the computer program instructions are run by a processor, the steps in the method according to any one of claims 1-5 are executed.

Images