Self-adaptive noise reduction method and device, equipment and storage medium
By adaptively updating the feedforward noise reduction filter coefficient of the noise reduction headset, the problem of poor noise reduction effect in the existing technology is solved, achieving more efficient noise reduction effect and better user experience.
Patent Information
- Application Number
- CN202311566619.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-22
- Publication Date
- 2025-05-23
AI Technical Summary
The existing noise-reduction headphones have poor noise reduction effects under different users and environmental conditions, resulting in poor user experience.
Adaptive noise reduction method is adopted to obtain the error signal and the conversion signal output by the feedforward conversion module, and update the filter coefficient of the feedforward noise reduction filter to make it more match the current noise scene, thereby outputting a more effective forward noise signal.
Improves noise reduction effect, improves user experience, and adapts to different users and environmental conditions.
Smart Images
Figure CN120034790A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the technical field of electronic devices, and in particular to an adaptive noise reduction method, apparatus, device and storage medium. Background Art
[0002] With the progress of society and the improvement of people's living standards, headphones have become an indispensable daily necessity for people. Ordinary Bluetooth headphones cancel the connection between the headphones and the wireless host, but there is still a connection between the left and right ears. Moreover, even if people wear Bluetooth headphones, they will be disturbed by the surrounding environmental noise, and the user experience is poor. Therefore, noise-canceling headphones have gradually entered people's lives, allowing people to get a relatively quiet environment in a noisy environment.
[0003] In the related art, the feedforward noise reduction method receives external noise signals before the human ear through a sampling microphone, and then generates a relatively opposite signal through a processing chip to offset the noise signal, thereby achieving the effect of reducing noise.
[0004] However, in actual applications, different users wear noise-cancelling headphones in different environments and in different wearing styles. Accordingly, the accuracy of the sampling microphone in collecting external noise signals is also different, resulting in poor noise reduction effects. Summary of the invention
[0005] The embodiment of the present application provides an adaptive noise reduction method, which effectively improves the noise reduction effect and enhances the user experience.
[0006] In a first aspect, an embodiment of the present application provides an adaptive noise reduction method, which is applied to a noise reduction headset, comprising:
[0007] Acquire an error signal and a conversion signal output by a feedforward conversion module in the noise reduction headset;
[0008] Based on the error signal and the conversion signal, the filter coefficient of the feedforward noise reduction filter in the noise reduction headset is updated with the minimum residual environmental noise at the position where the virtual acquisition module is located as the objective function, so that the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficient and outputs a forward noise signal for noise reduction;
[0009] The position of the virtual acquisition module refers to: the ear canal position between the side of the noise reduction headset close to the ear canal and the eardrum, and the residual environmental noise is associated with multiple virtual parameters of the virtual acquisition module.
[0010] In the embodiment of the present application, an error signal and a conversion signal output by a feedforward conversion module in the noise-cancelling headphones are first obtained, and then based on the error signal and the conversion signal, the filter coefficients of the feedforward noise reduction filter in the noise-cancelling headphones are updated with the minimum residual ambient noise at the location of the virtual acquisition module as the objective function, so that the updated filter coefficients of the feedforward noise reduction filter are more matched with the current noise scene. Therefore, when the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficients, it adaptively outputs a forward noise signal for noise reduction corresponding to the current noise scene, thereby effectively improving the noise reduction effect and enhancing the user experience.
[0011] In an optional implementation manner, the error signal refers to: a feedback sound signal collected by a feedback collection module in the noise reduction headset, or an output signal obtained after low-pass filtering and down-sampling the feedback sound signal.
[0012] In an optional implementation manner, the error signal refers to: an output signal obtained by estimating an audio signal at a location where a virtual acquisition module is located, or an output signal obtained by low-pass filtering and down-sampling an audio signal estimated at a location where the virtual acquisition module is located.
[0013] In an optional implementation manner, the residual environmental noise is obtained in the following manner:
[0014] The residual environmental noise is determined based on the multiple virtual parameters, the feedforward sound signal collected by the feedforward collection module in the noise cancelling earphone, the filter coefficient of the feedforward noise reduction filter and the filter coefficient of the feedback noise reduction filter in the noise cancelling earphone.
[0015] In an optional implementation manner, the plurality of virtual parameters include a target Cp transfer function and a target Cs transfer function, and the target Cp transfer function and the target Cs transfer function are obtained in the following manner:
[0016] Acquire experimental audio data measured when multiple testers wear the noise reduction headphones, each experimental audio data includes: an experimental audio signal collected by the position where the virtual collection module is located, ambient noise collected by the feedback collection module in the noise reduction headphones, and an audio component of the audio signal to be played;
[0017] For each tester, a test Cp transfer function is determined based on the environmental noise and the experimental audio signal; a test Cs transfer function is determined based on the audio component of the audio signal to be played and the experimental audio signal;
[0018] Based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers, a target Cp transfer function and a target Cs transfer function of the noise reducing headphone are determined.
[0019] In an optional implementation manner, determining the target Cp transfer function and the target Cs transfer function of the noise reducing headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes:
[0020] For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function;
[0021] taking a first average value of the first test ratios of the plurality of testers and a product of a second average value of the test Cp transfer functions corresponding to the plurality of testers as a target Cs transfer function of the noise reduction headphone;
[0022] The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0023] In an optional implementation manner, determining the target Cp transfer function and the target Cs transfer function of the noise reducing headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes:
[0024] For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function;
[0025] using a third average value of the test Cs transfer functions corresponding to the multiple testers as a target Cs transfer function of the noise reducing headphone;
[0026] The ratio of the third average value of the test Cs transfer functions corresponding to the multiple testers to the first average value of the first test ratios of the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0027] In an optional implementation manner, determining the target Cp transfer function and the target Cs transfer function of the noise reducing headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes:
[0028] For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function;
[0029] Using a ratio of a second average value of the test Cp transfer functions corresponding to the multiple testers to a first average value of the second test ratios of the multiple testers as a target Cs transfer function of the noise reduction headphone;
[0030] The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0031] In an optional implementation manner, determining the target Cp transfer function and the target Cs transfer function of the noise reducing headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes:
[0032] For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function;
[0033] using a third average value of the test Cs transfer functions corresponding to the multiple testers as a target Cs transfer function of the noise reducing headphone;
[0034] The product of a first average value of the second test ratios of the multiple testers and a third average value of the test Cs transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0035] In an optional implementation manner, the plurality of virtual parameters further include: a Pz transfer function and an Sz transfer function;
[0036] The Pz transfer function refers to: a transfer function between the feedforward sound signal and the feedback sound signal collected by the feedback collection module in the noise reduction headset;
[0037] The Sz transfer function refers to: a transfer function between the playback input signal of the playback module in the noise reduction headset and the feedback sound signal;
[0038] The Pz transfer function and the Sz transfer function are measured and obtained when a user wears the noise reduction headphones.
[0039] In a second aspect, an embodiment of the present application provides an adaptive noise reduction device, which is applied to a noise reduction headset, including:
[0040] An acquisition module, used for acquiring an error signal and a conversion signal output by a feedforward conversion module in the noise reduction earphone;
[0041] A control module, configured to update the filter coefficient of the feedforward noise reduction filter in the noise reduction headset based on the error signal and the conversion signal, taking the minimum residual environmental noise at the position where the virtual acquisition module is located as the objective function, so that the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficient and outputs a forward noise signal for noise reduction;
[0042] The position of the virtual acquisition module refers to: the ear canal position between the side of the noise reduction headset close to the ear canal and the eardrum, and the residual environmental noise is associated with multiple virtual parameters of the virtual acquisition module.
[0043] In an optional implementation manner, the control module is further used to:
[0044] The residual environmental noise is determined based on the multiple virtual parameters, the feedforward sound signal collected by the feedforward collection module in the noise cancelling earphone, the filter coefficient of the feedforward noise reduction filter and the filter coefficient of the feedback noise reduction filter in the noise cancelling earphone.
[0045] In an optional implementation manner, the plurality of virtual parameters include a target Cp transfer function and a target Cs transfer function, and the control module is further configured to:
[0046] Acquire experimental audio data measured when multiple testers wear the noise reduction headphones, each experimental audio data includes: an experimental audio signal collected by the position where the virtual collection module is located, ambient noise collected by the feedback collection module in the noise reduction headphones, and an audio component of the audio signal to be played;
[0047] For each tester, a test Cp transfer function is determined based on the environmental noise and the experimental audio signal; a test Cs transfer function is determined based on the audio component of the audio signal to be played and the experimental audio signal;
[0048] Based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers, a target Cp transfer function and a target Cs transfer function of the noise reducing headphone are determined.
[0049] In an optional implementation manner, the control module is further used to:
[0050] For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function;
[0051] taking a first average value of the first test ratios of the plurality of testers and a product of a second average value of the test Cp transfer functions corresponding to the plurality of testers as a target Cs transfer function of the noise reduction headphone;
[0052] The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0053] In an optional implementation manner, the control module is further used to:
[0054] For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function;
[0055] using a third average value of the test Cs transfer functions corresponding to the multiple testers as a target Cs transfer function of the noise reducing headphone;
[0056] The ratio of the third average value of the test Cs transfer functions corresponding to the multiple testers to the first average value of the first test ratios of the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0057] In an optional implementation manner, the control module is further used to:
[0058] For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function;
[0059] Using a ratio of a second average value of the test Cp transfer functions corresponding to the multiple testers to a first average value of the second test ratios of the multiple testers as a target Cs transfer function of the noise reduction headphone;
[0060] The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0061] In an optional implementation manner, the control module is further used to:
[0062] For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function;
[0063] using a third average value of the test Cs transfer functions corresponding to the multiple testers as a target Cs transfer function of the noise reducing headphone;
[0064] The product of the first average value of the second test ratios of the multiple testers and the third average value of the test Cs transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0065] In a third aspect, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned adaptive noise reduction method when executing the program.
[0066] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program executable by a computer device, and when the program is run on the computer device, the computer device executes the steps of the above-mentioned adaptive noise reduction method. BRIEF DESCRIPTION OF THE DRAWINGS
[0067] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0068] Figure 1 A schematic diagram of a system architecture provided in an embodiment of the present application;
[0069] Figure 2 A schematic diagram of the structure of a noise reduction headset provided in an embodiment of the present application;
[0070] Figure 3 A flowchart of an adaptive noise reduction method provided in an embodiment of the present application;
[0071] Figure 4 A schematic diagram of the structure of an adaptive noise reduction device provided in an embodiment of the present application;
[0072] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0073] In order to make the purpose, technical solution and beneficial effects of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0074] See also Figure 1 , which is a system architecture diagram applicable to an embodiment of the present application. The system architecture at least includes noise-canceling headphones 101 and an audio source device 102. The number of noise-canceling headphones 101 and audio source devices 102 can be one or more, and the present application does not make any specific limitation on this.
[0075] The noise reduction earphone 101 may be an in-ear earphone, a semi-in-ear earphone, or a true wireless stereo (TWS) earphone.
[0076] The audio source device 102 may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart home appliance, an intelligent voice interaction device, etc.
[0077] In actual applications, after the noise reduction headset 101 establishes a wireless connection with the audio source device 102, it receives the audio content sent by the audio source device 102 and plays the audio content in real time. The audio content may be music, audio books, interactive instructions, etc.
[0078] In the related art, the noise cancelling headphones 101 generally adopt a passive noise reduction method to passively reduce noise interference. However, when the surrounding environment becomes noisy, the passive noise reduction method has a poor noise reduction effect on mid- and low-frequency noise. Moreover, for different users, the noise cancelling headphones using the passive noise reduction method are difficult to achieve the ideal noise reduction effect, and the user noise reduction experience is poor.
[0079] In view of this, see Figure 2 , is a schematic diagram of the structure of a noise reduction headset provided in an embodiment of the present application, the noise reduction headset 101 comprises:
[0080] Feedforward noise reduction channel 201, adaptive control module 202, feedback noise reduction channel 203, superposition module 204, and playback module 205. The feedforward noise reduction channel 201 includes: a feedforward acquisition module 206, a feedforward conversion module 207, and a feedforward noise reduction filter 208;
[0081] A feedforward acquisition module 206, for acquiring a feedforward sound signal and transmitting the feedforward sound signal to a feedforward conversion module;
[0082] The adaptive control module 202 is used to update the filter coefficient of the feedforward noise reduction filter 208 based on the error signal and the conversion signal output by the feedforward conversion module 207, taking the minimum residual environmental noise at the location of the virtual acquisition module as the objective function.
[0083] The feedforward noise reduction filter 208 is used to filter the conversion signal based on the updated filter coefficients and output a forward noise signal for noise reduction.
[0084] A feedback noise reduction channel 203, used for outputting a reverse noise signal for noise reduction;
[0085] The superposition module 204 is used to superimpose the forward noise signal, the reverse noise signal and the audio signal to be played and transmit them to the playing module 205 for playing.
[0086] Specifically, the feedforward acquisition module 206 may be one or more microphones, which are usually located near the outer shell of the noise reduction headset to collect audio data outside the ear of the wearer.
[0087] In the embodiment of the present application, the feedforward acquisition module 206 of the noise reduction headset transmits the collected feedforward sound signal to the feedforward conversion module 207. The adaptive control module 202 updates the filter coefficient of the feedforward noise reduction filter 208 based on the error signal and the conversion signal output by the feedforward conversion module 207, taking the minimum residual ambient noise at the position of the virtual acquisition module as the objective function. The feedforward noise reduction filter 208 then filters the conversion signal based on the updated filter coefficient and outputs a forward noise signal for noise reduction, thereby effectively improving the active noise reduction effect and enhancing the user's noise reduction experience.
[0088] See also Figure 3 The embodiment of the present application provides an adaptive noise reduction method, which is applied to any noise reduction headset as described above, and specifically includes the following steps:
[0089] Step 301: Acquire an error signal and a conversion signal output by a feedforward conversion module in the noise reduction earphone.
[0090] Step 302, based on the error signal and the conversion signal, taking the minimum residual ambient noise at the position of the virtual acquisition module as the objective function, updating the filter coefficient of the feedforward noise reduction filter in the noise reduction headset, so that the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficient and outputs a forward noise signal for noise reduction.
[0091] The location of the virtual acquisition module refers to the ear canal position between the side of the noise reduction earphone close to the ear canal and the eardrum, and the residual environmental noise is associated with multiple virtual parameters of the virtual acquisition module.
[0092] In the embodiment of the present application, an error signal and a conversion signal output by a feedforward conversion module in the noise-cancelling headphones are first obtained, and then based on the error signal and the conversion signal, the filter coefficients of the feedforward noise reduction filter in the noise-cancelling headphones are updated with the minimum residual ambient noise at the location of the virtual acquisition module as the objective function, so that the updated filter coefficients of the feedforward noise reduction filter are more matched with the current noise scene. Therefore, when the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficients, it adaptively outputs a forward noise signal for noise reduction corresponding to the current noise scene, thereby effectively improving the noise reduction effect and enhancing the user experience.
[0093] In some embodiments, the error signal refers to: a feedback sound signal collected by a feedback collection module in the noise reduction headset, or an output signal obtained by low-pass filtering and down-sampling the feedback sound signal.
[0094] Specifically, the feedback collection module is arranged in the feedback noise reduction channel 203, which can be one or more microphones, also often called in-ear microphones. The in-ear microphone is usually located on the inside of the active noise reduction headset near the ear canal and is used to collect audio data inside the ear.
[0095] In some embodiments, the error signal is obtained by estimating the audio signal at the location of the virtual acquisition module, or is an output signal obtained by low-pass filtering and down-sampling the audio signal estimated at the location of the virtual acquisition module.
[0096] The location of the virtual acquisition module refers to: the ear canal position between the side of the active noise reduction headset close to the ear canal and the eardrum, especially the position of the ear canal close to the eardrum.
[0097] In some embodiments, the residual environmental noise is also obtained by estimating the audio signal at the location of the virtual acquisition module, or by low-pass filtering and down-sampling the audio signal estimated at the location of the virtual acquisition module to obtain an output signal.
[0098] When estimating the audio signal at the location of the virtual acquisition module to obtain the residual environmental noise, the following process is specifically included:
[0099] Based on multiple virtual parameters of the virtual acquisition module, the feedforward sound signal collected by the feedforward acquisition module 206 in the noise reduction headset, the filter coefficients of the feedforward noise reduction filter 208 and the filter coefficients of the feedback noise reduction filter in the noise reduction headset, the audio signal at the location of the virtual acquisition module is estimated, and the audio signal obtained by the estimation is the residual ambient noise (or error signal).
[0100] In some embodiments, the plurality of virtual parameters include a target Cp transfer function and a target Cs transfer function, and the target Cp transfer function and the target Cs transfer function are obtained in the following manner:
[0101] Acquire experimental audio data measured when multiple testers wear noise reduction headphones, each experimental audio data includes: an experimental audio signal collected by the virtual collection module, ambient noise collected by the feedback collection module in the noise reduction headphones, and an audio component of the audio signal to be played;
[0102] For each tester, a test Cp transfer function is determined based on the environmental noise and the experimental audio signal; a test Cs transfer function is determined based on the audio component of the audio signal to be played and the experimental audio signal;
[0103] Based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers, the target Cp transfer function and the target Cs transfer function of the noise canceling headphone are determined.
[0104] Specifically, the experimental audio signal collected at the location of the virtual acquisition module refers to: a microphone independent of the headset is placed at the location of the virtual acquisition module, and the audio signal is collected by the microphone. In actual applications, since the user does not place a microphone independent of the headset at the location of the virtual acquisition module when using active noise reduction headsets, it is necessary to place a microphone independent of the headset at the location of the virtual acquisition module during the audio experiment stage to collect the experimental audio signal.
[0105] After the user wears the active noise reduction headphones, the audio signal is played outside the headphones (for example, the audio signal is played through one or more speakers), and the ambient sound outside the headphones is transmitted to the feedback acquisition module and the virtual acquisition module respectively. The input is the ambient noise collected by the feedback acquisition module, and the output is the experimental audio signal collected by the virtual acquisition module. The transfer function between the above input and output is Cp.
[0106] After the user wears the active noise reduction headphones, the audio signal to be played played by the speaker in the headphones is transmitted to the feedback acquisition module and the virtual acquisition module respectively. The input is the audio component of the audio signal to be played collected by the feedback acquisition module, and the output is the experimental audio signal collected by the virtual acquisition module. The transfer function between the above input and output is Cs.
[0107] In practical applications, when determining the target Cp transfer function and the target Cs transfer function of the noise reduction headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to multiple testers, the embodiments of the present application provide at least the following implementation methods:
[0108] In the first implementation mode, for each tester, a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function is determined; a first average value of the first test ratios of multiple testers is multiplied by a second average value of the test Cp transfer functions corresponding to the multiple testers as the target Cs transfer function of the noise cancelling headphones; and the second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise cancelling headphones.
[0109] Specifically, for N testers, the test Cp transfer function of the i-th tester is Cp i , the test Cs transfer function of the i-th tester is Cs i When Cp i With Cs i The test ratio is Cs i / Cp i When the test ratio of N testers is calculated, the average Hsp_ave1 of the test ratios of N testers is calculated, and the Cp i Then use Cp_ave1 as the Cp transfer function of the active noise reduction headset, and use Cp_ave1*Hsp_ave1 as the Cs transfer function of the active noise reduction headset.
[0110] In the second implementation mode, for each tester, a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function is determined; a third average value of the test Cs transfer functions corresponding to multiple testers is used as the target Cs transfer function of the noise cancelling headphones; and a ratio of the third average value of the test Cs transfer functions corresponding to multiple testers to a first average value of the first test ratios of multiple testers is used as the target Cp transfer function of the noise cancelling headphones.
[0111] Specifically, for N testers, the test Cp transfer function of the i-th tester is Cp i , the test Cs transfer function of the i-th tester is Cs i When Cp i With Cs i The test ratio is Csi / Cp i When the test ratio of N testers is calculated, the average Hsp_ave1 of the test ratios of N testers is calculated, and the Cs of N testers is calculated. i Then use Cs_ave1 as the Cs transfer function of the active noise reduction headset, and use Cs_ave1 / Hsp_ave1 as the Cp transfer function of the active noise reduction headset.
[0112] Implementation method three, for each tester, determine the second test ratio of the corresponding test Cp transfer function to the test Cs transfer function; use the second average value of the test Cp transfer functions corresponding to multiple testers and the first average value of the second test ratios of multiple testers as the target Cs transfer function of the noise cancelling headphones; use the second average value of the test Cp transfer functions corresponding to multiple testers as the target Cp transfer function of the noise cancelling headphones.
[0113] Specifically, for N testers, the test Cp transfer function of the i-th tester is Cp i , the test Cs transfer function of the i-th tester is Cs i When Cp i With Cs i The test ratio is Cp i / Cs i When the test ratio of N testers is calculated, the average Hsp_ave1 of the test ratios of N testers is calculated, and the Cp i Then use Cp_ave1 as the Cp transfer function of the active noise reduction headset, and use Cp_ave1 / Hsp_ave1 as the Cs transfer function of the active noise reduction headset.
[0114] Embodiment 4: For each tester, determine the second test ratio of the corresponding test Cp transfer function to the test Cs transfer function; use the third average value of the test Cs transfer functions corresponding to multiple testers as the target Cs transfer function of the noise cancelling headphones; use the first average value of the second test ratios of multiple testers multiplied by the third average value of the test Cs transfer functions corresponding to multiple testers as the target Cp transfer function of the noise cancelling headphones.
[0115] Specifically, for N testers, the test Cp transfer function of the i-th tester is Cp i , the test Cs transfer function of the i-th tester is Cs i When Cp i With Cs i The test ratio is Cp i / Cs i When the test ratio of N testers is calculated, the average Hsp_ave1 of the test ratios of N testers is calculated, and the Cs of N testers is calculated.i Then use Cs_ave1 as the Cs transfer function of the active noise reduction headset, and use Cs_ave1*Hsp_ave1 as the Cp transfer function of the active noise reduction headset.
[0116] For different users, or the same user's wearing style differences, such as wearing tightness, wearing direction, the Cs transfer function and Cp transfer function of the same headset may be quite different. The error signal estimated at the location of the virtual acquisition module has a strong correlation with the ratio of Cs and Cp (such as Cs / Cp) or the difference between Cs and Cp (such as Cs-Cp). The more accurate the ratio of Cs to Cp or the difference between Cs and Cp, the more accurate the error signal estimated at the location of the virtual acquisition module. In this way, the better the active noise reduction effect at the location of the virtual acquisition module, the better the active noise reduction effect experienced by the user.
[0117] In the above implementation, for N testers, Cp is obtained i / Cs i or Cp i / Cs i The average value, i.e. Hsp_ave1, is used to obtain the estimated Cp transfer function and Cs transfer function. For different users, a more accurate error signal of the estimated position of the virtual acquisition module can be obtained, thus meeting the noise reduction requirements of different users.
[0118] In one embodiment, the plurality of virtual parameters further include: a Pz transfer function and an Sz transfer function;
[0119] The Pz transfer function refers to the transfer function between the feedforward sound signal and the feedback sound signal collected by the feedback collection module in the noise reduction earphone; the Sz transfer function refers to the transfer function between the playback input signal of the playback module 205 in the noise reduction earphone and the feedback sound signal; the Pz transfer function and the Sz transfer function are measured and obtained when the user wears the noise reduction earphone.
[0120] Specifically, after the user wears the active noise reduction headphones, the input is the feedforward sound signal collected by the feedforward acquisition module 206, and the output is the feedback sound signal collected by the feedback acquisition module. The transfer function between the above input and output (also called transfer function) is Pz.
[0121] After the user wears the active noise reduction headphones, the input is the playback input signal of the playback module 205, and the output is the feedback sound signal collected by the feedback collection module. The transfer function between the above input and output is Sz.
[0122] In practical applications, for the Pz transfer function, when the user wears headphones and the active noise reduction is turned off, Pz is obtained based on the feedforward sound signal collected by the feedforward acquisition module 206 and the feedback sound signal collected by the feedback acquisition module.
[0123] For the Sz transfer function, when the user wears the headphones, the playing module 205 of the active noise reduction headphones plays an audio signal, which may be a music signal, a prompt sound signal, a call voice signal, etc. Based on the playing input signal of the playing module 205 and the feedback sound signal collected by the feedback collection module, Sz is obtained.
[0124] Of course, active noise reduction headphones often do not have the opportunity to play music signals, prompt sound signals, call voice signals and other audio signals. In this case, the Sz transfer function can be measured in the following way:
[0125] When active noise reduction is turned on, the feedforward acquisition module 206 acquires the feedforward sound signal, and the feedback acquisition module acquires the feedback sound signal, and simultaneously obtains the playback input signal of the playback module 205 and the Pz transfer function, and then uses the following formula (3) to calculate the obtained Sz transfer function:
[0126] Sz=(FB_in-FF_in*Pz) / Y…………(3)
[0127] Among them, FB_in represents the feedback sound signal, FF_in represents the feedforward sound signal, and Y represents the playback input signal.
[0128] In some embodiments, the residual environmental noise is determined based on multiple virtual parameters, the feedforward sound signal collected by the feedforward collection module 206 in the noise reduction headset, the filter coefficient of the feedforward noise reduction filter 208, and the filter coefficient of the feedback noise reduction filter in the noise reduction headset, as shown in the following formula (2):
[0129] E1=FF_in*[Pz*Cp+Pz*FB_W*Sz*(Cp-Cs)-FF_W*Sz*Cs] / (1+FB_W
[0130] *Sz)...............(2)
[0131] Among them, E1 represents residual environmental noise, FF_in represents a feedforward sound signal, FB_W represents a filter coefficient of a feedback noise reduction filter, FF_W represents a filter coefficient of the feedforward noise reduction filter 208, and Pz, Sz, Cp and Cs represent virtual parameters.
[0132] Based on the same technical concept, see Figure 4 The embodiment of the present application provides an adaptive noise reduction device, which is applied to a noise reduction headset, including:
[0133] An acquisition module 401 is used to acquire an error signal and a conversion signal output by a feedforward conversion module in the noise reduction earphone;
[0134] A control module 402 is used to update the filter coefficient of the feedforward noise reduction filter 208 in the noise reduction headset based on the error signal and the conversion signal, taking the minimum residual environmental noise at the position of the virtual acquisition module as the objective function, so that the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficient and outputs a forward noise signal for noise reduction;
[0135] The location of the virtual acquisition module refers to the ear canal position between the side of the noise reduction earphone close to the ear canal and the eardrum, and the residual environmental noise is associated with multiple virtual parameters of the virtual acquisition module.
[0136] In an optional implementation manner, the control module 402 is further configured to:
[0137] The residual environmental noise is determined based on multiple virtual parameters, a feedforward sound signal collected by a feedforward collection module in the noise reduction headset, a filter coefficient of a feedforward noise reduction filter, and a filter coefficient of a feedback noise reduction filter in the noise reduction headset.
[0138] In an optional implementation, the plurality of virtual parameters include a target Cp transfer function and a target Cs transfer function, and the control module 402 is further configured to:
[0139] Acquire experimental audio data measured when multiple testers wear noise reduction headphones, each experimental audio data includes: an experimental audio signal collected by the virtual collection module, ambient noise collected by the feedback collection module in the noise reduction headphones, and an audio component of the audio signal to be played;
[0140] For each tester, a test Cp transfer function is determined based on the environmental noise and the experimental audio signal; a test Cs transfer function is determined based on the audio component of the audio signal to be played and the experimental audio signal;
[0141] Based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers, the target Cp transfer function and the target Cs transfer function of the noise canceling headphone are determined.
[0142] In an optional implementation manner, the control module 402 is further configured to:
[0143] For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function;
[0144] The product of a first average value of the first test ratios of the multiple testers and a second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cs transfer function of the noise reduction headphone;
[0145] The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0146] In an optional implementation manner, the control module 402 is further configured to:
[0147] For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function;
[0148] using a third average value of the test Cs transfer functions corresponding to the multiple testers as the target Cs transfer function of the noise reduction headphone;
[0149] The ratio of the third average value of the test Cs transfer functions corresponding to the multiple testers to the first average value of the first test ratios of the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0150] In an optional implementation manner, the control module 402 is further configured to:
[0151] For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function;
[0152] The ratio of the second average value of the test Cp transfer functions corresponding to the multiple testers to the first average value of the second test ratios of the multiple testers is used as the target Cs transfer function of the noise reduction headphone;
[0153] The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0154] In an optional implementation manner, the control module 402 is further configured to:
[0155] For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function;
[0156] using a third average value of the test Cs transfer functions corresponding to the multiple testers as the target Cs transfer function of the noise reduction headphone;
[0157] The product of the first average value of the second test ratios of the multiple testers and the third average value of the test Cs transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
[0158] In the embodiment of the present application, an error signal and a conversion signal output by a feedforward conversion module in the noise cancelling headphones are first obtained, and then based on the error signal and the conversion signal, the filter coefficients of the feedforward noise reduction filter in the noise cancelling headphones are updated with the objective function of minimizing the residual ambient noise at the location of the virtual acquisition module, so that the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficients and outputs a forward noise signal for noise reduction, and the residual ambient noise is associated with multiple virtual parameters of the virtual acquisition module, thereby effectively improving the noise reduction effect and enhancing the user's noise reduction experience.
[0159] Based on the same technical concept, the embodiment of the present application provides a computer device, which can be Figure 1 The noise reduction headphones 101 shown, Figure 5 As shown, it includes at least one processor 501 and a memory 502 connected to the at least one processor. The specific connection medium between the processor 501 and the memory 502 is not limited in the embodiment of the present application. Figure 5 For example, the processor 501 and the memory 502 are connected via a bus. The bus can be divided into an address bus, a data bus, a control bus, etc.
[0160] In the embodiment of the present application, the memory 502 stores instructions that can be executed by at least one processor 501, and the at least one processor 501 can perform the steps of the above-mentioned adaptive noise reduction method by executing the instructions stored in the memory 502.
[0161] Among them, the processor 501 is the control center of the computer device, and various interfaces and lines can be used to connect various parts of the computer device, and adaptive noise reduction can be achieved by running or executing instructions stored in the memory 502 and calling data stored in the memory 502. Optionally, the processor 501 may include one or more processing units, and the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 501. In some embodiments, the processor 501 and the memory 502 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on independent chips.
[0162] The processor 501 may be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.
[0163] The memory 502 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 502 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 502 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer device, but is not limited thereto. The memory 502 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.
[0164] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program executable by a computer device. When the program runs on the computer device, the computer device executes the steps of the above-mentioned adaptive noise reduction method.
[0165] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0166] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer device or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0167] These computer program instructions may also be stored in a computer readable memory capable of directing a computer device or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0168] These computer program instructions can also be loaded onto a computer device or other programmable data processing device so that a series of operation steps are executed on the computer device or other programmable device to produce a process implemented by the computer device, thereby providing instructions for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0169] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0170] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. An adaptive noise reduction method, applied to noise reduction headphones, It is characterized in that include: Acquire an error signal and a conversion signal output by a feedforward conversion module in the noise reduction headset; Based on the error signal and the conversion signal, the filter coefficient of the feedforward noise reduction filter in the noise reduction headset is updated with the minimum residual environmental noise at the position where the virtual acquisition module is located as the objective function, so that the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficient and outputs a forward noise signal for noise reduction; The position of the virtual acquisition module refers to: the ear canal position between the side of the noise reduction headset close to the ear canal and the eardrum, and the residual environmental noise is associated with multiple virtual parameters of the virtual acquisition module.
2. The method according to claim 1, It is characterized in that The error signal refers to: a feedback sound signal collected by a feedback collection module in the noise reduction headset, or an output signal obtained after low-pass filtering and down-sampling the feedback sound signal.
3. The method according to claim 1, It is characterized in that The error signal is obtained by estimating the audio signal at the location of the virtual acquisition module, or is an output signal obtained by low-pass filtering and down-sampling the audio signal estimated at the location of the virtual acquisition module.
4. The method according to claim 1, It is characterized in that The residual environmental noise is obtained in the following manner: The residual environmental noise is determined based on the multiple virtual parameters, the feedforward sound signal collected by the feedforward collection module in the noise cancelling earphone, the filter coefficient of the feedforward noise reduction filter and the filter coefficient of the feedback noise reduction filter in the noise cancelling earphone.
5. The method according to claim 4, It is characterized in that The plurality of virtual parameters include a target Cp transfer function and a target Cs transfer function, and the target Cp transfer function and the target Cs transfer function are obtained in the following manner: Acquire experimental audio data measured when multiple testers wear the noise reduction headphones, each experimental audio data includes: an experimental audio signal collected by the position where the virtual collection module is located, ambient noise collected by the feedback collection module in the noise reduction headphones, and an audio component of the audio signal to be played; For each tester, a test Cp transfer function is determined based on the environmental noise and the experimental audio signal; a test Cs transfer function is determined based on the audio component of the audio signal to be played and the experimental audio signal; Based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers, a target Cp transfer function and a target Cs transfer function of the noise reducing headphone are determined.
6. The method according to claim 5, It is characterized in that The determining the target Cp transfer function and the target Cs transfer function of the noise reduction headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes: For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function; taking a first average value of the first test ratios of the plurality of testers and a product of a second average value of the test Cp transfer functions corresponding to the plurality of testers as a target Cs transfer function of the noise reduction headphone; The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
7. The method according to claim 5, It is characterized in that The determining the target Cp transfer function and the target Cs transfer function of the noise reduction headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes: For each tester, determining a first test ratio of a corresponding test Cs transfer function to a test Cp transfer function; using a third average value of the test Cs transfer functions corresponding to the multiple testers as a target Cs transfer function of the noise reducing headphone; The ratio of the third average value of the test Cs transfer functions corresponding to the multiple testers to the first average value of the first test ratios of the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
8. The method according to claim 5, It is characterized in that The determining the target Cp transfer function and the target Cs transfer function of the noise reduction headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes: For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function; Using a ratio of a second average value of the test Cp transfer functions corresponding to the multiple testers to a first average value of the second test ratios of the multiple testers as a target Cs transfer function of the noise reduction headphone; The second average value of the test Cp transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
9. The method according to claim 5, It is characterized in that The determining the target Cp transfer function and the target Cs transfer function of the noise reduction headphone based on the test Cp transfer functions and the test Cs transfer functions corresponding to the multiple testers includes: For each tester, determining a second test ratio of a corresponding test Cp transfer function to a test Cs transfer function; using a third average value of the test Cs transfer functions corresponding to the multiple testers as a target Cs transfer function of the noise reducing headphone; The product of a first average value of the second test ratios of the multiple testers and a third average value of the test Cs transfer functions corresponding to the multiple testers is used as the target Cp transfer function of the noise reduction headphone.
10. The method according to claim 5, It is characterized in that The plurality of virtual parameters also include: a Pz transfer function and an Sz transfer function; The Pz transfer function refers to: a transfer function between the feedforward sound signal and the feedback sound signal collected by the feedback collection module in the noise reduction headset; The Sz transfer function refers to: a transfer function between the playback input signal of the playback module in the noise reduction headset and the feedback sound signal; The Pz transfer function and the Sz transfer function are measured and obtained when a user wears the noise reduction headphones.
11. An adaptive noise reduction device, applied to noise reduction headphones, It is characterized in that include: An acquisition module, used for acquiring an error signal and a conversion signal output by a feedforward conversion module in the noise reduction earphone; A control module, configured to update the filter coefficient of the feedforward noise reduction filter in the noise reduction headset based on the error signal and the conversion signal, taking the minimum residual environmental noise at the position where the virtual acquisition module is located as the objective function, so that the feedforward noise reduction filter filters the conversion signal based on the updated filter coefficient and outputs a forward noise signal for noise reduction; The position of the virtual acquisition module refers to: the ear canal position between the side of the noise reduction headset close to the ear canal and the eardrum, and the residual environmental noise is associated with multiple virtual parameters of the virtual acquisition module.
12. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the program, the steps of any one of the methods of claims 1 to 10 are implemented.
13. A computer-readable storage medium, It is characterized in that It stores a computer program executable by a computer device. When the program is run on the computer device, the computer device executes the steps of any method described in claims 1 to 10.