Noise reduction control method, device, noise reduction headphones and storage medium

By obtaining the sound wave signals around the earphones and in the ear canal, and adjusting the filter parameters of the noise-reducing earphones to adapt to changes in their wearable state, the problem of poor noise reduction effect caused by the deterioration of the headphones is solved, and a good noise reduction effect and user experience is achieved when wearing loose.

CN114786085BActive Publication Date: 2025-08-12BEIJING XIAOMI MOBILE SOFTWARE CO LTD +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210509398.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-11
Publication Date
2025-08-12
Estimated Expiration
2042-05-11

AI Technical Summary

Technical Problem

After wearing the existing noise-cancelling headphones for a long time, the noise reduction effect is poor due to the decrease in fit between the headphones and the ears, and the filter parameters cannot be adjusted in real time to adapt to the wearing situation.

Method used

By obtaining the environmental time domain signal and the ear canal time domain signal, we judge whether the filter parameter adjustment conditions are met, based on the frequency response function and preset configuration information, we determine the target noise reduction amount and acoustic leakage compensation gear, and adjust the filter parameters of the noise reduction filter to perform acoustic leakage compensation.

Benefits of technology

Adjust filter parameters in time when wearing the headset loosely to improve noise reduction and improve user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114786085B_ABST
    Figure CN114786085B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a noise reduction control method, device, noise reduction headphones and storage medium. The noise reduction control method includes: obtaining an ambient time domain signal, obtaining an ear canal time domain signal, and if the ambient time domain signal and the ear canal time domain signal meet the preset filter parameter adjustment conditions, then determining the target noise reduction amount based on the ambient time domain signal and the ear canal time domain signal and the preset frequency response function; determining the sound leakage compensation gear corresponding to the target noise reduction amount as the target sound leakage compensation gear based on the preset noise reduction configuration information and the target noise reduction amount; determining the target filter parameters based on the target sound leakage compensation gear; and adjusting the filter parameters in the preset noise reduction filter to the target filter parameters. Using the method in the present disclosure, when the headphones are worn loosely, the filter parameters in the preset noise reduction filter can be adjusted in time to compensate for sound leakage, so as to ensure a good noise reduction effect and enhance the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of signal processing, and in particular to a noise reduction control method, device, noise reduction headphones, and storage medium. Background Art

[0002] Active noise cancellation (ANC), also known as active noise control (ANC), is a technology that actively generates a signal with equal energy and opposite phase to the noise source, causing the acoustic signal to interfere with the noise source signal and cancel the sound waves. ANC is widely used in multimedia applications with audio playback capabilities, such as headphones, ship cabins, car cockpits, in-car speaker systems, and smart homes.

[0003] Currently, after users wear headphones for a long time, a gap is created between the headphones and the ear canal, and the fit between the headphones and the ears decreases, resulting in poor noise reduction effect. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides a noise reduction control method, device, noise reduction headphones and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a noise reduction control method is provided, which is applied to headphones. The method includes:

[0006] Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0007] Acquiring an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0008] If the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition, determining a target noise reduction amount based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function;

[0009] Determining, based on preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation level corresponding to the target noise reduction amount as the target acoustic leakage compensation level, wherein the noise reduction configuration information is used to characterize a correspondence between a noise reduction amount threshold and an acoustic leakage compensation level, and the noise reduction configuration information includes a plurality of noise reduction amount thresholds and an acoustic leakage compensation level corresponding to each of the noise reduction amount thresholds;

[0010] determining target filter parameters based on the target acoustic leakage compensation level;

[0011] The filter parameters in a preset noise reduction filter are adjusted to the target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal.

[0012] In an exemplary embodiment, the method further includes: determining whether the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition by using the following method:

[0013] Determine the total energy of the ambient time domain signal based on the ambient time domain signal, wherein the ambient time domain signal includes multiple frequency points, and the total energy of the ambient time domain signal refers to the sum of the energies of each frequency point in the ambient time domain signal;

[0014] Determining a total energy of the ear canal time domain signal based on the ear canal time domain signal, wherein the ear canal time domain signal includes multiple frequency points, and the total energy of the ear canal time domain signal refers to the sum of the energies of the various frequency points in the ear canal time domain signal;

[0015] If the ratio of the total energy of the ambient time domain signal to the total energy of the ear canal time domain signal is greater than or equal to a preset energy threshold, it is determined that the preset filter parameter adjustment condition is met.

[0016] In an exemplary embodiment, determining a target noise reduction amount based on the ambient time domain signal, the ear canal time domain signal, and a preset frequency response function includes:

[0017] Performing Fourier transform on the ambient time domain signal and the ear canal time domain signal respectively to obtain an ambient frequency domain signal and an ear canal frequency domain signal, wherein the ambient frequency domain signal refers to a sound wave signal in the environment surrounding the earphone represented by a frequency domain representation, and the ear canal frequency domain signal refers to a sound wave signal in the ear canal represented by a frequency domain representation;

[0018] Obtaining a crossover frequency response based on the ambient frequency domain signal, the ear canal frequency domain signal, and a preset frequency response function, where the crossover frequency response is related to a frequency point;

[0019] obtaining a reference noise reduction amount according to the crossover frequency response;

[0020] According to the reference noise reduction amount, an average noise reduction amount of the target frequency band is obtained, and the average noise reduction amount is determined as the target noise reduction amount, wherein the average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band.

[0021] In an exemplary embodiment, determining, based on the preset noise reduction configuration information and the target noise reduction amount, the sound leakage compensation level corresponding to the target noise reduction amount as the target sound leakage compensation level includes:

[0022] Obtaining a preset noise reduction threshold set, wherein the preset noise reduction threshold set includes a plurality of noise parameter values arranged from small to large, wherein the plurality of noise parameter values constitute a plurality of noise reduction thresholds, and the noise reduction thresholds correspond to the acoustic leakage compensation gears;

[0023] Determining, according to the target noise reduction amount and the preset noise reduction threshold set, a noise reduction amount threshold to which the target noise reduction amount belongs;

[0024] According to the noise reduction amount threshold to which the target noise reduction amount belongs, an acoustic leakage compensation gear corresponding to the noise reduction amount threshold to which the target noise reduction amount belongs is determined as a target acoustic leakage compensation gear.

[0025] In an exemplary embodiment, determining target filter parameters based on the target acoustic leakage compensation level, and adjusting filter parameters in a preset noise reduction filter to the target filter parameters, includes:

[0026] Obtain chip configuration information, where the chip configuration information is used to indicate whether filter coefficients stored in the chip support updating;

[0027] If the filter coefficients stored in the chip support updating, determining a target filter coefficient based on the target acoustic leakage compensation level, and adjusting the filter coefficients in the preset noise reduction filter to the target filter coefficients;

[0028] If the filter system stored in the chip does not support updating, a target filter gain is determined based on the target acoustic leakage compensation gear, and the filter gain in the preset noise reduction filter is adjusted to the target filter gain.

[0029] In an exemplary embodiment, the filter parameters of the preset noise reduction filter include:

[0030] filter parameters in a feedforward filter; or,

[0031] Filter parameters in the feedforward filter and filter parameters in the feedback filter.

[0032] According to a second aspect of an embodiment of the present disclosure, a noise reduction control device is provided, which is applied to headphones. The noise reduction control device includes:

[0033] A first acquisition module is configured to acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0034] A second acquisition module is configured to acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0035] a first determination module configured to determine a target noise reduction amount based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function if the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition;

[0036] a second determining module configured to determine, based on preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation gear corresponding to the target noise reduction amount as the target acoustic leakage compensation gear, wherein the noise reduction configuration information is used to characterize a correspondence between a noise reduction amount threshold and an acoustic leakage compensation gear, and the noise reduction configuration information includes a plurality of noise reduction amount thresholds and an acoustic leakage compensation gear corresponding to each of the noise reduction amount thresholds;

[0037] A third determining module is configured to determine a target filter parameter based on the target acoustic leakage compensation gear;

[0038] The adjustment module is configured to adjust the filter parameters in a preset noise reduction filter to the target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal.

[0039] In an exemplary embodiment, the first determining module is further configured to:

[0040] Determine the total energy of the ambient time domain signal based on the ambient time domain signal, wherein the ambient time domain signal includes multiple frequency points, and the total energy of the ambient time domain signal refers to the sum of the energies of each frequency point in the ambient time domain signal;

[0041] Determining a total energy of the ear canal time domain signal based on the ear canal time domain signal, wherein the ear canal time domain signal includes multiple frequency points, and the total energy of the ear canal time domain signal refers to the sum of the energies of the various frequency points in the ear canal time domain signal;

[0042] If the ratio of the total energy of the ambient time domain signal to the total energy of the ear canal time domain signal is greater than or equal to a preset energy threshold, it is determined that the preset filter parameter adjustment condition is met.

[0043] In an exemplary embodiment, the first determining module is further configured to:

[0044] Performing Fourier transform on the ambient time domain signal and the ear canal time domain signal respectively to obtain an ambient frequency domain signal and an ear canal frequency domain signal, wherein the ambient frequency domain signal refers to a sound wave signal in the environment surrounding the earphone represented by a frequency domain representation, and the ear canal frequency domain signal refers to a sound wave signal in the ear canal represented by a frequency domain representation;

[0045] Obtaining a crossover frequency response based on the ambient frequency domain signal, the ear canal frequency domain signal, and a preset frequency response function, where the crossover frequency response is related to a frequency point;

[0046] obtaining a reference noise reduction amount according to the crossover frequency response;

[0047] According to the reference noise reduction amount, an average noise reduction amount of the target frequency band is obtained, and the average noise reduction amount is determined as the target noise reduction amount, wherein the average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band.

[0048] In an exemplary embodiment, the second determining module is further configured to:

[0049] Obtaining a preset noise reduction threshold set, wherein the preset noise reduction threshold set includes a plurality of noise parameter values arranged from small to large, wherein the plurality of noise parameter values constitute a plurality of noise reduction thresholds, and the noise reduction thresholds correspond to the acoustic leakage compensation gears;

[0050] Determining, according to the target noise reduction amount and the preset noise reduction threshold set, a noise reduction amount threshold to which the target noise reduction amount belongs;

[0051] According to the noise reduction amount threshold to which the target noise reduction amount belongs, an acoustic leakage compensation gear corresponding to the noise reduction amount threshold to which the target noise reduction amount belongs is determined as a target acoustic leakage compensation gear.

[0052] In an exemplary embodiment, the third noise reduction threshold determination module is further configured to:

[0053] Obtain chip configuration information, where the chip configuration information is used to indicate whether filter coefficients stored in the chip support updating;

[0054] If the filter coefficients stored in the chip support updating, determining a target filter coefficient based on the target acoustic leakage compensation level, and adjusting the filter coefficients in the preset noise reduction filter to the target filter coefficients;

[0055] If the filter system stored in the chip does not support updating, a target filter gain is determined based on the target acoustic leakage compensation gear, and the filter gain in the preset noise reduction filter is adjusted to the target filter gain.

[0056] In an exemplary embodiment, the filter parameters of the preset noise reduction filter include:

[0057] filter parameters in a feedforward filter; or,

[0058] Filter parameters in the feedforward filter and filter parameters in the feedback filter.

[0059] According to a third aspect of an embodiment of the present disclosure, a noise-canceling headset is provided, comprising a housing and a feedforward microphone, a feedback microphone, a speaker, and a controller arranged on the housing:

[0060] The feedforward microphone is used to collect sound wave signals in the environment surrounding the earphone;

[0061] The feedback microphone is used to collect sound wave signals in the ear canal;

[0062] The speaker is used to play sound wave signals;

[0063] The controller is communicatively connected to the feedforward microphone, the feedback microphone and the speaker respectively, and the controller includes a processor and a memory, the memory stores computer program instructions that can be executed by the processor, and the processor is configured to call the computer program instructions to execute the method as described in any one of the first aspects of the embodiments of the present disclosure.

[0064] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which computer program instructions are stored, characterized in that when the computer program instructions are called by a processor, a method as described in any one of the first aspects of the embodiment of the present disclosure is executed.

[0065] The above-mentioned method disclosed in the present invention has the following beneficial effects: using the noise reduction control method disclosed in the present invention, when the earphones are worn loose, the filter parameters in the preset noise reduction filter can be adjusted in time to compensate for sound leakage, so as to ensure a good noise reduction effect and improve the user experience.

[0066] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0068] Figure 1 is a schematic diagram showing a noise-canceling headset according to an exemplary embodiment;

[0069] Figure 2 is a flow chart showing a noise reduction control method according to an exemplary embodiment;

[0070] Figure 3 is a flow chart showing a noise reduction control method according to an exemplary embodiment;

[0071] Figure 4is a flow chart showing a noise reduction control method according to an exemplary embodiment;

[0072] Figure 5 is a flow chart showing a noise reduction control method according to an exemplary embodiment;

[0073] Figure 6 is a flow chart showing a noise reduction control method according to an exemplary embodiment;

[0074] Figure 7 is a flow chart showing a noise reduction control method according to an exemplary embodiment;

[0075] Figure 8 is a block diagram of a noise reduction control device according to an exemplary embodiment;

[0076] Figure 9 is a block diagram of a noise-canceling headset according to an exemplary embodiment. DETAILED DESCRIPTION

[0077] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. In the following description, when referring to the drawings, like numbers in different figures represent like or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present invention, as detailed in the appended claims.

[0078] The "active noise reduction" of headphones corresponds to "passive noise reduction": passive noise reduction means that the headphones use the outer shell to physically block the ambient noise transmitted to the human ear. All headphones have passive noise reduction function; active noise reduction means that on the basis of passive noise reduction, the headphones actively generate sound waves with opposite phase and same or similar energy as the noise, and offset part of the ambient noise through the interference of sound waves.

[0079] With the development of active noise reduction technology, noise-canceling headphones have become increasingly popular, and their frequency and duration of use have increased significantly. However, after wearing headphones for tens of minutes or even hours, they gradually become loose and the fit between the headphones and the ears decreases. In other words, the fit of the headphones will gradually decrease with the user's daily activities. The noise reduction effect is closely related to the wearing state. When the wearing state changes, the noise reduction effect drops sharply.

[0080] In the existing technology, due to comprehensive considerations of chip cost and system stability, noise-canceling headphones all use fixed filter configurations, that is, the active noise reduction filter cannot adjust parameters in real time to adapt to the wearing situation in real time. As the wearing becomes loose, obvious sound leakage will occur, and users often find it difficult to repeatedly put the headphones on in practice. Therefore, the increased wearing time leads to a decrease in the noise reduction effect.

[0081] Figure 1 is a schematic diagram of a noise reduction headset according to an exemplary embodiment. Figure 1 As shown, the acoustic components mainly include: a feed-forward (FF) microphone 1, a feedback (FB) microphone 2, and a speaker 3. The feed-forward microphone 1 is placed outside the earphone to collect external environmental noise in real time; the feedback microphone 2 is placed near the speaker inside the earphone to detect residual noise near the ear canal in real time. The feed-forward microphone 1, the speaker 3, and the feed-forward active noise reduction chip 4 constitute the feed-forward active noise reduction path 5; the feedback microphone 2, the speaker 3, and the feedback active noise reduction chip 6 constitute the feedback active noise reduction path 7. The feed-forward active noise reduction chip 4 and the feedback active noise reduction chip 6 are composed of a feed-forward filter and a feedback filter implemented in hardware. The filter coefficients in the filter are erasable parameters and need to be burned in before use.

[0082] In an exemplary embodiment of the present disclosure, a noise reduction control method is provided, which is applied to headphones, including various headphone structures such as in-ear headphones, semi-in-ear headphones, and headsets. Figure 2 is a flow chart showing a noise reduction control method according to an exemplary embodiment. Figure 2 As shown, the noise reduction control method includes the following steps:

[0083] Step S201: Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0084] Step S202, obtaining an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0085] Step S203: If the ambient time domain signal and the ear canal time domain signal meet the preset filter parameter adjustment conditions, a target noise reduction amount is determined based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function;

[0086] Step S204: Determine, based on preset noise reduction configuration information and a target noise reduction amount, an acoustic leakage compensation level corresponding to the target noise reduction amount as the target acoustic leakage compensation level, wherein the noise reduction configuration information is used to characterize a correspondence between a noise reduction amount threshold and an acoustic leakage compensation level, and the noise reduction configuration information includes multiple noise reduction amount thresholds and an acoustic leakage compensation level corresponding to each noise reduction amount threshold;

[0087] Step S205, determining target filter parameters based on the target acoustic leakage compensation level;

[0088] Step S206 : adjusting the filter parameters of the preset noise reduction filter to target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal.

[0089] In step S201 and step S202, the environmental time domain signal is collected by the feedforward microphone. The environmental time domain signal refers to the sound wave signal in the environment around the earphone represented by the time domain representation; the ear canal time domain signal is collected by the feedback microphone. The ear canal time domain signal refers to the sound wave signal in the ear canal represented by the time domain representation. The collection time of the time domain signal can be set according to actual needs. In order to ensure the accuracy and timeliness of the signal, the collection time is generally between 1 and 3 seconds, for example, 2 seconds. The sampling rate of the time domain signal can also be set according to actual needs. In order to conveniently collect the signal, the general signal sampling rate is at least 16kHz.

[0090] In step S203, when the earphones are in-ear earphones, since the noise reduction effect is related to the fit of the earphones, when the earphones are in a completely fitted wearing state, the active noise reduction effect is the best, and at this time, there is no need to adjust the filter parameters; when the earphones are worn loosely, for example, when the user wears the earphones for a long time, resulting in a low fit between the earphones and the ears, the noise reduction effect will deteriorate, and at this time, the filter parameters need to be adjusted to improve the problem of poor noise reduction caused by poor fit. The adjustment conditions of the filter parameters are pre-stored in the earphones, and whether the adjustment conditions of the filter parameters are met is determined based on the ambient time domain signal and the ear canal time domain signal. When it is determined that the filter parameter adjustment conditions are met, the target noise reduction amount is determined based on the acquired ambient time domain signal and the ear canal time domain signal and the preset frequency response function. The target noise reduction amount is the noise reduction amount of the earphones in the current wearing state, and can be obtained by any formula that can calculate the noise reduction amount.

[0091] In step S204, preset noise reduction configuration information is used to characterize the correspondence between noise reduction thresholds and acoustic leakage compensation levels. This information is pre-stored in the headphone memory. Based on the noise reduction threshold range to which the target noise reduction falls, the corresponding acoustic leakage compensation level, i.e., the target acoustic leakage compensation level, is determined. Different acoustic leakage compensation levels can be set based on different headphone structures. For example, there are a total of 0 to X levels for acoustic leakage compensation, each corresponding to a different degree of headphone fit. From 0 to X, the headphone fit becomes increasingly loose, i.e., the fit between the headphone and the ear becomes increasingly poor. The initial level is 0, which is the level at which the headphone fits best, and the X level is the level at which the fit is least. Each acoustic leakage compensation level corresponds to a noise reduction threshold. For example, level 0 corresponds to a noise reduction threshold of ε0. If the target noise reduction is greater than ε0, the corresponding acoustic leakage compensation level is 0. The noise reduction configuration information includes multiple noise reduction thresholds and an acoustic leakage compensation level corresponding to each noise reduction threshold. Since different headphones have different noise reduction effects, the correspondence between the noise reduction threshold and the sound leakage compensation level can be set according to different headphones, so that the noise reduction amount can be increased through different sound leakage compensation under different wearing looseness, thereby improving the noise reduction effect.

[0092] In step S205 and step S206, different sound leakage compensation gears correspond to different filter parameters, and the target filter parameters are determined based on the sound leakage compensation gear corresponding to the target noise reduction amount, that is, the target sound leakage gear. The filter parameters in the preset noise reduction filter are adjusted to the target filter parameters. The noise reduction filter is the main hardware structure of the noise reduction chip in the headphone structure. The filter in the headphone includes a feedforward filter and a feedback filter, which are used to perform noise reduction filtering on the input sound wave signal. The adjusted target filter parameters can increase the noise reduction amount and enhance the noise reduction effect by means of sound leakage compensation. It should be noted here that, based on the principle of active noise reduction, the increase in noise reduction involved in this step refers to changing the gain of the output active noise signal used to offset the external noise signal, or changing the filtering characteristics of the device used to filter the active noise signal.

[0093] When adjusting filter parameters, you can adjust only the feedforward filter's parameters or both. Because excessive feedback noise reduction can cause abnormalities such as howling and device cavity resonance, whether to adjust the feedback filter's parameters should be determined based on the headphone structure, such as the acoustic cavity structure and component performance. Adjusting both the feedforward and feedback filter parameters simultaneously results in a more pronounced noise reduction effect, resulting in a better noise reduction effect.

[0094] In an exemplary embodiment of the present disclosure, an ambient time domain signal and an ear canal time domain signal are acquired. When the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition, a target noise reduction amount is determined based on the ambient time domain signal and the ear canal time domain signal. According to the correspondence between the noise reduction amount threshold and the sound leakage compensation gear and the target noise reduction amount, the sound leakage compensation gear corresponding to the target noise reduction amount is determined as the target sound leakage compensation gear. Based on the target sound leakage compensation gear, the target filter parameters are determined. The filter parameters in the preset noise reduction filter are adjusted to the target filter parameters. When the earphones are worn loosely, the filter parameters in the preset noise reduction filter can be adjusted in time to compensate for sound leakage, so as to ensure a good noise reduction effect and enhance the user experience.

[0095] In an exemplary embodiment of the present disclosure, a noise reduction control method is provided, which is applied to headphones, including various headphone structures such as in-ear headphones, semi-in-ear headphones, and headsets. Figure 3 is a flow chart showing a noise reduction control method according to an exemplary embodiment. Figure 3 As shown, the noise reduction control method includes the following steps:

[0096] Step S301: Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0097] Step S302: Acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0098] Step S303: determining the total energy of the ambient time domain signal based on the ambient time domain signal, wherein the ambient time domain signal includes multiple frequency points, and the total energy of the ambient time domain signal refers to the sum of the energies of the various frequency points in the ambient time domain signal;

[0099] Step S304: determining the total energy of the ear canal time domain signal based on the ear canal time domain signal, wherein the ear canal time domain signal includes multiple frequency points, and the total energy of the ear canal time domain signal refers to the sum of the energies of the various frequency points in the ear canal time domain signal;

[0100] Step S305: If the ratio of the total energy of the ambient time domain signal to the total energy of the ear canal time domain signal is greater than or equal to a preset energy threshold, it is determined that the preset filter parameter adjustment condition is met;

[0101] Step S306 , if the ambient time domain signal and the ear canal time domain signal meet the preset filter parameter adjustment conditions, then determining a target noise reduction amount based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function;

[0102] Step S307: Determine, based on preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation level corresponding to the target noise reduction amount as the target acoustic leakage compensation level, wherein the noise reduction configuration information is used to characterize the correspondence between the noise reduction amount threshold and the acoustic leakage compensation level, and the noise reduction configuration information includes multiple noise reduction amount thresholds and an acoustic leakage compensation level corresponding to each noise reduction amount threshold;

[0103] Step S308, determining target filter parameters based on the target acoustic leakage compensation level;

[0104] Step S309 : adjusting the filter parameters in the preset noise reduction filter to target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal.

[0105] Steps S306 to S309 are identical to steps S203 to S206 , and steps S301 to S302 are identical to steps S201 to S202 , and are not described in detail here.

[0106] In step S303 and step S304, the total energy of the ambient time domain signal and the total energy of the ear canal time domain signal are determined respectively. It should be noted that the order of step S303 and step S304 is not limited.

[0107] After obtaining the ambient time domain signal and the ear canal time domain signal, the ambient time domain signal and the ear canal time domain signal can be divided into multiple frame signals and the ear canal time domain signal can be divided into multiple frame signals by performing frame segmentation and windowing processing on the ambient time domain signal and the ear canal time domain signal. In subsequent related calculations, frame-by-frame calculations are performed on each frame.

[0108] For example, the time domain signal (which can be an ambient time domain signal or an ear canal time domain signal) has a total of M frames, that is, after frame division and windowing, it is divided into M windows. Each frame of the signal has a total of N sampling points, that is, when sampling the time domain signal, each frame contains N time domain sampling points. The ambient time domain signal of the feedforward microphone is recorded as s FF (m,n), the ear canal time domain signal of the feedback microphone is recorded as s FB (m,n). Among them, m is the frame index, that is, the mth frame signal in M frames in a time domain signal, m∈[0,M) and represents an integer; n is the sampling point index in a single frame signal, that is, the nth sampling point of the mth frame signal, n∈[0,N) and Represents an integer. M and N vary depending on factors such as the signal sampling rate and the application platform. To prevent blocking artifacts and facilitate frequency domain calculations, frames have some overlapping sampling points. That is, the tail data of the previous frame is the same as the head data of the next frame. The overlap ratio is denoted by δ, where δ∈(0%,100%). δ also varies depending on other platform factors such as the signal sampling rate. Specifically, when performing frame and window processing on the ambient time domain signal and the ear canal time domain signal, specifically overlapping windowing, adjacent windows overlap with an overlap ratio of 1 / 2.

[0109] In one example, when the signal sampling rate is 16 kHz, let M = 60, N = 512, and δ = 50%. That is, in this example, after performing frame windowing on a sound signal with a sampling rate of 16 kHz, the sound signal is divided into 60 frames in the time domain, each frame containing 512 time domain sampling points, and the overlap rate of sampling points between adjacent frames is 50%.

[0110] Since the calculation is performed frame by frame, each frame of the ambient time domain signal includes multiple frequency points, that is, multiple sampling points. The total energy of each frame of the ambient time domain signal is the sum of the energies of each frequency point in the ambient time domain signal, that is, the sum of the energies of each sampling point; each frame of the ear canal time domain signal includes multiple frequency points, that is, multiple sampling points. The total energy of each frame of the ear canal time domain signal is the sum of the energies of each frequency point in the ear canal time domain signal, that is, the sum of the energies of each sampling point. After calculating the total energy of each frame, the sum of the energies of all frames is added together to obtain the total energy of the ambient time domain signal and the total energy of the ear canal time domain signal. The total energy of the ambient time domain signal is denoted as E FF , the total energy of the ear canal time domain signal, denoted as E FB ,but:

[0111]

[0112]

[0113] Among them, s FB (m,n)—ear canal time domain signal;

[0114] s FF (m,n)—environmental time domain signal;

[0115] M—the number of frame signals obtained after the time domain signal is framed and windowed;

[0116] N—the number of time domain sampling points contained in each frame signal;

[0117] m—the mth frame in M frames;

[0118] n—The nth sampling point among N time domain sampling points.

[0119] In step S305, according to the total energy E of the environmental time domain signal FF The total energy E of the ear canal time domain signal FB , we can get the energy ratio, which is denoted as θ, then:

[0120]

[0121] The preset energy threshold is the threshold of the ratio of the total energy of the ambient time domain signal to the total energy of the ear canal time domain signal. The preset energy threshold is used to determine whether the preset filter parameter adjustment condition is met. The total energy of the ambient time domain signal and the total energy of the ear canal time domain signal can reflect the current usage status of the earphones. The usage status includes touching the earphones, strenuous exercise, playing the sound source at too high a volume, etc. When the earphones are in the above usage status, the filter parameters will also be unstable due to unstable wearing, and no adjustment is required at this time. The correlation between the total energy of the ear canal time domain signal and the usage status is greater than the correlation between the total energy of the ambient time domain signal and the usage status. When the usage status is unstable, the increase in the total energy of the ear canal time domain signal will be greater than the increase in the total energy of the ambient time domain signal, and the energy ratio will become smaller. Therefore, when the energy ratio is greater than or equal to the preset energy threshold, it is determined that the preset filter parameter adjustment condition is met; when the energy ratio is less than the preset energy threshold, the usage status is unstable, and it is determined that the preset filter parameter adjustment condition is not met.

[0122] For example, the preset energy threshold is denoted as θ0. When θ ≥ θ0, the preset filter parameter adjustment condition is satisfied; when θ < θ0, the preset filter parameter adjustment condition is not satisfied. In one example, the preset energy threshold θ0 = 1 / 3. The value of the preset energy threshold can be adjusted based on actual conditions and the different headphone devices used in the method of this embodiment. Furthermore, the preset energy threshold can be determined through multiple tests before the headphones leave the factory, or it can be determined based on empirical values and stored in the headphones.

[0123] In an exemplary embodiment of the present disclosure, when it is determined that the preset filter parameter adjustment conditions are met through the energy ratio of the total energy of the ambient time domain signal and the total energy of the ear canal time domain signal and the preset energy threshold, the filter parameters are adjusted. This can ensure that the usage status of the headphones is stable at this time, and avoid frequent adjustments of filter parameters due to unstable usage status, which will bring poor listening experience to users.

[0124] In an exemplary embodiment of the present disclosure, a noise reduction control method is provided, which is applied to headphones, including various headphone structures such as in-ear headphones, semi-in-ear headphones, and headsets. Figure 4 is a flow chart showing a noise reduction control method according to an exemplary embodiment. Figure 4 As shown, the noise reduction control method includes the following steps:

[0125] Step S401: Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0126] Step S402: Acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0127] Step S403: If the ambient time domain signal and the ear canal time domain signal meet the preset filter parameter adjustment conditions, Fourier transform is performed on the ambient time domain signal and the ear canal time domain signal respectively to obtain an ambient frequency domain signal and an ear canal frequency domain signal, wherein the ambient frequency domain signal refers to the sound wave signal in the environment around the headphone represented by the frequency domain, and the ear canal frequency domain signal refers to the sound wave signal in the ear canal represented by the frequency domain;

[0128] Step S404: obtaining a crossover frequency response based on the ambient frequency domain signal, the ear canal frequency domain signal, and a preset frequency response function, where the crossover frequency response is related to the frequency point;

[0129] Step S405, obtaining a reference noise reduction amount according to the crossover frequency response;

[0130] Step S406: obtaining an average noise reduction amount of the target frequency band according to the reference noise reduction amount, and determining the average noise reduction amount as the target noise reduction amount, wherein the average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band;

[0131] Step S407: Determine, based on preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation level corresponding to the target noise reduction amount as the target acoustic leakage compensation level, wherein the noise reduction configuration information is used to characterize the correspondence between the noise reduction amount threshold and the acoustic leakage compensation level, and the noise reduction configuration information includes multiple noise reduction amount thresholds and an acoustic leakage compensation level corresponding to each noise reduction amount threshold;

[0132] Step S408, determining target filter parameters based on the target acoustic leakage compensation level;

[0133] Step S409 : adjusting the filter parameters of the preset noise reduction filter to target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal.

[0134] Steps S401 to S402 are identical to steps S201 to S202 , and steps S407 to S409 are identical to steps S204 to S206 , which will not be described in detail here.

[0135] In step S403, when the ambient time domain signal and the ear canal time domain signal meet the preset filter parameter adjustment conditions, the ambient time domain signal and the ear canal time domain signal are respectively subjected to Fourier transform. For the convenience of calculation, the fast Fourier transform, that is, the discrete Fourier transform, can be used to obtain the ambient frequency domain signal and the ear canal frequency domain signal. The ambient frequency domain signal refers to the sound wave signal in the environment surrounding the earphone represented by the frequency domain representation, and the ear canal frequency domain signal refers to the sound wave signal in the ear canal represented by the frequency domain representation. Before performing the fast Fourier transform, in order to reduce the leakage error, the window function is superimposed on the ambient time domain signal and the ear canal time domain signal respectively. The window function can be selected according to actual needs, for example, using the Blackman-Harris window.

[0136] The ambient time domain signal is denoted as s FF (m,n), the ear canal time domain signal is recorded as s FB (m,n), the window function is recorded as w(n), and the ambient frequency domain signal is recorded as S FF (m,k), the ear canal frequency domain signal is recorded as S FB (m,k), then:

[0137]

[0138]

[0139] in, is the discrete Fourier transform operation, k is the scale of the Fourier transform, that is, after the Fourier transform, a spectrum of k frequency points will be generated. The value of k can be set according to actual needs. For example, when each frame of the time domain signal includes N signal sampling points, k = N. S FF (m,k) and S FB (m,k) represents the frequency domain signal of the kth frequency point in the mth frame. Of course, it is understandable that the scale k of the Fourier transform can be adjusted according to needs. When the value of k is larger, the number of frequency points in the spectrum after the Fourier transform is greater, and the analysis of the sound signal in the frequency domain is more accurate.

[0140] In step S404, a crossover frequency response is obtained based on the ambient frequency domain signal, the ear canal frequency domain signal, and a preset frequency response function. The crossover frequency response is related to the frequency point.

[0141] The three crossover frequency responses at the kth frequency point are denoted as H0(k), H1(k) and H2(k), respectively. Then:

[0142]

[0143]

[0144]

[0145] in, It means to find the real part of a complex number. Indicates the imaginary part of a complex number;

[0146] s FB (m,n)—ear canal time domain signal; S FF (m,k)—environmental frequency domain signal; S FB (m,k)—ear canal frequency domain signal;

[0147] M—the number of frame signals obtained after the time domain signal is framed and windowed;

[0148] m—the mth frame in M frames;

[0149] k—the kth frequency point in the mth frame;

[0150] n—The nth sampling point among N time domain sampling points.

[0151] In step S405, a reference noise reduction amount is obtained according to the cross-frequency response. The reference noise reduction amount at the k-th frequency point is recorded as H(k). Then:

[0152]

[0153] The unit of H(k) is dB.

[0154] In step S406, the average noise reduction amount of the target frequency band is obtained based on the reference noise reduction amount, and the average noise reduction amount is determined as the target noise reduction amount. The average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band. The target frequency band is the frequency band with the maximum noise reduction depth of the audio device, for example, between 50 and 300 Hz. The target noise reduction amount in this frequency band is denoted as ε, then:

[0155]

[0156] Where ε is expressed in dB, and k0 and k1 are the frequencies closest to 50 Hz and 300 Hz in the spectrum of k frequency points. Fine-tuning can be performed based on actual needs. The target noise reduction is the average of the noise reduction amounts for all frequency points in the target frequency band. For example, if the spectrum obtained after Fourier transform includes spectral lines at 50 Hz and 300 Hz, k0 is 50 Hz and k1 is 100 Hz. For another example, if the spectrum obtained after Fourier transform does not include spectral lines at 50 Hz and 300 Hz, but includes spectral lines at 49 Hz, 49 Hz, 52 Hz, 280 Hz, 298 Hz, and 306 Hz, k0 is 49 Hz and k1 is 298 Hz. Since different transformation scales are used when performing discrete Fourier transform on time domain signals to convert them into frequency domain signals, the total number of frequency points in the spectrum will be different, and the physical frequency corresponding to each frequency point will also be different. In actual implementation, k0, k1 and the noise reduction evaluation frequency band (that is, the target frequency band) can be fine-tuned according to the headphones.

[0157] In an exemplary embodiment of the present disclosure, a noise reduction control method is provided, which is applied to headphones, including various headphone structures such as in-ear headphones, semi-in-ear headphones, and headsets. Figure 5 is a flow chart showing a noise reduction control method according to an exemplary embodiment. Figure 5 As shown, the noise reduction control method includes the following steps:

[0158] Step S501: Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0159] Step S502: Acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0160] Step S503: If the ambient time domain signal and the ear canal time domain signal meet the preset filter parameter adjustment conditions, a target noise reduction amount is determined based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function;

[0161] Step S504: obtaining a preset noise reduction threshold set, where the preset noise reduction threshold set includes a plurality of noise parameter values arranged from small to large, and the plurality of noise parameter values constitute a plurality of noise reduction thresholds, where the noise reduction thresholds correspond to the acoustic leakage compensation gears;

[0162] Step S505: determining the noise reduction threshold to which the target noise reduction amount belongs according to the target noise reduction amount and a preset noise reduction threshold set;

[0163] Step S506: According to the noise reduction threshold to which the target noise reduction amount belongs, determining the acoustic leakage compensation gear corresponding to the noise reduction threshold to which the target noise reduction amount belongs as the target acoustic leakage compensation gear;

[0164] Step S507, determining target filter parameters based on the target acoustic leakage compensation level;

[0165] Step S508 : adjusting the filter parameters of the preset noise reduction filter to target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal.

[0166] The contents of steps S501 to S503 are the same as those of steps S201 to S203, and the contents of steps S507 to S508 are the same as those of steps S205 to S206, which will not be repeated here.

[0167] In step S504, multiple noise reduction threshold sets are obtained based on the noise reduction effect of the headphones. Different headphone devices have different noise reduction threshold sets. The multiple noise reduction threshold sets are preset in the headphones. The preset noise reduction threshold sets include multiple noise parameter values arranged from small to large. The multiple noise parameter values constitute multiple noise reduction thresholds. The noise reduction thresholds correspond to the sound leakage compensation levels.

[0168] For example, the denoising threshold set is denoted as {ε -X+1 ,…,ε -2 ,ε -1 ,ε0,ε1,ε2,…,ε X}, X represents the number of acoustic leakage compensation gears, ε1,ε2,…,ε X Indicates that the corresponding gear needs to be lowered, ε -X+1 ,…,ε -2 ,ε -1 Indicates the need to increase the level. The level and number of levels are determined by the wearing condition of the headphones and can be set according to actual needs. Levels 0 to X correspond to wearing conditions from tight to loose. This noise reduction threshold set is pre-stored in the headphones and is derived from an established acoustic model. During implementation, the noise reduction threshold set can be adjusted based on different headphone application scenarios.

[0169] In step S505 and step S506, the noise reduction threshold to which the target noise reduction belongs is determined according to the target noise reduction amount and the preset noise reduction threshold set, and the sound leakage compensation gear corresponding to the target noise reduction amount is obtained according to the noise reduction threshold to which the target noise reduction amount belongs.

[0170] For example, the target noise reduction amount is recorded as ε. When ε<ε0, it means that the wearing state is loose, the noise reduction amount is low, and the gear needs to be increased; when ε -1≤ε<ε0, then upgrade one gear; when ε -2 ≤ε<ε -1 When ε<ε, it will be increased by two gears; and so on. -X+1 , then increase the gear to X. If the sum of the gear number to be increased and the current gear number is greater than the maximum gear number X, then directly increase it to gear X. For example, the maximum gear number is 8, the current gear number is 4, and the gear number to be increased is 5, which exceeds the maximum gear number 8, and it is also directly increased to the maximum gear number 8. When ε>ε1, it means that the noise reduction is too high. In order to reduce ear pressure and maintain auditory comfort, it is necessary to lower the gear; when ε1≤ε<ε2, then reduce it by one gear; when ε2≤ε<ε3, then reduce it by two gears; and so on, when ε>ε X If the difference between the current gear and the gear to be reduced is less than zero, it will be directly reduced to gear 0.

[0171] In an exemplary embodiment of the present disclosure, a noise reduction control method is provided, which is applied to headphones, including various headphone structures such as in-ear headphones, semi-in-ear headphones, and headsets. Figure 6 is a flow chart showing a noise reduction control method according to an exemplary embodiment. Figure 6 As shown, the noise reduction control method includes the following steps:

[0172] Step S601: Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0173] Step S602: Acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0174] Step S603: If the ambient time domain signal and the ear canal time domain signal meet the preset filter parameter adjustment conditions, a target noise reduction amount is determined based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function;

[0175] Step S604: Determine, based on preset noise reduction configuration information and a target noise reduction amount, an acoustic leakage compensation level corresponding to the target noise reduction amount as the target acoustic leakage compensation level, wherein the noise reduction configuration information is used to characterize a correspondence between a noise reduction amount threshold and an acoustic leakage compensation level, and the noise reduction configuration information includes multiple noise reduction amount thresholds and an acoustic leakage compensation level corresponding to each noise reduction amount threshold;

[0176] Step S605: Obtain chip configuration information, where the chip configuration information is used to indicate whether the filter coefficients stored in the chip support updating.

[0177] If the filter coefficients stored in the chip support updating, step S606 is executed; if the filter coefficients stored in the chip do not support updating, step S607 is executed.

[0178] Step S606: determining a target filter coefficient based on the target acoustic leakage compensation level, and adjusting the filter coefficient in the preset noise reduction filter to the target filter coefficient;

[0179] Step S607: Determine the target filter gain based on the target sound leakage compensation level, and adjust the filter gain in the preset noise reduction filter to the target filter gain. Steps S601 to S604 are identical to steps S201 to S204 and are not described again.

[0180] In step S605, after determining the acoustic leakage compensation level, chip configuration information is obtained. The chip configuration information indicates whether the filter coefficients stored in the chip can be updated. Different headphones use different active noise reduction chips, and each chip has different support for filter coefficient updates. By obtaining the chip configuration information, it is determined whether the chip used in the headphones supports filter coefficient updates.

[0181] In steps S606 and S607, if the chip supports filter coefficient updates, the target filter coefficients are determined based on the target acoustic leakage compensation level, and the filter coefficients in the preset noise reduction filter are adjusted to the target filter coefficients. If the filter system stored in the chip does not support updates, the target filter gain is determined based on the target acoustic leakage compensation level, and the filter gain in the preset noise reduction filter is adjusted to the target filter gain. Since updating the filter coefficients also changes the filter gain and the filter phase, whether the chip supports updating the filter coefficients determines whether to update the filter coefficients or the filter gain.

[0182] When adjusting the filter parameters, only the filter parameters in the feedforward filter may be updated; or the filter parameters in the feedforward filter and the filter parameters in the feedback filter may be updated simultaneously.

[0183] When the chip supports updating the filter coefficients and only updates the filter parameters in the feedforward filter, it is recorded as When the chip supports updating the filter coefficients and simultaneously updates the filter parameters in the feedforward filter and the filter parameters in the feedback filter, it is recorded as When the chip does not support updating the filter coefficients and only updates the filter parameters in the feedforward filter, it is recorded as When the chip does not support updating the filter coefficients, and updates the filter parameters in the feedforward filter and the filter parameters in the feedback filter at the same time, it is recorded as Where c represents the filter coefficient, g represents the filter gain, x represents the current gear, and X represents the maximum gear.

[0184] In an exemplary embodiment of the present disclosure, a noise reduction control method is provided, which is applied to headphones, including various headphone structures such as in-ear headphones, semi-in-ear headphones, and headsets. Figure 7 is a flow chart showing a noise reduction control method according to an exemplary embodiment. Figure 7 As shown, the noise reduction control method includes the following steps:

[0185] Step S701: Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0186] Step S702: Acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation;

[0187] Step S703: determining the total energy of the ambient time domain signal based on the ambient time domain signal, wherein the ambient time domain signal includes multiple frequency points, and the total energy of the ambient time domain signal refers to the sum of the energies of the various frequency points in the ambient time domain signal;

[0188] Step S704: determining the total energy of the ear canal time domain signal based on the ear canal time domain signal, wherein the ear canal time domain signal includes multiple frequency points, and the total energy of the ear canal time domain signal refers to the sum of the energies of the various frequency points in the ear canal time domain signal;

[0189] Step S705, determining whether a preset filter parameter adjustment condition is met;

[0190] If the ratio of the total energy of the ambient time domain signal to the total energy of the ear canal time domain signal is greater than or equal to the preset energy threshold, it is determined that the preset filter parameter adjustment condition is met, and step S706 is executed; when it is determined that the preset filter parameter adjustment condition is not met, the process ends.

[0191] Step S706: Perform Fourier transform on the ambient time domain signal and the ear canal time domain signal respectively to obtain an ambient frequency domain signal and an ear canal frequency domain signal, wherein the ambient frequency domain signal refers to a sound wave signal in the environment surrounding the headphone represented by a frequency domain representation, and the ear canal frequency domain signal refers to a sound wave signal in the ear canal represented by a frequency domain representation;

[0192] Step S707: obtaining a crossover frequency response based on the ambient frequency domain signal, the ear canal frequency domain signal, and a preset frequency response function, where the crossover frequency response is related to the frequency point;

[0193] Step S708, obtaining a reference noise reduction amount according to the crossover frequency response;

[0194] Step S709: obtaining an average noise reduction amount of the target frequency band according to the reference noise reduction amount, and determining the average noise reduction amount as the target noise reduction amount, wherein the average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band;

[0195] Step S710: Obtain a preset noise reduction threshold set, where the preset noise reduction threshold set includes a plurality of noise parameter values arranged from small to large, and the plurality of noise parameter values constitute a plurality of noise reduction thresholds, where the noise reduction thresholds correspond to the acoustic leakage compensation gears;

[0196] Step S711, determining the noise reduction threshold to which the target noise reduction amount belongs according to the target noise reduction amount and a preset noise reduction threshold set;

[0197] Step S5712: According to the noise reduction threshold to which the target noise reduction amount belongs, determining the acoustic leakage compensation level corresponding to the noise reduction threshold to which the target noise reduction amount belongs as the target acoustic leakage compensation level;

[0198] Step S6713: Obtain chip configuration information, where the chip configuration information is used to indicate whether the filter coefficients stored in the chip support updating.

[0199] If the filter coefficients stored in the chip support updating, execute step S714; if the filter coefficients stored in the chip do not support updating, execute step S715.

[0200] Step S714: determining a target filter coefficient based on the target sound leakage compensation level, and adjusting the filter coefficient in the preset noise reduction filter to the target filter coefficient;

[0201] Step S715: Based on the target acoustic leakage compensation level, a target filter gain is determined, and the filter gain of the preset noise reduction filter is adjusted to the target filter gain. The filter parameters of the preset noise reduction filter include: filter parameters of a feedforward filter; or filter parameters of the feedforward filter and filter parameters of a feedback filter.

[0202] It should be noted that, in order to make the earphones adapt to the user's wearing state at all times, the above-mentioned noise reduction control method is repeatedly executed at preset time intervals, for example, at time intervals of 30s to 120s.

[0203] In an exemplary embodiment of the present disclosure, an ambient time domain signal and an ear canal time domain signal are obtained, and based on the ear canal time domain signal ratio of the ambient time domain signal total energy to the ear canal time domain signal total energy, it is determined whether the current usage state is stable, so as to determine whether the preset filter parameter adjustment conditions are met, and based on the ambient time domain signal and the ear canal time domain signal, a target noise reduction amount is determined, and based on the correspondence between the noise reduction amount threshold and the sound leakage compensation gear and the target noise reduction amount, the sound leakage compensation gear corresponding to the target noise reduction amount, that is, the target sound leakage compensation gear, is obtained, and based on the target sound leakage compensation gear, the target filter parameters are determined, and the filter parameters in the preset noise reduction filter are adjusted to the target filter parameters. When the earphones are worn loosely, the filter parameters in the preset filter can be adjusted in time to perform sound leakage compensation, so as to increase the noise reduction amount, ensure a good noise reduction effect, and enhance the user experience.

[0204] In an exemplary embodiment of the present disclosure, a noise reduction control device is provided, which is applied to headphones. Figure 8 is a block diagram of a noise reduction control device according to an exemplary embodiment. Figure 8 As shown, the noise reduction control device includes:

[0205] A first acquisition module 801 is configured to acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner;

[0206] A second acquisition module 802 is configured to acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented in a time domain manner;

[0207] A first determination module 803 is configured to determine a target noise reduction amount based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function if the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition;

[0208] A second determining module 804 is configured to determine, based on preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation level corresponding to the target noise reduction amount as the target acoustic leakage compensation level, wherein the noise reduction configuration information is used to represent a correspondence between a noise reduction amount threshold and an acoustic leakage compensation level, and the noise reduction configuration information includes a plurality of noise reduction amount thresholds and an acoustic leakage compensation level corresponding to each of the noise reduction amount thresholds;

[0209] A third determining module 805 is configured to determine target filter parameters based on the target acoustic leakage compensation level;

[0210] The adjustment module 806 is configured to adjust the filter parameters in a preset noise reduction filter to the target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal.

[0211] In an exemplary embodiment, the first determining module 803 is further configured to:

[0212] Determine the total energy of the ambient time domain signal based on the ambient time domain signal, wherein the ambient time domain signal includes multiple frequency points, and the total energy of the ambient time domain signal refers to the sum of the energies of each frequency point in the ambient time domain signal;

[0213] Determining a total energy of the ear canal time domain signal based on the ear canal time domain signal, wherein the ear canal time domain signal includes multiple frequency points, and the total energy of the ear canal time domain signal refers to the sum of the energies of the various frequency points in the ear canal time domain signal;

[0214] If the ratio of the total energy of the ambient time domain signal to the total energy of the ear canal time domain signal is greater than or equal to a preset energy threshold, it is determined that the preset filter parameter adjustment condition is met.

[0215] In an exemplary embodiment, the first determining module 803 is further configured to:

[0216] Performing Fourier transform on the ambient time domain signal and the ear canal time domain signal respectively to obtain an ambient frequency domain signal and an ear canal frequency domain signal, wherein the ambient frequency domain signal refers to a sound wave signal in the environment surrounding the earphone represented by a frequency domain representation, and the ear canal frequency domain signal refers to a sound wave signal in the ear canal represented by a frequency domain representation;

[0217] Obtaining a crossover frequency response based on the ambient frequency domain signal, the ear canal frequency domain signal, and a preset frequency response function, where the crossover frequency response is related to a frequency point;

[0218] obtaining a reference noise reduction amount according to the crossover frequency response;

[0219] According to the reference noise reduction amount, an average noise reduction amount of the target frequency band is obtained, and the average noise reduction amount is determined as the target noise reduction amount, wherein the average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band.

[0220] In an exemplary embodiment, the second determining module 804 is further configured to:

[0221] Obtaining a preset noise reduction threshold set, wherein the preset noise reduction threshold set includes a plurality of noise parameter values arranged from small to large, wherein the plurality of noise parameter values constitute a plurality of noise reduction thresholds, and the noise reduction thresholds correspond to the acoustic leakage compensation gears;

[0222] Determining, according to the target noise reduction amount and the preset noise reduction threshold set, a noise reduction amount threshold to which the target noise reduction amount belongs;

[0223] According to the noise reduction amount threshold to which the target noise reduction amount belongs, an acoustic leakage compensation gear corresponding to the noise reduction amount threshold to which the target noise reduction amount belongs is determined as a target acoustic leakage compensation gear.

[0224] In an exemplary embodiment, the third determining module 805 is further configured to:

[0225] Obtain chip configuration information, where the chip configuration information is used to indicate whether filter coefficients stored in the chip support updating;

[0226] If the filter coefficients stored in the chip support updating, determining a target filter coefficient based on the target acoustic leakage compensation level, and adjusting the filter coefficients in the preset noise reduction filter to the target filter coefficients;

[0227] If the filter system stored in the chip does not support updating, a target filter gain is determined based on the target acoustic leakage compensation gear, and the filter gain in the preset noise reduction filter is adjusted to the target filter gain.

[0228] In an exemplary embodiment, the filter parameters of the preset noise reduction filter include:

[0229] filter parameters in a feedforward filter; or,

[0230] Filter parameters in the feedforward filter and filter parameters in the feedback filter.

[0231] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0232] The present disclosure also provides a noise-canceling headset, on which the above-mentioned noise-canceling control device is provided to implement the noise-canceling control method in the above-mentioned embodiment. Figure 9 is a block diagram of a noise-canceling headset 900 according to an exemplary embodiment.

[0233] Reference Figure 9 The noise canceling headphones 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0234] The processing component 902 generally controls the overall operation of the noise-canceling headphones 900, such as operations associated with display, phone calls, data communications, camera operation, and recording. The processing component 902 may include one or more processors 920 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 902 may include one or more modules to facilitate interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.

[0235] The memory 904 is configured to store various types of data to support the operation of the noise cancelling headphones 900. Examples of such data include instructions for any application or method operating on the noise cancelling headphones 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0236] The power supply component 906 provides power to the various components of the noise cancelling headphones 900. The power supply component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the noise cancelling headphones 900.

[0237] The multimedia component 908 includes a screen that provides an output interface between the noise cancelling headphones 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the noise cancelling headphones 900 are in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0238] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), which is configured to receive external audio signals when the noise canceling headset 900 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode. The received audio signal can be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0239] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0240] The sensor assembly 914 includes one or more sensors for providing various status assessments for the noise cancelling headphones 900. For example, the sensor assembly 914 can detect the open / closed state of the noise cancelling headphones 900, the relative positioning of components, such as the display and keypad of the noise cancelling headphones 900. The sensor assembly 914 can also detect changes in the position of the noise cancelling headphones 900 or a component of the noise cancelling headphones 900, the presence or absence of user contact with the noise cancelling headphones 900, the orientation or acceleration / deceleration of the noise cancelling headphones 900, and changes in the temperature of the noise cancelling headphones 900. The sensor assembly 914 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 can also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0241] The communication component 916 is configured to facilitate wired or wireless communication between the noise cancelling headphones 900 and other devices. The noise cancelling headphones 900 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0242] In an exemplary embodiment, the noise canceling headphones 900 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-mentioned methods.

[0243] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions. The instructions can be executed by the processor 920 of the noise-canceling headphones 900 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0244] A non-transitory computer-readable storage medium having computer program instructions stored thereon, characterized in that when the computer program instructions are called by a processor, the method described in any one of the above embodiments is executed.

[0245] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

[0246] It should be understood that the present invention is not limited to the exact construction described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A noise reduction control method, characterized in that: Applied to headphones, the method includes: Acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner; Acquiring an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation; If the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition, determining a target noise reduction amount based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function; Determining, based on preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation gear corresponding to the target noise reduction amount as the target acoustic leakage compensation gear, wherein the noise reduction configuration information is used to characterize a correspondence between a noise reduction amount threshold and an acoustic leakage compensation gear, and the noise reduction configuration information includes a plurality of noise reduction amount thresholds and an acoustic leakage compensation gear corresponding to each of the noise reduction amount thresholds; determining target filter parameters based on the target acoustic leakage compensation level; Adjusting filter parameters in a preset noise reduction filter to the target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering on the input sound wave signal; The determining a target noise reduction amount based on the ambient time domain signal, the ear canal time domain signal, and a preset frequency response function includes: Obtaining a crossover frequency response based on the ambient time domain signal, the ear canal time domain signal, and the preset frequency response function; According to the crossover frequency response, a reference noise reduction amount is obtained; According to the reference noise reduction amount, the average noise reduction amount of the target frequency band is obtained, and the average noise reduction amount is determined as the target noise reduction amount, wherein the average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band, and the target frequency band is the frequency band with the maximum noise reduction depth of the headphones.

2. The noise reduction control method according to claim 1, characterized in that: The method further includes: determining whether the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition by using the following method: Determine the total energy of the ambient time domain signal based on the ambient time domain signal, wherein the ambient time domain signal includes multiple frequency points, and the total energy of the ambient time domain signal refers to the sum of the energies of each frequency point in the ambient time domain signal; Determining a total energy of the ear canal time domain signal based on the ear canal time domain signal, wherein the ear canal time domain signal includes multiple frequency points, and the total energy of the ear canal time domain signal refers to the sum of the energies of the various frequency points in the ear canal time domain signal; If the ratio of the total energy of the ambient time domain signal to the total energy of the ear canal time domain signal is greater than or equal to a preset energy threshold, it is determined that the preset filter parameter adjustment condition is met.

3. The noise reduction control method according to claim 1, wherein: The obtaining of a crossover frequency response based on the ambient time domain signal, the ear canal time domain signal, and the preset frequency response function includes: Performing Fourier transform on the ambient time domain signal and the ear canal time domain signal respectively to obtain an ambient frequency domain signal and an ear canal frequency domain signal, wherein the ambient frequency domain signal refers to a sound wave signal in the environment surrounding the earphone represented by a frequency domain representation, and the ear canal frequency domain signal refers to a sound wave signal in the ear canal represented by a frequency domain representation; The crossover frequency response is obtained based on the ambient frequency domain signal, the ear canal frequency domain signal, and a preset frequency response function.

4. The noise reduction control method according to claim 1, wherein: The step of determining, according to the preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation level corresponding to the target noise reduction amount as a target acoustic leakage compensation level includes: Obtaining a preset noise reduction threshold set, wherein the preset noise reduction threshold set includes a plurality of noise parameter values arranged from small to large, wherein the plurality of noise parameter values constitute a plurality of noise reduction thresholds, and the noise reduction thresholds correspond to the acoustic leakage compensation gears; Determining, according to the target noise reduction amount and the preset noise reduction threshold set, a noise reduction amount threshold to which the target noise reduction amount belongs; According to the noise reduction amount threshold to which the target noise reduction amount belongs, an acoustic leakage compensation gear corresponding to the noise reduction amount threshold to which the target noise reduction amount belongs is determined as a target acoustic leakage compensation gear.

5. The noise reduction control method according to claim 1, wherein: The determining target filter parameters based on the target sound leakage compensation gear, and adjusting the filter parameters in the preset noise reduction filter to the target filter parameters, includes: Obtain chip configuration information, where the chip configuration information is used to indicate whether filter coefficients stored in the chip support updating; If the filter coefficients stored in the chip support updating, determining a target filter coefficient based on the target acoustic leakage compensation level, and adjusting the filter coefficients in the preset noise reduction filter to the target filter coefficients; If the filter system stored in the chip does not support updating, a target filter gain is determined based on the target acoustic leakage compensation gear, and the filter gain in the preset noise reduction filter is adjusted to the target filter gain.

6. The noise reduction control method according to claim 5, characterized in that: The filter parameters of the preset noise reduction filter include: filter parameters in a feedforward filter; or, Filter parameters in the feedforward filter and filter parameters in the feedback filter.

7. A noise reduction control device, characterized in that: Applied to headphones, the noise reduction control device includes: A first acquisition module is configured to acquire an ambient time domain signal, wherein the ambient time domain signal refers to a sound wave signal in the environment surrounding the earphone represented in a time domain manner; A second acquisition module is configured to acquire an ear canal time domain signal, wherein the ear canal time domain signal refers to a sound wave signal in the ear canal represented by a time domain representation; a first determination module configured to determine a target noise reduction amount based on the ambient time domain signal and the ear canal time domain signal and a preset frequency response function if the ambient time domain signal and the ear canal time domain signal meet a preset filter parameter adjustment condition; a second determining module configured to determine, based on preset noise reduction configuration information and the target noise reduction amount, an acoustic leakage compensation gear corresponding to the target noise reduction amount as the target acoustic leakage compensation gear, wherein the noise reduction configuration information is used to characterize a correspondence between a noise reduction amount threshold and an acoustic leakage compensation gear, and the noise reduction configuration information includes a plurality of noise reduction amount thresholds and an acoustic leakage compensation gear corresponding to each of the noise reduction amount thresholds; A third determining module is configured to determine a target filter parameter based on the target acoustic leakage compensation gear; an adjustment module configured to adjust filter parameters in a preset noise reduction filter to the target filter parameters, wherein the noise reduction filter is used to perform noise reduction filtering processing on the input sound wave signal; The first determining module is further configured to: Obtaining a crossover frequency response based on the ambient time domain signal, the ear canal time domain signal, and the preset frequency response function; According to the crossover frequency response, a reference noise reduction amount is obtained; According to the reference noise reduction amount, the average noise reduction amount of the target frequency band is obtained, and the average noise reduction amount is determined as the target noise reduction amount, wherein the average noise reduction amount refers to the average value of the energy of each frequency point in the target frequency band, and the target frequency band is the frequency band with the maximum noise reduction depth of the headphones.

8. A noise-canceling headset, characterized in that: The earphone includes a housing and a feedforward microphone, a feedback microphone, a speaker, and a controller arranged on the housing: The feedforward microphone is used to collect sound wave signals in the environment surrounding the earphone; The feedback microphone is used to collect sound wave signals in the ear canal; The speaker is used to play sound wave signals; The controller is communicatively connected to the feedforward microphone, the feedback microphone and the speaker respectively, and includes a processor and a memory, wherein the memory stores computer program instructions executable by the processor, and the processor is configured to call the computer program instructions to execute the method as described in any one of claims 1 to 6.

9. A non-transitory computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are called by a processor, the method according to any one of claims 1 to 6 is executed.

Citation Information

Patent Citations

  • Noise reduction method and device, audio equipment and computer readable storage medium

    CN112911441A

  • Active noise reduction method and device

    CN113676804A

  • Earphone active noise reduction method and device, earphone and computer readable storage medium

    CN114040300A