Noise cancellation device and method
The noise cancellation device addresses inconsistent noise cancellation in headsets by using user-specific fit indicators to adjust noise cancellation parameters, improving effectiveness and user experience.
Patent Information
- Application Number
- JP2023215364
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-04-16
- Filing Date
- 2023-12-21
- Publication Date
- 2025-07-08
- Estimated Expiration
- 2040-01-21
AI Technical Summary
Ambient noise affects the clarity of audio in headsets, and existing active noise cancellation technologies struggle to adapt to varying noise levels and individual ear canal fits, leading to inconsistent noise cancellation effects.
A noise cancellation device that includes a main control unit and a noise cancellation processing circuit, which determines target noise cancellation parameters based on a noise cancellation parameter library and user-specific fit indicators, such as the degree of fit between the headset and the ear canal, to adjust noise cancellation levels and equalization parameters.
Improves noise cancellation effectiveness by adaptively adjusting to individual user fits and noise environments, enhancing user experience by minimizing noise leakage and audio distortion.
Smart Images

Figure 0007704494000001 
Figure 0007704494000002 
Figure 0007704494000003
Abstract
Description
Technical Field
[0001] This application claims the benefit of Chinese Patent Application No. 201910505445.3, filed with the China National Intellectual Property Administration on April 16, 2019, under the title "NOISE CANCELLATION APPARATUS AND METHOD", which is hereby incorporated by reference in its entirety.
[0002] This application relates to the field of multimedia technology, and more particularly, to a noise cancellation apparatus and method.
Background Art
[0003] When a user wears a headset to listen to music or make a voice call, if there is ambient noise, the clarity of the music or voice signal heard by the user will be affected. In the case of severe ambient noise, the user may not even be able to clearly hear the audio information inside the headset. Ambient noise significantly degrades the experience of the person wearing the headset. The purpose of an active noise cancellation headset is to use a speaker in the headset to create noise with the same amplitude and opposite phase as the ambient noise, cancel the ambient noise, and reduce the noise heard by the person wearing the headset.
[0004] There are many challenges in implementing active noise cancellation using a headset. On the one hand, ambient noise is variable and irregular. On the other hand, the degree to which ambient noise leaks into the ear canal is related to the fit between the headset and the person's ear. However, the size and shape of the ear canal vary from person to person. When different users wear the same headset, the degree of fit between the headset and the human ear will be different, and the level of noise leakage will be different.
[0005] How to improve the noise cancellation effect of the headset and avoid the influence of external noise on headset users as much as possible needs to be urgently solved.
Summary of the Invention
[0006] Embodiments of the present application provide a noise cancellation device and method that improve the noise cancellation effect.
[0007] In a first aspect of the present application, a noise cancellation device is provided. The noise cancellation device includes a main control unit (MCU) and a noise cancellation processing circuit. The MCU is configured to determine a target noise cancellation parameter from a noise cancellation parameter library based on a received or determined target noise cancellation level indicator. The noise cancellation parameter library includes a correspondence between the noise cancellation level indicator and the noise cancellation parameter. The noise cancellation processing circuit is configured to obtain a target anti-phase noise based on the target noise cancellation parameter. The target anti-phase noise is used to reduce or cancel the ambient noise acquired by a reference microphone. The noise cancellation processing circuit is further configured to perform an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal, and the mixed audio signal is reproduced using a speaker.
[0008] Since the mixed audio signal includes the anti-phase noise of the ambient noise, when the mixed audio signal and the ambient noise enter the user's external auditory canal together, the anti-phase noise can cancel the ambient noise. Since the noise cancellation parameter is determined from a preset noise cancellation parameter library based on the received or autonomously determined noise cancellation level indicator, it is not uniformly configured, and the noise cancellation level can be flexibly adjusted, thereby improving the noise cancellation effect and the user experience. It is understood that the anti-phase noise may completely cancel the ambient noise or partially cancel the ambient noise.
[0009] In a possible implementation, the target noise cancellation level indicator is related to the degree of fit between the headset and the user's external ear canal, and the noise cancellation level indicator is used to indicate the noise cancellation parameters that conform to the degree of fit.
[0010] Ambient noise is variable and irregular, and different from the size and shape of the user's external ear canal. Therefore, when different users wear the same headset, the degree of fit between the user's headset and the external ear canal is also different, and the degree to which noise leaks into the external ear canal is also different. If the noise cancellation solution of the headset is uniformly configured, the noise cancellation effect will not be satisfactory. In the noise cancellation device provided in this embodiment of the present application, the noise cancellation indicator is related to the degree of fit between the headset and the user's external ear canal (or the degree to which noise leaks into the user's external ear canal caused by the degree of fit). The noise cancellation level is not uniformly set, but can be adaptively determined so that different users can obtain an optimal noise cancellation experience in different noise environments.
[0011] In a possible implementation, the noise cancellation parameter library is obtained by statistical collection based on the relationship between the degree of fit and the noise cancellation parameters, and the noise cancellation level indicator reflects the value of the degree of fit.
[0012] In this embodiment of the present application, the correspondence between the noise cancellation level indicator and the noise cancellation parameters in the noise cancellation parameter library is universal, and the noise cancellation effect is better.
[0013] In a possible implementation, the MCU is specifically configured to select the target noise cancellation parameters from the noise cancellation parameter library based on the received target noise cancellation level indicator set by the user through the input interface.
[0014] In a possible implementation, the apparatus further comprises a reference microphone configured to acquire ambient noise and a transceiver; the transceiver is configured to receive a target noise cancellation level indicator, which is set by a user through an input interface and transmitted to the transceiver via a wireless link; the MCU is specifically configured to select a target noise cancellation parameter from a noise cancellation parameter library based on the target noise cancellation level indicator received by the transceiver.
[0015] The noise cancellation level is selected by the user based on the effect of the headset, and the noise cancellation parameter corresponding to the noise cancellation level is related to the degree of fit between the user's external auditory canal and the headset. Therefore, the anti-phase noise obtained by performing processing based on the noise cancellation parameter has a better effect of canceling the ambient noise. The headset has a better active noise cancellation effect. The user experience is better.
[0016] In a possible implementation, the apparatus further comprises a reference microphone, a speaker, and an error microphone; the MCU or the noise cancellation processing circuit is further configured to determine a target noise cancellation level indicator based on a degree-of-fit characteristic value used to indicate the degree of fit; the MCU is specifically configured to select a target noise cancellation parameter from a noise cancellation parameter library based on the determined target noise cancellation level indicator; the degree-of-fit characteristic value is determined by the MCU or the noise cancellation processing circuit based on the relationship between the primary path transfer function PP and the secondary path transfer function SP, where PP is the transfer function from the reference microphone to the error microphone, and SP is the transfer function from the speaker to the error microphone.
[0017] According to the noise cancellation device provided in this embodiment of the present application, the degree of coincidence between the user's headset and the external auditory canal is adaptively determined by measuring the degree-of-coincidence characteristic value, and the target noise cancellation parameters for different users are determined based on the degree of coincidence. In this way, the noise cancellation effect is improved and the adaptability is enhanced. Furthermore, the user does not need to set the noise cancellation level and the noise cancellation parameters, thereby improving the user experience.
[0018] In a possible implementation, the distance between the error microphone and the speaker is the first distance, the distance between the reference microphone and the speaker is the second distance, and the first distance is smaller than the second distance.
[0019] In a possible implementation, the degree-of-coincidence characteristic value is the ratio of PP to SP. When the ratio of PP to SP satisfies the preset condition, the MCU or the noise cancellation processing circuit is specifically configured to determine that the noise cancellation level index corresponding to the preset condition is the target noise cancellation level index.
[0020] In this embodiment of the present application, it is found that the amplitude-frequency responses of PP / SP (the ratio of PP to SP) corresponding to the ears of different people have a relatively clear change rule in the range of 1 kHz to 3 kHz. Therefore, in this embodiment of the present application, PP / SP is used as a characteristic value for recognizing the degree of coincidence.
[0021] In a possible implementation, the MCU presets N groups of value factors of the noise cancellation level index from L(1) to L(N), and specifically configures to determine, as the target noise cancellation level index, i that enables PP to be closest to L(i)×SP among the N groups of value factors of the noise cancellation level index, where 1≤i≤N.
[0022] In a possible implementation, the noise cancellation processing circuit includes a feedforward FF filter bank, the target noise cancellation parameter has FF filtering coefficients, and the FF filter bank processes ambient noise based on the FF filtering coefficients to obtain target anti-phase noise.
[0023] In a possible implementation, the noise cancellation processing circuit includes a feedforward FF filter bank and a feedback FB filter bank, the noise cancellation parameter includes FF filtering coefficients and FB filtering coefficients; the FF filter bank processes ambient noise based on the FF filtering coefficients to obtain first anti-phase noise; the FB filter bank in the noise cancellation processing circuit processes the noise signal of the error microphone based on the FB filtering coefficients to obtain second anti-phase noise, and after performing compensation filtering on the reproduced downlink audio signal and the audio signal obtained by the error microphone, audio mixing is performed on the reproduced downlink audio signal obtained, so that the noise signal of the error microphone is obtained; the first anti-phase noise and the second anti-phase noise are superimposed to obtain target anti-phase noise.
[0024] In a possible implementation, the target noise cancellation level indicator is further used to indicate an equalization parameter adapted to the degree of coincidence; the MCU is further configured to select a target equalization parameter from an equalization parameter library based on the target noise cancellation level indicator; the noise cancellation processing circuit is further configured to adjust the equalization EQ of the reproduced downlink audio signal based on the target equalization parameter.
[0025] The mixed audio signal is played using a speaker and reaches the user's external auditory canal. The audio signal heard by the user undergoes both noise cancellation processing and equalization processing. This not only removes the influence of ambient noise but also compensates for audio distortion caused by leakage, making the audio signal heard by the user closer to the original audio signal.
[0026] In a possible implementation, the equalization parameter library is obtained by statistical collection based on the relationship between the degree of match and the equalization parameters. The equalization parameter library includes the correspondence between the noise cancellation level index and the equalization parameters. The noise cancellation level index reflects the value of the degree of match, and the equalization parameters corresponding to the first noise cancellation level index are adapted to the degree of match corresponding to the first noise cancellation level index.
[0027] In a possible implementation, the instructions of the plurality of noise cancellation level indices presented within the input interface are arranged unevenly, and the interval between the instructions of adjacent noise cancellation level indices is related to the adjustment step between the noise cancellation levels corresponding to the noise cancellation level indices.
[0028] In a possible implementation, a preset noise cancellation level index is set in the input interface. The interval between adjacent noise cancellation level indices in the first noise cancellation level range is larger than the interval between adjacent noise cancellation level indices in the second noise cancellation level range. The noise cancellation level indices in the first noise cancellation level range are smaller than the preset noise cancellation level index, and the noise cancellation level indices in the second noise cancellation level range are equal to or greater than the preset noise cancellation level index.
[0029] In a possible implementation, the noise cancellation device further comprises a bone voiceprint sensor configured to obtain the user's bone voiceprint features; the MCU is further configured to associate the target noise cancellation parameters determined based on the received or determined target noise cancellation level indicator with the user's bone voiceprint features; the MCU determines whether the bone voiceprint features exist in the history parameter library, and the history parameter library includes the association relationship between the bone voiceprint features and the historical target noise cancellation parameters; when the bone voiceprint features exist in the history parameter library, the MCU is further configured to determine the historical target noise cancellation parameters associated with the bone voiceprint features as the target noise cancellation parameters.
[0030] When the user who has registered the bone voiceprint wears the headset again, the headset can automatically use the noise cancellation parameters, the hear-through parameters, or the equalization parameters associated with the user by identifying the user using the bone voiceprint features.
[0031] In a possible implementation, the noise cancellation device further comprises a voice recognition engine configured to recognize voice commands; the MCU is further configured to determine the target noise cancellation parameters based on the voice commands when the voice recognition engine recognizes the voice commands; the MCU is further configured to enable or disable the noise cancellation function based on the voice commands when the voice recognition engine recognizes the voice commands.
[0032] In a possible implementation, the MCU is further configured to determine target through-parameter related to the degree of coincidence; the noise cancellation processing circuit is configured to perform through-processing on the audio signal acquired by the reference microphone based on the target through-parameter to obtain a compensated audio signal of the useful audio signal, and the audio signal acquired by the reference microphone includes ambient noise and the useful audio signal; and is further configured to perform audio mixing processing on the reproduced downlink audio signal, the anti-phase noise, and the compensated audio signal to obtain a mixed audio signal.
[0033] The mixed audio signal includes the anti-phase noise used to cancel the ambient noise and the compensated audio signal used to compensate the useful audio signal attenuated by the headset. In this embodiment of the present application, the noise signal is removed based on the noise cancellation parameter, and the useful audio signal attenuated by the headset is compensated based on the through-parameter. When the noise is removed, the external useful audio signal is retained. The audio signal transmitted transparently to the user's external auditory canal is only the useful audio signal excluding the noise. Thereby, the noise cancellation function and the through function are provided.
[0034] In a possible implementation, the MCU is further configured to determine a target equalization parameter, and the target equalization parameter is related to the degree of leakage. The noise cancellation processing circuit is further configured to adjust the equalization EQ of the reproduced downlink audio signal based on the target equalization parameter.
[0035] In a possible implementation, the apparatus further includes a transceiver configured to receive an equalization level indicator, where the equalization level indicator is set by a user in the application APP and transmitted to the transceiver via a wireless link, and the equalization level indicator is related to the degree of leakage. The MCU is configured to select a target equalization parameter from an equalization parameter library based on the equalization level indicator.
[0036] In a possible implementation, the apparatus further includes an error microphone. The MCU or the noise cancellation processing circuit is further configured to determine the degree of leakage based on the degree of coincidence feature value. The MCU or the noise cancellation processing circuit is further configured to determine an equalization level indicator corresponding to the degree of leakage. The MCU is specifically configured to select a target equalization parameter from an equalization parameter library based on the equalization level indicator, and the degree of coincidence feature value is the ratio of the primary path transfer function PP to the secondary path transfer function SP. The input of PP is the ambient noise acquired by the reference microphone, and the output of PP is the audio signal acquired by the error microphone. The input of SP is the mixed audio signal sent to the speaker, and the output of SP is the audio signal acquired by the error microphone.
[0037] In a second aspect of the present application, a noise cancellation device is provided. The noise cancellation device includes a main control unit MCU and a noise cancellation processing circuit. The MCU is configured to determine a target noise cancellation parameter based on a degree of match feature value, and the degree of match feature value is used to indicate the degree of match between the headset and the user's external auditory canal. The noise cancellation processing circuit is configured to obtain a target anti-phase noise based on the target noise cancellation parameter, and the target anti-phase noise is used to reduce or cancel the ambient noise acquired by the reference microphone. The noise cancellation processing circuit is further configured to perform an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal, and the mixed audio signal is reproduced using a speaker. The degree of match feature value is determined by the MCU or the noise cancellation processing circuit based on the relationship between the primary path transfer function PP and the secondary path transfer function SP. PP is the transfer function from the reference microphone to the error microphone, and SP is the transfer function from the speaker to the error microphone.
[0038] According to the noise cancellation device provided in this embodiment of the present application, the degree of match between the user's headset and the external auditory canal is adaptively determined by measuring the degree of match feature value, and the target noise cancellation parameters for different users are determined based on the degree of match. In this way, the noise cancellation effect is improved and the adaptability is enhanced. Furthermore, the user does not need to set the noise cancellation level and the noise cancellation parameters, thereby improving the user experience.
[0039]
[0040] In a possible implementation, the noise cancellation parameter library is obtained by statistical collection based on the relationship between the degree of match and the noise cancellation parameters.
[0041] In a possible implementation, the degree of match feature value is the ratio of PP to SP.
[0042] In a possible implementation, the apparatus further includes a reference microphone configured to acquire ambient noise, an error microphone, and a speaker configured to reproduce a mixed audio signal.
[0043] In a possible implementation, the MCU is further configured to select a target equalization parameter corresponding to the degree of match feature value from an equalization parameter library based on the degree of match feature value, where the equalization parameter library includes the correspondence between the degree of match feature value and the equalization parameter.
[0044] In a possible implementation, the MCU is further configured to select a target through-parameter corresponding to the degree of match feature value from a through-parameter library based on the degree of match feature value, where the through-parameter library includes the correspondence between the degree of match feature value and the through-parameter.
[0045] In a possible implementation, the apparatus further includes a voice recognition engine and a bone voiceprint sensor.
[0046] In a third aspect of the present application, a noise cancellation device including a main control unit and a noise cancellation processing circuit is provided. The main control unit is configured to determine a target noise cancellation level based on the magnitude of ambient noise or the characteristic information of the ambient noise obtained by a reference microphone. The noise cancellation processing circuit is configured to obtain a target anti-phase noise based on a noise cancellation parameter corresponding to the target noise cancellation level, and the target anti-phase noise is used to reduce or cancel the ambient noise. The noise cancellation processing circuit is further configured to perform an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal, and the mixed audio signal is reproduced using a speaker.
[0047] According to the headset provided in this embodiment of the present application, the noise cancellation level may be adaptively determined based on the noise state (including the magnitude of the noise or the characteristic information of the noise), so that different users can obtain an optimal noise cancellation experience in different noise environments.
[0048] In a possible implementation, the device further includes a reference microphone configured to obtain ambient noise.
[0049] In a possible implementation, when the MCU determines that the ambient noise is less than the first threshold, it disables the noise cancellation function; when it determines that the ambient noise is greater than or equal to the first threshold and less than the second threshold, it determines that the target noise cancellation level is the first noise cancellation level; when it determines that the ambient noise is greater than or equal to the second threshold and less than the third threshold, it determines that the target noise cancellation level is the second noise cancellation level; and when it determines that the ambient noise is greater than or equal to the third threshold, it is specifically configured to determine that the target noise cancellation level is the third noise cancellation level. The noise cancellation parameters corresponding to the third noise cancellation level are greater than the noise cancellation parameters corresponding to the second noise cancellation level, and the noise cancellation parameters corresponding to the second noise cancellation level are greater than the noise cancellation parameters corresponding to the first noise cancellation level.
[0050] In a possible implementation, the MCU is configured to obtain the characteristic information of the ambient noise; when the characteristic information is the noise characteristic in a quiet environment, disable the noise cancellation function; or when the characteristic information is not the noise characteristic in a quiet environment, determine the target noise cancellation mode that matches the characteristic information; and determine the noise cancellation level corresponding to the target noise cancellation mode as the target noise cancellation level.
[0051] In a possible implementation, the noise cancellation mode includes at least one of an aircraft mode, a subway mode, a street mode, or an indoor mode, and each mode corresponds to one noise cancellation parameter.
[0052] In a possible implementation, the device further includes a voice recognition engine configured to recognize voice commands. The MCU is further configured to determine the target noise cancellation level based on the voice command when the voice recognition engine recognizes the voice command.
[0053] In a possible implementation, when the voice recognition engine recognizes a voice command, the MCU is further configured to enable the noise cancellation function, disable the noise cancellation function, or set the noise cancellation mode based on the voice command.
[0054] In a possible implementation, the MCU is further configured to determine a target noise cancellation level based on settings executed by the user through an input interface.
[0055] In a possible implementation, the noise cancellation mode further includes an automatic control mode. When it is determined that the noise cancellation mode is the automatic control mode, the MCU is configured to determine a target noise cancellation level based on the magnitude of ambient noise or characteristic information of the ambient noise.
[0056] In the automatic control mode, the noise cancellation level or noise cancellation parameters set by the user through the input interface or by voice are not effective.
[0057] In the fourth aspect of the present application, a control interface for an application of a noise cancellation headset is provided, including a noise cancellation control switch and a noise cancellation level adjustment module. The noise cancellation level adjustment module includes a plurality of non-uniformly arranged noise cancellation level indicators. The interval between adjacent noise cancellation level indicators is related to the adjustment step between noise cancellation levels. The noise cancellation control switch is configured to set to enable or disable the noise cancellation function of the noise cancellation headset. The noise cancellation level adjustment module is configured to set the noise cancellation level indicator. The noise cancellation level indicator is used to indicate the noise cancellation level of the noise cancellation headset.
[0058] In a possible implementation, the noise cancellation level indicator includes a preset noise cancellation level indicator, and the interval between adjacent noise cancellation level indicators within a first noise cancellation level range is greater than the interval between adjacent noise cancellation level indicators within a second noise cancellation level range. The noise cancellation level indicator within the first noise cancellation level range is less than the preset noise cancellation level indicator, and the noise cancellation level indicator within the second noise cancellation level range is greater than or equal to the preset noise cancellation level indicator.
[0059] In a possible implementation, the noise cancellation level indicator includes a default noise cancellation level indicator, and the default noise cancellation level indicator is used to indicate the noise cancellation level of the noise cancellation headset when the noise cancellation headset is first used.
[0060] In a possible implementation, the noise cancellation level adjustment module is in the shape of a circular disk or a bar graph.
[0061] In a possible implementation, the control interface further includes a hear-through control switch and a hear-through level adjustment module. The hear-through control switch is configured to set to enable or disable the hear-through function of the noise cancellation headset. The hear-through level adjustment module is configured to set a hear-through level indicator. Here, the hear-through level indicator is used to indicate the hear-through parameter of the noise cancellation headset.
[0062] In a possible implementation, the control interface further includes a plurality of noise cancellation mode control switches, and one noise cancellation mode control switch is configured to control the activation or deactivation of the corresponding noise cancellation mode. The control interface further includes an automatic mode control switch configured to activate or deactivate the automatic noise cancellation mode of the noise cancellation headset. When the automatic mode control switch is turned on, the plurality of noise cancellation mode control switches are not enabled.
[0063] In a fifth aspect of the present application, a method for controlling a noise cancellation headset is provided. The method includes presenting an input interface and providing a noise cancellation level adjustment module within the input interface, the noise cancellation level adjustment module including instructions for a plurality of non-uniformly arranged noise cancellation level indicators, where the interval between instructions of adjacent noise cancellation level indicators is related to the adjustment step between noise cancellation levels; receiving a switch control signal using a noise cancellation control switch, the switch control signal being a signal for setting by a user to activate or deactivate the noise cancellation function of the noise cancellation headset; and receiving, using the noise cancellation level adjustment module, a setting performed by the user with respect to the noise cancellation level indicator, the noise cancellation level indicator being used to indicate the noise cancellation level of the noise cancellation headset.
[0064] In a possible implementation, the method includes determining a noise cancellation level indicator based on a setting made by a user for the noise cancellation level indicator when the switch control signal is a signal for setting the user to enable or disable the noise cancellation function of the noise cancellation headset, and determining a target noise cancellation parameter from a noise cancellation parameter library based on the noise cancellation level indicator; and obtaining a target anti-phase noise based on the target noise cancellation parameter, where the target anti-phase noise is obtained for reducing or canceling ambient noise acquired by a reference microphone.
[0065] In a possible implementation, the method further includes performing an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal, where the mixed audio signal is reproduced using a speaker.
[0066] In a possible implementation, the method includes transmitting the switch control signal and the noise cancellation level indicator to the noise cancellation headset via a wireless link, where the noise cancellation headset enables or disables the noise cancellation function based on the switch control signal and adjusts the noise cancellation level of the headset based on the noise cancellation level indicator.
[0067] In a possible implementation, a hear-through control switch and a hear-through level adjustment module are further provided within the input interface; the method further comprises receiving, using the hear-through control switch, a second switch control signal, where the second switch control signal is a signal for setting by the user to enable or disable the hear-through function of the noise cancellation headset; and receiving, using the hear-through level adjustment module, a setting executed by the user for a hear-through level indicator, where the hear-through level indicator is used to display the hear-through parameter of the noise cancellation headset.
[0068] In a possible implementation, an automatic mode control switch and a plurality of noise cancellation scenario mode control switches are further provided within the input interface; the method comprises receiving, using the automatic mode control switch, a third switch control signal, where the third switch control signal is a signal for setting by the user to enable or disable the automatic noise cancellation mode of the noise cancellation headset; and receiving, using any one of the plurality of noise cancellation scenario control switches, a signal for setting to enable or disable the noise cancellation scenario mode corresponding to the any one of the control switches; when the automatic mode control switch is turned on, the plurality of noise cancellation scenario mode control switches are not enabled.
[0069] In a sixth aspect of the present application, there is provided a noise cancellation headset control device including a noise cancellation control switch and a noise cancellation level adjustment module. The noise cancellation level adjustment module includes a display of a plurality of non-uniformly arranged noise cancellation level indicators, and the interval between the displays of adjacent noise cancellation level indicators is related to the adjustment step between the noise cancellation levels. The noise cancellation control switch is configured to set to enable or disable the noise cancellation function of the noise cancellation headset. The noise cancellation level adjustment module is configured to set a noise cancellation level indicator, and the noise cancellation level indicator is used to indicate the noise cancellation level of the noise cancellation headset.
[0070] In a possible embodiment, the device includes a control module. When the control module determines that the noise cancellation control switch is set to enable the noise cancellation function of the noise cancellation headset, the control module determines the noise cancellation level indicator set in the noise cancellation level adjustment module; determines a target noise cancellation parameter from a noise cancellation parameter library based on the noise cancellation level indicator; and is configured to obtain target anti-phase noise based on the target noise cancellation parameter. Here, the target anti-phase noise is used to reduce or cancel the ambient noise acquired by the reference microphone.
[0071] In a possible implementation, the noise cancellation level indicator includes a preset noise cancellation level indicator, and the display of the preset noise cancellation level indicator is marked on the noise cancellation level adjustment module. The interval between adjacent noise cancellation level indicators in the first noise cancellation level range is larger than the interval between adjacent noise cancellation level indicators in the second noise cancellation level range. The noise cancellation level indicators in the first noise cancellation level range are smaller than the preset noise cancellation level indicator, and the noise cancellation level indicators in the second noise cancellation level range are greater than or equal to the preset noise cancellation level indicator.
[0072] In a possible implementation, the noise cancellation level indicator includes a default noise cancellation level indicator, and the default noise cancellation level indicator is used to indicate the noise cancellation level of the noise cancellation headset when the noise cancellation headset is first used.
[0073] In a possible implementation, the control module determines that the noise cancellation level indicator set on the noise cancellation level adjustment module is the default noise cancellation level indicator, and transmits the default noise cancellation level indicator to the headset. Thereby, the headset determines the target noise cancellation parameters based on the default noise cancellation level indicator, and acquires the anti-phase noise based on the target noise cancellation parameters.
[0074] In a possible implementation, the noise cancellation level indicator is further used to indicate the through parameter of the noise cancellation headset.
[0075] In a possible implementation, the control device further includes a through-control switch and a through-level adjustment module. The through-control switch is configured to set to enable or disable the through function of the noise cancellation headset. The through-level adjustment module is configured to set a through-level index. Here, the through-level index is used to display the through parameter of the noise cancellation headset.
[0076] In a possible implementation, the control device further includes a plurality of noise cancellation scenario mode control switches, and each noise cancellation scenario mode control switch is configured to control the enabling or disabling of the corresponding noise cancellation mode. The control device further includes an automatic mode control switch configured to enable or disable the automatic noise cancellation mode of the noise cancellation headset. When the automatic mode control switch is turned on, the plurality of noise cancellation scenario mode control switches are not enabled.
[0077] The user may use the noise cancellation level adjustment module to set a noise cancellation level index and use the noise cancellation parameter corresponding to the noise cancellation level index as a target noise cancellation parameter. Alternatively, the user may use each of the plurality of noise cancellation scenario control switches to set the corresponding noise cancellation scenario mode and use the noise cancellation parameter corresponding to the corresponding noise cancellation scenario mode as a target noise cancellation parameter. Or, the automatic noise cancellation mode may be enabled. In this case, the headset autonomously determines the noise cancellation mode or the noise cancellation level by determining the magnitude or characteristic information of the ambient noise.
[0078] In a seventh aspect of the present application, a noise cancellation method is provided. The noise cancellation method includes the step of determining a target noise cancellation parameter from a noise cancellation parameter library based on a received or determined target noise cancellation level indicator, where the noise cancellation parameter library includes a correspondence between the noise cancellation level indicator and the noise cancellation parameter; the step of obtaining a target anti-phase noise based on the target noise cancellation parameter, where the target anti-phase noise is used to reduce ambient noise acquired by a reference microphone; and the step of performing an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal.
[0079] In a possible implementation, the target noise cancellation level indicator is related to the degree of fit between the headset and the user's ear canal, and the noise cancellation level indicator is used to indicate a noise cancellation parameter adapted to the degree of fit.
[0080] In a possible implementation, the noise cancellation parameter library is obtained by statistical collection based on the relationship between the degree of fit and the noise cancellation parameter, and the noise cancellation level indicator reflects the value of the degree of fit.
[0081] In a possible implementation, the method further includes the step of receiving a target noise cancellation level indicator, where the target noise cancellation level indicator is set by the user through an input interface and transmitted to the transceiver of the headset via a wireless link; and the step of selecting a target noise cancellation parameter from the noise cancellation parameter library based on the target noise cancellation level indicator received by the transceiver.
[0082] In a possible implementation, the method further includes: determining a target noise cancellation level index based on a consistency characteristic value used to indicate a degree of consistency; and selecting a target noise cancellation parameter from a noise cancellation parameter library based on the determined target noise cancellation level index. The consistency characteristic value is determined by an MCU or a noise cancellation processing circuit based on the relationship between a primary path transfer function PP and a secondary path transfer function SP. PP is a transfer function from a reference microphone to an error microphone, and SP is a transfer function from a speaker to the error microphone.
[0083] In a possible implementation, the consistency characteristic value is a ratio of PP to SP. Based on the consistency characteristic value, the step of determining a target noise cancellation level index specifically includes determining that the noise cancellation level index corresponding to a preset condition is the target noise cancellation level index when the ratio of PP to SP meets the preset condition.
[0084] In a possible implementation, the step of determining a target noise cancellation level index based on the consistency characteristic value specifically includes presetting N groups of value factors of noise cancellation level indexes from L(1) to L(N); and determining, as the target noise cancellation level index, an i that enables PP to be closest to L(i)×SP among the N groups of value factors of noise cancellation level indexes, where 1≦i≦N.
[0085] In a possible implementation, the target noise cancellation parameter includes an FF filter coefficient. The step of obtaining target anti-phase noise based on the target noise cancellation parameter specifically includes processing ambient noise based on the FF filter coefficient to obtain the target anti-phase noise.
[0086] In a possible implementation, the noise cancellation parameter includes an FF filtering coefficient and an FB filtering coefficient; the step of obtaining a target inverse-phase noise based on the target noise cancellation parameter is to process ambient noise based on the FF filtering coefficient to obtain a first inverse-phase noise; and to process the noise signal of the error microphone based on the FB filtering coefficient to obtain a second inverse-phase noise, where, after performing compensation filtering on the reproduced downlink audio signal and the audio signal obtained by the error microphone, the noise signal of the error microphone is obtained by performing audio mixing on the obtained reproduced downlink audio signal; specifically including superimposing the first inverse-phase noise and the second inverse-phase noise to obtain a target inverse-phase noise.
[0087] In a possible implementation, the target noise cancellation level indicator is further used to indicate an equalization parameter that conforms to the degree of match; the method further includes the step of selecting a target equalization parameter from an equalization parameter library based on the target noise cancellation level indicator; and the step of adjusting the equalization EQ of the reproduced downlink audio signal based on the target equalization parameter.
[0088] In a possible implementation, the equalization parameter library is obtained by statistical collection based on the relationship between the degree of match and the equalization parameter, the noise cancellation level indicator reflects the value of the degree of match, and the equalization parameter corresponding to the first noise cancellation level indicator conforms to the degree of match corresponding to the first noise cancellation level indicator.
[0089] In a possible implementation, the method includes: obtaining the user's bone voiceprint feature; associating the target noise cancellation parameter determined based on the received or determined target noise cancellation level indicator with the user's bone voiceprint feature; determining whether the bone voiceprint feature exists in the history parameter library, where the history parameter library includes the association relationship between the bone voiceprint feature and the history target noise cancellation parameter; and when the bone voiceprint feature exists in the history parameter library, determining the history target noise cancellation parameter associated with the bone voiceprint feature as the target noise cancellation parameter.
[0090] In a possible implementation, the method further includes: when the voice recognition engine recognizes a voice command, determining a target noise cancellation parameter based on the voice command; and when the voice recognition engine recognizes a voice command, enabling or disabling the noise cancellation function based on the voice command.
[0091] In a possible implementation, the method further includes: determining a target through-parameter related to the degree of coincidence; based on the target through-parameter, performing a through-process on the audio signal acquired by the reference microphone to obtain a compensated audio signal of the useful audio signal, where the audio signal acquired by the reference microphone includes ambient noise and the useful audio signal; and performing an audio mixing process on the reproduced downlink audio signal, the anti-phase noise, and the compensated audio signal to obtain a mixed audio signal.
[0092] In an eighth aspect of the present application, a noise cancellation method is provided. The method includes a step of determining a target noise cancellation parameter based on a degree of coincidence feature value, where the degree of coincidence feature value is used to indicate the degree of coincidence between the headset and the user's external auditory canal; a step of obtaining a target anti-phase noise based on the target noise cancellation parameter, where the target anti-phase noise is used to reduce or cancel the ambient noise acquired by a reference microphone; a step of performing an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal, where the mixed audio signal is reproduced using a speaker; and the degree of coincidence feature value is determined by an MCU or a noise cancellation processing circuit based on the relationship between a primary path transfer function PP and a secondary path transfer function SP, where PP is the transfer function from the reference microphone to the error microphone, and SP is the transfer function from the speaker to the error microphone.
[0093] In a possible implementation, the step of determining a target noise cancellation parameter based on the degree of coincidence feature value specifically includes selecting a target noise cancellation parameter corresponding to the degree of coincidence feature value from a noise cancellation parameter library based on the degree of coincidence feature value, where the noise cancellation parameter library includes the correspondence between the degree of coincidence feature value and the noise cancellation parameter.
[0094] In a possible implementation, the degree of coincidence feature value is the ratio of PP to SP.
[0095] In a ninth aspect of the present application, a noise cancellation method is provided. The method includes determining a target noise cancellation level based on the magnitude of ambient noise acquired by a reference microphone or based on characteristic information of the ambient noise acquired by the reference microphone; obtaining a target anti-phase noise based on a noise cancellation parameter corresponding to the target noise cancellation level, and reducing or canceling the ambient noise using the target anti-phase noise; and performing an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain an audio mixing signal, and reproducing the mixed audio signal using a speaker.
[0096] According to the noise cancellation method provided in this embodiment of the present application, the noise cancellation level may be adaptively determined based on the noise state (including the magnitude of the noise or the characteristic information of the noise) so that different users can obtain an optimal noise cancellation experience in different noise environments.
[0097] In a possible implementation, the method further includes acquiring the ambient noise.
[0098] In a possible implementation, the step of determining a target noise cancellation level based on the magnitude of ambient noise acquired by a reference microphone specifically includes: when it is determined that the ambient noise is less than a first threshold, disabling the noise cancellation function; when it is determined that the ambient noise is equal to or greater than the first threshold and less than a second threshold, determining that the target noise cancellation level is a first noise cancellation level; when it is determined that the ambient noise is equal to or greater than the second threshold and less than a third threshold, determining that the target noise cancellation level is a second noise cancellation level; and when it is determined that the ambient noise is equal to or greater than the third threshold, determining that the target noise cancellation level is a third noise cancellation level. The noise cancellation parameter corresponding to the third noise cancellation level is greater than the noise cancellation parameter corresponding to the second noise cancellation level, and the noise cancellation parameter corresponding to the second noise cancellation level is greater than the noise cancellation parameter corresponding to the first noise cancellation level.
[0099] In a possible implementation, the step of determining a target noise cancellation level based on the characteristic information of ambient noise acquired by a reference microphone specifically includes: acquiring the characteristic information of ambient noise; when the characteristic information is the noise characteristic in a quiet environment, disabling the noise cancellation function; or when the characteristic information is not the noise characteristic in a quiet environment, determining a target noise cancellation mode that matches the characteristic information; and determining, as the target noise cancellation level, the noise cancellation level corresponding to the target noise cancellation mode.
[0100] In a possible implementation, the noise cancellation mode includes at least one of an aircraft mode, a subway mode, a street mode, or an indoor mode, and each mode corresponds to one noise cancellation parameter.
[0101] In a possible implementation, the method further includes the step of determining a target noise cancellation level based on an audio command when an audio recognition engine recognizes the audio command.
[0102] In a possible implementation, the method further includes, when a speech recognition engine recognizes a speech command, based on the speech command, enabling or disabling a noise cancellation function, or setting a noise cancellation mode.
[0103] In a possible implementation, the method further includes determining a target noise cancellation level based on a setting executed by a user at an input interface.
[0104] In a possible implementation, the noise cancellation mode further includes an automatic control mode, and the method further includes determining a target noise cancellation level based on the magnitude of ambient noise or characteristic information of the ambient noise when it is determined that the noise cancellation mode is the automatic control mode.
[0105] In the automatic control mode, a noise cancellation level or noise cancellation parameter set by the user through an input interface or by voice is not effective.
[0106] In a tenth aspect of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores instructions. When the instructions are executed on a computer or a processor, the computer or the processor is enabled to execute any one of the seventh aspect or possible implementations of the seventh aspect.
[0107] In an eleventh aspect of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores instructions. When the instructions are executed on a computer or a processor, the computer or the processor is enabled to execute any one of the eighth aspect or possible implementations of the eighth aspect.
[0108] In a 12th aspect of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores instructions. When the instructions are executed on a computer or a processor, the computer or the processor is enabled to execute any one of the 9th aspect or possible implementations of the 9th aspect.
[0109] In a 13th aspect of the present application, a computer program product including instructions is provided. When the computer program product is executed on a computer or a processor, the computer or the processor is enabled to execute any one of the 7th aspect or possible implementations of the 7th aspect.
[0110] In a 14th aspect of the present application, a computer program product including instructions is provided. When the computer program product is executed on a computer or a processor, the computer or the processor is enabled to execute any one of the 8th aspect or possible implementations of the 8th aspect.
[0111] In a 15th aspect of the present application, a computer program product including instructions is provided. When the computer program product is executed on a computer or a processor, the computer or the processor is enabled to execute any one of the 9th aspect or possible implementations of the 9th aspect.
Brief Description of the Drawings
[0112]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Best Mode for Carrying Out the Invention
[0113] In the specification, claims and attached drawings of this application, terms such as "first", "second", etc. are intended to distinguish similar objects, but do not necessarily indicate a specific order or arrangement. Further, terms such as "comprising", "having", and their other variants are intended to cover non-exclusive inclusion, for example, including a series of steps or units. A method, system, product or device need not be limited to the explicitly listed steps or units, but may include steps or units that are not explicitly listed or are otherwise specific to the process, method, product or device.
[0114] In this application, it is to be understood that "at least one (item)" means one or more, and "a plurality of" means two or more. The term "and / or" is used to represent the relationship between related objects and indicates that three relationships may exist. For example, "A and / or B" may represent the case where only A exists, only B exists, or both A and B exist. Here, A and B may be singular or plural. The character " / " generally indicates an "or" relationship between related objects. "At least one item (piece)" or their similar expressions indicate any combination of these items, including a single item (piece) or a combination of multiple items (pieces). For example, at least one of a, b or c may represent a, b, c, "a and b", "a and c", "b and c", or "a, b and c". Here, a, b and c may be singular or plural.
[0115] An active noise cancellation headset uses a speaker to emit noise with the same amplitude and opposite phase as the external ambient noise, reducing the noise heard by the person wearing the headset. Currently, common headsets on the market include in-ear type, semi-in-ear type, over-ear type (also known as ear-covering type), ear-hook type, semi-open type, etc. In-ear headsets and semi-in-ear headsets with active noise cancellation functions generally have rubber covers to ensure that the headset fits well on a person's ear, thereby physically isolating ambient noise. Although a headset with a rubber cover can achieve a relatively good physical isolation effect, due to the stimulating effect of the rubber cover on the external auditory canal, the occlusion effect usually exists, which affects the comfort of the user's wearing. The form of the semi-open headset resembles that of earphones. For example, Apple's AirPods headset is an example of a semi-open headset. Semi-open headsets generally do not have rubber covers, are comfortable to wear, and are suitable for long-term wearing. However, since semi-open headsets lack rubber covers, the noise isolation effect of semi-open headsets is not as good as that of headsets with rubber covers. In a noisy environment, it may affect the user experience.
[0116] Embodiments of the present application provide a semi-open headset with an active noise cancellation (ANC) function and an ANC method. The semi-open headset equipped with the ANC function has advantages such as a comfortable wearing state, compactness, portability, and good noise resistance. It is understood that the ANC method may also be applied to in-ear headsets with rubber covers, semi-in-ear headsets with rubber covers, over-ear headsets with rubber covers, etc. This is not limited in the embodiments of the present application.
[0117] FIG. 1 is a schematic diagram of the structure of an exemplary noise canceling headset according to an embodiment of the present application. Typically, since the headset does not fit perfectly into the external auditory canal, there is an inevitable gap between the headset and the external auditory canal. External noise enters the external auditory canal through the gap. In addition, since the sizes and shapes of the external auditory canals of different users are different, the degree of fit between the same headset and the ears of different people is different, and the noise leaking into the external auditory canal when different users wear the same headset is also different. In this embodiment of the present application, when the user wears the headset, the degree to which ambient noise leaks into the user's external auditory canal is referred to as the degree of leakage. It is understood that the degree of fit between the headset and the user's external auditory canal may be reflected in the degree of leakage. The different degrees of leakage in this embodiment of the present application are caused by different degrees of fit between the headset and the external auditory canal.
[0118] The headset includes a speaker, a reference microphone, a main control unit (MCU), and a noise canceling processing circuit. For example, the noise canceling processing circuit may be an ANC circuit or an integrated ANC hardware processor core. The MCU and the noise canceling processing circuit may be integrated on one processor chip or on two independent processor chips. Optionally, the headset may further include an error microphone, a bone voiceprint sensor, and an automatic speech recognition (ASR) engine. The reference microphone is relatively far from the speaker, and the error microphone is relatively close to the speaker.
[0119] It is understood that the speaker is configured to reproduce the downlink audio signal so that the audio signal enters the user's external auditory canal. For example, the downlink audio signal may be a music signal or a voice signal. The signal collected by the reference microphone is external ambient noise, and the signal collected by the error microphone is the noise cancellation sound at a position close to the speaker. The bone voiceprint sensor is configured to acquire the user's bone voiceprint in order to identify the identity of the person wearing the headset, and the ASR engine is configured to identify the user's voice command.
[0120] When the headset includes only the reference microphone, the noise cancellation processing circuit processes the signal collected by the reference microphone to obtain the inverse-phase noise. When the headset includes the reference microphone and the error microphone, the noise cancellation processing circuit processes the signal collected by the reference microphone and the signal collected by the error microphone to generate the inverse-phase noise.
[0121] In addition, the noise cancellation processing circuit is further configured to perform audio mixing on the inverse-phase noise and the reproduced downlink audio signal to obtain a mixed audio signal. The mixed audio signal is transmitted to the speaker for playback and then enters the user's external auditory canal.
[0122] Since the mixed audio signal includes the inverse-phase noise of the ambient noise, when both the ambient noise and the mixed audio signal enter the external auditory canal, the inverse-phase noise of the mixed audio signal is used to cancel the ambient noise. In this way, the sound heard by the user is the noise-canceled sound. It is understood that the inverse-phase noise may partially or completely cancel the ambient noise.
[0123] Figure 2 is a schematic diagram of the structure of an exemplary noise cancellation headset 200 according to an embodiment of the present application.
[0124] The noise cancellation headset 200 includes a speaker 210, a reference microphone 220, a main control unit 230, a noise cancellation processing circuit 240, and a transceiver 250. The main control unit 230 and the noise cancellation processing circuit 240 may be integrated on the same chip or on two independent processor chips. The transceiver 250 may be a wireless transceiver. In the case of an option, each of the foregoing parts of the headset 200 is coupled using a connector. In the embodiments of the present application, it is understood that the coupling means an interconnection in a specific way, including an indirect connection or a direct connection using other devices. For example, each part may be connected via various interfaces, transmission lines, buses, etc. These interfaces are usually electrical communication interfaces, but it is not excluded that the interface may be a mechanical interface or another form of interface. This is not limited in this embodiment.
[0125] The transceiver 250 is configured to receive a target noise cancellation level indicator, which is set by a user in an application (APP) and transmitted to the transceiver via a wireless link. For example, the wireless link may be a Bluetooth link. The target noise cancellation level indicator is used to determine a target noise cancellation level and a target noise cancellation parameter corresponding to the target noise cancellation level, where the target noise cancellation parameter is a noise cancellation parameter that matches the degree of leakage of ambient noise into the external auditory canal. In other words, the anti-phase noise obtained after processing based on the target noise cancellation parameter can cancel the external ambient noise to the maximum extent.
[0126] In the case of options, the user can use the active noise cancellation APP on the intelligent mobile terminal to control the activation or deactivation of the active noise cancellation function, and use the APP to set the target noise cancellation level. Here, the target noise cancellation level is a noise cancellation level suitable for the degree of leakage of the user's external auditory canal. For example, the user can select a noise cancellation level index suitable for the user by adjusting the noise cancellation level adjustment module on the APP, and send the noise cancellation level index to the transceiver of the headset via the Bluetooth link so that the headset can obtain the optimal noise cancellation effect. The value of the noise cancellation level index is related to the degree of leakage.
[0127] FIG. 3 is an exemplary control interface of the application APP according to an embodiment of the present application. In the case of an option, the control interface may be considered as a user-oriented input interface or a user-oriented input module. A number of function buttons or function modules are provided in the input interface, and the user controls the headset or the noise cancellation device by controlling the relevant function buttons or function modules. The control interface includes a switch control module and a noise cancellation level adjustment disk. The switch control module includes two gears, "OFF" and "ON". Alternatively, optionally, the gear identifiers may be written in Chinese. For example, the switch control module includes two gears, "關完成" and "破開". When the switch control module is set to "OFF" or "關完成", the active noise cancellation function of the headset is disabled. When the switch control module is set to "ON" or "破開", the active noise cancellation function of the headset is enabled. Optionally, the control interface includes a text prompt used to remind the user that the optimal position point of the noise cancellation effect varies from person to person. In the optional case, the display of the multiple noise cancellation level indicators presented on the control interface of the APP are arranged non-uniformly, and the interval between the display of adjacent noise cancellation level indicators is related to the adjustment step between the noise cancellation levels. It is understood that the display of the noise cancellation level indicators is a symbol or a graphic presented on the control interface, and may be, for example, the text symbols "strong" and "weak" or Arabic numeral symbols. The display of the noise cancellation level indicators is used to identify the corresponding noise cancellation level indicator.
[0128] The noise cancellation level adjustment dial has one indicator button. The indicator button is used to identify the set target noise cancellation level indicator. The user may set the noise cancellation level indicator by rotating the position of the indicator button. When the user stops rotating, the APP records the position of the indicator button, obtains the noise cancellation level indicator value corresponding to that position, and transmits the noise cancellation level indicator value to the headset via a Bluetooth link or other wireless link. Optionally, when the APP is restarted, the indicator button remains at the position previously set by the user. Optionally, the noise cancellation level adjustment dial includes a default noise cancellation level indicator. When the APP is launched for the first time, the indicator button stays at the position corresponding to the default noise cancellation level indicator. The default noise cancellation level indicator is used to indicate the noise cancellation level of the noise cancellation headset when the noise cancellation headset is first used. The distribution of the noise cancellation level indicators on the noise cancellation level adjustment dial is non-uniform, and the interval between two adjacent noise cancellation level indicators reflects the degree of adjustment or the adjustment step between adjacent noise cancellation levels. When the user drags the button on the noise cancellation level adjustment dial, the adjustment step between the noise cancellation levels changes non-linearly. For example, the total amount of the noise cancellation level is N corresponding to the indicator values 1 to N respectively, and any indicator value M greater than 1 and less than N is selected. In this case, the interval between the indicator "M - 1" and the indicator "M" is the first interval, and the interval between the indicator "M" and the indicator "M + 1" is the second interval. Correspondingly, the adjustment step from the M - 1 level to the M level is the first step, and the adjustment step from the M level to the M + 1 level is the second step. The first interval and the second interval may be equal or different. If the first interval and the second interval are not equal, the first step and the second step are also not equal.
[0129] Optionally, the noise cancellation level adjustment dial includes preset noise cancellation level indicators. The preset noise cancellation level indicators divide the noise cancellation level adjustment dial into two regions: a first region and a second region. The noise cancellation level indicators in the first region are smaller than the preset noise cancellation level indicators, and the noise cancellation level indicators in the second region are larger than the preset noise cancellation level indicators. The interval between two adjacent noise cancellation level indicators in the first region is relatively large, and the interval between two adjacent noise cancellation level indicators in the second region is relatively small. In other words, the adjustment step from the current noise cancellation level to the next noise cancellation level in the first region is larger than the adjustment step from the current noise cancellation level to the next noise cancellation level in the second region. For example, the preset noise cancellation level indicator is a noise cancellation level indicator identified as "strong". When the noise cancellation level indicator is smaller than the noise cancellation level indicator corresponding to "strong", the interval between adjacent indicators is relatively large, and the adjustment step between noise cancellation levels is relatively large. When the noise cancellation level indicator is larger than the noise cancellation level indicator corresponding to "strong", the interval between adjacent indicators is relatively small, and the adjustment step between noise cancellation levels is relatively small. For example, the noise cancellation level adjustment dial further includes a noise cancellation level indicator identified as "weak". When the noise cancellation level indicator is between the noise cancellation level indicator corresponding to "weak" and the noise cancellation level indicator corresponding to "strong", the interval between two adjacent level indicators is relatively large, and the adjustment step between noise cancellation levels is relatively large. When the noise cancellation level indicator is larger than the noise cancellation level indicator corresponding to "strong", the interval between two adjacent level indicators is relatively small, and the adjustment step between noise cancellation levels is relatively small.
[0130] When the noise cancellation level is lower than the preset level, the adjustment steps between the noise cancellation levels are relatively large. When the noise cancellation level is higher than the preset level, the adjustment steps between the noise cancellation levels are relatively small. This improves the flexibility and accuracy of the noise cancellation level adjustment.
[0131] In the case of an option, alternatively, a bar graph may be used to implement the noise cancellation level adjustment module. FIG. 4 is another exemplary control interface of the APP according to an embodiment of the present application. The control interface includes a level switch control module and a noise cancellation level indicator adjustment bar. For the function of the noise cancellation level adjustment bar, refer to the function of the noise cancellation level adjustment disk in FIG. 3. Details will not be described again here.
[0132] The reference microphone 220 is configured to collect external ambient noise.
[0133] Based on the target noise cancellation level indicator received by the transceiver 250, the main control unit 230 is configured to select a target noise cancellation parameter corresponding to the target noise cancellation level indicator from the noise cancellation parameter library. For example, the target noise cancellation parameter is a noise cancellation filtering coefficient. The headset further includes a memory 260, and the noise cancellation parameter library is stored in the memory 260. Optionally, the memory may be an external memory of the MCU or a storage unit built into the MCU. For example, the memory may be a non-power-off volatile memory, such as an Embedded Multimedia Card (eMMC), Universal Flash Storage (UFS), Read-Only Memory (ROM), flash memory, etc. Alternatively, the memory may be another type of static memory that can store static information and instructions. The noise cancellation parameter library includes the correspondence between the noise cancellation level indicator and the noise cancellation parameter. For example, the noise cancellation level indicator corresponds one-to-one with the noise cancellation parameter. For example, the noise cancellation parameter library includes a total of 64 noise cancellation level indicators from indicator 1 to indicator 64. The noise cancellation parameters include a total of 64 groups of noise cancellation parameters from parameter 1 to parameter 64. Noise cancellation level indicator 1 corresponds to parameter 1, noise cancellation level indicator 2 corresponds to parameter 2,..., and noise cancellation level indicator 64 corresponds to parameter 64. It is understood that the noise cancellation parameter may be a group of parameters, and the group of parameters may include a plurality of filtering coefficients. Optionally, multiple different noise cancellation levels may share the same group of noise cancellation parameters. The value of the noise cancellation level indicator reflects the degree of leakage.The smaller the noise cancellation level index, the smaller the degree of leakage and the smaller the corresponding noise cancellation intensity. The larger the noise cancellation level index, the larger the degree of leakage and the larger the corresponding noise cancellation intensity. The noise cancellation parameters corresponding to the noise cancellation level index in the noise cancellation parameter library also reflect the degree of leakage. For example, the noise cancellation parameter N corresponding to the noise cancellation level index N is consistent with the degree of leakage corresponding to the noise cancellation level index N. For example, the user drags the noise cancellation level adjustment module so as to select a noise cancellation level index having the best noise cancellation effect reflecting the degree of ambient noise leakage into the headset worn by the user. Based on the noise cancellation level index selected by the user, the MCU selects the corresponding noise cancellation parameter consistent with the degree of leakage from the noise cancellation parameter library.
[0134] In this embodiment of the present application, when a large number of users wear headsets, a noise cancellation parameter library is obtained by testing the relationship between the degree of leakage and the noise cancellation parameters. The correspondence between the noise cancellation level and the noise cancellation parameters in the noise cancellation parameter library is universal and effective for most users. For example, in this embodiment of the present application, the correspondence between the noise cancellation level and the noise cancellation parameters is obtained by testing the characteristics of the secondary path characteristic curve and the noise cancellation curve of the headset worn by a large number of users. The secondary path transfer function is the transfer function from the speaker of the headset to the error microphone. In other words, the input of the secondary path is the signal of the speaker, and the output of the secondary path is the signal of the error microphone.
[0135] Optionally, the main control unit 230 is further configured to write the noise cancellation parameters to the position of the filtering coefficient corresponding to the noise cancellation processing circuit 240 to configure the filter.
[0136] The noise cancellation processing circuit 240 is configured to obtain target anti-phase noise based on a target noise cancellation parameter, and the target anti-phase noise may be used to cancel external ambient noise.
[0137] For example, the noise cancellation processing circuit 240 includes a feed-forward (FF) filter 2401. The target noise cancellation parameter includes a feed-forward filter coefficient. After obtaining the feed-forward filter coefficient from the noise cancellation parameter library, the MCU writes the filter coefficient to the position where the FF filter coefficient is stored. The FF filter 2401 performs a filtering process on the ambient noise collected by the reference microphone based on the filter coefficient to obtain anti-phase noise.
[0138] For example, the noise cancellation processing circuit 240 further includes an audio mixing processing circuit 2402, and the audio mixing processing circuit 2402 is configured to perform an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal.
[0139] The speaker 210 is configured to transmit the mixed audio signal to the user's external auditory canal.
[0140] The audio signal processed by the noise cancellation processing circuit is understood to be an electrical signal. Optionally, the headset further includes an Analog-to-Digital Converter (ADC) 270 and a Digital-to-Analog Converter (DAC) 280. The ADC 270 is configured to convert ambient noise collected by the reference microphone from an analog signal to an electrical signal. The mixed audio signal obtained after the processing performed by the noise cancellation processing circuit is an electrical signal, and the DAC 280 is configured to convert the mixed audio signal from an electrical signal to an analog mixed audio signal. The speaker 210 is configured to reproduce, in particular, the analog mixed audio signal.
[0141] Since the mixed audio signal includes anti-phase noise of the ambient noise, when the mixed audio signal and the ambient noise both enter the user's external auditory canal, the anti-phase noise can cancel the ambient noise. Further, since the user selects the noise cancellation level based on the effect of the headset, the noise cancellation parameter corresponding to the noise cancellation level is related to the degree of leakage of ambient noise into the headset worn by the user. The anti-phase noise obtained by performing processing based on the noise cancellation parameter has a better effect of canceling the ambient noise, the active noise cancellation effect of the headset is better, and the user experience is better.
[0142] FIG. 5 is a signal flow diagram of a noise cancellation method according to an embodiment of the present application. The noise cancellation method may be applied to the noise cancellation headset shown in FIG. 2.
[0143] This method includes the following steps.
[0144] S1: The transceiver receives a noise cancellation level indicator.
[0145] For example, in the control interface of a noise cancellation application APP for a smartphone, a user may set a noise cancellation level index, and the noise cancellation level index may be transmitted to a transceiver of a headset via a Bluetooth link.
[0146] S2: Based on the noise cancellation level index, from a noise cancellation parameter library, the main control unit selects a noise cancellation parameter corresponding to the noise cancellation level index.
[0147] The noise cancellation parameter library includes a plurality of groups of correspondences between noise cancellation level indices and noise cancellation parameters. The value of the noise cancellation level index reflects the degree of leakage. The noise cancellation parameter corresponding to the noise cancellation level index coincides with the degree of leakage corresponding to the noise cancellation level index. Optionally, the noise cancellation parameter library is obtained by statistical collection based on the relationship between the degree of leakage and the noise cancellation parameter. In the case of an option, a plurality of adjacent noise cancellation level indices may correspond to the same noise cancellation parameter. For example, the noise cancellation level index in the first range corresponds to the first noise cancellation parameter, and the noise cancellation level index in the second range corresponds to the second noise cancellation parameter.
[0148] S3: The main control unit writes the noise cancellation parameter at the position of the feedforward filtering coefficient in the noise cancellation processing circuit.
[0149] S4: The feedforward filter performs filtering processing on the ambient noise collected by the reference microphone to obtain anti-phase noise based on the noise cancellation parameter. Here, the anti-phase noise is the anti-phase noise of the ambient noise.
[0150] It is understood that the signal processed by the feedforward filter is an electrical signal, and the ambient noise collected by the reference microphone is an analog signal. Optionally, before the feedforward filter filters the ambient noise, the ADC converts the analog signal of the ambient noise into an electrical signal.
[0151] S5: The audio mixing processing circuit performs an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal.
[0152] The reproduced downlink audio signal is the original audio signal without noise, and the mixed audio signal includes the anti-phase noise of the ambient noise.
[0153] S6: The DAC converts the mixed audio signal from an electrical signal to an analog signal.
[0154] S7: The analog signal of the mixed audio signal is reproduced using a speaker and enters the user's external auditory canal.
[0155] Since the mixed audio signal includes the anti-phase noise of the ambient noise, when the mixed audio signal and the ambient noise enter the user's external auditory canal together, the anti-phase noise can cancel the ambient noise. Furthermore, based on the user's situation, a noise cancellation index is set by the user, and the noise cancellation parameter corresponding to the noise cancellation index matches the degree of leakage of the ambient noise into the headset worn by the user. Therefore, the effect of canceling the ambient noise using the anti-phase noise obtained based on the noise cancellation parameter is optimal for the user wearing the headset.
[0156] In the case of an option, the headset shown in FIG. 2 further has a Hear Through (HT) function. Generally, when a user wears the headset, external sound is attenuated when transmitted to the user's external auditory canal using the headset. The Hear Through function is used to compensate for the audio components attenuated by the headset, so that the user can clearly hear sounds from the external environment even when wearing the headset. The sound transmitted transparently generally refers to sounds other than noise or other useful audio signals, and it is understood that the components compensated using the Hear Through function are usually the high-frequency components of the sound.
[0157] In this case, the transceiver 250 is further configured to receive a target Hear Through level indicator, where the target Hear Through level indicator is set by the user on the APP and transmitted to the transceiver via a wireless link. The target Hear Through level indicator is used to determine a target Hear Through level and a target Hear Through parameter corresponding to the target Hear Through level. The target Hear Through parameter is a Hear Through parameter that matches the degree of leakage of ambient noise into the external auditory canal. In other words, the compensated audio signal obtained after processing based on the target Hear Through parameter can maximally compensate for the audio signal attenuated by the headset. In the case of an option, the user can use the APP on the intelligent mobile terminal to control the activation or deactivation of the Hear Through function and set the target Hear Through level using the APP. Here, the target Hear Through level is a Hear Through level suitable for the degree of leakage of the user's external auditory canal. For example, the user can select a Hear Through level indicator suitable for the user by adjusting the Hear Through level adjustment module on the APP, and send the Hear Through level indicator to the transceiver of the headset through the Bluetooth link, so that the headset can obtain an optimal Hear Through effect. The value of the Hear Through level indicator is related to the degree of leakage.
[0158] It is understood that the sound collected by the reference microphone may include useful external audio signals or may include ambient noise.
[0159] The main control unit 230 is further configured to select a target through-parameter corresponding to the target through-level from a through-parameter library based on the target through-level index. For example, the target through-parameter is a through-filtering coefficient. The memory 260 further stores a through-parameter library. Here, the through-parameter library includes the correspondence between the through-level index and the through-parameter. The value of the through-level index reflects the degree of leakage. The smaller the through-level index, the smaller the degree of leakage, indicating that the corresponding through-intensity is small. The larger the through-level index, the larger the degree of leakage, indicating that the corresponding through-intensity is large. In this embodiment of the present application, when a large number of users wear the headset, the through-parameter library is obtained by testing the relationship between the degree of leakage and the through-parameter. The correspondence between the through-level and the through-parameter in the through-parameter library is universal and effective for most users.
[0160] The main control unit 230 is further configured to write the through-parameter to the position of the feedforward filtering coefficient to configure the filter.
[0161] The feedforward filter 2401 is further configured to perform a through - processing of the external audio signal collected by the reference microphone based on the through - parameter, and obtain a compensated audio signal for the external audio signal. The compensated audio signal is used to correct the audio signal attenuated by the headset within the external audio signal. Optionally, the audio signal attenuated by the headset is usually the high - frequency component of the audio signal. In the case of an option, the headset further includes a through - filter 2403. FIG. 6 is a schematic diagram of the structure of another exemplary noise - canceling headset. The feedforward filter 2401 performs a noise - canceling process on the ambient noise based on the noise - canceling parameter in order to obtain the anti - phase noise of the ambient noise. The through - filter 2403 performs a through - processing of the external useful audio signal based on the through - parameter and obtains a compensated audio signal.
[0162] The audio mixing processing circuit 2402 is further configured to perform audio mixing on the reproduced downlink audio signal and the compensated audio signal, and obtain a second mixed audio signal.
[0163] The speaker 210 is further configured to transmit the second mixed audio signal to the user's external auditory canal.
[0164] When the external audio signal and the second mixed audio signal enter the user's external auditory canal together, the compensated audio signal of the second mixed audio signal may compensate for the audio signal attenuated by the headset of the external audio signal so that the user can still clearly hear the external sound when wearing the headset.
[0165] The headset shown in FIG. 6 in this embodiment of the present application removes a noise signal based on a noise cancellation parameter and compensates for a useful audio signal attenuated by the headset based on a hear-through parameter. When the noise is removed, the external useful audio signal is retained. In this way, the audio signal transmitted transparently to the user's external auditory canal consists only of the useful audio signal, excluding noise.
[0166] FIG. 7 is a signal flow diagram of a hear-through method according to an embodiment of the present application. The hear-through method may be applied to the headset shown in FIG. 2.
[0167] This method includes the following steps.
[0168] S1: The transceiver receives a hear-through level indicator.
[0169] For example, the user may set a hear-through level indicator in the control interface of the application APP of the smartphone and transmit it to the transceiver of the headset via a Bluetooth link.
[0170] S2: Based on the hear-through level indicator, the main control unit selects a hear-through parameter corresponding to the hear-through level indicator from a hear-through parameter library.
[0171] The hear-through parameter library includes a plurality of groups of correspondences between hear-through level indicators and hear-through level parameters. The value of the hear-through level indicator reflects the degree of leakage. The hear-through parameter corresponding to the hear-through level indicator is consistent with the degree of leakage corresponding to the hear-through level indicator. Optionally, the hear-through parameter library is obtained by collecting statistical information based on the relationship between the degree of leakage and the hear-through parameter.
[0172] S3: The main control unit writes the through - parameter at the position of the feed - forward filtering coefficient.
[0173] S4: The feed - forward filter processes the useful audio signal collected by the reference microphone based on the through - parameter to perform a through - process and obtains a compensated audio signal. Here, the compensated audio signal is used to compensate for the useful audio signal attenuated by the headset.
[0174] It is understood that the signal processed by the feed - forward filter is an electrical signal, and the useful audio signal collected by the reference microphone is an analog signal. Optionally, before the feed - forward filter filters the useful audio signal, the ADC converts the analog signal of the useful audio signal into an electrical signal.
[0175] S5: The audio mixing processing circuit performs an audio mixing process on the reproduced down - link audio signal and the compensated audio signal to obtain a second mixed audio signal.
[0176] The reproduced down - link audio signal is the original audio signal without noise, and the mixed audio signal includes the compensated audio signal of the useful audio signal.
[0177] S6: The DAC converts the second mixed audio signal from an electrical signal into an analog signal.
[0178] S7: The analog signal of the mixed audio signal is reproduced using a speaker and enters the user's external auditory canal.
[0179] When both the external audio signal and the second mixed audio signal enter the user's external auditory canal, the compensation audio signal of the second mixed audio signal may compensate for the audio signal attenuated by the headset of the external audio signal, so that the user can still clearly hear the external sound when wearing the headset. In addition to this, based on the user's situation, the hear-through index is set by the user, and the parameter corresponding to the hear-through index matches the degree to which ambient noise leaks into the headset worn by the user. Therefore, for the user wearing the headset, the effect of compensating the audio signal attenuated by the headset using the compensation audio signal obtained based on the hear-through parameter is optimal.
[0180] Figure 8 is a signal flow diagram of a noise cancellation and hear-through method according to an embodiment of the present application. This method may be applied to the headset shown in FIG. 6.
[0181] This method includes the following steps.
[0182] S1: The transceiver receives a noise cancellation level index and a hear-through level index.
[0183] For example, in the control interface of the application APP of the smartphone, the user may set a noise cancellation level index and a hear-through level index, and transmit them to the transceiver of the headset through a Bluetooth link.
[0184] S2: The main control unit selects the noise cancellation parameter corresponding to the noise cancellation level index from the noise cancellation parameter library based on the noise cancellation level index, and selects the hear-through parameter corresponding to the hear-through level index from the hear-through parameter library based on the hear-through level index.
[0185] S3: In the noise cancellation processing circuit, the main control unit writes the noise cancellation parameter to the position of the feed-forward filter coefficient and writes the through-parameter to the position of the through-filter coefficient.
[0186] S4: Based on the noise cancellation parameter, the feed-forward filter performs filtering processing on the ambient noise collected by the reference microphone to obtain anti-phase noise, where the anti-phase noise is the anti-phase noise of the ambient noise.
[0187] S5: Based on the through-parameter, the through-filter performs through-processing on the useful audio signal collected by the reference microphone to obtain a compensated audio signal. Here, the compensated audio signal is used to correct the useful audio signal attenuated by the headset.
[0188] Optionally, the method further includes S6: the ADC converts the ambient noise and the useful audio signal from an analog signal to an electrical signal.
[0189] S7: The audio mixing processing circuit performs audio mixing processing on the reproduced downlink audio signal, the anti-phase noise, and the compensated audio signal to obtain a mixed audio signal.
[0190] The reproduced downlink audio signal is the original audio signal without noise, and the mixed audio signal includes the anti-phase noise of the ambient noise and the compensated audio signal of the useful audio signal.
[0191] S8: The DAC converts the mixed audio signal from an electrical signal to an analog signal.
[0192] S9: The analog signal of the mixed audio signal is reproduced using a speaker and enters the user's external auditory canal.
[0193] The mixed audio signal includes an anti-phase noise used to cancel the ambient noise and a compensation audio signal used to compensate the useful audio signal attenuated by the headset. In this embodiment of the present application, the noise signal is removed based on the noise cancellation parameters, and the useful audio signal attenuated by the headset is compensated based on the hear-through parameters. When the noise is removed, the external useful audio signal is preserved. The audio signal that is transparently transmitted to the user's ear canal is only the useful audio signal, except for the noise. This provides the noise cancellation function and the hear-through function.
[0194] FIG. 9 is an exemplary control interface of an application according to one embodiment of the present application.
[0195] The control interface includes a switch control module and a level adjustment disk, and the control interface integrally controls the noise cancellation function and the hear-through function. The switch control module is configured to control the activation or deactivation of the noise cancellation function and the hear-through function. The switch control module includes two gears, namely "OFF" and "ON". Alternatively, optionally, the gear identifiers may be written in Chinese. For example, the switch control module includes two gears, namely "關完成" and "破開". When the switch control module is set to "OFF" or "關完成", the active noise cancellation function and the hear-through function of the headset are simultaneously disabled. When the switch control module is set to "ON" or "破開", the active noise cancellation function and the hear-through function of the headset are simultaneously enabled. The level adjustment disk has one instruction button. The instruction button is used to distinguish between the set noise cancellation level indicator and the set hear-through level indicator. The user may set the noise cancellation level indicator and the hear-through level indicator by rotating the position of the instruction button. For the features and functions of the level adjustment disc, please refer to the description of the embodiment corresponding to Fig. 3. The details will not be described again here.
[0196] Figure 10 is a control interface for another example of an application according to an embodiment of the present application. The control interface includes a noise cancellation function switch control module, a hear-through function switch control module, a noise cancellation level adjustment dial, and a hear-through level adjustment dial, and the control interface controls the noise cancellation function and the hear-through function respectively. For the features and functions of the level adjustment dial, refer to the description of the embodiment corresponding to FIG. 3. Details will not be described again here.
[0197] Optionally, the level adjustment modules of FIGS. 9 and 10 may alternatively be implemented using bar graphs respectively. This is not limited in the embodiments of the present application.
[0198] Figure 11 is a schematic diagram of the structure of an exemplary noise cancellation headset 1100 according to an embodiment of the present application.
[0199] The headset 1100 includes a transceiver 1110, a main control unit 1120, a noise cancellation processing circuit 1130, a reference microphone 1140, an error microphone 1150, and a speaker 1160. Optionally, the headset 1100 further includes a memory 1170, an ADC 1180, and a DAC 1190. The noise cancellation processing circuit 1130 includes a feed-forward filter 1131, a feed-backward (FB) filter 1133, and an audio mixing processing circuit 1132. In the case of an option, each of the foregoing parts of the headset 1100 is coupled using a connector. In the embodiments of the present application, it is understood that the coupling means an interconnection in a specific way, including an indirect connection or a direct connection using other devices. For example, each part may be connected via various interfaces, transmission lines, buses, etc. These interfaces are usually electrical communication interfaces, but it is not excluded that the interface may be a mechanical interface or another form of interface. This is not limited in this embodiment.
[0200] The main control unit 1120 is configured to determine a target noise cancellation level index based on a degree of coincidence characteristic value, and the degree of coincidence characteristic value is used to indicate the degree of coincidence between the headset and the user's external auditory canal. When the degree of coincidence is different, the degree to which ambient noise leaks into the external auditory canal of the person wearing the headset will be different.
[0201] For example, the degree of coincidence characteristic value is a ratio of the secondary path (SP) transfer function to the primary path (PP) transfer function, where PP is the transfer function from the reference microphone to the error microphone, and SP is the transfer function from the speaker to the error microphone. The input of PP is the ambient noise obtained by the reference microphone, and the output is the audio signal obtained by the error microphone. The input of SP is the mixed audio signal sent to the speaker, and the output is the audio signal obtained by the error microphone.
[0202] In this case, PP / SP is used to indicate the degree of leakage of the headset (or may also be referred to as the degree of fit between the headset and the external auditory canal), and the degree of fit may be reflected by the value of the noise cancellation level index value. Optionally, when PP / SP satisfies the preset condition, the noise cancellation level index value corresponding to the preset condition is selected. For example, when L0 ≦ PP / SP < L1, the noise cancellation level index value is 1. When L1 ≦ PP / SP < L2, the noise cancellation level index value is 2. The rest can be inferred by analogy.
[0203] In the semi-open headset, it has been experimentally found that the amplitude-frequency responses of PP and SP corresponding to the ears of different people vary in the range of 1 kHz to 3 kHz. There is no obvious rule. When the degree of fit is determined based on the amplitude-frequency response of PP or SP, the noise cancellation intensity is adjusted accordingly. This is not fully applicable to different users. In this embodiment of the present application, it is found that the amplitude-frequency response (the ratio of PP to SP) of PP / SP corresponding to the ears of different people has a relatively clear change rule in the range of 1 kHz to 3 kHz. Therefore, in this embodiment of the present application, PP / SP is used as a characteristic value for recognizing the degree of fit.
[0204] For example, the degree of coincidence characteristic value is obtained by the MCU1120. Specifically, the MCU1120 transmits a test signal to the speaker 1160 and instructs the speaker to transmit the mixed audio signal received by the speaker to the MCU. The MCU1120 acquires the audio signal obtained by the reference microphone 1140, the audio signal obtained by the error microphone 1150, and the mixed audio signal sent to the speaker 1160. In any solution, after performing sampling rate conversion (SRC) processing on the audio signal obtained by the reference microphone 1140, the audio signal obtained by the error microphone 1150, and the mixed audio signal sent to the speaker 1160, the processed audio signal is sent to the MCU1120. The SRC processing is used to reduce the sampling rate of the audio signal. When the sampling rate of the audio signal is reduced, the computing resources, interface bandwidth, storage space, etc. of the MCU are reduced. Optionally, the MCU1120 includes a digital signal processor core (DSP Core) 1121, and the DSP Core1121 acquires the SP based on the mixed audio signal sent to the speaker 1160 and the audio signal obtained by the error microphone 1150. The DSP Core1121 acquires the PP based on the audio signal obtained by the reference microphone 1140 and the audio signal obtained by the error microphone 1150. Further, the DSP Core1121 acquires the degree of coincidence characteristic value PP / SP based on the PP and the SP. Instead of this, it is understood that the DSP Core may be independent of the MCU. This is not limited in this embodiment of the present application.
[0205] In any solution, the noise cancellation processing circuit 1130 may obtain the degree of match feature value instead. For example, the noise cancellation processing circuit is an active noise cancellation processor core ANC core. In this case, the ANC core obtains SP, PP, and PP / SP.
[0206] In any solution, first, a factor L(i) is set based on different noise cancellation level index values i, PP is compared with L(i)×SP, and the value i that makes PP closest to L(i)×SP is used as the target noise cancellation level index. For example, N groups of value factors of noise cancellation level indexes from L(1) to L(N) are preset, PP is compared with L(i)×SP, where 1≦i≦N, and when PP is closest to L(j)×SP, j is determined as the target noise cancellation level index.
[0207] Furthermore, the main control unit 1120 is configured to select, from the noise cancellation parameter library, a target noise cancellation parameter corresponding to the target noise cancellation level index based on the target noise cancellation level index, and the target noise cancellation parameter corresponding to the target noise cancellation level index matches the degree of leakage.
[0208] In any solution, the main control unit 1120 may determine the target noise cancellation parameter based on the degree of match feature value. For example, the main control unit 1120 selects, from the noise cancellation parameter library based on the degree of match feature value, the noise cancellation parameter corresponding to the degree of match feature value as the target noise cancellation parameter, where the noise cancellation parameter library includes the correspondence between the degree of match feature value and the noise cancellation parameter. The noise cancellation parameter library is obtained based on the statistical results of the relationship between the degree of match feature value and the noise cancellation parameter.
[0209] For example, the target noise cancellation parameters include FF filter coefficients and FB filter coefficients. For example, the noise cancellation parameter library is stored in the memory 1170. The memory 1170 may be an external memory of the MCU or an internal storage unit of the MCU. The memory is a non-power-off volatile memory. The noise cancellation parameter library includes a plurality of groups of one-to-one corresponding noise cancellation level indicators and noise cancellation parameters. Optionally, a plurality of adjacent noise cancellation level indicators may correspond to the same noise cancellation parameter. For example, the noise cancellation level indicators in the first range correspond to the first noise cancellation parameter, and the noise cancellation level indicators in the second range correspond to the second noise cancellation parameter. Alternatively, the noise cancellation parameter library is obtained by statistical collection based on the relationship between the degree of leakage and the noise cancellation parameters.
[0210] The main control unit 1120 is further configured to write the noise cancellation parameters at the positions of the filter coefficients corresponding to the noise cancellation processing circuit 1130 to configure the filter.
[0211] Specifically, the main control unit 1120 is configured to write the FF filter coefficients at the positions of the feedforward filter coefficients in the noise cancellation processing circuit, and is configured to write the FB filter coefficients at the positions of the feedback filter coefficients in the noise cancellation processing circuit, thereby constituting the FF filter and the FB filter.
[0212] The noise cancellation processing circuit 1130 is configured to obtain target anti-phase noise based on the target noise cancellation parameters, where the target anti-phase noise may be used to cancel external ambient noise.
[0213] Specifically, the FF filter 1131 executes a filtering process on the ambient noise obtained by the reference microphone 1140 based on the FF filter coefficient to obtain the first anti-phase noise. The FB filter 1133 executes a filtering process on the noise signal of the error microphone based on the FB filter coefficient to obtain the second anti-phase noise. The first anti-phase noise and the second anti-phase noise are superimposed to obtain the target anti-phase noise.
[0214] The noise signal of the error microphone is the audio signal obtained after the reproduced downlink audio signal is removed from the audio signal obtained by the error microphone 1150. Specifically, after compensation filtering is executed on the reproduced downlink audio signal, audio mixing is performed on the audio signal obtained by the error microphone 1150 to obtain the noise signal of the error microphone. It is understood that the compensation filtering is executed on the reproduced downlink audio signal to prevent the FB filter from canceling the reproduced downlink audio signal.
[0215] The audio mixing processing circuit 1132 is configured to execute an audio mixing process on the reproduced downlink audio signal and the target anti-phase noise to obtain a mixed audio signal.
[0216] The ADC 1180 is configured to convert the ambient noise obtained by the reference microphone 1140 and the audio signal obtained by the error microphone 1150 from an analog signal to an electrical signal. Here, the mixed audio signal obtained after the processing executed by the noise cancellation processing circuit is an electrical signal. The DAC 1190 is configured to convert the mixed audio signal from an electrical signal to an analog mixed audio signal. Specifically, the speaker 1160 is configured to reproduce the analog mixed audio signal toward the user's external auditory canal.
[0217] According to the noise cancellation headset provided in the present embodiment of the present application, the degree of fit between the headset and the user's external auditory canal is adaptively determined by measuring the fit characteristic value, the degree of noise leakage generated by the headset is determined, and the noise cancellation level index and the target noise cancellation parameter are determined based on the degree of fit. The target noise cancellation parameter is adapted to the degree of fit, the noise cancellation processing circuit executes noise cancellation processing based on the noise cancellation parameter, and the headset can obtain an optimal noise cancellation effect. The noise cancellation headset may determine the degree of fit of different users and adaptively select noise cancellation parameters adapted to different users, with a good noise cancellation effect and high adaptability. Furthermore, the user does not need to set the noise cancellation level and the noise cancellation parameter, thereby improving the user experience. In addition, in this embodiment of the present application, since PP / SP is selected as the characteristic value for determining the degree of fit, determining the degree of fit based on the characteristic value is more accurate. Therefore, the determined noise cancellation intensity and the determined noise cancellation parameter are more accurate, and an optimal noise cancellation effect can be provided for different users.
[0218] FIG. 12 is a signal flow diagram of a noise cancellation method according to an embodiment of the present application. The noise cancellation method may be applied to the noise cancellation headset shown in FIG. 11.
[0219] This method includes the following steps.
[0220] S1201: The main control unit determines the fit characteristic value and determines the target noise cancellation level index based on the fit characteristic value.
[0221] The consistency characteristic value is used to indicate the degree of leakage, and it is understood that step S1201 may instead be completed by the noise cancellation processing circuit 1130. For the consistency characteristic value, refer to the description of the embodiment corresponding to FIG. 11. Details will not be described again here.
[0222] For example, determining the target noise cancellation level index based on the consistency characteristic value specifically includes the following.
[0223] When PP / SP satisfies the preset condition, the index value corresponding to the preset condition is determined as the target noise cancellation level index. For example, when L0 ≦ PP / SP < L1, the noise cancellation level index value is 1. When L1 ≦ PP / SP < L2, the noise cancellation level index value is 2. The rest can be inferred by analogy.
[0224] In any solution, the factor L(i) is first set based on different noise cancellation level index values i, PP is compared with L(i)×SP, and the value i that enables PP to be closest to L(i)×SP is the target noise cancellation level index. For example, N groups of values of the factor L(1) to L(N) of the noise cancellation level index are preset, PP is compared with L(i)×SP, where 1 ≦ i ≦ N, and when PP is closest to L(j)×SP, j is determined as the target noise cancellation level index.
[0225] S1202: Based on the target noise cancellation level index, from the noise cancellation parameter library, the main control unit selects the target noise cancellation parameter corresponding to the target noise cancellation level index. Here, the target noise cancellation parameter corresponding to the target noise cancellation level index matches the degree of leakage. For example, the noise cancellation parameter library is stored in the memory. The target noise cancellation parameter includes a feedforward filtering coefficient and a feedback filtering coefficient.
[0226] In the case of options, S1201 and S1202 may be replaced as follows. That is, based on the degree-of-match feature, from the noise cancellation parameter library, the main control unit selects the noise cancellation parameter corresponding to the degree-of-match feature value as the target noise cancellation parameter. The noise cancellation parameter library includes the correspondence between the degree-of-match feature value and the noise cancellation parameter. The noise cancellation parameter library is obtained based on the statistical results of the relationship between the degree-of-match feature value and the noise cancellation parameter.
[0227] S1203: The reference microphone acquires ambient noise, and the error microphone acquires an audio signal. The audio signal obtained by the error microphone is approximately considered as the audio signal audible to the human ear. The audio mixing process is performed on the reproduced downlink audio signal obtained after performing compensation filtering on the reproduced downlink audio signal, and is performed on the audio signal obtained by the error microphone to acquire the noise signal of the error microphone.
[0228] S1204: The main control unit writes the FF filtering coefficient to the position of the feedforward filtering coefficient of the noise cancellation processing circuit, and writes the FB filtering coefficient to the position of the feedback filtering coefficient of the noise cancellation processing circuit, thereby constituting the FF filter and the FB filter.
[0229] S1205: The FF filter performs filtering processing on the ambient noise obtained by the reference microphone based on the FF filtering coefficient to acquire the first anti-phase noise. The FB filter performs filtering processing on the noise signal of the error microphone based on the FB filtering coefficient to acquire the second anti-phase noise. The first anti-phase noise and the second anti-phase noise are superimposed to acquire the target anti-phase noise.
[0230] S1206: The audio mixing processing circuit performs audio mixing processing on the reproduced downlink audio signal and the target inverted-phase noise to obtain a mixed audio signal.
[0231] S1207: The DAC converts the mixed audio signal from an electrical signal into an analog mixed audio signal, and the analog mixed audio signal is reproduced toward the user's external auditory canal using a speaker.
[0232] According to the noise cancellation method provided in the present embodiment of the present application, the headset autonomously measures the degree of coincidence characteristic value, adaptively determines the degree of coincidence between the headset and the user's external auditory canal, and determines a noise cancellation level index and a target noise cancellation parameter based on the degree of coincidence. This method can adaptively select noise cancellation parameters that adapt to different users. In this way, the noise cancellation effect is improved and the adaptability is increased. In addition, in this embodiment of the present application, since PP / SP is selected as the characteristic value for determining the degree of coincidence, determining the degree of coincidence based on the characteristic value is more accurate. Therefore, the determined noise cancellation intensity and the determined noise cancellation parameters are also more accurate, and an optimal noise cancellation effect can be provided for different users.
[0233] For ease of understanding, it is understood that embodiments of the method are described in the form of steps within the embodiments of the present application. However, in some cases, the described steps may be performed in an order different from that described herein. In addition, it is understood that the noise cancellation method for realizing noise cancellation by the noise cancellation processing circuit in the headset shown in FIG. 11 may be any method in the prior art that realizes noise cancellation by processing an audio signal obtained from a reference microphone and an audio signal obtained from an error microphone.
[0234] In the case of an option, the headset shown in FIG. 11 may further implement a hear-through function, or the headset shown in FIG. 11 may implement both a noise cancellation function and a hear-through function. The parameters for performing the hear-through processing by the headset shown in FIG. 11 are automatically determined by the headset based on the degree of match feature value and do not need to be set by the user. For the implementation of other parts, refer to the description of the embodiments in which the headsets of FIGS. 2 and 6 implement the hear-through function. Details will not be described again here.
[0235] One embodiment of the present application further provides an active noise cancellation headset. The active noise cancellation headset includes a reference microphone, a main control unit MCU, a noise cancellation processing circuit, and a speaker. Based on the magnitude of the ambient noise or the characteristic information of the ambient noise obtained by the reference microphone, the active noise cancellation headset may automatically control the activation or deactivation of the noise cancellation function, the adjustment of the noise cancellation level of the headset, etc. For example, the active noise cancellation headset may be the headset shown in FIGS. 2, 6, and 11.
[0236] The reference microphone is set to acquire external ambient noise.
[0237] The MCU is configured to compare the ambient noise with a plurality of groups of preset noise ranges, determine the noise range to which the ambient noise belongs, and determine the corresponding noise cancellation level and the corresponding noise cancellation parameters. The plurality of groups of preset noise ranges, and the noise cancellation levels and noise cancellation parameters corresponding to the preset noise ranges may be stored in the non-power-off volatile memory of the headset.
[0238] For example, in the automatic control mode, when the ambient noise is lower than the noise cancellation function activation threshold Threshold_low, the noise cancellation function is deactivated.
[0239] When the ambient noise is in the range of [Threshold_low, Threshold_middle], the noise cancellation level of the headset is set to a weak noise cancellation level.
[0240] When the ambient noise is in the range of [Threshold_middle, Threshold_high], the noise cancellation level of the headset is set to a normal noise cancellation level.
[0241] When the ambient noise is greater than Threshold_high, the noise cancellation level of the headset is set to a deep noise cancellation level.
[0242] The weak noise cancellation level corresponds to weak noise cancellation parameters, the normal noise cancellation level corresponds to normal noise cancellation parameters, and the deep noise cancellation level corresponds to deep noise cancellation parameters.
[0243] The noise cancellation processing circuit performs noise cancellation processing on the ambient noise based on the noise cancellation parameters corresponding to the set noise cancellation level.
[0244] Figure 13 is a schematic diagram of an exemplary control interface of an APP according to an embodiment of the present application. The control interface includes an automatic mode switch control module. The user can control whether to enable the automatic control mode based on the perception of the ambient noise through the control interface. When the automatic control mode is enabled, the headset automatically controls the activation or deactivation of the active noise cancellation function and sets the noise cancellation level based on the magnitude of the ambient noise. In this case, the user's settings become invalid. Specifically, when the automatic control mode is enabled, the noise cancellation level indicator set by the user by dragging the noise cancellation level adjustment disk or adjustment bar becomes ineffective.
[0245] In the case of an option, the MCU may alternatively detect the feature information of the ambient noise acquired by the reference microphone, and automatically control the activation or deactivation of the active noise cancellation function and the setting of the noise cancellation level based on the feature information. For example, the memory stores a plurality of groups of correspondences between preset noise feature information, noise cancellation levels, and noise cancellation parameters. The MCU automatically determines the noise cancellation level and noise cancellation parameters that match the ambient noise by comparing the feature information of the ambient noise with the preset noise feature information.
[0246] For example, the preset noise feature information includes the noise features in a quiet environment, the noise features of an aircraft in flight, the noise features of a subway in motion, the noise features in a street environment, and the like.
[0247] When the feature information of the ambient noise satisfies the noise features in a quiet environment, the active noise cancellation function is deactivated.
[0248] When the feature information of the ambient noise satisfies the noise features of an aircraft in flight, the noise cancellation level of the headset is set to the aircraft mode noise cancellation level.
[0249] When the feature information of the ambient noise satisfies the noise features of a running subway, the noise cancellation level of the headset is set to the subway mode noise cancellation level.
[0250] When the feature information of the ambient noise satisfies the noise features in a street environment, the noise cancellation level of the headset is set to the street mode noise cancellation level.
[0251] Other environments are estimated by analogy and not listed in this embodiment of the present application.
[0252] In the case of options, alternatively, the user may control whether to enable the automatic control mode based on the perception of ambient noise through the control interface of the APP. When the automatic control mode is enabled, the headset automatically controls the activation or deactivation of the active noise cancellation function and the setting of the noise cancellation level based on the characteristic information of the ambient noise. In this case, the noise cancellation level indicator set by the user by dragging the noise cancellation level adjustment disk or adjustment bar will not take effect.
[0253] Figure 14 is a schematic diagram of another control interface according to an embodiment of the present application. The control interface includes an active noise cancellation function switch module, an airplane mode switch module, a subway mode switch module, a street mode switch module, and a noise cancellation level indicator adjustment module. The user may manually select different noise cancellation modes through the control interface of the APP. For example, the user may select the active noise cancellation function. In this case, by rotating the instruction button of the noise cancellation level indicator adjustment module, specific noise cancellation parameters are selected. Alternatively, "subway mode", "airplane mode", or "street mode" is manually selected. Optionally, different modes may be selected using buttons or a drop-down menu. This is not limited in this embodiment of the present application.
[0254] According to the active noise cancellation headset provided in this embodiment of the present application, the noise cancellation level and the noise cancellation parameters that match the magnitude or characteristic information of the ambient noise are autonomously determined by detecting the magnitude or characteristic information of the ambient noise. In this way, the noise cancellation effect is more flexible and the effect is better.
[0255] Embodiments of the present application further provide a headset for adjusting the Equalization (EQ) function of downlink signals. The EQ function adjusts the reproduced music signal, balances the frequency characteristics of the signal, or makes some frequency bands more prominent. Due to different degrees of consistency, the characteristics of the music heard by the human ear change accordingly. Therefore, in this embodiment of the present application, according to this principle, equalization adjustment is performed on the reproduced downlink audio signal based on the degree of consistency. The changes in audio characteristics caused by leakage are compensated by corresponding compensation, reducing the audio distortion caused by leakage and making the audio signal heard by the user approach the original audio signal.
[0256] For example, the headset shown in FIGS. 2 and 6 may have a downlink EQ function. In this case, since there is no error microphone in the headset, the noise cancellation level index is manually set by the user through the control interface of the APP and sent to the transceiver of the headset via a Bluetooth link. The main control unit is configured to select the corresponding equalization filter coefficient from the equalization parameter library based on the noise cancellation level index received by the transceiver. In this case, there is a correspondence between the noise cancellation level index and the noise cancellation parameter. Also, there is a correspondence between the noise cancellation level index and the equalization parameter. The correspondence between the noise cancellation level index and the noise cancellation parameter is stored in the noise cancellation parameter library. The correspondence between the noise cancellation level index and the equalization parameter is stored in the equalization parameter library. Both the equalization parameter library and the noise cancellation parameter library are stored in the memory, and the equalization parameter library is obtained by statistical collection based on the relationship between the degree of consistency and the equalization parameter.
[0257] The noise cancellation processing circuit further includes an equalization filter. The MCU writes the selected equalization filter coefficient to the position corresponding to the equalization filter coefficient, sets the equalization filter, and the equalization filter adjusts the EQ of the reproduced downlink audio signal based on the equalization parameter.
[0258] FIG. 15 is a signal flow diagram of a method for performing EQ adjustment on the reproduced downlink audio signal using a headset without using an error microphone.
[0259] Compared with the method shown in FIG. 5, this method adds a step of performing EQ adjustment on the reproduced downlink audio signal. Specifically, the main control unit selects the corresponding noise cancellation parameter and the corresponding equalization parameter based on the noise cancellation level index obtained by the transceiver. The MCU writes the noise cancellation parameter to the position corresponding to the feedforward filter coefficient and writes the equalization parameter to the position corresponding to the equalization filter coefficient. The feedforward filter performs filtering processing on the ambient noise based on the noise cancellation parameter to obtain the inverted-phase noise. The equalization filter performs EQ processing on the reproduced downlink audio signal based on the equalization parameter to obtain the reproduced downlink audio signal after EQ processing. The audio mixing processing circuit performs audio mixing on the inverted-phase noise and the reproduced downlink audio signal after EQ processing to obtain the mixed audio signal. The mixed audio signal is reproduced using a speaker and reaches the user's external auditory canal, and the audio signal listened to by the user undergoes both noise cancellation processing and equalization processing. For other steps, refer to the description of the corresponding embodiment in FIG. 5. Details will not be described again here.
[0260] For example, the headset shown in FIG. 11 has a downlink EQ function. In this case, the headset has an error microphone. The noise cancellation level index is obtained by the headset by measuring the degree of coincidence feature value. The MCU is configured to select a corresponding equalization parameter from the equalization parameter library based on the noise cancellation level index. There is a correspondence between the noise cancellation level index determined based on the degree of coincidence feature value and the noise cancellation parameter. There is a correspondence between the noise cancellation level index determined based on the degree of coincidence feature value and the equalization parameter. The correspondence between the noise cancellation level index and the noise cancellation parameter is stored in the noise cancellation parameter library. The correspondence between the noise cancellation level index and the equalization parameter is stored in the equalization parameter library. Both the equalization parameter library and the noise cancellation parameter library are stored in the memory.
[0261] The noise cancellation processing circuit further includes an equalization filter. The MCU writes the selected equalization filter coefficient to the position corresponding to the equalization filter coefficient, sets the equalization filter, and the equalization filter adjusts the EQ of the reproduced downlink audio signal based on the equalization parameter.
[0262] FIG. 16 is a signal flow diagram of a method for performing EQ adjustment on a reproduced downlink audio signal by a headset equipped with an error microphone.
[0263] Compared with the method shown in FIG. 12, this method adds a step of performing EQ adjustment on the reproduced downlink audio signal. Specifically, the main control unit selects a corresponding noise cancellation parameter based on the noise cancellation level index obtained by the transceiver. Further, the main control unit selects an equalization parameter from the equalization parameter library based on the noise cancellation level index. Further, the MCU writes the equalization parameter to the position corresponding to the equalization filter coefficient.
[0264] The equalization filter performs EQ processing on the reproduced downlink audio signal based on the equalization parameters and obtains the reproduced downlink audio signal after the EQ processing.
[0265] Perform audio mixing of the reproduced downlink audio signal after the EQ processing obtained after the compensation filtering process and the audio signal obtained by the error microphone to obtain the noise signal of the error microphone.
[0266] After processing the noise signal of the error microphone with the FB filter, the second anti-phase noise is obtained.
[0267] The first anti-phase noise and the second anti-phase noise are superimposed to obtain the target anti-phase noise. The method for obtaining the first anti-phase noise is the same as the method shown in FIG. 12.
[0268] After the target anti-phase noise and the reproduced downlink audio signal after the EQ processing pass through the audio mixing processing circuit, the mixed audio signal is obtained. For other steps, refer to the description of the embodiment corresponding to FIG. 12. Details will not be described again here.
[0269] The mixed audio signal is reproduced using a speaker and reaches the user's ear canal. The audio signal heard by the user undergoes both noise cancellation processing and equalization processing. This not only removes the influence of ambient noise but also compensates for the distortion of the audio caused by leakage, making the audio signal heard by the user closer to the original audio signal.
[0270] FIG. 17 is a schematic diagram of the structure of another example of the headset 1700 according to an embodiment of the present application.
[0271] The headset 1700 includes a transceiver 1710, a main control unit 1720, a noise cancellation processing circuit 1730, a reference microphone 1740, an error microphone 1750, and a speaker 1760. Optionally, the headset 1700 further includes a bone voiceprint sensor 1701, a voice recognition engine 1702, a memory 1770, an ADC 1780, and a DAC 1790. The noise cancellation processing circuit 1730 includes a feed-forward filter 1731, a feed-backward (FB) filter 1733, and an audio mixing processing circuit 1732. The main control unit 1720 further includes a DSP core 1721. In the case of options, each of the foregoing parts of the headset 1700 is coupled using a connector. It is understood that in the embodiments of this application, the coupling means an interconnection in a specific way, including an indirect connection or a direct connection using other devices. For example, each part may be connected via various interfaces, transmission lines, buses, etc. These interfaces are usually electrical communication interfaces, but it does not exclude that the interface may be a mechanical interface or another form of interface. This is not limited in this embodiment.
[0272] Compared with the headset shown in FIG. 11, a bone voiceprint sensor and an automatic speech recognition (ASR) engine 1702 are added to the headset shown in FIG. 17. For the functions of other parts, refer to the description of the corresponding embodiments in FIG. 11. Details are not described again here.
[0273] The bone voiceprint sensor 1701 is configured to acquire the user's bone voiceprint characteristics, where the bone voiceprint characteristics are used to identify the user's identity.
[0274] When the user wears the headset, the bone voiceprint is registered. For example, when the user wears the headset and emits a voice, the bone voiceprint sensor 1701 acquires the user's voice information and extracts the bone voiceprint feature based on the voice information. The bone voiceprint feature is associated with the user and stored in the memory 1770 of the headset. When the user selects a noise cancellation parameter, a hear-through parameter, or an equalization parameter, or when the headset autonomously determines a noise cancellation parameter, a hear-through parameter, or an equalization parameter based on the matching degree feature value, the main control unit 1720 associates the noise cancellation parameter, the hear-through parameter, or the equalization parameter with the user. For example, the noise cancellation parameter, the hear-through parameter, or the equalization parameter may be associated with the user's bone voiceprint. When the user wears the headset again, the headset can use the bone voiceprint feature to identify the user and automatically use the noise cancellation parameter, the hear-through parameter, or the equalization parameter associated with the user.
[0275] Specifically, after the bone voiceprint sensor 1701 acquires the user's bone voiceprint feature, the MCU 1720 determines the history parameters related to the user's bone voiceprint feature. The history parameters may include a noise cancellation parameter, a hear-through parameter, an equalization parameter, etc., and are configured to determine the history parameters as the target noise cancellation parameter, the target hear-through parameter, or the target equalization parameter.
[0276] The ASR engine 1702 is configured to recognize the user's voice commands.
[0277] The user's voice command may include control commands (including commands for enabling or disabling and for switching modes) for an active noise cancellation function, a hear-through function, or an equalization function. For example, it may include keywords such as "enable the active noise cancellation function", "disable the active noise cancellation function", "switch to airplane mode", "set the noise cancellation level index to 10". Details are not enumerated here.
[0278] After the ASR engine 1702 recognizes the user's voice command, the MCU 1720 controls the noise cancellation processing circuit 1730 to execute corresponding processing.
[0279] The user may further use the ASR engine 1702 to reset the noise cancellation parameters to achieve personalized settings according to the user. Voice-based control is more convenient and faster, and can further improve the user experience.
[0280] The headset shown in FIGS. 2 and 6 may also include a bone voiceprint sensor and an ASR engine. For the functions of the bone voiceprint sensor and the ASR engine, refer to the description of the embodiment corresponding to FIG. 17. Details are not described again here.
[0281] One embodiment of the present application further provides an active noise cancellation device 1800, as shown in FIG. 18. For example, the device may be a headset processor chip. The device includes a transceiver 1810, a main control unit 1820, a noise cancellation processing circuit 1830, a memory 1840, an ADC 1850, and a DAC 1860. For example, the noise cancellation processing circuit 1830 includes a feedforward filter 1831 and an audio mixing processing circuit 1832. Optionally, each of the foregoing parts of the device 1800 is coupled using a connector. For example, each part may be coupled via various interfaces, transmission lines, buses, etc. These interfaces are usually electrical communication interfaces, but it does not exclude the possibility that the interface may be a mechanical interface or another form of interface. This is not limited in this embodiment.
[0282] For the functions of each part of the active noise cancellation device 1800, reference shall be made to the description of the corresponding part of the headset 200. For example, for the transceiver 1810, reference shall be made to the description of the transceiver 250. For the main control unit 1820, reference shall be made to the description of the main control unit 230. Details are not enumerated here.
[0283] FIG. 19 shows another active noise cancellation device 1900 according to an embodiment of the present application. For example, the device may be a headset processor chip. The device 1900 includes a transceiver 1910, a main control unit 1920, a noise cancellation processing circuit 1930, a memory 1940, an ADC 1950, and a DAC 1960. For example, the noise cancellation processing circuit 1930 includes a feedforward filter 1931, an audio mixing processing circuit 1932, and a feedback filter 1933. The main control unit 1920 may further include a DSP core 1921. In the case of options, the above-mentioned parts of the device 1900 are coupled using connectors. For example, each part may be coupled via various interfaces, transmission lines, buses, etc. These interfaces are usually electrical communication interfaces, but it does not exclude the possibility that the interface may be a mechanical interface or another form of interface. This is not limited in this embodiment.
[0284] For the functions of each part of the active noise cancellation device 1900, reference shall be made to the description of the corresponding part of the headset 1100. For example, for the transceiver 1910, reference shall be made to the description of the transceiver 1110. For the main control unit 1920, reference shall be made to the description of the main control unit 1120. Details are not enumerated here.
[0285] In the case of an option, an embodiment of the present application further provides a noise cancellation headset control method. The method includes presenting an input interface and providing a noise cancellation level adjustment module within the input interface, where the noise cancellation level adjustment module includes instructions of a plurality of non-uniformly arranged noise cancellation level indicators, and the interval between the instructions of adjacent noise cancellation level indicators is related to the adjustment step between noise cancellation levels; receiving a switch control signal using a noise cancellation control switch, where the switch control signal is a signal set by the user to enable or disable the noise cancellation function of the noise cancellation headset; receiving a setting performed by the user for the noise cancellation level indicator using the noise cancellation level adjustment module, where the noise cancellation level indicator is used to indicate the noise cancellation level of the noise cancellation headset.
[0286] In a possible implementation, the method includes determining a noise cancellation level indicator based on the setting made by the user for the noise cancellation level indicator when the switch control signal is a signal set by the user to enable or disable the noise cancellation function of the noise cancellation headset, and determining a target noise cancellation parameter from a noise cancellation parameter library based on the noise cancellation level indicator; obtaining a target anti-phase noise based on the target noise cancellation parameter, where the target anti-phase noise is used to reduce or cancel the ambient noise obtained by a reference microphone.
[0287] In a possible implementation, the method further includes performing an audio mixing process on the reproduced downlink audio signal and the anti-phase noise to obtain a mixed audio signal, where the mixed audio signal is reproduced using a speaker.
[0288] In a possible embodiment, the method includes transmitting a switch control signal and a noise cancellation level indicator to a noise cancellation headset via a wireless link, and the noise cancellation headset enables or disables a noise cancellation function based on the switch control signal and adjusts a noise cancellation level of the headset based on the noise cancellation level indicator.
[0289] In a possible implementation, a through-control switch and a through-level adjustment module are further provided within an input interface. The method further includes receiving a second switch control signal using the through-control switch, where the second switch control signal is a signal for setting to enable or disable a through function of the noise cancellation headset by a user; and receiving a setting performed by the user for a through-level indicator using the through-level adjustment module, where the through-level indicator is used to display a through parameter of the noise cancellation headset.
[0290] In a possible implementation, an automatic mode control switch and a plurality of noise cancellation scenario mode control switches are further provided within the input interface. The method includes receiving a third switch control signal using the automatic mode control switch, where the third switch control signal is a signal for setting to enable or disable an automatic noise cancellation mode of the noise cancellation headset by a user; and receiving a signal for setting to enable or disable a noise cancellation scenario mode corresponding to any control switch using any control switch within the plurality of noise cancellation scenario control switches, and when the automatic mode control switch is turned on, the plurality of noise cancellation scenario mode control switches are not enabled.
[0291] The chip in the embodiment of this application is a system manufactured on the same semiconductor substrate using integrated circuit technology, and is also called a semiconductor chip. The chip may be a set of integrated circuits formed on a substrate (usually a semiconductor material such as silicon) using integrated circuit technology, and the outer layer of the chip is usually packaged with semiconductor package materials. The integrated circuit may include various types of functional devices. Each type of functional device includes logic gate circuits, Metal-Oxide-Semiconductor (MOS) transistors, or transistors such as bipolar transistors or diodes. Instead, it may include other components such as capacitors, resistors, or inductors. Each functional device may operate independently or may operate after being driven by the necessary driver software, and may perform various functions such as communication, operation, or storage.
[0292] One embodiment of this application further provides a computer-readable storage medium. The computer-readable storage medium stores instructions. When the instructions are executed on a computer or a processor, the computer or the processor can execute one or more steps according to any one of the foregoing methods. When the foregoing modules of the signal processing device are implemented in the form of software functional units and are sold or used as independent products, the component modules may be stored in a computer-readable storage medium.
[0293] Based on such an understanding, one embodiment of the present application further provides a computer program product including instructions. When the computer program product is executed on a computer or a processor, the computer or the processor will be able to execute any method provided in the embodiments of the present application. The technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution may be implemented in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for instructing a computer device or a processor in the computer device to execute all or part of the steps of the method in the embodiments of the present application.
[0294] The embodiments are merely intended to illustrate the technical solutions of the present application and do not limit the present application. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that without departing from the spirit and scope of the technical solutions of the embodiments of the present application, they may still modify the technical solutions described in the foregoing embodiments or perform equivalent replacements for some of their technical features. For example, for some specific operations in the device embodiments, reference may be made to the method embodiments described above.
Claims
1. A noise cancellation device comprising a main control unit (MCU) and a noise cancellation processing circuit, wherein the MCU is configured to determine a target noise cancellation parameter from a noise cancellation parameter library based on a target noise cancellation level index, the noise cancellation parameter library includes a correspondence between a noise cancellation level index and a noise cancellation parameter, the noise cancellation parameter library is obtained by statistical collection based on a relationship between a degree of match between a headset and a user's external auditory canal and a noise cancellation parameter, and the noise cancellation level index reflects a value of the degree of match, the noise cancellation processing circuit is configured to obtain a target anti-phase noise based on the target noise cancellation parameter, and the target anti-phase noise is used to reduce or cancel ambient noise acquired by a reference microphone, the noise cancellation processing circuit is further configured to perform an audio mixing process on the reproduced downlink audio signal and the target anti-phase noise to obtain a mixed audio signal, the MCU is configured to select the target noise cancellation parameter from the noise cancellation parameter library based on the target noise cancellation level index set and received by a user through an input interface, A noise cancellation device.
2. The target noise cancellation level index is related to the degree of match, and the noise cancellation level index is used to indicate the noise cancellation parameter adapted to the degree of match. The noise cancellation device according to Claim 1.
3. The noise cancellation device further comprises a reference microphone configured to acquire the ambient noise and a transceiver, the transceiver is configured to receive the target noise cancellation level index, and the target noise cancellation level index is set by the user through the input interface and transmitted to the transceiver via a wireless link. The noise cancellation device according to Claim 1 or 2.
4. The noise cancellation processing circuit has a feed-forward FF filter bank, and the target noise cancellation parameter includes FF filtering coefficients. The FF filter bank processes the ambient noise based on the FF filtering coefficients to obtain the target inverse-phase noise. The noise cancellation device according to any one of claims 1 to 3.
5. The target noise cancellation level index is further used to indicate an equalization parameter adapted to the degree of match. The MCU is further configured to select a target equalization parameter from an equalization parameter library based on the target noise cancellation level index. The noise cancellation processing circuit is further configured to adjust the equalization EQ of the reproduced downlink audio signal based on the target equalization parameter. The noise cancellation device according to any one of claims 1 to 4.
6. The equalization parameter library is obtained by statistical collection based on the relationship between the degree of match and the equalization parameter. The equalization parameter library includes a correspondence between a noise cancellation level index and an equalization parameter. The noise cancellation level index reflects the value of the degree of match, and the equalization parameter corresponding to the first noise cancellation level index is adapted to the degree of match corresponding to the first noise cancellation level index. The noise cancellation device according to claim 5.
7. A preset noise cancellation level index is set at the input interface. The interval between adjacent noise cancellation level indices in the first noise cancellation level range is larger than the interval between adjacent noise cancellation level indices in the second noise cancellation level range. The noise cancellation level indices in the first noise cancellation level range are smaller than the preset noise cancellation level index, and the noise cancellation level indices in the second noise cancellation level range are equal to or greater than the preset noise cancellation level index. The noise cancellation device according to any one of claims 1 to 6.
8. The MCU is further configured to determine a target bias-through parameter related to the degree of match. The noise cancellation processing circuit Based on the target through-parameter, perform through-processing on the audio signal acquired by the reference microphone to obtain a compensated audio signal of the useful audio signal. The audio signal acquired by the reference microphone includes the ambient noise and the useful audio signal. It is further configured to perform audio mixing processing on the reproduced downlink audio signal, the target anti-phase noise, and the compensated audio signal to obtain a mixed audio signal. The noise cancellation device according to any one of claims 1 to 7.
9. A noise cancellation device, comprising a main control unit (MCU), a noise cancellation processing circuit, and a bone voiceprint sensor. The MCU is configured to determine a target noise cancellation parameter from a noise cancellation parameter library based on a target noise cancellation level index. The noise cancellation parameter library includes the correspondence between the noise cancellation level index and the noise cancellation parameter. The noise cancellation processing circuit is configured to obtain target anti-phase noise based on the target noise cancellation parameter. The target anti-phase noise is used to reduce or cancel the ambient noise acquired by a reference microphone. The noise cancellation processing circuit is further configured to perform audio mixing processing on the reproduced downlink audio signal and the target anti-phase noise to obtain a mixed audio signal. The bone voiceprint sensor is configured to acquire the bone voiceprint feature of the user. The MCU is further configured to associate the target noise cancellation parameter determined based on the target noise cancellation level index with the bone voiceprint feature of the user. The MCU determines whether the bone voiceprint feature exists in a history parameter library. The history parameter library includes the relationship between the bone voiceprint feature and the history target noise cancellation parameter. When the bone voiceprint feature exists in the history parameter library, it is further configured to determine the history target noise cancellation parameter associated with the bone voiceprint feature as the target noise cancellation parameter. Noise cancellation device.
10. A noise cancellation device, comprising a main control unit (MCU), a noise cancellation processing circuit, and a voice recognition engine, wherein the MCU is configured to determine a target noise cancellation parameter from a noise cancellation parameter library based on a target noise cancellation level index, the noise cancellation parameter library includes a correspondence between the noise cancellation level index and the noise cancellation parameter, the noise cancellation parameter library is obtained by statistical collection based on the relationship between the degree of coincidence between the headset and the user's external auditory canal and the noise cancellation parameter, and the noise cancellation level index reflects the value of the degree of coincidence, the noise cancellation processing circuit is configured to obtain a target inverse-phase noise based on the target noise cancellation parameter, and the target inverse-phase noise is used to reduce or cancel the ambient noise acquired by a reference microphone, the noise cancellation processing circuit is further configured to perform an audio mixing process on the reproduced downlink audio signal and the target inverse-phase noise to obtain a mixed audio signal, the voice recognition engine is configured to recognize a voice command, the MCU is further configured to determine the target noise cancellation parameter based on the voice command when the voice recognition engine recognizes the voice command, the MCU is further configured to enable or disable a noise cancellation function based on the voice command when the voice recognition engine recognizes the voice command, A noise cancellation device.
11. A noise cancellation method, comprising: determining a target noise cancellation parameter from a noise cancellation parameter library based on a target noise cancellation level index, the noise cancellation parameter library includes a correspondence between the noise cancellation level index and the noise cancellation parameter, the noise cancellation parameter library is obtained by statistical collection based on the relationship between the degree of coincidence between the headset and the user's external auditory canal and the noise cancellation parameter, and the noise cancellation level index reflects the value of the degree of coincidence; A step of obtaining target inverse-phase noise based on the target noise cancellation parameter, wherein the target inverse-phase noise is used to reduce ambient noise acquired by a reference microphone, and the step; Performing an audio mixing process on the reproduced downlink audio signal and the target inverse-phase noise to obtain a mixed audio signal; The method further comprises receiving the target noise cancellation level index set by a user through an input interface; The step of determining a target noise cancellation parameter from a noise cancellation parameter library based on the target noise cancellation level index includes selecting the target noise cancellation parameter from the noise cancellation parameter library based on the received target noise cancellation level index; A noise cancellation method.
12. The target noise cancellation level index is related to the degree of consistency, and the noise cancellation level index is used to indicate the noise cancellation parameter adapted to the degree of consistency; The method according to claim 11.
13. The target noise cancellation level index is set by the user through the input interface and transmitted to a transceiver of a headset through a wireless link; The step of selecting the target noise cancellation parameter from the noise cancellation parameter library based on the received target noise cancellation level index includes selecting the target noise cancellation parameter from the noise cancellation parameter library based on the target noise cancellation level index received by the transceiver; The method according to claim 11 or 12.
14. The target noise cancellation parameter includes FF filter coefficients; The step of obtaining target inverse-phase noise based on the target noise cancellation parameter includes processing the ambient noise based on the FF filter coefficients to obtain the target inverse-phase noise; The method according to any one of claims 11 to 13.
15. The target noise cancellation level index is further used to indicate an equalization parameter adapted to the degree of consistency, and the method is; selecting a target equalization parameter from an equalization parameter library based on the target noise cancellation level indicator; further comprising adjusting an equalization EQ of the reproduced downlink audio signal based on the target equalization parameter. The method according to any one of claims 11 to 14.
16. The equalization parameter library is obtained by statistical collection based on the relationship between the degree of coincidence and the equalization parameter, the noise cancellation level indicator reflects the value of the degree of coincidence, and the equalization parameter corresponding to the first noise cancellation level indicator conforms to the degree of coincidence corresponding to the first noise cancellation level indicator. The method according to claim 15.
17. The method includes: determining a target through-parameter related to the degree of coincidence; performing a through-process on the audio signal acquired by the reference microphone based on the target through-parameter to obtain a compensated audio signal of the useful audio signal, wherein the audio signal acquired by the reference microphone includes the ambient noise and the useful audio signal; further comprising performing an audio mixing process on the reproduced downlink audio signal, the target anti-phase noise, and the compensated audio signal to obtain a mixed audio signal. The method according to any one of claims 11 to 16.
18. A noise cancellation method, comprising: determining a target noise cancellation parameter from a noise cancellation parameter library based on a target noise cancellation level indicator, wherein the noise cancellation parameter library includes a correspondence between a noise cancellation level indicator and a noise cancellation parameter; obtaining target anti-phase noise based on the target noise cancellation parameter, wherein the target anti-phase noise is used to reduce ambient noise acquired by a reference microphone; performing an audio mixing process on the reproduced downlink audio signal and the target anti-phase noise to obtain a mixed audio signal. The method includes: obtaining the bone voiceprint feature of the user; Associating the target noise cancellation parameter determined based on the target noise cancellation level index with the bone voiceprint feature of the user; Determining whether the bone voiceprint feature exists in a history parameter library, the history parameter library including an association relationship between the bone voiceprint feature and a history target noise cancellation parameter; When the bone voiceprint feature exists in the history parameter library, determining the history target noise cancellation parameter associated with the bone voiceprint feature as the target noise cancellation parameter; A noise cancellation method.
19. A noise cancellation method, comprising: Determining a target noise cancellation parameter from a noise cancellation parameter library based on a target noise cancellation level index, the noise cancellation parameter library including a correspondence between a noise cancellation level index and a noise cancellation parameter, the noise cancellation parameter library being obtained by statistical collection based on a relationship between a degree of coincidence between a headset and the user's external auditory canal and a noise cancellation parameter, the noise cancellation level index reflecting a value of the degree of coincidence; Obtaining a target inverse-phase noise based on the target noise cancellation parameter, the target inverse-phase noise being used to reduce ambient noise obtained by a reference microphone; Performing an audio mixing process on the reproduced downlink audio signal and the target inverse-phase noise to obtain a mixed audio signal. The method further comprises: When a voice recognition engine recognizes a voice command, determining the target noise cancellation parameter based on the voice command; When a voice recognition engine recognizes a voice command, enabling or disabling a noise cancellation function based on the voice command. A noise cancellation method.
20. A computer program for causing a processor to execute the method according to any one of claims 11 to 17, the method according to claim 18 or the method according to claim 19.
21. A computer-readable storage medium for storing instructions, which enables a computer or a processor to execute the method according to any one of claims 11 to 17, the method according to claim 18, or the method according to claim 19 when the instructions are executed by the computer or the processor.
Citation Information
Patent Citations
Noise-canceling headphones
JP2008124564A
Signal processing apparatus
JP2011087192A
Signal processor, signal processing method and program
JP2015173369A
Acoustic device, sound volume control method, sound volume control program, and storage medium
JP2016131404A
Configurable Noise Cancelling System
US20140079235A1