Noise cancellation method, device, electronic equipment, earphone and storage medium
Patent Information
- Application Number
- TW114102137
- Authority / Receiving Office
- TW · TW
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-10-18
- Filing Date
- 2022-11-30
- Publication Date
- 2026-10-11
- Estimated Expiration
- 2042-11-29
AI Technical Summary
Existing noise cancellation technologies, such as active noise cancellation (ANC), fail to effectively distinguish between ambient sound and human voices, leading to poor noise cancellation performance and noisy listening experiences.
A combined noise elimination method using both active noise cancellation (ANC) and environmental noise cancellation (ENC) to process sound signals, followed by mixing and adding the processed signals to enhance noise cancellation and preserve human voices.
Improves noise cancellation performance by distinguishing between ambient noise and human voices, resulting in clearer sound quality and reduced computational delays.
Smart Images

Figure TWG2TB001915312_001 
Figure TWG2TB001915312_002 
Figure TWG2TB001915312_003
Abstract
Description
Technical Field
[0001] The present invention relates to the field of audio processing technology, and in particular to a noise elimination method, device, electronic equipment, earphones and storage medium. Prior Art
[0002] In some headphone-related products, such as headphones, on-ear headphones, in-ear headphones, hearing aids, etc., the original sound signals usually contain noise, and directly transmitting the original sound signals to the user will cause interference.
[0003] In previous technologies, active noise cancellation (ANC) was typically used to remove noise from the original sound signal. However, ANC alone cannot effectively distinguish between ambient sound and human voices, resulting in poor noise cancellation performance and the user still hears noisy sounds. Summary of the Invention
[0004] The present invention provides a noise elimination method, device, electronic equipment, earphones, and storage medium, which can improve noise elimination performance and enable users to hear clearer sounds.
[0005] According to one aspect of the present invention, a noise elimination method is provided, the method comprising: obtaining original sound source information; The original sound source signal is subjected to noise reduction processing using active noise cancellation (ANC) to obtain a first sound signal; and the original sound source signal is subjected to noise reduction processing using environmental noise cancellation (ENC) to obtain a second sound signal. The first sound message and the second sound message are mixed and added to obtain a target sound message, and the target sound message is played.
[0006] According to another aspect of the present invention, there is provided a noise elimination device, the device comprising: The original sound source information acquisition module is used to obtain the original sound source information; a noise reduction processing module for performing noise reduction processing on the original sound source signal using active noise cancellation (ANC) to obtain a first sound signal; and simultaneously performing noise reduction processing on the original sound source signal using environmental noise cancellation (ENC) to obtain a second sound signal; The sound playing module is used to mix and add the first sound message and the second sound message to obtain the target sound message, and then play the target sound message.
[0007] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: at least one processor; and A memory communicatively connected to at least one processor; wherein, The memory stores a computer program that can be executed by at least one processor. The computer program is executed by the at least one processor so that the at least one processor can execute the noise elimination method of any embodiment of the present invention.
[0008] According to another aspect of the present invention, a noise-canceling headset is provided, comprising: a microphone, a noise reduction processor, and a speaker; wherein: Microphone, used to obtain original sound source information; A noise reduction processor, configured to perform noise reduction processing on the original sound source signal using the method provided by any embodiment of the present invention to obtain a target sound signal; A loudspeaker is used to play a target sound message using the method provided by any embodiment of the present invention.
[0009] According to another aspect of the present invention, a noise-canceling headset is provided, comprising: a first microphone, a second microphone, a noise reduction processor, and a speaker; wherein: A first microphone is used to obtain a first sound source message; The second microphone is used to obtain the second sound source information; a noise reduction processor, configured to perform active noise cancellation (ANC) noise reduction processing on the first sound source signal based on the second sound source signal to obtain a third sound signal; The noise reduction processor is further configured to use the first sound source signal as the original sound source signal and perform environmental noise cancellation (ENC) noise reduction processing using the method provided in any embodiment of the present invention to obtain a second sound signal; The noise reduction processor is further configured to mix and add the third sound signal with the second sound signal to obtain a target sound signal; A loudspeaker is used to play a target sound message using the method provided by any embodiment of the present invention.
[0010] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, which are used to enable a processor to implement the noise elimination method of any embodiment of the present invention when executed.
[0011] The technical means of the embodiments of the present invention solve the problem of noise cancellation by obtaining an original sound source message; performing noise reduction processing on the original sound source message using ANC to obtain a first sound message; and simultaneously performing noise reduction processing on the original sound source message using ENC to obtain a second sound message; mixing and adding the first sound message and the second sound message to obtain a target sound message, and playing the target sound message. By performing ANC and ENC noise reduction processing on the sound, it is possible to distinguish between ambient noise and human voices, improve noise cancellation performance, and enable users to hear clearer sound.
[0012] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. Simple diagram description
[0013] In order to more clearly illustrate the technical means in the embodiments of the present invention, the following will briefly introduce the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those with ordinary knowledge in the relevant technical field, other drawings can be obtained based on these drawings without any creative work. [ FIG. 1 a ] is a flow chart of a noise elimination method provided according to the first embodiment of the present invention. [Figure 1b] is a flow chart of another noise elimination method provided according to the first embodiment of the present invention. [Figure 2a] is a flow chart of a noise elimination method provided according to the second embodiment of the present invention. [ FIG. 2 b ] is a flow chart of another noise elimination method provided according to the second embodiment of the present invention. [Figure 2c] is a schematic diagram of an application scenario of a noise elimination method provided according to the second embodiment of the present invention. FIG3 is a schematic structural diagram of a noise elimination device provided according to a third embodiment of the present invention. FIG4 is a schematic structural diagram of a noise-canceling headset according to a fourth embodiment of the present invention. FIG5 is a schematic structural diagram of a noise-canceling headset according to a fifth embodiment of the present invention. FIG6 is a schematic diagram of the structure of an electronic device for implementing the noise elimination method according to an embodiment of the present invention. Implementation Method
[0014] To help those skilled in the art better understand the present invention, the following provides a clear and complete description of the technical means in the embodiments of the present invention, in conjunction with the accompanying drawings. Obviously, the described embodiments represent only a portion of the present invention, not all of it. All other embodiments derived from the embodiments of the present invention by those skilled in the art without inventive effort should fall within the scope of protection of the present invention.
[0015] It should be noted that the terms "first," "second," "original," "target," and the like in the present description, patent claims, and drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, such that the embodiments of the present invention described herein can be implemented in an order other than that illustrated or described herein. Furthermore, the terms "including," "comprising," and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, product, or apparatus. [Example 1]
[0016] Figure 1a is a flow chart of a noise cancellation method according to a first embodiment of the present invention. This embodiment is applicable to noise cancellation in headphone-related products. The method can be performed by a noise cancellation device, which can be implemented in hardware and / or software and can be configured in electronic devices such as headphones, computers, and mobile phones. As shown in Figure 1a, the method includes: Step 110: Obtain original sound source information.
[0017] The original sound source information may include environmental noise and human voice. Specifically, the original sound source information may be generated by collecting the sounds in the environment through a microphone.
[0018] Specifically, in an optional implementation of an embodiment of the present invention, obtaining the original sound source information includes: obtaining the sound signal of the original sound source through a microphone, and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter, and using the digital signal of the original sound source as the original sound source information.
[0019] The original sound source contains a mixture of human voice and noise, which can be simultaneously captured by a microphone (such as an FF MIC). The microphone converts the sound signal into an electrical signal. This electrical signal is converted into a digital signal through an analog-to-digital converter (ADC). The digital signal is then distributed to both ANC and environmental noise cancellation (ENC) for processing, facilitating noise reduction.
[0020] Step 120: Perform noise reduction processing on the original sound source signal using ANC to obtain a first sound signal; and simultaneously perform noise reduction processing on the original sound source signal using ENC to obtain a second sound signal.
[0021] ANC can achieve noise reduction by performing digital signal processing (DSP) on the original sound source signal to generate anti-noise of equal magnitude and opposite phase to the original noise. However, previous ANC technologies do not distinguish between ambient noise and human voices, eliminating both, resulting in poor sound quality for the user.
[0022] ENC utilizes the ENC chip to process the original sound source information, distinguishing between human voices and ambient noise, retaining only the human voice and eliminating the ambient noise. However, using ENC alone for DSP processing to achieve noise reduction requires a long computation time, such as 30-50 milliseconds. Due to the ENC computational delay, users may perceive two sounds: the original source and the delayed sound. This results in a poor user experience.
[0023] In an embodiment of the present invention, the original sound source signal is processed using both ANC and ENC for noise reduction. This reduces the processing time of ENC on top of the ANC noise reduction. This avoids the problem of using ANC alone, which causes the ambient noise and human voice to be unable to be separated and eliminated together. It also avoids the problem of using ENC alone for noise reduction, which fails to achieve effective ambient noise elimination. Furthermore, when the user is using the device at the near end, this avoids the problem of external noise penetrating into the user's ears due to the long ENC processing time, causing the user to perceive two sounds. In summary, by simultaneously processing the original sound source signal using ANC and ENC, the signal processing is clearer while preserving the integrity of the human voice, allowing the user to hear the external human voice more clearly.
[0024] Step 130: Mix and add the first sound message and the second sound message to obtain a target sound message, and play the target sound message.
[0025] Among them, the method of the embodiment of the present invention can mix the sound information obtained by ANC and ENC processing to obtain a complete and clean human voice, improve the problem of noisy listening in the transparency mode of headphones, hearing aids or hearing aids in the previous technology, enhance the ambient sound noise reduction effect and enhance the human voice, so that the user can hear the external human voice more clearly.
[0026] Specifically, in an optional implementation of an embodiment of the present invention, mixing and adding the first sound message and the second sound message to obtain a target sound message includes: converting the mixed and added sound messages into a target electrical signal through a digital-to-analog converter, and converting the target electrical signal into a target sound signal through a speaker to obtain the target sound message.
[0027] The digital-to-analog converter (DAC) converts the mixed and summed ANC and ENC signals into electrical signals. The resulting electrical signals are then transmitted to the speakers, which convert them into audio signals for playback.
[0028] The technical means of this embodiment solves the noise cancellation problem by obtaining an original sound source message; performing noise reduction processing on the original sound source message using active noise cancellation (ANC) to obtain a first sound message; and simultaneously performing noise reduction processing on the original sound source message using environmental noise cancellation (ENC) to obtain a second sound message; mixing and adding the first sound message and the second sound message to obtain a target sound message, and playing the target sound message. By performing ANC and ENC noise reduction processing on the sound, it is possible to distinguish between environmental noise and human voices, improve noise cancellation performance, and enable the user to hear clearer sound.
[0029] Figure 1b is a flowchart of another noise cancellation method provided according to the first embodiment of the present invention. As shown in Figure 1b, the microphone can pick up external signals. Since human voices cannot be distinguished from ambient noise, if the user directly listens to these external signals, they will sound noisy. The technical means of this embodiment of the present invention can combine the respective characteristics of ANC and ENC to process voice signals. ANC can reduce low-frequency signal noise, while ENC can independently process the voice band of the human voice, preserving the human voice and reducing computation time. Specifically, ANC achieves noise cancellation through anti-phase waves, while ENC removes both the human voice and ambient noise. The signals processed by ANC and ENC can then be mixed and played through a speaker. This improves the noisy sound quality of traditional headphone products in transparent mode, enhances ambient noise cancellation, and enhances the human voice, allowing the user to hear external voices more clearly. When using transparent mode, the shortened ENC computation time also prevents the user from perceiving two voices. [Example 2]
[0030] Figure 2a is a flow chart of a noise elimination method according to Embodiment 2 of the present invention. This embodiment further refines the aforementioned technical approach and can be combined with various optional solutions in one or more of the aforementioned embodiments. As shown in Figure 2a, the method includes: Step 210: Obtain original sound source information.
[0031] In an optional implementation of an embodiment of the present invention, obtaining original sound source information includes: obtaining an acoustic signal of the original sound source through a microphone and converting the acoustic signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter, and using the digital signal of the original sound source as the original sound source information.
[0032] Step 220: The original sound source signal is passed through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal.
[0033] In an optional implementation of an embodiment of the present invention, before the original sound source signal is passed through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal, the method further includes: low-pass filtering the original sound source signal to obtain the original sound source signal in the first target frequency band.
[0034] The low-pass filter can filter the original sound source signal to select the first target frequency band with the best ANC noise reduction effect. Specifically, due to the physical delay between the sound wavelength and the anti-phase wave during the ANC processing, high frequencies with poor noise reduction effects can be filtered out, thus avoiding the adverse effect of high-frequency inversion during ANC processing. In other words, the first target frequency band can be a low-frequency band. Specifically, based on specific research, the first target frequency band can be set to a range from 20 Hz to 4 kHz.
[0035] Although the faster the ANC DSP processing speed is in the frequency band above 1 kHz, the higher the frequency that can be processed by noise reduction; however, considering the need to avoid the effect of high-frequency inversion, that is, to prevent the original noise reduction from increasing noise, the embodiment of the present invention uses a low-pass filter to only process the original sound source information from 20 Hz to 4 kHz through ANC, thereby preventing high-frequency noise from affecting the noise reduction quality.
[0036] Specifically, in an optional implementation of an embodiment of the present invention, the original sound source message is low-pass filtered to obtain the original sound source message of the first target frequency band, including: low-pass filtering the original sound source message through a biquad filter to obtain the original sound source message of the first target frequency band.
[0037] Among them, the biquad filter is a filter whose numerator and denominator of the transfer function are both second-order polynomials. Using a biquad filter can avoid the filter being sensitive to coefficients and can achieve better filtering effects when used alone.
[0038] After low-pass filtering the original sound source signal to obtain the original sound source signal in the first target frequency band, the filtered original sound source signal can be subjected to phase inversion processing through a phase inverter to obtain an anti-phase wave signal. Furthermore, the anti-phase wave signal can be used to cancel the noise of the original sound source signal to obtain the first sound signal, achieving low-frequency noise reduction.
[0039] Step 230: Perform noise cancellation on the original sound source signal according to the anti-phase wave signal to obtain a first sound signal.
[0040] In an optional implementation of an embodiment of the present invention, noise cancellation is performed on an original sound source signal based on an inverted wave signal to obtain a first sound signal, including: adjusting the volume of the inverted wave signal through gain adjustment to obtain a target inverted wave signal having the same level of noise as the original sound source signal; and performing noise cancellation on the original sound source signal based on the target inverted wave signal to obtain the first sound signal.
[0041] After obtaining the inverted wave signal, the gain can be used to adjust its volume, bringing it to a target inverted wave signal that matches the current residual noise level in the ear. This target inverted wave signal can directly cancel out the original sound source, achieving a low-frequency noise reduction effect.
[0042] Step 240: Separate the human voice from the ambient noise using a software noise reduction algorithm on the original sound source signal, and retain the human voice signal.
[0043] The software noise reduction (NR) algorithm can be a calculation that preserves the human voice while removing noise. However, based on the original sound source signal in the embodiments of the present invention, the residual noise can be reduced through ANC processing. The NR operation can be appropriately weakened, thereby increasing the operation speed by reducing the amount of calculation. Furthermore, filtering can be performed before NR to further reduce residual noise, thereby further reducing the intensity of the NR operation and noise processing delay, thereby preventing the user from perceiving two voices. For example, by controlling the NR operation to complete within 0 to 30 milliseconds, the user can avoid perceiving two voices.
[0044] Specifically, in an optional implementation of an embodiment of the present invention, before separating the human voice from the ambient noise through a software noise reduction algorithm and retaining the human voice signal, the method further includes: bandpass filtering the original sound source signal to obtain the original sound source signal in the second target frequency band.
[0045] Band-pass filtering can be performed by filtering the original sound source signal and selecting a second target frequency band corresponding to the human voice audio segment for ENC noise reduction. This filtering of the original sound source signal can reduce ENC processing latency, thereby reducing the computational complexity of NR. Specifically, based on specific research, the second target frequency band can be set to a frequency range of 100 Hz to 8 kHz. By selecting the original sound source signal in this second target frequency band for processing, the difficulty of ENC adaptation and the processing time can be reduced. Furthermore, by not processing frequency bands outside the 100 Hz to 8 kHz range, non-speech noise can be prevented from affecting speech quality.
[0046] Specifically, in an optional implementation of an embodiment of the present invention, the original sound source message is bandpass filtered to obtain the original sound source message of the second target frequency band, including: bandpass filtering the original sound source message through a biquad filter to obtain the original sound source message of the second target frequency band.
[0047] Among them, the biquad filter is a filter whose numerator and denominator of the transfer function are both second-order polynomials. The use of biquad filters can avoid the filter being sensitive to the coefficients and can be used alone to achieve better filtering effects.
[0048] After bandpass filtering is performed on the original sound source signal to obtain the original sound source signal of the second target frequency band, the filtered original sound source signal can be processed by NR to obtain the human voice signal.
[0049] Step 250: Enhance the human voice signal to obtain a second voice message.
[0050] Enhancement processing of a human voice signal can be performed to enable the user to clearly hear a clean voice signal. Enhancement processing can include various processes. Specifically, in an optional implementation of an embodiment of the present invention, enhancing the human voice signal to obtain a second sound message includes: performing audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain the second sound message.
[0051] Among them, audio enhancement processing can be to dynamically adjust the amplitude of the human voice signal to make the sound softer. Volume enhancement processing can be to amplify the volume dimension of the human voice signal to make the sound signal louder.
[0052] Specifically, in an optional implementation of an embodiment of the present invention, performing audio enhancement and / or volume enhancement on a human voice signal includes: performing audio enhancement on the human voice signal by dynamically adjusting the audio output amplitude in multiple frequency bands. Specifically, multi-band dynamic adjustment of the audio output amplitude (multiband DRC) is used to enhance quiet audio and suppress transiently excessively loud signals, thereby enhancing signal clarity.
[0053] Furthermore, in an optional embodiment of the present invention, performing audio enhancement and / or volume enhancement on a vocal signal includes enhancing the vocal signal's volume through gain adjustment. Properly adjusting the vocal signal's volume through gain can make the user hear the speech more comfortably and clearly.
[0054] Step 260: Mix and add the first sound message and the second sound message to obtain a target sound message, and play the target sound message.
[0055] In an optional implementation of the embodiment of the present invention, mixing and adding the first sound message and the second sound message to obtain a target sound message includes: converting the mixed and added sound messages into a target electrical signal via a digital-to-analog converter, and converting the target electrical signal into a target sound signal via a speaker to obtain the target sound message.
[0056] The technical means of the embodiment of the present invention obtains the original sound source information; performs noise phase inversion processing on the original sound source information through a phase inverter to obtain an inverted wave signal; performs noise cancellation on the original sound source information based on the inverted wave signal to obtain a first sound message; separates the human voice from the environmental noise through a software noise reduction algorithm on the original sound source information, while retaining the human voice signal; enhances the human voice signal to obtain a second sound message; mixes and adds the first sound message and the second sound message to obtain a target sound message, and plays the target sound message, thereby solving the problem of noise cancellation. By performing ANC and ENC noise reduction processing on the sound, it is possible to distinguish between environmental noise and human voice, improve noise cancellation performance, and reduce the delay of NR processing, so that users can hear clearer sound and enhance the user experience.
[0057] Figure 2b is a flow chart of another noise cancellation method provided according to the second embodiment of the present invention. As shown in Figure 2b, the microphone can pick up sounds in the environment, including ambient noise and human voices. The microphone can convert the sounds in the environment from acoustic signals into electrical signals. The electrical signals can be converted into digital signals via an ADC. The digital signals can be distributed to the ANC and ENC for separate processing.
[0058] As shown in Figure 2b, in the ANC system, the original sound source signal undergoes a Biquad filter. A low-pass filter selects the frequency band with the best noise cancellation performance, namely, 20 Hz to 4 kHz, for ANC adjustment. Signals above 1 kHz are filtered out and not processed to prevent high-frequency noise from affecting noise cancellation quality. After the Biquad filter, a phase inverter is applied to generate an inverted signal. The gain control adjusts the volume of the inverted signal to match the level of residual noise in the ear. The DAC then converts the digital signal into an electrical signal and transmits it to the speaker (spearker). This signal, converted into an acoustic signal, cancels out the residual noise, achieving the desired noise cancellation effect.
[0059] As shown in Figure 2b, in the ENC process, the original sound source signal undergoes Biquad filtering. A band-pass filter selects the speech signal between 100 Hz and 8 kHz for ENC adaptation, filtering out signals in other frequency bands to prevent non-speech noise from affecting speech quality. Following the Biquad filter, NR noise cancellation can be performed to preserve the human voice while removing noise. Because the Biquad filter removes some noise before the NR process, and this embodiment of the present invention can be combined with ANC noise reduction, the residual noise is minimal. Therefore, NR processing can be completed within 0 to 30 milliseconds, avoiding excessive delays that can cause the user to perceive two sounds. Multiband DRC can then be used to enhance quiet audio and suppress transient loud signals, enhancing voice clarity. The retained voice volume can then be appropriately adjusted using Gain.
[0060] Finally, as shown in Figure 2b, the processing results of the ANC and ENC parts can be mixed and added, and the DAC then converts the digital signal into an electrical signal and transmits it to the speaker for broadcast, achieving a high-definition transparency mode with clear vocals and noise elimination.
[0061] Figure 2c is a schematic diagram of an application scenario for a noise cancellation method provided according to a second embodiment of the present invention. As shown in Figure 2c, the noise cancellation method provided by this embodiment of the present invention can be applied when a user is answering a call. Specifically, the sound processed by ENC can be used as a normal call. When the user needs to speak, the boom microphone or boomless microphone responsible for receiving the sound can use ENC to cancel ambient noise. The caller on the other end will not hear the noise around the user, providing better call quality.
[0062] The acquisition, storage, and application of original sound source information involved in the technical means of the embodiments of the present invention comply with the provisions of relevant laws and regulations and do not violate public order and good morals. [Example 3]
[0063] FIG3 is a schematic diagram of the structure of a noise cancellation device according to a third embodiment of the present invention. As shown in FIG3 , the device includes: an original sound source information acquisition module 310, a noise reduction processing module 320, and a sound playback module 330. Among them: Original sound source information acquisition module 310, for obtaining the original sound source information; Noise reduction processing module 320, for performing noise reduction processing on the original sound source signal using active noise cancellation (ANC) to obtain a first sound signal; and simultaneously performing noise reduction processing on the original sound source signal using environmental noise cancellation (ENC) to obtain a second sound signal; The sound playing module 330 is used to mix and add the first sound message and the second sound message to obtain a target sound message, and then play the target sound message.
[0064] Optionally, the noise reduction processing module 320 includes: The anti-phase wave signal determination unit is used to process the original sound source information through the phase inverter to perform noise phase inversion processing to obtain an anti-phase wave signal; The first sound message determination unit is used to perform noise cancellation on the original sound source message according to the anti-phase wave signal to obtain the first sound message.
[0065] Optionally, the first sound message determination unit includes: a target inverse phase wave signal determination subunit, configured to adjust the volume of the inverse phase wave signal by gain adjustment to obtain a target inverse phase wave signal having the same magnitude as the noise in the original sound source message; The first sound message determination subunit is used to perform noise cancellation on the original sound source message according to the target inverse phase wave signal to obtain the first sound message.
[0066] Optionally, the device further includes: The original sound source signal filtering module is used to perform low-pass filtering on the original sound source signal to obtain the original sound source signal of the first target frequency band before passing the original sound source signal through the phase inverter to perform noise phase inversion processing to obtain the inverted wave signal.
[0067] Optional, original sound source information filtering module, including: The original sound source signal filtering unit is used to perform low-pass filtering on the original sound source signal through a biquad filter to obtain the original sound source signal in the first target frequency band.
[0068] Optionally, the first target frequency band includes: a frequency band consisting of 20 Hz to 4 kHz.
[0069] Optionally, the noise reduction processing module 320 includes: The human voice signal determination unit is used to separate the human voice from the ambient noise through the software noise reduction algorithm, while retaining the human voice signal; The second voice message determination unit is used to enhance the human voice signal to obtain the second voice message.
[0070] Optionally, the device further includes: Another original sound source signal filtering module is used to perform bandpass filtering on the original sound source signal to obtain the original sound source signal in the second target frequency band before separating the human voice from the ambient noise through the software noise reduction algorithm and retaining the human voice signal.
[0071] Optional, another original sound source information filtering module, including: Another original sound source signal filtering unit is used to perform bandpass filtering on the original sound source signal through a biquad filter to obtain the original sound source signal in the second target frequency band.
[0072] Optionally, the second target frequency band includes: a frequency band consisting of 100 Hz to 8 kHz.
[0073] Optionally, the second sound message determination unit includes: The second sound message determination subunit is used to perform audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain the second sound message.
[0074] Optionally, the second voice message determination subunit is specifically configured to: The audio output amplitude is dynamically adjusted in multiple frequency bands to enhance the human voice signal.
[0075] Optionally, the second voice message determination subunit is further specifically configured to: Enhance the volume of vocal signals by adjusting the gain.
[0076] Optionally, the original sound source information acquisition module 310 includes: The electric signal conversion unit is used to obtain the sound signal of the original sound source through the microphone and convert the sound signal of the original sound source into the electric signal of the original sound source; The digital signal conversion unit is used to convert the electrical signal of the original sound source into the digital signal of the original sound source through an analog-to-digital converter, and use the digital signal of the original sound source as the original sound source information.
[0077] Optionally, the sound playback module 330 includes: The target sound message determination unit is used to convert the mixed and added sound messages into target electrical signals through an analog-to-digital converter, and convert the target electrical signals into target sound signals through a loudspeaker to obtain the target sound message.
[0078] The noise elimination device provided in the embodiment of the present invention can execute the noise elimination method provided in any embodiment of the present invention, and has functional modules and functions corresponding to the execution method. [Example 4]
[0079] FIG4 is a schematic diagram of the structure of a noise-canceling headset provided according to a fourth embodiment of the present invention. As shown in FIG4 , the noise-canceling headset includes: a microphone, a noise reduction processor, and a speaker; wherein: the microphone is used to obtain the original sound source information; A noise reduction processor for performing noise reduction processing on the original sound source signal using the noise reduction method provided by any embodiment of the present invention to obtain a target sound signal; A loudspeaker is used to play a target sound message using the noise elimination method provided by any embodiment of the present invention.
[0080] Among them, the noise reduction processor can eliminate noise through ANC and ENC, allowing users to hear clear human voices.
[0081] The noise-canceling earphones provided in the embodiments of the present invention can improve the problem of noisy listening in the transparency mode of traditional earphones, hearing aids, or hearing aids, and can enhance the noise cancellation effect of ambient noise and enhance the human voice, thereby allowing users to hear external human voices more clearly. [Example 5]
[0082] Figure 5 is a schematic diagram of the structure of a noise-canceling headset provided according to a fifth embodiment of the present invention. As shown in Figure 5, the noise-canceling headset includes: a first microphone, a second microphone, a noise reduction processor, and a speaker; wherein: the first microphone is used to obtain a first sound source signal; The second microphone is used to obtain the second sound source information; a noise reduction processor, configured to perform active noise cancellation (ANC) noise reduction processing on the first sound source signal based on the second sound source signal to obtain a third sound signal; The noise reduction processor is further configured to use the first sound source signal as the original sound source signal and perform ENC noise reduction processing using the noise cancellation method provided in any embodiment of the present invention to obtain a second sound signal; The noise reduction processor is further configured to mix and add the third sound signal with the second sound signal to obtain a target sound signal; A loudspeaker is used to play a target sound message using the noise elimination method provided by any embodiment of the present invention.
[0083] The first microphone may be an FB microphone, and the second microphone may be an FF microphone. The FB microphone can enhance the ANC noise cancellation effect, while the original FF microphone is primarily used to collect noise and voice. The third sound signal may be the signal generated by the FB microphone enhancing the ANC noise cancellation effect, and may be the result of optimizing the first sound signal.
[0084] In other words, the noise cancellation method provided in the embodiment of the present invention can be applied to hybrid headphones (Hybrid ANC) to improve the Hybrid ANC and enhance the noise reduction effect of the Hybrid ANC, allowing users to hear clearer sounds without affecting the computing speed and causing the user to perceive two sounds. [Example 6]
[0085] FIG6 illustrates a schematic diagram of an electronic device 10 that can be used to implement an embodiment of the present invention. The term "electronic device" is intended to represent various forms of digital computers, such as laptops, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The term "electronic device" may also represent various forms of mobile devices, such as personal digital assistants, mobile phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components, their connections and relationships, and their functions shown in this specification are merely examples and are not intended to limit the implementation of the present invention described and / or claimed in this specification.
[0086] As shown in Figure 6, electronic device 10 includes at least one processor 11 and memory, such as read-only memory (ROM) 12 and random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. Processor 11 can perform various appropriate actions and processes based on the computer programs stored in ROM 12 or loaded from memory unit 18 into RAM 13. RAM 13 can also store various programs and data required for the operation of electronic device 10. Processor 11, ROM 12, and RAM 13 are interconnected via bus 14. An input / output (I / O) interface 15 is also connected to bus 14.
[0087] Multiple components within electronic device 10 are connected to I / O interface 15, including an input unit 16, such as a keyboard and mouse; an output unit 17, such as various types of displays and speakers; a memory unit 18, such as a hard drive and optical disk; and a communication unit 19, such as a network card, modem, or wireless communication transceiver. Communication unit 19 allows electronic device 10 to exchange information / data with other devices via a computer network, such as the Internet, and / or various telecommunications networks.
[0088] Processor 11 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, microcontroller, etc. Processor 11 executes the various methods and processes described above, such as the noise cancellation method.
[0089] In some embodiments, the noise cancellation method can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as memory unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the noise cancellation method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the noise cancellation method via any other suitable means (e.g., via firmware).
[0090] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable logic controller (PLC), which can be a special-purpose or general-purpose PLC that can receive data and instructions from a memory system, at least one input device, and at least one output device, and transmit data and instructions to the memory system, the at least one input device, and the at least one output device.
[0091] Computer programs for implementing the methods of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.
[0092] In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. Computer-readable storage media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media would include electrical connections based on one or more wires, a portable computer hard drive, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0093] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0094] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.
[0095] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communications network. The client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server can be a cloud server, also known as cloud computing or cloud hosting. This server is a hosting product within a cloud computing server system that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.
[0096] It should be understood that the various forms of the processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical means of the present invention can be achieved. This specification does not limit this.
[0097] The above specific embodiments do not limit the scope of protection of this invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions are possible based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention are intended to be within the scope of protection of this invention.
[0098] 110,120,130: Steps 210, 220, 230, 240, 250, 260: Steps 310: Original sound source information acquisition module 320: Noise reduction processing module 330: Sound playback module 10: Electronic devices 11: Processor 12: Read-only memory 13: Random Access Memory 14: Bus 15: Input / output interface 16: Input unit 17: Output unit 18: Memory Unit 19: Communication unit
Claims
1. A noise cancellation method, characterized by comprising: Obtain the original sound source information; The original sound source information is processed by active noise cancellation (ANC) to reduce noise and obtain the first sound information. Simultaneously, the original sound source message is subjected to environmental noise cancellation (ENC) for noise reduction to obtain a second sound message; the original sound source message is subjected to ANC for noise reduction to obtain a first sound message, including: passing the original sound source message through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal; performing noise cancellation on the original sound source message based on the inverted wave signal to obtain a first sound message; mixing and adding the first sound message and the second sound message to obtain a target sound message, and playing the target sound message; wherein, before passing the original sound source message through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal, the method further includes: performing low-pass filtering on the original sound source message to obtain the original sound source message of the first target frequency band; wherein, performing low-pass filtering on the original sound source message to obtain the original sound source message of the first target frequency band includes: performing low-pass filtering on the original sound source message through a double second-order filter to obtain the original sound source message of the first target frequency band.
2. The method as described in claim 1, wherein, Based on the inverted wave signal, noise cancellation is performed on the original sound source message to obtain a first sound message, including: adjusting the volume of the inverted wave signal by gain adjustment to obtain a target inverted wave signal with the same noise level as the original sound source message; and performing noise cancellation on the original sound source message based on the target inverted wave signal to obtain the first sound message.
3. The method as described in claim 1, wherein, The first target frequency band includes the frequency band consisting of 20 Hz to 4 kHz.
4. The method as described in claim 1, wherein, The original sound source message is denoised using ENC to obtain a second sound message, including: separating human voice from environmental noise using a software denoising algorithm while preserving the human voice signal; and enhancing the human voice signal to obtain the second sound message.
5. The method as described in claim 4, wherein, Before separating human voice from environmental noise using a software noise reduction algorithm and preserving the human voice signal, the process also includes: performing bandpass filtering on the original sound source information to obtain the original sound source information for the second target frequency band.
6. The method as described in claim 5, wherein, The original sound source information is bandpass filtered to obtain the original sound source information of the second target frequency band, including: bandpass filtering the original sound source information through a double second-order filter to obtain the original sound source information of the second target frequency band.
7. The method as described in claim 5, wherein, The second target frequency band includes the band consisting of 100 Hz to 8 kHz.
8. The method as described in claim 4, wherein, The original sound source information is separated from the ambient noise within 0 to 30 milliseconds using a software noise reduction algorithm, while preserving the human voice signal.
9. The method as described in claim 4, wherein, The voice signal is enhanced to obtain a second sound message, including: audio enhancement processing and / or volume enhancement processing of the voice signal to obtain a second sound message.
10. The method as described in claim 9, wherein, Perform audio enhancement processing and / or volume enhancement processing on the human voice signal, including: performing audio enhancement processing on the human voice signal by dynamically adjusting the audio output amplitude through multiple frequency bands.
11. The method as described in claim 9, wherein, Perform audio enhancement processing and / or volume enhancement processing on the human voice signal, including: enhancing the volume of the human voice signal through gain adjustment.
12. The method as described in claim 1, wherein, Acquiring original sound source information includes: acquiring the sound signal of the original sound source through a microphone and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter and using the digital signal of the original sound source as the original sound source information.
13. The method as described in claim 10, wherein, The process of mixing and adding the first audio message with the second audio message to obtain the target audio message includes: converting the mixed audio message into a target electrical signal using an analog-to-digital converter, and converting the target electrical signal into a target audio signal using a speaker to obtain the target audio message.
14. A noise cancellation device, characterized in that it comprises: The original sound source information acquisition module is used to acquire the original sound source information; The noise reduction module is used to perform noise reduction processing on the original sound source information using active noise cancellation (ANC) to obtain the first sound information. Simultaneously, the original sound source information is processed by environmental noise cancellation (ENC) to reduce noise and obtain the second sound information. The noise reduction processing module includes: an inverted wave signal determination unit, used to perform noise phase inversion processing on the original sound source message through a phase inverter to obtain an inverted wave signal; a first sound message determination unit, used to perform noise cancellation on the original sound source message according to the inverted wave signal to obtain a first sound message; a sound playback module, used to mix and add the first sound message and the second sound message to obtain a target sound message, and play the target sound message; and an original sound source message filtering module, used to perform low-pass filtering on the original sound source message before performing noise phase inversion processing on the original sound source message through a phase inverter to obtain an inverted wave signal, to obtain the original sound source message of the first target frequency band; the original sound source message filtering module includes: an original sound source message filtering unit, used to perform low-pass filtering on the original sound source message through a double second-order filter to obtain the original sound source message of the first target frequency band.
15. An electronic device, characterized in that the electronic device comprises: At least one processor; And a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the noise cancellation method as described in any one of claims 1 to 13.
16. A noise-canceling headset, characterized in that the noise-canceling headset comprises: A microphone, a noise reduction processor, and a speaker; wherein: the microphone is used to acquire original sound source information; the noise reduction processor is used to perform noise reduction processing on the original sound source information using the method described in any one of claims 1 to 11 to obtain target sound information; and the speaker is used to play the target sound information using the method described in any one of claims 1 to 13.
17. A noise-canceling headset, characterized in that the noise-canceling headset comprises: The system comprises a first microphone, a second microphone, a noise reduction processor, and a speaker; wherein: the first microphone is used to acquire a first sound source message; the second microphone is used to acquire a second sound source message; the noise reduction processor is used to perform active noise cancellation (ANC) noise reduction processing on the first sound source message based on the second sound source message to obtain a third sound message; the noise reduction processor is also used to use the first sound source message as the original sound source message and perform environmental noise cancellation (ENC) noise reduction processing using the method described in any one of claims 1, 4 to 11 to obtain a second sound message; the noise reduction processor is also used to mix and add the third sound message with the second sound message to obtain a target sound message; and the speaker is used to play the target sound message using the method described in claim 1 or 13.
18. A computer-readable storage medium, characterized in that the computer-readable storage medium stores computer instructions for causing a processor to execute and implement the noise cancellation method as described in any one of claims 1 to 13.
Citation Information
Patent Citations
Earphone and noise reduction method
CN112399301A
Calibration and stabilization of an active noise cancelation system
TW201719636A
Calibration and stabilization of an active noise cancelation system
TW202209305A
Audio processing sytem signal-level based temporal masking
US20220284877A1
